May 28 01:49:06.222365 np0000001583 systemd[1]: Started devstack@n-cpu.service - Devstack devstack@n-cpu.service.
May 28 01:49:07.914723 np0000001583 nova-compute[98241]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=98241) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:54}}
May 28 01:49:07.915637 np0000001583 nova-compute[98241]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=98241) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:54}}
May 28 01:49:07.915637 np0000001583 nova-compute[98241]: INFO os_vif [-] Loaded VIF plugins: noop, ovs
May 28 01:49:08.036266 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:49:08.047513 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.011s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:49:08.193237 np0000001583 nova-compute[98241]: INFO oslo_service.periodic_task [-] Skipping periodic task _heal_instance_info_cache because its interval is negative
May 28 01:49:08.928422 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] In native threading mode the number of concurrent builds, and snapshots should be limited to the same number. The current configuration has differing limits: max_concurrent_builds: 10, max_concurrent_snapshots: 5. Nova will use a single, overall limit of 10 for these tasks.
May 28 01:49:08.928801 np0000001583 nova-compute[98241]: INFO nova.utils [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] The long task thread pool MainProcess.long_task is initialized
May 28 01:49:08.928942 np0000001583 nova-compute[98241]: INFO nova.virt.driver [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Loading compute driver 'libvirt.LibvirtDriver'
May 28 01:49:09.021159 np0000001583 nova-compute[98241]: INFO nova.compute.provider_config [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
May 28 01:49:09.523362 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Acquiring lock "singleton_lock" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:49:09.523467 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Acquired lock "singleton_lock" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:49:09.523638 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Releasing lock "singleton_lock" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:49:09.523807 np0000001583 nova-compute[98241]: WARNING oslo_service.backend._threading.service [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] no_fork=True: running service in main process
May 28 01:49:09.524062 np0000001583 nova-compute[98241]: INFO nova.service [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Starting compute node (version 33.1.0)
May 28 01:49:10.026759 np0000001583 nova-compute[98241]: INFO nova.utils [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] The default thread pool MainProcess.default is initialized
May 28 01:49:10.027385 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:49:10.027629 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Starting event thread {{(pid=98241) start /opt/stack/nova/nova/virt/libvirt/host.py:252}}
May 28 01:49:10.028304 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Starting connection event dispatch thread {{(pid=98241) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:553}}
May 28 01:49:10.028978 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Connecting to libvirt: qemu:///system {{(pid=98241) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:558}}
May 28 01:49:10.656493 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x77250229eea0> {{(pid=98241) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:564}}
May 28 01:49:10.656493 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x77250229eea0> {{(pid=98241) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:585}}
May 28 01:49:10.656579 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Connection event '1' reason 'None'
May 28 01:49:11.159118 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Cannot update service status on host "np0000001583" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host np0000001583 could not be found.
May 28 01:49:11.159803 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.mount [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Initialising _HostMountState generation 0 {{(pid=98241) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
May 28 01:49:21.345287 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Libvirt host capabilities <capabilities>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:   <host>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:     <uuid>0fbeada7-265e-4536-bdd8-74ffd44032fb</uuid>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:     <cpu>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:       <arch>x86_64</arch>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:       <model>EPYC-Milan</model>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:       <vendor>AMD</vendor>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:       <microcode version='16777317'/>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:       <signature family='25' model='1' stepping='1'/>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:       <topology sockets='12' dies='1' cores='1' threads='1'/>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:       <maxphysaddr mode='emulate' bits='40'/>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:       <feature name='x2apic'/>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:       <feature name='tsc-deadline'/>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:       <feature name='osxsave'/>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:       <feature name='hypervisor'/>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:       <feature name='tsc_adjust'/>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:       <feature name='ospke'/>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:       <feature name='vaes'/>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:       <feature name='vpclmulqdq'/>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:       <feature name='spec-ctrl'/>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:       <feature name='stibp'/>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:       <feature name='arch-capabilities'/>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:       <feature name='ssbd'/>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:       <feature name='cmp_legacy'/>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:       <feature name='topoext'/>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:       <feature name='stibp-always-on'/>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:       <feature name='virt-ssbd'/>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:       <feature name='amd-psfd'/>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:       <feature name='lbrv'/>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:       <feature name='tsc-scale'/>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:       <feature name='vmcb-clean'/>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:       <feature name='flushbyasid'/>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:       <feature name='pause-filter'/>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:       <feature name='pfthreshold'/>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:       <feature name='v-vmsave-vmload'/>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:       <feature name='vgif'/>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:       <feature name='no-nested-data-bp'/>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:       <feature name='lfence-always-serializing'/>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:       <feature name='null-sel-clr-base'/>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:       <feature name='rdctl-no'/>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:       <feature name='skip-l1dfl-vmentry'/>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:       <feature name='mds-no'/>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:       <feature name='pschange-mc-no'/>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:       <feature name='gds-no'/>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:       <pages unit='KiB' size='4'/>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:       <pages unit='KiB' size='2048'/>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:       <pages unit='KiB' size='1048576'/>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:     </cpu>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:     <power_management/>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:     <iommu support='no'/>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:     <migration_features>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:       <live/>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:       <uri_transports>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:         <uri_transport>tcp</uri_transport>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:         <uri_transport>rdma</uri_transport>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:       </uri_transports>
May 28 01:49:21.345287 np0000001583 nova-compute[98241]:     </migration_features>
May 28 01:49:21.347523 np0000001583 nova-compute[98241]:     <topology>
May 28 01:49:21.347523 np0000001583 nova-compute[98241]:       <cells num='1'>
May 28 01:49:21.347523 np0000001583 nova-compute[98241]:         <cell id='0'>
May 28 01:49:21.347523 np0000001583 nova-compute[98241]:           <memory unit='KiB'>24607192</memory>
May 28 01:49:21.347523 np0000001583 nova-compute[98241]:           <pages unit='KiB' size='4'>6151798</pages>
May 28 01:49:21.347523 np0000001583 nova-compute[98241]:           <pages unit='KiB' size='2048'>0</pages>
May 28 01:49:21.347523 np0000001583 nova-compute[98241]:           <pages unit='KiB' size='1048576'>0</pages>
May 28 01:49:21.347523 np0000001583 nova-compute[98241]:           <distances>
May 28 01:49:21.347523 np0000001583 nova-compute[98241]:             <sibling id='0' value='10'/>
May 28 01:49:21.347523 np0000001583 nova-compute[98241]:           </distances>
May 28 01:49:21.347523 np0000001583 nova-compute[98241]:           <cpus num='12'>
May 28 01:49:21.347523 np0000001583 nova-compute[98241]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
May 28 01:49:21.347523 np0000001583 nova-compute[98241]:             <cpu id='1' socket_id='1' die_id='1' core_id='0' siblings='1'/>
May 28 01:49:21.347523 np0000001583 nova-compute[98241]:             <cpu id='2' socket_id='2' die_id='2' core_id='0' siblings='2'/>
May 28 01:49:21.347523 np0000001583 nova-compute[98241]:             <cpu id='3' socket_id='3' die_id='3' core_id='0' siblings='3'/>
May 28 01:49:21.347523 np0000001583 nova-compute[98241]:             <cpu id='4' socket_id='4' die_id='4' core_id='0' siblings='4'/>
May 28 01:49:21.347523 np0000001583 nova-compute[98241]:             <cpu id='5' socket_id='5' die_id='5' core_id='0' siblings='5'/>
May 28 01:49:21.347523 np0000001583 nova-compute[98241]:             <cpu id='6' socket_id='6' die_id='6' core_id='0' siblings='6'/>
May 28 01:49:21.347523 np0000001583 nova-compute[98241]:             <cpu id='7' socket_id='7' die_id='7' core_id='0' siblings='7'/>
May 28 01:49:21.347523 np0000001583 nova-compute[98241]:             <cpu id='8' socket_id='8' die_id='8' core_id='0' siblings='8'/>
May 28 01:49:21.347523 np0000001583 nova-compute[98241]:             <cpu id='9' socket_id='9' die_id='9' core_id='0' siblings='9'/>
May 28 01:49:21.347523 np0000001583 nova-compute[98241]:             <cpu id='10' socket_id='10' die_id='10' core_id='0' siblings='10'/>
May 28 01:49:21.347523 np0000001583 nova-compute[98241]:             <cpu id='11' socket_id='11' die_id='11' core_id='0' siblings='11'/>
May 28 01:49:21.347523 np0000001583 nova-compute[98241]:           </cpus>
May 28 01:49:21.347523 np0000001583 nova-compute[98241]:         </cell>
May 28 01:49:21.347523 np0000001583 nova-compute[98241]:       </cells>
May 28 01:49:21.347523 np0000001583 nova-compute[98241]:     </topology>
May 28 01:49:21.347523 np0000001583 nova-compute[98241]:     <cache>
May 28 01:49:21.347523 np0000001583 nova-compute[98241]:       <bank id='0' level='3' type='both' size='32' unit='MiB' cpus='0'/>
May 28 01:49:21.347523 np0000001583 nova-compute[98241]:       <bank id='1' level='3' type='both' size='32' unit='MiB' cpus='1'/>
May 28 01:49:21.347523 np0000001583 nova-compute[98241]:       <bank id='2' level='3' type='both' size='32' unit='MiB' cpus='2'/>
May 28 01:49:21.347523 np0000001583 nova-compute[98241]:       <bank id='3' level='3' type='both' size='32' unit='MiB' cpus='3'/>
May 28 01:49:21.347523 np0000001583 nova-compute[98241]:       <bank id='4' level='3' type='both' size='32' unit='MiB' cpus='4'/>
May 28 01:49:21.347523 np0000001583 nova-compute[98241]:       <bank id='5' level='3' type='both' size='32' unit='MiB' cpus='5'/>
May 28 01:49:21.347523 np0000001583 nova-compute[98241]:       <bank id='6' level='3' type='both' size='32' unit='MiB' cpus='6'/>
May 28 01:49:21.347523 np0000001583 nova-compute[98241]:       <bank id='7' level='3' type='both' size='32' unit='MiB' cpus='7'/>
May 28 01:49:21.347523 np0000001583 nova-compute[98241]:       <bank id='8' level='3' type='both' size='32' unit='MiB' cpus='8'/>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:       <bank id='9' level='3' type='both' size='32' unit='MiB' cpus='9'/>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:       <bank id='10' level='3' type='both' size='32' unit='MiB' cpus='10'/>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:       <bank id='11' level='3' type='both' size='32' unit='MiB' cpus='11'/>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:     </cache>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:     <secmodel>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:       <model>apparmor</model>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:       <doi>0</doi>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:     </secmodel>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:     <secmodel>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:       <model>dac</model>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:       <doi>0</doi>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:       <baselabel type='kvm'>+64055:+993</baselabel>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:       <baselabel type='qemu'>+64055:+993</baselabel>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:     </secmodel>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:   </host>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:   <guest>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:     <os_type>hvm</os_type>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:     <arch name='alpha'>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:       <wordsize>64</wordsize>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:       <machine maxCpus='4'>clipper</machine>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:       <domain type='qemu'/>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:     </arch>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:     <features>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:       <cpuselection/>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:       <deviceboot/>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:       <disksnapshot default='on' toggle='no'/>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:       <externalSnapshot/>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:     </features>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:   </guest>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:   <guest>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:     <os_type>hvm</os_type>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:     <arch name='armv6l'>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:       <wordsize>32</wordsize>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:       <emulator>/usr/bin/qemu-system-arm</emulator>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:       <machine maxCpus='512'>virt-8.2</machine>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:       <machine canonical='virt-8.2' maxCpus='512'>virt</machine>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>qcom-dc-scm-v1-bmc</machine>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>mori-bmc</machine>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>ast2600-evb</machine>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>borzoi</machine>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>tiogapass-bmc</machine>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>spitz</machine>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>virt-2.7</machine>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>nuri</machine>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>romulus-bmc</machine>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:       <machine maxCpus='512'>virt-3.0</machine>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:       <machine maxCpus='512'>virt-5.0</machine>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>npcm750-evb</machine>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>virt-2.10</machine>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>rainier-bmc</machine>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>mps3-an547</machine>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>musca-b1</machine>
May 28 01:49:21.348656 np0000001583 nova-compute[98241]:       <machine maxCpus='4'>realview-pbx-a9</machine>
May 28 01:49:21.350137 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>versatileab</machine>
May 28 01:49:21.350137 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>kzm</machine>
May 28 01:49:21.350137 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>virt-2.8</machine>
May 28 01:49:21.350137 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>fby35-bmc</machine>
May 28 01:49:21.350137 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>musca-a</machine>
May 28 01:49:21.350137 np0000001583 nova-compute[98241]:       <machine maxCpus='512'>virt-3.1</machine>
May 28 01:49:21.350137 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
May 28 01:49:21.350137 np0000001583 nova-compute[98241]:       <machine maxCpus='512'>virt-5.1</machine>
May 28 01:49:21.350137 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>smdkc210</machine>
May 28 01:49:21.350137 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>sx1</machine>
May 28 01:49:21.350137 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>virt-2.11</machine>
May 28 01:49:21.350137 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>imx25-pdk</machine>
May 28 01:49:21.350137 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>stm32vldiscovery</machine>
May 28 01:49:21.350137 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>virt-2.9</machine>
May 28 01:49:21.350137 np0000001583 nova-compute[98241]:       <machine maxCpus='4'>orangepi-pc</machine>
May 28 01:49:21.350137 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
May 28 01:49:21.350137 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>z2</machine>
May 28 01:49:21.350137 np0000001583 nova-compute[98241]:       <machine maxCpus='512'>virt-5.2</machine>
May 28 01:49:21.350137 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
May 28 01:49:21.350137 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>tosa</machine>
May 28 01:49:21.350137 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>mps2-an500</machine>
May 28 01:49:21.350137 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>virt-2.12</machine>
May 28 01:49:21.350137 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>mps2-an521</machine>
May 28 01:49:21.350137 np0000001583 nova-compute[98241]:       <machine maxCpus='4'>sabrelite</machine>
May 28 01:49:21.350137 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>mps2-an511</machine>
May 28 01:49:21.350137 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>canon-a1100</machine>
May 28 01:49:21.350137 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>realview-eb</machine>
May 28 01:49:21.350137 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
May 28 01:49:21.350137 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>emcraft-sf2</machine>
May 28 01:49:21.350137 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>realview-pb-a8</machine>
May 28 01:49:21.350137 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>yosemitev2-bmc</machine>
May 28 01:49:21.350137 np0000001583 nova-compute[98241]:       <machine maxCpus='512'>virt-7.0</machine>
May 28 01:49:21.350137 np0000001583 nova-compute[98241]:       <machine maxCpus='512'>virt-4.0</machine>
May 28 01:49:21.350137 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>raspi1ap</machine>
May 28 01:49:21.350137 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>palmetto-bmc</machine>
May 28 01:49:21.350137 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>sx1-v1</machine>
May 28 01:49:21.350137 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>n810</machine>
May 28 01:49:21.350137 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>g220a-bmc</machine>
May 28 01:49:21.350137 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>n800</machine>
May 28 01:49:21.350137 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>bletchley-bmc</machine>
May 28 01:49:21.350137 np0000001583 nova-compute[98241]:       <machine maxCpus='512'>virt-7.1</machine>
May 28 01:49:21.350137 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>tacoma-bmc</machine>
May 28 01:49:21.350137 np0000001583 nova-compute[98241]:       <machine maxCpus='512'>virt-4.1</machine>
May 28 01:49:21.350930 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>quanta-gsj</machine>
May 28 01:49:21.350930 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>versatilepb</machine>
May 28 01:49:21.350930 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>terrier</machine>
May 28 01:49:21.350930 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>mainstone</machine>
May 28 01:49:21.350930 np0000001583 nova-compute[98241]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
May 28 01:49:21.350930 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>integratorcp</machine>
May 28 01:49:21.350930 np0000001583 nova-compute[98241]:       <machine maxCpus='512'>virt-7.2</machine>
May 28 01:49:21.350930 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
May 28 01:49:21.350930 np0000001583 nova-compute[98241]:       <machine maxCpus='512'>virt-4.2</machine>
May 28 01:49:21.350930 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>witherspoon-bmc</machine>
May 28 01:49:21.350930 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>qcom-firework-bmc</machine>
May 28 01:49:21.350930 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>mps3-an524</machine>
May 28 01:49:21.350930 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>kudo-bmc</machine>
May 28 01:49:21.350930 np0000001583 nova-compute[98241]:       <machine maxCpus='4'>vexpress-a9</machine>
May 28 01:49:21.350930 np0000001583 nova-compute[98241]:       <machine maxCpus='4'>midway</machine>
May 28 01:49:21.350930 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>musicpal</machine>
May 28 01:49:21.350930 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>lm3s811evb</machine>
May 28 01:49:21.350930 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>lm3s6965evb</machine>
May 28 01:49:21.350930 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>supermicro-x11spi-bmc</machine>
May 28 01:49:21.350930 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>microbit</machine>
May 28 01:49:21.350930 np0000001583 nova-compute[98241]:       <machine maxCpus='3'>fby35</machine>
May 28 01:49:21.350930 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>mps2-an505</machine>
May 28 01:49:21.350930 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>mps2-an385</machine>
May 28 01:49:21.350930 np0000001583 nova-compute[98241]:       <machine maxCpus='512'>virt-6.0</machine>
May 28 01:49:21.350930 np0000001583 nova-compute[98241]:       <machine maxCpus='512'>virt-8.0</machine>
May 28 01:49:21.350930 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>cubieboard</machine>
May 28 01:49:21.350930 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>ast1030-evb</machine>
May 28 01:49:21.350930 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>verdex</machine>
May 28 01:49:21.350930 np0000001583 nova-compute[98241]:       <machine maxCpus='4'>bpim2u</machine>
May 28 01:49:21.350930 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>netduino2</machine>
May 28 01:49:21.350930 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>mps2-an386</machine>
May 28 01:49:21.350930 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>olimex-stm32-h405</machine>
May 28 01:49:21.350930 np0000001583 nova-compute[98241]:       <machine maxCpus='512'>virt-6.1</machine>
May 28 01:49:21.350930 np0000001583 nova-compute[98241]:       <machine maxCpus='512'>virt-8.1</machine>
May 28 01:49:21.350930 np0000001583 nova-compute[98241]:       <machine maxCpus='4'>raspi2b</machine>
May 28 01:49:21.350930 np0000001583 nova-compute[98241]:       <machine maxCpus='4'>vexpress-a15</machine>
May 28 01:49:21.350930 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>fuji-bmc</machine>
May 28 01:49:21.350930 np0000001583 nova-compute[98241]:       <machine maxCpus='512'>virt-6.2</machine>
May 28 01:49:21.350930 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>sonorapass-bmc</machine>
May 28 01:49:21.350930 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>cheetah</machine>
May 28 01:49:21.350930 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>virt-2.6</machine>
May 28 01:49:21.350930 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>ast2500-evb</machine>
May 28 01:49:21.351691 np0000001583 nova-compute[98241]:       <machine maxCpus='4'>highbank</machine>
May 28 01:49:21.351691 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>akita</machine>
May 28 01:49:21.351691 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>connex</machine>
May 28 01:49:21.351691 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>netduinoplus2</machine>
May 28 01:49:21.351691 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>collie</machine>
May 28 01:49:21.351691 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>raspi0</machine>
May 28 01:49:21.351691 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
May 28 01:49:21.351691 np0000001583 nova-compute[98241]:       <domain type='qemu'/>
May 28 01:49:21.351691 np0000001583 nova-compute[98241]:     </arch>
May 28 01:49:21.351691 np0000001583 nova-compute[98241]:     <features>
May 28 01:49:21.351691 np0000001583 nova-compute[98241]:       <cpuselection/>
May 28 01:49:21.351691 np0000001583 nova-compute[98241]:       <deviceboot/>
May 28 01:49:21.351691 np0000001583 nova-compute[98241]:       <disksnapshot default='on' toggle='no'/>
May 28 01:49:21.351691 np0000001583 nova-compute[98241]:       <externalSnapshot/>
May 28 01:49:21.351691 np0000001583 nova-compute[98241]:     </features>
May 28 01:49:21.351691 np0000001583 nova-compute[98241]:   </guest>
May 28 01:49:21.351691 np0000001583 nova-compute[98241]:   <guest>
May 28 01:49:21.351691 np0000001583 nova-compute[98241]:     <os_type>hvm</os_type>
May 28 01:49:21.351691 np0000001583 nova-compute[98241]:     <arch name='armv7l'>
May 28 01:49:21.351691 np0000001583 nova-compute[98241]:       <wordsize>32</wordsize>
May 28 01:49:21.351691 np0000001583 nova-compute[98241]:       <emulator>/usr/bin/qemu-system-arm</emulator>
May 28 01:49:21.351691 np0000001583 nova-compute[98241]:       <machine maxCpus='512'>virt-8.2</machine>
May 28 01:49:21.351691 np0000001583 nova-compute[98241]:       <machine canonical='virt-8.2' maxCpus='512'>virt</machine>
May 28 01:49:21.351691 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>qcom-dc-scm-v1-bmc</machine>
May 28 01:49:21.351691 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>mori-bmc</machine>
May 28 01:49:21.351691 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>ast2600-evb</machine>
May 28 01:49:21.351691 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>borzoi</machine>
May 28 01:49:21.351691 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>tiogapass-bmc</machine>
May 28 01:49:21.351691 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>spitz</machine>
May 28 01:49:21.351691 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>virt-2.7</machine>
May 28 01:49:21.351691 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>nuri</machine>
May 28 01:49:21.351691 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
May 28 01:49:21.351691 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>romulus-bmc</machine>
May 28 01:49:21.351691 np0000001583 nova-compute[98241]:       <machine maxCpus='512'>virt-3.0</machine>
May 28 01:49:21.351691 np0000001583 nova-compute[98241]:       <machine maxCpus='512'>virt-5.0</machine>
May 28 01:49:21.351691 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>npcm750-evb</machine>
May 28 01:49:21.351691 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>virt-2.10</machine>
May 28 01:49:21.351691 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>rainier-bmc</machine>
May 28 01:49:21.351691 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>mps3-an547</machine>
May 28 01:49:21.351691 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>musca-b1</machine>
May 28 01:49:21.351691 np0000001583 nova-compute[98241]:       <machine maxCpus='4'>realview-pbx-a9</machine>
May 28 01:49:21.351691 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>versatileab</machine>
May 28 01:49:21.351691 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>kzm</machine>
May 28 01:49:21.351691 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>virt-2.8</machine>
May 28 01:49:21.351691 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>fby35-bmc</machine>
May 28 01:49:21.351691 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>musca-a</machine>
May 28 01:49:21.351691 np0000001583 nova-compute[98241]:       <machine maxCpus='512'>virt-3.1</machine>
May 28 01:49:21.351691 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
May 28 01:49:21.351691 np0000001583 nova-compute[98241]:       <machine maxCpus='512'>virt-5.1</machine>
May 28 01:49:21.353361 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>smdkc210</machine>
May 28 01:49:21.353361 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>sx1</machine>
May 28 01:49:21.353361 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>virt-2.11</machine>
May 28 01:49:21.353361 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>imx25-pdk</machine>
May 28 01:49:21.353361 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>stm32vldiscovery</machine>
May 28 01:49:21.353361 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>virt-2.9</machine>
May 28 01:49:21.353361 np0000001583 nova-compute[98241]:       <machine maxCpus='4'>orangepi-pc</machine>
May 28 01:49:21.353361 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
May 28 01:49:21.353361 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>z2</machine>
May 28 01:49:21.353361 np0000001583 nova-compute[98241]:       <machine maxCpus='512'>virt-5.2</machine>
May 28 01:49:21.353361 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
May 28 01:49:21.353361 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>tosa</machine>
May 28 01:49:21.353361 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>mps2-an500</machine>
May 28 01:49:21.353361 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>virt-2.12</machine>
May 28 01:49:21.353361 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>mps2-an521</machine>
May 28 01:49:21.353361 np0000001583 nova-compute[98241]:       <machine maxCpus='4'>sabrelite</machine>
May 28 01:49:21.353361 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>mps2-an511</machine>
May 28 01:49:21.353361 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>canon-a1100</machine>
May 28 01:49:21.353361 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>realview-eb</machine>
May 28 01:49:21.353361 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
May 28 01:49:21.353361 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>emcraft-sf2</machine>
May 28 01:49:21.353361 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>realview-pb-a8</machine>
May 28 01:49:21.353361 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>yosemitev2-bmc</machine>
May 28 01:49:21.353361 np0000001583 nova-compute[98241]:       <machine maxCpus='512'>virt-7.0</machine>
May 28 01:49:21.353361 np0000001583 nova-compute[98241]:       <machine maxCpus='512'>virt-4.0</machine>
May 28 01:49:21.353361 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>raspi1ap</machine>
May 28 01:49:21.353361 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>palmetto-bmc</machine>
May 28 01:49:21.353361 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>sx1-v1</machine>
May 28 01:49:21.353361 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>n810</machine>
May 28 01:49:21.353361 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>g220a-bmc</machine>
May 28 01:49:21.353361 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>n800</machine>
May 28 01:49:21.353361 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>bletchley-bmc</machine>
May 28 01:49:21.353361 np0000001583 nova-compute[98241]:       <machine maxCpus='512'>virt-7.1</machine>
May 28 01:49:21.353361 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>tacoma-bmc</machine>
May 28 01:49:21.353361 np0000001583 nova-compute[98241]:       <machine maxCpus='512'>virt-4.1</machine>
May 28 01:49:21.353361 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>quanta-gsj</machine>
May 28 01:49:21.353361 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>versatilepb</machine>
May 28 01:49:21.353361 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>terrier</machine>
May 28 01:49:21.353361 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>mainstone</machine>
May 28 01:49:21.353361 np0000001583 nova-compute[98241]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
May 28 01:49:21.353361 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>integratorcp</machine>
May 28 01:49:21.353361 np0000001583 nova-compute[98241]:       <machine maxCpus='512'>virt-7.2</machine>
May 28 01:49:21.354465 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
May 28 01:49:21.354465 np0000001583 nova-compute[98241]:       <machine maxCpus='512'>virt-4.2</machine>
May 28 01:49:21.354465 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>witherspoon-bmc</machine>
May 28 01:49:21.354465 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>qcom-firework-bmc</machine>
May 28 01:49:21.354465 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>mps3-an524</machine>
May 28 01:49:21.354465 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>kudo-bmc</machine>
May 28 01:49:21.354465 np0000001583 nova-compute[98241]:       <machine maxCpus='4'>vexpress-a9</machine>
May 28 01:49:21.354465 np0000001583 nova-compute[98241]:       <machine maxCpus='4'>midway</machine>
May 28 01:49:21.354465 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>musicpal</machine>
May 28 01:49:21.354465 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>lm3s811evb</machine>
May 28 01:49:21.354465 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>lm3s6965evb</machine>
May 28 01:49:21.354465 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>supermicro-x11spi-bmc</machine>
May 28 01:49:21.354465 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>microbit</machine>
May 28 01:49:21.354465 np0000001583 nova-compute[98241]:       <machine maxCpus='3'>fby35</machine>
May 28 01:49:21.354465 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>mps2-an505</machine>
May 28 01:49:21.354465 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>mps2-an385</machine>
May 28 01:49:21.354465 np0000001583 nova-compute[98241]:       <machine maxCpus='512'>virt-6.0</machine>
May 28 01:49:21.354465 np0000001583 nova-compute[98241]:       <machine maxCpus='512'>virt-8.0</machine>
May 28 01:49:21.354465 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>cubieboard</machine>
May 28 01:49:21.354465 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>ast1030-evb</machine>
May 28 01:49:21.354465 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>verdex</machine>
May 28 01:49:21.354465 np0000001583 nova-compute[98241]:       <machine maxCpus='4'>bpim2u</machine>
May 28 01:49:21.354465 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>netduino2</machine>
May 28 01:49:21.354465 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>mps2-an386</machine>
May 28 01:49:21.354465 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>olimex-stm32-h405</machine>
May 28 01:49:21.354465 np0000001583 nova-compute[98241]:       <machine maxCpus='512'>virt-6.1</machine>
May 28 01:49:21.354465 np0000001583 nova-compute[98241]:       <machine maxCpus='512'>virt-8.1</machine>
May 28 01:49:21.354465 np0000001583 nova-compute[98241]:       <machine maxCpus='4'>raspi2b</machine>
May 28 01:49:21.354465 np0000001583 nova-compute[98241]:       <machine maxCpus='4'>vexpress-a15</machine>
May 28 01:49:21.354465 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>fuji-bmc</machine>
May 28 01:49:21.354465 np0000001583 nova-compute[98241]:       <machine maxCpus='512'>virt-6.2</machine>
May 28 01:49:21.354465 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>sonorapass-bmc</machine>
May 28 01:49:21.354465 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>cheetah</machine>
May 28 01:49:21.354465 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>virt-2.6</machine>
May 28 01:49:21.354465 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>ast2500-evb</machine>
May 28 01:49:21.354465 np0000001583 nova-compute[98241]:       <machine maxCpus='4'>highbank</machine>
May 28 01:49:21.354465 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>akita</machine>
May 28 01:49:21.354465 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>connex</machine>
May 28 01:49:21.354465 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>netduinoplus2</machine>
May 28 01:49:21.354465 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>collie</machine>
May 28 01:49:21.354465 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>raspi0</machine>
May 28 01:49:21.354465 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
May 28 01:49:21.354465 np0000001583 nova-compute[98241]:       <domain type='qemu'/>
May 28 01:49:21.355244 np0000001583 nova-compute[98241]:     </arch>
May 28 01:49:21.355244 np0000001583 nova-compute[98241]:     <features>
May 28 01:49:21.355244 np0000001583 nova-compute[98241]:       <cpuselection/>
May 28 01:49:21.355244 np0000001583 nova-compute[98241]:       <deviceboot/>
May 28 01:49:21.355244 np0000001583 nova-compute[98241]:       <disksnapshot default='on' toggle='no'/>
May 28 01:49:21.355244 np0000001583 nova-compute[98241]:       <externalSnapshot/>
May 28 01:49:21.355244 np0000001583 nova-compute[98241]:     </features>
May 28 01:49:21.355244 np0000001583 nova-compute[98241]:   </guest>
May 28 01:49:21.355244 np0000001583 nova-compute[98241]:   <guest>
May 28 01:49:21.355244 np0000001583 nova-compute[98241]:     <os_type>hvm</os_type>
May 28 01:49:21.355244 np0000001583 nova-compute[98241]:     <arch name='aarch64'>
May 28 01:49:21.355244 np0000001583 nova-compute[98241]:       <wordsize>64</wordsize>
May 28 01:49:21.355244 np0000001583 nova-compute[98241]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
May 28 01:49:21.355244 np0000001583 nova-compute[98241]:       <machine maxCpus='512'>virt-8.2</machine>
May 28 01:49:21.355244 np0000001583 nova-compute[98241]:       <machine canonical='virt-8.2' maxCpus='512'>virt</machine>
May 28 01:49:21.355244 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>qcom-dc-scm-v1-bmc</machine>
May 28 01:49:21.355244 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>mori-bmc</machine>
May 28 01:49:21.355244 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>ast2600-evb</machine>
May 28 01:49:21.355244 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>borzoi</machine>
May 28 01:49:21.355244 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>tiogapass-bmc</machine>
May 28 01:49:21.355244 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>spitz</machine>
May 28 01:49:21.355244 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>virt-2.7</machine>
May 28 01:49:21.355244 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>nuri</machine>
May 28 01:49:21.355244 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
May 28 01:49:21.355244 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>romulus-bmc</machine>
May 28 01:49:21.355244 np0000001583 nova-compute[98241]:       <machine maxCpus='512'>virt-3.0</machine>
May 28 01:49:21.355244 np0000001583 nova-compute[98241]:       <machine maxCpus='512'>virt-5.0</machine>
May 28 01:49:21.355244 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>npcm750-evb</machine>
May 28 01:49:21.355244 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>virt-2.10</machine>
May 28 01:49:21.355244 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>rainier-bmc</machine>
May 28 01:49:21.355244 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>mps3-an547</machine>
May 28 01:49:21.355244 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>virt-2.8</machine>
May 28 01:49:21.355244 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>musca-b1</machine>
May 28 01:49:21.355244 np0000001583 nova-compute[98241]:       <machine maxCpus='4'>realview-pbx-a9</machine>
May 28 01:49:21.355244 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>versatileab</machine>
May 28 01:49:21.355244 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>kzm</machine>
May 28 01:49:21.355244 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>fby35-bmc</machine>
May 28 01:49:21.355244 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>musca-a</machine>
May 28 01:49:21.355244 np0000001583 nova-compute[98241]:       <machine maxCpus='512'>virt-3.1</machine>
May 28 01:49:21.355244 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
May 28 01:49:21.355244 np0000001583 nova-compute[98241]:       <machine maxCpus='512'>virt-5.1</machine>
May 28 01:49:21.355244 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>smdkc210</machine>
May 28 01:49:21.355244 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>sx1</machine>
May 28 01:49:21.355244 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>virt-2.11</machine>
May 28 01:49:21.355244 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>imx25-pdk</machine>
May 28 01:49:21.355244 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>stm32vldiscovery</machine>
May 28 01:49:21.355244 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>virt-2.9</machine>
May 28 01:49:21.355244 np0000001583 nova-compute[98241]:       <machine maxCpus='4'>orangepi-pc</machine>
May 28 01:49:21.355957 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
May 28 01:49:21.355957 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>z2</machine>
May 28 01:49:21.355957 np0000001583 nova-compute[98241]:       <machine maxCpus='512'>virt-5.2</machine>
May 28 01:49:21.355957 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
May 28 01:49:21.355957 np0000001583 nova-compute[98241]:       <machine maxCpus='6'>xlnx-zcu102</machine>
May 28 01:49:21.355957 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>tosa</machine>
May 28 01:49:21.355957 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>mps2-an500</machine>
May 28 01:49:21.355957 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>virt-2.12</machine>
May 28 01:49:21.355957 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>mps2-an521</machine>
May 28 01:49:21.355957 np0000001583 nova-compute[98241]:       <machine maxCpus='4'>sabrelite</machine>
May 28 01:49:21.355957 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>mps2-an511</machine>
May 28 01:49:21.355957 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>canon-a1100</machine>
May 28 01:49:21.355957 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>realview-eb</machine>
May 28 01:49:21.355957 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
May 28 01:49:21.355957 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>emcraft-sf2</machine>
May 28 01:49:21.355957 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>realview-pb-a8</machine>
May 28 01:49:21.355957 np0000001583 nova-compute[98241]:       <machine maxCpus='512'>sbsa-ref</machine>
May 28 01:49:21.355957 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>yosemitev2-bmc</machine>
May 28 01:49:21.355957 np0000001583 nova-compute[98241]:       <machine maxCpus='512'>virt-7.0</machine>
May 28 01:49:21.355957 np0000001583 nova-compute[98241]:       <machine maxCpus='512'>virt-4.0</machine>
May 28 01:49:21.355957 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>raspi1ap</machine>
May 28 01:49:21.355957 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>palmetto-bmc</machine>
May 28 01:49:21.355957 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>sx1-v1</machine>
May 28 01:49:21.355957 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>n810</machine>
May 28 01:49:21.355957 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>g220a-bmc</machine>
May 28 01:49:21.355957 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>n800</machine>
May 28 01:49:21.355957 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>bletchley-bmc</machine>
May 28 01:49:21.355957 np0000001583 nova-compute[98241]:       <machine maxCpus='512'>virt-7.1</machine>
May 28 01:49:21.355957 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>tacoma-bmc</machine>
May 28 01:49:21.355957 np0000001583 nova-compute[98241]:       <machine maxCpus='512'>virt-4.1</machine>
May 28 01:49:21.355957 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>quanta-gsj</machine>
May 28 01:49:21.355957 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>versatilepb</machine>
May 28 01:49:21.355957 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>terrier</machine>
May 28 01:49:21.355957 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>mainstone</machine>
May 28 01:49:21.355957 np0000001583 nova-compute[98241]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
May 28 01:49:21.355957 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>integratorcp</machine>
May 28 01:49:21.355957 np0000001583 nova-compute[98241]:       <machine maxCpus='512'>virt-7.2</machine>
May 28 01:49:21.355957 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
May 28 01:49:21.355957 np0000001583 nova-compute[98241]:       <machine maxCpus='512'>virt-4.2</machine>
May 28 01:49:21.355957 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>witherspoon-bmc</machine>
May 28 01:49:21.355957 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>qcom-firework-bmc</machine>
May 28 01:49:21.355957 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>mps3-an524</machine>
May 28 01:49:21.356733 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>kudo-bmc</machine>
May 28 01:49:21.356733 np0000001583 nova-compute[98241]:       <machine maxCpus='4'>vexpress-a9</machine>
May 28 01:49:21.356733 np0000001583 nova-compute[98241]:       <machine maxCpus='4'>midway</machine>
May 28 01:49:21.356733 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>musicpal</machine>
May 28 01:49:21.356733 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>lm3s811evb</machine>
May 28 01:49:21.356733 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>lm3s6965evb</machine>
May 28 01:49:21.356733 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>supermicro-x11spi-bmc</machine>
May 28 01:49:21.356733 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>microbit</machine>
May 28 01:49:21.356733 np0000001583 nova-compute[98241]:       <machine maxCpus='3'>fby35</machine>
May 28 01:49:21.356733 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>mps2-an505</machine>
May 28 01:49:21.356733 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>mps2-an385</machine>
May 28 01:49:21.356733 np0000001583 nova-compute[98241]:       <machine maxCpus='512'>virt-6.0</machine>
May 28 01:49:21.356733 np0000001583 nova-compute[98241]:       <machine maxCpus='512'>virt-8.0</machine>
May 28 01:49:21.356733 np0000001583 nova-compute[98241]:       <machine maxCpus='4'>raspi3ap</machine>
May 28 01:49:21.356733 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>cubieboard</machine>
May 28 01:49:21.356733 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>ast1030-evb</machine>
May 28 01:49:21.356733 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>verdex</machine>
May 28 01:49:21.356733 np0000001583 nova-compute[98241]:       <machine maxCpus='4'>bpim2u</machine>
May 28 01:49:21.356733 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>netduino2</machine>
May 28 01:49:21.356733 np0000001583 nova-compute[98241]:       <machine maxCpus='4'>xlnx-versal-virt</machine>
May 28 01:49:21.356733 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>mps2-an386</machine>
May 28 01:49:21.356733 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>olimex-stm32-h405</machine>
May 28 01:49:21.356733 np0000001583 nova-compute[98241]:       <machine maxCpus='512'>virt-6.1</machine>
May 28 01:49:21.356733 np0000001583 nova-compute[98241]:       <machine maxCpus='512'>virt-8.1</machine>
May 28 01:49:21.356733 np0000001583 nova-compute[98241]:       <machine maxCpus='4'>raspi3b</machine>
May 28 01:49:21.356733 np0000001583 nova-compute[98241]:       <machine maxCpus='4'>raspi2b</machine>
May 28 01:49:21.356733 np0000001583 nova-compute[98241]:       <machine maxCpus='4'>vexpress-a15</machine>
May 28 01:49:21.356733 np0000001583 nova-compute[98241]:       <machine maxCpus='2'>fuji-bmc</machine>
May 28 01:49:21.356733 np0000001583 nova-compute[98241]:       <machine maxCpus='512'>virt-6.2</machine>
May 28 01:49:21.356733 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>sonorapass-bmc</machine>
May 28 01:49:21.356733 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>cheetah</machine>
May 28 01:49:21.356733 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>virt-2.6</machine>
May 28 01:49:21.356733 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>ast2500-evb</machine>
May 28 01:49:21.356733 np0000001583 nova-compute[98241]:       <machine maxCpus='4'>highbank</machine>
May 28 01:49:21.356733 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>akita</machine>
May 28 01:49:21.356733 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>connex</machine>
May 28 01:49:21.356733 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>netduinoplus2</machine>
May 28 01:49:21.356733 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>collie</machine>
May 28 01:49:21.356733 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>raspi0</machine>
May 28 01:49:21.356733 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
May 28 01:49:21.356733 np0000001583 nova-compute[98241]:       <domain type='qemu'/>
May 28 01:49:21.356733 np0000001583 nova-compute[98241]:     </arch>
May 28 01:49:21.356733 np0000001583 nova-compute[98241]:     <features>
May 28 01:49:21.356733 np0000001583 nova-compute[98241]:       <acpi default='on' toggle='yes'/>
May 28 01:49:21.356733 np0000001583 nova-compute[98241]:       <cpuselection/>
May 28 01:49:21.356733 np0000001583 nova-compute[98241]:       <deviceboot/>
May 28 01:49:21.357445 np0000001583 nova-compute[98241]:       <disksnapshot default='on' toggle='no'/>
May 28 01:49:21.357445 np0000001583 nova-compute[98241]:       <externalSnapshot/>
May 28 01:49:21.357445 np0000001583 nova-compute[98241]:     </features>
May 28 01:49:21.357445 np0000001583 nova-compute[98241]:   </guest>
May 28 01:49:21.357445 np0000001583 nova-compute[98241]:   <guest>
May 28 01:49:21.357445 np0000001583 nova-compute[98241]:     <os_type>hvm</os_type>
May 28 01:49:21.357445 np0000001583 nova-compute[98241]:     <arch name='cris'>
May 28 01:49:21.357445 np0000001583 nova-compute[98241]:       <wordsize>32</wordsize>
May 28 01:49:21.357445 np0000001583 nova-compute[98241]:       <emulator>/usr/bin/qemu-system-cris</emulator>
May 28 01:49:21.357445 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>axis-dev88</machine>
May 28 01:49:21.357445 np0000001583 nova-compute[98241]:       <domain type='qemu'/>
May 28 01:49:21.357445 np0000001583 nova-compute[98241]:     </arch>
May 28 01:49:21.357445 np0000001583 nova-compute[98241]:     <features>
May 28 01:49:21.357445 np0000001583 nova-compute[98241]:       <cpuselection/>
May 28 01:49:21.357445 np0000001583 nova-compute[98241]:       <deviceboot/>
May 28 01:49:21.357445 np0000001583 nova-compute[98241]:       <disksnapshot default='on' toggle='no'/>
May 28 01:49:21.357445 np0000001583 nova-compute[98241]:       <externalSnapshot/>
May 28 01:49:21.357445 np0000001583 nova-compute[98241]:     </features>
May 28 01:49:21.357445 np0000001583 nova-compute[98241]:   </guest>
May 28 01:49:21.357445 np0000001583 nova-compute[98241]:   <guest>
May 28 01:49:21.357445 np0000001583 nova-compute[98241]:     <os_type>hvm</os_type>
May 28 01:49:21.357445 np0000001583 nova-compute[98241]:     <arch name='i686'>
May 28 01:49:21.357445 np0000001583 nova-compute[98241]:       <wordsize>32</wordsize>
May 28 01:49:21.357445 np0000001583 nova-compute[98241]:       <emulator>/usr/bin/qemu-system-i386</emulator>
May 28 01:49:21.357445 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-noble-v2</machine>
May 28 01:49:21.357445 np0000001583 nova-compute[98241]:       <machine canonical='pc-i440fx-noble-v2' maxCpus='255'>ubuntu</machine>
May 28 01:49:21.357445 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-mantic</machine>
May 28 01:49:21.357445 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
May 28 01:49:21.357445 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-5.2</machine>
May 28 01:49:21.357445 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-lunar-hpb</machine>
May 28 01:49:21.357445 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-mantic</machine>
May 28 01:49:21.357445 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
May 28 01:49:21.357445 np0000001583 nova-compute[98241]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.0</machine>
May 28 01:49:21.357445 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
May 28 01:49:21.357445 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-kinetic</machine>
May 28 01:49:21.357445 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
May 28 01:49:21.357445 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-4.2</machine>
May 28 01:49:21.357445 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-mantic-maxcpus</machine>
May 28 01:49:21.357445 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
May 28 01:49:21.357445 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
May 28 01:49:21.357445 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
May 28 01:49:21.357445 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
May 28 01:49:21.357445 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-q35-xenial</machine>
May 28 01:49:21.357445 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
May 28 01:49:21.357445 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
May 28 01:49:21.357445 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-q35-2.7</machine>
May 28 01:49:21.357445 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
May 28 01:49:21.357445 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
May 28 01:49:21.357445 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-groovy</machine>
May 28 01:49:21.358213 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
May 28 01:49:21.358213 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-lunar</machine>
May 28 01:49:21.358213 np0000001583 nova-compute[98241]:       <machine maxCpus='1024'>pc-q35-mantic-hpb-maxcpus</machine>
May 28 01:49:21.358213 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
May 28 01:49:21.358213 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-7.1</machine>
May 28 01:49:21.358213 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-artful</machine>
May 28 01:49:21.358213 np0000001583 nova-compute[98241]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-trusty</machine>
May 28 01:49:21.358213 np0000001583 nova-compute[98241]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.2</machine>
May 28 01:49:21.358213 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
May 28 01:49:21.358213 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
May 28 01:49:21.358213 np0000001583 nova-compute[98241]:       <machine maxCpus='1024'>pc-q35-8.1</machine>
May 28 01:49:21.358213 np0000001583 nova-compute[98241]:       <machine maxCpus='1024'>pc-q35-jammy-maxcpus</machine>
May 28 01:49:21.358213 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
May 28 01:49:21.358213 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-mantic-hpb</machine>
May 28 01:49:21.358213 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
May 28 01:49:21.358213 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-8.1</machine>
May 28 01:49:21.358213 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
May 28 01:49:21.358213 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-6.1</machine>
May 28 01:49:21.358213 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-kinetic</machine>
May 28 01:49:21.358213 np0000001583 nova-compute[98241]:       <machine maxCpus='1024'>pc-i440fx-jammy-maxcpus</machine>
May 28 01:49:21.358213 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
May 28 01:49:21.358213 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-q35-2.4</machine>
May 28 01:49:21.358213 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
May 28 01:49:21.358213 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-7.1</machine>
May 28 01:49:21.358213 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-2.10</machine>
May 28 01:49:21.358213 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>x-remote</machine>
May 28 01:49:21.358213 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-5.1</machine>
May 28 01:49:21.358213 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-2.9</machine>
May 28 01:49:21.358213 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
May 28 01:49:21.358213 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb-maxcpus</machine>
May 28 01:49:21.358213 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-3.1</machine>
May 28 01:49:21.358213 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
May 28 01:49:21.358213 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-4.1</machine>
May 28 01:49:21.358213 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-jammy</machine>
May 28 01:49:21.358213 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
May 28 01:49:21.358213 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
May 28 01:49:21.358213 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-eoan</machine>
May 28 01:49:21.358932 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
May 28 01:49:21.358932 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
May 28 01:49:21.358932 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
May 28 01:49:21.358932 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
May 28 01:49:21.358932 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-lunar</machine>
May 28 01:49:21.358932 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>isapc</machine>
May 28 01:49:21.358932 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb</machine>
May 28 01:49:21.358932 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
May 28 01:49:21.358932 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-q35-2.6</machine>
May 28 01:49:21.358932 np0000001583 nova-compute[98241]:       <machine maxCpus='1024'>pc-q35-mantic-maxcpus</machine>
May 28 01:49:21.358932 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
May 28 01:49:21.358932 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-bionic</machine>
May 28 01:49:21.358932 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
May 28 01:49:21.358932 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
May 28 01:49:21.358932 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-2.12</machine>
May 28 01:49:21.358932 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
May 28 01:49:21.358932 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-kinetic-hpb</machine>
May 28 01:49:21.358932 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
May 28 01:49:21.358932 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-7.0</machine>
May 28 01:49:21.358932 np0000001583 nova-compute[98241]:       <machine maxCpus='1024'>pc-q35-noble-v2</machine>
May 28 01:49:21.358932 np0000001583 nova-compute[98241]:       <machine canonical='pc-q35-noble-v2' maxCpus='1024'>ubuntu-q35</machine>
May 28 01:49:21.358932 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-lunar-hpb</machine>
May 28 01:49:21.358932 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-disco</machine>
May 28 01:49:21.358932 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
May 28 01:49:21.358932 np0000001583 nova-compute[98241]:       <machine maxCpus='1024'>pc-q35-noble</machine>
May 28 01:49:21.358932 np0000001583 nova-compute[98241]:       <machine canonical='pc-q35-noble' maxCpus='1024'>q35</machine>
May 28 01:49:21.358932 np0000001583 nova-compute[98241]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.1</machine>
May 28 01:49:21.358932 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-8.0</machine>
May 28 01:49:21.358932 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-impish</machine>
May 28 01:49:21.358932 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
May 28 01:49:21.358932 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-8.0</machine>
May 28 01:49:21.358932 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
May 28 01:49:21.358932 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-6.0</machine>
May 28 01:49:21.358932 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
May 28 01:49:21.358932 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
May 28 01:49:21.358932 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
May 28 01:49:21.359925 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
May 28 01:49:21.359925 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
May 28 01:49:21.359925 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
May 28 01:49:21.359925 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-7.0</machine>
May 28 01:49:21.359925 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-5.0</machine>
May 28 01:49:21.359925 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-2.8</machine>
May 28 01:49:21.359925 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
May 28 01:49:21.359925 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-3.0</machine>
May 28 01:49:21.359925 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
May 28 01:49:21.359925 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-zesty</machine>
May 28 01:49:21.359925 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-7.2</machine>
May 28 01:49:21.359925 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-4.0</machine>
May 28 01:49:21.359925 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-focal</machine>
May 28 01:49:21.359925 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>microvm</machine>
May 28 01:49:21.359925 np0000001583 nova-compute[98241]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.3</machine>
May 28 01:49:21.359925 np0000001583 nova-compute[98241]:       <machine maxCpus='1024'>pc-q35-jammy-hpb-maxcpus</machine>
May 28 01:49:21.359925 np0000001583 nova-compute[98241]:       <machine maxCpus='1024'>pc-q35-8.2</machine>
May 28 01:49:21.359925 np0000001583 nova-compute[98241]:       <machine canonical='pc-q35-8.2' maxCpus='1024'>q35</machine>
May 28 01:49:21.359925 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-kinetic-hpb</machine>
May 28 01:49:21.359925 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
May 28 01:49:21.359925 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
May 28 01:49:21.359925 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-noble</machine>
May 28 01:49:21.359925 np0000001583 nova-compute[98241]:       <machine canonical='pc-i440fx-noble' maxCpus='255'>pc</machine>
May 28 01:49:21.359925 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
May 28 01:49:21.359925 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
May 28 01:49:21.359925 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-8.2</machine>
May 28 01:49:21.359925 np0000001583 nova-compute[98241]:       <machine canonical='pc-i440fx-8.2' maxCpus='255'>pc</machine>
May 28 01:49:21.359925 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
May 28 01:49:21.359925 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
May 28 01:49:21.359925 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-6.2</machine>
May 28 01:49:21.359925 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
May 28 01:49:21.359925 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
May 28 01:49:21.359925 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-q35-2.5</machine>
May 28 01:49:21.359925 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
May 28 01:49:21.359925 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
May 28 01:49:21.359925 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb-maxcpus</machine>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-7.2</machine>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-2.11</machine>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:       <domain type='qemu'/>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:       <domain type='kvm'/>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:     </arch>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:     <features>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:       <pae/>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:       <nonpae/>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:       <acpi default='on' toggle='yes'/>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:       <apic default='on' toggle='no'/>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:       <cpuselection/>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:       <deviceboot/>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:       <disksnapshot default='on' toggle='no'/>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:       <externalSnapshot/>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:     </features>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:   </guest>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:   <guest>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:     <os_type>hvm</os_type>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:     <arch name='m68k'>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:       <wordsize>32</wordsize>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>mcf5208evb</machine>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>virt-7.0</machine>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>an5206</machine>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>virt-6.0</machine>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>q800</machine>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>virt-8.1</machine>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>virt-7.2</machine>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>virt-6.2</machine>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>virt-8.0</machine>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>next-cube</machine>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>virt-7.1</machine>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>virt-6.1</machine>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>virt-8.2</machine>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:       <machine canonical='virt-8.2' maxCpus='1'>virt</machine>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:       <domain type='qemu'/>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:     </arch>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:     <features>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:       <cpuselection/>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:       <deviceboot/>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:       <disksnapshot default='on' toggle='no'/>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:       <externalSnapshot/>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:     </features>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:   </guest>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:   <guest>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:     <os_type>hvm</os_type>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:     <arch name='microblaze'>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:       <wordsize>32</wordsize>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>petalogix-ml605</machine>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:       <domain type='qemu'/>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:     </arch>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:     <features>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:       <cpuselection/>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:       <deviceboot/>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:       <disksnapshot default='on' toggle='no'/>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:       <externalSnapshot/>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:     </features>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:   </guest>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:   <guest>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:     <os_type>hvm</os_type>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:     <arch name='microblazeel'>
May 28 01:49:21.360585 np0000001583 nova-compute[98241]:       <wordsize>32</wordsize>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>petalogix-ml605</machine>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:       <domain type='qemu'/>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:     </arch>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:     <features>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:       <cpuselection/>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:       <deviceboot/>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:       <disksnapshot default='on' toggle='no'/>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:       <externalSnapshot/>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:     </features>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:   </guest>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:   <guest>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:     <os_type>hvm</os_type>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:     <arch name='mips'>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:       <wordsize>32</wordsize>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:       <emulator>/usr/bin/qemu-system-mips</emulator>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:       <machine maxCpus='16'>malta</machine>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>mipssim</machine>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:       <domain type='qemu'/>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:     </arch>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:     <features>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:       <cpuselection/>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:       <deviceboot/>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:       <disksnapshot default='on' toggle='no'/>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:       <externalSnapshot/>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:     </features>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:   </guest>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:   <guest>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:     <os_type>hvm</os_type>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:     <arch name='mipsel'>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:       <wordsize>32</wordsize>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:       <machine maxCpus='16'>malta</machine>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>mipssim</machine>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:       <domain type='qemu'/>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:     </arch>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:     <features>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:       <cpuselection/>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:       <deviceboot/>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:       <disksnapshot default='on' toggle='no'/>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:       <externalSnapshot/>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:     </features>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:   </guest>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:   <guest>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:     <os_type>hvm</os_type>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:     <arch name='mips64'>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:       <wordsize>64</wordsize>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:       <machine maxCpus='16'>malta</machine>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>mipssim</machine>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>pica61</machine>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>magnum</machine>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:       <domain type='qemu'/>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:     </arch>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:     <features>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:       <cpuselection/>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:       <deviceboot/>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:       <disksnapshot default='on' toggle='no'/>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:       <externalSnapshot/>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:     </features>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:   </guest>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:   <guest>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:     <os_type>hvm</os_type>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:     <arch name='mips64el'>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:       <wordsize>64</wordsize>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
May 28 01:49:21.361835 np0000001583 nova-compute[98241]:       <machine maxCpus='16'>malta</machine>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:       <machine maxCpus='16'>loongson3-virt</machine>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>mipssim</machine>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>pica61</machine>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>magnum</machine>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:       <machine maxCpus='16'>boston</machine>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>fuloong2e</machine>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:       <domain type='qemu'/>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:     </arch>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:     <features>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:       <cpuselection/>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:       <deviceboot/>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:       <disksnapshot default='on' toggle='no'/>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:       <externalSnapshot/>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:     </features>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:   </guest>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:   <guest>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:     <os_type>hvm</os_type>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:     <arch name='ppc'>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:       <wordsize>32</wordsize>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>g3beige</machine>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>amigaone</machine>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>virtex-ml507</machine>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>mac99</machine>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:       <machine maxCpus='32'>ppce500</machine>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>sam460ex</machine>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>pegasos2</machine>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>bamboo</machine>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>40p</machine>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>ref405ep</machine>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:       <machine maxCpus='15'>mpc8544ds</machine>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:       <domain type='qemu'/>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:     </arch>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:     <features>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:       <cpuselection/>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:       <deviceboot/>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:       <disksnapshot default='on' toggle='no'/>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:       <externalSnapshot/>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:     </features>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:   </guest>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:   <guest>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:     <os_type>hvm</os_type>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:     <arch name='ppc64'>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:       <wordsize>64</wordsize>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-noble</machine>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:       <machine canonical='pseries-noble' maxCpus='4096'>pseries</machine>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>amigaone</machine>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:       <machine maxCpus='2048'>powernv9</machine>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-4.1</machine>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:       <machine maxCpus='15'>mpc8544ds</machine>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-6.1</machine>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-2.5</machine>
May 28 01:49:21.363625 np0000001583 nova-compute[98241]:       <machine maxCpus='2048'>powernv10</machine>
May 28 01:49:21.364787 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-xenial</machine>
May 28 01:49:21.364787 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-4.2</machine>
May 28 01:49:21.364787 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-6.2</machine>
May 28 01:49:21.364787 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-yakkety</machine>
May 28 01:49:21.364787 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-2.6</machine>
May 28 01:49:21.364787 np0000001583 nova-compute[98241]:       <machine maxCpus='32'>ppce500</machine>
May 28 01:49:21.364787 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-bionic-sxxm</machine>
May 28 01:49:21.364787 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-2.7</machine>
May 28 01:49:21.364787 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-3.0</machine>
May 28 01:49:21.364787 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-8.0</machine>
May 28 01:49:21.364787 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-5.0</machine>
May 28 01:49:21.364787 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>40p</machine>
May 28 01:49:21.364787 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-lunar</machine>
May 28 01:49:21.364787 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-2.8</machine>
May 28 01:49:21.364787 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>pegasos2</machine>
May 28 01:49:21.364787 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-hirsute</machine>
May 28 01:49:21.364787 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-3.1</machine>
May 28 01:49:21.364787 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-8.1</machine>
May 28 01:49:21.364787 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-5.1</machine>
May 28 01:49:21.364787 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-eoan</machine>
May 28 01:49:21.364787 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-2.9</machine>
May 28 01:49:21.364787 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-zesty</machine>
May 28 01:49:21.364787 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>bamboo</machine>
May 28 01:49:21.364787 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-groovy</machine>
May 28 01:49:21.364787 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-focal</machine>
May 28 01:49:21.364787 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>g3beige</machine>
May 28 01:49:21.364787 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-8.2</machine>
May 28 01:49:21.364787 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-5.2</machine>
May 28 01:49:21.364787 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-disco</machine>
May 28 01:49:21.364787 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-2.12-sxxm</machine>
May 28 01:49:21.364787 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-mantic</machine>
May 28 01:49:21.364787 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-kinetic</machine>
May 28 01:49:21.364787 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-2.10</machine>
May 28 01:49:21.364787 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-7.0</machine>
May 28 01:49:21.364787 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>virtex-ml507</machine>
May 28 01:49:21.364787 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-2.11</machine>
May 28 01:49:21.364787 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-2.1</machine>
May 28 01:49:21.364787 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-7.1</machine>
May 28 01:49:21.364787 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-cosmic</machine>
May 28 01:49:21.365484 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-bionic</machine>
May 28 01:49:21.365484 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-2.12</machine>
May 28 01:49:21.365484 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-2.2</machine>
May 28 01:49:21.365484 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-7.2</machine>
May 28 01:49:21.365484 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>mac99</machine>
May 28 01:49:21.365484 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-impish</machine>
May 28 01:49:21.365484 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-jammy</machine>
May 28 01:49:21.365484 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-artful</machine>
May 28 01:49:21.365484 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>sam460ex</machine>
May 28 01:49:21.365484 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>ref405ep</machine>
May 28 01:49:21.365484 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-2.3</machine>
May 28 01:49:21.365484 np0000001583 nova-compute[98241]:       <machine maxCpus='2048'>powernv8</machine>
May 28 01:49:21.365484 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-4.0</machine>
May 28 01:49:21.365484 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-6.0</machine>
May 28 01:49:21.365484 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-2.4</machine>
May 28 01:49:21.365484 np0000001583 nova-compute[98241]:       <domain type='qemu'/>
May 28 01:49:21.365484 np0000001583 nova-compute[98241]:     </arch>
May 28 01:49:21.365484 np0000001583 nova-compute[98241]:     <features>
May 28 01:49:21.365484 np0000001583 nova-compute[98241]:       <cpuselection/>
May 28 01:49:21.365484 np0000001583 nova-compute[98241]:       <deviceboot/>
May 28 01:49:21.365484 np0000001583 nova-compute[98241]:       <disksnapshot default='on' toggle='no'/>
May 28 01:49:21.365484 np0000001583 nova-compute[98241]:       <externalSnapshot/>
May 28 01:49:21.365484 np0000001583 nova-compute[98241]:     </features>
May 28 01:49:21.365484 np0000001583 nova-compute[98241]:   </guest>
May 28 01:49:21.365484 np0000001583 nova-compute[98241]:   <guest>
May 28 01:49:21.365484 np0000001583 nova-compute[98241]:     <os_type>hvm</os_type>
May 28 01:49:21.365484 np0000001583 nova-compute[98241]:     <arch name='ppc64le'>
May 28 01:49:21.365484 np0000001583 nova-compute[98241]:       <wordsize>64</wordsize>
May 28 01:49:21.365484 np0000001583 nova-compute[98241]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
May 28 01:49:21.365484 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-noble</machine>
May 28 01:49:21.365484 np0000001583 nova-compute[98241]:       <machine canonical='pseries-noble' maxCpus='4096'>pseries</machine>
May 28 01:49:21.365484 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>amigaone</machine>
May 28 01:49:21.365484 np0000001583 nova-compute[98241]:       <machine maxCpus='2048'>powernv9</machine>
May 28 01:49:21.365484 np0000001583 nova-compute[98241]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
May 28 01:49:21.365484 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-4.1</machine>
May 28 01:49:21.365484 np0000001583 nova-compute[98241]:       <machine maxCpus='15'>mpc8544ds</machine>
May 28 01:49:21.365484 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-6.1</machine>
May 28 01:49:21.365484 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-2.5</machine>
May 28 01:49:21.365484 np0000001583 nova-compute[98241]:       <machine maxCpus='2048'>powernv10</machine>
May 28 01:49:21.365484 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-xenial</machine>
May 28 01:49:21.365484 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-4.2</machine>
May 28 01:49:21.365484 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-6.2</machine>
May 28 01:49:21.365484 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-yakkety</machine>
May 28 01:49:21.365484 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-2.6</machine>
May 28 01:49:21.365484 np0000001583 nova-compute[98241]:       <machine maxCpus='32'>ppce500</machine>
May 28 01:49:21.365484 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-bionic-sxxm</machine>
May 28 01:49:21.366394 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-2.7</machine>
May 28 01:49:21.366394 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-3.0</machine>
May 28 01:49:21.366394 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-8.0</machine>
May 28 01:49:21.366394 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-5.0</machine>
May 28 01:49:21.366394 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>40p</machine>
May 28 01:49:21.366394 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-lunar</machine>
May 28 01:49:21.366394 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-2.8</machine>
May 28 01:49:21.366394 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>pegasos2</machine>
May 28 01:49:21.366394 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-hirsute</machine>
May 28 01:49:21.366394 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-3.1</machine>
May 28 01:49:21.366394 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-8.1</machine>
May 28 01:49:21.366394 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-5.1</machine>
May 28 01:49:21.366394 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-eoan</machine>
May 28 01:49:21.366394 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-2.9</machine>
May 28 01:49:21.366394 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-zesty</machine>
May 28 01:49:21.366394 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>bamboo</machine>
May 28 01:49:21.366394 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-groovy</machine>
May 28 01:49:21.366394 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-focal</machine>
May 28 01:49:21.366394 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>g3beige</machine>
May 28 01:49:21.366394 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-8.2</machine>
May 28 01:49:21.366394 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-5.2</machine>
May 28 01:49:21.366394 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-disco</machine>
May 28 01:49:21.366394 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-2.12-sxxm</machine>
May 28 01:49:21.366394 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-mantic</machine>
May 28 01:49:21.366394 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-kinetic</machine>
May 28 01:49:21.366394 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-2.10</machine>
May 28 01:49:21.366394 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-7.0</machine>
May 28 01:49:21.366394 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>virtex-ml507</machine>
May 28 01:49:21.366394 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-2.11</machine>
May 28 01:49:21.366394 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-2.1</machine>
May 28 01:49:21.366394 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-7.1</machine>
May 28 01:49:21.366394 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-cosmic</machine>
May 28 01:49:21.366394 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-bionic</machine>
May 28 01:49:21.366394 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-2.12</machine>
May 28 01:49:21.366394 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-2.2</machine>
May 28 01:49:21.366394 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-7.2</machine>
May 28 01:49:21.366394 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>mac99</machine>
May 28 01:49:21.366394 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-impish</machine>
May 28 01:49:21.366394 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-jammy</machine>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-artful</machine>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>sam460ex</machine>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>ref405ep</machine>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-2.3</machine>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:       <machine maxCpus='2048'>powernv8</machine>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-4.0</machine>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-6.0</machine>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:       <machine maxCpus='4096'>pseries-2.4</machine>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:       <domain type='qemu'/>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:     </arch>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:     <features>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:       <cpuselection/>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:       <deviceboot/>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:       <disksnapshot default='on' toggle='no'/>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:       <externalSnapshot/>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:     </features>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:   </guest>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:   <guest>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:     <os_type>hvm</os_type>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:     <arch name='riscv32'>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:       <wordsize>32</wordsize>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:       <machine maxCpus='512'>virt</machine>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:       <machine maxCpus='8'>spike</machine>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>opentitan</machine>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:       <machine maxCpus='5'>sifive_u</machine>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>sifive_e</machine>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:       <domain type='qemu'/>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:     </arch>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:     <features>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:       <cpuselection/>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:       <deviceboot/>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:       <disksnapshot default='on' toggle='no'/>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:       <externalSnapshot/>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:     </features>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:   </guest>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:   <guest>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:     <os_type>hvm</os_type>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:     <arch name='riscv64'>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:       <wordsize>64</wordsize>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:       <machine maxCpus='512'>virt</machine>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:       <machine maxCpus='8'>spike</machine>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:       <machine maxCpus='5'>sifive_u</machine>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>shakti_c</machine>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>sifive_e</machine>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:       <domain type='qemu'/>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:     </arch>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:     <features>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:       <cpuselection/>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:       <deviceboot/>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:       <disksnapshot default='on' toggle='no'/>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:       <externalSnapshot/>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:     </features>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:   </guest>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:   <guest>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:     <os_type>hvm</os_type>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:     <arch name='s390x'>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:       <wordsize>64</wordsize>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
May 28 01:49:21.366981 np0000001583 nova-compute[98241]:       <machine maxCpus='248'>s390-ccw-virtio-noble</machine>
May 28 01:49:21.368476 np0000001583 nova-compute[98241]:       <machine canonical='s390-ccw-virtio-noble' maxCpus='248'>s390-ccw-virtio</machine>
May 28 01:49:21.368476 np0000001583 nova-compute[98241]:       <machine maxCpus='248'>s390-ccw-virtio-8.0</machine>
May 28 01:49:21.368476 np0000001583 nova-compute[98241]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
May 28 01:49:21.368476 np0000001583 nova-compute[98241]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
May 28 01:49:21.368476 np0000001583 nova-compute[98241]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
May 28 01:49:21.368476 np0000001583 nova-compute[98241]:       <machine maxCpus='248'>s390-ccw-virtio-7.0</machine>
May 28 01:49:21.368476 np0000001583 nova-compute[98241]:       <machine maxCpus='248'>s390-ccw-virtio-mantic</machine>
May 28 01:49:21.368476 np0000001583 nova-compute[98241]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
May 28 01:49:21.368476 np0000001583 nova-compute[98241]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
May 28 01:49:21.368476 np0000001583 nova-compute[98241]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
May 28 01:49:21.368476 np0000001583 nova-compute[98241]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
May 28 01:49:21.368476 np0000001583 nova-compute[98241]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
May 28 01:49:21.368476 np0000001583 nova-compute[98241]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
May 28 01:49:21.368476 np0000001583 nova-compute[98241]:       <machine maxCpus='248'>s390-ccw-virtio-8.2</machine>
May 28 01:49:21.368476 np0000001583 nova-compute[98241]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
May 28 01:49:21.368476 np0000001583 nova-compute[98241]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
May 28 01:49:21.368476 np0000001583 nova-compute[98241]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
May 28 01:49:21.368476 np0000001583 nova-compute[98241]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
May 28 01:49:21.368476 np0000001583 nova-compute[98241]:       <machine maxCpus='248'>s390-ccw-virtio-7.2</machine>
May 28 01:49:21.368476 np0000001583 nova-compute[98241]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
May 28 01:49:21.368476 np0000001583 nova-compute[98241]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
May 28 01:49:21.368476 np0000001583 nova-compute[98241]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
May 28 01:49:21.368476 np0000001583 nova-compute[98241]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
May 28 01:49:21.368476 np0000001583 nova-compute[98241]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
May 28 01:49:21.368476 np0000001583 nova-compute[98241]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
May 28 01:49:21.368476 np0000001583 nova-compute[98241]:       <machine maxCpus='248'>s390-ccw-virtio-lunar</machine>
May 28 01:49:21.368476 np0000001583 nova-compute[98241]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
May 28 01:49:21.368476 np0000001583 nova-compute[98241]:       <machine maxCpus='248'>s390-ccw-virtio-kinetic</machine>
May 28 01:49:21.368476 np0000001583 nova-compute[98241]:       <machine maxCpus='248'>s390-ccw-virtio-8.1</machine>
May 28 01:49:21.368476 np0000001583 nova-compute[98241]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
May 28 01:49:21.368476 np0000001583 nova-compute[98241]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
May 28 01:49:21.368476 np0000001583 nova-compute[98241]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
May 28 01:49:21.368476 np0000001583 nova-compute[98241]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:       <machine maxCpus='248'>s390-ccw-virtio-7.1</machine>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:       <domain type='qemu'/>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:     </arch>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:     <features>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:       <cpuselection/>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:       <deviceboot/>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:       <disksnapshot default='on' toggle='no'/>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:       <externalSnapshot/>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:     </features>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:   </guest>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:   <guest>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:     <os_type>hvm</os_type>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:     <arch name='sh4'>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:       <wordsize>32</wordsize>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>shix</machine>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>r2d</machine>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:       <domain type='qemu'/>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:     </arch>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:     <features>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:       <cpuselection/>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:       <deviceboot/>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:       <disksnapshot default='on' toggle='no'/>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:       <externalSnapshot/>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:     </features>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:   </guest>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:   <guest>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:     <os_type>hvm</os_type>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:     <arch name='sh4eb'>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:       <wordsize>64</wordsize>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>shix</machine>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>r2d</machine>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:       <domain type='qemu'/>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:     </arch>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:     <features>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:       <cpuselection/>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:       <deviceboot/>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:       <disksnapshot default='on' toggle='no'/>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:       <externalSnapshot/>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:     </features>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:   </guest>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:   <guest>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:     <os_type>hvm</os_type>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:     <arch name='sparc'>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:       <wordsize>32</wordsize>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>SS-5</machine>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:       <machine maxCpus='4'>SS-20</machine>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>LX</machine>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>SPARCClassic</machine>
May 28 01:49:21.370616 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>leon3_generic</machine>
May 28 01:49:21.371887 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>SPARCbook</machine>
May 28 01:49:21.371887 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>SS-4</machine>
May 28 01:49:21.371887 np0000001583 nova-compute[98241]:       <machine maxCpus='4'>SS-600MP</machine>
May 28 01:49:21.371887 np0000001583 nova-compute[98241]:       <machine maxCpus='4'>SS-10</machine>
May 28 01:49:21.371887 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>Voyager</machine>
May 28 01:49:21.371887 np0000001583 nova-compute[98241]:       <domain type='qemu'/>
May 28 01:49:21.371887 np0000001583 nova-compute[98241]:     </arch>
May 28 01:49:21.371887 np0000001583 nova-compute[98241]:     <features>
May 28 01:49:21.371887 np0000001583 nova-compute[98241]:       <cpuselection/>
May 28 01:49:21.371887 np0000001583 nova-compute[98241]:       <deviceboot/>
May 28 01:49:21.371887 np0000001583 nova-compute[98241]:       <disksnapshot default='on' toggle='no'/>
May 28 01:49:21.371887 np0000001583 nova-compute[98241]:       <externalSnapshot/>
May 28 01:49:21.371887 np0000001583 nova-compute[98241]:     </features>
May 28 01:49:21.371887 np0000001583 nova-compute[98241]:   </guest>
May 28 01:49:21.371887 np0000001583 nova-compute[98241]:   <guest>
May 28 01:49:21.371887 np0000001583 nova-compute[98241]:     <os_type>hvm</os_type>
May 28 01:49:21.371887 np0000001583 nova-compute[98241]:     <arch name='sparc64'>
May 28 01:49:21.371887 np0000001583 nova-compute[98241]:       <wordsize>64</wordsize>
May 28 01:49:21.371887 np0000001583 nova-compute[98241]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
May 28 01:49:21.371887 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>sun4u</machine>
May 28 01:49:21.371887 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>niagara</machine>
May 28 01:49:21.371887 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>sun4v</machine>
May 28 01:49:21.371887 np0000001583 nova-compute[98241]:       <domain type='qemu'/>
May 28 01:49:21.371887 np0000001583 nova-compute[98241]:     </arch>
May 28 01:49:21.371887 np0000001583 nova-compute[98241]:     <features>
May 28 01:49:21.371887 np0000001583 nova-compute[98241]:       <cpuselection/>
May 28 01:49:21.371887 np0000001583 nova-compute[98241]:       <deviceboot/>
May 28 01:49:21.371887 np0000001583 nova-compute[98241]:       <disksnapshot default='on' toggle='no'/>
May 28 01:49:21.371887 np0000001583 nova-compute[98241]:       <externalSnapshot/>
May 28 01:49:21.371887 np0000001583 nova-compute[98241]:     </features>
May 28 01:49:21.371887 np0000001583 nova-compute[98241]:   </guest>
May 28 01:49:21.371887 np0000001583 nova-compute[98241]:   <guest>
May 28 01:49:21.371887 np0000001583 nova-compute[98241]:     <os_type>hvm</os_type>
May 28 01:49:21.371887 np0000001583 nova-compute[98241]:     <arch name='x86_64'>
May 28 01:49:21.371887 np0000001583 nova-compute[98241]:       <wordsize>64</wordsize>
May 28 01:49:21.371887 np0000001583 nova-compute[98241]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 28 01:49:21.371887 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-noble-v2</machine>
May 28 01:49:21.371887 np0000001583 nova-compute[98241]:       <machine canonical='pc-i440fx-noble-v2' maxCpus='255'>ubuntu</machine>
May 28 01:49:21.371887 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-mantic</machine>
May 28 01:49:21.371887 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
May 28 01:49:21.371887 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-5.2</machine>
May 28 01:49:21.371887 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-lunar-hpb</machine>
May 28 01:49:21.371887 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-mantic</machine>
May 28 01:49:21.371887 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
May 28 01:49:21.371887 np0000001583 nova-compute[98241]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.0</machine>
May 28 01:49:21.371887 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
May 28 01:49:21.371887 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-kinetic</machine>
May 28 01:49:21.371887 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
May 28 01:49:21.371887 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-4.2</machine>
May 28 01:49:21.371887 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-mantic-maxcpus</machine>
May 28 01:49:21.371887 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
May 28 01:49:21.371887 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
May 28 01:49:21.371887 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
May 28 01:49:21.372973 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
May 28 01:49:21.372973 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-q35-xenial</machine>
May 28 01:49:21.372973 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
May 28 01:49:21.372973 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
May 28 01:49:21.372973 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-q35-2.7</machine>
May 28 01:49:21.372973 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
May 28 01:49:21.372973 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
May 28 01:49:21.372973 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-groovy</machine>
May 28 01:49:21.372973 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
May 28 01:49:21.372973 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-lunar</machine>
May 28 01:49:21.372973 np0000001583 nova-compute[98241]:       <machine maxCpus='1024'>pc-q35-mantic-hpb-maxcpus</machine>
May 28 01:49:21.372973 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
May 28 01:49:21.372973 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-7.1</machine>
May 28 01:49:21.372973 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-artful</machine>
May 28 01:49:21.372973 np0000001583 nova-compute[98241]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-trusty</machine>
May 28 01:49:21.372973 np0000001583 nova-compute[98241]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.2</machine>
May 28 01:49:21.372973 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
May 28 01:49:21.372973 np0000001583 nova-compute[98241]:       <machine maxCpus='1024'>pc-q35-8.1</machine>
May 28 01:49:21.372973 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
May 28 01:49:21.372973 np0000001583 nova-compute[98241]:       <machine maxCpus='1024'>pc-q35-jammy-maxcpus</machine>
May 28 01:49:21.372973 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
May 28 01:49:21.372973 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-mantic-hpb</machine>
May 28 01:49:21.372973 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
May 28 01:49:21.372973 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-8.1</machine>
May 28 01:49:21.372973 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
May 28 01:49:21.372973 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-6.1</machine>
May 28 01:49:21.372973 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-kinetic</machine>
May 28 01:49:21.372973 np0000001583 nova-compute[98241]:       <machine maxCpus='1024'>pc-i440fx-jammy-maxcpus</machine>
May 28 01:49:21.372973 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
May 28 01:49:21.372973 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-q35-2.4</machine>
May 28 01:49:21.372973 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
May 28 01:49:21.372973 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-7.1</machine>
May 28 01:49:21.372973 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-2.10</machine>
May 28 01:49:21.372973 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>x-remote</machine>
May 28 01:49:21.372973 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-5.1</machine>
May 28 01:49:21.372973 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-2.9</machine>
May 28 01:49:21.372973 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
May 28 01:49:21.373893 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb-maxcpus</machine>
May 28 01:49:21.373893 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-3.1</machine>
May 28 01:49:21.373893 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
May 28 01:49:21.373893 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-4.1</machine>
May 28 01:49:21.373893 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-jammy</machine>
May 28 01:49:21.373893 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
May 28 01:49:21.373893 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
May 28 01:49:21.373893 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-eoan</machine>
May 28 01:49:21.373893 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
May 28 01:49:21.373893 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
May 28 01:49:21.373893 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
May 28 01:49:21.373893 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
May 28 01:49:21.373893 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-lunar</machine>
May 28 01:49:21.373893 np0000001583 nova-compute[98241]:       <machine maxCpus='1'>isapc</machine>
May 28 01:49:21.373893 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb</machine>
May 28 01:49:21.373893 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
May 28 01:49:21.373893 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-q35-2.6</machine>
May 28 01:49:21.373893 np0000001583 nova-compute[98241]:       <machine maxCpus='1024'>pc-q35-mantic-maxcpus</machine>
May 28 01:49:21.373893 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
May 28 01:49:21.373893 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-bionic</machine>
May 28 01:49:21.373893 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
May 28 01:49:21.373893 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
May 28 01:49:21.373893 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-2.12</machine>
May 28 01:49:21.373893 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
May 28 01:49:21.373893 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-kinetic-hpb</machine>
May 28 01:49:21.373893 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
May 28 01:49:21.373893 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-7.0</machine>
May 28 01:49:21.373893 np0000001583 nova-compute[98241]:       <machine maxCpus='1024'>pc-q35-noble-v2</machine>
May 28 01:49:21.373893 np0000001583 nova-compute[98241]:       <machine canonical='pc-q35-noble-v2' maxCpus='1024'>ubuntu-q35</machine>
May 28 01:49:21.373893 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-lunar-hpb</machine>
May 28 01:49:21.373893 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-disco</machine>
May 28 01:49:21.373893 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
May 28 01:49:21.373893 np0000001583 nova-compute[98241]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.1</machine>
May 28 01:49:21.373893 np0000001583 nova-compute[98241]:       <machine maxCpus='1024'>pc-q35-noble</machine>
May 28 01:49:21.373893 np0000001583 nova-compute[98241]:       <machine canonical='pc-q35-noble' maxCpus='1024'>q35</machine>
May 28 01:49:21.373893 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-8.0</machine>
May 28 01:49:21.374500 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
May 28 01:49:21.374500 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-impish</machine>
May 28 01:49:21.374500 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-8.0</machine>
May 28 01:49:21.374500 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
May 28 01:49:21.374500 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-6.0</machine>
May 28 01:49:21.374500 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
May 28 01:49:21.374500 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
May 28 01:49:21.374500 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
May 28 01:49:21.374500 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
May 28 01:49:21.374500 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
May 28 01:49:21.374500 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
May 28 01:49:21.374500 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-7.0</machine>
May 28 01:49:21.374500 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-5.0</machine>
May 28 01:49:21.374500 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-2.8</machine>
May 28 01:49:21.374500 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
May 28 01:49:21.374500 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-3.0</machine>
May 28 01:49:21.374500 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-zesty</machine>
May 28 01:49:21.374500 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-7.2</machine>
May 28 01:49:21.374500 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-4.0</machine>
May 28 01:49:21.374500 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
May 28 01:49:21.374500 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-focal</machine>
May 28 01:49:21.374500 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>microvm</machine>
May 28 01:49:21.374500 np0000001583 nova-compute[98241]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.3</machine>
May 28 01:49:21.374500 np0000001583 nova-compute[98241]:       <machine maxCpus='1024'>pc-q35-jammy-hpb-maxcpus</machine>
May 28 01:49:21.374500 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
May 28 01:49:21.374500 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-kinetic-hpb</machine>
May 28 01:49:21.374500 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
May 28 01:49:21.374500 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
May 28 01:49:21.374500 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-noble</machine>
May 28 01:49:21.374500 np0000001583 nova-compute[98241]:       <machine canonical='pc-i440fx-noble' maxCpus='255'>pc</machine>
May 28 01:49:21.374500 np0000001583 nova-compute[98241]:       <machine maxCpus='1024'>pc-q35-8.2</machine>
May 28 01:49:21.374500 np0000001583 nova-compute[98241]:       <machine canonical='pc-q35-8.2' maxCpus='1024'>q35</machine>
May 28 01:49:21.374500 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
May 28 01:49:21.374500 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
May 28 01:49:21.374500 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-8.2</machine>
May 28 01:49:21.374500 np0000001583 nova-compute[98241]:       <machine canonical='pc-i440fx-8.2' maxCpus='255'>pc</machine>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-6.2</machine>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-q35-2.5</machine>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb-maxcpus</machine>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:       <machine maxCpus='255'>pc-i440fx-7.2</machine>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:       <machine maxCpus='288'>pc-q35-2.11</machine>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:       <domain type='qemu'/>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:       <domain type='kvm'/>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:     </arch>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:     <features>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:       <acpi default='on' toggle='yes'/>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:       <apic default='on' toggle='no'/>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:       <cpuselection/>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:       <deviceboot/>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:       <disksnapshot default='on' toggle='no'/>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:       <externalSnapshot/>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:     </features>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:   </guest>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:   <guest>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:     <os_type>hvm</os_type>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:     <arch name='xtensa'>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:       <wordsize>32</wordsize>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:       <machine maxCpus='4'>sim</machine>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:       <machine maxCpus='32'>kc705</machine>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:       <machine maxCpus='32'>ml605</machine>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:       <machine maxCpus='32'>ml605-nommu</machine>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:       <machine maxCpus='32'>virt</machine>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:       <machine maxCpus='32'>lx60-nommu</machine>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:       <machine maxCpus='32'>lx200</machine>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:       <machine maxCpus='32'>lx200-nommu</machine>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:       <machine maxCpus='32'>lx60</machine>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:       <machine maxCpus='32'>kc705-nommu</machine>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:       <domain type='qemu'/>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:     </arch>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:     <features>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:       <cpuselection/>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:       <deviceboot/>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:       <disksnapshot default='on' toggle='no'/>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:       <externalSnapshot/>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:     </features>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:   </guest>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:   <guest>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:     <os_type>hvm</os_type>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:     <arch name='xtensaeb'>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:       <wordsize>32</wordsize>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:       <machine maxCpus='4'>sim</machine>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:       <machine maxCpus='32'>kc705</machine>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:       <machine maxCpus='32'>ml605</machine>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:       <machine maxCpus='32'>ml605-nommu</machine>
May 28 01:49:21.375150 np0000001583 nova-compute[98241]:       <machine maxCpus='32'>virt</machine>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:       <machine maxCpus='32'>lx60-nommu</machine>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:       <machine maxCpus='32'>lx200</machine>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:       <machine maxCpus='32'>lx200-nommu</machine>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:       <machine maxCpus='32'>lx60</machine>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:       <machine maxCpus='32'>kc705-nommu</machine>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:       <domain type='qemu'/>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:     </arch>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:     <features>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:       <cpuselection/>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:       <deviceboot/>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:       <disksnapshot default='on' toggle='no'/>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:       <externalSnapshot/>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:     </features>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:   </guest>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]: </capabilities>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]: 
May 28 01:49:21.376562 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=98241) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 01:49:21.376562 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Libvirt host hypervisor capabilities for arch=alpha and machine_type=None:
May 28 01:49:21.376562 np0000001583 nova-compute[98241]: <domainCapabilities>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:   <path>/usr/bin/qemu-system-alpha</path>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:   <domain>qemu</domain>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:   <machine>clipper</machine>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:   <arch>alpha</arch>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:   <vcpu max='4'/>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:   <iothreads supported='yes'/>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:   <os supported='yes'>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:     <enum name='firmware'/>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:     <loader supported='yes'>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:         <value>rom</value>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:         <value>pflash</value>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:       <enum name='readonly'>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:         <value>yes</value>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:       <enum name='secure'>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:     </loader>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:   </os>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:   <cpu>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:     <mode name='host-passthrough' supported='no'/>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:     <mode name='maximum' supported='no'/>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:     <mode name='host-model' supported='no'/>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:     <mode name='custom' supported='no'/>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:   <memoryBacking supported='yes'>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:     <enum name='sourceType'>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:       <value>file</value>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:       <value>anonymous</value>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:       <value>memfd</value>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:     </enum>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:   </memoryBacking>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:   <devices>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:     <disk supported='yes'>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:       <enum name='diskDevice'>
May 28 01:49:21.376562 np0000001583 nova-compute[98241]:         <value>disk</value>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:         <value>cdrom</value>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:         <value>floppy</value>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:         <value>lun</value>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:         <value>fdc</value>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:         <value>sata</value>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:     </disk>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:     <graphics supported='yes'>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:         <value>sdl</value>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:         <value>vnc</value>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:         <value>spice</value>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:         <value>egl-headless</value>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:         <value>dbus</value>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:     </graphics>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:     <video supported='yes'>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:       <enum name='modelType'>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:         <value>vga</value>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:         <value>cirrus</value>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:         <value>none</value>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:         <value>bochs</value>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:     </video>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:     <hostdev supported='yes'>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:       <enum name='mode'>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:         <value>subsystem</value>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:       <enum name='startupPolicy'>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:         <value>default</value>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:         <value>mandatory</value>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:         <value>requisite</value>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:         <value>optional</value>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:       <enum name='subsysType'>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:         <value>pci</value>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:       <enum name='capsType'/>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:       <enum name='pciBackend'/>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:     </hostdev>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:     <rng supported='yes'>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:         <value>random</value>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:         <value>egd</value>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:     </rng>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:     <filesystem supported='yes'>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:       <enum name='driverType'>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:         <value>path</value>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:         <value>handle</value>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:         <value>virtiofs</value>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:     </filesystem>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:     <tpm supported='no'/>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:     <redirdev supported='yes'>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.379578 np0000001583 nova-compute[98241]:     </redirdev>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:     <channel supported='yes'>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:         <value>pty</value>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:         <value>unix</value>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:         <value>spicevmc</value>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:     </channel>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:     <crypto supported='yes'>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:         <value>qemu</value>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:     </crypto>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:   </devices>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:   <features>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:     <gic supported='no'/>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:     <vmcoreinfo supported='no'/>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:     <genid supported='no'/>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:     <backingStoreInput supported='yes'/>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:     <backup supported='yes'/>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:     <async-teardown supported='yes'/>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:     <sev supported='no'/>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:     <sgx supported='no'/>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:   </features>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]: </domainCapabilities>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 01:49:21.383776 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=98241) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 01:49:21.383776 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Libvirt host hypervisor capabilities for arch=armv6l and machine_type=None:
May 28 01:49:21.383776 np0000001583 nova-compute[98241]: <domainCapabilities>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:   <path>/usr/bin/qemu-system-arm</path>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:   <domain>qemu</domain>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:   <machine>virt-8.2</machine>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:   <arch>armv6l</arch>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:   <vcpu max='512'/>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:   <iothreads supported='yes'/>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:   <os supported='yes'>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:     <enum name='firmware'/>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:     <loader supported='yes'>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:         <value>rom</value>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:         <value>pflash</value>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:       <enum name='readonly'>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:         <value>yes</value>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:       <enum name='secure'>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:     </loader>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:   </os>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:   <cpu>
May 28 01:49:21.383776 np0000001583 nova-compute[98241]:     <mode name='host-passthrough' supported='no'/>
May 28 01:49:21.384831 np0000001583 nova-compute[98241]:     <mode name='maximum' supported='yes'>
May 28 01:49:21.384831 np0000001583 nova-compute[98241]:       <enum name='maximumMigratable'>
May 28 01:49:21.384831 np0000001583 nova-compute[98241]:         <value>on</value>
May 28 01:49:21.384831 np0000001583 nova-compute[98241]:         <value>off</value>
May 28 01:49:21.384831 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.384831 np0000001583 nova-compute[98241]:     </mode>
May 28 01:49:21.384831 np0000001583 nova-compute[98241]:     <mode name='host-model' supported='no'/>
May 28 01:49:21.384831 np0000001583 nova-compute[98241]:     <mode name='custom' supported='yes'>
May 28 01:49:21.384831 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 28 01:49:21.384831 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 28 01:49:21.384831 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 28 01:49:21.384831 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 28 01:49:21.384831 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 28 01:49:21.384831 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 28 01:49:21.384831 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 28 01:49:21.384831 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 28 01:49:21.384831 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 28 01:49:21.384831 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 28 01:49:21.384831 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 28 01:49:21.384831 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 28 01:49:21.384831 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 28 01:49:21.384831 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 28 01:49:21.384831 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 28 01:49:21.384831 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 28 01:49:21.384831 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 28 01:49:21.384831 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 28 01:49:21.384831 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 28 01:49:21.384831 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 28 01:49:21.384831 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 28 01:49:21.384831 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 28 01:49:21.384831 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 28 01:49:21.384831 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 28 01:49:21.384831 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 28 01:49:21.384831 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>max</model>
May 28 01:49:21.384831 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 28 01:49:21.384831 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:     </mode>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:   <memoryBacking supported='yes'>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:     <enum name='sourceType'>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:       <value>file</value>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:       <value>anonymous</value>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:       <value>memfd</value>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:     </enum>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:   </memoryBacking>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:   <devices>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:     <disk supported='yes'>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:       <enum name='diskDevice'>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:         <value>disk</value>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:         <value>cdrom</value>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:         <value>floppy</value>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:         <value>lun</value>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:         <value>fdc</value>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:         <value>sata</value>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:     </disk>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:     <graphics supported='yes'>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:         <value>sdl</value>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:         <value>vnc</value>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:         <value>spice</value>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:         <value>egl-headless</value>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:         <value>dbus</value>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:     </graphics>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:     <video supported='yes'>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:       <enum name='modelType'>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:         <value>vga</value>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:         <value>cirrus</value>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:         <value>none</value>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:         <value>bochs</value>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:         <value>ramfb</value>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:     </video>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:     <hostdev supported='yes'>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:       <enum name='mode'>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:         <value>subsystem</value>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:       <enum name='startupPolicy'>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:         <value>default</value>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:         <value>mandatory</value>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:         <value>requisite</value>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:         <value>optional</value>
May 28 01:49:21.385567 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:       <enum name='subsysType'>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:         <value>pci</value>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:       <enum name='capsType'/>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:       <enum name='pciBackend'/>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:     </hostdev>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:     <rng supported='yes'>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:         <value>random</value>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:         <value>egd</value>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:     </rng>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:     <filesystem supported='yes'>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:       <enum name='driverType'>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:         <value>path</value>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:         <value>handle</value>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:         <value>virtiofs</value>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:     </filesystem>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:     <tpm supported='yes'>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:         <value>tpm-tis</value>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:         <value>passthrough</value>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:         <value>emulator</value>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:         <value>external</value>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:       <enum name='backendVersion'>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:         <value>1.2</value>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:         <value>2.0</value>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:     </tpm>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:     <redirdev supported='yes'>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:     </redirdev>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:     <channel supported='yes'>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:         <value>pty</value>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:         <value>unix</value>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:         <value>spicevmc</value>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:     </channel>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:     <crypto supported='yes'>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:         <value>qemu</value>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:     </crypto>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:   </devices>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:   <features>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:     <gic supported='yes'>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:       <enum name='version'>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:         <value>2</value>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:         <value>3</value>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:     </gic>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:     <vmcoreinfo supported='yes'/>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:     <genid supported='no'/>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:     <backingStoreInput supported='yes'/>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:     <backup supported='yes'/>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:     <async-teardown supported='yes'/>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:     <sev supported='no'/>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:     <sgx supported='no'/>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]:   </features>
May 28 01:49:21.387239 np0000001583 nova-compute[98241]: </domainCapabilities>
May 28 01:49:21.389689 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 01:49:21.389689 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Libvirt host hypervisor capabilities for arch=armv6l and machine_type=virt:
May 28 01:49:21.389689 np0000001583 nova-compute[98241]: <domainCapabilities>
May 28 01:49:21.389689 np0000001583 nova-compute[98241]:   <path>/usr/bin/qemu-system-arm</path>
May 28 01:49:21.389689 np0000001583 nova-compute[98241]:   <domain>qemu</domain>
May 28 01:49:21.389689 np0000001583 nova-compute[98241]:   <machine>virt-8.2</machine>
May 28 01:49:21.389689 np0000001583 nova-compute[98241]:   <arch>armv6l</arch>
May 28 01:49:21.389689 np0000001583 nova-compute[98241]:   <vcpu max='512'/>
May 28 01:49:21.389689 np0000001583 nova-compute[98241]:   <iothreads supported='yes'/>
May 28 01:49:21.389689 np0000001583 nova-compute[98241]:   <os supported='yes'>
May 28 01:49:21.389689 np0000001583 nova-compute[98241]:     <enum name='firmware'/>
May 28 01:49:21.389689 np0000001583 nova-compute[98241]:     <loader supported='yes'>
May 28 01:49:21.389689 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 01:49:21.389689 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 01:49:21.389689 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.389689 np0000001583 nova-compute[98241]:         <value>rom</value>
May 28 01:49:21.389689 np0000001583 nova-compute[98241]:         <value>pflash</value>
May 28 01:49:21.389689 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.389689 np0000001583 nova-compute[98241]:       <enum name='readonly'>
May 28 01:49:21.389689 np0000001583 nova-compute[98241]:         <value>yes</value>
May 28 01:49:21.389689 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.389689 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.389689 np0000001583 nova-compute[98241]:       <enum name='secure'>
May 28 01:49:21.389689 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.389689 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.389689 np0000001583 nova-compute[98241]:     </loader>
May 28 01:49:21.389689 np0000001583 nova-compute[98241]:   </os>
May 28 01:49:21.389689 np0000001583 nova-compute[98241]:   <cpu>
May 28 01:49:21.389689 np0000001583 nova-compute[98241]:     <mode name='host-passthrough' supported='no'/>
May 28 01:49:21.389689 np0000001583 nova-compute[98241]:     <mode name='maximum' supported='yes'>
May 28 01:49:21.389689 np0000001583 nova-compute[98241]:       <enum name='maximumMigratable'>
May 28 01:49:21.389689 np0000001583 nova-compute[98241]:         <value>on</value>
May 28 01:49:21.389689 np0000001583 nova-compute[98241]:         <value>off</value>
May 28 01:49:21.389689 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.389689 np0000001583 nova-compute[98241]:     </mode>
May 28 01:49:21.389689 np0000001583 nova-compute[98241]:     <mode name='host-model' supported='no'/>
May 28 01:49:21.389689 np0000001583 nova-compute[98241]:     <mode name='custom' supported='yes'>
May 28 01:49:21.389689 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 28 01:49:21.389689 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 28 01:49:21.389689 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 28 01:49:21.389689 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 28 01:49:21.389689 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 28 01:49:21.389689 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 28 01:49:21.389689 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 28 01:49:21.389689 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 28 01:49:21.389689 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 28 01:49:21.389689 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 28 01:49:21.389689 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 28 01:49:21.389689 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 28 01:49:21.390896 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 28 01:49:21.390896 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 28 01:49:21.390896 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 28 01:49:21.390896 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 28 01:49:21.390896 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 28 01:49:21.390896 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 28 01:49:21.390896 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 28 01:49:21.390896 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 28 01:49:21.390896 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 28 01:49:21.390896 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 28 01:49:21.390896 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 28 01:49:21.390896 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 28 01:49:21.390896 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 28 01:49:21.390896 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>max</model>
May 28 01:49:21.390896 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 28 01:49:21.390896 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 28 01:49:21.390896 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 28 01:49:21.390896 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 28 01:49:21.390896 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 28 01:49:21.390896 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 28 01:49:21.390896 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 28 01:49:21.390896 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 28 01:49:21.390896 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 28 01:49:21.390896 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 28 01:49:21.390896 np0000001583 nova-compute[98241]:     </mode>
May 28 01:49:21.390896 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:49:21.390896 np0000001583 nova-compute[98241]:   <memoryBacking supported='yes'>
May 28 01:49:21.390896 np0000001583 nova-compute[98241]:     <enum name='sourceType'>
May 28 01:49:21.390896 np0000001583 nova-compute[98241]:       <value>file</value>
May 28 01:49:21.390896 np0000001583 nova-compute[98241]:       <value>anonymous</value>
May 28 01:49:21.390896 np0000001583 nova-compute[98241]:       <value>memfd</value>
May 28 01:49:21.390896 np0000001583 nova-compute[98241]:     </enum>
May 28 01:49:21.390896 np0000001583 nova-compute[98241]:   </memoryBacking>
May 28 01:49:21.390896 np0000001583 nova-compute[98241]:   <devices>
May 28 01:49:21.390896 np0000001583 nova-compute[98241]:     <disk supported='yes'>
May 28 01:49:21.390896 np0000001583 nova-compute[98241]:       <enum name='diskDevice'>
May 28 01:49:21.390896 np0000001583 nova-compute[98241]:         <value>disk</value>
May 28 01:49:21.390896 np0000001583 nova-compute[98241]:         <value>cdrom</value>
May 28 01:49:21.390896 np0000001583 nova-compute[98241]:         <value>floppy</value>
May 28 01:49:21.390896 np0000001583 nova-compute[98241]:         <value>lun</value>
May 28 01:49:21.390896 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.390896 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.390896 np0000001583 nova-compute[98241]:         <value>fdc</value>
May 28 01:49:21.390896 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.390896 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:         <value>sata</value>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:     </disk>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:     <graphics supported='yes'>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:         <value>sdl</value>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:         <value>vnc</value>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:         <value>spice</value>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:         <value>egl-headless</value>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:         <value>dbus</value>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:     </graphics>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:     <video supported='yes'>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:       <enum name='modelType'>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:         <value>vga</value>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:         <value>cirrus</value>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:         <value>none</value>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:         <value>bochs</value>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:         <value>ramfb</value>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:     </video>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:     <hostdev supported='yes'>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:       <enum name='mode'>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:         <value>subsystem</value>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:       <enum name='startupPolicy'>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:         <value>default</value>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:         <value>mandatory</value>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:         <value>requisite</value>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:         <value>optional</value>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:       <enum name='subsysType'>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:         <value>pci</value>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:       <enum name='capsType'/>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:       <enum name='pciBackend'/>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:     </hostdev>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:     <rng supported='yes'>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:         <value>random</value>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:         <value>egd</value>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:     </rng>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:     <filesystem supported='yes'>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:       <enum name='driverType'>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:         <value>path</value>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:         <value>handle</value>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:         <value>virtiofs</value>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:     </filesystem>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:     <tpm supported='yes'>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:         <value>tpm-tis</value>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:         <value>passthrough</value>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:         <value>emulator</value>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:         <value>external</value>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:       <enum name='backendVersion'>
May 28 01:49:21.391749 np0000001583 nova-compute[98241]:         <value>1.2</value>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:         <value>2.0</value>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:     </tpm>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:     <redirdev supported='yes'>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:     </redirdev>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:     <channel supported='yes'>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:         <value>pty</value>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:         <value>unix</value>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:         <value>spicevmc</value>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:     </channel>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:     <crypto supported='yes'>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:         <value>qemu</value>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:     </crypto>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:   </devices>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:   <features>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:     <gic supported='yes'>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:       <enum name='version'>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:         <value>2</value>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:         <value>3</value>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:     </gic>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:     <vmcoreinfo supported='yes'/>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:     <genid supported='no'/>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:     <backingStoreInput supported='yes'/>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:     <backup supported='yes'/>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:     <async-teardown supported='yes'/>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:     <sev supported='no'/>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:     <sgx supported='no'/>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:   </features>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]: </domainCapabilities>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 01:49:21.393090 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=98241) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 01:49:21.393090 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Libvirt host hypervisor capabilities for arch=armv7l and machine_type=virt:
May 28 01:49:21.393090 np0000001583 nova-compute[98241]: <domainCapabilities>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:   <path>/usr/bin/qemu-system-arm</path>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:   <domain>qemu</domain>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:   <machine>virt-8.2</machine>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:   <arch>armv7l</arch>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:   <vcpu max='512'/>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:   <iothreads supported='yes'/>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:   <os supported='yes'>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:     <enum name='firmware'>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:       <value>efi</value>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:     </enum>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:     <loader supported='yes'>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:         <value>rom</value>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:         <value>pflash</value>
May 28 01:49:21.393090 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.394276 np0000001583 nova-compute[98241]:       <enum name='readonly'>
May 28 01:49:21.394276 np0000001583 nova-compute[98241]:         <value>yes</value>
May 28 01:49:21.394276 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.394276 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.394276 np0000001583 nova-compute[98241]:       <enum name='secure'>
May 28 01:49:21.394276 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.394276 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.394276 np0000001583 nova-compute[98241]:     </loader>
May 28 01:49:21.394276 np0000001583 nova-compute[98241]:   </os>
May 28 01:49:21.394276 np0000001583 nova-compute[98241]:   <cpu>
May 28 01:49:21.394276 np0000001583 nova-compute[98241]:     <mode name='host-passthrough' supported='no'/>
May 28 01:49:21.394276 np0000001583 nova-compute[98241]:     <mode name='maximum' supported='yes'>
May 28 01:49:21.394276 np0000001583 nova-compute[98241]:       <enum name='maximumMigratable'>
May 28 01:49:21.394276 np0000001583 nova-compute[98241]:         <value>on</value>
May 28 01:49:21.394276 np0000001583 nova-compute[98241]:         <value>off</value>
May 28 01:49:21.394276 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.394276 np0000001583 nova-compute[98241]:     </mode>
May 28 01:49:21.394276 np0000001583 nova-compute[98241]:     <mode name='host-model' supported='no'/>
May 28 01:49:21.394276 np0000001583 nova-compute[98241]:     <mode name='custom' supported='yes'>
May 28 01:49:21.394276 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 28 01:49:21.394276 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 28 01:49:21.394276 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 28 01:49:21.394276 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 28 01:49:21.394276 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 28 01:49:21.394276 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 28 01:49:21.394276 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 28 01:49:21.394276 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 28 01:49:21.394276 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 28 01:49:21.394276 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 28 01:49:21.394276 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 28 01:49:21.394276 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 28 01:49:21.394276 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 28 01:49:21.394276 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 28 01:49:21.394276 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 28 01:49:21.394276 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 28 01:49:21.394276 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 28 01:49:21.394276 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 28 01:49:21.394276 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 28 01:49:21.394276 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 28 01:49:21.394276 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 28 01:49:21.394276 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 28 01:49:21.394276 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 28 01:49:21.394276 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>max</model>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:     </mode>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:   <memoryBacking supported='yes'>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:     <enum name='sourceType'>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:       <value>file</value>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:       <value>anonymous</value>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:       <value>memfd</value>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:     </enum>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:   </memoryBacking>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:   <devices>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:     <disk supported='yes'>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:       <enum name='diskDevice'>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:         <value>disk</value>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:         <value>cdrom</value>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:         <value>floppy</value>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:         <value>lun</value>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:         <value>fdc</value>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:         <value>sata</value>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:     </disk>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:     <graphics supported='yes'>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:         <value>sdl</value>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:         <value>vnc</value>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:         <value>spice</value>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:         <value>egl-headless</value>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:         <value>dbus</value>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:     </graphics>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:     <video supported='yes'>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:       <enum name='modelType'>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:         <value>vga</value>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:         <value>cirrus</value>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:         <value>none</value>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:         <value>bochs</value>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:         <value>ramfb</value>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:     </video>
May 28 01:49:21.396544 np0000001583 nova-compute[98241]:     <hostdev supported='yes'>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:       <enum name='mode'>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:         <value>subsystem</value>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:       <enum name='startupPolicy'>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:         <value>default</value>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:         <value>mandatory</value>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:         <value>requisite</value>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:         <value>optional</value>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:       <enum name='subsysType'>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:         <value>pci</value>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:       <enum name='capsType'/>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:       <enum name='pciBackend'/>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:     </hostdev>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:     <rng supported='yes'>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:         <value>random</value>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:         <value>egd</value>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:     </rng>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:     <filesystem supported='yes'>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:       <enum name='driverType'>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:         <value>path</value>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:         <value>handle</value>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:         <value>virtiofs</value>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:     </filesystem>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:     <tpm supported='yes'>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:         <value>tpm-tis</value>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:         <value>passthrough</value>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:         <value>emulator</value>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:         <value>external</value>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:       <enum name='backendVersion'>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:         <value>1.2</value>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:         <value>2.0</value>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:     </tpm>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:     <redirdev supported='yes'>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:     </redirdev>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:     <channel supported='yes'>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:         <value>pty</value>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:         <value>unix</value>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:         <value>spicevmc</value>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:     </channel>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:     <crypto supported='yes'>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:         <value>qemu</value>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:     </crypto>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:   </devices>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:   <features>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:     <gic supported='yes'>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:       <enum name='version'>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:         <value>2</value>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:         <value>3</value>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.398343 np0000001583 nova-compute[98241]:     </gic>
May 28 01:49:21.400475 np0000001583 nova-compute[98241]:     <vmcoreinfo supported='yes'/>
May 28 01:49:21.400475 np0000001583 nova-compute[98241]:     <genid supported='no'/>
May 28 01:49:21.400475 np0000001583 nova-compute[98241]:     <backingStoreInput supported='yes'/>
May 28 01:49:21.400475 np0000001583 nova-compute[98241]:     <backup supported='yes'/>
May 28 01:49:21.400475 np0000001583 nova-compute[98241]:     <async-teardown supported='yes'/>
May 28 01:49:21.400475 np0000001583 nova-compute[98241]:     <sev supported='no'/>
May 28 01:49:21.400475 np0000001583 nova-compute[98241]:     <sgx supported='no'/>
May 28 01:49:21.400475 np0000001583 nova-compute[98241]:   </features>
May 28 01:49:21.400475 np0000001583 nova-compute[98241]: </domainCapabilities>
May 28 01:49:21.400475 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 01:49:21.400475 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=98241) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 01:49:21.400475 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Libvirt host hypervisor capabilities for arch=aarch64 and machine_type=virt:
May 28 01:49:21.400475 np0000001583 nova-compute[98241]: <domainCapabilities>
May 28 01:49:21.400475 np0000001583 nova-compute[98241]:   <path>/usr/bin/qemu-system-aarch64</path>
May 28 01:49:21.400475 np0000001583 nova-compute[98241]:   <domain>qemu</domain>
May 28 01:49:21.400475 np0000001583 nova-compute[98241]:   <machine>virt-8.2</machine>
May 28 01:49:21.400475 np0000001583 nova-compute[98241]:   <arch>aarch64</arch>
May 28 01:49:21.400475 np0000001583 nova-compute[98241]:   <vcpu max='512'/>
May 28 01:49:21.400475 np0000001583 nova-compute[98241]:   <iothreads supported='yes'/>
May 28 01:49:21.400475 np0000001583 nova-compute[98241]:   <os supported='yes'>
May 28 01:49:21.400475 np0000001583 nova-compute[98241]:     <enum name='firmware'>
May 28 01:49:21.400475 np0000001583 nova-compute[98241]:       <value>efi</value>
May 28 01:49:21.400475 np0000001583 nova-compute[98241]:     </enum>
May 28 01:49:21.400475 np0000001583 nova-compute[98241]:     <loader supported='yes'>
May 28 01:49:21.400475 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF_CODE.ms.fd</value>
May 28 01:49:21.400475 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF_CODE.secboot.fd</value>
May 28 01:49:21.400475 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF_CODE.no-secboot.fd</value>
May 28 01:49:21.400475 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.400475 np0000001583 nova-compute[98241]:         <value>rom</value>
May 28 01:49:21.400475 np0000001583 nova-compute[98241]:         <value>pflash</value>
May 28 01:49:21.400475 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.400475 np0000001583 nova-compute[98241]:       <enum name='readonly'>
May 28 01:49:21.400475 np0000001583 nova-compute[98241]:         <value>yes</value>
May 28 01:49:21.400475 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.400475 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.400475 np0000001583 nova-compute[98241]:       <enum name='secure'>
May 28 01:49:21.400475 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.400475 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.400475 np0000001583 nova-compute[98241]:     </loader>
May 28 01:49:21.400475 np0000001583 nova-compute[98241]:   </os>
May 28 01:49:21.400475 np0000001583 nova-compute[98241]:   <cpu>
May 28 01:49:21.400475 np0000001583 nova-compute[98241]:     <mode name='host-passthrough' supported='no'/>
May 28 01:49:21.400475 np0000001583 nova-compute[98241]:     <mode name='maximum' supported='yes'>
May 28 01:49:21.400475 np0000001583 nova-compute[98241]:       <enum name='maximumMigratable'>
May 28 01:49:21.400475 np0000001583 nova-compute[98241]:         <value>on</value>
May 28 01:49:21.400475 np0000001583 nova-compute[98241]:         <value>off</value>
May 28 01:49:21.400475 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.400475 np0000001583 nova-compute[98241]:     </mode>
May 28 01:49:21.400475 np0000001583 nova-compute[98241]:     <mode name='host-model' supported='no'/>
May 28 01:49:21.400475 np0000001583 nova-compute[98241]:     <mode name='custom' supported='yes'>
May 28 01:49:21.400475 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>neoverse-n2</model>
May 28 01:49:21.400475 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 28 01:49:21.401815 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 28 01:49:21.401815 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 28 01:49:21.401815 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-a57</model>
May 28 01:49:21.401815 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 28 01:49:21.401815 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 28 01:49:21.401815 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 28 01:49:21.401815 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 28 01:49:21.401815 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 28 01:49:21.401815 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 28 01:49:21.401815 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-a76</model>
May 28 01:49:21.401815 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>a64fx</model>
May 28 01:49:21.401815 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 28 01:49:21.401815 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>neoverse-v1</model>
May 28 01:49:21.401815 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 28 01:49:21.401815 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 28 01:49:21.401815 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 28 01:49:21.401815 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 28 01:49:21.401815 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 28 01:49:21.401815 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 28 01:49:21.401815 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 28 01:49:21.401815 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 28 01:49:21.401815 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 28 01:49:21.401815 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 28 01:49:21.401815 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 28 01:49:21.401815 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 28 01:49:21.401815 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-a710</model>
May 28 01:49:21.401815 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 28 01:49:21.401815 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 28 01:49:21.401815 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 28 01:49:21.401815 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>max</model>
May 28 01:49:21.401815 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-a53</model>
May 28 01:49:21.401815 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-a72</model>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-a55</model>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>neoverse-n1</model>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-a35</model>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:     </mode>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:   <memoryBacking supported='yes'>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:     <enum name='sourceType'>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:       <value>file</value>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:       <value>anonymous</value>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:       <value>memfd</value>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:     </enum>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:   </memoryBacking>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:   <devices>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:     <disk supported='yes'>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:       <enum name='diskDevice'>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:         <value>disk</value>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:         <value>cdrom</value>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:         <value>floppy</value>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:         <value>lun</value>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:         <value>fdc</value>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:         <value>sata</value>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:     </disk>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:     <graphics supported='yes'>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:         <value>sdl</value>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:         <value>vnc</value>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:         <value>spice</value>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:         <value>egl-headless</value>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:         <value>dbus</value>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:     </graphics>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:     <video supported='yes'>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:       <enum name='modelType'>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:         <value>vga</value>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:         <value>cirrus</value>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:         <value>none</value>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:         <value>bochs</value>
May 28 01:49:21.402446 np0000001583 nova-compute[98241]:         <value>ramfb</value>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:     </video>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:     <hostdev supported='yes'>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:       <enum name='mode'>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:         <value>subsystem</value>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:       <enum name='startupPolicy'>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:         <value>default</value>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:         <value>mandatory</value>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:         <value>requisite</value>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:         <value>optional</value>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:       <enum name='subsysType'>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:         <value>pci</value>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:       <enum name='capsType'/>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:       <enum name='pciBackend'/>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:     </hostdev>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:     <rng supported='yes'>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:         <value>random</value>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:         <value>egd</value>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:     </rng>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:     <filesystem supported='yes'>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:       <enum name='driverType'>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:         <value>path</value>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:         <value>handle</value>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:         <value>virtiofs</value>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:     </filesystem>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:     <tpm supported='yes'>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:         <value>tpm-tis</value>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:         <value>passthrough</value>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:         <value>emulator</value>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:         <value>external</value>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:       <enum name='backendVersion'>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:         <value>1.2</value>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:         <value>2.0</value>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:     </tpm>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:     <redirdev supported='yes'>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:     </redirdev>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:     <channel supported='yes'>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:         <value>pty</value>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:         <value>unix</value>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:         <value>spicevmc</value>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:     </channel>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:     <crypto supported='yes'>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:         <value>qemu</value>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:     </crypto>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:   </devices>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:   <features>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:     <gic supported='yes'>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:       <enum name='version'>
May 28 01:49:21.403618 np0000001583 nova-compute[98241]:         <value>2</value>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]:         <value>3</value>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]:     </gic>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]:     <vmcoreinfo supported='yes'/>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]:     <genid supported='no'/>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]:     <backingStoreInput supported='yes'/>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]:     <backup supported='yes'/>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]:     <async-teardown supported='yes'/>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]:     <sev supported='no'/>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]:     <sgx supported='no'/>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]:   </features>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]: </domainCapabilities>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 01:49:21.405439 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=98241) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 01:49:21.405439 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Libvirt host hypervisor capabilities for arch=cris and machine_type=None:
May 28 01:49:21.405439 np0000001583 nova-compute[98241]: <domainCapabilities>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]:   <path>/usr/bin/qemu-system-cris</path>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]:   <domain>qemu</domain>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]:   <machine>axis-dev88</machine>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]:   <arch>cris</arch>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]:   <vcpu max='1'/>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]:   <iothreads supported='yes'/>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]:   <os supported='yes'>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]:     <enum name='firmware'/>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]:     <loader supported='yes'>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]:         <value>rom</value>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]:         <value>pflash</value>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]:       <enum name='readonly'>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]:         <value>yes</value>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]:       <enum name='secure'>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]:     </loader>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]:   </os>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]:   <cpu>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]:     <mode name='host-passthrough' supported='no'/>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]:     <mode name='maximum' supported='no'/>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]:     <mode name='host-model' supported='no'/>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]:     <mode name='custom' supported='no'/>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]:   <memoryBacking supported='yes'>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]:     <enum name='sourceType'>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]:       <value>file</value>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]:       <value>anonymous</value>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]:       <value>memfd</value>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]:     </enum>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]:   </memoryBacking>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]:   <devices>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]:     <disk supported='yes'>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]:       <enum name='diskDevice'>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]:         <value>disk</value>
May 28 01:49:21.405439 np0000001583 nova-compute[98241]:         <value>cdrom</value>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:         <value>floppy</value>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:         <value>lun</value>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:         <value>fdc</value>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:     </disk>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:     <graphics supported='yes'>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:         <value>sdl</value>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:         <value>vnc</value>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:         <value>spice</value>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:         <value>egl-headless</value>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:         <value>dbus</value>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:     </graphics>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:     <video supported='yes'>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:       <enum name='modelType'>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:         <value>none</value>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:     </video>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:     <hostdev supported='yes'>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:       <enum name='mode'>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:         <value>subsystem</value>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:       <enum name='startupPolicy'>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:         <value>default</value>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:         <value>mandatory</value>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:         <value>requisite</value>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:         <value>optional</value>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:       <enum name='subsysType'>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:         <value>pci</value>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:       <enum name='capsType'/>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:       <enum name='pciBackend'/>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:     </hostdev>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:     <rng supported='yes'>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:       <enum name='model'/>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:         <value>random</value>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:         <value>egd</value>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:     </rng>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:     <filesystem supported='yes'>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:       <enum name='driverType'>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:         <value>path</value>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:         <value>handle</value>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:     </filesystem>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:     <tpm supported='no'/>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:     <redirdev supported='no'/>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:     <channel supported='yes'>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:         <value>pty</value>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:         <value>unix</value>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:         <value>spicevmc</value>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:     </channel>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:     <crypto supported='yes'>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:       <enum name='model'/>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:         <value>qemu</value>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:     </crypto>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:   </devices>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:   <features>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:     <gic supported='no'/>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:     <vmcoreinfo supported='no'/>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:     <genid supported='no'/>
May 28 01:49:21.406502 np0000001583 nova-compute[98241]:     <backingStoreInput supported='yes'/>
May 28 01:49:21.408904 np0000001583 nova-compute[98241]:     <backup supported='yes'/>
May 28 01:49:21.408904 np0000001583 nova-compute[98241]:     <async-teardown supported='yes'/>
May 28 01:49:21.408904 np0000001583 nova-compute[98241]:     <sev supported='no'/>
May 28 01:49:21.408904 np0000001583 nova-compute[98241]:     <sgx supported='no'/>
May 28 01:49:21.408904 np0000001583 nova-compute[98241]:   </features>
May 28 01:49:21.408904 np0000001583 nova-compute[98241]: </domainCapabilities>
May 28 01:49:21.408904 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 01:49:21.408904 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'pc', 'ubuntu-q35', 'q35'} {{(pid=98241) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 01:49:21.408904 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
May 28 01:49:21.408904 np0000001583 nova-compute[98241]: <domainCapabilities>
May 28 01:49:21.408904 np0000001583 nova-compute[98241]:   <path>/usr/bin/qemu-system-i386</path>
May 28 01:49:21.408904 np0000001583 nova-compute[98241]:   <domain>qemu</domain>
May 28 01:49:21.408904 np0000001583 nova-compute[98241]:   <machine>pc-i440fx-noble-v2</machine>
May 28 01:49:21.408904 np0000001583 nova-compute[98241]:   <arch>i686</arch>
May 28 01:49:21.408904 np0000001583 nova-compute[98241]:   <vcpu max='255'/>
May 28 01:49:21.408904 np0000001583 nova-compute[98241]:   <iothreads supported='yes'/>
May 28 01:49:21.408904 np0000001583 nova-compute[98241]:   <os supported='yes'>
May 28 01:49:21.408904 np0000001583 nova-compute[98241]:     <enum name='firmware'/>
May 28 01:49:21.408904 np0000001583 nova-compute[98241]:     <loader supported='yes'>
May 28 01:49:21.408904 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 01:49:21.408904 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 01:49:21.408904 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.408904 np0000001583 nova-compute[98241]:         <value>rom</value>
May 28 01:49:21.408904 np0000001583 nova-compute[98241]:         <value>pflash</value>
May 28 01:49:21.408904 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.408904 np0000001583 nova-compute[98241]:       <enum name='readonly'>
May 28 01:49:21.408904 np0000001583 nova-compute[98241]:         <value>yes</value>
May 28 01:49:21.408904 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.408904 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.408904 np0000001583 nova-compute[98241]:       <enum name='secure'>
May 28 01:49:21.408904 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.408904 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.408904 np0000001583 nova-compute[98241]:     </loader>
May 28 01:49:21.408904 np0000001583 nova-compute[98241]:   </os>
May 28 01:49:21.408904 np0000001583 nova-compute[98241]:   <cpu>
May 28 01:49:21.408904 np0000001583 nova-compute[98241]:     <mode name='host-passthrough' supported='no'/>
May 28 01:49:21.408904 np0000001583 nova-compute[98241]:     <mode name='maximum' supported='yes'>
May 28 01:49:21.408904 np0000001583 nova-compute[98241]:       <enum name='maximumMigratable'>
May 28 01:49:21.408904 np0000001583 nova-compute[98241]:         <value>on</value>
May 28 01:49:21.408904 np0000001583 nova-compute[98241]:         <value>off</value>
May 28 01:49:21.408904 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.408904 np0000001583 nova-compute[98241]:     </mode>
May 28 01:49:21.408904 np0000001583 nova-compute[98241]:     <mode name='host-model' supported='yes'>
May 28 01:49:21.408904 np0000001583 nova-compute[98241]:       <model fallback='forbid'>EPYC</model>
May 28 01:49:21.408904 np0000001583 nova-compute[98241]:       <vendor>AMD</vendor>
May 28 01:49:21.408904 np0000001583 nova-compute[98241]:       <feature policy='require' name='acpi'/>
May 28 01:49:21.408904 np0000001583 nova-compute[98241]:       <feature policy='require' name='ss'/>
May 28 01:49:21.408904 np0000001583 nova-compute[98241]:       <feature policy='require' name='monitor'/>
May 28 01:49:21.408904 np0000001583 nova-compute[98241]:       <feature policy='require' name='hypervisor'/>
May 28 01:49:21.408904 np0000001583 nova-compute[98241]:       <feature policy='require' name='erms'/>
May 28 01:49:21.408904 np0000001583 nova-compute[98241]:       <feature policy='require' name='mpx'/>
May 28 01:49:21.409999 np0000001583 nova-compute[98241]:       <feature policy='require' name='pcommit'/>
May 28 01:49:21.409999 np0000001583 nova-compute[98241]:       <feature policy='require' name='clwb'/>
May 28 01:49:21.409999 np0000001583 nova-compute[98241]:       <feature policy='require' name='umip'/>
May 28 01:49:21.409999 np0000001583 nova-compute[98241]:       <feature policy='require' name='pku'/>
May 28 01:49:21.409999 np0000001583 nova-compute[98241]:       <feature policy='require' name='vaes'/>
May 28 01:49:21.409999 np0000001583 nova-compute[98241]:       <feature policy='require' name='la57'/>
May 28 01:49:21.409999 np0000001583 nova-compute[98241]:       <feature policy='require' name='rdpid'/>
May 28 01:49:21.409999 np0000001583 nova-compute[98241]:       <feature policy='require' name='pks'/>
May 28 01:49:21.409999 np0000001583 nova-compute[98241]:       <feature policy='require' name='fsrm'/>
May 28 01:49:21.409999 np0000001583 nova-compute[98241]:       <feature policy='require' name='fzrm'/>
May 28 01:49:21.409999 np0000001583 nova-compute[98241]:       <feature policy='require' name='fsrs'/>
May 28 01:49:21.409999 np0000001583 nova-compute[98241]:       <feature policy='require' name='fsrc'/>
May 28 01:49:21.409999 np0000001583 nova-compute[98241]:       <feature policy='require' name='3dnowext'/>
May 28 01:49:21.409999 np0000001583 nova-compute[98241]:       <feature policy='require' name='3dnow'/>
May 28 01:49:21.409999 np0000001583 nova-compute[98241]:       <feature policy='require' name='xsaveerptr'/>
May 28 01:49:21.409999 np0000001583 nova-compute[98241]:       <feature policy='require' name='wbnoinvd'/>
May 28 01:49:21.409999 np0000001583 nova-compute[98241]:       <feature policy='require' name='npt'/>
May 28 01:49:21.409999 np0000001583 nova-compute[98241]:       <feature policy='require' name='vgif'/>
May 28 01:49:21.409999 np0000001583 nova-compute[98241]:       <feature policy='require' name='svme-addr-chk'/>
May 28 01:49:21.409999 np0000001583 nova-compute[98241]:       <feature policy='disable' name='vme'/>
May 28 01:49:21.409999 np0000001583 nova-compute[98241]:       <feature policy='disable' name='xsavec'/>
May 28 01:49:21.409999 np0000001583 nova-compute[98241]:       <feature policy='disable' name='fxsr_opt'/>
May 28 01:49:21.409999 np0000001583 nova-compute[98241]:       <feature policy='disable' name='lm'/>
May 28 01:49:21.409999 np0000001583 nova-compute[98241]:       <feature policy='disable' name='misalignsse'/>
May 28 01:49:21.409999 np0000001583 nova-compute[98241]:       <feature policy='disable' name='osvw'/>
May 28 01:49:21.409999 np0000001583 nova-compute[98241]:       <feature policy='disable' name='topoext'/>
May 28 01:49:21.409999 np0000001583 nova-compute[98241]:       <feature policy='disable' name='nrip-save'/>
May 28 01:49:21.409999 np0000001583 nova-compute[98241]:     </mode>
May 28 01:49:21.409999 np0000001583 nova-compute[98241]:     <mode name='custom' supported='yes'>
May 28 01:49:21.409999 np0000001583 nova-compute[98241]:       <model usable='no' vendor='unknown'>qemu64</model>
May 28 01:49:21.409999 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 28 01:49:21.409999 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>phenom</model>
May 28 01:49:21.409999 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 28 01:49:21.409999 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 28 01:49:21.409999 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>pentium</model>
May 28 01:49:21.409999 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='Intel'>n270</model>
May 28 01:49:21.409999 np0000001583 nova-compute[98241]:       <model usable='no' vendor='unknown'>kvm64</model>
May 28 01:49:21.409999 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 28 01:49:21.409999 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 28 01:49:21.409999 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>core2duo</model>
May 28 01:49:21.409999 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='AMD'>athlon</model>
May 28 01:49:21.410735 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 28 01:49:21.410735 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Westmere</model>
May 28 01:49:21.410735 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 28 01:49:21.410735 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 28 01:49:21.410735 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 28 01:49:21.410735 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 28 01:49:21.410735 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 28 01:49:21.410735 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 28 01:49:21.410735 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 28 01:49:21.410735 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 28 01:49:21.410735 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 28 01:49:21.410735 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 28 01:49:21.410735 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Penryn</model>
May 28 01:49:21.410735 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 28 01:49:21.410735 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 28 01:49:21.410735 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 28 01:49:21.410735 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 28 01:49:21.410735 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 28 01:49:21.410735 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 28 01:49:21.410735 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 28 01:49:21.410735 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 28 01:49:21.410735 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 28 01:49:21.410735 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 28 01:49:21.410735 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 28 01:49:21.410735 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 28 01:49:21.410735 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 28 01:49:21.410735 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 28 01:49:21.410735 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Haswell</model>
May 28 01:49:21.410735 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 28 01:49:21.410735 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 28 01:49:21.410735 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 28 01:49:21.410735 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 28 01:49:21.410735 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>EPYC</model>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Conroe</model>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>486</model>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:     </mode>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:   <memoryBacking supported='yes'>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:     <enum name='sourceType'>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:       <value>file</value>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:       <value>anonymous</value>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:       <value>memfd</value>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:     </enum>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:   </memoryBacking>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:   <devices>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:     <disk supported='yes'>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:       <enum name='diskDevice'>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:         <value>disk</value>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:         <value>cdrom</value>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:         <value>floppy</value>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:         <value>lun</value>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:         <value>ide</value>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:         <value>fdc</value>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:         <value>sata</value>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:     </disk>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:     <graphics supported='yes'>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:         <value>sdl</value>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:         <value>vnc</value>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:         <value>spice</value>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:         <value>egl-headless</value>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:         <value>dbus</value>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:     </graphics>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:     <video supported='yes'>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:       <enum name='modelType'>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:         <value>vga</value>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:         <value>cirrus</value>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:         <value>vmvga</value>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:         <value>qxl</value>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:         <value>none</value>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:         <value>bochs</value>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:         <value>ramfb</value>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:     </video>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:     <hostdev supported='yes'>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:       <enum name='mode'>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:         <value>subsystem</value>
May 28 01:49:21.411496 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:       <enum name='startupPolicy'>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:         <value>default</value>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:         <value>mandatory</value>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:         <value>requisite</value>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:         <value>optional</value>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:       <enum name='subsysType'>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:         <value>pci</value>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:       <enum name='capsType'/>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:       <enum name='pciBackend'/>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:     </hostdev>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:     <rng supported='yes'>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:         <value>random</value>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:         <value>egd</value>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:     </rng>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:     <filesystem supported='yes'>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:       <enum name='driverType'>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:         <value>path</value>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:         <value>handle</value>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:         <value>virtiofs</value>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:     </filesystem>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:     <tpm supported='yes'>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:         <value>tpm-tis</value>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:         <value>tpm-crb</value>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:         <value>passthrough</value>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:         <value>emulator</value>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:         <value>external</value>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:       <enum name='backendVersion'>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:         <value>1.2</value>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:         <value>2.0</value>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:     </tpm>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:     <redirdev supported='yes'>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:     </redirdev>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:     <channel supported='yes'>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:         <value>pty</value>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:         <value>unix</value>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:         <value>spicevmc</value>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:     </channel>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:     <crypto supported='yes'>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:         <value>qemu</value>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:     </crypto>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:   </devices>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:   <features>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:     <gic supported='no'/>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:     <vmcoreinfo supported='yes'/>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:     <genid supported='yes'/>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:     <backingStoreInput supported='yes'/>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:     <backup supported='yes'/>
May 28 01:49:21.412663 np0000001583 nova-compute[98241]:     <async-teardown supported='yes'/>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:     <sev supported='no'/>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:     <sgx supported='no'/>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:     <hyperv supported='yes'>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:       <enum name='features'>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:         <value>relaxed</value>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:         <value>vapic</value>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:         <value>spinlocks</value>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:         <value>vpindex</value>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:         <value>runtime</value>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:         <value>synic</value>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:         <value>stimer</value>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:         <value>reset</value>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:         <value>vendor_id</value>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:         <value>frequencies</value>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:         <value>reenlightenment</value>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:         <value>tlbflush</value>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:         <value>ipi</value>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:         <value>avic</value>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:     </hyperv>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:   </features>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]: </domainCapabilities>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 01:49:21.415438 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
May 28 01:49:21.415438 np0000001583 nova-compute[98241]: <domainCapabilities>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:   <path>/usr/bin/qemu-system-i386</path>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:   <domain>qemu</domain>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:   <machine>pc-i440fx-noble</machine>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:   <arch>i686</arch>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:   <vcpu max='255'/>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:   <iothreads supported='yes'/>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:   <os supported='yes'>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:     <enum name='firmware'/>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:     <loader supported='yes'>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:         <value>rom</value>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:         <value>pflash</value>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:       <enum name='readonly'>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:         <value>yes</value>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:       <enum name='secure'>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:     </loader>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:   </os>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:   <cpu>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:     <mode name='host-passthrough' supported='no'/>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:     <mode name='maximum' supported='yes'>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:       <enum name='maximumMigratable'>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:         <value>on</value>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:         <value>off</value>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:     </mode>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:     <mode name='host-model' supported='yes'>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:       <model fallback='forbid'>EPYC</model>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:       <vendor>AMD</vendor>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:       <feature policy='require' name='acpi'/>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:       <feature policy='require' name='ss'/>
May 28 01:49:21.415438 np0000001583 nova-compute[98241]:       <feature policy='require' name='monitor'/>
May 28 01:49:21.416609 np0000001583 nova-compute[98241]:       <feature policy='require' name='hypervisor'/>
May 28 01:49:21.416609 np0000001583 nova-compute[98241]:       <feature policy='require' name='erms'/>
May 28 01:49:21.416609 np0000001583 nova-compute[98241]:       <feature policy='require' name='mpx'/>
May 28 01:49:21.416609 np0000001583 nova-compute[98241]:       <feature policy='require' name='pcommit'/>
May 28 01:49:21.416609 np0000001583 nova-compute[98241]:       <feature policy='require' name='clwb'/>
May 28 01:49:21.416609 np0000001583 nova-compute[98241]:       <feature policy='require' name='umip'/>
May 28 01:49:21.416609 np0000001583 nova-compute[98241]:       <feature policy='require' name='pku'/>
May 28 01:49:21.416609 np0000001583 nova-compute[98241]:       <feature policy='require' name='vaes'/>
May 28 01:49:21.416609 np0000001583 nova-compute[98241]:       <feature policy='require' name='la57'/>
May 28 01:49:21.416609 np0000001583 nova-compute[98241]:       <feature policy='require' name='rdpid'/>
May 28 01:49:21.416609 np0000001583 nova-compute[98241]:       <feature policy='require' name='pks'/>
May 28 01:49:21.416609 np0000001583 nova-compute[98241]:       <feature policy='require' name='fsrm'/>
May 28 01:49:21.416609 np0000001583 nova-compute[98241]:       <feature policy='require' name='fzrm'/>
May 28 01:49:21.416609 np0000001583 nova-compute[98241]:       <feature policy='require' name='fsrs'/>
May 28 01:49:21.416609 np0000001583 nova-compute[98241]:       <feature policy='require' name='fsrc'/>
May 28 01:49:21.416609 np0000001583 nova-compute[98241]:       <feature policy='require' name='3dnowext'/>
May 28 01:49:21.416609 np0000001583 nova-compute[98241]:       <feature policy='require' name='3dnow'/>
May 28 01:49:21.416609 np0000001583 nova-compute[98241]:       <feature policy='require' name='xsaveerptr'/>
May 28 01:49:21.416609 np0000001583 nova-compute[98241]:       <feature policy='require' name='wbnoinvd'/>
May 28 01:49:21.416609 np0000001583 nova-compute[98241]:       <feature policy='require' name='npt'/>
May 28 01:49:21.416609 np0000001583 nova-compute[98241]:       <feature policy='require' name='vgif'/>
May 28 01:49:21.416609 np0000001583 nova-compute[98241]:       <feature policy='require' name='svme-addr-chk'/>
May 28 01:49:21.416609 np0000001583 nova-compute[98241]:       <feature policy='disable' name='vme'/>
May 28 01:49:21.416609 np0000001583 nova-compute[98241]:       <feature policy='disable' name='xsavec'/>
May 28 01:49:21.416609 np0000001583 nova-compute[98241]:       <feature policy='disable' name='fxsr_opt'/>
May 28 01:49:21.416609 np0000001583 nova-compute[98241]:       <feature policy='disable' name='lm'/>
May 28 01:49:21.416609 np0000001583 nova-compute[98241]:       <feature policy='disable' name='misalignsse'/>
May 28 01:49:21.416609 np0000001583 nova-compute[98241]:       <feature policy='disable' name='osvw'/>
May 28 01:49:21.416609 np0000001583 nova-compute[98241]:       <feature policy='disable' name='topoext'/>
May 28 01:49:21.416609 np0000001583 nova-compute[98241]:       <feature policy='disable' name='nrip-save'/>
May 28 01:49:21.416609 np0000001583 nova-compute[98241]:     </mode>
May 28 01:49:21.416609 np0000001583 nova-compute[98241]:     <mode name='custom' supported='yes'>
May 28 01:49:21.416609 np0000001583 nova-compute[98241]:       <model usable='no' vendor='unknown'>qemu64</model>
May 28 01:49:21.416609 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 28 01:49:21.416609 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>phenom</model>
May 28 01:49:21.416609 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 28 01:49:21.416609 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 28 01:49:21.416609 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>pentium</model>
May 28 01:49:21.416609 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='Intel'>n270</model>
May 28 01:49:21.416609 np0000001583 nova-compute[98241]:       <model usable='no' vendor='unknown'>kvm64</model>
May 28 01:49:21.416609 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 28 01:49:21.416609 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 28 01:49:21.417597 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>core2duo</model>
May 28 01:49:21.417597 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='AMD'>athlon</model>
May 28 01:49:21.417597 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 28 01:49:21.417597 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Westmere</model>
May 28 01:49:21.417597 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 28 01:49:21.417597 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 28 01:49:21.417597 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 28 01:49:21.417597 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 28 01:49:21.417597 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 28 01:49:21.417597 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 28 01:49:21.417597 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 28 01:49:21.417597 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 28 01:49:21.417597 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 28 01:49:21.417597 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 28 01:49:21.417597 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Penryn</model>
May 28 01:49:21.417597 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 28 01:49:21.417597 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 28 01:49:21.417597 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 28 01:49:21.417597 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 28 01:49:21.417597 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 28 01:49:21.417597 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 28 01:49:21.417597 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 28 01:49:21.417597 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 28 01:49:21.417597 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 28 01:49:21.417597 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 28 01:49:21.417597 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 28 01:49:21.417597 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 28 01:49:21.417597 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 28 01:49:21.417597 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 28 01:49:21.417597 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Haswell</model>
May 28 01:49:21.417597 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 28 01:49:21.417597 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 28 01:49:21.417597 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>EPYC</model>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Conroe</model>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>486</model>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:     </mode>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:   <memoryBacking supported='yes'>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:     <enum name='sourceType'>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:       <value>file</value>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:       <value>anonymous</value>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:       <value>memfd</value>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:     </enum>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:   </memoryBacking>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:   <devices>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:     <disk supported='yes'>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:       <enum name='diskDevice'>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:         <value>disk</value>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:         <value>cdrom</value>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:         <value>floppy</value>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:         <value>lun</value>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:         <value>ide</value>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:         <value>fdc</value>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:         <value>sata</value>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:     </disk>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:     <graphics supported='yes'>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:         <value>sdl</value>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:         <value>vnc</value>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:         <value>spice</value>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:         <value>egl-headless</value>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:         <value>dbus</value>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:     </graphics>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:     <video supported='yes'>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:       <enum name='modelType'>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:         <value>vga</value>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:         <value>cirrus</value>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:         <value>vmvga</value>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:         <value>qxl</value>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:         <value>none</value>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:         <value>bochs</value>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:         <value>ramfb</value>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.418154 np0000001583 nova-compute[98241]:     </video>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:     <hostdev supported='yes'>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:       <enum name='mode'>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:         <value>subsystem</value>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:       <enum name='startupPolicy'>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:         <value>default</value>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:         <value>mandatory</value>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:         <value>requisite</value>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:         <value>optional</value>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:       <enum name='subsysType'>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:         <value>pci</value>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:       <enum name='capsType'/>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:       <enum name='pciBackend'/>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:     </hostdev>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:     <rng supported='yes'>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:         <value>random</value>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:         <value>egd</value>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:     </rng>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:     <filesystem supported='yes'>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:       <enum name='driverType'>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:         <value>path</value>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:         <value>handle</value>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:         <value>virtiofs</value>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:     </filesystem>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:     <tpm supported='yes'>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:         <value>tpm-tis</value>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:         <value>tpm-crb</value>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:         <value>passthrough</value>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:         <value>emulator</value>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:         <value>external</value>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:       <enum name='backendVersion'>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:         <value>1.2</value>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:         <value>2.0</value>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:     </tpm>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:     <redirdev supported='yes'>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:     </redirdev>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:     <channel supported='yes'>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:         <value>pty</value>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:         <value>unix</value>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:         <value>spicevmc</value>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:     </channel>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:     <crypto supported='yes'>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:         <value>qemu</value>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:     </crypto>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:   </devices>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:   <features>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:     <gic supported='no'/>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:     <vmcoreinfo supported='yes'/>
May 28 01:49:21.419206 np0000001583 nova-compute[98241]:     <genid supported='yes'/>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:     <backingStoreInput supported='yes'/>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:     <backup supported='yes'/>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:     <async-teardown supported='yes'/>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:     <sev supported='no'/>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:     <sgx supported='no'/>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:     <hyperv supported='yes'>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:       <enum name='features'>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:         <value>relaxed</value>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:         <value>vapic</value>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:         <value>spinlocks</value>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:         <value>vpindex</value>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:         <value>runtime</value>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:         <value>synic</value>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:         <value>stimer</value>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:         <value>reset</value>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:         <value>vendor_id</value>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:         <value>frequencies</value>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:         <value>reenlightenment</value>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:         <value>tlbflush</value>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:         <value>ipi</value>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:         <value>avic</value>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:     </hyperv>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:   </features>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]: </domainCapabilities>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 01:49:21.421159 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
May 28 01:49:21.421159 np0000001583 nova-compute[98241]: <domainCapabilities>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:   <path>/usr/bin/qemu-system-i386</path>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:   <domain>qemu</domain>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:   <machine>pc-q35-noble-v2</machine>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:   <arch>i686</arch>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:   <vcpu max='1024'/>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:   <iothreads supported='yes'/>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:   <os supported='yes'>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:     <enum name='firmware'/>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:     <loader supported='yes'>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:         <value>rom</value>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:         <value>pflash</value>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:       <enum name='readonly'>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:         <value>yes</value>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:       <enum name='secure'>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:     </loader>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:   </os>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:   <cpu>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:     <mode name='host-passthrough' supported='no'/>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:     <mode name='maximum' supported='yes'>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:       <enum name='maximumMigratable'>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:         <value>on</value>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:         <value>off</value>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:     </mode>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:     <mode name='host-model' supported='yes'>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:       <model fallback='forbid'>EPYC</model>
May 28 01:49:21.421159 np0000001583 nova-compute[98241]:       <vendor>AMD</vendor>
May 28 01:49:21.422169 np0000001583 nova-compute[98241]:       <feature policy='require' name='acpi'/>
May 28 01:49:21.422169 np0000001583 nova-compute[98241]:       <feature policy='require' name='ss'/>
May 28 01:49:21.422169 np0000001583 nova-compute[98241]:       <feature policy='require' name='monitor'/>
May 28 01:49:21.422169 np0000001583 nova-compute[98241]:       <feature policy='require' name='hypervisor'/>
May 28 01:49:21.422169 np0000001583 nova-compute[98241]:       <feature policy='require' name='erms'/>
May 28 01:49:21.422169 np0000001583 nova-compute[98241]:       <feature policy='require' name='mpx'/>
May 28 01:49:21.422169 np0000001583 nova-compute[98241]:       <feature policy='require' name='pcommit'/>
May 28 01:49:21.422169 np0000001583 nova-compute[98241]:       <feature policy='require' name='clwb'/>
May 28 01:49:21.422169 np0000001583 nova-compute[98241]:       <feature policy='require' name='umip'/>
May 28 01:49:21.422169 np0000001583 nova-compute[98241]:       <feature policy='require' name='pku'/>
May 28 01:49:21.422169 np0000001583 nova-compute[98241]:       <feature policy='require' name='vaes'/>
May 28 01:49:21.422169 np0000001583 nova-compute[98241]:       <feature policy='require' name='la57'/>
May 28 01:49:21.422169 np0000001583 nova-compute[98241]:       <feature policy='require' name='rdpid'/>
May 28 01:49:21.422169 np0000001583 nova-compute[98241]:       <feature policy='require' name='pks'/>
May 28 01:49:21.422169 np0000001583 nova-compute[98241]:       <feature policy='require' name='fsrm'/>
May 28 01:49:21.422169 np0000001583 nova-compute[98241]:       <feature policy='require' name='fzrm'/>
May 28 01:49:21.422169 np0000001583 nova-compute[98241]:       <feature policy='require' name='fsrs'/>
May 28 01:49:21.422169 np0000001583 nova-compute[98241]:       <feature policy='require' name='fsrc'/>
May 28 01:49:21.422169 np0000001583 nova-compute[98241]:       <feature policy='require' name='3dnowext'/>
May 28 01:49:21.422169 np0000001583 nova-compute[98241]:       <feature policy='require' name='3dnow'/>
May 28 01:49:21.422169 np0000001583 nova-compute[98241]:       <feature policy='require' name='xsaveerptr'/>
May 28 01:49:21.422169 np0000001583 nova-compute[98241]:       <feature policy='require' name='wbnoinvd'/>
May 28 01:49:21.422169 np0000001583 nova-compute[98241]:       <feature policy='require' name='npt'/>
May 28 01:49:21.422169 np0000001583 nova-compute[98241]:       <feature policy='require' name='vgif'/>
May 28 01:49:21.422169 np0000001583 nova-compute[98241]:       <feature policy='require' name='svme-addr-chk'/>
May 28 01:49:21.422169 np0000001583 nova-compute[98241]:       <feature policy='disable' name='vme'/>
May 28 01:49:21.422169 np0000001583 nova-compute[98241]:       <feature policy='disable' name='xsavec'/>
May 28 01:49:21.422169 np0000001583 nova-compute[98241]:       <feature policy='disable' name='fxsr_opt'/>
May 28 01:49:21.422169 np0000001583 nova-compute[98241]:       <feature policy='disable' name='lm'/>
May 28 01:49:21.422169 np0000001583 nova-compute[98241]:       <feature policy='disable' name='misalignsse'/>
May 28 01:49:21.422169 np0000001583 nova-compute[98241]:       <feature policy='disable' name='osvw'/>
May 28 01:49:21.422169 np0000001583 nova-compute[98241]:       <feature policy='disable' name='topoext'/>
May 28 01:49:21.422169 np0000001583 nova-compute[98241]:       <feature policy='disable' name='nrip-save'/>
May 28 01:49:21.422169 np0000001583 nova-compute[98241]:     </mode>
May 28 01:49:21.422169 np0000001583 nova-compute[98241]:     <mode name='custom' supported='yes'>
May 28 01:49:21.422169 np0000001583 nova-compute[98241]:       <model usable='no' vendor='unknown'>qemu64</model>
May 28 01:49:21.422169 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 28 01:49:21.422169 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>phenom</model>
May 28 01:49:21.422169 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 28 01:49:21.422169 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 28 01:49:21.422169 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>pentium</model>
May 28 01:49:21.422169 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='Intel'>n270</model>
May 28 01:49:21.422909 np0000001583 nova-compute[98241]:       <model usable='no' vendor='unknown'>kvm64</model>
May 28 01:49:21.422909 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 28 01:49:21.422909 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 28 01:49:21.422909 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>core2duo</model>
May 28 01:49:21.422909 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='AMD'>athlon</model>
May 28 01:49:21.422909 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 28 01:49:21.422909 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Westmere</model>
May 28 01:49:21.422909 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 28 01:49:21.422909 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 28 01:49:21.422909 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 28 01:49:21.422909 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 28 01:49:21.422909 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 28 01:49:21.422909 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 28 01:49:21.422909 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 28 01:49:21.422909 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 28 01:49:21.422909 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 28 01:49:21.422909 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 28 01:49:21.422909 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Penryn</model>
May 28 01:49:21.422909 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 28 01:49:21.422909 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 28 01:49:21.422909 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 28 01:49:21.422909 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 28 01:49:21.422909 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 28 01:49:21.422909 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 28 01:49:21.422909 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 28 01:49:21.422909 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 28 01:49:21.422909 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 28 01:49:21.422909 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 28 01:49:21.422909 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 28 01:49:21.422909 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 28 01:49:21.422909 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 28 01:49:21.422909 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 28 01:49:21.422909 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Haswell</model>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>EPYC</model>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Conroe</model>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>486</model>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:     </mode>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:   <memoryBacking supported='yes'>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:     <enum name='sourceType'>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:       <value>file</value>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:       <value>anonymous</value>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:       <value>memfd</value>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:     </enum>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:   </memoryBacking>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:   <devices>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:     <disk supported='yes'>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:       <enum name='diskDevice'>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:         <value>disk</value>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:         <value>cdrom</value>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:         <value>floppy</value>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:         <value>lun</value>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:         <value>fdc</value>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:         <value>sata</value>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:     </disk>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:     <graphics supported='yes'>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:         <value>sdl</value>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:         <value>vnc</value>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:         <value>spice</value>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:         <value>egl-headless</value>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:         <value>dbus</value>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:     </graphics>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:     <video supported='yes'>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:       <enum name='modelType'>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:         <value>vga</value>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:         <value>cirrus</value>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:         <value>vmvga</value>
May 28 01:49:21.423414 np0000001583 nova-compute[98241]:         <value>qxl</value>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:         <value>none</value>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:         <value>bochs</value>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:         <value>ramfb</value>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:     </video>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:     <hostdev supported='yes'>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:       <enum name='mode'>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:         <value>subsystem</value>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:       <enum name='startupPolicy'>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:         <value>default</value>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:         <value>mandatory</value>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:         <value>requisite</value>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:         <value>optional</value>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:       <enum name='subsysType'>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:         <value>pci</value>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:       <enum name='capsType'/>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:       <enum name='pciBackend'/>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:     </hostdev>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:     <rng supported='yes'>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:         <value>random</value>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:         <value>egd</value>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:     </rng>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:     <filesystem supported='yes'>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:       <enum name='driverType'>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:         <value>path</value>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:         <value>handle</value>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:         <value>virtiofs</value>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:     </filesystem>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:     <tpm supported='yes'>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:         <value>tpm-tis</value>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:         <value>tpm-crb</value>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:         <value>passthrough</value>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:         <value>emulator</value>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:         <value>external</value>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:       <enum name='backendVersion'>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:         <value>1.2</value>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:         <value>2.0</value>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:     </tpm>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:     <redirdev supported='yes'>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:     </redirdev>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:     <channel supported='yes'>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:         <value>pty</value>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:         <value>unix</value>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:         <value>spicevmc</value>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:     </channel>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:     <crypto supported='yes'>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:         <value>qemu</value>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.424781 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:     </crypto>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:   </devices>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:   <features>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:     <gic supported='no'/>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:     <vmcoreinfo supported='yes'/>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:     <genid supported='yes'/>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:     <backingStoreInput supported='yes'/>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:     <backup supported='yes'/>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:     <async-teardown supported='yes'/>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:     <sev supported='no'/>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:     <sgx supported='no'/>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:     <hyperv supported='yes'>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:       <enum name='features'>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:         <value>relaxed</value>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:         <value>vapic</value>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:         <value>spinlocks</value>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:         <value>vpindex</value>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:         <value>runtime</value>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:         <value>synic</value>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:         <value>stimer</value>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:         <value>reset</value>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:         <value>vendor_id</value>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:         <value>frequencies</value>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:         <value>reenlightenment</value>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:         <value>tlbflush</value>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:         <value>ipi</value>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:         <value>avic</value>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:     </hyperv>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:   </features>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]: </domainCapabilities>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 01:49:21.426129 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
May 28 01:49:21.426129 np0000001583 nova-compute[98241]: <domainCapabilities>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:   <path>/usr/bin/qemu-system-i386</path>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:   <domain>qemu</domain>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:   <machine>pc-q35-noble</machine>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:   <arch>i686</arch>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:   <vcpu max='1024'/>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:   <iothreads supported='yes'/>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:   <os supported='yes'>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:     <enum name='firmware'/>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:     <loader supported='yes'>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:         <value>rom</value>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:         <value>pflash</value>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:       <enum name='readonly'>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:         <value>yes</value>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:       <enum name='secure'>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:     </loader>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:   </os>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:   <cpu>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:     <mode name='host-passthrough' supported='no'/>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:     <mode name='maximum' supported='yes'>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:       <enum name='maximumMigratable'>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:         <value>on</value>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:         <value>off</value>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.426129 np0000001583 nova-compute[98241]:     </mode>
May 28 01:49:21.427558 np0000001583 nova-compute[98241]:     <mode name='host-model' supported='yes'>
May 28 01:49:21.427558 np0000001583 nova-compute[98241]:       <model fallback='forbid'>EPYC</model>
May 28 01:49:21.427558 np0000001583 nova-compute[98241]:       <vendor>AMD</vendor>
May 28 01:49:21.427558 np0000001583 nova-compute[98241]:       <feature policy='require' name='acpi'/>
May 28 01:49:21.427558 np0000001583 nova-compute[98241]:       <feature policy='require' name='ss'/>
May 28 01:49:21.427558 np0000001583 nova-compute[98241]:       <feature policy='require' name='monitor'/>
May 28 01:49:21.427558 np0000001583 nova-compute[98241]:       <feature policy='require' name='hypervisor'/>
May 28 01:49:21.427558 np0000001583 nova-compute[98241]:       <feature policy='require' name='erms'/>
May 28 01:49:21.427558 np0000001583 nova-compute[98241]:       <feature policy='require' name='mpx'/>
May 28 01:49:21.427558 np0000001583 nova-compute[98241]:       <feature policy='require' name='pcommit'/>
May 28 01:49:21.427558 np0000001583 nova-compute[98241]:       <feature policy='require' name='clwb'/>
May 28 01:49:21.427558 np0000001583 nova-compute[98241]:       <feature policy='require' name='umip'/>
May 28 01:49:21.427558 np0000001583 nova-compute[98241]:       <feature policy='require' name='pku'/>
May 28 01:49:21.427558 np0000001583 nova-compute[98241]:       <feature policy='require' name='vaes'/>
May 28 01:49:21.427558 np0000001583 nova-compute[98241]:       <feature policy='require' name='la57'/>
May 28 01:49:21.427558 np0000001583 nova-compute[98241]:       <feature policy='require' name='rdpid'/>
May 28 01:49:21.427558 np0000001583 nova-compute[98241]:       <feature policy='require' name='pks'/>
May 28 01:49:21.427558 np0000001583 nova-compute[98241]:       <feature policy='require' name='fsrm'/>
May 28 01:49:21.427558 np0000001583 nova-compute[98241]:       <feature policy='require' name='fzrm'/>
May 28 01:49:21.427558 np0000001583 nova-compute[98241]:       <feature policy='require' name='fsrs'/>
May 28 01:49:21.427558 np0000001583 nova-compute[98241]:       <feature policy='require' name='fsrc'/>
May 28 01:49:21.427558 np0000001583 nova-compute[98241]:       <feature policy='require' name='3dnowext'/>
May 28 01:49:21.427558 np0000001583 nova-compute[98241]:       <feature policy='require' name='3dnow'/>
May 28 01:49:21.427558 np0000001583 nova-compute[98241]:       <feature policy='require' name='xsaveerptr'/>
May 28 01:49:21.427558 np0000001583 nova-compute[98241]:       <feature policy='require' name='wbnoinvd'/>
May 28 01:49:21.427558 np0000001583 nova-compute[98241]:       <feature policy='require' name='npt'/>
May 28 01:49:21.427558 np0000001583 nova-compute[98241]:       <feature policy='require' name='vgif'/>
May 28 01:49:21.427558 np0000001583 nova-compute[98241]:       <feature policy='require' name='svme-addr-chk'/>
May 28 01:49:21.427558 np0000001583 nova-compute[98241]:       <feature policy='disable' name='vme'/>
May 28 01:49:21.427558 np0000001583 nova-compute[98241]:       <feature policy='disable' name='xsavec'/>
May 28 01:49:21.427558 np0000001583 nova-compute[98241]:       <feature policy='disable' name='fxsr_opt'/>
May 28 01:49:21.427558 np0000001583 nova-compute[98241]:       <feature policy='disable' name='lm'/>
May 28 01:49:21.427558 np0000001583 nova-compute[98241]:       <feature policy='disable' name='misalignsse'/>
May 28 01:49:21.427558 np0000001583 nova-compute[98241]:       <feature policy='disable' name='osvw'/>
May 28 01:49:21.427558 np0000001583 nova-compute[98241]:       <feature policy='disable' name='topoext'/>
May 28 01:49:21.427558 np0000001583 nova-compute[98241]:       <feature policy='disable' name='nrip-save'/>
May 28 01:49:21.427558 np0000001583 nova-compute[98241]:     </mode>
May 28 01:49:21.427558 np0000001583 nova-compute[98241]:     <mode name='custom' supported='yes'>
May 28 01:49:21.427558 np0000001583 nova-compute[98241]:       <model usable='no' vendor='unknown'>qemu64</model>
May 28 01:49:21.427558 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 28 01:49:21.427558 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>phenom</model>
May 28 01:49:21.427558 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 28 01:49:21.427558 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 28 01:49:21.428302 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>pentium</model>
May 28 01:49:21.428302 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='Intel'>n270</model>
May 28 01:49:21.428302 np0000001583 nova-compute[98241]:       <model usable='no' vendor='unknown'>kvm64</model>
May 28 01:49:21.428302 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 28 01:49:21.428302 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 28 01:49:21.428302 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>core2duo</model>
May 28 01:49:21.428302 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='AMD'>athlon</model>
May 28 01:49:21.428302 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 28 01:49:21.428302 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Westmere</model>
May 28 01:49:21.428302 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 28 01:49:21.428302 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 28 01:49:21.428302 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 28 01:49:21.428302 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 28 01:49:21.428302 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 28 01:49:21.428302 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 28 01:49:21.428302 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 28 01:49:21.428302 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 28 01:49:21.428302 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 28 01:49:21.428302 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 28 01:49:21.428302 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Penryn</model>
May 28 01:49:21.428302 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 28 01:49:21.428302 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 28 01:49:21.428302 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 28 01:49:21.428302 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 28 01:49:21.428302 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 28 01:49:21.428302 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 28 01:49:21.428302 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 28 01:49:21.428302 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 28 01:49:21.428302 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 28 01:49:21.428302 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 28 01:49:21.428302 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 28 01:49:21.428302 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 28 01:49:21.428302 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Haswell</model>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>EPYC</model>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Conroe</model>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>486</model>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:     </mode>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:   <memoryBacking supported='yes'>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:     <enum name='sourceType'>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:       <value>file</value>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:       <value>anonymous</value>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:       <value>memfd</value>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:     </enum>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:   </memoryBacking>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:   <devices>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:     <disk supported='yes'>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:       <enum name='diskDevice'>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:         <value>disk</value>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:         <value>cdrom</value>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:         <value>floppy</value>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:         <value>lun</value>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:         <value>fdc</value>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:         <value>sata</value>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:     </disk>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:     <graphics supported='yes'>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:         <value>sdl</value>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:         <value>vnc</value>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:         <value>spice</value>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:         <value>egl-headless</value>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:         <value>dbus</value>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:     </graphics>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:     <video supported='yes'>
May 28 01:49:21.428931 np0000001583 nova-compute[98241]:       <enum name='modelType'>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:         <value>vga</value>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:         <value>cirrus</value>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:         <value>vmvga</value>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:         <value>qxl</value>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:         <value>none</value>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:         <value>bochs</value>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:         <value>ramfb</value>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:     </video>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:     <hostdev supported='yes'>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:       <enum name='mode'>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:         <value>subsystem</value>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:       <enum name='startupPolicy'>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:         <value>default</value>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:         <value>mandatory</value>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:         <value>requisite</value>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:         <value>optional</value>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:       <enum name='subsysType'>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:         <value>pci</value>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:       <enum name='capsType'/>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:       <enum name='pciBackend'/>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:     </hostdev>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:     <rng supported='yes'>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:         <value>random</value>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:         <value>egd</value>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:     </rng>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:     <filesystem supported='yes'>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:       <enum name='driverType'>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:         <value>path</value>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:         <value>handle</value>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:         <value>virtiofs</value>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:     </filesystem>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:     <tpm supported='yes'>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:         <value>tpm-tis</value>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:         <value>tpm-crb</value>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:         <value>passthrough</value>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:         <value>emulator</value>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:         <value>external</value>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:       <enum name='backendVersion'>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:         <value>1.2</value>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:         <value>2.0</value>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:     </tpm>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:     <redirdev supported='yes'>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:     </redirdev>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:     <channel supported='yes'>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:         <value>pty</value>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:         <value>unix</value>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:         <value>spicevmc</value>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:     </channel>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:     <crypto supported='yes'>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.430024 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.431281 np0000001583 nova-compute[98241]:         <value>qemu</value>
May 28 01:49:21.431281 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.431281 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.431281 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.431281 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.431281 np0000001583 nova-compute[98241]:     </crypto>
May 28 01:49:21.431281 np0000001583 nova-compute[98241]:   </devices>
May 28 01:49:21.431281 np0000001583 nova-compute[98241]:   <features>
May 28 01:49:21.431281 np0000001583 nova-compute[98241]:     <gic supported='no'/>
May 28 01:49:21.431281 np0000001583 nova-compute[98241]:     <vmcoreinfo supported='yes'/>
May 28 01:49:21.431281 np0000001583 nova-compute[98241]:     <genid supported='yes'/>
May 28 01:49:21.431281 np0000001583 nova-compute[98241]:     <backingStoreInput supported='yes'/>
May 28 01:49:21.431281 np0000001583 nova-compute[98241]:     <backup supported='yes'/>
May 28 01:49:21.431281 np0000001583 nova-compute[98241]:     <async-teardown supported='yes'/>
May 28 01:49:21.431281 np0000001583 nova-compute[98241]:     <sev supported='no'/>
May 28 01:49:21.431281 np0000001583 nova-compute[98241]:     <sgx supported='no'/>
May 28 01:49:21.431281 np0000001583 nova-compute[98241]:     <hyperv supported='yes'>
May 28 01:49:21.431281 np0000001583 nova-compute[98241]:       <enum name='features'>
May 28 01:49:21.431281 np0000001583 nova-compute[98241]:         <value>relaxed</value>
May 28 01:49:21.431281 np0000001583 nova-compute[98241]:         <value>vapic</value>
May 28 01:49:21.431281 np0000001583 nova-compute[98241]:         <value>spinlocks</value>
May 28 01:49:21.431281 np0000001583 nova-compute[98241]:         <value>vpindex</value>
May 28 01:49:21.431281 np0000001583 nova-compute[98241]:         <value>runtime</value>
May 28 01:49:21.431281 np0000001583 nova-compute[98241]:         <value>synic</value>
May 28 01:49:21.431281 np0000001583 nova-compute[98241]:         <value>stimer</value>
May 28 01:49:21.431281 np0000001583 nova-compute[98241]:         <value>reset</value>
May 28 01:49:21.431281 np0000001583 nova-compute[98241]:         <value>vendor_id</value>
May 28 01:49:21.431281 np0000001583 nova-compute[98241]:         <value>frequencies</value>
May 28 01:49:21.431281 np0000001583 nova-compute[98241]:         <value>reenlightenment</value>
May 28 01:49:21.431281 np0000001583 nova-compute[98241]:         <value>tlbflush</value>
May 28 01:49:21.431281 np0000001583 nova-compute[98241]:         <value>ipi</value>
May 28 01:49:21.431281 np0000001583 nova-compute[98241]:         <value>avic</value>
May 28 01:49:21.431281 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.431281 np0000001583 nova-compute[98241]:     </hyperv>
May 28 01:49:21.431281 np0000001583 nova-compute[98241]:   </features>
May 28 01:49:21.431281 np0000001583 nova-compute[98241]: </domainCapabilities>
May 28 01:49:21.431281 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 01:49:21.431281 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=98241) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 01:49:21.431281 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Libvirt host hypervisor capabilities for arch=m68k and machine_type=None:
May 28 01:49:21.431281 np0000001583 nova-compute[98241]: <domainCapabilities>
May 28 01:49:21.431281 np0000001583 nova-compute[98241]:   <path>/usr/bin/qemu-system-m68k</path>
May 28 01:49:21.431281 np0000001583 nova-compute[98241]:   <domain>qemu</domain>
May 28 01:49:21.431281 np0000001583 nova-compute[98241]:   <machine>mcf5208evb</machine>
May 28 01:49:21.431281 np0000001583 nova-compute[98241]:   <arch>m68k</arch>
May 28 01:49:21.431281 np0000001583 nova-compute[98241]:   <vcpu max='1'/>
May 28 01:49:21.431281 np0000001583 nova-compute[98241]:   <iothreads supported='yes'/>
May 28 01:49:21.431281 np0000001583 nova-compute[98241]:   <os supported='yes'>
May 28 01:49:21.431281 np0000001583 nova-compute[98241]:     <enum name='firmware'/>
May 28 01:49:21.431281 np0000001583 nova-compute[98241]:     <loader supported='yes'>
May 28 01:49:21.431281 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 01:49:21.431281 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 01:49:21.431281 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.431281 np0000001583 nova-compute[98241]:         <value>rom</value>
May 28 01:49:21.431281 np0000001583 nova-compute[98241]:         <value>pflash</value>
May 28 01:49:21.431281 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.431281 np0000001583 nova-compute[98241]:       <enum name='readonly'>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:         <value>yes</value>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:       <enum name='secure'>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:     </loader>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:   </os>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:   <cpu>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:     <mode name='host-passthrough' supported='no'/>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:     <mode name='maximum' supported='no'/>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:     <mode name='host-model' supported='no'/>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:     <mode name='custom' supported='no'/>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:   <memoryBacking supported='yes'>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:     <enum name='sourceType'>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:       <value>file</value>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:       <value>anonymous</value>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:       <value>memfd</value>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:     </enum>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:   </memoryBacking>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:   <devices>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:     <disk supported='yes'>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:       <enum name='diskDevice'>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:         <value>disk</value>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:         <value>cdrom</value>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:         <value>floppy</value>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:         <value>lun</value>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:         <value>fdc</value>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:     </disk>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:     <graphics supported='yes'>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:         <value>sdl</value>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:         <value>vnc</value>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:         <value>spice</value>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:         <value>egl-headless</value>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:         <value>dbus</value>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:     </graphics>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:     <video supported='yes'>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:       <enum name='modelType'>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:         <value>none</value>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:     </video>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:     <hostdev supported='yes'>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:       <enum name='mode'>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:         <value>subsystem</value>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:       <enum name='startupPolicy'>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:         <value>default</value>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:         <value>mandatory</value>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:         <value>requisite</value>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:         <value>optional</value>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:       <enum name='subsysType'>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:         <value>pci</value>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:       <enum name='capsType'/>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:       <enum name='pciBackend'/>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:     </hostdev>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:     <rng supported='yes'>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:         <value>random</value>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:         <value>egd</value>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:     </rng>
May 28 01:49:21.432354 np0000001583 nova-compute[98241]:     <filesystem supported='yes'>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:       <enum name='driverType'>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:         <value>path</value>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:         <value>handle</value>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:         <value>virtiofs</value>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:     </filesystem>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:     <tpm supported='no'/>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:     <redirdev supported='no'/>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:     <channel supported='yes'>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:         <value>pty</value>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:         <value>unix</value>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:         <value>spicevmc</value>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:     </channel>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:     <crypto supported='yes'>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:         <value>qemu</value>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:     </crypto>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:   </devices>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:   <features>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:     <gic supported='no'/>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:     <vmcoreinfo supported='no'/>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:     <genid supported='no'/>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:     <backingStoreInput supported='yes'/>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:     <backup supported='yes'/>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:     <async-teardown supported='yes'/>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:     <sev supported='no'/>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:     <sgx supported='no'/>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:   </features>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]: </domainCapabilities>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 01:49:21.433750 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Libvirt host hypervisor capabilities for arch=m68k and machine_type=virt:
May 28 01:49:21.433750 np0000001583 nova-compute[98241]: <domainCapabilities>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:   <path>/usr/bin/qemu-system-m68k</path>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:   <domain>qemu</domain>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:   <machine>virt-8.2</machine>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:   <arch>m68k</arch>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:   <vcpu max='1'/>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:   <iothreads supported='yes'/>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:   <os supported='yes'>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:     <enum name='firmware'/>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:     <loader supported='yes'>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:         <value>rom</value>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:         <value>pflash</value>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:       <enum name='readonly'>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:         <value>yes</value>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:       <enum name='secure'>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:     </loader>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:   </os>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:   <cpu>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:     <mode name='host-passthrough' supported='no'/>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:     <mode name='maximum' supported='no'/>
May 28 01:49:21.433750 np0000001583 nova-compute[98241]:     <mode name='host-model' supported='no'/>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:     <mode name='custom' supported='no'/>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:   <memoryBacking supported='yes'>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:     <enum name='sourceType'>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:       <value>file</value>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:       <value>anonymous</value>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:       <value>memfd</value>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:     </enum>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:   </memoryBacking>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:   <devices>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:     <disk supported='yes'>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:       <enum name='diskDevice'>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:         <value>disk</value>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:         <value>cdrom</value>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:         <value>floppy</value>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:         <value>lun</value>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:         <value>fdc</value>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:     </disk>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:     <graphics supported='yes'>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:         <value>sdl</value>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:         <value>vnc</value>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:         <value>spice</value>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:         <value>egl-headless</value>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:         <value>dbus</value>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:     </graphics>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:     <video supported='yes'>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:       <enum name='modelType'>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:         <value>none</value>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:     </video>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:     <hostdev supported='yes'>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:       <enum name='mode'>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:         <value>subsystem</value>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:       <enum name='startupPolicy'>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:         <value>default</value>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:         <value>mandatory</value>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:         <value>requisite</value>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:         <value>optional</value>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:       <enum name='subsysType'>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:         <value>pci</value>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:       <enum name='capsType'/>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:       <enum name='pciBackend'/>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:     </hostdev>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:     <rng supported='yes'>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:         <value>random</value>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:         <value>egd</value>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:     </rng>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:     <filesystem supported='yes'>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:       <enum name='driverType'>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:         <value>path</value>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:         <value>handle</value>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:         <value>virtiofs</value>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:     </filesystem>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:     <tpm supported='no'/>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:     <redirdev supported='no'/>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:     <channel supported='yes'>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.435689 np0000001583 nova-compute[98241]:         <value>pty</value>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]:         <value>unix</value>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]:         <value>spicevmc</value>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]:     </channel>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]:     <crypto supported='yes'>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]:         <value>qemu</value>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]:     </crypto>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]:   </devices>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]:   <features>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]:     <gic supported='no'/>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]:     <vmcoreinfo supported='no'/>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]:     <genid supported='no'/>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]:     <backingStoreInput supported='yes'/>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]:     <backup supported='yes'/>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]:     <async-teardown supported='yes'/>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]:     <sev supported='no'/>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]:     <sgx supported='no'/>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]:   </features>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]: </domainCapabilities>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 01:49:21.437167 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=98241) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 01:49:21.437167 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Libvirt host hypervisor capabilities for arch=microblaze and machine_type=None:
May 28 01:49:21.437167 np0000001583 nova-compute[98241]: <domainCapabilities>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]:   <path>/usr/bin/qemu-system-microblaze</path>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]:   <domain>qemu</domain>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]:   <machine>petalogix-s3adsp1800</machine>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]:   <arch>microblaze</arch>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]:   <vcpu max='1'/>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]:   <iothreads supported='yes'/>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]:   <os supported='yes'>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]:     <enum name='firmware'/>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]:     <loader supported='yes'>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]:         <value>rom</value>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]:         <value>pflash</value>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]:       <enum name='readonly'>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]:         <value>yes</value>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]:       <enum name='secure'>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]:     </loader>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]:   </os>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]:   <cpu>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]:     <mode name='host-passthrough' supported='no'/>
May 28 01:49:21.437167 np0000001583 nova-compute[98241]:     <mode name='maximum' supported='no'/>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:     <mode name='host-model' supported='no'/>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:     <mode name='custom' supported='no'/>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:   <memoryBacking supported='yes'>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:     <enum name='sourceType'>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:       <value>file</value>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:       <value>anonymous</value>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:       <value>memfd</value>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:     </enum>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:   </memoryBacking>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:   <devices>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:     <disk supported='yes'>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:       <enum name='diskDevice'>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:         <value>disk</value>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:         <value>cdrom</value>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:         <value>floppy</value>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:         <value>lun</value>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:         <value>fdc</value>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:     </disk>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:     <graphics supported='yes'>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:         <value>sdl</value>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:         <value>vnc</value>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:         <value>spice</value>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:         <value>egl-headless</value>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:         <value>dbus</value>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:     </graphics>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:     <video supported='yes'>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:       <enum name='modelType'>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:         <value>none</value>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:     </video>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:     <hostdev supported='yes'>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:       <enum name='mode'>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:         <value>subsystem</value>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:       <enum name='startupPolicy'>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:         <value>default</value>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:         <value>mandatory</value>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:         <value>requisite</value>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:         <value>optional</value>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:       <enum name='subsysType'>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:         <value>pci</value>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:       <enum name='capsType'/>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:       <enum name='pciBackend'/>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:     </hostdev>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:     <rng supported='yes'>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:       <enum name='model'/>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:         <value>random</value>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:         <value>egd</value>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:     </rng>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:     <filesystem supported='yes'>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:       <enum name='driverType'>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:         <value>path</value>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:         <value>handle</value>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:     </filesystem>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:     <tpm supported='no'/>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:     <redirdev supported='no'/>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:     <channel supported='yes'>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:         <value>pty</value>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:         <value>unix</value>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:         <value>spicevmc</value>
May 28 01:49:21.438230 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.439748 np0000001583 nova-compute[98241]:     </channel>
May 28 01:49:21.439748 np0000001583 nova-compute[98241]:     <crypto supported='yes'>
May 28 01:49:21.439748 np0000001583 nova-compute[98241]:       <enum name='model'/>
May 28 01:49:21.439748 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.439748 np0000001583 nova-compute[98241]:         <value>qemu</value>
May 28 01:49:21.439748 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.439748 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.439748 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.439748 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.439748 np0000001583 nova-compute[98241]:     </crypto>
May 28 01:49:21.439748 np0000001583 nova-compute[98241]:   </devices>
May 28 01:49:21.439748 np0000001583 nova-compute[98241]:   <features>
May 28 01:49:21.439748 np0000001583 nova-compute[98241]:     <gic supported='no'/>
May 28 01:49:21.439748 np0000001583 nova-compute[98241]:     <vmcoreinfo supported='no'/>
May 28 01:49:21.439748 np0000001583 nova-compute[98241]:     <genid supported='no'/>
May 28 01:49:21.439748 np0000001583 nova-compute[98241]:     <backingStoreInput supported='yes'/>
May 28 01:49:21.439748 np0000001583 nova-compute[98241]:     <backup supported='yes'/>
May 28 01:49:21.439748 np0000001583 nova-compute[98241]:     <async-teardown supported='yes'/>
May 28 01:49:21.439748 np0000001583 nova-compute[98241]:     <sev supported='no'/>
May 28 01:49:21.439748 np0000001583 nova-compute[98241]:     <sgx supported='no'/>
May 28 01:49:21.439748 np0000001583 nova-compute[98241]:   </features>
May 28 01:49:21.439748 np0000001583 nova-compute[98241]: </domainCapabilities>
May 28 01:49:21.439748 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 01:49:21.439748 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=98241) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 01:49:21.439748 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Libvirt host hypervisor capabilities for arch=microblazeel and machine_type=None:
May 28 01:49:21.439748 np0000001583 nova-compute[98241]: <domainCapabilities>
May 28 01:49:21.439748 np0000001583 nova-compute[98241]:   <path>/usr/bin/qemu-system-microblazeel</path>
May 28 01:49:21.439748 np0000001583 nova-compute[98241]:   <domain>qemu</domain>
May 28 01:49:21.439748 np0000001583 nova-compute[98241]:   <machine>petalogix-s3adsp1800</machine>
May 28 01:49:21.439748 np0000001583 nova-compute[98241]:   <arch>microblazeel</arch>
May 28 01:49:21.439748 np0000001583 nova-compute[98241]:   <vcpu max='1'/>
May 28 01:49:21.439748 np0000001583 nova-compute[98241]:   <iothreads supported='yes'/>
May 28 01:49:21.439748 np0000001583 nova-compute[98241]:   <os supported='yes'>
May 28 01:49:21.439748 np0000001583 nova-compute[98241]:     <enum name='firmware'/>
May 28 01:49:21.439748 np0000001583 nova-compute[98241]:     <loader supported='yes'>
May 28 01:49:21.439748 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 01:49:21.439748 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 01:49:21.439748 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.439748 np0000001583 nova-compute[98241]:         <value>rom</value>
May 28 01:49:21.439748 np0000001583 nova-compute[98241]:         <value>pflash</value>
May 28 01:49:21.439748 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.439748 np0000001583 nova-compute[98241]:       <enum name='readonly'>
May 28 01:49:21.439748 np0000001583 nova-compute[98241]:         <value>yes</value>
May 28 01:49:21.439748 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.439748 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.439748 np0000001583 nova-compute[98241]:       <enum name='secure'>
May 28 01:49:21.439748 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.439748 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.439748 np0000001583 nova-compute[98241]:     </loader>
May 28 01:49:21.439748 np0000001583 nova-compute[98241]:   </os>
May 28 01:49:21.439748 np0000001583 nova-compute[98241]:   <cpu>
May 28 01:49:21.439748 np0000001583 nova-compute[98241]:     <mode name='host-passthrough' supported='no'/>
May 28 01:49:21.439748 np0000001583 nova-compute[98241]:     <mode name='maximum' supported='no'/>
May 28 01:49:21.439748 np0000001583 nova-compute[98241]:     <mode name='host-model' supported='no'/>
May 28 01:49:21.439748 np0000001583 nova-compute[98241]:     <mode name='custom' supported='no'/>
May 28 01:49:21.439748 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:49:21.439748 np0000001583 nova-compute[98241]:   <memoryBacking supported='yes'>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:     <enum name='sourceType'>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:       <value>file</value>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:       <value>anonymous</value>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:       <value>memfd</value>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:     </enum>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:   </memoryBacking>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:   <devices>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:     <disk supported='yes'>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:       <enum name='diskDevice'>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:         <value>disk</value>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:         <value>cdrom</value>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:         <value>floppy</value>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:         <value>lun</value>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:         <value>fdc</value>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:     </disk>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:     <graphics supported='yes'>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:         <value>sdl</value>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:         <value>vnc</value>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:         <value>spice</value>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:         <value>egl-headless</value>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:         <value>dbus</value>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:     </graphics>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:     <video supported='yes'>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:       <enum name='modelType'>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:         <value>none</value>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:     </video>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:     <hostdev supported='yes'>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:       <enum name='mode'>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:         <value>subsystem</value>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:       <enum name='startupPolicy'>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:         <value>default</value>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:         <value>mandatory</value>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:         <value>requisite</value>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:         <value>optional</value>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:       <enum name='subsysType'>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:         <value>pci</value>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:       <enum name='capsType'/>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:       <enum name='pciBackend'/>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:     </hostdev>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:     <rng supported='yes'>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:       <enum name='model'/>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:         <value>random</value>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:         <value>egd</value>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:     </rng>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:     <filesystem supported='yes'>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:       <enum name='driverType'>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:         <value>path</value>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:         <value>handle</value>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:     </filesystem>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:     <tpm supported='no'/>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:     <redirdev supported='no'/>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:     <channel supported='yes'>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:         <value>pty</value>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:         <value>unix</value>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:         <value>spicevmc</value>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:     </channel>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:     <crypto supported='yes'>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:       <enum name='model'/>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:         <value>qemu</value>
May 28 01:49:21.440869 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:     </crypto>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:   </devices>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:   <features>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:     <gic supported='no'/>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:     <vmcoreinfo supported='no'/>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:     <genid supported='no'/>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:     <backingStoreInput supported='yes'/>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:     <backup supported='yes'/>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:     <async-teardown supported='yes'/>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:     <sev supported='no'/>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:     <sgx supported='no'/>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:   </features>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]: </domainCapabilities>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 01:49:21.442285 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=98241) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 01:49:21.442285 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Libvirt host hypervisor capabilities for arch=mips and machine_type=None:
May 28 01:49:21.442285 np0000001583 nova-compute[98241]: <domainCapabilities>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:   <path>/usr/bin/qemu-system-mips</path>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:   <domain>qemu</domain>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:   <machine>malta</machine>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:   <arch>mips</arch>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:   <vcpu max='16'/>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:   <iothreads supported='yes'/>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:   <os supported='yes'>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:     <enum name='firmware'/>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:     <loader supported='yes'>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:         <value>rom</value>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:         <value>pflash</value>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:       <enum name='readonly'>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:         <value>yes</value>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:       <enum name='secure'>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:     </loader>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:   </os>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:   <cpu>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:     <mode name='host-passthrough' supported='no'/>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:     <mode name='maximum' supported='no'/>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:     <mode name='host-model' supported='no'/>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:     <mode name='custom' supported='no'/>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:   <memoryBacking supported='yes'>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:     <enum name='sourceType'>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:       <value>file</value>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:       <value>anonymous</value>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:       <value>memfd</value>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:     </enum>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:   </memoryBacking>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:   <devices>
May 28 01:49:21.442285 np0000001583 nova-compute[98241]:     <disk supported='yes'>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:       <enum name='diskDevice'>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:         <value>disk</value>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:         <value>cdrom</value>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:         <value>floppy</value>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:         <value>lun</value>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:         <value>ide</value>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:         <value>fdc</value>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:         <value>sata</value>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:     </disk>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:     <graphics supported='yes'>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:         <value>sdl</value>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:         <value>vnc</value>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:         <value>spice</value>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:         <value>egl-headless</value>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:         <value>dbus</value>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:     </graphics>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:     <video supported='yes'>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:       <enum name='modelType'>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:         <value>vga</value>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:         <value>cirrus</value>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:         <value>vmvga</value>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:         <value>none</value>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:         <value>bochs</value>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:     </video>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:     <hostdev supported='yes'>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:       <enum name='mode'>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:         <value>subsystem</value>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:       <enum name='startupPolicy'>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:         <value>default</value>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:         <value>mandatory</value>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:         <value>requisite</value>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:         <value>optional</value>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:       <enum name='subsysType'>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:         <value>pci</value>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:       <enum name='capsType'/>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:       <enum name='pciBackend'/>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:     </hostdev>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:     <rng supported='yes'>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:         <value>random</value>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:         <value>egd</value>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:     </rng>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:     <filesystem supported='yes'>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:       <enum name='driverType'>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:         <value>path</value>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:         <value>handle</value>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:         <value>virtiofs</value>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:     </filesystem>
May 28 01:49:21.443401 np0000001583 nova-compute[98241]:     <tpm supported='no'/>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:     <redirdev supported='yes'>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:     </redirdev>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:     <channel supported='yes'>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:         <value>pty</value>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:         <value>unix</value>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:         <value>spicevmc</value>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:     </channel>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:     <crypto supported='yes'>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:         <value>qemu</value>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:     </crypto>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:   </devices>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:   <features>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:     <gic supported='no'/>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:     <vmcoreinfo supported='no'/>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:     <genid supported='no'/>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:     <backingStoreInput supported='yes'/>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:     <backup supported='yes'/>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:     <async-teardown supported='yes'/>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:     <sev supported='no'/>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:     <sgx supported='no'/>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:   </features>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]: </domainCapabilities>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 01:49:21.445997 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=98241) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 01:49:21.445997 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Libvirt host hypervisor capabilities for arch=mipsel and machine_type=None:
May 28 01:49:21.445997 np0000001583 nova-compute[98241]: <domainCapabilities>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:   <path>/usr/bin/qemu-system-mipsel</path>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:   <domain>qemu</domain>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:   <machine>malta</machine>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:   <arch>mipsel</arch>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:   <vcpu max='16'/>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:   <iothreads supported='yes'/>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:   <os supported='yes'>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:     <enum name='firmware'/>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:     <loader supported='yes'>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:         <value>rom</value>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:         <value>pflash</value>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:       <enum name='readonly'>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:         <value>yes</value>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:       <enum name='secure'>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.445997 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:     </loader>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:   </os>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:   <cpu>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:     <mode name='host-passthrough' supported='no'/>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:     <mode name='maximum' supported='no'/>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:     <mode name='host-model' supported='no'/>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:     <mode name='custom' supported='no'/>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:   <memoryBacking supported='yes'>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:     <enum name='sourceType'>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:       <value>file</value>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:       <value>anonymous</value>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:       <value>memfd</value>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:     </enum>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:   </memoryBacking>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:   <devices>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:     <disk supported='yes'>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:       <enum name='diskDevice'>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:         <value>disk</value>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:         <value>cdrom</value>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:         <value>floppy</value>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:         <value>lun</value>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:         <value>ide</value>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:         <value>fdc</value>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:         <value>sata</value>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:     </disk>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:     <graphics supported='yes'>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:         <value>sdl</value>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:         <value>vnc</value>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:         <value>spice</value>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:         <value>egl-headless</value>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:         <value>dbus</value>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:     </graphics>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:     <video supported='yes'>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:       <enum name='modelType'>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:         <value>vga</value>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:         <value>cirrus</value>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:         <value>vmvga</value>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:         <value>none</value>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:         <value>bochs</value>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:     </video>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:     <hostdev supported='yes'>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:       <enum name='mode'>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:         <value>subsystem</value>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:       <enum name='startupPolicy'>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:         <value>default</value>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:         <value>mandatory</value>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:         <value>requisite</value>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:         <value>optional</value>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:       <enum name='subsysType'>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:         <value>pci</value>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:       <enum name='capsType'/>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:       <enum name='pciBackend'/>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:     </hostdev>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:     <rng supported='yes'>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.447223 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:         <value>random</value>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:         <value>egd</value>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:     </rng>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:     <filesystem supported='yes'>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:       <enum name='driverType'>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:         <value>path</value>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:         <value>handle</value>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:         <value>virtiofs</value>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:     </filesystem>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:     <tpm supported='no'/>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:     <redirdev supported='yes'>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:     </redirdev>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:     <channel supported='yes'>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:         <value>pty</value>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:         <value>unix</value>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:         <value>spicevmc</value>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:     </channel>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:     <crypto supported='yes'>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:         <value>qemu</value>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:     </crypto>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:   </devices>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:   <features>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:     <gic supported='no'/>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:     <vmcoreinfo supported='no'/>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:     <genid supported='no'/>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:     <backingStoreInput supported='yes'/>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:     <backup supported='yes'/>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:     <async-teardown supported='yes'/>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:     <sev supported='no'/>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:     <sgx supported='no'/>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:   </features>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]: </domainCapabilities>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 01:49:21.448825 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=98241) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 01:49:21.448825 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Libvirt host hypervisor capabilities for arch=mips64 and machine_type=None:
May 28 01:49:21.448825 np0000001583 nova-compute[98241]: <domainCapabilities>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:   <path>/usr/bin/qemu-system-mips64</path>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:   <domain>qemu</domain>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:   <machine>malta</machine>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:   <arch>mips64</arch>
May 28 01:49:21.448825 np0000001583 nova-compute[98241]:   <vcpu max='16'/>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:   <iothreads supported='yes'/>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:   <os supported='yes'>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:     <enum name='firmware'/>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:     <loader supported='yes'>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:         <value>rom</value>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:         <value>pflash</value>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:       <enum name='readonly'>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:         <value>yes</value>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:       <enum name='secure'>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:     </loader>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:   </os>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:   <cpu>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:     <mode name='host-passthrough' supported='no'/>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:     <mode name='maximum' supported='no'/>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:     <mode name='host-model' supported='no'/>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:     <mode name='custom' supported='no'/>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:   <memoryBacking supported='yes'>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:     <enum name='sourceType'>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:       <value>file</value>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:       <value>anonymous</value>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:       <value>memfd</value>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:     </enum>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:   </memoryBacking>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:   <devices>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:     <disk supported='yes'>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:       <enum name='diskDevice'>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:         <value>disk</value>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:         <value>cdrom</value>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:         <value>floppy</value>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:         <value>lun</value>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:         <value>ide</value>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:         <value>fdc</value>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:         <value>sata</value>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:     </disk>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:     <graphics supported='yes'>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:         <value>sdl</value>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:         <value>vnc</value>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:         <value>spice</value>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:         <value>egl-headless</value>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:         <value>dbus</value>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:     </graphics>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:     <video supported='yes'>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:       <enum name='modelType'>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:         <value>vga</value>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:         <value>cirrus</value>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:         <value>vmvga</value>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:         <value>none</value>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:         <value>bochs</value>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:     </video>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:     <hostdev supported='yes'>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:       <enum name='mode'>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:         <value>subsystem</value>
May 28 01:49:21.450742 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:       <enum name='startupPolicy'>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:         <value>default</value>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:         <value>mandatory</value>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:         <value>requisite</value>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:         <value>optional</value>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:       <enum name='subsysType'>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:         <value>pci</value>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:       <enum name='capsType'/>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:       <enum name='pciBackend'/>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:     </hostdev>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:     <rng supported='yes'>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:         <value>random</value>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:         <value>egd</value>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:     </rng>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:     <filesystem supported='yes'>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:       <enum name='driverType'>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:         <value>path</value>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:         <value>handle</value>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:         <value>virtiofs</value>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:     </filesystem>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:     <tpm supported='no'/>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:     <redirdev supported='yes'>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:     </redirdev>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:     <channel supported='yes'>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:         <value>pty</value>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:         <value>unix</value>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:         <value>spicevmc</value>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:     </channel>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:     <crypto supported='yes'>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:         <value>qemu</value>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:     </crypto>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:   </devices>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:   <features>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:     <gic supported='no'/>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:     <vmcoreinfo supported='no'/>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:     <genid supported='no'/>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:     <backingStoreInput supported='yes'/>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:     <backup supported='yes'/>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:     <async-teardown supported='yes'/>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:     <sev supported='no'/>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:     <sgx supported='no'/>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:   </features>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]: </domainCapabilities>
May 28 01:49:21.452140 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 01:49:21.453662 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=98241) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 01:49:21.453662 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Libvirt host hypervisor capabilities for arch=mips64el and machine_type=None:
May 28 01:49:21.453662 np0000001583 nova-compute[98241]: <domainCapabilities>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:   <path>/usr/bin/qemu-system-mips64el</path>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:   <domain>qemu</domain>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:   <machine>malta</machine>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:   <arch>mips64el</arch>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:   <vcpu max='16'/>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:   <iothreads supported='yes'/>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:   <os supported='yes'>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:     <enum name='firmware'/>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:     <loader supported='yes'>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:         <value>rom</value>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:         <value>pflash</value>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:       <enum name='readonly'>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:         <value>yes</value>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:       <enum name='secure'>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:     </loader>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:   </os>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:   <cpu>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:     <mode name='host-passthrough' supported='no'/>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:     <mode name='maximum' supported='no'/>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:     <mode name='host-model' supported='no'/>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:     <mode name='custom' supported='no'/>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:   <memoryBacking supported='yes'>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:     <enum name='sourceType'>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:       <value>file</value>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:       <value>anonymous</value>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:       <value>memfd</value>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:     </enum>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:   </memoryBacking>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:   <devices>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:     <disk supported='yes'>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:       <enum name='diskDevice'>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:         <value>disk</value>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:         <value>cdrom</value>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:         <value>floppy</value>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:         <value>lun</value>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:         <value>ide</value>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:         <value>fdc</value>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:         <value>sata</value>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.453662 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:     </disk>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:     <graphics supported='yes'>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:         <value>sdl</value>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:         <value>vnc</value>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:         <value>spice</value>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:         <value>egl-headless</value>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:         <value>dbus</value>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:     </graphics>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:     <video supported='yes'>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:       <enum name='modelType'>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:         <value>vga</value>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:         <value>cirrus</value>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:         <value>vmvga</value>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:         <value>none</value>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:         <value>bochs</value>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:     </video>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:     <hostdev supported='yes'>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:       <enum name='mode'>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:         <value>subsystem</value>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:       <enum name='startupPolicy'>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:         <value>default</value>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:         <value>mandatory</value>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:         <value>requisite</value>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:         <value>optional</value>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:       <enum name='subsysType'>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:         <value>pci</value>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:       <enum name='capsType'/>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:       <enum name='pciBackend'/>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:     </hostdev>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:     <rng supported='yes'>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:         <value>random</value>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:         <value>egd</value>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:     </rng>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:     <filesystem supported='yes'>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:       <enum name='driverType'>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:         <value>path</value>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:         <value>handle</value>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:         <value>virtiofs</value>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:     </filesystem>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:     <tpm supported='no'/>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:     <redirdev supported='yes'>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:     </redirdev>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:     <channel supported='yes'>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:         <value>pty</value>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:         <value>unix</value>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:         <value>spicevmc</value>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:     </channel>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:     <crypto supported='yes'>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:         <value>qemu</value>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.454784 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:     </crypto>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:   </devices>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:   <features>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:     <gic supported='no'/>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:     <vmcoreinfo supported='no'/>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:     <genid supported='no'/>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:     <backingStoreInput supported='yes'/>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:     <backup supported='yes'/>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:     <async-teardown supported='yes'/>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:     <sev supported='no'/>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:     <sgx supported='no'/>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:   </features>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]: </domainCapabilities>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 01:49:21.456319 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=98241) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 01:49:21.456319 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Libvirt host hypervisor capabilities for arch=ppc and machine_type=None:
May 28 01:49:21.456319 np0000001583 nova-compute[98241]: <domainCapabilities>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:   <path>/usr/bin/qemu-system-ppc</path>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:   <domain>qemu</domain>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:   <machine>g3beige</machine>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:   <arch>ppc</arch>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:   <vcpu max='1'/>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:   <iothreads supported='yes'/>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:   <os supported='yes'>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:     <enum name='firmware'/>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:     <loader supported='yes'>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:         <value>rom</value>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:         <value>pflash</value>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:       <enum name='readonly'>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:         <value>yes</value>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:       <enum name='secure'>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:     </loader>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:   </os>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:   <cpu>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:     <mode name='host-passthrough' supported='no'/>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:     <mode name='maximum' supported='no'/>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:     <mode name='host-model' supported='no'/>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:     <mode name='custom' supported='no'/>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:   <memoryBacking supported='yes'>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:     <enum name='sourceType'>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:       <value>file</value>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:       <value>anonymous</value>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:       <value>memfd</value>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:     </enum>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:   </memoryBacking>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:   <devices>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:     <disk supported='yes'>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:       <enum name='diskDevice'>
May 28 01:49:21.456319 np0000001583 nova-compute[98241]:         <value>disk</value>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:         <value>cdrom</value>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:         <value>floppy</value>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:         <value>lun</value>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:         <value>ide</value>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:         <value>fdc</value>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:         <value>sata</value>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:     </disk>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:     <graphics supported='yes'>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:         <value>sdl</value>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:         <value>vnc</value>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:         <value>spice</value>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:         <value>egl-headless</value>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:         <value>dbus</value>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:     </graphics>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:     <video supported='yes'>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:       <enum name='modelType'>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:         <value>vga</value>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:         <value>cirrus</value>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:         <value>none</value>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:         <value>bochs</value>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:     </video>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:     <hostdev supported='yes'>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:       <enum name='mode'>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:         <value>subsystem</value>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:       <enum name='startupPolicy'>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:         <value>default</value>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:         <value>mandatory</value>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:         <value>requisite</value>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:         <value>optional</value>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:       <enum name='subsysType'>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:         <value>pci</value>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:       <enum name='capsType'/>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:       <enum name='pciBackend'/>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:     </hostdev>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:     <rng supported='yes'>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:         <value>random</value>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:         <value>egd</value>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:     </rng>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:     <filesystem supported='yes'>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:       <enum name='driverType'>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:         <value>path</value>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:         <value>handle</value>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:         <value>virtiofs</value>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:     </filesystem>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:     <tpm supported='no'/>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:     <redirdev supported='yes'>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.457409 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:     </redirdev>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:     <channel supported='yes'>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:         <value>pty</value>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:         <value>unix</value>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:         <value>spicevmc</value>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:     </channel>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:     <crypto supported='yes'>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:         <value>qemu</value>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:     </crypto>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:   </devices>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:   <features>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:     <gic supported='no'/>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:     <vmcoreinfo supported='no'/>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:     <genid supported='no'/>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:     <backingStoreInput supported='yes'/>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:     <backup supported='yes'/>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:     <async-teardown supported='yes'/>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:     <sev supported='no'/>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:     <sgx supported='no'/>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:   </features>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]: </domainCapabilities>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 01:49:21.459284 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Getting domain capabilities for ppc64 via machine types: {None, 'powernv', 'pseries'} {{(pid=98241) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 01:49:21.459284 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=None:
May 28 01:49:21.459284 np0000001583 nova-compute[98241]: <domainCapabilities>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:   <path>/usr/bin/qemu-system-ppc64</path>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:   <domain>qemu</domain>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:   <machine>pseries-noble</machine>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:   <arch>ppc64</arch>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:   <vcpu max='4096'/>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:   <iothreads supported='yes'/>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:   <os supported='yes'>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:     <enum name='firmware'/>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:     <loader supported='yes'>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:         <value>rom</value>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:         <value>pflash</value>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:       <enum name='readonly'>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:         <value>yes</value>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:       <enum name='secure'>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:     </loader>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:   </os>
May 28 01:49:21.459284 np0000001583 nova-compute[98241]:   <cpu>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:     <mode name='host-passthrough' supported='no'/>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:     <mode name='maximum' supported='no'/>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:     <mode name='host-model' supported='no'/>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:     <mode name='custom' supported='yes'>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:     </mode>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:   <memoryBacking supported='yes'>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:     <enum name='sourceType'>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:       <value>file</value>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:       <value>anonymous</value>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:       <value>memfd</value>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:     </enum>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:   </memoryBacking>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:   <devices>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:     <disk supported='yes'>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:       <enum name='diskDevice'>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:         <value>disk</value>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:         <value>cdrom</value>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:         <value>lun</value>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:         <value>sata</value>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:     </disk>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:     <graphics supported='yes'>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:         <value>sdl</value>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:         <value>vnc</value>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:         <value>spice</value>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:         <value>egl-headless</value>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:         <value>dbus</value>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:     </graphics>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:     <video supported='yes'>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:       <enum name='modelType'>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:         <value>vga</value>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:         <value>cirrus</value>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:         <value>none</value>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:         <value>bochs</value>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:     </video>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:     <hostdev supported='yes'>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:       <enum name='mode'>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:         <value>subsystem</value>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:       <enum name='startupPolicy'>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:         <value>default</value>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:         <value>mandatory</value>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:         <value>requisite</value>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:         <value>optional</value>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:       <enum name='subsysType'>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:         <value>pci</value>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:       <enum name='capsType'/>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:       <enum name='pciBackend'/>
May 28 01:49:21.460398 np0000001583 nova-compute[98241]:     </hostdev>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:     <rng supported='yes'>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:         <value>random</value>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:         <value>egd</value>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:     </rng>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:     <filesystem supported='yes'>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:       <enum name='driverType'>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:         <value>path</value>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:         <value>handle</value>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:         <value>virtiofs</value>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:     </filesystem>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:     <tpm supported='yes'>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:         <value>tpm-spapr</value>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:         <value>spapr-tpm-proxy</value>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:         <value>passthrough</value>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:         <value>emulator</value>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:         <value>external</value>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:       <enum name='backendVersion'>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:         <value>1.2</value>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:         <value>2.0</value>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:     </tpm>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:     <redirdev supported='yes'>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:     </redirdev>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:     <channel supported='yes'>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:         <value>pty</value>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:         <value>unix</value>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:         <value>spicevmc</value>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:     </channel>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:     <crypto supported='yes'>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:         <value>qemu</value>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:     </crypto>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:   </devices>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:   <features>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:     <gic supported='no'/>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:     <vmcoreinfo supported='no'/>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:     <genid supported='no'/>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:     <backingStoreInput supported='yes'/>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:     <backup supported='yes'/>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:     <async-teardown supported='yes'/>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:     <sev supported='no'/>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:     <sgx supported='no'/>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:   </features>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]: </domainCapabilities>
May 28 01:49:21.461568 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 01:49:21.462679 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=powernv:
May 28 01:49:21.462679 np0000001583 nova-compute[98241]: <domainCapabilities>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:   <path>/usr/bin/qemu-system-ppc64</path>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:   <domain>qemu</domain>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:   <machine>powernv9</machine>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:   <arch>ppc64</arch>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:   <vcpu max='2048'/>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:   <iothreads supported='yes'/>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:   <os supported='yes'>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:     <enum name='firmware'/>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:     <loader supported='yes'>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:         <value>rom</value>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:         <value>pflash</value>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:       <enum name='readonly'>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:         <value>yes</value>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:       <enum name='secure'>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:     </loader>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:   </os>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:   <cpu>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:     <mode name='host-passthrough' supported='no'/>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:     <mode name='maximum' supported='no'/>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:     <mode name='host-model' supported='no'/>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:     <mode name='custom' supported='yes'>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:     </mode>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:   <memoryBacking supported='yes'>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:     <enum name='sourceType'>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:       <value>file</value>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:       <value>anonymous</value>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:       <value>memfd</value>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:     </enum>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:   </memoryBacking>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:   <devices>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:     <disk supported='yes'>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:       <enum name='diskDevice'>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:         <value>disk</value>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:         <value>cdrom</value>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:         <value>floppy</value>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:         <value>lun</value>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:         <value>fdc</value>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:         <value>sata</value>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:     </disk>
May 28 01:49:21.462679 np0000001583 nova-compute[98241]:     <graphics supported='yes'>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:         <value>sdl</value>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:         <value>vnc</value>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:         <value>spice</value>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:         <value>egl-headless</value>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:         <value>dbus</value>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:     </graphics>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:     <video supported='yes'>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:       <enum name='modelType'>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:         <value>vga</value>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:         <value>cirrus</value>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:         <value>none</value>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:         <value>bochs</value>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:     </video>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:     <hostdev supported='yes'>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:       <enum name='mode'>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:         <value>subsystem</value>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:       <enum name='startupPolicy'>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:         <value>default</value>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:         <value>mandatory</value>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:         <value>requisite</value>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:         <value>optional</value>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:       <enum name='subsysType'>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:         <value>pci</value>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:       <enum name='capsType'/>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:       <enum name='pciBackend'/>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:     </hostdev>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:     <rng supported='yes'>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:         <value>random</value>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:         <value>egd</value>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:     </rng>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:     <filesystem supported='yes'>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:       <enum name='driverType'>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:         <value>path</value>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:         <value>handle</value>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:         <value>virtiofs</value>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:     </filesystem>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:     <tpm supported='yes'>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:         <value>tpm-spapr</value>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:         <value>spapr-tpm-proxy</value>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:         <value>passthrough</value>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:         <value>emulator</value>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:         <value>external</value>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:       <enum name='backendVersion'>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:         <value>1.2</value>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:         <value>2.0</value>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:     </tpm>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:     <redirdev supported='yes'>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:     </redirdev>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:     <channel supported='yes'>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:         <value>pty</value>
May 28 01:49:21.463683 np0000001583 nova-compute[98241]:         <value>unix</value>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:         <value>spicevmc</value>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:     </channel>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:     <crypto supported='yes'>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:         <value>qemu</value>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:     </crypto>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:   </devices>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:   <features>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:     <gic supported='no'/>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:     <vmcoreinfo supported='no'/>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:     <genid supported='no'/>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:     <backingStoreInput supported='yes'/>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:     <backup supported='yes'/>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:     <async-teardown supported='yes'/>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:     <sev supported='no'/>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:     <sgx supported='no'/>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:   </features>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]: </domainCapabilities>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 01:49:21.464864 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=pseries:
May 28 01:49:21.464864 np0000001583 nova-compute[98241]: <domainCapabilities>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:   <path>/usr/bin/qemu-system-ppc64</path>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:   <domain>qemu</domain>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:   <machine>pseries-noble</machine>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:   <arch>ppc64</arch>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:   <vcpu max='4096'/>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:   <iothreads supported='yes'/>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:   <os supported='yes'>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:     <enum name='firmware'/>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:     <loader supported='yes'>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:         <value>rom</value>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:         <value>pflash</value>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:       <enum name='readonly'>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:         <value>yes</value>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:       <enum name='secure'>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:     </loader>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:   </os>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:   <cpu>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:     <mode name='host-passthrough' supported='no'/>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:     <mode name='maximum' supported='no'/>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:     <mode name='host-model' supported='no'/>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:     <mode name='custom' supported='yes'>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:     </mode>
May 28 01:49:21.464864 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:   <memoryBacking supported='yes'>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:     <enum name='sourceType'>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:       <value>file</value>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:       <value>anonymous</value>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:       <value>memfd</value>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:     </enum>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:   </memoryBacking>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:   <devices>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:     <disk supported='yes'>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:       <enum name='diskDevice'>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:         <value>disk</value>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:         <value>cdrom</value>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:         <value>lun</value>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:         <value>sata</value>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:     </disk>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:     <graphics supported='yes'>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:         <value>sdl</value>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:         <value>vnc</value>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:         <value>spice</value>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:         <value>egl-headless</value>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:         <value>dbus</value>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:     </graphics>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:     <video supported='yes'>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:       <enum name='modelType'>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:         <value>vga</value>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:         <value>cirrus</value>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:         <value>none</value>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:         <value>bochs</value>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:     </video>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:     <hostdev supported='yes'>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:       <enum name='mode'>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:         <value>subsystem</value>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:       <enum name='startupPolicy'>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:         <value>default</value>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:         <value>mandatory</value>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:         <value>requisite</value>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:         <value>optional</value>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:       <enum name='subsysType'>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:         <value>pci</value>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:       <enum name='capsType'/>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:       <enum name='pciBackend'/>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:     </hostdev>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:     <rng supported='yes'>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:         <value>random</value>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:         <value>egd</value>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:     </rng>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:     <filesystem supported='yes'>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:       <enum name='driverType'>
May 28 01:49:21.465810 np0000001583 nova-compute[98241]:         <value>path</value>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:         <value>handle</value>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:         <value>virtiofs</value>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:     </filesystem>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:     <tpm supported='yes'>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:         <value>tpm-spapr</value>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:         <value>spapr-tpm-proxy</value>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:         <value>passthrough</value>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:         <value>emulator</value>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:         <value>external</value>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:       <enum name='backendVersion'>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:         <value>1.2</value>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:         <value>2.0</value>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:     </tpm>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:     <redirdev supported='yes'>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:     </redirdev>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:     <channel supported='yes'>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:         <value>pty</value>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:         <value>unix</value>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:         <value>spicevmc</value>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:     </channel>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:     <crypto supported='yes'>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:         <value>qemu</value>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:     </crypto>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:   </devices>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:   <features>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:     <gic supported='no'/>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:     <vmcoreinfo supported='no'/>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:     <genid supported='no'/>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:     <backingStoreInput supported='yes'/>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:     <backup supported='yes'/>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:     <async-teardown supported='yes'/>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:     <sev supported='no'/>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:     <sgx supported='no'/>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:   </features>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]: </domainCapabilities>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 01:49:21.467003 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=98241) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 01:49:21.467003 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Libvirt host hypervisor capabilities for arch=ppc64le and machine_type=powernv:
May 28 01:49:21.467003 np0000001583 nova-compute[98241]: <domainCapabilities>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:   <path>/usr/bin/qemu-system-ppc64le</path>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:   <domain>qemu</domain>
May 28 01:49:21.467003 np0000001583 nova-compute[98241]:   <machine>powernv9</machine>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:   <arch>ppc64le</arch>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:   <vcpu max='2048'/>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:   <iothreads supported='yes'/>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:   <os supported='yes'>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:     <enum name='firmware'/>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:     <loader supported='yes'>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:         <value>rom</value>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:         <value>pflash</value>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:       <enum name='readonly'>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:         <value>yes</value>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:       <enum name='secure'>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:     </loader>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:   </os>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:   <cpu>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:     <mode name='host-passthrough' supported='no'/>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:     <mode name='maximum' supported='no'/>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:     <mode name='host-model' supported='no'/>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:     <mode name='custom' supported='yes'>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:     </mode>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:   <memoryBacking supported='yes'>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:     <enum name='sourceType'>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:       <value>file</value>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:       <value>anonymous</value>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:       <value>memfd</value>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:     </enum>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:   </memoryBacking>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:   <devices>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:     <disk supported='yes'>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:       <enum name='diskDevice'>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:         <value>disk</value>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:         <value>cdrom</value>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:         <value>floppy</value>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:         <value>lun</value>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:         <value>fdc</value>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:         <value>sata</value>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:     </disk>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:     <graphics supported='yes'>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:         <value>sdl</value>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:         <value>vnc</value>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:         <value>spice</value>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:         <value>egl-headless</value>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:         <value>dbus</value>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:     </graphics>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:     <video supported='yes'>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:       <enum name='modelType'>
May 28 01:49:21.468015 np0000001583 nova-compute[98241]:         <value>vga</value>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:         <value>cirrus</value>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:         <value>none</value>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:         <value>bochs</value>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:     </video>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:     <hostdev supported='yes'>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:       <enum name='mode'>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:         <value>subsystem</value>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:       <enum name='startupPolicy'>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:         <value>default</value>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:         <value>mandatory</value>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:         <value>requisite</value>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:         <value>optional</value>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:       <enum name='subsysType'>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:         <value>pci</value>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:       <enum name='capsType'/>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:       <enum name='pciBackend'/>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:     </hostdev>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:     <rng supported='yes'>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:         <value>random</value>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:         <value>egd</value>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:     </rng>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:     <filesystem supported='yes'>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:       <enum name='driverType'>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:         <value>path</value>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:         <value>handle</value>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:         <value>virtiofs</value>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:     </filesystem>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:     <tpm supported='yes'>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:         <value>tpm-spapr</value>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:         <value>spapr-tpm-proxy</value>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:         <value>passthrough</value>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:         <value>emulator</value>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:         <value>external</value>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:       <enum name='backendVersion'>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:         <value>1.2</value>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:         <value>2.0</value>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:     </tpm>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:     <redirdev supported='yes'>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:     </redirdev>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:     <channel supported='yes'>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:         <value>pty</value>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:         <value>unix</value>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:         <value>spicevmc</value>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:     </channel>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:     <crypto supported='yes'>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:         <value>qemu</value>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.469312 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:     </crypto>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:   </devices>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:   <features>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:     <gic supported='no'/>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:     <vmcoreinfo supported='no'/>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:     <genid supported='no'/>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:     <backingStoreInput supported='yes'/>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:     <backup supported='yes'/>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:     <async-teardown supported='yes'/>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:     <sev supported='no'/>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:     <sgx supported='no'/>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:   </features>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]: </domainCapabilities>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 01:49:21.470541 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Libvirt host hypervisor capabilities for arch=ppc64le and machine_type=pseries:
May 28 01:49:21.470541 np0000001583 nova-compute[98241]: <domainCapabilities>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:   <path>/usr/bin/qemu-system-ppc64le</path>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:   <domain>qemu</domain>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:   <machine>pseries-noble</machine>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:   <arch>ppc64le</arch>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:   <vcpu max='4096'/>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:   <iothreads supported='yes'/>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:   <os supported='yes'>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:     <enum name='firmware'/>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:     <loader supported='yes'>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:         <value>rom</value>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:         <value>pflash</value>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:       <enum name='readonly'>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:         <value>yes</value>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:       <enum name='secure'>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:     </loader>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:   </os>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:   <cpu>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:     <mode name='host-passthrough' supported='no'/>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:     <mode name='maximum' supported='no'/>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:     <mode name='host-model' supported='no'/>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:     <mode name='custom' supported='yes'>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:     </mode>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:   <memoryBacking supported='yes'>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:     <enum name='sourceType'>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:       <value>file</value>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:       <value>anonymous</value>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:       <value>memfd</value>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:     </enum>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:   </memoryBacking>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:   <devices>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:     <disk supported='yes'>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:       <enum name='diskDevice'>
May 28 01:49:21.470541 np0000001583 nova-compute[98241]:         <value>disk</value>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:         <value>cdrom</value>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:         <value>lun</value>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:         <value>sata</value>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:     </disk>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:     <graphics supported='yes'>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:         <value>sdl</value>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:         <value>vnc</value>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:         <value>spice</value>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:         <value>egl-headless</value>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:         <value>dbus</value>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:     </graphics>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:     <video supported='yes'>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:       <enum name='modelType'>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:         <value>vga</value>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:         <value>cirrus</value>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:         <value>none</value>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:         <value>bochs</value>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:     </video>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:     <hostdev supported='yes'>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:       <enum name='mode'>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:         <value>subsystem</value>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:       <enum name='startupPolicy'>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:         <value>default</value>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:         <value>mandatory</value>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:         <value>requisite</value>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:         <value>optional</value>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:       <enum name='subsysType'>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:         <value>pci</value>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:       <enum name='capsType'/>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:       <enum name='pciBackend'/>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:     </hostdev>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:     <rng supported='yes'>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:         <value>random</value>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:         <value>egd</value>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:     </rng>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:     <filesystem supported='yes'>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:       <enum name='driverType'>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:         <value>path</value>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:         <value>handle</value>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:         <value>virtiofs</value>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:     </filesystem>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:     <tpm supported='yes'>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:         <value>tpm-spapr</value>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:         <value>spapr-tpm-proxy</value>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.471587 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:         <value>passthrough</value>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:         <value>emulator</value>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:         <value>external</value>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:       <enum name='backendVersion'>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:         <value>1.2</value>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:         <value>2.0</value>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:     </tpm>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:     <redirdev supported='yes'>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:     </redirdev>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:     <channel supported='yes'>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:         <value>pty</value>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:         <value>unix</value>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:         <value>spicevmc</value>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:     </channel>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:     <crypto supported='yes'>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:         <value>qemu</value>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:     </crypto>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:   </devices>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:   <features>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:     <gic supported='no'/>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:     <vmcoreinfo supported='no'/>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:     <genid supported='no'/>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:     <backingStoreInput supported='yes'/>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:     <backup supported='yes'/>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:     <async-teardown supported='yes'/>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:     <sev supported='no'/>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:     <sgx supported='no'/>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:   </features>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]: </domainCapabilities>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 01:49:21.472822 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=98241) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 01:49:21.472822 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Libvirt host hypervisor capabilities for arch=riscv32 and machine_type=None:
May 28 01:49:21.472822 np0000001583 nova-compute[98241]: <domainCapabilities>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:   <path>/usr/bin/qemu-system-riscv32</path>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:   <domain>qemu</domain>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:   <machine>virt</machine>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:   <arch>riscv32</arch>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:   <vcpu max='512'/>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:   <iothreads supported='yes'/>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:   <os supported='yes'>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:     <enum name='firmware'/>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:     <loader supported='yes'>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 01:49:21.472822 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:         <value>rom</value>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:         <value>pflash</value>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:       <enum name='readonly'>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:         <value>yes</value>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:       <enum name='secure'>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:     </loader>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:   </os>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:   <cpu>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:     <mode name='host-passthrough' supported='no'/>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:     <mode name='maximum' supported='yes'>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:       <enum name='maximumMigratable'>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:         <value>on</value>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:         <value>off</value>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:     </mode>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:     <mode name='host-model' supported='no'/>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:     <mode name='custom' supported='no'/>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:   <memoryBacking supported='yes'>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:     <enum name='sourceType'>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:       <value>file</value>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:       <value>anonymous</value>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:       <value>memfd</value>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:     </enum>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:   </memoryBacking>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:   <devices>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:     <disk supported='yes'>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:       <enum name='diskDevice'>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:         <value>disk</value>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:         <value>cdrom</value>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:         <value>floppy</value>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:         <value>lun</value>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:         <value>fdc</value>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:         <value>sata</value>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:     </disk>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:     <graphics supported='yes'>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:         <value>sdl</value>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:         <value>vnc</value>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:         <value>spice</value>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:         <value>egl-headless</value>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:         <value>dbus</value>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:     </graphics>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:     <video supported='yes'>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:       <enum name='modelType'>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:         <value>vga</value>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:         <value>cirrus</value>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:         <value>none</value>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:         <value>bochs</value>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:         <value>ramfb</value>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:     </video>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:     <hostdev supported='yes'>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:       <enum name='mode'>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:         <value>subsystem</value>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:       <enum name='startupPolicy'>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:         <value>default</value>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:         <value>mandatory</value>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:         <value>requisite</value>
May 28 01:49:21.473785 np0000001583 nova-compute[98241]:         <value>optional</value>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:       <enum name='subsysType'>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:         <value>pci</value>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:       <enum name='capsType'/>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:       <enum name='pciBackend'/>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:     </hostdev>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:     <rng supported='yes'>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:         <value>random</value>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:         <value>egd</value>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:     </rng>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:     <filesystem supported='yes'>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:       <enum name='driverType'>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:         <value>path</value>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:         <value>handle</value>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:         <value>virtiofs</value>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:     </filesystem>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:     <tpm supported='yes'>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:         <value>tpm-tis</value>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:         <value>passthrough</value>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:         <value>emulator</value>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:         <value>external</value>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:       <enum name='backendVersion'>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:         <value>1.2</value>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:         <value>2.0</value>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:     </tpm>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:     <redirdev supported='yes'>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:     </redirdev>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:     <channel supported='yes'>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:         <value>pty</value>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:         <value>unix</value>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:         <value>spicevmc</value>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:     </channel>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:     <crypto supported='yes'>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:         <value>qemu</value>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:     </crypto>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:   </devices>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:   <features>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:     <gic supported='no'/>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:     <vmcoreinfo supported='yes'/>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:     <genid supported='no'/>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:     <backingStoreInput supported='yes'/>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:     <backup supported='yes'/>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:     <async-teardown supported='yes'/>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:     <sev supported='no'/>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:     <sgx supported='no'/>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:   </features>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]: </domainCapabilities>
May 28 01:49:21.475350 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 01:49:21.476810 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=98241) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 01:49:21.476810 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Libvirt host hypervisor capabilities for arch=riscv64 and machine_type=None:
May 28 01:49:21.476810 np0000001583 nova-compute[98241]: <domainCapabilities>
May 28 01:49:21.476810 np0000001583 nova-compute[98241]:   <path>/usr/bin/qemu-system-riscv64</path>
May 28 01:49:21.476810 np0000001583 nova-compute[98241]:   <domain>qemu</domain>
May 28 01:49:21.476810 np0000001583 nova-compute[98241]:   <machine>virt</machine>
May 28 01:49:21.476810 np0000001583 nova-compute[98241]:   <arch>riscv64</arch>
May 28 01:49:21.476810 np0000001583 nova-compute[98241]:   <vcpu max='512'/>
May 28 01:49:21.476810 np0000001583 nova-compute[98241]:   <iothreads supported='yes'/>
May 28 01:49:21.476810 np0000001583 nova-compute[98241]:   <os supported='yes'>
May 28 01:49:21.476810 np0000001583 nova-compute[98241]:     <enum name='firmware'/>
May 28 01:49:21.476810 np0000001583 nova-compute[98241]:     <loader supported='yes'>
May 28 01:49:21.476810 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 01:49:21.476810 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 01:49:21.476810 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.476810 np0000001583 nova-compute[98241]:         <value>rom</value>
May 28 01:49:21.476810 np0000001583 nova-compute[98241]:         <value>pflash</value>
May 28 01:49:21.476810 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.476810 np0000001583 nova-compute[98241]:       <enum name='readonly'>
May 28 01:49:21.476810 np0000001583 nova-compute[98241]:         <value>yes</value>
May 28 01:49:21.476810 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.476810 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.476810 np0000001583 nova-compute[98241]:       <enum name='secure'>
May 28 01:49:21.476810 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.476810 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.476810 np0000001583 nova-compute[98241]:     </loader>
May 28 01:49:21.476810 np0000001583 nova-compute[98241]:   </os>
May 28 01:49:21.476810 np0000001583 nova-compute[98241]:   <cpu>
May 28 01:49:21.476810 np0000001583 nova-compute[98241]:     <mode name='host-passthrough' supported='no'/>
May 28 01:49:21.476810 np0000001583 nova-compute[98241]:     <mode name='maximum' supported='yes'>
May 28 01:49:21.476810 np0000001583 nova-compute[98241]:       <enum name='maximumMigratable'>
May 28 01:49:21.476810 np0000001583 nova-compute[98241]:         <value>on</value>
May 28 01:49:21.476810 np0000001583 nova-compute[98241]:         <value>off</value>
May 28 01:49:21.476810 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.476810 np0000001583 nova-compute[98241]:     </mode>
May 28 01:49:21.476810 np0000001583 nova-compute[98241]:     <mode name='host-model' supported='no'/>
May 28 01:49:21.476810 np0000001583 nova-compute[98241]:     <mode name='custom' supported='yes'>
May 28 01:49:21.476810 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>rv64</model>
May 28 01:49:21.476810 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>sifive-e51</model>
May 28 01:49:21.476810 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>any</model>
May 28 01:49:21.476810 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>x-rv128</model>
May 28 01:49:21.476810 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>shakti-c</model>
May 28 01:49:21.476810 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>max</model>
May 28 01:49:21.476810 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>thead-c906</model>
May 28 01:49:21.476810 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>sifive-u54</model>
May 28 01:49:21.476810 np0000001583 nova-compute[98241]:       <model usable='unknown' vendor='unknown'>veyron-v1</model>
May 28 01:49:21.476810 np0000001583 nova-compute[98241]:     </mode>
May 28 01:49:21.476810 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:49:21.476810 np0000001583 nova-compute[98241]:   <memoryBacking supported='yes'>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:     <enum name='sourceType'>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:       <value>file</value>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:       <value>anonymous</value>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:       <value>memfd</value>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:     </enum>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:   </memoryBacking>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:   <devices>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:     <disk supported='yes'>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:       <enum name='diskDevice'>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:         <value>disk</value>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:         <value>cdrom</value>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:         <value>floppy</value>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:         <value>lun</value>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:         <value>fdc</value>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:         <value>sata</value>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:     </disk>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:     <graphics supported='yes'>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:         <value>sdl</value>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:         <value>vnc</value>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:         <value>spice</value>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:         <value>egl-headless</value>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:         <value>dbus</value>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:     </graphics>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:     <video supported='yes'>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:       <enum name='modelType'>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:         <value>vga</value>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:         <value>cirrus</value>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:         <value>none</value>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:         <value>bochs</value>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:         <value>ramfb</value>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:     </video>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:     <hostdev supported='yes'>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:       <enum name='mode'>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:         <value>subsystem</value>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:       <enum name='startupPolicy'>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:         <value>default</value>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:         <value>mandatory</value>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:         <value>requisite</value>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:         <value>optional</value>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:       <enum name='subsysType'>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:         <value>pci</value>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:       <enum name='capsType'/>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:       <enum name='pciBackend'/>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:     </hostdev>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:     <rng supported='yes'>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:         <value>random</value>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:         <value>egd</value>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:     </rng>
May 28 01:49:21.477762 np0000001583 nova-compute[98241]:     <filesystem supported='yes'>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:       <enum name='driverType'>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:         <value>path</value>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:         <value>handle</value>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:         <value>virtiofs</value>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:     </filesystem>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:     <tpm supported='yes'>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:         <value>tpm-tis</value>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:         <value>passthrough</value>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:         <value>emulator</value>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:         <value>external</value>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:       <enum name='backendVersion'>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:         <value>1.2</value>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:         <value>2.0</value>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:     </tpm>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:     <redirdev supported='yes'>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:     </redirdev>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:     <channel supported='yes'>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:         <value>pty</value>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:         <value>unix</value>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:         <value>spicevmc</value>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:     </channel>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:     <crypto supported='yes'>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:         <value>qemu</value>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:     </crypto>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:   </devices>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:   <features>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:     <gic supported='no'/>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:     <vmcoreinfo supported='yes'/>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:     <genid supported='no'/>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:     <backingStoreInput supported='yes'/>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:     <backup supported='yes'/>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:     <async-teardown supported='yes'/>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:     <sev supported='no'/>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:     <sgx supported='no'/>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:   </features>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]: </domainCapabilities>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 01:49:21.479143 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=98241) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 01:49:21.479143 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Libvirt host hypervisor capabilities for arch=s390x and machine_type=s390-ccw-virtio:
May 28 01:49:21.479143 np0000001583 nova-compute[98241]: <domainCapabilities>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:   <path>/usr/bin/qemu-system-s390x</path>
May 28 01:49:21.479143 np0000001583 nova-compute[98241]:   <domain>qemu</domain>
May 28 01:49:21.480145 np0000001583 nova-compute[98241]:   <machine>s390-ccw-virtio-noble</machine>
May 28 01:49:21.480145 np0000001583 nova-compute[98241]:   <arch>s390x</arch>
May 28 01:49:21.480145 np0000001583 nova-compute[98241]:   <vcpu max='248'/>
May 28 01:49:21.480145 np0000001583 nova-compute[98241]:   <iothreads supported='yes'/>
May 28 01:49:21.480145 np0000001583 nova-compute[98241]:   <os supported='yes'>
May 28 01:49:21.480145 np0000001583 nova-compute[98241]:     <enum name='firmware'/>
May 28 01:49:21.480145 np0000001583 nova-compute[98241]:     <loader supported='yes'>
May 28 01:49:21.480145 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 01:49:21.480145 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 01:49:21.480145 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.480145 np0000001583 nova-compute[98241]:         <value>rom</value>
May 28 01:49:21.480145 np0000001583 nova-compute[98241]:         <value>pflash</value>
May 28 01:49:21.480145 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.480145 np0000001583 nova-compute[98241]:       <enum name='readonly'>
May 28 01:49:21.480145 np0000001583 nova-compute[98241]:         <value>yes</value>
May 28 01:49:21.480145 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.480145 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.480145 np0000001583 nova-compute[98241]:       <enum name='secure'>
May 28 01:49:21.480145 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.480145 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.480145 np0000001583 nova-compute[98241]:     </loader>
May 28 01:49:21.480145 np0000001583 nova-compute[98241]:   </os>
May 28 01:49:21.480145 np0000001583 nova-compute[98241]:   <cpu>
May 28 01:49:21.480145 np0000001583 nova-compute[98241]:     <mode name='host-passthrough' supported='no'/>
May 28 01:49:21.480145 np0000001583 nova-compute[98241]:     <mode name='maximum' supported='yes'>
May 28 01:49:21.480145 np0000001583 nova-compute[98241]:       <enum name='maximumMigratable'>
May 28 01:49:21.480145 np0000001583 nova-compute[98241]:         <value>on</value>
May 28 01:49:21.480145 np0000001583 nova-compute[98241]:         <value>off</value>
May 28 01:49:21.480145 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.480145 np0000001583 nova-compute[98241]:     </mode>
May 28 01:49:21.480145 np0000001583 nova-compute[98241]:     <mode name='host-model' supported='no'/>
May 28 01:49:21.480145 np0000001583 nova-compute[98241]:     <mode name='custom' supported='yes'>
May 28 01:49:21.480145 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>z13</model>
May 28 01:49:21.480145 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>z990.3</model>
May 28 01:49:21.480145 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>z13-base</model>
May 28 01:49:21.480145 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>z990.2</model>
May 28 01:49:21.480145 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>z196.2-base</model>
May 28 01:49:21.480145 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>z14</model>
May 28 01:49:21.480145 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>z14.2-base</model>
May 28 01:49:21.480145 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>z990.4</model>
May 28 01:49:21.480145 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>z196</model>
May 28 01:49:21.480145 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>z10BC.2-base</model>
May 28 01:49:21.480145 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>z114-base</model>
May 28 01:49:21.480145 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>gen16b</model>
May 28 01:49:21.480145 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>z890.3-base</model>
May 28 01:49:21.480145 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>gen16a</model>
May 28 01:49:21.480145 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>z990.5</model>
May 28 01:49:21.480145 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>z196.2</model>
May 28 01:49:21.480145 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>zEC12</model>
May 28 01:49:21.480145 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>zEC12.2</model>
May 28 01:49:21.480145 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>z9EC.2</model>
May 28 01:49:21.480145 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>z9BC</model>
May 28 01:49:21.480145 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>z9EC.3-base</model>
May 28 01:49:21.481153 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='IBM'>z800-base</model>
May 28 01:49:21.481153 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>z14ZR1-base</model>
May 28 01:49:21.481153 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>z890</model>
May 28 01:49:21.481153 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>z990.4-base</model>
May 28 01:49:21.481153 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>z9EC.3</model>
May 28 01:49:21.481153 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>z13.2</model>
May 28 01:49:21.481153 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>z10BC.2</model>
May 28 01:49:21.481153 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>gen15a-base</model>
May 28 01:49:21.481153 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>z14.2</model>
May 28 01:49:21.481153 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>zBC12-base</model>
May 28 01:49:21.481153 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>gen16a-base</model>
May 28 01:49:21.481153 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='IBM'>z900.3</model>
May 28 01:49:21.481153 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>z196-base</model>
May 28 01:49:21.481153 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>z990</model>
May 28 01:49:21.481153 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>z14-base</model>
May 28 01:49:21.481153 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='IBM'>z900.2</model>
May 28 01:49:21.481153 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='IBM'>z800</model>
May 28 01:49:21.481153 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>z10EC</model>
May 28 01:49:21.481153 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>z14ZR1</model>
May 28 01:49:21.481153 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='IBM'>z900</model>
May 28 01:49:21.481153 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>z10EC.2</model>
May 28 01:49:21.481153 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>z10EC.2-base</model>
May 28 01:49:21.481153 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='IBM'>z900.2-base</model>
May 28 01:49:21.481153 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='IBM'>z900-base</model>
May 28 01:49:21.481153 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>z10EC.3</model>
May 28 01:49:21.481153 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>z990.5-base</model>
May 28 01:49:21.481153 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>max</model>
May 28 01:49:21.481153 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>gen15b</model>
May 28 01:49:21.481153 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>z9BC.2-base</model>
May 28 01:49:21.481153 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>gen15a</model>
May 28 01:49:21.481153 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>z990.2-base</model>
May 28 01:49:21.481153 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>z10EC-base</model>
May 28 01:49:21.481153 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>gen16b-base</model>
May 28 01:49:21.481153 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>z114</model>
May 28 01:49:21.481153 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>z9EC-base</model>
May 28 01:49:21.481153 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>z13s</model>
May 28 01:49:21.481153 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>qemu</model>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>gen15b-base</model>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>zEC12-base</model>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>z890.3</model>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>z10EC.3-base</model>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>z890.2-base</model>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>z890.2</model>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>z10BC-base</model>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>zEC12.2-base</model>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>z890-base</model>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>z9BC-base</model>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>z10BC</model>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>z9EC</model>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>z9EC.2-base</model>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>z13.2-base</model>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='IBM'>z900.3-base</model>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>z990.3-base</model>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>z13s-base</model>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>zBC12</model>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>z990-base</model>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:       <model usable='no' vendor='IBM'>z9BC.2</model>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:     </mode>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:   <memoryBacking supported='yes'>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:     <enum name='sourceType'>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:       <value>file</value>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:       <value>anonymous</value>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:       <value>memfd</value>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:     </enum>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:   </memoryBacking>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:   <devices>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:     <disk supported='yes'>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:       <enum name='diskDevice'>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:         <value>disk</value>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:         <value>cdrom</value>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:         <value>floppy</value>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:         <value>lun</value>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:         <value>fdc</value>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:     </disk>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:     <graphics supported='yes'>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:         <value>sdl</value>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:         <value>vnc</value>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:         <value>spice</value>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:         <value>egl-headless</value>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:         <value>dbus</value>
May 28 01:49:21.481937 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:     </graphics>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:     <video supported='yes'>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:       <enum name='modelType'>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:         <value>none</value>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:     </video>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:     <hostdev supported='yes'>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:       <enum name='mode'>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:         <value>subsystem</value>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:       <enum name='startupPolicy'>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:         <value>default</value>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:         <value>mandatory</value>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:         <value>requisite</value>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:         <value>optional</value>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:       <enum name='subsysType'>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:         <value>pci</value>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:       <enum name='capsType'/>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:       <enum name='pciBackend'/>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:     </hostdev>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:     <rng supported='yes'>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:         <value>random</value>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:         <value>egd</value>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:     </rng>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:     <filesystem supported='yes'>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:       <enum name='driverType'>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:         <value>path</value>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:         <value>handle</value>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:         <value>virtiofs</value>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:     </filesystem>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:     <tpm supported='no'/>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:     <redirdev supported='yes'>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:     </redirdev>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:     <channel supported='yes'>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:         <value>pty</value>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:         <value>unix</value>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:         <value>spicevmc</value>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:     </channel>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:     <crypto supported='yes'>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:         <value>qemu</value>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:     </crypto>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:   </devices>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:   <features>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:     <gic supported='no'/>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:     <vmcoreinfo supported='no'/>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:     <genid supported='no'/>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:     <backingStoreInput supported='yes'/>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:     <backup supported='yes'/>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:     <async-teardown supported='yes'/>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:     <s390-pv supported='no'/>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:     <sev supported='no'/>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:     <sgx supported='no'/>
May 28 01:49:21.482931 np0000001583 nova-compute[98241]:   </features>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]: </domainCapabilities>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 01:49:21.484337 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=98241) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 01:49:21.484337 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Libvirt host hypervisor capabilities for arch=sh4 and machine_type=None:
May 28 01:49:21.484337 np0000001583 nova-compute[98241]: <domainCapabilities>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:   <path>/usr/bin/qemu-system-sh4</path>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:   <domain>qemu</domain>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:   <machine>shix</machine>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:   <arch>sh4</arch>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:   <vcpu max='1'/>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:   <iothreads supported='yes'/>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:   <os supported='yes'>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:     <enum name='firmware'/>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:     <loader supported='yes'>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:         <value>rom</value>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:         <value>pflash</value>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:       <enum name='readonly'>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:         <value>yes</value>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:       <enum name='secure'>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:     </loader>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:   </os>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:   <cpu>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:     <mode name='host-passthrough' supported='no'/>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:     <mode name='maximum' supported='no'/>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:     <mode name='host-model' supported='no'/>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:     <mode name='custom' supported='no'/>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:   <memoryBacking supported='yes'>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:     <enum name='sourceType'>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:       <value>file</value>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:       <value>anonymous</value>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:       <value>memfd</value>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:     </enum>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:   </memoryBacking>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:   <devices>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:     <disk supported='yes'>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:       <enum name='diskDevice'>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:         <value>disk</value>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:         <value>cdrom</value>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:         <value>floppy</value>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:         <value>lun</value>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:         <value>fdc</value>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:         <value>sata</value>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.484337 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:     </disk>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:     <graphics supported='yes'>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:         <value>sdl</value>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:         <value>vnc</value>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:         <value>spice</value>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:         <value>egl-headless</value>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:         <value>dbus</value>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:     </graphics>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:     <video supported='yes'>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:       <enum name='modelType'>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:         <value>vga</value>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:         <value>cirrus</value>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:         <value>none</value>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:         <value>bochs</value>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:     </video>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:     <hostdev supported='yes'>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:       <enum name='mode'>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:         <value>subsystem</value>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:       <enum name='startupPolicy'>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:         <value>default</value>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:         <value>mandatory</value>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:         <value>requisite</value>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:         <value>optional</value>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:       <enum name='subsysType'>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:         <value>pci</value>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:       <enum name='capsType'/>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:       <enum name='pciBackend'/>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:     </hostdev>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:     <rng supported='yes'>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:         <value>random</value>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:         <value>egd</value>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:     </rng>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:     <filesystem supported='yes'>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:       <enum name='driverType'>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:         <value>path</value>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:         <value>handle</value>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:         <value>virtiofs</value>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:     </filesystem>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:     <tpm supported='no'/>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:     <redirdev supported='yes'>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:     </redirdev>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:     <channel supported='yes'>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:         <value>pty</value>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:         <value>unix</value>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:         <value>spicevmc</value>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:     </channel>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:     <crypto supported='yes'>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:         <value>qemu</value>
May 28 01:49:21.485370 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:     </crypto>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:   </devices>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:   <features>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:     <gic supported='no'/>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:     <vmcoreinfo supported='no'/>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:     <genid supported='no'/>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:     <backingStoreInput supported='yes'/>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:     <backup supported='yes'/>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:     <async-teardown supported='yes'/>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:     <sev supported='no'/>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:     <sgx supported='no'/>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:   </features>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]: </domainCapabilities>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 01:49:21.486654 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=98241) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 01:49:21.486654 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Libvirt host hypervisor capabilities for arch=sh4eb and machine_type=None:
May 28 01:49:21.486654 np0000001583 nova-compute[98241]: <domainCapabilities>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:   <path>/usr/bin/qemu-system-sh4eb</path>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:   <domain>qemu</domain>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:   <machine>shix</machine>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:   <arch>sh4eb</arch>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:   <vcpu max='1'/>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:   <iothreads supported='yes'/>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:   <os supported='yes'>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:     <enum name='firmware'/>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:     <loader supported='yes'>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:         <value>rom</value>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:         <value>pflash</value>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:       <enum name='readonly'>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:         <value>yes</value>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:       <enum name='secure'>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:     </loader>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:   </os>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:   <cpu>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:     <mode name='host-passthrough' supported='no'/>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:     <mode name='maximum' supported='no'/>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:     <mode name='host-model' supported='no'/>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:     <mode name='custom' supported='no'/>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:   <memoryBacking supported='yes'>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:     <enum name='sourceType'>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:       <value>file</value>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:       <value>anonymous</value>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:       <value>memfd</value>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:     </enum>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:   </memoryBacking>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:   <devices>
May 28 01:49:21.486654 np0000001583 nova-compute[98241]:     <disk supported='yes'>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:       <enum name='diskDevice'>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:         <value>disk</value>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:         <value>cdrom</value>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:         <value>floppy</value>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:         <value>lun</value>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:         <value>fdc</value>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:         <value>sata</value>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:     </disk>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:     <graphics supported='yes'>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:         <value>sdl</value>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:         <value>vnc</value>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:         <value>spice</value>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:         <value>egl-headless</value>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:         <value>dbus</value>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:     </graphics>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:     <video supported='yes'>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:       <enum name='modelType'>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:         <value>vga</value>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:         <value>cirrus</value>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:         <value>none</value>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:         <value>bochs</value>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:     </video>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:     <hostdev supported='yes'>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:       <enum name='mode'>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:         <value>subsystem</value>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:       <enum name='startupPolicy'>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:         <value>default</value>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:         <value>mandatory</value>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:         <value>requisite</value>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:         <value>optional</value>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:       <enum name='subsysType'>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:         <value>pci</value>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:       <enum name='capsType'/>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:       <enum name='pciBackend'/>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:     </hostdev>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:     <rng supported='yes'>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:         <value>random</value>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:         <value>egd</value>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:     </rng>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:     <filesystem supported='yes'>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:       <enum name='driverType'>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:         <value>path</value>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:         <value>handle</value>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:         <value>virtiofs</value>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:     </filesystem>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:     <tpm supported='no'/>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:     <redirdev supported='yes'>
May 28 01:49:21.487687 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:     </redirdev>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:     <channel supported='yes'>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:         <value>pty</value>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:         <value>unix</value>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:         <value>spicevmc</value>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:     </channel>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:     <crypto supported='yes'>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:         <value>qemu</value>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:     </crypto>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:   </devices>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:   <features>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:     <gic supported='no'/>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:     <vmcoreinfo supported='no'/>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:     <genid supported='no'/>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:     <backingStoreInput supported='yes'/>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:     <backup supported='yes'/>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:     <async-teardown supported='yes'/>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:     <sev supported='no'/>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:     <sgx supported='no'/>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:   </features>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]: </domainCapabilities>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 01:49:21.489124 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=98241) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 01:49:21.489124 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Libvirt host hypervisor capabilities for arch=sparc and machine_type=None:
May 28 01:49:21.489124 np0000001583 nova-compute[98241]: <domainCapabilities>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:   <path>/usr/bin/qemu-system-sparc</path>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:   <domain>qemu</domain>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:   <machine>SS-5</machine>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:   <arch>sparc</arch>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:   <vcpu max='1'/>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:   <iothreads supported='yes'/>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:   <os supported='yes'>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:     <enum name='firmware'/>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:     <loader supported='yes'>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:         <value>rom</value>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:         <value>pflash</value>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:       <enum name='readonly'>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:         <value>yes</value>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:       <enum name='secure'>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:     </loader>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:   </os>
May 28 01:49:21.489124 np0000001583 nova-compute[98241]:   <cpu>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:     <mode name='host-passthrough' supported='no'/>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:     <mode name='maximum' supported='no'/>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:     <mode name='host-model' supported='no'/>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:     <mode name='custom' supported='no'/>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:   <memoryBacking supported='yes'>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:     <enum name='sourceType'>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:       <value>file</value>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:       <value>anonymous</value>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:       <value>memfd</value>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:     </enum>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:   </memoryBacking>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:   <devices>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:     <disk supported='yes'>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:       <enum name='diskDevice'>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:         <value>disk</value>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:         <value>cdrom</value>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:         <value>floppy</value>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:         <value>lun</value>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:         <value>fdc</value>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:     </disk>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:     <graphics supported='yes'>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:         <value>sdl</value>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:         <value>vnc</value>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:         <value>spice</value>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:         <value>egl-headless</value>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:         <value>dbus</value>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:     </graphics>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:     <video supported='yes'>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:       <enum name='modelType'>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:         <value>none</value>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:     </video>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:     <hostdev supported='yes'>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:       <enum name='mode'>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:         <value>subsystem</value>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:       <enum name='startupPolicy'>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:         <value>default</value>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:         <value>mandatory</value>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:         <value>requisite</value>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:         <value>optional</value>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:       <enum name='subsysType'>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:         <value>pci</value>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:       <enum name='capsType'/>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:       <enum name='pciBackend'/>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:     </hostdev>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:     <rng supported='yes'>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:       <enum name='model'/>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:         <value>random</value>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:         <value>egd</value>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:     </rng>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:     <filesystem supported='yes'>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:       <enum name='driverType'>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:         <value>path</value>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:         <value>handle</value>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:     </filesystem>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:     <tpm supported='no'/>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:     <redirdev supported='no'/>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:     <channel supported='yes'>
May 28 01:49:21.490160 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:         <value>pty</value>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:         <value>unix</value>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:         <value>spicevmc</value>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:     </channel>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:     <crypto supported='yes'>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:       <enum name='model'/>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:         <value>qemu</value>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:     </crypto>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:   </devices>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:   <features>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:     <gic supported='no'/>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:     <vmcoreinfo supported='no'/>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:     <genid supported='no'/>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:     <backingStoreInput supported='yes'/>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:     <backup supported='yes'/>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:     <async-teardown supported='yes'/>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:     <sev supported='no'/>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:     <sgx supported='no'/>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:   </features>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]: </domainCapabilities>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 01:49:21.491426 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=98241) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 01:49:21.491426 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Libvirt host hypervisor capabilities for arch=sparc64 and machine_type=None:
May 28 01:49:21.491426 np0000001583 nova-compute[98241]: <domainCapabilities>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:   <path>/usr/bin/qemu-system-sparc64</path>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:   <domain>qemu</domain>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:   <machine>sun4u</machine>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:   <arch>sparc64</arch>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:   <vcpu max='1'/>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:   <iothreads supported='yes'/>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:   <os supported='yes'>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:     <enum name='firmware'/>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:     <loader supported='yes'>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:         <value>rom</value>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:         <value>pflash</value>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:       <enum name='readonly'>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:         <value>yes</value>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:       <enum name='secure'>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:     </loader>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:   </os>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:   <cpu>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:     <mode name='host-passthrough' supported='no'/>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:     <mode name='maximum' supported='no'/>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:     <mode name='host-model' supported='no'/>
May 28 01:49:21.491426 np0000001583 nova-compute[98241]:     <mode name='custom' supported='no'/>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:   <memoryBacking supported='yes'>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:     <enum name='sourceType'>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:       <value>file</value>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:       <value>anonymous</value>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:       <value>memfd</value>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:     </enum>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:   </memoryBacking>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:   <devices>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:     <disk supported='yes'>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:       <enum name='diskDevice'>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:         <value>disk</value>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:         <value>cdrom</value>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:         <value>floppy</value>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:         <value>lun</value>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:         <value>ide</value>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:         <value>fdc</value>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:         <value>sata</value>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:     </disk>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:     <graphics supported='yes'>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:         <value>sdl</value>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:         <value>vnc</value>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:         <value>spice</value>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:         <value>egl-headless</value>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:         <value>dbus</value>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:     </graphics>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:     <video supported='yes'>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:       <enum name='modelType'>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:         <value>vga</value>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:         <value>cirrus</value>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:         <value>none</value>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:         <value>bochs</value>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:     </video>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:     <hostdev supported='yes'>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:       <enum name='mode'>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:         <value>subsystem</value>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:       <enum name='startupPolicy'>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:         <value>default</value>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:         <value>mandatory</value>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:         <value>requisite</value>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:         <value>optional</value>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:       <enum name='subsysType'>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:         <value>pci</value>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:       <enum name='capsType'/>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:       <enum name='pciBackend'/>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:     </hostdev>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:     <rng supported='yes'>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:         <value>random</value>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:         <value>egd</value>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.492368 np0000001583 nova-compute[98241]:     </rng>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:     <filesystem supported='yes'>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:       <enum name='driverType'>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:         <value>path</value>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:         <value>handle</value>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:         <value>virtiofs</value>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:     </filesystem>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:     <tpm supported='no'/>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:     <redirdev supported='yes'>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:     </redirdev>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:     <channel supported='yes'>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:         <value>pty</value>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:         <value>unix</value>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:         <value>spicevmc</value>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:     </channel>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:     <crypto supported='yes'>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:         <value>qemu</value>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:     </crypto>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:   </devices>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:   <features>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:     <gic supported='no'/>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:     <vmcoreinfo supported='no'/>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:     <genid supported='no'/>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:     <backingStoreInput supported='yes'/>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:     <backup supported='yes'/>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:     <async-teardown supported='yes'/>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:     <sev supported='no'/>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:     <sgx supported='no'/>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:   </features>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]: </domainCapabilities>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 01:49:21.493586 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'pc', 'ubuntu-q35', 'q35'} {{(pid=98241) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 01:49:21.493586 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
May 28 01:49:21.493586 np0000001583 nova-compute[98241]: <domainCapabilities>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:   <path>/usr/bin/qemu-system-x86_64</path>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:   <domain>qemu</domain>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:   <machine>pc-i440fx-noble-v2</machine>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:   <arch>x86_64</arch>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:   <vcpu max='255'/>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:   <iothreads supported='yes'/>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:   <os supported='yes'>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:     <enum name='firmware'>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:       <value>efi</value>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:     </enum>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:     <loader supported='yes'>
May 28 01:49:21.493586 np0000001583 nova-compute[98241]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 28 01:49:21.494554 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.494554 np0000001583 nova-compute[98241]:         <value>rom</value>
May 28 01:49:21.494554 np0000001583 nova-compute[98241]:         <value>pflash</value>
May 28 01:49:21.494554 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.494554 np0000001583 nova-compute[98241]:       <enum name='readonly'>
May 28 01:49:21.494554 np0000001583 nova-compute[98241]:         <value>yes</value>
May 28 01:49:21.494554 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.494554 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.494554 np0000001583 nova-compute[98241]:       <enum name='secure'>
May 28 01:49:21.494554 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.494554 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.494554 np0000001583 nova-compute[98241]:     </loader>
May 28 01:49:21.494554 np0000001583 nova-compute[98241]:   </os>
May 28 01:49:21.494554 np0000001583 nova-compute[98241]:   <cpu>
May 28 01:49:21.494554 np0000001583 nova-compute[98241]:     <mode name='host-passthrough' supported='no'/>
May 28 01:49:21.494554 np0000001583 nova-compute[98241]:     <mode name='maximum' supported='yes'>
May 28 01:49:21.494554 np0000001583 nova-compute[98241]:       <enum name='maximumMigratable'>
May 28 01:49:21.494554 np0000001583 nova-compute[98241]:         <value>on</value>
May 28 01:49:21.494554 np0000001583 nova-compute[98241]:         <value>off</value>
May 28 01:49:21.494554 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.494554 np0000001583 nova-compute[98241]:     </mode>
May 28 01:49:21.494554 np0000001583 nova-compute[98241]:     <mode name='host-model' supported='yes'>
May 28 01:49:21.494554 np0000001583 nova-compute[98241]:       <model fallback='forbid'>EPYC</model>
May 28 01:49:21.494554 np0000001583 nova-compute[98241]:       <vendor>AMD</vendor>
May 28 01:49:21.494554 np0000001583 nova-compute[98241]:       <feature policy='require' name='acpi'/>
May 28 01:49:21.494554 np0000001583 nova-compute[98241]:       <feature policy='require' name='ss'/>
May 28 01:49:21.494554 np0000001583 nova-compute[98241]:       <feature policy='require' name='monitor'/>
May 28 01:49:21.494554 np0000001583 nova-compute[98241]:       <feature policy='require' name='hypervisor'/>
May 28 01:49:21.494554 np0000001583 nova-compute[98241]:       <feature policy='require' name='erms'/>
May 28 01:49:21.494554 np0000001583 nova-compute[98241]:       <feature policy='require' name='mpx'/>
May 28 01:49:21.494554 np0000001583 nova-compute[98241]:       <feature policy='require' name='pcommit'/>
May 28 01:49:21.494554 np0000001583 nova-compute[98241]:       <feature policy='require' name='clwb'/>
May 28 01:49:21.494554 np0000001583 nova-compute[98241]:       <feature policy='require' name='umip'/>
May 28 01:49:21.494554 np0000001583 nova-compute[98241]:       <feature policy='require' name='pku'/>
May 28 01:49:21.494554 np0000001583 nova-compute[98241]:       <feature policy='require' name='vaes'/>
May 28 01:49:21.494554 np0000001583 nova-compute[98241]:       <feature policy='require' name='la57'/>
May 28 01:49:21.494554 np0000001583 nova-compute[98241]:       <feature policy='require' name='rdpid'/>
May 28 01:49:21.494554 np0000001583 nova-compute[98241]:       <feature policy='require' name='pks'/>
May 28 01:49:21.494554 np0000001583 nova-compute[98241]:       <feature policy='require' name='fsrm'/>
May 28 01:49:21.494554 np0000001583 nova-compute[98241]:       <feature policy='require' name='fzrm'/>
May 28 01:49:21.494554 np0000001583 nova-compute[98241]:       <feature policy='require' name='fsrs'/>
May 28 01:49:21.494554 np0000001583 nova-compute[98241]:       <feature policy='require' name='fsrc'/>
May 28 01:49:21.494554 np0000001583 nova-compute[98241]:       <feature policy='require' name='3dnowext'/>
May 28 01:49:21.494554 np0000001583 nova-compute[98241]:       <feature policy='require' name='3dnow'/>
May 28 01:49:21.494554 np0000001583 nova-compute[98241]:       <feature policy='require' name='xsaveerptr'/>
May 28 01:49:21.494554 np0000001583 nova-compute[98241]:       <feature policy='require' name='wbnoinvd'/>
May 28 01:49:21.494554 np0000001583 nova-compute[98241]:       <feature policy='require' name='npt'/>
May 28 01:49:21.494554 np0000001583 nova-compute[98241]:       <feature policy='require' name='vgif'/>
May 28 01:49:21.494554 np0000001583 nova-compute[98241]:       <feature policy='require' name='svme-addr-chk'/>
May 28 01:49:21.494554 np0000001583 nova-compute[98241]:       <feature policy='disable' name='vme'/>
May 28 01:49:21.494554 np0000001583 nova-compute[98241]:       <feature policy='disable' name='xsavec'/>
May 28 01:49:21.494554 np0000001583 nova-compute[98241]:       <feature policy='disable' name='fxsr_opt'/>
May 28 01:49:21.494554 np0000001583 nova-compute[98241]:       <feature policy='disable' name='misalignsse'/>
May 28 01:49:21.494554 np0000001583 nova-compute[98241]:       <feature policy='disable' name='osvw'/>
May 28 01:49:21.495389 np0000001583 nova-compute[98241]:       <feature policy='disable' name='topoext'/>
May 28 01:49:21.495389 np0000001583 nova-compute[98241]:       <feature policy='disable' name='nrip-save'/>
May 28 01:49:21.495389 np0000001583 nova-compute[98241]:     </mode>
May 28 01:49:21.495389 np0000001583 nova-compute[98241]:     <mode name='custom' supported='yes'>
May 28 01:49:21.495389 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 28 01:49:21.495389 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 28 01:49:21.495389 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>phenom</model>
May 28 01:49:21.495389 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 28 01:49:21.495389 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 28 01:49:21.495389 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>pentium</model>
May 28 01:49:21.495389 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='Intel'>n270</model>
May 28 01:49:21.495389 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 28 01:49:21.495389 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 28 01:49:21.495389 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 28 01:49:21.495389 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 28 01:49:21.495389 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='AMD'>athlon</model>
May 28 01:49:21.495389 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 28 01:49:21.495389 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 28 01:49:21.495389 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 28 01:49:21.495389 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 28 01:49:21.495389 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 28 01:49:21.495389 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 28 01:49:21.495389 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 28 01:49:21.495389 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 28 01:49:21.495389 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 28 01:49:21.495389 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 28 01:49:21.495389 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 28 01:49:21.495389 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 28 01:49:21.495389 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 28 01:49:21.495389 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 28 01:49:21.495389 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 28 01:49:21.495389 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 28 01:49:21.495389 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 28 01:49:21.495389 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 28 01:49:21.495389 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 28 01:49:21.495912 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 28 01:49:21.495912 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 28 01:49:21.495912 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 28 01:49:21.495912 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 28 01:49:21.495912 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 28 01:49:21.495912 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 28 01:49:21.495912 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 28 01:49:21.495912 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 28 01:49:21.495912 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Haswell</model>
May 28 01:49:21.495912 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 28 01:49:21.495912 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 28 01:49:21.495912 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 28 01:49:21.495912 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 28 01:49:21.495912 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>EPYC</model>
May 28 01:49:21.495912 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 28 01:49:21.495912 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 28 01:49:21.495912 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 28 01:49:21.495912 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 28 01:49:21.495912 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 28 01:49:21.495912 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 28 01:49:21.495912 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 28 01:49:21.495912 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 28 01:49:21.495912 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 28 01:49:21.495912 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>486</model>
May 28 01:49:21.495912 np0000001583 nova-compute[98241]:     </mode>
May 28 01:49:21.495912 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:49:21.495912 np0000001583 nova-compute[98241]:   <memoryBacking supported='yes'>
May 28 01:49:21.495912 np0000001583 nova-compute[98241]:     <enum name='sourceType'>
May 28 01:49:21.495912 np0000001583 nova-compute[98241]:       <value>file</value>
May 28 01:49:21.495912 np0000001583 nova-compute[98241]:       <value>anonymous</value>
May 28 01:49:21.495912 np0000001583 nova-compute[98241]:       <value>memfd</value>
May 28 01:49:21.495912 np0000001583 nova-compute[98241]:     </enum>
May 28 01:49:21.495912 np0000001583 nova-compute[98241]:   </memoryBacking>
May 28 01:49:21.495912 np0000001583 nova-compute[98241]:   <devices>
May 28 01:49:21.495912 np0000001583 nova-compute[98241]:     <disk supported='yes'>
May 28 01:49:21.495912 np0000001583 nova-compute[98241]:       <enum name='diskDevice'>
May 28 01:49:21.495912 np0000001583 nova-compute[98241]:         <value>disk</value>
May 28 01:49:21.495912 np0000001583 nova-compute[98241]:         <value>cdrom</value>
May 28 01:49:21.495912 np0000001583 nova-compute[98241]:         <value>floppy</value>
May 28 01:49:21.495912 np0000001583 nova-compute[98241]:         <value>lun</value>
May 28 01:49:21.495912 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.495912 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.495912 np0000001583 nova-compute[98241]:         <value>ide</value>
May 28 01:49:21.495912 np0000001583 nova-compute[98241]:         <value>fdc</value>
May 28 01:49:21.495912 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.495912 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.495912 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.495912 np0000001583 nova-compute[98241]:         <value>sata</value>
May 28 01:49:21.495912 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:     </disk>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:     <graphics supported='yes'>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:         <value>sdl</value>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:         <value>vnc</value>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:         <value>spice</value>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:         <value>egl-headless</value>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:         <value>dbus</value>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:     </graphics>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:     <video supported='yes'>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:       <enum name='modelType'>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:         <value>vga</value>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:         <value>cirrus</value>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:         <value>vmvga</value>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:         <value>qxl</value>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:         <value>none</value>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:         <value>bochs</value>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:         <value>ramfb</value>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:     </video>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:     <hostdev supported='yes'>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:       <enum name='mode'>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:         <value>subsystem</value>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:       <enum name='startupPolicy'>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:         <value>default</value>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:         <value>mandatory</value>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:         <value>requisite</value>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:         <value>optional</value>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:       <enum name='subsysType'>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:         <value>pci</value>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:       <enum name='capsType'/>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:       <enum name='pciBackend'/>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:     </hostdev>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:     <rng supported='yes'>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:         <value>random</value>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:         <value>egd</value>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:     </rng>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:     <filesystem supported='yes'>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:       <enum name='driverType'>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:         <value>path</value>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:         <value>handle</value>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:         <value>virtiofs</value>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:     </filesystem>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:     <tpm supported='yes'>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:         <value>tpm-tis</value>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:         <value>tpm-crb</value>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:         <value>passthrough</value>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:         <value>emulator</value>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:         <value>external</value>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.496681 np0000001583 nova-compute[98241]:       <enum name='backendVersion'>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:         <value>1.2</value>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:         <value>2.0</value>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:     </tpm>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:     <redirdev supported='yes'>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:     </redirdev>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:     <channel supported='yes'>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:         <value>pty</value>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:         <value>unix</value>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:         <value>spicevmc</value>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:     </channel>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:     <crypto supported='yes'>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:         <value>qemu</value>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:     </crypto>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:   </devices>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:   <features>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:     <gic supported='no'/>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:     <vmcoreinfo supported='yes'/>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:     <genid supported='yes'/>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:     <backingStoreInput supported='yes'/>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:     <backup supported='yes'/>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:     <async-teardown supported='yes'/>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:     <sev supported='no'/>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:     <sgx supported='no'/>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:     <hyperv supported='yes'>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:       <enum name='features'>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:         <value>relaxed</value>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:         <value>vapic</value>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:         <value>spinlocks</value>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:         <value>vpindex</value>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:         <value>runtime</value>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:         <value>synic</value>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:         <value>stimer</value>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:         <value>reset</value>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:         <value>vendor_id</value>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:         <value>frequencies</value>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:         <value>reenlightenment</value>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:         <value>tlbflush</value>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:         <value>ipi</value>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:         <value>avic</value>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:     </hyperv>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:   </features>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]: </domainCapabilities>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 01:49:21.497853 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
May 28 01:49:21.497853 np0000001583 nova-compute[98241]: <domainCapabilities>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:   <path>/usr/bin/qemu-system-x86_64</path>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:   <domain>qemu</domain>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:   <machine>pc-i440fx-noble</machine>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:   <arch>x86_64</arch>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:   <vcpu max='255'/>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:   <iothreads supported='yes'/>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:   <os supported='yes'>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:     <enum name='firmware'>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:       <value>efi</value>
May 28 01:49:21.497853 np0000001583 nova-compute[98241]:     </enum>
May 28 01:49:21.499008 np0000001583 nova-compute[98241]:     <loader supported='yes'>
May 28 01:49:21.499008 np0000001583 nova-compute[98241]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 28 01:49:21.499008 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.499008 np0000001583 nova-compute[98241]:         <value>rom</value>
May 28 01:49:21.499008 np0000001583 nova-compute[98241]:         <value>pflash</value>
May 28 01:49:21.499008 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.499008 np0000001583 nova-compute[98241]:       <enum name='readonly'>
May 28 01:49:21.499008 np0000001583 nova-compute[98241]:         <value>yes</value>
May 28 01:49:21.499008 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.499008 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.499008 np0000001583 nova-compute[98241]:       <enum name='secure'>
May 28 01:49:21.499008 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.499008 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.499008 np0000001583 nova-compute[98241]:     </loader>
May 28 01:49:21.499008 np0000001583 nova-compute[98241]:   </os>
May 28 01:49:21.499008 np0000001583 nova-compute[98241]:   <cpu>
May 28 01:49:21.499008 np0000001583 nova-compute[98241]:     <mode name='host-passthrough' supported='no'/>
May 28 01:49:21.499008 np0000001583 nova-compute[98241]:     <mode name='maximum' supported='yes'>
May 28 01:49:21.499008 np0000001583 nova-compute[98241]:       <enum name='maximumMigratable'>
May 28 01:49:21.499008 np0000001583 nova-compute[98241]:         <value>on</value>
May 28 01:49:21.499008 np0000001583 nova-compute[98241]:         <value>off</value>
May 28 01:49:21.499008 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.499008 np0000001583 nova-compute[98241]:     </mode>
May 28 01:49:21.499008 np0000001583 nova-compute[98241]:     <mode name='host-model' supported='yes'>
May 28 01:49:21.499008 np0000001583 nova-compute[98241]:       <model fallback='forbid'>EPYC</model>
May 28 01:49:21.499008 np0000001583 nova-compute[98241]:       <vendor>AMD</vendor>
May 28 01:49:21.499008 np0000001583 nova-compute[98241]:       <feature policy='require' name='acpi'/>
May 28 01:49:21.499008 np0000001583 nova-compute[98241]:       <feature policy='require' name='ss'/>
May 28 01:49:21.499008 np0000001583 nova-compute[98241]:       <feature policy='require' name='monitor'/>
May 28 01:49:21.499008 np0000001583 nova-compute[98241]:       <feature policy='require' name='hypervisor'/>
May 28 01:49:21.499008 np0000001583 nova-compute[98241]:       <feature policy='require' name='erms'/>
May 28 01:49:21.499008 np0000001583 nova-compute[98241]:       <feature policy='require' name='mpx'/>
May 28 01:49:21.499008 np0000001583 nova-compute[98241]:       <feature policy='require' name='pcommit'/>
May 28 01:49:21.499008 np0000001583 nova-compute[98241]:       <feature policy='require' name='clwb'/>
May 28 01:49:21.499008 np0000001583 nova-compute[98241]:       <feature policy='require' name='umip'/>
May 28 01:49:21.499008 np0000001583 nova-compute[98241]:       <feature policy='require' name='pku'/>
May 28 01:49:21.499008 np0000001583 nova-compute[98241]:       <feature policy='require' name='vaes'/>
May 28 01:49:21.499008 np0000001583 nova-compute[98241]:       <feature policy='require' name='la57'/>
May 28 01:49:21.499008 np0000001583 nova-compute[98241]:       <feature policy='require' name='rdpid'/>
May 28 01:49:21.499008 np0000001583 nova-compute[98241]:       <feature policy='require' name='pks'/>
May 28 01:49:21.499008 np0000001583 nova-compute[98241]:       <feature policy='require' name='fsrm'/>
May 28 01:49:21.499008 np0000001583 nova-compute[98241]:       <feature policy='require' name='fzrm'/>
May 28 01:49:21.499008 np0000001583 nova-compute[98241]:       <feature policy='require' name='fsrs'/>
May 28 01:49:21.499008 np0000001583 nova-compute[98241]:       <feature policy='require' name='fsrc'/>
May 28 01:49:21.499008 np0000001583 nova-compute[98241]:       <feature policy='require' name='3dnowext'/>
May 28 01:49:21.499008 np0000001583 nova-compute[98241]:       <feature policy='require' name='3dnow'/>
May 28 01:49:21.499008 np0000001583 nova-compute[98241]:       <feature policy='require' name='xsaveerptr'/>
May 28 01:49:21.499008 np0000001583 nova-compute[98241]:       <feature policy='require' name='wbnoinvd'/>
May 28 01:49:21.499008 np0000001583 nova-compute[98241]:       <feature policy='require' name='npt'/>
May 28 01:49:21.499008 np0000001583 nova-compute[98241]:       <feature policy='require' name='vgif'/>
May 28 01:49:21.499008 np0000001583 nova-compute[98241]:       <feature policy='require' name='svme-addr-chk'/>
May 28 01:49:21.499008 np0000001583 nova-compute[98241]:       <feature policy='disable' name='vme'/>
May 28 01:49:21.499008 np0000001583 nova-compute[98241]:       <feature policy='disable' name='xsavec'/>
May 28 01:49:21.499008 np0000001583 nova-compute[98241]:       <feature policy='disable' name='fxsr_opt'/>
May 28 01:49:21.499838 np0000001583 nova-compute[98241]:       <feature policy='disable' name='misalignsse'/>
May 28 01:49:21.499838 np0000001583 nova-compute[98241]:       <feature policy='disable' name='osvw'/>
May 28 01:49:21.499838 np0000001583 nova-compute[98241]:       <feature policy='disable' name='topoext'/>
May 28 01:49:21.499838 np0000001583 nova-compute[98241]:       <feature policy='disable' name='nrip-save'/>
May 28 01:49:21.499838 np0000001583 nova-compute[98241]:     </mode>
May 28 01:49:21.499838 np0000001583 nova-compute[98241]:     <mode name='custom' supported='yes'>
May 28 01:49:21.499838 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 28 01:49:21.499838 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 28 01:49:21.499838 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>phenom</model>
May 28 01:49:21.499838 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 28 01:49:21.499838 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 28 01:49:21.499838 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>pentium</model>
May 28 01:49:21.499838 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='Intel'>n270</model>
May 28 01:49:21.499838 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 28 01:49:21.499838 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 28 01:49:21.499838 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 28 01:49:21.499838 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 28 01:49:21.499838 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='AMD'>athlon</model>
May 28 01:49:21.499838 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 28 01:49:21.499838 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 28 01:49:21.499838 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 28 01:49:21.499838 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 28 01:49:21.499838 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 28 01:49:21.499838 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 28 01:49:21.499838 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 28 01:49:21.499838 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 28 01:49:21.499838 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 28 01:49:21.499838 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 28 01:49:21.499838 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 28 01:49:21.499838 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 28 01:49:21.499838 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 28 01:49:21.499838 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 28 01:49:21.499838 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 28 01:49:21.499838 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 28 01:49:21.499838 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 28 01:49:21.500548 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 28 01:49:21.500548 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 28 01:49:21.500548 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 28 01:49:21.500548 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 28 01:49:21.500548 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 28 01:49:21.500548 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 28 01:49:21.500548 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 28 01:49:21.500548 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 28 01:49:21.500548 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 28 01:49:21.500548 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 28 01:49:21.500548 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Haswell</model>
May 28 01:49:21.500548 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 28 01:49:21.500548 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 28 01:49:21.500548 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 28 01:49:21.500548 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 28 01:49:21.500548 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>EPYC</model>
May 28 01:49:21.500548 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 28 01:49:21.500548 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 28 01:49:21.500548 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 28 01:49:21.500548 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 28 01:49:21.500548 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 28 01:49:21.500548 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 28 01:49:21.500548 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 28 01:49:21.500548 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 28 01:49:21.500548 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 28 01:49:21.500548 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>486</model>
May 28 01:49:21.500548 np0000001583 nova-compute[98241]:     </mode>
May 28 01:49:21.500548 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:49:21.500548 np0000001583 nova-compute[98241]:   <memoryBacking supported='yes'>
May 28 01:49:21.500548 np0000001583 nova-compute[98241]:     <enum name='sourceType'>
May 28 01:49:21.500548 np0000001583 nova-compute[98241]:       <value>file</value>
May 28 01:49:21.500548 np0000001583 nova-compute[98241]:       <value>anonymous</value>
May 28 01:49:21.500548 np0000001583 nova-compute[98241]:       <value>memfd</value>
May 28 01:49:21.500548 np0000001583 nova-compute[98241]:     </enum>
May 28 01:49:21.500548 np0000001583 nova-compute[98241]:   </memoryBacking>
May 28 01:49:21.500548 np0000001583 nova-compute[98241]:   <devices>
May 28 01:49:21.500548 np0000001583 nova-compute[98241]:     <disk supported='yes'>
May 28 01:49:21.500548 np0000001583 nova-compute[98241]:       <enum name='diskDevice'>
May 28 01:49:21.500548 np0000001583 nova-compute[98241]:         <value>disk</value>
May 28 01:49:21.500548 np0000001583 nova-compute[98241]:         <value>cdrom</value>
May 28 01:49:21.500548 np0000001583 nova-compute[98241]:         <value>floppy</value>
May 28 01:49:21.500548 np0000001583 nova-compute[98241]:         <value>lun</value>
May 28 01:49:21.500548 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.500548 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.500548 np0000001583 nova-compute[98241]:         <value>ide</value>
May 28 01:49:21.500548 np0000001583 nova-compute[98241]:         <value>fdc</value>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:         <value>sata</value>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:     </disk>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:     <graphics supported='yes'>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:         <value>sdl</value>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:         <value>vnc</value>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:         <value>spice</value>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:         <value>egl-headless</value>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:         <value>dbus</value>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:     </graphics>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:     <video supported='yes'>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:       <enum name='modelType'>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:         <value>vga</value>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:         <value>cirrus</value>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:         <value>vmvga</value>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:         <value>qxl</value>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:         <value>none</value>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:         <value>bochs</value>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:         <value>ramfb</value>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:     </video>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:     <hostdev supported='yes'>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:       <enum name='mode'>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:         <value>subsystem</value>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:       <enum name='startupPolicy'>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:         <value>default</value>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:         <value>mandatory</value>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:         <value>requisite</value>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:         <value>optional</value>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:       <enum name='subsysType'>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:         <value>pci</value>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:       <enum name='capsType'/>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:       <enum name='pciBackend'/>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:     </hostdev>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:     <rng supported='yes'>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:         <value>random</value>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:         <value>egd</value>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:     </rng>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:     <filesystem supported='yes'>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:       <enum name='driverType'>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:         <value>path</value>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:         <value>handle</value>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:         <value>virtiofs</value>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:     </filesystem>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:     <tpm supported='yes'>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:         <value>tpm-tis</value>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:         <value>tpm-crb</value>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.501338 np0000001583 nova-compute[98241]:         <value>passthrough</value>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:         <value>emulator</value>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:         <value>external</value>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:       <enum name='backendVersion'>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:         <value>1.2</value>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:         <value>2.0</value>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:     </tpm>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:     <redirdev supported='yes'>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:     </redirdev>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:     <channel supported='yes'>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:         <value>pty</value>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:         <value>unix</value>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:         <value>spicevmc</value>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:     </channel>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:     <crypto supported='yes'>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:         <value>qemu</value>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:     </crypto>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:   </devices>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:   <features>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:     <gic supported='no'/>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:     <vmcoreinfo supported='yes'/>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:     <genid supported='yes'/>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:     <backingStoreInput supported='yes'/>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:     <backup supported='yes'/>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:     <async-teardown supported='yes'/>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:     <sev supported='no'/>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:     <sgx supported='no'/>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:     <hyperv supported='yes'>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:       <enum name='features'>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:         <value>relaxed</value>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:         <value>vapic</value>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:         <value>spinlocks</value>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:         <value>vpindex</value>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:         <value>runtime</value>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:         <value>synic</value>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:         <value>stimer</value>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:         <value>reset</value>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:         <value>vendor_id</value>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:         <value>frequencies</value>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:         <value>reenlightenment</value>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:         <value>tlbflush</value>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:         <value>ipi</value>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:         <value>avic</value>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:     </hyperv>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:   </features>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]: </domainCapabilities>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 01:49:21.502477 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
May 28 01:49:21.502477 np0000001583 nova-compute[98241]: <domainCapabilities>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:   <path>/usr/bin/qemu-system-x86_64</path>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:   <domain>qemu</domain>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:   <machine>pc-q35-noble-v2</machine>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:   <arch>x86_64</arch>
May 28 01:49:21.502477 np0000001583 nova-compute[98241]:   <vcpu max='1024'/>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:   <iothreads supported='yes'/>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:   <os supported='yes'>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:     <enum name='firmware'>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:       <value>efi</value>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:     </enum>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:     <loader supported='yes'>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:       <value>/usr/share/ovmf/OVMF.amdsev.fd</value>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:         <value>rom</value>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:         <value>pflash</value>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:       <enum name='readonly'>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:         <value>yes</value>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:       <enum name='secure'>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:         <value>yes</value>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:     </loader>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:   </os>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:   <cpu>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:     <mode name='host-passthrough' supported='no'/>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:     <mode name='maximum' supported='yes'>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:       <enum name='maximumMigratable'>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:         <value>on</value>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:         <value>off</value>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:     </mode>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:     <mode name='host-model' supported='yes'>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:       <model fallback='forbid'>EPYC</model>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:       <vendor>AMD</vendor>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:       <feature policy='require' name='acpi'/>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:       <feature policy='require' name='ss'/>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:       <feature policy='require' name='monitor'/>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:       <feature policy='require' name='hypervisor'/>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:       <feature policy='require' name='erms'/>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:       <feature policy='require' name='mpx'/>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:       <feature policy='require' name='pcommit'/>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:       <feature policy='require' name='clwb'/>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:       <feature policy='require' name='umip'/>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:       <feature policy='require' name='pku'/>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:       <feature policy='require' name='vaes'/>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:       <feature policy='require' name='la57'/>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:       <feature policy='require' name='rdpid'/>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:       <feature policy='require' name='pks'/>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:       <feature policy='require' name='fsrm'/>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:       <feature policy='require' name='fzrm'/>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:       <feature policy='require' name='fsrs'/>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:       <feature policy='require' name='fsrc'/>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:       <feature policy='require' name='3dnowext'/>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:       <feature policy='require' name='3dnow'/>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:       <feature policy='require' name='xsaveerptr'/>
May 28 01:49:21.503679 np0000001583 nova-compute[98241]:       <feature policy='require' name='wbnoinvd'/>
May 28 01:49:21.504760 np0000001583 nova-compute[98241]:       <feature policy='require' name='npt'/>
May 28 01:49:21.504760 np0000001583 nova-compute[98241]:       <feature policy='require' name='vgif'/>
May 28 01:49:21.504760 np0000001583 nova-compute[98241]:       <feature policy='require' name='svme-addr-chk'/>
May 28 01:49:21.504760 np0000001583 nova-compute[98241]:       <feature policy='disable' name='vme'/>
May 28 01:49:21.504760 np0000001583 nova-compute[98241]:       <feature policy='disable' name='xsavec'/>
May 28 01:49:21.504760 np0000001583 nova-compute[98241]:       <feature policy='disable' name='fxsr_opt'/>
May 28 01:49:21.504760 np0000001583 nova-compute[98241]:       <feature policy='disable' name='misalignsse'/>
May 28 01:49:21.504760 np0000001583 nova-compute[98241]:       <feature policy='disable' name='osvw'/>
May 28 01:49:21.504760 np0000001583 nova-compute[98241]:       <feature policy='disable' name='topoext'/>
May 28 01:49:21.504760 np0000001583 nova-compute[98241]:       <feature policy='disable' name='nrip-save'/>
May 28 01:49:21.504760 np0000001583 nova-compute[98241]:     </mode>
May 28 01:49:21.504760 np0000001583 nova-compute[98241]:     <mode name='custom' supported='yes'>
May 28 01:49:21.504760 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 28 01:49:21.504760 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 28 01:49:21.504760 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>phenom</model>
May 28 01:49:21.504760 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 28 01:49:21.504760 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 28 01:49:21.504760 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>pentium</model>
May 28 01:49:21.504760 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='Intel'>n270</model>
May 28 01:49:21.504760 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 28 01:49:21.504760 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 28 01:49:21.504760 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 28 01:49:21.504760 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 28 01:49:21.504760 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='AMD'>athlon</model>
May 28 01:49:21.504760 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 28 01:49:21.504760 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 28 01:49:21.504760 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 28 01:49:21.504760 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 28 01:49:21.504760 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 28 01:49:21.504760 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 28 01:49:21.504760 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 28 01:49:21.504760 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 28 01:49:21.504760 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 28 01:49:21.504760 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 28 01:49:21.504760 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 28 01:49:21.504760 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 28 01:49:21.505338 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 28 01:49:21.505338 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 28 01:49:21.505338 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 28 01:49:21.505338 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 28 01:49:21.505338 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 28 01:49:21.505338 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 28 01:49:21.505338 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 28 01:49:21.505338 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 28 01:49:21.505338 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 28 01:49:21.505338 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 28 01:49:21.505338 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 28 01:49:21.505338 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 28 01:49:21.505338 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 28 01:49:21.505338 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 28 01:49:21.505338 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 28 01:49:21.505338 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Haswell</model>
May 28 01:49:21.505338 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 28 01:49:21.505338 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 28 01:49:21.505338 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 28 01:49:21.505338 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 28 01:49:21.505338 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>EPYC</model>
May 28 01:49:21.505338 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 28 01:49:21.505338 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 28 01:49:21.505338 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 28 01:49:21.505338 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 28 01:49:21.505338 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 28 01:49:21.505338 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 28 01:49:21.505338 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 28 01:49:21.505338 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 28 01:49:21.505338 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 28 01:49:21.505338 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>486</model>
May 28 01:49:21.505338 np0000001583 nova-compute[98241]:     </mode>
May 28 01:49:21.505338 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:49:21.505338 np0000001583 nova-compute[98241]:   <memoryBacking supported='yes'>
May 28 01:49:21.505338 np0000001583 nova-compute[98241]:     <enum name='sourceType'>
May 28 01:49:21.505338 np0000001583 nova-compute[98241]:       <value>file</value>
May 28 01:49:21.505338 np0000001583 nova-compute[98241]:       <value>anonymous</value>
May 28 01:49:21.505338 np0000001583 nova-compute[98241]:       <value>memfd</value>
May 28 01:49:21.505338 np0000001583 nova-compute[98241]:     </enum>
May 28 01:49:21.505338 np0000001583 nova-compute[98241]:   </memoryBacking>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:   <devices>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:     <disk supported='yes'>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:       <enum name='diskDevice'>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:         <value>disk</value>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:         <value>cdrom</value>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:         <value>floppy</value>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:         <value>lun</value>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:         <value>fdc</value>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:         <value>sata</value>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:     </disk>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:     <graphics supported='yes'>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:         <value>sdl</value>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:         <value>vnc</value>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:         <value>spice</value>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:         <value>egl-headless</value>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:         <value>dbus</value>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:     </graphics>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:     <video supported='yes'>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:       <enum name='modelType'>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:         <value>vga</value>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:         <value>cirrus</value>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:         <value>vmvga</value>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:         <value>qxl</value>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:         <value>none</value>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:         <value>bochs</value>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:         <value>ramfb</value>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:     </video>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:     <hostdev supported='yes'>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:       <enum name='mode'>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:         <value>subsystem</value>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:       <enum name='startupPolicy'>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:         <value>default</value>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:         <value>mandatory</value>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:         <value>requisite</value>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:         <value>optional</value>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:       <enum name='subsysType'>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:         <value>pci</value>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:       <enum name='capsType'/>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:       <enum name='pciBackend'/>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:     </hostdev>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:     <rng supported='yes'>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:         <value>random</value>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:         <value>egd</value>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:     </rng>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:     <filesystem supported='yes'>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:       <enum name='driverType'>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:         <value>path</value>
May 28 01:49:21.505946 np0000001583 nova-compute[98241]:         <value>handle</value>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:         <value>virtiofs</value>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:     </filesystem>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:     <tpm supported='yes'>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:         <value>tpm-tis</value>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:         <value>tpm-crb</value>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:         <value>passthrough</value>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:         <value>emulator</value>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:         <value>external</value>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:       <enum name='backendVersion'>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:         <value>1.2</value>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:         <value>2.0</value>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:     </tpm>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:     <redirdev supported='yes'>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:     </redirdev>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:     <channel supported='yes'>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:         <value>pty</value>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:         <value>unix</value>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:         <value>spicevmc</value>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:     </channel>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:     <crypto supported='yes'>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:         <value>qemu</value>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:     </crypto>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:   </devices>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:   <features>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:     <gic supported='no'/>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:     <vmcoreinfo supported='yes'/>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:     <genid supported='yes'/>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:     <backingStoreInput supported='yes'/>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:     <backup supported='yes'/>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:     <async-teardown supported='yes'/>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:     <sev supported='no'/>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:     <sgx supported='no'/>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:     <hyperv supported='yes'>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:       <enum name='features'>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:         <value>relaxed</value>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:         <value>vapic</value>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:         <value>spinlocks</value>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:         <value>vpindex</value>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:         <value>runtime</value>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:         <value>synic</value>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:         <value>stimer</value>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:         <value>reset</value>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:         <value>vendor_id</value>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:         <value>frequencies</value>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:         <value>reenlightenment</value>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:         <value>tlbflush</value>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:         <value>ipi</value>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:         <value>avic</value>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:     </hyperv>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:   </features>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]: </domainCapabilities>
May 28 01:49:21.507267 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 01:49:21.508510 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
May 28 01:49:21.508510 np0000001583 nova-compute[98241]: <domainCapabilities>
May 28 01:49:21.508510 np0000001583 nova-compute[98241]:   <path>/usr/bin/qemu-system-x86_64</path>
May 28 01:49:21.508510 np0000001583 nova-compute[98241]:   <domain>qemu</domain>
May 28 01:49:21.508510 np0000001583 nova-compute[98241]:   <machine>pc-q35-noble</machine>
May 28 01:49:21.508510 np0000001583 nova-compute[98241]:   <arch>x86_64</arch>
May 28 01:49:21.508510 np0000001583 nova-compute[98241]:   <vcpu max='1024'/>
May 28 01:49:21.508510 np0000001583 nova-compute[98241]:   <iothreads supported='yes'/>
May 28 01:49:21.508510 np0000001583 nova-compute[98241]:   <os supported='yes'>
May 28 01:49:21.508510 np0000001583 nova-compute[98241]:     <enum name='firmware'>
May 28 01:49:21.508510 np0000001583 nova-compute[98241]:       <value>efi</value>
May 28 01:49:21.508510 np0000001583 nova-compute[98241]:     </enum>
May 28 01:49:21.508510 np0000001583 nova-compute[98241]:     <loader supported='yes'>
May 28 01:49:21.508510 np0000001583 nova-compute[98241]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
May 28 01:49:21.508510 np0000001583 nova-compute[98241]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
May 28 01:49:21.508510 np0000001583 nova-compute[98241]:       <value>/usr/share/ovmf/OVMF.amdsev.fd</value>
May 28 01:49:21.508510 np0000001583 nova-compute[98241]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 28 01:49:21.508510 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.508510 np0000001583 nova-compute[98241]:         <value>rom</value>
May 28 01:49:21.508510 np0000001583 nova-compute[98241]:         <value>pflash</value>
May 28 01:49:21.508510 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.508510 np0000001583 nova-compute[98241]:       <enum name='readonly'>
May 28 01:49:21.508510 np0000001583 nova-compute[98241]:         <value>yes</value>
May 28 01:49:21.508510 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.508510 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.508510 np0000001583 nova-compute[98241]:       <enum name='secure'>
May 28 01:49:21.508510 np0000001583 nova-compute[98241]:         <value>yes</value>
May 28 01:49:21.508510 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.508510 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.508510 np0000001583 nova-compute[98241]:     </loader>
May 28 01:49:21.508510 np0000001583 nova-compute[98241]:   </os>
May 28 01:49:21.508510 np0000001583 nova-compute[98241]:   <cpu>
May 28 01:49:21.508510 np0000001583 nova-compute[98241]:     <mode name='host-passthrough' supported='no'/>
May 28 01:49:21.508510 np0000001583 nova-compute[98241]:     <mode name='maximum' supported='yes'>
May 28 01:49:21.508510 np0000001583 nova-compute[98241]:       <enum name='maximumMigratable'>
May 28 01:49:21.508510 np0000001583 nova-compute[98241]:         <value>on</value>
May 28 01:49:21.508510 np0000001583 nova-compute[98241]:         <value>off</value>
May 28 01:49:21.508510 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.508510 np0000001583 nova-compute[98241]:     </mode>
May 28 01:49:21.508510 np0000001583 nova-compute[98241]:     <mode name='host-model' supported='yes'>
May 28 01:49:21.508510 np0000001583 nova-compute[98241]:       <model fallback='forbid'>EPYC</model>
May 28 01:49:21.508510 np0000001583 nova-compute[98241]:       <vendor>AMD</vendor>
May 28 01:49:21.508510 np0000001583 nova-compute[98241]:       <feature policy='require' name='acpi'/>
May 28 01:49:21.508510 np0000001583 nova-compute[98241]:       <feature policy='require' name='ss'/>
May 28 01:49:21.508510 np0000001583 nova-compute[98241]:       <feature policy='require' name='monitor'/>
May 28 01:49:21.508510 np0000001583 nova-compute[98241]:       <feature policy='require' name='hypervisor'/>
May 28 01:49:21.508510 np0000001583 nova-compute[98241]:       <feature policy='require' name='erms'/>
May 28 01:49:21.508510 np0000001583 nova-compute[98241]:       <feature policy='require' name='mpx'/>
May 28 01:49:21.508510 np0000001583 nova-compute[98241]:       <feature policy='require' name='pcommit'/>
May 28 01:49:21.508510 np0000001583 nova-compute[98241]:       <feature policy='require' name='clwb'/>
May 28 01:49:21.508510 np0000001583 nova-compute[98241]:       <feature policy='require' name='umip'/>
May 28 01:49:21.508510 np0000001583 nova-compute[98241]:       <feature policy='require' name='pku'/>
May 28 01:49:21.508510 np0000001583 nova-compute[98241]:       <feature policy='require' name='vaes'/>
May 28 01:49:21.508510 np0000001583 nova-compute[98241]:       <feature policy='require' name='la57'/>
May 28 01:49:21.508510 np0000001583 nova-compute[98241]:       <feature policy='require' name='rdpid'/>
May 28 01:49:21.508510 np0000001583 nova-compute[98241]:       <feature policy='require' name='pks'/>
May 28 01:49:21.509403 np0000001583 nova-compute[98241]:       <feature policy='require' name='fsrm'/>
May 28 01:49:21.509403 np0000001583 nova-compute[98241]:       <feature policy='require' name='fzrm'/>
May 28 01:49:21.509403 np0000001583 nova-compute[98241]:       <feature policy='require' name='fsrs'/>
May 28 01:49:21.509403 np0000001583 nova-compute[98241]:       <feature policy='require' name='fsrc'/>
May 28 01:49:21.509403 np0000001583 nova-compute[98241]:       <feature policy='require' name='3dnowext'/>
May 28 01:49:21.509403 np0000001583 nova-compute[98241]:       <feature policy='require' name='3dnow'/>
May 28 01:49:21.509403 np0000001583 nova-compute[98241]:       <feature policy='require' name='xsaveerptr'/>
May 28 01:49:21.509403 np0000001583 nova-compute[98241]:       <feature policy='require' name='wbnoinvd'/>
May 28 01:49:21.509403 np0000001583 nova-compute[98241]:       <feature policy='require' name='npt'/>
May 28 01:49:21.509403 np0000001583 nova-compute[98241]:       <feature policy='require' name='vgif'/>
May 28 01:49:21.509403 np0000001583 nova-compute[98241]:       <feature policy='require' name='svme-addr-chk'/>
May 28 01:49:21.509403 np0000001583 nova-compute[98241]:       <feature policy='disable' name='vme'/>
May 28 01:49:21.509403 np0000001583 nova-compute[98241]:       <feature policy='disable' name='xsavec'/>
May 28 01:49:21.509403 np0000001583 nova-compute[98241]:       <feature policy='disable' name='fxsr_opt'/>
May 28 01:49:21.509403 np0000001583 nova-compute[98241]:       <feature policy='disable' name='misalignsse'/>
May 28 01:49:21.509403 np0000001583 nova-compute[98241]:       <feature policy='disable' name='osvw'/>
May 28 01:49:21.509403 np0000001583 nova-compute[98241]:       <feature policy='disable' name='topoext'/>
May 28 01:49:21.509403 np0000001583 nova-compute[98241]:       <feature policy='disable' name='nrip-save'/>
May 28 01:49:21.509403 np0000001583 nova-compute[98241]:     </mode>
May 28 01:49:21.509403 np0000001583 nova-compute[98241]:     <mode name='custom' supported='yes'>
May 28 01:49:21.509403 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 28 01:49:21.509403 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 28 01:49:21.509403 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>phenom</model>
May 28 01:49:21.509403 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 28 01:49:21.509403 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 28 01:49:21.509403 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>pentium</model>
May 28 01:49:21.509403 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='Intel'>n270</model>
May 28 01:49:21.509403 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 28 01:49:21.509403 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 28 01:49:21.509403 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 28 01:49:21.509403 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 28 01:49:21.509403 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='AMD'>athlon</model>
May 28 01:49:21.509403 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 28 01:49:21.509403 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 28 01:49:21.509403 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 28 01:49:21.509403 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 28 01:49:21.509403 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 28 01:49:21.509403 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 28 01:49:21.509989 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 28 01:49:21.509989 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 28 01:49:21.509989 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 28 01:49:21.509989 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 28 01:49:21.509989 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 28 01:49:21.509989 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 28 01:49:21.509989 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 28 01:49:21.509989 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 28 01:49:21.509989 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 28 01:49:21.509989 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 28 01:49:21.509989 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 28 01:49:21.509989 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 28 01:49:21.509989 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 28 01:49:21.509989 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 28 01:49:21.509989 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 28 01:49:21.509989 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 28 01:49:21.509989 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 28 01:49:21.509989 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 28 01:49:21.509989 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 28 01:49:21.509989 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 28 01:49:21.509989 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 28 01:49:21.509989 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Haswell</model>
May 28 01:49:21.509989 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 28 01:49:21.509989 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 28 01:49:21.509989 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 28 01:49:21.509989 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 28 01:49:21.509989 np0000001583 nova-compute[98241]:       <model usable='no' vendor='AMD'>EPYC</model>
May 28 01:49:21.509989 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 28 01:49:21.509989 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 28 01:49:21.509989 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 28 01:49:21.509989 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 28 01:49:21.509989 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 28 01:49:21.509989 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:       <model usable='yes' vendor='unknown'>486</model>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:     </mode>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:   <memoryBacking supported='yes'>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:     <enum name='sourceType'>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:       <value>file</value>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:       <value>anonymous</value>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:       <value>memfd</value>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:     </enum>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:   </memoryBacking>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:   <devices>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:     <disk supported='yes'>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:       <enum name='diskDevice'>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:         <value>disk</value>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:         <value>cdrom</value>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:         <value>floppy</value>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:         <value>lun</value>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:         <value>fdc</value>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:         <value>sata</value>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:     </disk>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:     <graphics supported='yes'>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:         <value>sdl</value>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:         <value>vnc</value>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:         <value>spice</value>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:         <value>egl-headless</value>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:         <value>dbus</value>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:     </graphics>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:     <video supported='yes'>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:       <enum name='modelType'>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:         <value>vga</value>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:         <value>cirrus</value>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:         <value>vmvga</value>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:         <value>qxl</value>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:         <value>none</value>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:         <value>bochs</value>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:         <value>ramfb</value>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:     </video>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:     <hostdev supported='yes'>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:       <enum name='mode'>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:         <value>subsystem</value>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:       <enum name='startupPolicy'>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:         <value>default</value>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:         <value>mandatory</value>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:         <value>requisite</value>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:         <value>optional</value>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:       <enum name='subsysType'>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:         <value>pci</value>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:       <enum name='capsType'/>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:       <enum name='pciBackend'/>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:     </hostdev>
May 28 01:49:21.510616 np0000001583 nova-compute[98241]:     <rng supported='yes'>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:         <value>random</value>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:         <value>egd</value>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:     </rng>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:     <filesystem supported='yes'>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:       <enum name='driverType'>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:         <value>path</value>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:         <value>handle</value>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:         <value>virtiofs</value>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:     </filesystem>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:     <tpm supported='yes'>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:         <value>tpm-tis</value>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:         <value>tpm-crb</value>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:         <value>passthrough</value>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:         <value>emulator</value>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:         <value>external</value>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:       <enum name='backendVersion'>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:         <value>1.2</value>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:         <value>2.0</value>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:     </tpm>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:     <redirdev supported='yes'>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:     </redirdev>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:     <channel supported='yes'>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:         <value>pty</value>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:         <value>unix</value>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:         <value>spicevmc</value>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:     </channel>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:     <crypto supported='yes'>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:         <value>qemu</value>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:     </crypto>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:   </devices>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:   <features>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:     <gic supported='no'/>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:     <vmcoreinfo supported='yes'/>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:     <genid supported='yes'/>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:     <backingStoreInput supported='yes'/>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:     <backup supported='yes'/>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:     <async-teardown supported='yes'/>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:     <sev supported='no'/>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:     <sgx supported='no'/>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:     <hyperv supported='yes'>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:       <enum name='features'>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:         <value>relaxed</value>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:         <value>vapic</value>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:         <value>spinlocks</value>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:         <value>vpindex</value>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:         <value>runtime</value>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:         <value>synic</value>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:         <value>stimer</value>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:         <value>reset</value>
May 28 01:49:21.511874 np0000001583 nova-compute[98241]:         <value>vendor_id</value>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:         <value>frequencies</value>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:         <value>reenlightenment</value>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:         <value>tlbflush</value>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:         <value>ipi</value>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:         <value>avic</value>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:     </hyperv>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:   </features>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]: </domainCapabilities>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 01:49:21.513120 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=98241) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 01:49:21.513120 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Libvirt host hypervisor capabilities for arch=xtensa and machine_type=None:
May 28 01:49:21.513120 np0000001583 nova-compute[98241]: <domainCapabilities>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:   <path>/usr/bin/qemu-system-xtensa</path>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:   <domain>qemu</domain>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:   <machine>sim</machine>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:   <arch>xtensa</arch>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:   <vcpu max='4'/>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:   <iothreads supported='yes'/>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:   <os supported='yes'>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:     <enum name='firmware'/>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:     <loader supported='yes'>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:         <value>rom</value>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:         <value>pflash</value>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:       <enum name='readonly'>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:         <value>yes</value>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:       <enum name='secure'>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:     </loader>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:   </os>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:   <cpu>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:     <mode name='host-passthrough' supported='no'/>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:     <mode name='maximum' supported='no'/>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:     <mode name='host-model' supported='no'/>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:     <mode name='custom' supported='no'/>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:   <memoryBacking supported='yes'>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:     <enum name='sourceType'>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:       <value>file</value>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:       <value>anonymous</value>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:       <value>memfd</value>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:     </enum>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:   </memoryBacking>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:   <devices>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:     <disk supported='yes'>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:       <enum name='diskDevice'>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:         <value>disk</value>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:         <value>cdrom</value>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:         <value>floppy</value>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:         <value>lun</value>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.513120 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:         <value>fdc</value>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:         <value>sata</value>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:     </disk>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:     <graphics supported='yes'>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:         <value>sdl</value>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:         <value>vnc</value>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:         <value>spice</value>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:         <value>egl-headless</value>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:         <value>dbus</value>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:     </graphics>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:     <video supported='yes'>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:       <enum name='modelType'>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:         <value>vga</value>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:         <value>cirrus</value>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:         <value>none</value>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:         <value>bochs</value>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:     </video>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:     <hostdev supported='yes'>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:       <enum name='mode'>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:         <value>subsystem</value>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:       <enum name='startupPolicy'>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:         <value>default</value>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:         <value>mandatory</value>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:         <value>requisite</value>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:         <value>optional</value>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:       <enum name='subsysType'>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:         <value>pci</value>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:       <enum name='capsType'/>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:       <enum name='pciBackend'/>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:     </hostdev>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:     <rng supported='yes'>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:         <value>random</value>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:         <value>egd</value>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:     </rng>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:     <filesystem supported='yes'>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:       <enum name='driverType'>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:         <value>path</value>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:         <value>handle</value>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:         <value>virtiofs</value>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:     </filesystem>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:     <tpm supported='no'/>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:     <redirdev supported='yes'>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:     </redirdev>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:     <channel supported='yes'>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:         <value>pty</value>
May 28 01:49:21.514088 np0000001583 nova-compute[98241]:         <value>unix</value>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:         <value>spicevmc</value>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:     </channel>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:     <crypto supported='yes'>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:         <value>qemu</value>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:     </crypto>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:   </devices>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:   <features>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:     <gic supported='no'/>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:     <vmcoreinfo supported='no'/>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:     <genid supported='no'/>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:     <backingStoreInput supported='yes'/>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:     <backup supported='yes'/>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:     <async-teardown supported='yes'/>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:     <sev supported='no'/>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:     <sgx supported='no'/>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:   </features>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]: </domainCapabilities>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 01:49:21.515410 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=98241) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 01:49:21.515410 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Libvirt host hypervisor capabilities for arch=xtensaeb and machine_type=None:
May 28 01:49:21.515410 np0000001583 nova-compute[98241]: <domainCapabilities>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:   <path>/usr/bin/qemu-system-xtensaeb</path>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:   <domain>qemu</domain>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:   <machine>sim</machine>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:   <arch>xtensaeb</arch>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:   <vcpu max='4'/>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:   <iothreads supported='yes'/>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:   <os supported='yes'>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:     <enum name='firmware'/>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:     <loader supported='yes'>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:         <value>rom</value>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:         <value>pflash</value>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:       <enum name='readonly'>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:         <value>yes</value>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:       <enum name='secure'>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:         <value>no</value>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:     </loader>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:   </os>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:   <cpu>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:     <mode name='host-passthrough' supported='no'/>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:     <mode name='maximum' supported='no'/>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:     <mode name='host-model' supported='no'/>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:     <mode name='custom' supported='no'/>
May 28 01:49:21.515410 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:   <memoryBacking supported='yes'>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:     <enum name='sourceType'>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:       <value>file</value>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:       <value>anonymous</value>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:       <value>memfd</value>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:     </enum>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:   </memoryBacking>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:   <devices>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:     <disk supported='yes'>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:       <enum name='diskDevice'>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:         <value>disk</value>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:         <value>cdrom</value>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:         <value>floppy</value>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:         <value>lun</value>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:         <value>fdc</value>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:         <value>sata</value>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:     </disk>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:     <graphics supported='yes'>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:         <value>sdl</value>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:         <value>vnc</value>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:         <value>spice</value>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:         <value>egl-headless</value>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:         <value>dbus</value>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:     </graphics>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:     <video supported='yes'>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:       <enum name='modelType'>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:         <value>vga</value>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:         <value>cirrus</value>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:         <value>none</value>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:         <value>bochs</value>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:     </video>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:     <hostdev supported='yes'>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:       <enum name='mode'>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:         <value>subsystem</value>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:       <enum name='startupPolicy'>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:         <value>default</value>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:         <value>mandatory</value>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:         <value>requisite</value>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:         <value>optional</value>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:       <enum name='subsysType'>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:         <value>pci</value>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:         <value>scsi</value>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:       <enum name='capsType'/>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:       <enum name='pciBackend'/>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:     </hostdev>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:     <rng supported='yes'>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:         <value>virtio-transitional</value>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:         <value>virtio-non-transitional</value>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:         <value>random</value>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:         <value>egd</value>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:     </rng>
May 28 01:49:21.516425 np0000001583 nova-compute[98241]:     <filesystem supported='yes'>
May 28 01:49:21.517512 np0000001583 nova-compute[98241]:       <enum name='driverType'>
May 28 01:49:21.517512 np0000001583 nova-compute[98241]:         <value>path</value>
May 28 01:49:21.517512 np0000001583 nova-compute[98241]:         <value>handle</value>
May 28 01:49:21.517512 np0000001583 nova-compute[98241]:         <value>virtiofs</value>
May 28 01:49:21.517512 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.517512 np0000001583 nova-compute[98241]:     </filesystem>
May 28 01:49:21.517512 np0000001583 nova-compute[98241]:     <tpm supported='no'/>
May 28 01:49:21.517512 np0000001583 nova-compute[98241]:     <redirdev supported='yes'>
May 28 01:49:21.517512 np0000001583 nova-compute[98241]:       <enum name='bus'>
May 28 01:49:21.517512 np0000001583 nova-compute[98241]:         <value>usb</value>
May 28 01:49:21.517512 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.517512 np0000001583 nova-compute[98241]:     </redirdev>
May 28 01:49:21.517512 np0000001583 nova-compute[98241]:     <channel supported='yes'>
May 28 01:49:21.517512 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.517512 np0000001583 nova-compute[98241]:         <value>pty</value>
May 28 01:49:21.517512 np0000001583 nova-compute[98241]:         <value>unix</value>
May 28 01:49:21.517512 np0000001583 nova-compute[98241]:         <value>spicevmc</value>
May 28 01:49:21.517512 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.517512 np0000001583 nova-compute[98241]:     </channel>
May 28 01:49:21.517512 np0000001583 nova-compute[98241]:     <crypto supported='yes'>
May 28 01:49:21.517512 np0000001583 nova-compute[98241]:       <enum name='model'>
May 28 01:49:21.517512 np0000001583 nova-compute[98241]:         <value>virtio</value>
May 28 01:49:21.517512 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.517512 np0000001583 nova-compute[98241]:       <enum name='type'>
May 28 01:49:21.517512 np0000001583 nova-compute[98241]:         <value>qemu</value>
May 28 01:49:21.517512 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.517512 np0000001583 nova-compute[98241]:       <enum name='backendModel'>
May 28 01:49:21.517512 np0000001583 nova-compute[98241]:         <value>builtin</value>
May 28 01:49:21.517512 np0000001583 nova-compute[98241]:       </enum>
May 28 01:49:21.517512 np0000001583 nova-compute[98241]:     </crypto>
May 28 01:49:21.517512 np0000001583 nova-compute[98241]:   </devices>
May 28 01:49:21.517512 np0000001583 nova-compute[98241]:   <features>
May 28 01:49:21.517512 np0000001583 nova-compute[98241]:     <gic supported='no'/>
May 28 01:49:21.517512 np0000001583 nova-compute[98241]:     <vmcoreinfo supported='no'/>
May 28 01:49:21.517512 np0000001583 nova-compute[98241]:     <genid supported='no'/>
May 28 01:49:21.517512 np0000001583 nova-compute[98241]:     <backingStoreInput supported='yes'/>
May 28 01:49:21.517512 np0000001583 nova-compute[98241]:     <backup supported='yes'/>
May 28 01:49:21.517512 np0000001583 nova-compute[98241]:     <async-teardown supported='yes'/>
May 28 01:49:21.517512 np0000001583 nova-compute[98241]:     <sev supported='no'/>
May 28 01:49:21.517512 np0000001583 nova-compute[98241]:     <sgx supported='no'/>
May 28 01:49:21.517512 np0000001583 nova-compute[98241]:   </features>
May 28 01:49:21.517512 np0000001583 nova-compute[98241]: </domainCapabilities>
May 28 01:49:21.517512 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 01:49:21.517512 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Checking secure boot support for host arch (x86_64) {{(pid=98241) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1962}}
May 28 01:49:21.517512 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Checking secure boot support for host arch (x86_64) {{(pid=98241) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1962}}
May 28 01:49:21.517512 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Checking secure boot support for host arch (x86_64) {{(pid=98241) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1962}}
May 28 01:49:21.518190 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Checking secure boot support for host arch (x86_64) {{(pid=98241) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1962}}
May 28 01:49:21.518190 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Checking secure boot support for host arch (x86_64) {{(pid=98241) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1962}}
May 28 01:49:21.518190 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Secure Boot support detected
May 28 01:49:21.962217 np0000001583 nova-compute[98241]: INFO nova.virt.node [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Generated node identity cfa1af79-477d-460a-869d-84a19fa91765
May 28 01:49:21.962464 np0000001583 nova-compute[98241]: INFO nova.virt.node [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Wrote node identity cfa1af79-477d-460a-869d-84a19fa91765 to /opt/stack/data/nova/compute_id
May 28 01:49:22.464558 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Compute nodes ['cfa1af79-477d-460a-869d-84a19fa91765'] for host np0000001583 were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
May 28 01:49:23.468390 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
May 28 01:49:24.473187 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] No compute node record found for host np0000001583. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host np0000001583 could not be found.
May 28 01:49:24.473756 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:49:24.473756 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:49:24.473756 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:49:24.473756 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Auditing locally available compute resources for np0000001583 (node: np0000001583) {{(pid=98241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 01:49:24.527829 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:49:24.528560 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:49:24.543356 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] CMD "env LANG=C uptime" returned: 0 in 0.014s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:49:24.543658 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Hypervisor/Node resource view: name=np0000001583 free_ram=16536MB free_disk=75.20334243774414GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 01:49:24.543785 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:49:24.544002 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:49:25.047132 np0000001583 nova-compute[98241]: WARNING nova.compute.resource_tracker [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] No compute node record for np0000001583:cfa1af79-477d-460a-869d-84a19fa91765: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host cfa1af79-477d-460a-869d-84a19fa91765 could not be found.
May 28 01:49:25.551459 np0000001583 nova-compute[98241]: INFO nova.compute.resource_tracker [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Compute node record created for np0000001583:np0000001583 with uuid: cfa1af79-477d-460a-869d-84a19fa91765
May 28 01:49:27.058634 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 01:49:27.059201 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Final resource view: name=np0000001583 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 01:49:24 up 25 min,  2 users,  load average: 2.79, 1.56, 0.79\n'} {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 01:49:27.520848 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] [req-ea87e769-e746-4eae-9caf-09c482a672fe] Created resource provider record via placement API for resource provider with UUID cfa1af79-477d-460a-869d-84a19fa91765 and name np0000001583.
May 28 01:49:27.569479 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] /sys/module/kvm_amd/parameters/sev contains [N
May 28 01:49:27.569479 np0000001583 nova-compute[98241]: ] {{(pid=98241) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:2038}}
May 28 01:49:27.569617 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.host [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] kernel doesn't support AMD SEV
May 28 01:49:27.569770 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:49:27.569929 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Updating inventory in ProviderTree for provider cfa1af79-477d-460a-869d-84a19fa91765 with inventory: {'MEMORY_MB': {'total': 24030, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 95, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 28 01:49:27.570185 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:49:27.573698 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Libvirt baseline CPU <cpu>
May 28 01:49:27.573698 np0000001583 nova-compute[98241]:   <arch>x86_64</arch>
May 28 01:49:27.573698 np0000001583 nova-compute[98241]:   <model>Nehalem</model>
May 28 01:49:27.573698 np0000001583 nova-compute[98241]:   <vendor>AMD</vendor>
May 28 01:49:27.573698 np0000001583 nova-compute[98241]:   <topology sockets="12" cores="1" threads="1"/>
May 28 01:49:27.573698 np0000001583 nova-compute[98241]:   <maxphysaddr mode="emulate" bits="40"/>
May 28 01:49:27.573698 np0000001583 nova-compute[98241]: </cpu>
May 28 01:49:27.573698 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:13740}}
May 28 01:49:28.139901 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Updated inventory for provider cfa1af79-477d-460a-869d-84a19fa91765 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 24030, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 95, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:975}}
May 28 01:49:28.140292 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Updating resource provider cfa1af79-477d-460a-869d-84a19fa91765 generation from 0 to 1 during operation: update_inventory {{(pid=98241) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
May 28 01:49:28.140292 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Updating inventory in ProviderTree for provider cfa1af79-477d-460a-869d-84a19fa91765 with inventory: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 28 01:49:28.265288 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Updating resource provider cfa1af79-477d-460a-869d-84a19fa91765 generation from 1 to 2 during operation: update_traits {{(pid=98241) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
May 28 01:49:28.772109 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Compute_service record updated for np0000001583:np0000001583 {{(pid=98241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 01:49:28.772272 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 4.228s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:49:28.772420 np0000001583 nova-compute[98241]: DEBUG nova.service [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Creating RPC server for service: nova-compute on topic: compute {{(pid=98241) start /opt/stack/nova/nova/service.py:195}}
May 28 01:49:28.785406 np0000001583 nova-compute[98241]: DEBUG nova.service [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Creating 2nd RPC server for service: nova-compute on topic: compute-alt {{(pid=98241) start /opt/stack/nova/nova/service.py:211}}
May 28 01:49:28.796696 np0000001583 nova-compute[98241]: DEBUG nova.service [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] Join ServiceGroup membership for this service compute {{(pid=98241) start /opt/stack/nova/nova/service.py:221}}
May 28 01:49:28.796887 np0000001583 nova-compute[98241]: DEBUG nova.servicegroup.drivers.db [None req-ec02301e-b577-461e-bb19-2f3e5dd86689 None None] DB_Driver: join new ServiceGroup member np0000001583 to the compute group, service = <Service: host=np0000001583, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=98241) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
May 28 01:49:34.300675 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:50:06.798562 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:50:07.301427 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:50:07.302271 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.89 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:50:08.194388 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:50:08.194882 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:50:08.194933 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:50:08.195254 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:50:08.195572 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:50:08.195762 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:50:08.196008 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:50:08.196240 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 01:50:08.196438 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:50:08.700706 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:50:08.700862 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:50:08.701061 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:50:08.701198 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Auditing locally available compute resources for np0000001583 (node: np0000001583) {{(pid=98241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 01:50:08.708410 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:50:08.709155 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:50:08.723373 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.014s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:50:08.723936 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Hypervisor/Node resource view: name=np0000001583 free_ram=16267MB free_disk=75.06370162963867GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 01:50:08.724187 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:50:08.724386 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:50:09.774312 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 01:50:09.774729 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Final resource view: name=np0000001583 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 01:50:08 up 26 min,  2 users,  load average: 2.43, 1.64, 0.86\n'} {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 01:50:09.814485 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:50:09.814695 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:50:10.317387 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:50:10.823833 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Compute_service record updated for np0000001583:np0000001583 {{(pid=98241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 01:50:10.823833 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.099s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:50:10.824607 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 59.99 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:51:10.818881 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:51:10.819405 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:51:10.819405 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:51:10.819587 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:51:10.819764 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:51:10.819929 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:51:10.820094 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:51:10.820250 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:51:10.820376 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 01:51:10.820559 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:51:11.323718 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:51:11.323912 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:51:11.323912 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:51:11.324031 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Auditing locally available compute resources for np0000001583 (node: np0000001583) {{(pid=98241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 01:51:11.330676 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:51:11.331378 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:51:11.344434 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.013s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:51:11.345246 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Hypervisor/Node resource view: name=np0000001583 free_ram=16246MB free_disk=74.85197067260742GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 01:51:11.345407 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:51:11.345586 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:51:12.393268 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 01:51:12.393616 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Final resource view: name=np0000001583 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 01:51:11 up 27 min,  2 users,  load average: 1.35, 1.48, 0.86\n'} {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 01:51:12.435310 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:51:12.435602 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:51:12.937996 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:51:13.443943 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Compute_service record updated for np0000001583:np0000001583 {{(pid=98241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 01:51:13.444419 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.098s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:51:13.444419 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 60.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:51:34.302891 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:51:44.263795 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Acquiring lock "bfb723e1-a6b7-460b-b115-62d1f2922066" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:51:44.264269 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Lock "bfb723e1-a6b7-460b-b115-62d1f2922066" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:51:44.768699 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:51:45.360409 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:51:45.360727 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:51:45.363723 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:51:45.363907 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Claim successful on node np0000001583
May 28 01:51:46.493616 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:51:46.493948 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:51:46.999384 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:51:47.509101 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.147s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:51:47.509101 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:51:48.015027 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:51:48.015431 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:51:48.016400 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:51:48.017886 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:51:48.520237 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:51:49.001046 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1b947140d3864542a79a544b0c9376ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad9015838ce40f99e83bc413aa1c08b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:51:49.024317 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:51:50.039963 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:51:50.042354 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:51:50.044044 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Creating image(s)
May 28 01:51:50.044558 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Acquiring lock "/opt/stack/data/nova/instances/bfb723e1-a6b7-460b-b115-62d1f2922066/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:51:50.044773 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Lock "/opt/stack/data/nova/instances/bfb723e1-a6b7-460b-b115-62d1f2922066/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:51:50.045308 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Lock "/opt/stack/data/nova/instances/bfb723e1-a6b7-460b-b115-62d1f2922066/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:51:50.045851 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:51:50.046742 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:51:50.405430 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:51:50.409666 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:51:50.410161 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899.part --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:51:50.475168 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899.part --force-share --output=json" returned: 0 in 0.065s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:51:50.475930 np0000001583 nova-compute[98241]: DEBUG nova.virt.images [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] 3aa57a53-c080-4a55-ba67-d70bf1ef7690 was qcow2, converting to raw {{(pid=98241) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 01:51:50.476388 np0000001583 nova-compute[98241]: DEBUG nova.privsep.utils [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98241) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 01:51:50.476657 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899.part /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899.converted {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:51:50.652123 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899.part /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899.converted" returned: 0 in 0.175s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:51:50.658893 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899.converted --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:51:50.726418 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899.converted --force-share --output=json" returned: 0 in 0.067s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:51:50.727517 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.681s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:51:50.728388 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:51:50.732475 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:51:50.732605 np0000001583 nova-compute[98241]: INFO oslo.privsep.daemon [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpf92x6ani/privsep.sock']
May 28 01:51:50.740164 np0000001583 sudo[109754]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpf92x6ani/privsep.sock
May 28 01:51:50.741001 np0000001583 sudo[109754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002)
May 28 01:51:50.981857 np0000001583 nova-compute[98241]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
May 28 01:51:50.981857 np0000001583 nova-compute[98241]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 28 01:51:50.981857 np0000001583 nova-compute[98241]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 28 01:51:50.982017 np0000001583 nova-compute[98241]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 01:51:50.982017 np0000001583 nova-compute[98241]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 28 01:51:50.982017 np0000001583 nova-compute[98241]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 28 01:51:50.982017 np0000001583 nova-compute[98241]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 28 01:51:50.982161 np0000001583 nova-compute[98241]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 01:51:50.982161 np0000001583 nova-compute[98241]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
May 28 01:51:51.050496 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Successfully created port: abeff3c8-2440-496e-b339-d23c6c7ad07e {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:51:51.327651 np0000001583 nova-compute[98241]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
May 28 01:51:51.327801 np0000001583 nova-compute[98241]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 28 01:51:51.327900 np0000001583 nova-compute[98241]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 28 01:51:51.327990 np0000001583 nova-compute[98241]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 01:51:51.328361 np0000001583 nova-compute[98241]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 28 01:51:51.328361 np0000001583 nova-compute[98241]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 28 01:51:51.328361 np0000001583 nova-compute[98241]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 28 01:51:51.328361 np0000001583 nova-compute[98241]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 01:51:51.328438 np0000001583 nova-compute[98241]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
May 28 01:51:51.580458 np0000001583 sudo[109754]: pam_unix(sudo:session): session closed for user root
May 28 01:51:51.582101 np0000001583 nova-compute[98241]: INFO oslo.privsep.daemon [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Spawned new privsep daemon via rootwrap
May 28 01:51:51.583036 np0000001583 nova-compute[98241]: INFO oslo.privsep.daemon [-] privsep daemon starting
May 28 01:51:51.583157 np0000001583 nova-compute[98241]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
May 28 01:51:51.583239 np0000001583 nova-compute[98241]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
May 28 01:51:51.583285 np0000001583 nova-compute[98241]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 109768
May 28 01:51:51.640104 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:51:51.712906 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.075s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:51:51.713953 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:51:51.714496 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:51:51.714933 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:51:51.718223 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:51:51.718919 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:51:51.785386 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.066s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:51:51.786191 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/bfb723e1-a6b7-460b-b115-62d1f2922066/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:51:51.815215 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/bfb723e1-a6b7-460b-b115-62d1f2922066/disk 1073741824" returned: 0 in 0.029s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:51:51.815777 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.101s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:51:51.816094 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:51:51.890860 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.074s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:51:51.891876 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bfb723e1-a6b7-460b-b115-62d1f2922066/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:51:51.892187 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb723e1-a6b7-460b-b115-62d1f2922066/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:51:51.959267 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb723e1-a6b7-460b-b115-62d1f2922066/disk --force-share --output=json" returned: 0 in 0.067s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:51:51.960369 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Cannot resize image /opt/stack/data/nova/instances/bfb723e1-a6b7-460b-b115-62d1f2922066/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:51:51.961273 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:51:51.961983 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Ensure instance console log exists: /opt/stack/data/nova/instances/bfb723e1-a6b7-460b-b115-62d1f2922066/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:51:51.962432 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:51:51.962760 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:51:51.963166 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:51:52.223122 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Acquiring lock "a4e5fc7a-978f-407f-9faf-7ec539b55e0e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:51:52.223122 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Lock "a4e5fc7a-978f-407f-9faf-7ec539b55e0e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:51:52.606369 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Successfully updated port: abeff3c8-2440-496e-b339-d23c6c7ad07e {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:51:52.726347 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:51:53.109251 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Acquiring lock "refresh_cache-bfb723e1-a6b7-460b-b115-62d1f2922066" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:51:53.109368 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Acquired lock "refresh_cache-bfb723e1-a6b7-460b-b115-62d1f2922066" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:51:53.109499 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:51:53.292431 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:51:53.292898 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:51:53.296574 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:51:53.296768 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Claim successful on node np0000001583
May 28 01:51:53.326056 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-69b1c9d0-bba8-41c9-b252-b1b8237cf0c3 req-da4c82aa-7154-4999-af9b-289d767f7827 service nova] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Received event network-changed-abeff3c8-2440-496e-b339-d23c6c7ad07e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:51:53.326056 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-69b1c9d0-bba8-41c9-b252-b1b8237cf0c3 req-da4c82aa-7154-4999-af9b-289d767f7827 service nova] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Refreshing instance network info cache due to event network-changed-abeff3c8-2440-496e-b339-d23c6c7ad07e. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:51:53.326056 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-69b1c9d0-bba8-41c9-b252-b1b8237cf0c3 req-da4c82aa-7154-4999-af9b-289d767f7827 service nova] Acquiring lock "refresh_cache-bfb723e1-a6b7-460b-b115-62d1f2922066" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:51:53.866825 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:51:54.463422 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:51:54.463875 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:51:54.733188 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:51:54.967213 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:51:55.167415 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Updating instance_info_cache with network_info: [{"id": "abeff3c8-2440-496e-b339-d23c6c7ad07e", "address": "fa:16:3e:bd:12:11", "network": {"id": "ff18d2b2-aaf4-4fbb-9b27-93d0e1ea8678", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-145899974-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ad9015838ce40f99e83bc413aa1c08b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapabeff3c8-24", "ovs_interfaceid": "abeff3c8-2440-496e-b339-d23c6c7ad07e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:51:55.473643 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.180s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:51:55.473643 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:51:55.669877 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Releasing lock "refresh_cache-bfb723e1-a6b7-460b-b115-62d1f2922066" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:51:55.669877 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Instance network_info: |[{"id": "abeff3c8-2440-496e-b339-d23c6c7ad07e", "address": "fa:16:3e:bd:12:11", "network": {"id": "ff18d2b2-aaf4-4fbb-9b27-93d0e1ea8678", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-145899974-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ad9015838ce40f99e83bc413aa1c08b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapabeff3c8-24", "ovs_interfaceid": "abeff3c8-2440-496e-b339-d23c6c7ad07e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:51:55.670069 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-69b1c9d0-bba8-41c9-b252-b1b8237cf0c3 req-da4c82aa-7154-4999-af9b-289d767f7827 service nova] Acquired lock "refresh_cache-bfb723e1-a6b7-460b-b115-62d1f2922066" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:51:55.670672 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-69b1c9d0-bba8-41c9-b252-b1b8237cf0c3 req-da4c82aa-7154-4999-af9b-289d767f7827 service nova] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Refreshing network info cache for port abeff3c8-2440-496e-b339-d23c6c7ad07e {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:51:55.674321 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Start _get_guest_xml network_info=[{"id": "abeff3c8-2440-496e-b339-d23c6c7ad07e", "address": "fa:16:3e:bd:12:11", "network": {"id": "ff18d2b2-aaf4-4fbb-9b27-93d0e1ea8678", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-145899974-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ad9015838ce40f99e83bc413aa1c08b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapabeff3c8-24", "ovs_interfaceid": "abeff3c8-2440-496e-b339-d23c6c7ad07e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:51:55.677245 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:51:55.678535 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-DeleteServersTestJSON-server-936358237', uuid='bfb723e1-a6b7-460b-b115-62d1f2922066'), owner=OwnerMeta(userid='1b947140d3864542a79a544b0c9376ed', username='tempest-DeleteServersTestJSON-1865350861-project-member', projectid='1ad9015838ce40f99e83bc413aa1c08b', projectname='tempest-DeleteServersTestJSON-1865350861'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "abeff3c8-2440-496e-b339-d23c6c7ad07e", "address": "fa:16:3e:bd:12:11", "network": {"id": "ff18d2b2-aaf4-4fbb-9b27-93d0e1ea8678", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-145899974-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ad9015838ce40f99e83bc413aa1c08b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapabeff3c8-24", "ovs_interfaceid": "abeff3c8-2440-496e-b339-d23c6c7ad07e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933115.6778383) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:51:55.680041 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:51:55.680041 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:51:55.680990 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:51:55.681193 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:51:55.682591 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:51:55.683034 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:51:55.683225 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:51:55.683297 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:51:55.683417 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:51:55.683508 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:51:55.683614 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:51:55.683810 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:51:55.683913 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:51:55.684220 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:51:55.684345 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:51:55.684674 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:51:55.698101 np0000001583 nova-compute[98241]: DEBUG nova.privsep.utils [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98241) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 01:51:55.698291 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:51:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-936358237',display_name='tempest-DeleteServersTestJSON-server-936358237',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-deleteserverstestjson-server-936358237',id=1,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ad9015838ce40f99e83bc413aa1c08b',ramdisk_id='',reservation_id='r-0yg57ukj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1865350861',owner_user_name='tempest-DeleteServersTestJSON-1865350861-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:51:49Z,user_data=None,user_id='1b947140d3864542a79a544b0c9376ed',uuid=bfb723e1-a6b7-460b-b115-62d1f2922066,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "abeff3c8-2440-496e-b339-d23c6c7ad07e", "address": "fa:16:3e:bd:12:11", "network": {"id": "ff18d2b2-aaf4-4fbb-9b27-93d0e1ea8678", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-145899974-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ad9015838ce40f99e83bc413aa1c08b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapabeff3c8-24", "ovs_interfaceid": "abeff3c8-2440-496e-b339-d23c6c7ad07e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:51:55.698410 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Converting VIF {"id": "abeff3c8-2440-496e-b339-d23c6c7ad07e", "address": "fa:16:3e:bd:12:11", "network": {"id": "ff18d2b2-aaf4-4fbb-9b27-93d0e1ea8678", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-145899974-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ad9015838ce40f99e83bc413aa1c08b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapabeff3c8-24", "ovs_interfaceid": "abeff3c8-2440-496e-b339-d23c6c7ad07e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:51:55.699355 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:12:11,bridge_name='br-int',has_traffic_filtering=True,id=abeff3c8-2440-496e-b339-d23c6c7ad07e,network=Network(ff18d2b2-aaf4-4fbb-9b27-93d0e1ea8678),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabeff3c8-24') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:51:55.700135 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Lazy-loading 'pci_devices' on Instance uuid bfb723e1-a6b7-460b-b115-62d1f2922066 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:51:55.962203 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Acquiring lock "02b42340-8535-4682-98db-49f970ff5597" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:51:55.962438 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Lock "02b42340-8535-4682-98db-49f970ff5597" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:51:55.980351 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:51:55.980698 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:51:55.981203 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:51:55.981351 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:51:56.179113 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-69b1c9d0-bba8-41c9-b252-b1b8237cf0c3 req-da4c82aa-7154-4999-af9b-289d767f7827 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:51:56.202812 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] End _get_guest_xml xml=<domain type="qemu">
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:   <uuid>bfb723e1-a6b7-460b-b115-62d1f2922066</uuid>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:   <name>instance-00000001</name>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:       <nova:name>tempest-DeleteServersTestJSON-server-936358237</nova:name>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:51:55</nova:creationTime>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:         <nova:user uuid="1b947140d3864542a79a544b0c9376ed">tempest-DeleteServersTestJSON-1865350861-project-member</nova:user>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:         <nova:project uuid="1ad9015838ce40f99e83bc413aa1c08b">tempest-DeleteServersTestJSON-1865350861</nova:project>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:         <nova:port uuid="abeff3c8-2440-496e-b339-d23c6c7ad07e">
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:     <system>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:       <entry name="serial">bfb723e1-a6b7-460b-b115-62d1f2922066</entry>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:       <entry name="uuid">bfb723e1-a6b7-460b-b115-62d1f2922066</entry>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:     </system>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:   <os>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:   </os>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:   <features>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:   </features>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:   <devices>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/bfb723e1-a6b7-460b-b115-62d1f2922066/disk"/>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:     </disk>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/bfb723e1-a6b7-460b-b115-62d1f2922066/disk.config"/>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:     </disk>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:bd:12:11"/>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:       <target dev="tapabeff3c8-24"/>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:     </interface>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/bfb723e1-a6b7-460b-b115-62d1f2922066/console.log" append="off"/>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:     </serial>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:     <video>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:     </video>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:     </rng>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:   </devices>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]: </domain>
May 28 01:51:56.202812 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:51:56.204936 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Preparing to wait for external event network-vif-plugged-abeff3c8-2440-496e-b339-d23c6c7ad07e {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:51:56.204936 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Acquiring lock "bfb723e1-a6b7-460b-b115-62d1f2922066-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:51:56.204936 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Lock "bfb723e1-a6b7-460b-b115-62d1f2922066-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:51:56.204936 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Lock "bfb723e1-a6b7-460b-b115-62d1f2922066-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:51:56.204936 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:51:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-936358237',display_name='tempest-DeleteServersTestJSON-server-936358237',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-deleteserverstestjson-server-936358237',id=1,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ad9015838ce40f99e83bc413aa1c08b',ramdisk_id='',reservation_id='r-0yg57ukj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1865350861',owner_user_name='tempest-DeleteServersTestJSON-1865350861-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:51:49Z,user_data=None,user_id='1b947140d3864542a79a544b0c9376ed',uuid=bfb723e1-a6b7-460b-b115-62d1f2922066,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "abeff3c8-2440-496e-b339-d23c6c7ad07e", "address": "fa:16:3e:bd:12:11", "network": {"id": "ff18d2b2-aaf4-4fbb-9b27-93d0e1ea8678", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-145899974-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ad9015838ce40f99e83bc413aa1c08b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapabeff3c8-24", "ovs_interfaceid": "abeff3c8-2440-496e-b339-d23c6c7ad07e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:51:56.205131 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Converting VIF {"id": "abeff3c8-2440-496e-b339-d23c6c7ad07e", "address": "fa:16:3e:bd:12:11", "network": {"id": "ff18d2b2-aaf4-4fbb-9b27-93d0e1ea8678", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-145899974-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ad9015838ce40f99e83bc413aa1c08b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapabeff3c8-24", "ovs_interfaceid": "abeff3c8-2440-496e-b339-d23c6c7ad07e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:51:56.205131 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:12:11,bridge_name='br-int',has_traffic_filtering=True,id=abeff3c8-2440-496e-b339-d23c6c7ad07e,network=Network(ff18d2b2-aaf4-4fbb-9b27-93d0e1ea8678),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabeff3c8-24') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:51:56.205131 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:12:11,bridge_name='br-int',has_traffic_filtering=True,id=abeff3c8-2440-496e-b339-d23c6c7ad07e,network=Network(ff18d2b2-aaf4-4fbb-9b27-93d0e1ea8678),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabeff3c8-24') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:51:56.219046 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '44b82243cb2c4fe8af34d1300bc4ff69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525e2c2d9a9421da5a3eeb5af5958f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:51:56.234771 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Acquiring lock "f342ed55-ce60-405b-bc09-856eced24bf7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:51:56.234771 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Lock "f342ed55-ce60-405b-bc09-856eced24bf7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:51:56.262143 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Created schema index Interface.name {{(pid=98241) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
May 28 01:51:56.262393 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Created schema index Port.name {{(pid=98241) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
May 28 01:51:56.262438 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Created schema index Bridge.name {{(pid=98241) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
May 28 01:51:56.263110 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 01:51:56.263661 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] [POLLOUT] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:51:56.263661 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 01:51:56.264285 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:51:56.281176 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:51:56.297254 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:51:56.297434 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:51:56.297648 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:51:56.298357 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:51:56.298500 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '868cc0fd-60dd-58b7-bc4a-2bdb39808026', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:51:56.299344 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:51:56.299871 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:51:56.300091 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:51:56.300911 np0000001583 nova-compute[98241]: INFO oslo.privsep.daemon [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp7gfhzbci/privsep.sock']
May 28 01:51:56.307612 np0000001583 sudo[109871]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp7gfhzbci/privsep.sock
May 28 01:51:56.308214 np0000001583 sudo[109871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002)
May 28 01:51:56.864827 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] [instance: 02b42340-8535-4682-98db-49f970ff5597] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:51:56.864827 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
May 28 01:51:56.864827 np0000001583 nova-compute[98241]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
May 28 01:51:56.864827 np0000001583 nova-compute[98241]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 28 01:51:56.864827 np0000001583 nova-compute[98241]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 28 01:51:56.864827 np0000001583 nova-compute[98241]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 01:51:56.864827 np0000001583 nova-compute[98241]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 28 01:51:56.864827 np0000001583 nova-compute[98241]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 28 01:51:56.864827 np0000001583 nova-compute[98241]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 28 01:51:56.864827 np0000001583 nova-compute[98241]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 01:51:56.864827 np0000001583 nova-compute[98241]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
May 28 01:51:56.864827 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Acquiring lock "1291c6e1-108e-46d1-85bc-0197f71eec1f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:51:56.864827 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "1291c6e1-108e-46d1-85bc-0197f71eec1f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:51:56.864827 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:51:56.864827 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Acquiring lock "bad69594-f163-41a6-931f-d2fcda0cb7d1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:51:56.864827 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "bad69594-f163-41a6-931f-d2fcda0cb7d1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:51:56.952909 np0000001583 nova-compute[98241]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
May 28 01:51:56.953019 np0000001583 nova-compute[98241]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 28 01:51:56.953046 np0000001583 nova-compute[98241]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 28 01:51:56.953123 np0000001583 nova-compute[98241]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 01:51:56.953175 np0000001583 nova-compute[98241]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 28 01:51:56.953225 np0000001583 nova-compute[98241]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 28 01:51:56.953271 np0000001583 nova-compute[98241]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 28 01:51:56.953316 np0000001583 nova-compute[98241]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 01:51:56.953363 np0000001583 nova-compute[98241]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
May 28 01:51:56.990636 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:51:57.025461 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:51:57.025676 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:51:57.029715 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:51:57.029852 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] [instance: 02b42340-8535-4682-98db-49f970ff5597] Claim successful on node np0000001583
May 28 01:51:57.210281 np0000001583 sudo[109871]: pam_unix(sudo:session): session closed for user root
May 28 01:51:57.211992 np0000001583 nova-compute[98241]: INFO oslo.privsep.daemon [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Spawned new privsep daemon via rootwrap
May 28 01:51:57.212762 np0000001583 nova-compute[98241]: INFO oslo.privsep.daemon [-] privsep daemon starting
May 28 01:51:57.212970 np0000001583 nova-compute[98241]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
May 28 01:51:57.213026 np0000001583 nova-compute[98241]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
May 28 01:51:57.213089 np0000001583 nova-compute[98241]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 109890
May 28 01:51:57.218154 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:51:57.221806 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-69b1c9d0-bba8-41c9-b252-b1b8237cf0c3 req-da4c82aa-7154-4999-af9b-289d767f7827 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:51:57.252928 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:51:57.256447 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:51:57.276812 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Successfully created port: b9924df6-f6a0-4dc6-a309-04713d02e8e2 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:51:57.317400 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:51:57.454029 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-69b1c9d0-bba8-41c9-b252-b1b8237cf0c3 req-da4c82aa-7154-4999-af9b-289d767f7827 service nova] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Updated VIF entry in instance network info cache for port abeff3c8-2440-496e-b339-d23c6c7ad07e. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:51:57.454294 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-69b1c9d0-bba8-41c9-b252-b1b8237cf0c3 req-da4c82aa-7154-4999-af9b-289d767f7827 service nova] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Updating instance_info_cache with network_info: [{"id": "abeff3c8-2440-496e-b339-d23c6c7ad07e", "address": "fa:16:3e:bd:12:11", "network": {"id": "ff18d2b2-aaf4-4fbb-9b27-93d0e1ea8678", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-145899974-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ad9015838ce40f99e83bc413aa1c08b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapabeff3c8-24", "ovs_interfaceid": "abeff3c8-2440-496e-b339-d23c6c7ad07e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:51:57.474858 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:51:57.474858 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapabeff3c8-24, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:51:57.474858 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapabeff3c8-24, col_values=(('qos', UUID('f5f48f1e-bc17-42c8-b2dc-ac3be1e37f2f')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:51:57.475248 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapabeff3c8-24, col_values=(('external_ids', {'iface-id': 'abeff3c8-2440-496e-b339-d23c6c7ad07e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:12:11', 'vm-uuid': 'bfb723e1-a6b7-460b-b115-62d1f2922066'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:51:57.476177 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:51:57.477578 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:51:57.482153 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:51:57.483451 np0000001583 nova-compute[98241]: INFO os_vif [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:12:11,bridge_name='br-int',has_traffic_filtering=True,id=abeff3c8-2440-496e-b339-d23c6c7ad07e,network=Network(ff18d2b2-aaf4-4fbb-9b27-93d0e1ea8678),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabeff3c8-24')
May 28 01:51:57.750155 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:51:57.774620 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:51:57.785653 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Successfully updated port: b9924df6-f6a0-4dc6-a309-04713d02e8e2 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:51:57.806438 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:51:57.854210 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d41ba91b-c02c-4731-90d3-04efd9f3e5b6 req-218bc841-aa9e-4613-8b2a-869b3eab82cc service nova] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Received event network-changed-b9924df6-f6a0-4dc6-a309-04713d02e8e2 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:51:57.854320 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d41ba91b-c02c-4731-90d3-04efd9f3e5b6 req-218bc841-aa9e-4613-8b2a-869b3eab82cc service nova] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Refreshing instance network info cache due to event network-changed-b9924df6-f6a0-4dc6-a309-04713d02e8e2. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:51:57.854477 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d41ba91b-c02c-4731-90d3-04efd9f3e5b6 req-218bc841-aa9e-4613-8b2a-869b3eab82cc service nova] Acquiring lock "refresh_cache-a4e5fc7a-978f-407f-9faf-7ec539b55e0e" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:51:57.854800 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d41ba91b-c02c-4731-90d3-04efd9f3e5b6 req-218bc841-aa9e-4613-8b2a-869b3eab82cc service nova] Acquired lock "refresh_cache-a4e5fc7a-978f-407f-9faf-7ec539b55e0e" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:51:57.854923 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-d41ba91b-c02c-4731-90d3-04efd9f3e5b6 req-218bc841-aa9e-4613-8b2a-869b3eab82cc service nova] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Refreshing network info cache for port b9924df6-f6a0-4dc6-a309-04713d02e8e2 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:51:57.956256 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-69b1c9d0-bba8-41c9-b252-b1b8237cf0c3 req-da4c82aa-7154-4999-af9b-289d767f7827 service nova] Releasing lock "refresh_cache-bfb723e1-a6b7-460b-b115-62d1f2922066" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:51:57.999312 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:51:58.000073 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:51:58.000322 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Creating image(s)
May 28 01:51:58.000831 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Acquiring lock "/opt/stack/data/nova/instances/a4e5fc7a-978f-407f-9faf-7ec539b55e0e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:51:58.000970 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Lock "/opt/stack/data/nova/instances/a4e5fc7a-978f-407f-9faf-7ec539b55e0e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:51:58.001684 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Lock "/opt/stack/data/nova/instances/a4e5fc7a-978f-407f-9faf-7ec539b55e0e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:51:58.001916 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Acquiring lock "e27f461ed4738d95f9590de1f4c12a3363ed8cbd" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:51:58.002194 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Lock "e27f461ed4738d95f9590de1f4c12a3363ed8cbd" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:51:58.287524 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Acquiring lock "refresh_cache-a4e5fc7a-978f-407f-9faf-7ec539b55e0e" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:51:58.356710 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-d41ba91b-c02c-4731-90d3-04efd9f3e5b6 req-218bc841-aa9e-4613-8b2a-869b3eab82cc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:51:58.365683 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:51:58.365965 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:51:58.471627 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-d41ba91b-c02c-4731-90d3-04efd9f3e5b6 req-218bc841-aa9e-4613-8b2a-869b3eab82cc service nova] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:51:58.650669 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-d41ba91b-c02c-4731-90d3-04efd9f3e5b6 req-218bc841-aa9e-4613-8b2a-869b3eab82cc service nova] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:51:58.778852 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:51:58.781059 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:51:58.781345 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e27f461ed4738d95f9590de1f4c12a3363ed8cbd.part --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:51:58.847228 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e27f461ed4738d95f9590de1f4c12a3363ed8cbd.part --force-share --output=json" returned: 0 in 0.065s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:51:58.848116 np0000001583 nova-compute[98241]: DEBUG nova.virt.images [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] 6488f736-e196-4a2e-9046-5de055c9c47f was qcow2, converting to raw {{(pid=98241) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 01:51:58.848623 np0000001583 nova-compute[98241]: DEBUG nova.privsep.utils [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98241) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 01:51:58.848838 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e27f461ed4738d95f9590de1f4c12a3363ed8cbd.part /opt/stack/data/nova/instances/_base/e27f461ed4738d95f9590de1f4c12a3363ed8cbd.converted {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:51:58.870030 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:51:58.962566 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e27f461ed4738d95f9590de1f4c12a3363ed8cbd.part /opt/stack/data/nova/instances/_base/e27f461ed4738d95f9590de1f4c12a3363ed8cbd.converted" returned: 0 in 0.113s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:51:58.968004 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e27f461ed4738d95f9590de1f4c12a3363ed8cbd.converted --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:51:59.001151 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:51:59.001284 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:51:59.001432 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] No VIF found with MAC fa:16:3e:bd:12:11, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:51:59.002072 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Using config drive
May 28 01:51:59.025903 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e27f461ed4738d95f9590de1f4c12a3363ed8cbd.converted --force-share --output=json" returned: 0 in 0.058s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:51:59.028058 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Lock "e27f461ed4738d95f9590de1f4c12a3363ed8cbd" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.025s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:51:59.028058 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:51:59.030329 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:51:59.031531 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e27f461ed4738d95f9590de1f4c12a3363ed8cbd --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:51:59.105899 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e27f461ed4738d95f9590de1f4c12a3363ed8cbd --force-share --output=json" returned: 0 in 0.074s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:51:59.106404 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Acquiring lock "e27f461ed4738d95f9590de1f4c12a3363ed8cbd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:51:59.107032 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Lock "e27f461ed4738d95f9590de1f4c12a3363ed8cbd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:51:59.107616 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:51:59.110789 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:51:59.111175 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e27f461ed4738d95f9590de1f4c12a3363ed8cbd --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:51:59.153313 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d41ba91b-c02c-4731-90d3-04efd9f3e5b6 req-218bc841-aa9e-4613-8b2a-869b3eab82cc service nova] Releasing lock "refresh_cache-a4e5fc7a-978f-407f-9faf-7ec539b55e0e" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:51:59.155195 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Acquired lock "refresh_cache-a4e5fc7a-978f-407f-9faf-7ec539b55e0e" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:51:59.155467 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:51:59.183440 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e27f461ed4738d95f9590de1f4c12a3363ed8cbd --force-share --output=json" returned: 0 in 0.072s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:51:59.184740 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e27f461ed4738d95f9590de1f4c12a3363ed8cbd,backing_fmt=raw /opt/stack/data/nova/instances/a4e5fc7a-978f-407f-9faf-7ec539b55e0e/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:51:59.210309 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e27f461ed4738d95f9590de1f4c12a3363ed8cbd,backing_fmt=raw /opt/stack/data/nova/instances/a4e5fc7a-978f-407f-9faf-7ec539b55e0e/disk 1073741824" returned: 0 in 0.025s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:51:59.210856 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Lock "e27f461ed4738d95f9590de1f4c12a3363ed8cbd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.104s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:51:59.211183 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e27f461ed4738d95f9590de1f4c12a3363ed8cbd --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:51:59.273604 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e27f461ed4738d95f9590de1f4c12a3363ed8cbd --force-share --output=json" returned: 0 in 0.062s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:51:59.275199 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a4e5fc7a-978f-407f-9faf-7ec539b55e0e/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:51:59.275199 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4e5fc7a-978f-407f-9faf-7ec539b55e0e/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:51:59.346244 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4e5fc7a-978f-407f-9faf-7ec539b55e0e/disk --force-share --output=json" returned: 0 in 0.071s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:51:59.346244 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Cannot resize image /opt/stack/data/nova/instances/a4e5fc7a-978f-407f-9faf-7ec539b55e0e/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:51:59.346428 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:51:59.346586 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Ensure instance console log exists: /opt/stack/data/nova/instances/a4e5fc7a-978f-407f-9faf-7ec539b55e0e/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:51:59.346923 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:51:59.347303 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:51:59.347451 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:51:59.380411 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.355s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:51:59.381483 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.063s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:51:59.381767 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] [instance: 02b42340-8535-4682-98db-49f970ff5597] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:51:59.387918 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:51:59.388064 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Claim successful on node np0000001583
May 28 01:51:59.507491 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:51:59.683319 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:51:59.819072 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:51:59.853920 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Creating config drive at /opt/stack/data/nova/instances/bfb723e1-a6b7-460b-b115-62d1f2922066/disk.config
May 28 01:51:59.857987 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/bfb723e1-a6b7-460b-b115-62d1f2922066/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3jrffaxn {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:51:59.887856 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/bfb723e1-a6b7-460b-b115-62d1f2922066/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3jrffaxn" returned: 0 in 0.030s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:51:59.896103 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] [instance: 02b42340-8535-4682-98db-49f970ff5597] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:51:59.896268 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] [instance: 02b42340-8535-4682-98db-49f970ff5597] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:51:59.896682 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:51:59.896886 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:51:59.968939 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6397db19b6ed41699a9dce1a95a8471a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c294dcbfc5459898bb040ccdf1b52f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:51:59.998412 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:00.119753 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Updating instance_info_cache with network_info: [{"id": "b9924df6-f6a0-4dc6-a309-04713d02e8e2", "address": "fa:16:3e:22:21:82", "network": {"id": "4524b467-4e05-4f3e-8b60-9d1df8eeab06", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1571320637-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b525e2c2d9a9421da5a3eeb5af5958f7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9924df6-f6", "ovs_interfaceid": "b9924df6-f6a0-4dc6-a309-04713d02e8e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:52:00.297694 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:00.315293 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:00.401775 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] [instance: 02b42340-8535-4682-98db-49f970ff5597] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:52:00.412986 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] [instance: 02b42340-8535-4682-98db-49f970ff5597] Successfully created port: 0ac172e4-b81e-4014-bb42-bb91fe781adf {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:52:00.414912 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:00.417761 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:00.622673 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Releasing lock "refresh_cache-a4e5fc7a-978f-407f-9faf-7ec539b55e0e" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:52:00.625113 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Instance network_info: |[{"id": "b9924df6-f6a0-4dc6-a309-04713d02e8e2", "address": "fa:16:3e:22:21:82", "network": {"id": "4524b467-4e05-4f3e-8b60-9d1df8eeab06", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1571320637-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b525e2c2d9a9421da5a3eeb5af5958f7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9924df6-f6", "ovs_interfaceid": "b9924df6-f6a0-4dc6-a309-04713d02e8e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:52:00.625113 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Start _get_guest_xml network_info=[{"id": "b9924df6-f6a0-4dc6-a309-04713d02e8e2", "address": "fa:16:3e:22:21:82", "network": {"id": "4524b467-4e05-4f3e-8b60-9d1df8eeab06", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1571320637-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b525e2c2d9a9421da5a3eeb5af5958f7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9924df6-f6", "ovs_interfaceid": "b9924df6-f6a0-4dc6-a309-04713d02e8e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:51:41Z,direct_url=<?>,disk_format='qcow2',id=6488f736-e196-4a2e-9046-5de055c9c47f,min_disk=0,min_ram=0,name='',owner='7b83b2f302b14b40b6f6c0e3dd992146',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:51:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/sda', 'disk_bus': 'scsi', 'encryption_secret_uuid': None, 'image_id': '6488f736-e196-4a2e-9046-5de055c9c47f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:52:00.637920 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:52:00.641874 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6488f736-e196-4a2e-9046-5de055c9c47f', instance_meta=NovaInstanceMeta(name='tempest-AttachSCSIVolumeTestJSON-server-487281858', uuid='a4e5fc7a-978f-407f-9faf-7ec539b55e0e'), owner=OwnerMeta(userid='44b82243cb2c4fe8af34d1300bc4ff69', username='tempest-AttachSCSIVolumeTestJSON-2104948228-project-member', projectid='b525e2c2d9a9421da5a3eeb5af5958f7', projectname='tempest-AttachSCSIVolumeTestJSON-2104948228'), image=ImageMeta(id='6488f736-e196-4a2e-9046-5de055c9c47f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'scsi', 'hw_disk_bus': 'scsi', 'hw_scsi_model': 'virtio-scsi'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b9924df6-f6a0-4dc6-a309-04713d02e8e2", "address": "fa:16:3e:22:21:82", "network": {"id": "4524b467-4e05-4f3e-8b60-9d1df8eeab06", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1571320637-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b525e2c2d9a9421da5a3eeb5af5958f7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9924df6-f6", "ovs_interfaceid": "b9924df6-f6a0-4dc6-a309-04713d02e8e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933120.6405964) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:52:00.643263 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:52:00.643573 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:52:00.647274 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:52:00.647274 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:52:00.647274 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:52:00.647274 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:51:41Z,direct_url=<?>,disk_format='qcow2',id=6488f736-e196-4a2e-9046-5de055c9c47f,min_disk=0,min_ram=0,name='',owner='7b83b2f302b14b40b6f6c0e3dd992146',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:51:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:52:00.647274 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:52:00.647274 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:52:00.647274 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:52:00.647274 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:52:00.647274 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:52:00.647274 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:52:00.647274 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:52:00.647274 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:52:00.647274 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:52:00.647790 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:52:00.662415 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:51:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-487281858',display_name='tempest-AttachSCSIVolumeTestJSON-server-487281858',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-attachscsivolumetestjson-server-487281858',id=2,image_ref='6488f736-e196-4a2e-9046-5de055c9c47f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDDxYEogI39GVE1ytjzPZCHEmuELU1UW+fZK3pyz3CkN0pDevQL1svoDZ4T1x4I/E9WbzUiIJJwFQv9e9JqcsXBSbNanFhBjTuXiQlIXMWxG63KPiFRgJBtf5WE7TffNVA==',key_name='tempest-keypair-1342711016',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b525e2c2d9a9421da5a3eeb5af5958f7',ramdisk_id='',reservation_id='r-m4oa8nfr',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6488f736-e196-4a2e-9046-5de055c9c47f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-2104948228',owner_user_name='tempest-AttachSCSIVolumeTestJSON-2104948228-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:51:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44b82243cb2c4fe8af34d1300bc4ff69',uuid=a4e5fc7a-978f-407f-9faf-7ec539b55e0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9924df6-f6a0-4dc6-a309-04713d02e8e2", "address": "fa:16:3e:22:21:82", "network": {"id": "4524b467-4e05-4f3e-8b60-9d1df8eeab06", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1571320637-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b525e2c2d9a9421da5a3eeb5af5958f7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9924df6-f6", "ovs_interfaceid": "b9924df6-f6a0-4dc6-a309-04713d02e8e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:52:00.662415 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Converting VIF {"id": "b9924df6-f6a0-4dc6-a309-04713d02e8e2", "address": "fa:16:3e:22:21:82", "network": {"id": "4524b467-4e05-4f3e-8b60-9d1df8eeab06", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1571320637-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b525e2c2d9a9421da5a3eeb5af5958f7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9924df6-f6", "ovs_interfaceid": "b9924df6-f6a0-4dc6-a309-04713d02e8e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:52:00.662925 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:21:82,bridge_name='br-int',has_traffic_filtering=True,id=b9924df6-f6a0-4dc6-a309-04713d02e8e2,network=Network(4524b467-4e05-4f3e-8b60-9d1df8eeab06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9924df6-f6') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:52:00.663682 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Lazy-loading 'pci_devices' on Instance uuid a4e5fc7a-978f-407f-9faf-7ec539b55e0e {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:52:00.837391 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:52:00.837609 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:52:00.904198 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] [instance: 02b42340-8535-4682-98db-49f970ff5597] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:52:01.012695 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9ae5c0ed-71f2-447e-bdf7-a11c4326273f req-656a6e30-d58c-441f-b0e9-b5dcda2c32d7 service nova] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Received event network-vif-plugged-abeff3c8-2440-496e-b339-d23c6c7ad07e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:01.012695 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9ae5c0ed-71f2-447e-bdf7-a11c4326273f req-656a6e30-d58c-441f-b0e9-b5dcda2c32d7 service nova] Acquiring lock "bfb723e1-a6b7-460b-b115-62d1f2922066-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:01.015156 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9ae5c0ed-71f2-447e-bdf7-a11c4326273f req-656a6e30-d58c-441f-b0e9-b5dcda2c32d7 service nova] Lock "bfb723e1-a6b7-460b-b115-62d1f2922066-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:01.015156 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9ae5c0ed-71f2-447e-bdf7-a11c4326273f req-656a6e30-d58c-441f-b0e9-b5dcda2c32d7 service nova] Lock "bfb723e1-a6b7-460b-b115-62d1f2922066-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:01.015156 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9ae5c0ed-71f2-447e-bdf7-a11c4326273f req-656a6e30-d58c-441f-b0e9-b5dcda2c32d7 service nova] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Processing event network-vif-plugged-abeff3c8-2440-496e-b339-d23c6c7ad07e {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:52:01.077182 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] [instance: 02b42340-8535-4682-98db-49f970ff5597] Successfully updated port: 0ac172e4-b81e-4014-bb42-bb91fe781adf {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:52:01.129849 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-8d527947-808a-47fa-bedc-1bf160bcab43 req-895789a3-9f5b-4fcb-b1e0-28b64fcce591 service nova] [instance: 02b42340-8535-4682-98db-49f970ff5597] Received event network-changed-0ac172e4-b81e-4014-bb42-bb91fe781adf {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:01.129849 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-8d527947-808a-47fa-bedc-1bf160bcab43 req-895789a3-9f5b-4fcb-b1e0-28b64fcce591 service nova] [instance: 02b42340-8535-4682-98db-49f970ff5597] Refreshing instance network info cache due to event network-changed-0ac172e4-b81e-4014-bb42-bb91fe781adf. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:52:01.129849 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-8d527947-808a-47fa-bedc-1bf160bcab43 req-895789a3-9f5b-4fcb-b1e0-28b64fcce591 service nova] Acquiring lock "refresh_cache-02b42340-8535-4682-98db-49f970ff5597" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:52:01.129849 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-8d527947-808a-47fa-bedc-1bf160bcab43 req-895789a3-9f5b-4fcb-b1e0-28b64fcce591 service nova] Acquired lock "refresh_cache-02b42340-8535-4682-98db-49f970ff5597" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:52:01.129849 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-8d527947-808a-47fa-bedc-1bf160bcab43 req-895789a3-9f5b-4fcb-b1e0-28b64fcce591 service nova] [instance: 02b42340-8535-4682-98db-49f970ff5597] Refreshing network info cache for port 0ac172e4-b81e-4014-bb42-bb91fe781adf {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:52:01.166231 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] End _get_guest_xml xml=<domain type="qemu">
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:   <uuid>a4e5fc7a-978f-407f-9faf-7ec539b55e0e</uuid>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:   <name>instance-00000002</name>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-487281858</nova:name>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:52:00</nova:creationTime>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:       <nova:image uuid="6488f736-e196-4a2e-9046-5de055c9c47f">
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:           <nova:property name="hw_cdrom_bus">scsi</nova:property>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:           <nova:property name="hw_disk_bus">scsi</nova:property>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:           <nova:property name="hw_scsi_model">virtio-scsi</nova:property>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:         <nova:user uuid="44b82243cb2c4fe8af34d1300bc4ff69">tempest-AttachSCSIVolumeTestJSON-2104948228-project-member</nova:user>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:         <nova:project uuid="b525e2c2d9a9421da5a3eeb5af5958f7">tempest-AttachSCSIVolumeTestJSON-2104948228</nova:project>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="6488f736-e196-4a2e-9046-5de055c9c47f"/>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:         <nova:port uuid="b9924df6-f6a0-4dc6-a309-04713d02e8e2">
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:     <system>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:       <entry name="serial">a4e5fc7a-978f-407f-9faf-7ec539b55e0e</entry>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:       <entry name="uuid">a4e5fc7a-978f-407f-9faf-7ec539b55e0e</entry>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:     </system>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:   <os>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:   </os>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:   <features>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:   </features>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:   <devices>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/a4e5fc7a-978f-407f-9faf-7ec539b55e0e/disk"/>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:       <target dev="sda" bus="scsi"/>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:       <address type="drive" controller="0" unit="0"/>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:     </disk>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/a4e5fc7a-978f-407f-9faf-7ec539b55e0e/disk.config"/>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:       <target dev="sdb" bus="scsi"/>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:       <address type="drive" controller="0" unit="1"/>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:     </disk>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:     <controller type="scsi" index="0" model="virtio-scsi"/>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:22:21:82"/>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:       <target dev="tapb9924df6-f6"/>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:     </interface>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/a4e5fc7a-978f-407f-9faf-7ec539b55e0e/console.log" append="off"/>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:     </serial>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:     <video>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:     </video>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:     </rng>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:   </devices>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]: </domain>
May 28 01:52:01.166231 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:52:01.169380 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Preparing to wait for external event network-vif-plugged-b9924df6-f6a0-4dc6-a309-04713d02e8e2 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:52:01.169380 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Acquiring lock "a4e5fc7a-978f-407f-9faf-7ec539b55e0e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:01.169380 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Lock "a4e5fc7a-978f-407f-9faf-7ec539b55e0e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:01.169380 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Lock "a4e5fc7a-978f-407f-9faf-7ec539b55e0e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:01.169380 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:51:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-487281858',display_name='tempest-AttachSCSIVolumeTestJSON-server-487281858',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-attachscsivolumetestjson-server-487281858',id=2,image_ref='6488f736-e196-4a2e-9046-5de055c9c47f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDDxYEogI39GVE1ytjzPZCHEmuELU1UW+fZK3pyz3CkN0pDevQL1svoDZ4T1x4I/E9WbzUiIJJwFQv9e9JqcsXBSbNanFhBjTuXiQlIXMWxG63KPiFRgJBtf5WE7TffNVA==',key_name='tempest-keypair-1342711016',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b525e2c2d9a9421da5a3eeb5af5958f7',ramdisk_id='',reservation_id='r-m4oa8nfr',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6488f736-e196-4a2e-9046-5de055c9c47f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-2104948228',owner_user_name='tempest-AttachSCSIVolumeTestJSON-2104948228-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:51:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44b82243cb2c4fe8af34d1300bc4ff69',uuid=a4e5fc7a-978f-407f-9faf-7ec539b55e0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9924df6-f6a0-4dc6-a309-04713d02e8e2", "address": "fa:16:3e:22:21:82", "network": {"id": "4524b467-4e05-4f3e-8b60-9d1df8eeab06", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1571320637-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b525e2c2d9a9421da5a3eeb5af5958f7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9924df6-f6", "ovs_interfaceid": "b9924df6-f6a0-4dc6-a309-04713d02e8e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:52:01.169724 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Converting VIF {"id": "b9924df6-f6a0-4dc6-a309-04713d02e8e2", "address": "fa:16:3e:22:21:82", "network": {"id": "4524b467-4e05-4f3e-8b60-9d1df8eeab06", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1571320637-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b525e2c2d9a9421da5a3eeb5af5958f7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9924df6-f6", "ovs_interfaceid": "b9924df6-f6a0-4dc6-a309-04713d02e8e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:52:01.169724 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:21:82,bridge_name='br-int',has_traffic_filtering=True,id=b9924df6-f6a0-4dc6-a309-04713d02e8e2,network=Network(4524b467-4e05-4f3e-8b60-9d1df8eeab06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9924df6-f6') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:52:01.169724 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:21:82,bridge_name='br-int',has_traffic_filtering=True,id=b9924df6-f6a0-4dc6-a309-04713d02e8e2,network=Network(4524b467-4e05-4f3e-8b60-9d1df8eeab06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9924df6-f6') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:52:01.169914 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:01.170144 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:01.170893 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:52:01.171399 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:01.172032 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9821b6d9-ba07-5ae8-9938-85ea6a079b78', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:01.172231 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:01.172757 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:52:01.173050 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:01.174934 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:01.175075 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb9924df6-f6, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:01.175440 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb9924df6-f6, col_values=(('qos', UUID('33e42294-baca-42ed-8b99-cffe0ed5f5ab')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:01.175676 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb9924df6-f6, col_values=(('external_ids', {'iface-id': 'b9924df6-f6a0-4dc6-a309-04713d02e8e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:21:82', 'vm-uuid': 'a4e5fc7a-978f-407f-9faf-7ec539b55e0e'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:01.176311 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:01.177490 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:52:01.181993 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:01.182697 np0000001583 nova-compute[98241]: INFO os_vif [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:21:82,bridge_name='br-int',has_traffic_filtering=True,id=b9924df6-f6a0-4dc6-a309-04713d02e8e2,network=Network(4524b467-4e05-4f3e-8b60-9d1df8eeab06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9924df6-f6')
May 28 01:52:01.257827 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:52:01.258225 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1779933121.2579367, bfb723e1-a6b7-460b-b115-62d1f2922066 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:52:01.258485 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] VM Started (Lifecycle Event)
May 28 01:52:01.261853 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:52:01.263540 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Instance spawned successfully.
May 28 01:52:01.264940 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:52:01.341986 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:52:01.578794 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Acquiring lock "refresh_cache-02b42340-8535-4682-98db-49f970ff5597" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:52:01.631096 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-8d527947-808a-47fa-bedc-1bf160bcab43 req-895789a3-9f5b-4fcb-b1e0-28b64fcce591 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:01.729726 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-8d527947-808a-47fa-bedc-1bf160bcab43 req-895789a3-9f5b-4fcb-b1e0-28b64fcce591 service nova] [instance: 02b42340-8535-4682-98db-49f970ff5597] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:52:01.761139 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:52:01.763679 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:52:01.771042 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:52:01.771175 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:52:01.771482 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:52:01.771691 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:52:01.771916 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:52:01.772162 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:52:01.852003 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.471s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:01.852754 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:52:01.857183 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 4.079s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:01.858644 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:52:01.858852 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Claim successful on node np0000001583
May 28 01:52:01.917918 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] [instance: 02b42340-8535-4682-98db-49f970ff5597] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:52:01.919555 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] [instance: 02b42340-8535-4682-98db-49f970ff5597] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:52:01.920175 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] [instance: 02b42340-8535-4682-98db-49f970ff5597] Creating image(s)
May 28 01:52:01.920561 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Acquiring lock "/opt/stack/data/nova/instances/02b42340-8535-4682-98db-49f970ff5597/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:01.920975 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Lock "/opt/stack/data/nova/instances/02b42340-8535-4682-98db-49f970ff5597/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:01.921721 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Lock "/opt/stack/data/nova/instances/02b42340-8535-4682-98db-49f970ff5597/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:01.922564 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:52:01.928255 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:52:01.933768 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:52:01.955430 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-8d527947-808a-47fa-bedc-1bf160bcab43 req-895789a3-9f5b-4fcb-b1e0-28b64fcce591 service nova] [instance: 02b42340-8535-4682-98db-49f970ff5597] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:52:02.009389 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.079s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:52:02.013284 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:02.013284 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:02.013284 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:52:02.017703 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:52:02.018355 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:52:02.085609 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.067s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:52:02.086125 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/02b42340-8535-4682-98db-49f970ff5597/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:52:02.117023 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/02b42340-8535-4682-98db-49f970ff5597/disk 1073741824" returned: 0 in 0.029s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:52:02.118588 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.108s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:02.118992 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:52:02.209090 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.090s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:52:02.209364 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Checking if we can resize image /opt/stack/data/nova/instances/02b42340-8535-4682-98db-49f970ff5597/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:52:02.209595 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02b42340-8535-4682-98db-49f970ff5597/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:52:02.269566 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02b42340-8535-4682-98db-49f970ff5597/disk --force-share --output=json" returned: 0 in 0.060s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:52:02.270465 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:52:02.270950 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Cannot resize image /opt/stack/data/nova/instances/02b42340-8535-4682-98db-49f970ff5597/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:52:02.271305 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] [instance: 02b42340-8535-4682-98db-49f970ff5597] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:52:02.271469 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] [instance: 02b42340-8535-4682-98db-49f970ff5597] Ensure instance console log exists: /opt/stack/data/nova/instances/02b42340-8535-4682-98db-49f970ff5597/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:52:02.271739 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:02.271959 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:02.272114 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:02.272885 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933122.2725508, bfb723e1-a6b7-460b-b115-62d1f2922066 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:52:02.273070 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] VM Paused (Lifecycle Event)
May 28 01:52:02.279829 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Took 12.24 seconds to spawn the instance on the hypervisor.
May 28 01:52:02.279829 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:52:02.372912 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:52:02.378221 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:52:02.379007 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:02.379259 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:02.455794 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8608d299c7e641c2a403907cb4674347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745d9bd220de4beaab6c7561af376ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:52:02.460178 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-8d527947-808a-47fa-bedc-1bf160bcab43 req-895789a3-9f5b-4fcb-b1e0-28b64fcce591 service nova] Releasing lock "refresh_cache-02b42340-8535-4682-98db-49f970ff5597" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:52:02.460561 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Acquired lock "refresh_cache-02b42340-8535-4682-98db-49f970ff5597" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:52:02.460742 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] [instance: 02b42340-8535-4682-98db-49f970ff5597] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:52:02.699391 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] No BDM found with device name sda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:52:02.700097 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] No BDM found with device name sdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:52:02.700097 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] No VIF found with MAC fa:16:3e:22:21:82, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:52:02.701923 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Using config drive
May 28 01:52:02.755123 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:02.776399 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:52:02.780103 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933122.7775967, bfb723e1-a6b7-460b-b115-62d1f2922066 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:52:02.780103 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] VM Resumed (Lifecycle Event)
May 28 01:52:02.787921 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Took 17.51 seconds to build instance.
May 28 01:52:02.882110 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:52:02.927249 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Successfully created port: 00a0837b-bced-48a4-84d6-8ba3fa1cccfc {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:52:02.990054 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:02.997511 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:03.002477 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:03.024362 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:03.032242 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:03.054348 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] [instance: 02b42340-8535-4682-98db-49f970ff5597] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:52:03.093257 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Acquiring lock "d3a7c39a-f946-496d-9153-0a422e7f5350" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:03.093409 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:03.099227 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f397e17a-fc7f-4130-aa51-1fdeea1ad670 req-bfca855c-ef21-4a2a-b09b-6278b955af33 service nova] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Received event network-vif-plugged-abeff3c8-2440-496e-b339-d23c6c7ad07e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:03.100387 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f397e17a-fc7f-4130-aa51-1fdeea1ad670 req-bfca855c-ef21-4a2a-b09b-6278b955af33 service nova] Acquiring lock "bfb723e1-a6b7-460b-b115-62d1f2922066-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:03.100601 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f397e17a-fc7f-4130-aa51-1fdeea1ad670 req-bfca855c-ef21-4a2a-b09b-6278b955af33 service nova] Lock "bfb723e1-a6b7-460b-b115-62d1f2922066-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:03.100704 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f397e17a-fc7f-4130-aa51-1fdeea1ad670 req-bfca855c-ef21-4a2a-b09b-6278b955af33 service nova] Lock "bfb723e1-a6b7-460b-b115-62d1f2922066-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:03.100835 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f397e17a-fc7f-4130-aa51-1fdeea1ad670 req-bfca855c-ef21-4a2a-b09b-6278b955af33 service nova] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] No waiting events found dispatching network-vif-plugged-abeff3c8-2440-496e-b339-d23c6c7ad07e {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:52:03.100965 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-f397e17a-fc7f-4130-aa51-1fdeea1ad670 req-bfca855c-ef21-4a2a-b09b-6278b955af33 service nova] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Received unexpected event network-vif-plugged-abeff3c8-2440-496e-b339-d23c6c7ad07e for instance with vm_state active and task_state None.
May 28 01:52:03.206039 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:03.281798 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:52:03.283253 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:52:03.291008 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-66bb3073-9e0b-418b-bda3-9e1a1065a638 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Lock "bfb723e1-a6b7-460b-b115-62d1f2922066" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.027s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:03.296446 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:03.387534 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:52:03.402197 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:52:03.402558 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:52:03.418831 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Creating config drive at /opt/stack/data/nova/instances/a4e5fc7a-978f-407f-9faf-7ec539b55e0e/disk.config
May 28 01:52:03.426730 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a4e5fc7a-978f-407f-9faf-7ec539b55e0e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7_zb3h9y {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:52:03.464923 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a4e5fc7a-978f-407f-9faf-7ec539b55e0e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7_zb3h9y" returned: 0 in 0.038s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:52:03.504717 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] [instance: 02b42340-8535-4682-98db-49f970ff5597] Updating instance_info_cache with network_info: [{"id": "0ac172e4-b81e-4014-bb42-bb91fe781adf", "address": "fa:16:3e:f4:4b:8c", "network": {"id": "f0cd4ecd-6ce5-4118-a161-0bc234bc71f7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1347979747-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "43c294dcbfc5459898bb040ccdf1b52f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac172e4-b8", "ovs_interfaceid": "0ac172e4-b81e-4014-bb42-bb91fe781adf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:52:03.581567 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Successfully updated port: 00a0837b-bced-48a4-84d6-8ba3fa1cccfc {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:52:03.597062 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:52:03.900706 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:03.906711 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:52:03.921170 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:04.008172 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Releasing lock "refresh_cache-02b42340-8535-4682-98db-49f970ff5597" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:52:04.008489 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] [instance: 02b42340-8535-4682-98db-49f970ff5597] Instance network_info: |[{"id": "0ac172e4-b81e-4014-bb42-bb91fe781adf", "address": "fa:16:3e:f4:4b:8c", "network": {"id": "f0cd4ecd-6ce5-4118-a161-0bc234bc71f7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1347979747-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "43c294dcbfc5459898bb040ccdf1b52f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac172e4-b8", "ovs_interfaceid": "0ac172e4-b81e-4014-bb42-bb91fe781adf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:52:04.010490 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] [instance: 02b42340-8535-4682-98db-49f970ff5597] Start _get_guest_xml network_info=[{"id": "0ac172e4-b81e-4014-bb42-bb91fe781adf", "address": "fa:16:3e:f4:4b:8c", "network": {"id": "f0cd4ecd-6ce5-4118-a161-0bc234bc71f7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1347979747-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "43c294dcbfc5459898bb040ccdf1b52f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac172e4-b8", "ovs_interfaceid": "0ac172e4-b81e-4014-bb42-bb91fe781adf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:52:04.015780 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:52:04.017096 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-VolumesAssistedSnapshotsTest-server-1927554545', uuid='02b42340-8535-4682-98db-49f970ff5597'), owner=OwnerMeta(userid='6397db19b6ed41699a9dce1a95a8471a', username='tempest-VolumesAssistedSnapshotsTest-167698526-project-member', projectid='43c294dcbfc5459898bb040ccdf1b52f', projectname='tempest-VolumesAssistedSnapshotsTest-167698526'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0ac172e4-b81e-4014-bb42-bb91fe781adf", "address": "fa:16:3e:f4:4b:8c", "network": {"id": "f0cd4ecd-6ce5-4118-a161-0bc234bc71f7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1347979747-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "43c294dcbfc5459898bb040ccdf1b52f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac172e4-b8", "ovs_interfaceid": "0ac172e4-b81e-4014-bb42-bb91fe781adf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933124.0167367) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:52:04.018112 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:52:04.018395 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:52:04.021292 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:52:04.021292 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:52:04.021292 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:52:04.021435 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:52:04.021647 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:52:04.021890 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:04.025097 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:52:04.025097 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:52:04.025097 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:52:04.025097 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:52:04.025097 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:52:04.025097 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:52:04.025097 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:52:04.025097 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:52:04.025097 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:52:04.036341 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:51:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1927554545',display_name='tempest-VolumesAssistedSnapshotsTest-server-1927554545',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-volumesassistedsnapshotstest-server-1927554545',id=3,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH1ORm2bAC9pSCTpqpq7/6dHWgWHkyWvTbf7nsO5W9cbBimklfTaLLCh0LO3WyPmGHgBJdATEdQsWMtaZ6MmaEfH+7e9mN1r4DAQ/4Ii2Cqci/tTUM79p8JHrbTb/CvUcg==',key_name='tempest-keypair-29474514',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='43c294dcbfc5459898bb040ccdf1b52f',ramdisk_id='',reservation_id='r-yxkej6ix',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-167698526',owner_user_name='tempest-VolumesAssistedSnapshotsTest-167698526-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:52:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6397db19b6ed41699a9dce1a95a8471a',uuid=02b42340-8535-4682-98db-49f970ff5597,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ac172e4-b81e-4014-bb42-bb91fe781adf", "address": "fa:16:3e:f4:4b:8c", "network": {"id": "f0cd4ecd-6ce5-4118-a161-0bc234bc71f7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1347979747-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "43c294dcbfc5459898bb040ccdf1b52f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac172e4-b8", "ovs_interfaceid": "0ac172e4-b81e-4014-bb42-bb91fe781adf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:52:04.036574 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Converting VIF {"id": "0ac172e4-b81e-4014-bb42-bb91fe781adf", "address": "fa:16:3e:f4:4b:8c", "network": {"id": "f0cd4ecd-6ce5-4118-a161-0bc234bc71f7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1347979747-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "43c294dcbfc5459898bb040ccdf1b52f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac172e4-b8", "ovs_interfaceid": "0ac172e4-b81e-4014-bb42-bb91fe781adf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:52:04.038488 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:4b:8c,bridge_name='br-int',has_traffic_filtering=True,id=0ac172e4-b81e-4014-bb42-bb91fe781adf,network=Network(f0cd4ecd-6ce5-4118-a161-0bc234bc71f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ac172e4-b8') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:52:04.038488 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Lazy-loading 'pci_devices' on Instance uuid 02b42340-8535-4682-98db-49f970ff5597 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:52:04.081664 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-55f5b5b9-7f7f-467b-8506-7096159e755f req-81700702-4362-460c-a9bd-d42e50e988e8 service nova] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Received event network-changed-00a0837b-bced-48a4-84d6-8ba3fa1cccfc {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:04.081770 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-55f5b5b9-7f7f-467b-8506-7096159e755f req-81700702-4362-460c-a9bd-d42e50e988e8 service nova] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Refreshing instance network info cache due to event network-changed-00a0837b-bced-48a4-84d6-8ba3fa1cccfc. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:52:04.081952 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-55f5b5b9-7f7f-467b-8506-7096159e755f req-81700702-4362-460c-a9bd-d42e50e988e8 service nova] Acquiring lock "refresh_cache-f342ed55-ce60-405b-bc09-856eced24bf7" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:52:04.082047 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-55f5b5b9-7f7f-467b-8506-7096159e755f req-81700702-4362-460c-a9bd-d42e50e988e8 service nova] Acquired lock "refresh_cache-f342ed55-ce60-405b-bc09-856eced24bf7" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:52:04.082169 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-55f5b5b9-7f7f-467b-8506-7096159e755f req-81700702-4362-460c-a9bd-d42e50e988e8 service nova] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Refreshing network info cache for port 00a0837b-bced-48a4-84d6-8ba3fa1cccfc {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:52:04.084775 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Acquiring lock "refresh_cache-f342ed55-ce60-405b-bc09-856eced24bf7" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:52:04.149624 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:04.228447 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:04.231099 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:04.231950 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:04.248255 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:04.406155 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:52:04.408048 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:52:04.409300 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Creating image(s)
May 28 01:52:04.409826 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Acquiring lock "/opt/stack/data/nova/instances/f342ed55-ce60-405b-bc09-856eced24bf7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:04.410539 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Lock "/opt/stack/data/nova/instances/f342ed55-ce60-405b-bc09-856eced24bf7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:04.411005 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Lock "/opt/stack/data/nova/instances/f342ed55-ce60-405b-bc09-856eced24bf7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:04.412575 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:52:04.417290 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.564s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:04.422381 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:52:04.424987 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:52:04.425254 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 6.619s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:04.429100 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:52:04.438019 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:52:04.438200 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Claim successful on node np0000001583
May 28 01:52:04.499374 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.073s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:52:04.499798 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:04.501346 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:04.501842 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:52:04.505402 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:52:04.505805 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:52:04.542644 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] [instance: 02b42340-8535-4682-98db-49f970ff5597] End _get_guest_xml xml=<domain type="qemu">
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:   <uuid>02b42340-8535-4682-98db-49f970ff5597</uuid>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:   <name>instance-00000003</name>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1927554545</nova:name>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:52:04</nova:creationTime>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:         <nova:user uuid="6397db19b6ed41699a9dce1a95a8471a">tempest-VolumesAssistedSnapshotsTest-167698526-project-member</nova:user>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:         <nova:project uuid="43c294dcbfc5459898bb040ccdf1b52f">tempest-VolumesAssistedSnapshotsTest-167698526</nova:project>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:         <nova:port uuid="0ac172e4-b81e-4014-bb42-bb91fe781adf">
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:     <system>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:       <entry name="serial">02b42340-8535-4682-98db-49f970ff5597</entry>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:       <entry name="uuid">02b42340-8535-4682-98db-49f970ff5597</entry>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:     </system>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:   <os>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:   </os>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:   <features>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:   </features>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:   <devices>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/02b42340-8535-4682-98db-49f970ff5597/disk"/>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:     </disk>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/02b42340-8535-4682-98db-49f970ff5597/disk.config"/>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:     </disk>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:f4:4b:8c"/>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:       <target dev="tap0ac172e4-b8"/>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:     </interface>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/02b42340-8535-4682-98db-49f970ff5597/console.log" append="off"/>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:     </serial>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:     <video>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:     </video>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:     </rng>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:   </devices>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]: </domain>
May 28 01:52:04.542644 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:52:04.544611 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] [instance: 02b42340-8535-4682-98db-49f970ff5597] Preparing to wait for external event network-vif-plugged-0ac172e4-b81e-4014-bb42-bb91fe781adf {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:52:04.544611 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Acquiring lock "02b42340-8535-4682-98db-49f970ff5597-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:04.544611 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Lock "02b42340-8535-4682-98db-49f970ff5597-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:04.544611 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Lock "02b42340-8535-4682-98db-49f970ff5597-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:04.545027 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:51:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1927554545',display_name='tempest-VolumesAssistedSnapshotsTest-server-1927554545',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-volumesassistedsnapshotstest-server-1927554545',id=3,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH1ORm2bAC9pSCTpqpq7/6dHWgWHkyWvTbf7nsO5W9cbBimklfTaLLCh0LO3WyPmGHgBJdATEdQsWMtaZ6MmaEfH+7e9mN1r4DAQ/4Ii2Cqci/tTUM79p8JHrbTb/CvUcg==',key_name='tempest-keypair-29474514',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='43c294dcbfc5459898bb040ccdf1b52f',ramdisk_id='',reservation_id='r-yxkej6ix',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-167698526',owner_user_name='tempest-VolumesAssistedSnapshotsTest-167698526-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:52:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6397db19b6ed41699a9dce1a95a8471a',uuid=02b42340-8535-4682-98db-49f970ff5597,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ac172e4-b81e-4014-bb42-bb91fe781adf", "address": "fa:16:3e:f4:4b:8c", "network": {"id": "f0cd4ecd-6ce5-4118-a161-0bc234bc71f7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1347979747-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "43c294dcbfc5459898bb040ccdf1b52f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac172e4-b8", "ovs_interfaceid": "0ac172e4-b81e-4014-bb42-bb91fe781adf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:52:04.545027 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Converting VIF {"id": "0ac172e4-b81e-4014-bb42-bb91fe781adf", "address": "fa:16:3e:f4:4b:8c", "network": {"id": "f0cd4ecd-6ce5-4118-a161-0bc234bc71f7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1347979747-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "43c294dcbfc5459898bb040ccdf1b52f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac172e4-b8", "ovs_interfaceid": "0ac172e4-b81e-4014-bb42-bb91fe781adf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:52:04.545827 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:4b:8c,bridge_name='br-int',has_traffic_filtering=True,id=0ac172e4-b81e-4014-bb42-bb91fe781adf,network=Network(f0cd4ecd-6ce5-4118-a161-0bc234bc71f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ac172e4-b8') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:52:04.546160 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:4b:8c,bridge_name='br-int',has_traffic_filtering=True,id=0ac172e4-b81e-4014-bb42-bb91fe781adf,network=Network(f0cd4ecd-6ce5-4118-a161-0bc234bc71f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ac172e4-b8') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:52:04.546604 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:04.546971 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:04.547326 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:52:04.548185 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:04.548358 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '89ae1b14-d012-54b5-a6da-91d0d22c96ec', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:04.549681 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:04.549806 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:52:04.550737 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:04.554122 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:04.554293 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ac172e4-b8, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:04.554765 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0ac172e4-b8, col_values=(('qos', UUID('b2843d80-6179-4e43-8db7-a0d0965237ea')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:04.554826 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0ac172e4-b8, col_values=(('external_ids', {'iface-id': '0ac172e4-b81e-4014-bb42-bb91fe781adf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:4b:8c', 'vm-uuid': '02b42340-8535-4682-98db-49f970ff5597'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:04.555569 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:04.556681 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:52:04.561354 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:04.562761 np0000001583 nova-compute[98241]: INFO os_vif [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:4b:8c,bridge_name='br-int',has_traffic_filtering=True,id=0ac172e4-b81e-4014-bb42-bb91fe781adf,network=Network(f0cd4ecd-6ce5-4118-a161-0bc234bc71f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ac172e4-b8')
May 28 01:52:04.580856 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.075s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:52:04.581165 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/f342ed55-ce60-405b-bc09-856eced24bf7/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:52:04.591618 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-55f5b5b9-7f7f-467b-8506-7096159e755f req-81700702-4362-460c-a9bd-d42e50e988e8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:04.613575 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/f342ed55-ce60-405b-bc09-856eced24bf7/disk 1073741824" returned: 0 in 0.032s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:52:04.613960 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.113s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:04.614261 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:52:04.689968 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-55f5b5b9-7f7f-467b-8506-7096159e755f req-81700702-4362-460c-a9bd-d42e50e988e8 service nova] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:52:04.699233 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.085s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:52:04.699692 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f342ed55-ce60-405b-bc09-856eced24bf7/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:52:04.699969 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f342ed55-ce60-405b-bc09-856eced24bf7/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:52:04.711159 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933124.7090647, a4e5fc7a-978f-407f-9faf-7ec539b55e0e => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:52:04.711517 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] VM Started (Lifecycle Event)
May 28 01:52:04.784957 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f342ed55-ce60-405b-bc09-856eced24bf7/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:52:04.785383 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Cannot resize image /opt/stack/data/nova/instances/f342ed55-ce60-405b-bc09-856eced24bf7/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:52:04.785781 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:52:04.786005 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Ensure instance console log exists: /opt/stack/data/nova/instances/f342ed55-ce60-405b-bc09-856eced24bf7/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:52:04.786368 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:04.786630 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:04.786788 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:04.799623 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Acquiring lock "bfb723e1-a6b7-460b-b115-62d1f2922066" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:04.799820 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Lock "bfb723e1-a6b7-460b-b115-62d1f2922066" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:04.929930 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:52:04.930188 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:52:04.930593 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:04.930886 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:04.942657 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-55f5b5b9-7f7f-467b-8506-7096159e755f req-81700702-4362-460c-a9bd-d42e50e988e8 service nova] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:52:05.015587 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7c4695d222b84104999cd5793122458a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947f6e33004d49cdb05fe27674f9eea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:52:05.178175 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-26b7ed5a-1411-4412-ba05-be205ea31296 req-718dc198-d391-45aa-a2a1-5c35675e0219 service nova] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Received event network-vif-plugged-b9924df6-f6a0-4dc6-a309-04713d02e8e2 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:05.178619 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-26b7ed5a-1411-4412-ba05-be205ea31296 req-718dc198-d391-45aa-a2a1-5c35675e0219 service nova] Acquiring lock "a4e5fc7a-978f-407f-9faf-7ec539b55e0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:05.178619 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-26b7ed5a-1411-4412-ba05-be205ea31296 req-718dc198-d391-45aa-a2a1-5c35675e0219 service nova] Lock "a4e5fc7a-978f-407f-9faf-7ec539b55e0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:05.178795 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-26b7ed5a-1411-4412-ba05-be205ea31296 req-718dc198-d391-45aa-a2a1-5c35675e0219 service nova] Lock "a4e5fc7a-978f-407f-9faf-7ec539b55e0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:05.178961 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-26b7ed5a-1411-4412-ba05-be205ea31296 req-718dc198-d391-45aa-a2a1-5c35675e0219 service nova] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Processing event network-vif-plugged-b9924df6-f6a0-4dc6-a309-04713d02e8e2 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:52:05.179237 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-26b7ed5a-1411-4412-ba05-be205ea31296 req-718dc198-d391-45aa-a2a1-5c35675e0219 service nova] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Received event network-vif-plugged-b9924df6-f6a0-4dc6-a309-04713d02e8e2 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:05.179363 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-26b7ed5a-1411-4412-ba05-be205ea31296 req-718dc198-d391-45aa-a2a1-5c35675e0219 service nova] Acquiring lock "a4e5fc7a-978f-407f-9faf-7ec539b55e0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:05.179530 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-26b7ed5a-1411-4412-ba05-be205ea31296 req-718dc198-d391-45aa-a2a1-5c35675e0219 service nova] Lock "a4e5fc7a-978f-407f-9faf-7ec539b55e0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:05.180060 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:52:05.180231 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-26b7ed5a-1411-4412-ba05-be205ea31296 req-718dc198-d391-45aa-a2a1-5c35675e0219 service nova] Lock "a4e5fc7a-978f-407f-9faf-7ec539b55e0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:05.180425 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-26b7ed5a-1411-4412-ba05-be205ea31296 req-718dc198-d391-45aa-a2a1-5c35675e0219 service nova] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] No waiting events found dispatching network-vif-plugged-b9924df6-f6a0-4dc6-a309-04713d02e8e2 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:52:05.180554 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-26b7ed5a-1411-4412-ba05-be205ea31296 req-718dc198-d391-45aa-a2a1-5c35675e0219 service nova] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Received unexpected event network-vif-plugged-b9924df6-f6a0-4dc6-a309-04713d02e8e2 for instance with vm_state building and task_state spawning.
May 28 01:52:05.182425 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:52:05.186029 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Instance spawned successfully.
May 28 01:52:05.186339 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:52:05.189058 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:52:05.189058 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:52:05.189058 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:52:05.189345 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:52:05.219923 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:52:05.223351 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:52:05.306910 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Lazy-loading 'flavor' on Instance uuid bfb723e1-a6b7-460b-b115-62d1f2922066 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:52:05.432983 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:52:05.444776 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-55f5b5b9-7f7f-467b-8506-7096159e755f req-81700702-4362-460c-a9bd-d42e50e988e8 service nova] Releasing lock "refresh_cache-f342ed55-ce60-405b-bc09-856eced24bf7" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:52:05.445272 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Acquired lock "refresh_cache-f342ed55-ce60-405b-bc09-856eced24bf7" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:52:05.445490 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:52:05.486250 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Successfully created port: ba06c38a-7287-4a4b-b2d9-015659e538a0 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:52:05.694684 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Took 7.70 seconds to spawn the instance on the hypervisor.
May 28 01:52:05.694878 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:52:05.726411 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:52:05.726411 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933125.7259758, a4e5fc7a-978f-407f-9faf-7ec539b55e0e => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:52:05.727585 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] VM Paused (Lifecycle Event)
May 28 01:52:05.884028 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:52:05.884245 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:52:05.936818 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:52:06.025206 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:52:06.060150 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Successfully updated port: ba06c38a-7287-4a4b-b2d9-015659e538a0 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:52:06.088266 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:52:06.088266 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:52:06.088266 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] No VIF found with MAC fa:16:3e:f4:4b:8c, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:52:06.088456 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] [instance: 02b42340-8535-4682-98db-49f970ff5597] Using config drive
May 28 01:52:06.110857 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-14e3abce-3fb4-4c22-80e0-bfeb701ec460 req-945f697d-9f00-4ebb-b144-3e8520fc42e4 service nova] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Received event network-changed-ba06c38a-7287-4a4b-b2d9-015659e538a0 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:06.113164 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-14e3abce-3fb4-4c22-80e0-bfeb701ec460 req-945f697d-9f00-4ebb-b144-3e8520fc42e4 service nova] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Refreshing instance network info cache due to event network-changed-ba06c38a-7287-4a4b-b2d9-015659e538a0. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:52:06.113164 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-14e3abce-3fb4-4c22-80e0-bfeb701ec460 req-945f697d-9f00-4ebb-b144-3e8520fc42e4 service nova] Acquiring lock "refresh_cache-1291c6e1-108e-46d1-85bc-0197f71eec1f" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:52:06.113164 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-14e3abce-3fb4-4c22-80e0-bfeb701ec460 req-945f697d-9f00-4ebb-b144-3e8520fc42e4 service nova] Acquired lock "refresh_cache-1291c6e1-108e-46d1-85bc-0197f71eec1f" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:52:06.114385 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-14e3abce-3fb4-4c22-80e0-bfeb701ec460 req-945f697d-9f00-4ebb-b144-3e8520fc42e4 service nova] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Refreshing network info cache for port ba06c38a-7287-4a4b-b2d9-015659e538a0 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:52:06.207699 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Took 12.98 seconds to build instance.
May 28 01:52:06.232992 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:52:06.235012 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933126.234669, a4e5fc7a-978f-407f-9faf-7ec539b55e0e => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:52:06.235124 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] VM Resumed (Lifecycle Event)
May 28 01:52:06.312693 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Lock "bfb723e1-a6b7-460b-b115-62d1f2922066" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.513s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:06.369490 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:06.386925 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:52:06.562201 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Acquiring lock "refresh_cache-1291c6e1-108e-46d1-85bc-0197f71eec1f" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:52:06.593528 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:06.616366 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-14e3abce-3fb4-4c22-80e0-bfeb701ec460 req-945f697d-9f00-4ebb-b144-3e8520fc42e4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:06.712881 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0046ead9-3219-4c17-89a5-64ed49bf129f tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Lock "a4e5fc7a-978f-407f-9faf-7ec539b55e0e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.490s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:06.738550 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:52:06.741787 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:52:06.893841 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.469s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:06.894268 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:52:06.897389 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.748s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:06.903915 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:52:06.904148 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Claim successful on node np0000001583
May 28 01:52:06.910273 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-14e3abce-3fb4-4c22-80e0-bfeb701ec460 req-945f697d-9f00-4ebb-b144-3e8520fc42e4 service nova] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:52:06.947685 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:52:06.947685 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:52:06.947685 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Creating image(s)
May 28 01:52:06.950011 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Acquiring lock "/opt/stack/data/nova/instances/1291c6e1-108e-46d1-85bc-0197f71eec1f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:06.951913 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "/opt/stack/data/nova/instances/1291c6e1-108e-46d1-85bc-0197f71eec1f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:06.951913 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "/opt/stack/data/nova/instances/1291c6e1-108e-46d1-85bc-0197f71eec1f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:06.952045 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:52:06.957867 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:52:06.961203 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:52:07.037587 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.075s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:52:07.038760 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:07.039183 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:07.039560 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:52:07.045052 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Updating instance_info_cache with network_info: [{"id": "00a0837b-bced-48a4-84d6-8ba3fa1cccfc", "address": "fa:16:3e:d6:49:ea", "network": {"id": "429537a1-a364-4a80-a366-c295d81735e4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1730022347-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "745d9bd220de4beaab6c7561af376ae3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00a0837b-bc", "ovs_interfaceid": "00a0837b-bced-48a4-84d6-8ba3fa1cccfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:52:07.048740 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:52:07.048964 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:52:07.106026 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] [instance: 02b42340-8535-4682-98db-49f970ff5597] Creating config drive at /opt/stack/data/nova/instances/02b42340-8535-4682-98db-49f970ff5597/disk.config
May 28 01:52:07.112679 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/02b42340-8535-4682-98db-49f970ff5597/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpk8jxvbrk {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:52:07.130848 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.080s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:52:07.131638 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/1291c6e1-108e-46d1-85bc-0197f71eec1f/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:52:07.157299 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/02b42340-8535-4682-98db-49f970ff5597/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpk8jxvbrk" returned: 0 in 0.044s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:52:07.173730 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/1291c6e1-108e-46d1-85bc-0197f71eec1f/disk 1073741824" returned: 0 in 0.042s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:52:07.174976 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.136s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:07.175287 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:52:07.237036 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-14e3abce-3fb4-4c22-80e0-bfeb701ec460 req-945f697d-9f00-4ebb-b144-3e8520fc42e4 service nova] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:52:07.253783 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.078s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:52:07.254187 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1291c6e1-108e-46d1-85bc-0197f71eec1f/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:52:07.254478 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1291c6e1-108e-46d1-85bc-0197f71eec1f/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:52:07.326525 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1291c6e1-108e-46d1-85bc-0197f71eec1f/disk --force-share --output=json" returned: 0 in 0.071s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:52:07.327511 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Cannot resize image /opt/stack/data/nova/instances/1291c6e1-108e-46d1-85bc-0197f71eec1f/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:52:07.327585 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:52:07.328031 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Ensure instance console log exists: /opt/stack/data/nova/instances/1291c6e1-108e-46d1-85bc-0197f71eec1f/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:52:07.328838 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:07.328838 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:07.328838 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:07.404434 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:52:07.404434 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:52:07.404800 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:07.405050 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:07.555829 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Releasing lock "refresh_cache-f342ed55-ce60-405b-bc09-856eced24bf7" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:52:07.560264 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Instance network_info: |[{"id": "00a0837b-bced-48a4-84d6-8ba3fa1cccfc", "address": "fa:16:3e:d6:49:ea", "network": {"id": "429537a1-a364-4a80-a366-c295d81735e4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1730022347-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "745d9bd220de4beaab6c7561af376ae3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00a0837b-bc", "ovs_interfaceid": "00a0837b-bced-48a4-84d6-8ba3fa1cccfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:52:07.562954 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Start _get_guest_xml network_info=[{"id": "00a0837b-bced-48a4-84d6-8ba3fa1cccfc", "address": "fa:16:3e:d6:49:ea", "network": {"id": "429537a1-a364-4a80-a366-c295d81735e4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1730022347-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "745d9bd220de4beaab6c7561af376ae3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00a0837b-bc", "ovs_interfaceid": "00a0837b-bced-48a4-84d6-8ba3fa1cccfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:52:07.565685 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:52:07.567243 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-VolumesAdminNegativeTest-server-1088022252', uuid='f342ed55-ce60-405b-bc09-856eced24bf7'), owner=OwnerMeta(userid='8608d299c7e641c2a403907cb4674347', username='tempest-VolumesAdminNegativeTest-1603446702-project-member', projectid='745d9bd220de4beaab6c7561af376ae3', projectname='tempest-VolumesAdminNegativeTest-1603446702'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "00a0837b-bced-48a4-84d6-8ba3fa1cccfc", "address": "fa:16:3e:d6:49:ea", "network": {"id": "429537a1-a364-4a80-a366-c295d81735e4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1730022347-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "745d9bd220de4beaab6c7561af376ae3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00a0837b-bc", "ovs_interfaceid": "00a0837b-bced-48a4-84d6-8ba3fa1cccfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933127.5668137) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:52:07.570289 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:52:07.570871 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:52:07.571783 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:52:07.572025 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:52:07.573205 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:52:07.573797 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:52:07.574056 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:52:07.574380 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:52:07.574425 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:52:07.574584 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:52:07.574743 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:52:07.574977 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:52:07.575136 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:52:07.575341 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:52:07.575604 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:52:07.575802 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:52:07.602653 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:51:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1088022252',display_name='tempest-VolumesAdminNegativeTest-server-1088022252',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-volumesadminnegativetest-server-1088022252',id=4,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='745d9bd220de4beaab6c7561af376ae3',ramdisk_id='',reservation_id='r-d1widkbt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1603446702',owner_user_name='tempest-VolumesAdminNegativeTest-1603446702-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:52:03Z,user_data=None,user_id='8608d299c7e641c2a403907cb4674347',uuid=f342ed55-ce60-405b-bc09-856eced24bf7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00a0837b-bced-48a4-84d6-8ba3fa1cccfc", "address": "fa:16:3e:d6:49:ea", "network": {"id": "429537a1-a364-4a80-a366-c295d81735e4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1730022347-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "745d9bd220de4beaab6c7561af376ae3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00a0837b-bc", "ovs_interfaceid": "00a0837b-bced-48a4-84d6-8ba3fa1cccfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:52:07.603595 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Converting VIF {"id": "00a0837b-bced-48a4-84d6-8ba3fa1cccfc", "address": "fa:16:3e:d6:49:ea", "network": {"id": "429537a1-a364-4a80-a366-c295d81735e4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1730022347-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "745d9bd220de4beaab6c7561af376ae3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00a0837b-bc", "ovs_interfaceid": "00a0837b-bced-48a4-84d6-8ba3fa1cccfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:52:07.604229 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:49:ea,bridge_name='br-int',has_traffic_filtering=True,id=00a0837b-bced-48a4-84d6-8ba3fa1cccfc,network=Network(429537a1-a364-4a80-a366-c295d81735e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00a0837b-bc') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:52:07.605875 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Lazy-loading 'pci_devices' on Instance uuid f342ed55-ce60-405b-bc09-856eced24bf7 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:52:07.610259 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7c4695d222b84104999cd5793122458a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947f6e33004d49cdb05fe27674f9eea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:52:07.640822 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:07.664503 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:07.739912 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-14e3abce-3fb4-4c22-80e0-bfeb701ec460 req-945f697d-9f00-4ebb-b144-3e8520fc42e4 service nova] Releasing lock "refresh_cache-1291c6e1-108e-46d1-85bc-0197f71eec1f" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:52:07.740547 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Acquired lock "refresh_cache-1291c6e1-108e-46d1-85bc-0197f71eec1f" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:52:07.740784 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:52:07.755343 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:07.763296 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:07.770324 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:07.842579 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Acquiring lock "bfb723e1-a6b7-460b-b115-62d1f2922066" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:07.842781 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Lock "bfb723e1-a6b7-460b-b115-62d1f2922066" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:07.843002 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Attaching volume 9f02787a-4f69-4834-af37-6cec9394f4ea to /dev/vdb
May 28 01:52:07.909844 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:52:07.926068 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:52:07.926509 np0000001583 nova-compute[98241]: INFO oslo.privsep.daemon [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpfgu3kd7l/privsep.sock']
May 28 01:52:07.941175 np0000001583 sudo[110423]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpfgu3kd7l/privsep.sock
May 28 01:52:07.942767 np0000001583 sudo[110423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002)
May 28 01:52:08.065308 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:08.069928 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:08.078287 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:08.097938 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:08.114988 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] End _get_guest_xml xml=<domain type="qemu">
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:   <uuid>f342ed55-ce60-405b-bc09-856eced24bf7</uuid>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:   <name>instance-00000004</name>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1088022252</nova:name>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:52:07</nova:creationTime>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:         <nova:user uuid="8608d299c7e641c2a403907cb4674347">tempest-VolumesAdminNegativeTest-1603446702-project-member</nova:user>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:         <nova:project uuid="745d9bd220de4beaab6c7561af376ae3">tempest-VolumesAdminNegativeTest-1603446702</nova:project>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:         <nova:port uuid="00a0837b-bced-48a4-84d6-8ba3fa1cccfc">
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:     <system>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:       <entry name="serial">f342ed55-ce60-405b-bc09-856eced24bf7</entry>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:       <entry name="uuid">f342ed55-ce60-405b-bc09-856eced24bf7</entry>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:     </system>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:   <os>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:   </os>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:   <features>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:   </features>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:   <devices>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/f342ed55-ce60-405b-bc09-856eced24bf7/disk"/>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:     </disk>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/f342ed55-ce60-405b-bc09-856eced24bf7/disk.config"/>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:     </disk>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:d6:49:ea"/>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:       <target dev="tap00a0837b-bc"/>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:     </interface>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/f342ed55-ce60-405b-bc09-856eced24bf7/console.log" append="off"/>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:     </serial>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:     <video>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:     </video>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:     </rng>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:   </devices>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]: </domain>
May 28 01:52:08.114988 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:52:08.118220 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Preparing to wait for external event network-vif-plugged-00a0837b-bced-48a4-84d6-8ba3fa1cccfc {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:52:08.118414 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Acquiring lock "f342ed55-ce60-405b-bc09-856eced24bf7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:08.118616 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Lock "f342ed55-ce60-405b-bc09-856eced24bf7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:08.118794 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Lock "f342ed55-ce60-405b-bc09-856eced24bf7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:08.119871 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:51:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1088022252',display_name='tempest-VolumesAdminNegativeTest-server-1088022252',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-volumesadminnegativetest-server-1088022252',id=4,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='745d9bd220de4beaab6c7561af376ae3',ramdisk_id='',reservation_id='r-d1widkbt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1603446702',owner_user_name='tempest-VolumesAdminNegativeTest-1603446702-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:52:03Z,user_data=None,user_id='8608d299c7e641c2a403907cb4674347',uuid=f342ed55-ce60-405b-bc09-856eced24bf7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00a0837b-bced-48a4-84d6-8ba3fa1cccfc", "address": "fa:16:3e:d6:49:ea", "network": {"id": "429537a1-a364-4a80-a366-c295d81735e4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1730022347-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "745d9bd220de4beaab6c7561af376ae3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00a0837b-bc", "ovs_interfaceid": "00a0837b-bced-48a4-84d6-8ba3fa1cccfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:52:08.120211 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Converting VIF {"id": "00a0837b-bced-48a4-84d6-8ba3fa1cccfc", "address": "fa:16:3e:d6:49:ea", "network": {"id": "429537a1-a364-4a80-a366-c295d81735e4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1730022347-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "745d9bd220de4beaab6c7561af376ae3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00a0837b-bc", "ovs_interfaceid": "00a0837b-bced-48a4-84d6-8ba3fa1cccfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:52:08.120974 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:49:ea,bridge_name='br-int',has_traffic_filtering=True,id=00a0837b-bced-48a4-84d6-8ba3fa1cccfc,network=Network(429537a1-a364-4a80-a366-c295d81735e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00a0837b-bc') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:52:08.121390 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:49:ea,bridge_name='br-int',has_traffic_filtering=True,id=00a0837b-bced-48a4-84d6-8ba3fa1cccfc,network=Network(429537a1-a364-4a80-a366-c295d81735e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00a0837b-bc') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:52:08.121981 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:08.122933 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:08.123164 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:52:08.129181 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:08.129410 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fbcdc67a-80b9-5af5-8a62-bfe7547574c3', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:08.133023 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:52:08.139068 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:08.139351 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap00a0837b-bc, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:08.141351 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap00a0837b-bc, col_values=(('qos', UUID('880c91da-feb5-43b3-a940-5f89b453acf5')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:08.141446 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap00a0837b-bc, col_values=(('external_ids', {'iface-id': '00a0837b-bced-48a4-84d6-8ba3fa1cccfc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:49:ea', 'vm-uuid': 'f342ed55-ce60-405b-bc09-856eced24bf7'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:08.144064 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:08.144463 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:52:08.150566 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:08.151243 np0000001583 nova-compute[98241]: INFO os_vif [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:49:ea,bridge_name='br-int',has_traffic_filtering=True,id=00a0837b-bced-48a4-84d6-8ba3fa1cccfc,network=Network(429537a1-a364-4a80-a366-c295d81735e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00a0837b-bc')
May 28 01:52:08.191146 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-407ba896-e9d6-4e41-ae7b-47a0114e2075 req-23d48d5d-db84-4357-9d1c-e483c11d678e service nova] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Received event network-changed-b9924df6-f6a0-4dc6-a309-04713d02e8e2 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:08.194221 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-407ba896-e9d6-4e41-ae7b-47a0114e2075 req-23d48d5d-db84-4357-9d1c-e483c11d678e service nova] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Refreshing instance network info cache due to event network-changed-b9924df6-f6a0-4dc6-a309-04713d02e8e2. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:52:08.194431 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-407ba896-e9d6-4e41-ae7b-47a0114e2075 req-23d48d5d-db84-4357-9d1c-e483c11d678e service nova] Acquiring lock "refresh_cache-a4e5fc7a-978f-407f-9faf-7ec539b55e0e" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:52:08.194534 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-407ba896-e9d6-4e41-ae7b-47a0114e2075 req-23d48d5d-db84-4357-9d1c-e483c11d678e service nova] Acquired lock "refresh_cache-a4e5fc7a-978f-407f-9faf-7ec539b55e0e" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:52:08.195151 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-407ba896-e9d6-4e41-ae7b-47a0114e2075 req-23d48d5d-db84-4357-9d1c-e483c11d678e service nova] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Refreshing network info cache for port b9924df6-f6a0-4dc6-a309-04713d02e8e2 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:52:08.209165 np0000001583 nova-compute[98241]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
May 28 01:52:08.209165 np0000001583 nova-compute[98241]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 28 01:52:08.209165 np0000001583 nova-compute[98241]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 28 01:52:08.209165 np0000001583 nova-compute[98241]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 01:52:08.209344 np0000001583 nova-compute[98241]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 28 01:52:08.209344 np0000001583 nova-compute[98241]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 28 01:52:08.209344 np0000001583 nova-compute[98241]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 28 01:52:08.209344 np0000001583 nova-compute[98241]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 01:52:08.209510 np0000001583 nova-compute[98241]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
May 28 01:52:08.335146 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:52:08.417924 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:52:08.485287 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:52:08.485552 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:52:08.567767 np0000001583 nova-compute[98241]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
May 28 01:52:08.567887 np0000001583 nova-compute[98241]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 28 01:52:08.567887 np0000001583 nova-compute[98241]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 28 01:52:08.567983 np0000001583 nova-compute[98241]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 01:52:08.568123 np0000001583 nova-compute[98241]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 28 01:52:08.568123 np0000001583 nova-compute[98241]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 28 01:52:08.568262 np0000001583 nova-compute[98241]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 28 01:52:08.568262 np0000001583 nova-compute[98241]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 01:52:08.568373 np0000001583 nova-compute[98241]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
May 28 01:52:08.585849 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:08.690217 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933128.6898763, 02b42340-8535-4682-98db-49f970ff5597 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:52:08.690380 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 02b42340-8535-4682-98db-49f970ff5597] VM Started (Lifecycle Event)
May 28 01:52:08.696987 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-407ba896-e9d6-4e41-ae7b-47a0114e2075 req-23d48d5d-db84-4357-9d1c-e483c11d678e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:08.756419 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Updating instance_info_cache with network_info: [{"id": "ba06c38a-7287-4a4b-b2d9-015659e538a0", "address": "fa:16:3e:45:c5:fe", "network": {"id": "1a3cc53e-d09d-45ba-a64b-48bf74dd1680", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-582528653-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "947f6e33004d49cdb05fe27674f9eea8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba06c38a-72", "ovs_interfaceid": "ba06c38a-7287-4a4b-b2d9-015659e538a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:52:08.817012 np0000001583 sudo[110423]: pam_unix(sudo:session): session closed for user root
May 28 01:52:08.819291 np0000001583 nova-compute[98241]: INFO oslo.privsep.daemon [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Spawned new privsep daemon via rootwrap
May 28 01:52:08.833611 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Successfully created port: 62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:52:08.897465 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:52:08.897842 np0000001583 nova-compute[98241]: WARNING os_brick.initiator.connectors.nvmeof [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
May 28 01:52:08.924065 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:52:08.951735 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:52:08.952012 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:52:08.963124 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:52:08.964061 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:febd:1211', 'fe80::68de:aaff:fea6:1b7e', 'fe80::fc16:3eff:fe22:2182', 'fe80::384c:7dff:fea8:707f', 'fe80::fc16:3eff:fef4:4b8c', 'fe80::e02a:5fff:fe52:f5a1'] 
May 28 01:52:08.964220 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:52:08.964321 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:52:08.964590 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] <== get_connector_properties: return (1038ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:52:08.964725 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Updating existing volume attachment record: c2c4ab98-45f8-4ce6-87ae-8b3b5368900e {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:52:08.989004 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:52:09.100556 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-407ba896-e9d6-4e41-ae7b-47a0114e2075 req-23d48d5d-db84-4357-9d1c-e483c11d678e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:09.192931 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 02b42340-8535-4682-98db-49f970ff5597] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:52:09.194282 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933129.194056, 02b42340-8535-4682-98db-49f970ff5597 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:52:09.194450 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 02b42340-8535-4682-98db-49f970ff5597] VM Paused (Lifecycle Event)
May 28 01:52:09.259659 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Releasing lock "refresh_cache-1291c6e1-108e-46d1-85bc-0197f71eec1f" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:52:09.259976 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Instance network_info: |[{"id": "ba06c38a-7287-4a4b-b2d9-015659e538a0", "address": "fa:16:3e:45:c5:fe", "network": {"id": "1a3cc53e-d09d-45ba-a64b-48bf74dd1680", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-582528653-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "947f6e33004d49cdb05fe27674f9eea8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba06c38a-72", "ovs_interfaceid": "ba06c38a-7287-4a4b-b2d9-015659e538a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:52:09.263245 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Start _get_guest_xml network_info=[{"id": "ba06c38a-7287-4a4b-b2d9-015659e538a0", "address": "fa:16:3e:45:c5:fe", "network": {"id": "1a3cc53e-d09d-45ba-a64b-48bf74dd1680", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-582528653-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "947f6e33004d49cdb05fe27674f9eea8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba06c38a-72", "ovs_interfaceid": "ba06c38a-7287-4a4b-b2d9-015659e538a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:52:09.269207 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-407ba896-e9d6-4e41-ae7b-47a0114e2075 req-23d48d5d-db84-4357-9d1c-e483c11d678e service nova] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Updated VIF entry in instance network info cache for port b9924df6-f6a0-4dc6-a309-04713d02e8e2. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:52:09.269660 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-407ba896-e9d6-4e41-ae7b-47a0114e2075 req-23d48d5d-db84-4357-9d1c-e483c11d678e service nova] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Updating instance_info_cache with network_info: [{"id": "b9924df6-f6a0-4dc6-a309-04713d02e8e2", "address": "fa:16:3e:22:21:82", "network": {"id": "4524b467-4e05-4f3e-8b60-9d1df8eeab06", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1571320637-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b525e2c2d9a9421da5a3eeb5af5958f7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9924df6-f6", "ovs_interfaceid": "b9924df6-f6a0-4dc6-a309-04713d02e8e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:52:09.273949 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:52:09.275107 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-TestMultiAttachVolumeSwap-server-1270524779-1', uuid='1291c6e1-108e-46d1-85bc-0197f71eec1f'), owner=OwnerMeta(userid='7c4695d222b84104999cd5793122458a', username='tempest-TestMultiAttachVolumeSwap-2109764512-project-member', projectid='947f6e33004d49cdb05fe27674f9eea8', projectname='tempest-TestMultiAttachVolumeSwap-2109764512'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ba06c38a-7287-4a4b-b2d9-015659e538a0", "address": "fa:16:3e:45:c5:fe", "network": {"id": "1a3cc53e-d09d-45ba-a64b-48bf74dd1680", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-582528653-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "947f6e33004d49cdb05fe27674f9eea8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba06c38a-72", "ovs_interfaceid": "ba06c38a-7287-4a4b-b2d9-015659e538a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933129.2747772) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:52:09.277727 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:52:09.277727 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:52:09.281490 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:52:09.281490 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:52:09.281490 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:52:09.281490 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:52:09.281490 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:52:09.281490 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:52:09.281490 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:52:09.281490 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:52:09.281490 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:52:09.281490 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:52:09.281490 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:52:09.281490 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:52:09.281490 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:52:09.282130 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:52:09.296570 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:51:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1270524779-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testmultiattachvolumeswap-server-1270524779-1',id=5,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9T0jFy877GDUIXf8XLwKi1a8geNpNqHXybbcwc8hk9OWvDAevATdpbJCrejEqP1SYlxqf+1qQGfUGM9hrgOtGGbFh3nMI3KqgwiYl59qZQV/o6QSLmhZ8QN57QO0pJzA==',key_name='tempest-keypair-2135479035',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='947f6e33004d49cdb05fe27674f9eea8',ramdisk_id='',reservation_id='r-uv6dleay',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-2109764512',owner_user_name='tempest-TestMultiAttachVolumeSwap-2109764512-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:52:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c4695d222b84104999cd5793122458a',uuid=1291c6e1-108e-46d1-85bc-0197f71eec1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba06c38a-7287-4a4b-b2d9-015659e538a0", "address": "fa:16:3e:45:c5:fe", "network": {"id": "1a3cc53e-d09d-45ba-a64b-48bf74dd1680", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-582528653-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "947f6e33004d49cdb05fe27674f9eea8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba06c38a-72", "ovs_interfaceid": "ba06c38a-7287-4a4b-b2d9-015659e538a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:52:09.296994 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Converting VIF {"id": "ba06c38a-7287-4a4b-b2d9-015659e538a0", "address": "fa:16:3e:45:c5:fe", "network": {"id": "1a3cc53e-d09d-45ba-a64b-48bf74dd1680", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-582528653-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "947f6e33004d49cdb05fe27674f9eea8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba06c38a-72", "ovs_interfaceid": "ba06c38a-7287-4a4b-b2d9-015659e538a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:52:09.298983 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:c5:fe,bridge_name='br-int',has_traffic_filtering=True,id=ba06c38a-7287-4a4b-b2d9-015659e538a0,network=Network(1a3cc53e-d09d-45ba-a64b-48bf74dd1680),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba06c38a-72') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:52:09.301212 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lazy-loading 'pci_devices' on Instance uuid 1291c6e1-108e-46d1-85bc-0197f71eec1f {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:52:09.452509 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:52:09.453591 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:52:09.453873 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Creating image(s)
May 28 01:52:09.454778 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Acquiring lock "/opt/stack/data/nova/instances/bad69594-f163-41a6-931f-d2fcda0cb7d1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:09.454778 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "/opt/stack/data/nova/instances/bad69594-f163-41a6-931f-d2fcda0cb7d1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:09.455453 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "/opt/stack/data/nova/instances/bad69594-f163-41a6-931f-d2fcda0cb7d1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:09.456230 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:52:09.459517 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:52:09.460530 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:52:09.500477 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.600s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:09.500823 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:52:09.538665 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.078s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:52:09.539308 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:09.539830 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:09.540014 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:52:09.542924 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:52:09.543316 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:52:09.555964 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:09.556305 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:09.560489 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connector [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Factory for ISCSI on None {{(pid=98241) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}}
May 28 01:52:09.560974 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:09.561046 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:52:09.561491 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea', 'iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9f02787a-4f69-4834-af37-6cec9394f4ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:52:09.561743 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:52:09.562325 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:52:09.563571 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea', 'iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9f02787a-4f69-4834-af37-6cec9394f4ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:52:09.577639 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:52:09.579519 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:52:09.580869 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:52:09.580869 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:52:09.581598 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:52:09.581598 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:52:09.593776 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:52:09.593776 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:09.602478 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:52:09.602478 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:09.609128 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea] added
May 28 01:52:09.609128 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:52:09.609128 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:52:09.609128 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:52:09.609128 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:52:09.609128 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:52:09.609128 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:09.609581 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:52:09.609581 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0288(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:52:09.609712 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:52:09.612895 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea] added
May 28 01:52:09.612895 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:52:09.612895 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:52:09.612895 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:52:09.612895 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:52:09.612895 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:52:09.612895 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:09.612895 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:52:09.613259 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0316(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:52:09.613660 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.070s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:52:09.613660 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:52:09.614092 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/bad69594-f163-41a6-931f-d2fcda0cb7d1/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:52:09.645669 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/bad69594-f163-41a6-931f-d2fcda0cb7d1/disk 1073741824" returned: 0 in 0.031s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:52:09.646089 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.107s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:09.646413 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:52:09.676872 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:52:09.677521 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:52:09.677521 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] No VIF found with MAC fa:16:3e:d6:49:ea, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:52:09.677702 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Using config drive
May 28 01:52:09.699168 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 02b42340-8535-4682-98db-49f970ff5597] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:52:09.701595 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 02b42340-8535-4682-98db-49f970ff5597] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:52:09.733818 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.087s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:52:09.734261 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bad69594-f163-41a6-931f-d2fcda0cb7d1/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:52:09.734951 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad69594-f163-41a6-931f-d2fcda0cb7d1/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:52:09.762640 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Successfully updated port: 62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:52:09.774871 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-407ba896-e9d6-4e41-ae7b-47a0114e2075 req-23d48d5d-db84-4357-9d1c-e483c11d678e service nova] Releasing lock "refresh_cache-a4e5fc7a-978f-407f-9faf-7ec539b55e0e" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:52:09.800976 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad69594-f163-41a6-931f-d2fcda0cb7d1/disk --force-share --output=json" returned: 0 in 0.066s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:52:09.801384 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Cannot resize image /opt/stack/data/nova/instances/bad69594-f163-41a6-931f-d2fcda0cb7d1/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:52:09.801769 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:52:09.801961 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Ensure instance console log exists: /opt/stack/data/nova/instances/bad69594-f163-41a6-931f-d2fcda0cb7d1/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:52:09.802297 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:09.802564 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:09.802725 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:09.804511 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] End _get_guest_xml xml=<domain type="qemu">
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:   <uuid>1291c6e1-108e-46d1-85bc-0197f71eec1f</uuid>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:   <name>instance-00000005</name>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:       <nova:name>tempest-TestMultiAttachVolumeSwap-server-1270524779-1</nova:name>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:52:09</nova:creationTime>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:         <nova:user uuid="7c4695d222b84104999cd5793122458a">tempest-TestMultiAttachVolumeSwap-2109764512-project-member</nova:user>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:         <nova:project uuid="947f6e33004d49cdb05fe27674f9eea8">tempest-TestMultiAttachVolumeSwap-2109764512</nova:project>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:         <nova:port uuid="ba06c38a-7287-4a4b-b2d9-015659e538a0">
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:     <system>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:       <entry name="serial">1291c6e1-108e-46d1-85bc-0197f71eec1f</entry>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:       <entry name="uuid">1291c6e1-108e-46d1-85bc-0197f71eec1f</entry>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:     </system>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:   <os>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:   </os>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:   <features>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:   </features>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:   <devices>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/1291c6e1-108e-46d1-85bc-0197f71eec1f/disk"/>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:     </disk>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/1291c6e1-108e-46d1-85bc-0197f71eec1f/disk.config"/>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:     </disk>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:45:c5:fe"/>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:       <target dev="tapba06c38a-72"/>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:     </interface>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/1291c6e1-108e-46d1-85bc-0197f71eec1f/console.log" append="off"/>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:     </serial>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:     <video>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:     </video>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:     </rng>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:   </devices>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]: </domain>
May 28 01:52:09.804511 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:52:09.806631 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Preparing to wait for external event network-vif-plugged-ba06c38a-7287-4a4b-b2d9-015659e538a0 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:52:09.806631 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Acquiring lock "1291c6e1-108e-46d1-85bc-0197f71eec1f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:09.806631 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "1291c6e1-108e-46d1-85bc-0197f71eec1f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:09.806631 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "1291c6e1-108e-46d1-85bc-0197f71eec1f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:09.806631 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:51:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1270524779-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testmultiattachvolumeswap-server-1270524779-1',id=5,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9T0jFy877GDUIXf8XLwKi1a8geNpNqHXybbcwc8hk9OWvDAevATdpbJCrejEqP1SYlxqf+1qQGfUGM9hrgOtGGbFh3nMI3KqgwiYl59qZQV/o6QSLmhZ8QN57QO0pJzA==',key_name='tempest-keypair-2135479035',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='947f6e33004d49cdb05fe27674f9eea8',ramdisk_id='',reservation_id='r-uv6dleay',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-2109764512',owner_user_name='tempest-TestMultiAttachVolumeSwap-2109764512-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:52:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c4695d222b84104999cd5793122458a',uuid=1291c6e1-108e-46d1-85bc-0197f71eec1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba06c38a-7287-4a4b-b2d9-015659e538a0", "address": "fa:16:3e:45:c5:fe", "network": {"id": "1a3cc53e-d09d-45ba-a64b-48bf74dd1680", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-582528653-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "947f6e33004d49cdb05fe27674f9eea8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba06c38a-72", "ovs_interfaceid": "ba06c38a-7287-4a4b-b2d9-015659e538a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:52:09.806854 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Converting VIF {"id": "ba06c38a-7287-4a4b-b2d9-015659e538a0", "address": "fa:16:3e:45:c5:fe", "network": {"id": "1a3cc53e-d09d-45ba-a64b-48bf74dd1680", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-582528653-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "947f6e33004d49cdb05fe27674f9eea8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba06c38a-72", "ovs_interfaceid": "ba06c38a-7287-4a4b-b2d9-015659e538a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:52:09.808096 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:c5:fe,bridge_name='br-int',has_traffic_filtering=True,id=ba06c38a-7287-4a4b-b2d9-015659e538a0,network=Network(1a3cc53e-d09d-45ba-a64b-48bf74dd1680),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba06c38a-72') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:52:09.808096 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:c5:fe,bridge_name='br-int',has_traffic_filtering=True,id=ba06c38a-7287-4a4b-b2d9-015659e538a0,network=Network(1a3cc53e-d09d-45ba-a64b-48bf74dd1680),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba06c38a-72') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:52:09.808096 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:09.808599 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:09.808889 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:52:09.811186 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:09.811383 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c7691fa6-a4ac-5837-a99d-b0e8be5e4560', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:09.812094 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:09.812760 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:52:09.819565 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:09.822784 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:09.822984 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba06c38a-72, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:09.823466 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapba06c38a-72, col_values=(('qos', UUID('effa126e-be10-4afb-9524-a0b3e3012c4b')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:09.827273 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapba06c38a-72, col_values=(('external_ids', {'iface-id': 'ba06c38a-7287-4a4b-b2d9-015659e538a0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:c5:fe', 'vm-uuid': '1291c6e1-108e-46d1-85bc-0197f71eec1f'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:09.828956 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:09.830068 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:52:09.837826 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:09.838835 np0000001583 nova-compute[98241]: INFO os_vif [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:c5:fe,bridge_name='br-int',has_traffic_filtering=True,id=ba06c38a-7287-4a4b-b2d9-015659e538a0,network=Network(1a3cc53e-d09d-45ba-a64b-48bf74dd1680),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba06c38a-72')
May 28 01:52:09.845439 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d5da44e8-8f81-4544-89ba-a40d17e61a95 req-f61e6f94-59c6-4dd2-9205-7fc4d4a9ea3d service nova] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Received event network-changed-62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:09.847928 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d5da44e8-8f81-4544-89ba-a40d17e61a95 req-f61e6f94-59c6-4dd2-9205-7fc4d4a9ea3d service nova] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Refreshing instance network info cache due to event network-changed-62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:52:09.847928 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d5da44e8-8f81-4544-89ba-a40d17e61a95 req-f61e6f94-59c6-4dd2-9205-7fc4d4a9ea3d service nova] Acquiring lock "refresh_cache-bad69594-f163-41a6-931f-d2fcda0cb7d1" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:52:09.847928 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d5da44e8-8f81-4544-89ba-a40d17e61a95 req-f61e6f94-59c6-4dd2-9205-7fc4d4a9ea3d service nova] Acquired lock "refresh_cache-bad69594-f163-41a6-931f-d2fcda0cb7d1" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:52:09.847928 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-d5da44e8-8f81-4544-89ba-a40d17e61a95 req-f61e6f94-59c6-4dd2-9205-7fc4d4a9ea3d service nova] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Refreshing network info cache for port 62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:52:09.997130 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:10.013287 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:52:10.014581 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:52:10.015103 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:10.015433 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:10.190913 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:10.203764 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 02b42340-8535-4682-98db-49f970ff5597] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:52:10.260860 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd5369516340f4495b7f29ffd82dd9654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94701d7485c4c46adefaf3637f27990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:52:10.264796 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Acquiring lock "refresh_cache-bad69594-f163-41a6-931f-d2fcda0cb7d1" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:52:10.343160 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Creating config drive at /opt/stack/data/nova/instances/f342ed55-ce60-405b-bc09-856eced24bf7/disk.config
May 28 01:52:10.351106 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f342ed55-ce60-405b-bc09-856eced24bf7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzww80u12 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:52:10.363114 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-d5da44e8-8f81-4544-89ba-a40d17e61a95 req-f61e6f94-59c6-4dd2-9205-7fc4d4a9ea3d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:10.390934 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f342ed55-ce60-405b-bc09-856eced24bf7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzww80u12" returned: 0 in 0.042s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:52:10.460379 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-d5da44e8-8f81-4544-89ba-a40d17e61a95 req-f61e6f94-59c6-4dd2-9205-7fc4d4a9ea3d service nova] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:52:10.519095 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:52:10.610155 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:52:10.614882 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:52:10.621913 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:52:10.621913 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:52:10.631624 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:52:10.631624 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:10.638456 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:10.648007 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:10.657597 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 01:52:10.657597 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:52:10.657716 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 01:52:10.657716 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:52:10.657891 np0000001583 nova-compute[98241]: WARNING os_brick.initiator.connectors.iscsi [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 01:52:10.657891 np0000001583 nova-compute[98241]: 
May 28 01:52:10.665728 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 01:52:10.665728 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:52:10.665876 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 01:52:10.665876 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:52:10.665978 np0000001583 nova-compute[98241]: WARNING os_brick.initiator.connectors.iscsi [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 01:52:10.665978 np0000001583 nova-compute[98241]: 
May 28 01:52:10.686559 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-d5da44e8-8f81-4544-89ba-a40d17e61a95 req-f61e6f94-59c6-4dd2-9205-7fc4d4a9ea3d service nova] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:52:10.855156 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Successfully created port: 0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:52:10.899729 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:10.924171 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:11.032573 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:11.188665 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d5da44e8-8f81-4544-89ba-a40d17e61a95 req-f61e6f94-59c6-4dd2-9205-7fc4d4a9ea3d service nova] Releasing lock "refresh_cache-bad69594-f163-41a6-931f-d2fcda0cb7d1" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:52:11.189219 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Acquired lock "refresh_cache-bad69594-f163-41a6-931f-d2fcda0cb7d1" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:52:11.189409 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:52:11.211736 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:11.220461 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:11.246319 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:11.251568 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:11.361624 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Successfully created port: f5e93ea0-a679-45fb-9178-3842154f2e4d {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:52:11.382542 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:52:11.382542 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:52:11.382542 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] No VIF found with MAC fa:16:3e:45:c5:fe, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:52:11.382839 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Using config drive
May 28 01:52:11.700542 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea, portal: 192.168.40.100,3260]
May 28 01:52:11.700542 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea, portal: 192.168.40.100,3260] successful.
May 28 01:52:11.700542 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:11.707920 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea, portal: 192.168.50.100,3260]
May 28 01:52:11.707920 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea, portal: 192.168.50.100,3260] successful.
May 28 01:52:11.707920 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:11.714656 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:11.721910 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:11.730770 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea (non-flash)
May 28 01:52:11.730770 np0000001583 nova-compute[98241]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea (non-flash)
May 28 01:52:11.730770 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:52:11.730770 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea (non-flash)
May 28 01:52:11.730770 np0000001583 nova-compute[98241]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea (non-flash)
May 28 01:52:11.730770 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:52:11.733778 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.151s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:52:11.733778 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:52:11.733778 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] HCTL ('7', '-', '-', 0) found on session 3 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:52:11.733778 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:52:11.737129 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea (non-flash)
May 28 01:52:11.737129 np0000001583 nova-compute[98241]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea (non-flash)
May 28 01:52:11.737129 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:52:11.737262 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea (non-flash)
May 28 01:52:11.737262 np0000001583 nova-compute[98241]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea (non-flash)
May 28 01:52:11.737262 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:52:11.737596 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.156s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:52:11.737729 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:52:11.739161 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] HCTL ('8', '-', '-', 0) found on session 4 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:52:11.739161 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:52:11.763348 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Searching for a device in session 3 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:52:11.763348 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9f02787a-4f69-4834-af37-6cec9394f4ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:52:11.763348 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Searching for a device in session 4 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:52:11.763348 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9f02787a-4f69-4834-af37-6cec9394f4ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:52:11.770734 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933131.7702506, f342ed55-ce60-405b-bc09-856eced24bf7 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:52:11.770872 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] VM Started (Lifecycle Event)
May 28 01:52:11.786478 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Successfully created port: 91f6bd16-2cfa-44ca-a7ea-ef3ef4933092 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:52:11.804098 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:52:11.891130 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:12.003092 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:12.029696 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:52:12.047411 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Creating config drive at /opt/stack/data/nova/instances/1291c6e1-108e-46d1-85bc-0197f71eec1f/disk.config
May 28 01:52:12.052210 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1291c6e1-108e-46d1-85bc-0197f71eec1f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpsnhowgx6 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:52:12.100566 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1291c6e1-108e-46d1-85bc-0197f71eec1f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpsnhowgx6" returned: 0 in 0.048s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:52:12.158468 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Updating instance_info_cache with network_info: [{"id": "62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6", "address": "fa:16:3e:52:00:6a", "network": {"id": "1a3cc53e-d09d-45ba-a64b-48bf74dd1680", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-582528653-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "947f6e33004d49cdb05fe27674f9eea8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d17bf8-d7", "ovs_interfaceid": "62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:52:12.256889 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Successfully created port: 9e08628c-1ff2-4d4b-9f3d-50231fa6ceec {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:52:12.273175 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:52:12.274573 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933132.2743533, f342ed55-ce60-405b-bc09-856eced24bf7 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:52:12.274693 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] VM Paused (Lifecycle Event)
May 28 01:52:12.538125 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Booting with volume 5882db55-1e44-4bae-be6c-74bd366d0eb8 at /dev/vda
May 28 01:52:12.552034 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:12.571474 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:12.576702 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:12.583089 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:52:12.622851 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:52:12.636977 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:52:12.657537 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:12.661729 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:52:12.662247 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Releasing lock "refresh_cache-bad69594-f163-41a6-931f-d2fcda0cb7d1" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:52:12.663367 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Instance network_info: |[{"id": "62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6", "address": "fa:16:3e:52:00:6a", "network": {"id": "1a3cc53e-d09d-45ba-a64b-48bf74dd1680", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-582528653-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "947f6e33004d49cdb05fe27674f9eea8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d17bf8-d7", "ovs_interfaceid": "62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:52:12.664975 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Start _get_guest_xml network_info=[{"id": "62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6", "address": "fa:16:3e:52:00:6a", "network": {"id": "1a3cc53e-d09d-45ba-a64b-48bf74dd1680", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-582528653-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "947f6e33004d49cdb05fe27674f9eea8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d17bf8-d7", "ovs_interfaceid": "62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:52:12.682029 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:52:12.686919 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-TestMultiAttachVolumeSwap-server-1270524779-2', uuid='bad69594-f163-41a6-931f-d2fcda0cb7d1'), owner=OwnerMeta(userid='7c4695d222b84104999cd5793122458a', username='tempest-TestMultiAttachVolumeSwap-2109764512-project-member', projectid='947f6e33004d49cdb05fe27674f9eea8', projectname='tempest-TestMultiAttachVolumeSwap-2109764512'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6", "address": "fa:16:3e:52:00:6a", "network": {"id": "1a3cc53e-d09d-45ba-a64b-48bf74dd1680", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-582528653-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "947f6e33004d49cdb05fe27674f9eea8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d17bf8-d7", "ovs_interfaceid": "62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933132.6856534) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:52:12.693013 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:52:12.694057 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:52:12.694565 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:52:12.695129 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:52:12.701655 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:52:12.703698 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:52:12.704834 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:52:12.705232 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:52:12.705385 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:52:12.705561 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:52:12.705622 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:52:12.705698 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:52:12.705801 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:52:12.706214 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:52:12.706214 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:52:12.706379 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:52:12.707035 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:52:12.707243 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:52:12.713043 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:52:12.714660 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:febd:1211', 'fe80::68de:aaff:fea6:1b7e', 'fe80::fc16:3eff:fe22:2182', 'fe80::384c:7dff:fea8:707f', 'fe80::fc16:3eff:fef4:4b8c', 'fe80::e02a:5fff:fe52:f5a1', 'fe80::fc16:3eff:fed6:49ea', 'fe80::14ff:22ff:fe20:1ea1', 'fe80::fc16:3eff:fe45:c5fe'] 
May 28 01:52:12.714764 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:52:12.715065 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:52:12.715291 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] <== get_connector_properties: return (92ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:52:12.715562 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Updating existing volume attachment record: f8fdadcb-8574-487a-b18d-ae5b2ba45467 {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:52:12.726739 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:51:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1270524779-2',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testmultiattachvolumeswap-server-1270524779-2',id=6,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9T0jFy877GDUIXf8XLwKi1a8geNpNqHXybbcwc8hk9OWvDAevATdpbJCrejEqP1SYlxqf+1qQGfUGM9hrgOtGGbFh3nMI3KqgwiYl59qZQV/o6QSLmhZ8QN57QO0pJzA==',key_name='tempest-keypair-2135479035',keypairs=KeyPairList,launch_index=1,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='947f6e33004d49cdb05fe27674f9eea8',ramdisk_id='',reservation_id='r-uv6dleay',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-2109764512',owner_user_name='tempest-TestMultiAttachVolumeSwap-2109764512-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:52:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c4695d222b84104999cd5793122458a',uuid=bad69594-f163-41a6-931f-d2fcda0cb7d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6", "address": "fa:16:3e:52:00:6a", "network": {"id": "1a3cc53e-d09d-45ba-a64b-48bf74dd1680", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-582528653-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "947f6e33004d49cdb05fe27674f9eea8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d17bf8-d7", "ovs_interfaceid": "62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:52:12.726739 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Converting VIF {"id": "62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6", "address": "fa:16:3e:52:00:6a", "network": {"id": "1a3cc53e-d09d-45ba-a64b-48bf74dd1680", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-582528653-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "947f6e33004d49cdb05fe27674f9eea8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d17bf8-d7", "ovs_interfaceid": "62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:52:12.726739 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:00:6a,bridge_name='br-int',has_traffic_filtering=True,id=62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6,network=Network(1a3cc53e-d09d-45ba-a64b-48bf74dd1680),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62d17bf8-d7') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:52:12.726958 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lazy-loading 'pci_devices' on Instance uuid bad69594-f163-41a6-931f-d2fcda0cb7d1 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:52:12.769784 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:12.778110 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:52:12.789190 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:52:12.847030 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-8ae4b788-515b-414a-b4e3-05f0a6bd0596 req-60af616d-fbdf-468e-8949-de0db493cc39 service nova] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Received event network-vif-plugged-ba06c38a-7287-4a4b-b2d9-015659e538a0 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:12.852646 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Successfully created port: a566955f-6906-4a3b-bdf1-2f55b31b6e21 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:52:12.855241 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-8ae4b788-515b-414a-b4e3-05f0a6bd0596 req-60af616d-fbdf-468e-8949-de0db493cc39 service nova] Acquiring lock "1291c6e1-108e-46d1-85bc-0197f71eec1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:12.855580 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-8ae4b788-515b-414a-b4e3-05f0a6bd0596 req-60af616d-fbdf-468e-8949-de0db493cc39 service nova] Lock "1291c6e1-108e-46d1-85bc-0197f71eec1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:12.858225 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-8ae4b788-515b-414a-b4e3-05f0a6bd0596 req-60af616d-fbdf-468e-8949-de0db493cc39 service nova] Lock "1291c6e1-108e-46d1-85bc-0197f71eec1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:12.858225 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-8ae4b788-515b-414a-b4e3-05f0a6bd0596 req-60af616d-fbdf-468e-8949-de0db493cc39 service nova] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Processing event network-vif-plugged-ba06c38a-7287-4a4b-b2d9-015659e538a0 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:52:12.971210 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:12.975149 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:12.975951 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:12.978898 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:12.995902 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:13.229411 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] End _get_guest_xml xml=<domain type="qemu">
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:   <uuid>bad69594-f163-41a6-931f-d2fcda0cb7d1</uuid>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:   <name>instance-00000006</name>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:       <nova:name>tempest-TestMultiAttachVolumeSwap-server-1270524779-2</nova:name>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:52:12</nova:creationTime>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:         <nova:user uuid="7c4695d222b84104999cd5793122458a">tempest-TestMultiAttachVolumeSwap-2109764512-project-member</nova:user>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:         <nova:project uuid="947f6e33004d49cdb05fe27674f9eea8">tempest-TestMultiAttachVolumeSwap-2109764512</nova:project>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:         <nova:port uuid="62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6">
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:     <system>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:       <entry name="serial">bad69594-f163-41a6-931f-d2fcda0cb7d1</entry>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:       <entry name="uuid">bad69594-f163-41a6-931f-d2fcda0cb7d1</entry>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:     </system>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:   <os>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:   </os>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:   <features>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:   </features>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:   <devices>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/bad69594-f163-41a6-931f-d2fcda0cb7d1/disk"/>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:     </disk>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/bad69594-f163-41a6-931f-d2fcda0cb7d1/disk.config"/>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:     </disk>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:52:00:6a"/>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:       <target dev="tap62d17bf8-d7"/>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:     </interface>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/bad69594-f163-41a6-931f-d2fcda0cb7d1/console.log" append="off"/>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:     </serial>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:     <video>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:     </video>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:     </rng>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:   </devices>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]: </domain>
May 28 01:52:13.229411 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:52:13.233239 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Preparing to wait for external event network-vif-plugged-62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:52:13.233239 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Acquiring lock "bad69594-f163-41a6-931f-d2fcda0cb7d1-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:13.233239 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "bad69594-f163-41a6-931f-d2fcda0cb7d1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:13.233239 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "bad69594-f163-41a6-931f-d2fcda0cb7d1-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:13.233239 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:51:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1270524779-2',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testmultiattachvolumeswap-server-1270524779-2',id=6,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9T0jFy877GDUIXf8XLwKi1a8geNpNqHXybbcwc8hk9OWvDAevATdpbJCrejEqP1SYlxqf+1qQGfUGM9hrgOtGGbFh3nMI3KqgwiYl59qZQV/o6QSLmhZ8QN57QO0pJzA==',key_name='tempest-keypair-2135479035',keypairs=KeyPairList,launch_index=1,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='947f6e33004d49cdb05fe27674f9eea8',ramdisk_id='',reservation_id='r-uv6dleay',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-2109764512',owner_user_name='tempest-TestMultiAttachVolumeSwap-2109764512-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:52:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c4695d222b84104999cd5793122458a',uuid=bad69594-f163-41a6-931f-d2fcda0cb7d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6", "address": "fa:16:3e:52:00:6a", "network": {"id": "1a3cc53e-d09d-45ba-a64b-48bf74dd1680", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-582528653-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "947f6e33004d49cdb05fe27674f9eea8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d17bf8-d7", "ovs_interfaceid": "62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:52:13.233777 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Converting VIF {"id": "62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6", "address": "fa:16:3e:52:00:6a", "network": {"id": "1a3cc53e-d09d-45ba-a64b-48bf74dd1680", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-582528653-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "947f6e33004d49cdb05fe27674f9eea8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d17bf8-d7", "ovs_interfaceid": "62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:52:13.235389 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:00:6a,bridge_name='br-int',has_traffic_filtering=True,id=62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6,network=Network(1a3cc53e-d09d-45ba-a64b-48bf74dd1680),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62d17bf8-d7') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:52:13.235389 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:00:6a,bridge_name='br-int',has_traffic_filtering=True,id=62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6,network=Network(1a3cc53e-d09d-45ba-a64b-48bf74dd1680),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62d17bf8-d7') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:52:13.235721 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:13.236000 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:13.236227 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:52:13.237576 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:13.237728 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3dcc3524-53c8-502b-b833-0ba123e1e3e2', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:13.239612 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:13.239612 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:52:13.242668 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:13.242874 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap62d17bf8-d7, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:13.243284 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap62d17bf8-d7, col_values=(('qos', UUID('c544154f-a670-40bf-891f-cb90a794cbda')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:13.243483 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap62d17bf8-d7, col_values=(('external_ids', {'iface-id': '62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:00:6a', 'vm-uuid': 'bad69594-f163-41a6-931f-d2fcda0cb7d1'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:13.244385 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:13.247014 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:52:13.250146 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:13.251700 np0000001583 nova-compute[98241]: INFO os_vif [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:00:6a,bridge_name='br-int',has_traffic_filtering=True,id=62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6,network=Network(1a3cc53e-d09d-45ba-a64b-48bf74dd1680),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62d17bf8-d7')
May 28 01:52:13.297441 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:52:13.446133 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:52:13.446465 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:52:13.446929 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:52:13.447262 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:52:13.447533 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:52:13.448626 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:52:13.449468 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:52:13.449468 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 01:52:13.449669 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:52:13.494382 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933133.4940221, 1291c6e1-108e-46d1-85bc-0197f71eec1f => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:52:13.494492 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] VM Started (Lifecycle Event)
May 28 01:52:13.495427 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:52:13.498744 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:52:13.501228 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Instance spawned successfully.
May 28 01:52:13.501437 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:52:13.596973 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Successfully updated port: 0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:52:13.602280 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Found WWN 33000000032e795dd for multipath device dm-0 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:52:13.602683 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.040s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:52:13.602874 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] <== connect_volume: return (4041ms) {'type': 'block', 'scsi_wwn': '33000000032e795dd', 'path': '/dev/dm-0', 'multipath_id': '33000000032e795dd'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:52:13.603029 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000032e795dd', 'path': '/dev/dm-0', 'multipath_id': '33000000032e795dd'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:52:13.605546 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Lazy-loading 'flavor' on Instance uuid bfb723e1-a6b7-460b-b115-62d1f2922066 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:52:13.954269 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:13.954686 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:13.954747 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:13.954951 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Auditing locally available compute resources for np0000001583 (node: np0000001583) {{(pid=98241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 01:52:13.998186 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:52:13.999862 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:52:14.006811 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:52:14.007590 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:52:14.009410 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:52:14.009981 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:52:14.010322 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:52:14.011754 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:52:14.110229 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Attempting to attach volume 9f02787a-4f69-4834-af37-6cec9394f4ea with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98241) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 01:52:14.114564 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] attach device xml: <disk type="block" device="disk">
May 28 01:52:14.114564 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:52:14.114564 np0000001583 nova-compute[98241]:   <alias name="ua-9f02787a-4f69-4834-af37-6cec9394f4ea"/>
May 28 01:52:14.114564 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-0"/>
May 28 01:52:14.114564 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 01:52:14.114564 np0000001583 nova-compute[98241]:   <serial>9f02787a-4f69-4834-af37-6cec9394f4ea</serial>
May 28 01:52:14.114564 np0000001583 nova-compute[98241]: </disk>
May 28 01:52:14.114564 np0000001583 nova-compute[98241]:  {{(pid=98241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 01:52:14.361576 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Booting with volume 7ddf6798-56b7-484e-8f23-b19628080e02 at /dev/vdb
May 28 01:52:14.435759 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:52:14.451357 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:52:14.476756 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:52:14.498069 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:52:14.498658 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:52:14.504546 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:52:14.504546 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933134.502741, 1291c6e1-108e-46d1-85bc-0197f71eec1f => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:52:14.504546 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] VM Paused (Lifecycle Event)
May 28 01:52:14.507764 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:52:14.509027 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:febd:1211', 'fe80::68de:aaff:fea6:1b7e', 'fe80::fc16:3eff:fe22:2182', 'fe80::384c:7dff:fea8:707f', 'fe80::fc16:3eff:fef4:4b8c', 'fe80::e02a:5fff:fe52:f5a1', 'fe80::fc16:3eff:fed6:49ea', 'fe80::14ff:22ff:fe20:1ea1', 'fe80::fc16:3eff:fe45:c5fe', 'fe80::e05c:5bff:fea5:7965'] 
May 28 01:52:14.509213 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:52:14.509440 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:52:14.509673 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] <== get_connector_properties: return (73ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:52:14.510018 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Updating existing volume attachment record: 02dde8c1-81d0-493a-9946-d7279a3b2802 {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:52:14.516737 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Took 7.57 seconds to spawn the instance on the hypervisor.
May 28 01:52:14.518273 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:52:14.755626 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Successfully updated port: 3d994306-44d7-4407-94eb-49b142832ffc {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:52:14.772719 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:52:14.772931 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:52:14.773123 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] No VIF found with MAC fa:16:3e:52:00:6a, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:52:14.773723 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Using config drive
May 28 01:52:14.822527 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9a0682c9-8cb5-4bec-813d-929b91dcc49e req-e741db2b-99ce-436a-9b56-fe3d16a81c3f service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-changed-3d994306-44d7-4407-94eb-49b142832ffc {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:14.822669 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9a0682c9-8cb5-4bec-813d-929b91dcc49e req-e741db2b-99ce-436a-9b56-fe3d16a81c3f service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Refreshing instance network info cache due to event network-changed-3d994306-44d7-4407-94eb-49b142832ffc. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:52:14.823188 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9a0682c9-8cb5-4bec-813d-929b91dcc49e req-e741db2b-99ce-436a-9b56-fe3d16a81c3f service nova] Acquiring lock "refresh_cache-d3a7c39a-f946-496d-9153-0a422e7f5350" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:52:14.823853 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9a0682c9-8cb5-4bec-813d-929b91dcc49e req-e741db2b-99ce-436a-9b56-fe3d16a81c3f service nova] Acquired lock "refresh_cache-d3a7c39a-f946-496d-9153-0a422e7f5350" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:52:14.824023 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-9a0682c9-8cb5-4bec-813d-929b91dcc49e req-e741db2b-99ce-436a-9b56-fe3d16a81c3f service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Refreshing network info cache for port 3d994306-44d7-4407-94eb-49b142832ffc {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:52:14.910375 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-725d4fd3-2ccb-4c1c-8e51-af632720b682 req-08086ca3-9000-436d-909c-df5b08c729c5 service nova] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Received event network-vif-plugged-ba06c38a-7287-4a4b-b2d9-015659e538a0 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:14.910375 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-725d4fd3-2ccb-4c1c-8e51-af632720b682 req-08086ca3-9000-436d-909c-df5b08c729c5 service nova] Acquiring lock "1291c6e1-108e-46d1-85bc-0197f71eec1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:14.910375 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-725d4fd3-2ccb-4c1c-8e51-af632720b682 req-08086ca3-9000-436d-909c-df5b08c729c5 service nova] Lock "1291c6e1-108e-46d1-85bc-0197f71eec1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:14.910375 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-725d4fd3-2ccb-4c1c-8e51-af632720b682 req-08086ca3-9000-436d-909c-df5b08c729c5 service nova] Lock "1291c6e1-108e-46d1-85bc-0197f71eec1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:14.910546 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-725d4fd3-2ccb-4c1c-8e51-af632720b682 req-08086ca3-9000-436d-909c-df5b08c729c5 service nova] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] No waiting events found dispatching network-vif-plugged-ba06c38a-7287-4a4b-b2d9-015659e538a0 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:52:14.910593 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-725d4fd3-2ccb-4c1c-8e51-af632720b682 req-08086ca3-9000-436d-909c-df5b08c729c5 service nova] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Received unexpected event network-vif-plugged-ba06c38a-7287-4a4b-b2d9-015659e538a0 for instance with vm_state active and task_state None.
May 28 01:52:14.910756 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-725d4fd3-2ccb-4c1c-8e51-af632720b682 req-08086ca3-9000-436d-909c-df5b08c729c5 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-changed-0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:14.911540 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-725d4fd3-2ccb-4c1c-8e51-af632720b682 req-08086ca3-9000-436d-909c-df5b08c729c5 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Refreshing instance network info cache due to event network-changed-0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:52:14.911853 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-725d4fd3-2ccb-4c1c-8e51-af632720b682 req-08086ca3-9000-436d-909c-df5b08c729c5 service nova] Acquiring lock "refresh_cache-d3a7c39a-f946-496d-9153-0a422e7f5350" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:52:14.977816 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb723e1-a6b7-460b-b115-62d1f2922066/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:52:15.008034 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:52:15.011811 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933135.0092347, 1291c6e1-108e-46d1-85bc-0197f71eec1f => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:52:15.011811 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] VM Resumed (Lifecycle Event)
May 28 01:52:15.030923 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Took 17.30 seconds to build instance.
May 28 01:52:15.038044 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb723e1-a6b7-460b-b115-62d1f2922066/disk --force-share --output=json" returned: 0 in 0.060s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:52:15.038464 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb723e1-a6b7-460b-b115-62d1f2922066/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:52:15.104632 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb723e1-a6b7-460b-b115-62d1f2922066/disk --force-share --output=json" returned: 0 in 0.066s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:52:15.105000 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:52:15.107239 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1291c6e1-108e-46d1-85bc-0197f71eec1f/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:52:15.171011 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1291c6e1-108e-46d1-85bc-0197f71eec1f/disk --force-share --output=json" returned: 0 in 0.063s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:52:15.171719 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1291c6e1-108e-46d1-85bc-0197f71eec1f/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:52:15.235606 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1291c6e1-108e-46d1-85bc-0197f71eec1f/disk --force-share --output=json" returned: 0 in 0.064s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:52:15.237874 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4e5fc7a-978f-407f-9faf-7ec539b55e0e/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:52:15.280417 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:15.311857 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4e5fc7a-978f-407f-9faf-7ec539b55e0e/disk --force-share --output=json" returned: 0 in 0.073s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:52:15.311857 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4e5fc7a-978f-407f-9faf-7ec539b55e0e/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:52:15.327784 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-9a0682c9-8cb5-4bec-813d-929b91dcc49e req-e741db2b-99ce-436a-9b56-fe3d16a81c3f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:15.379323 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4e5fc7a-978f-407f-9faf-7ec539b55e0e/disk --force-share --output=json" returned: 0 in 0.067s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:52:15.383719 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f342ed55-ce60-405b-bc09-856eced24bf7/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:52:15.435182 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-9a0682c9-8cb5-4bec-813d-929b91dcc49e req-e741db2b-99ce-436a-9b56-fe3d16a81c3f service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:52:15.459638 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f342ed55-ce60-405b-bc09-856eced24bf7/disk --force-share --output=json" returned: 0 in 0.076s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:52:15.461225 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f342ed55-ce60-405b-bc09-856eced24bf7/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:52:15.487745 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Creating config drive at /opt/stack/data/nova/instances/bad69594-f163-41a6-931f-d2fcda0cb7d1/disk.config
May 28 01:52:15.493359 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/bad69594-f163-41a6-931f-d2fcda0cb7d1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwl12wjgj {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:52:15.518260 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:52:15.521243 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:52:15.532147 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/bad69594-f163-41a6-931f-d2fcda0cb7d1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwl12wjgj" returned: 0 in 0.038s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:52:15.534409 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "1291c6e1-108e-46d1-85bc-0197f71eec1f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.818s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:15.540312 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f342ed55-ce60-405b-bc09-856eced24bf7/disk --force-share --output=json" returned: 0 in 0.080s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:52:15.650047 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-9a0682c9-8cb5-4bec-813d-929b91dcc49e req-e741db2b-99ce-436a-9b56-fe3d16a81c3f service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:52:15.823316 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:52:15.823495 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:52:15.823626 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:52:15.823757 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] No VIF found with MAC fa:16:3e:bd:12:11, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:52:15.906839 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Successfully updated port: bf1e69e9-a858-4270-8c47-a209493f7e48 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:52:15.974420 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:15.997861 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:16.026314 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Acquiring lock "f2805796-e531-4508-8585-0d110f4bd4e7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:16.026314 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Lock "f2805796-e531-4508-8585-0d110f4bd4e7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:16.125398 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:16.127620 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:16.129637 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:16.131220 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Booting with volume fe81d64a-afda-41db-b18c-986ff2d9fbcb at /dev/vdc
May 28 01:52:16.154919 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9a0682c9-8cb5-4bec-813d-929b91dcc49e req-e741db2b-99ce-436a-9b56-fe3d16a81c3f service nova] Releasing lock "refresh_cache-d3a7c39a-f946-496d-9153-0a422e7f5350" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:52:16.155101 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-725d4fd3-2ccb-4c1c-8e51-af632720b682 req-08086ca3-9000-436d-909c-df5b08c729c5 service nova] Acquired lock "refresh_cache-d3a7c39a-f946-496d-9153-0a422e7f5350" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:52:16.155265 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-725d4fd3-2ccb-4c1c-8e51-af632720b682 req-08086ca3-9000-436d-909c-df5b08c729c5 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Refreshing network info cache for port 0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:52:16.171037 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad69594-f163-41a6-931f-d2fcda0cb7d1/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:52:16.182241 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:52:16.195169 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:52:16.216487 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:52:16.239007 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:52:16.239449 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:52:16.244232 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad69594-f163-41a6-931f-d2fcda0cb7d1/disk --force-share --output=json" returned: 0 in 0.073s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:52:16.244696 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad69594-f163-41a6-931f-d2fcda0cb7d1/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:52:16.253097 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:52:16.254725 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:febd:1211', 'fe80::68de:aaff:fea6:1b7e', 'fe80::fc16:3eff:fe22:2182', 'fe80::384c:7dff:fea8:707f', 'fe80::fc16:3eff:fef4:4b8c', 'fe80::e02a:5fff:fe52:f5a1', 'fe80::fc16:3eff:fed6:49ea', 'fe80::14ff:22ff:fe20:1ea1', 'fe80::fc16:3eff:fe45:c5fe', 'fe80::e05c:5bff:fea5:7965', 'fe80::fc16:3eff:fe52:6a'] 
May 28 01:52:16.254919 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:52:16.255088 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:52:16.255593 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] <== get_connector_properties: return (72ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:52:16.255916 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Updating existing volume attachment record: 4e14cab6-17ad-4175-ae27-470d1e2f6a33 {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:52:16.327693 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad69594-f163-41a6-931f-d2fcda0cb7d1/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:52:16.330133 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02b42340-8535-4682-98db-49f970ff5597/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:52:16.406764 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02b42340-8535-4682-98db-49f970ff5597/disk --force-share --output=json" returned: 0 in 0.076s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:52:16.407266 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02b42340-8535-4682-98db-49f970ff5597/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:52:16.503128 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02b42340-8535-4682-98db-49f970ff5597/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:52:16.505773 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:52:16.506857 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:52:16.529103 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:52:16.535488 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.028s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:52:16.536333 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Hypervisor/Node resource view: name=np0000001583 free_ram=14067MB free_disk=74.70667266845703GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 01:52:16.536498 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:16.536674 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:16.659447 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-725d4fd3-2ccb-4c1c-8e51-af632720b682 req-08086ca3-9000-436d-909c-df5b08c729c5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:16.749486 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-725d4fd3-2ccb-4c1c-8e51-af632720b682 req-08086ca3-9000-436d-909c-df5b08c729c5 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:52:16.896010 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933136.894427, bad69594-f163-41a6-931f-d2fcda0cb7d1 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:52:16.896010 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] VM Started (Lifecycle Event)
May 28 01:52:16.935626 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-725d4fd3-2ccb-4c1c-8e51-af632720b682 req-08086ca3-9000-436d-909c-df5b08c729c5 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:52:17.039498 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-44ca4514-c2cd-40be-a79f-26960f3ca43e req-e66d9f76-aded-476e-a8f8-0657f035bdf4 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-changed-bf1e69e9-a858-4270-8c47-a209493f7e48 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:17.043490 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-44ca4514-c2cd-40be-a79f-26960f3ca43e req-e66d9f76-aded-476e-a8f8-0657f035bdf4 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Refreshing instance network info cache due to event network-changed-bf1e69e9-a858-4270-8c47-a209493f7e48. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:52:17.044479 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-44ca4514-c2cd-40be-a79f-26960f3ca43e req-e66d9f76-aded-476e-a8f8-0657f035bdf4 service nova] Acquiring lock "refresh_cache-d3a7c39a-f946-496d-9153-0a422e7f5350" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:52:17.082615 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Successfully updated port: f5e93ea0-a679-45fb-9178-3842154f2e4d {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:52:17.110755 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:17.400852 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:52:17.402392 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933137.4021318, bad69594-f163-41a6-931f-d2fcda0cb7d1 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:52:17.402545 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] VM Paused (Lifecycle Event)
May 28 01:52:17.432920 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-677b199a-68b2-44cb-8539-f3c3505ff25a tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Lock "bfb723e1-a6b7-460b-b115-62d1f2922066" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.589s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:17.438787 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-725d4fd3-2ccb-4c1c-8e51-af632720b682 req-08086ca3-9000-436d-909c-df5b08c729c5 service nova] Releasing lock "refresh_cache-d3a7c39a-f946-496d-9153-0a422e7f5350" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:52:17.439595 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-44ca4514-c2cd-40be-a79f-26960f3ca43e req-e66d9f76-aded-476e-a8f8-0657f035bdf4 service nova] Acquired lock "refresh_cache-d3a7c39a-f946-496d-9153-0a422e7f5350" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:52:17.439770 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-44ca4514-c2cd-40be-a79f-26960f3ca43e req-e66d9f76-aded-476e-a8f8-0657f035bdf4 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Refreshing network info cache for port bf1e69e9-a858-4270-8c47-a209493f7e48 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:52:17.615222 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance bfb723e1-a6b7-460b-b115-62d1f2922066 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:52:17.770721 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:17.907021 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:52:17.908412 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:52:17.933103 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Acquiring lock "bfb723e1-a6b7-460b-b115-62d1f2922066" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:17.933335 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Lock "bfb723e1-a6b7-460b-b115-62d1f2922066" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:17.933488 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Acquiring lock "bfb723e1-a6b7-460b-b115-62d1f2922066-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:17.933652 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Lock "bfb723e1-a6b7-460b-b115-62d1f2922066-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:17.933793 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Lock "bfb723e1-a6b7-460b-b115-62d1f2922066-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:17.936183 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Terminating instance
May 28 01:52:17.941807 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-44ca4514-c2cd-40be-a79f-26960f3ca43e req-e66d9f76-aded-476e-a8f8-0657f035bdf4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:18.041693 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-44ca4514-c2cd-40be-a79f-26960f3ca43e req-e66d9f76-aded-476e-a8f8-0657f035bdf4 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:52:18.123543 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance f2805796-e531-4508-8585-0d110f4bd4e7 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
May 28 01:52:18.123543 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 02b42340-8535-4682-98db-49f970ff5597 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:52:18.123543 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance f342ed55-ce60-405b-bc09-856eced24bf7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:52:18.123543 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 1291c6e1-108e-46d1-85bc-0197f71eec1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:52:18.123543 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance bad69594-f163-41a6-931f-d2fcda0cb7d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:52:18.123543 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance a4e5fc7a-978f-407f-9faf-7ec539b55e0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:52:18.123543 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance d3a7c39a-f946-496d-9153-0a422e7f5350 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:52:18.123543 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 01:52:18.123543 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Final resource view: name=np0000001583 phys_ram=24030MB used_ram=1856MB phys_disk=95GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 01:52:16 up 28 min,  2 users,  load average: 5.68, 2.66, 1.30\n', 'num_instances': '7', 'num_vm_active': '3', 'num_task_None': '3', 'num_os_type_None': '7', 'num_proj_1ad9015838ce40f99e83bc413aa1c08b': '1', 'io_workload': '4', 'num_proj_b525e2c2d9a9421da5a3eeb5af5958f7': '1', 'num_vm_building': '4', 'num_task_spawning': '3', 'num_proj_43c294dcbfc5459898bb040ccdf1b52f': '1', 'num_proj_745d9bd220de4beaab6c7561af376ae3': '1', 'num_proj_947f6e33004d49cdb05fe27674f9eea8': '2', 'num_task_block_device_mapping': '1', 'num_proj_e94701d7485c4c46adefaf3637f27990': '1'} {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 01:52:18.146238 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Successfully updated port: 91f6bd16-2cfa-44ca-a7ea-ef3ef4933092 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:52:18.243825 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-44ca4514-c2cd-40be-a79f-26960f3ca43e req-e66d9f76-aded-476e-a8f8-0657f035bdf4 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:52:18.246408 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:18.247979 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-816928b5-89df-499a-8d0a-f7894998ce25 req-38829c6e-ed98-4994-8163-8a5df5302911 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-changed-91f6bd16-2cfa-44ca-a7ea-ef3ef4933092 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:18.250190 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-816928b5-89df-499a-8d0a-f7894998ce25 req-38829c6e-ed98-4994-8163-8a5df5302911 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Refreshing instance network info cache due to event network-changed-91f6bd16-2cfa-44ca-a7ea-ef3ef4933092. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:52:18.250190 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-816928b5-89df-499a-8d0a-f7894998ce25 req-38829c6e-ed98-4994-8163-8a5df5302911 service nova] Acquiring lock "refresh_cache-d3a7c39a-f946-496d-9153-0a422e7f5350" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:52:18.374234 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:52:18.375561 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:52:18.375626 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Creating image(s)
May 28 01:52:18.377405 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Did not create local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 01:52:18.377405 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Ensure instance console log exists: /opt/stack/data/nova/instances/d3a7c39a-f946-496d-9153-0a422e7f5350/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:52:18.377405 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:18.377405 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:18.377405 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:18.412584 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:52:18.441112 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:52:18.463628 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:18.484411 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:18.490800 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:18.512787 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:18.519687 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:18.635415 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:52:18.635415 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:52:18.746766 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-44ca4514-c2cd-40be-a79f-26960f3ca43e req-e66d9f76-aded-476e-a8f8-0657f035bdf4 service nova] Releasing lock "refresh_cache-d3a7c39a-f946-496d-9153-0a422e7f5350" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:52:18.748949 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-816928b5-89df-499a-8d0a-f7894998ce25 req-38829c6e-ed98-4994-8163-8a5df5302911 service nova] Acquired lock "refresh_cache-d3a7c39a-f946-496d-9153-0a422e7f5350" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:52:18.749238 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-816928b5-89df-499a-8d0a-f7894998ce25 req-38829c6e-ed98-4994-8163-8a5df5302911 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Refreshing network info cache for port 91f6bd16-2cfa-44ca-a7ea-ef3ef4933092 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:52:18.750415 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:18.759177 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:18.792601 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999062542000047 future=<Future at 0x7724f844d970 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:52:18.792601 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.99834098500014 future=<Future at 0x7724f844d970 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:52:18.792601 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.998096172000032 future=<Future at 0x7724f844d970 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:52:18.794127 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Instance destroyed successfully.
May 28 01:52:18.794684 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Lazy-loading 'resources' on Instance uuid bfb723e1-a6b7-460b-b115-62d1f2922066 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:52:19.136717 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:52:19.144190 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e72b5c35-05d0-43f8-8724-c35bf5bc7998 req-383297cd-3e80-4628-914b-077880f3f59e service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-changed-f5e93ea0-a679-45fb-9178-3842154f2e4d {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:19.144190 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e72b5c35-05d0-43f8-8724-c35bf5bc7998 req-383297cd-3e80-4628-914b-077880f3f59e service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Refreshing instance network info cache due to event network-changed-f5e93ea0-a679-45fb-9178-3842154f2e4d. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:52:19.144190 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e72b5c35-05d0-43f8-8724-c35bf5bc7998 req-383297cd-3e80-4628-914b-077880f3f59e service nova] Acquiring lock "refresh_cache-d3a7c39a-f946-496d-9153-0a422e7f5350" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:52:19.254271 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-816928b5-89df-499a-8d0a-f7894998ce25 req-38829c6e-ed98-4994-8163-8a5df5302911 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:19.297641 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:51:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-936358237',display_name='tempest-DeleteServersTestJSON-server-936358237',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-deleteserverstestjson-server-936358237',id=1,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:52:02Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ad9015838ce40f99e83bc413aa1c08b',ramdisk_id='',reservation_id='r-0yg57ukj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1865350861',owner_user_name='tempest-DeleteServersTestJSON-1865350861-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:52:02Z,user_data=None,user_id='1b947140d3864542a79a544b0c9376ed',uuid=bfb723e1-a6b7-460b-b115-62d1f2922066,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "abeff3c8-2440-496e-b339-d23c6c7ad07e", "address": "fa:16:3e:bd:12:11", "network": {"id": "ff18d2b2-aaf4-4fbb-9b27-93d0e1ea8678", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-145899974-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ad9015838ce40f99e83bc413aa1c08b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapabeff3c8-24", "ovs_interfaceid": "abeff3c8-2440-496e-b339-d23c6c7ad07e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:52:19.297818 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Converting VIF {"id": "abeff3c8-2440-496e-b339-d23c6c7ad07e", "address": "fa:16:3e:bd:12:11", "network": {"id": "ff18d2b2-aaf4-4fbb-9b27-93d0e1ea8678", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-145899974-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ad9015838ce40f99e83bc413aa1c08b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapabeff3c8-24", "ovs_interfaceid": "abeff3c8-2440-496e-b339-d23c6c7ad07e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:52:19.298450 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:12:11,bridge_name='br-int',has_traffic_filtering=True,id=abeff3c8-2440-496e-b339-d23c6c7ad07e,network=Network(ff18d2b2-aaf4-4fbb-9b27-93d0e1ea8678),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabeff3c8-24') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:52:19.298701 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:12:11,bridge_name='br-int',has_traffic_filtering=True,id=abeff3c8-2440-496e-b339-d23c6c7ad07e,network=Network(ff18d2b2-aaf4-4fbb-9b27-93d0e1ea8678),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabeff3c8-24') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:52:19.305481 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:19.305808 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapabeff3c8-24, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:19.306995 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:19.308597 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:52:19.309341 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:19.310133 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:19.310327 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f5f48f1e-bc17-42c8-b2dc-ac3be1e37f2f) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:19.311703 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:19.312271 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:52:19.314328 np0000001583 nova-compute[98241]: INFO os_vif [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:12:11,bridge_name='br-int',has_traffic_filtering=True,id=abeff3c8-2440-496e-b339-d23c6c7ad07e,network=Network(ff18d2b2-aaf4-4fbb-9b27-93d0e1ea8678),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabeff3c8-24')
May 28 01:52:19.316410 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:52:19.320148 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea', 'iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9f02787a-4f69-4834-af37-6cec9394f4ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:52:19.320148 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:52:19.320148 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:52:19.320148 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea', 'iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9f02787a-4f69-4834-af37-6cec9394f4ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:52:19.320148 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:52:19.339284 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea (non-flash)
May 28 01:52:19.339284 np0000001583 nova-compute[98241]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea (non-flash)
May 28 01:52:19.339284 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:52:19.339419 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea (non-flash)
May 28 01:52:19.339419 np0000001583 nova-compute[98241]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea (non-flash)
May 28 01:52:19.339419 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:52:19.340452 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea', '4')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:52:19.340452 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea', '3')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:52:19.340643 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea', '4')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:52:19.341827 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f839a980>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea'): ({'sdc'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:52:19.343974 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-816928b5-89df-499a-8d0a-f7894998ce25 req-38829c6e-ed98-4994-8163-8a5df5302911 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:52:19.345501 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Removing multipathed devices sdc, sdb {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:52:19.345856 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Flush multipath device 33000000032e795dd {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:52:19.356209 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Successfully updated port: 9e08628c-1ff2-4d4b-9f3d-50231fa6ceec {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:52:19.378605 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:52:19.428462 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:52:19.473462 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:52:19.473699 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:52:19.475054 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:52:19.491532 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:52:19.492064 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:52:19.505574 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:19.513497 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-816928b5-89df-499a-8d0a-f7894998ce25 req-38829c6e-ed98-4994-8163-8a5df5302911 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:52:19.532242 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea, portal: 192.168.40.100,3260]
May 28 01:52:19.532242 np0000001583 nova-compute[98241]: Logout of [sid: 3, target: iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea, portal: 192.168.40.100,3260] successful.
May 28 01:52:19.532242 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:19.548496 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:19.568737 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:19.570128 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:19.600710 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea, portal: 192.168.50.100,3260]
May 28 01:52:19.600710 np0000001583 nova-compute[98241]: Logout of [sid: 4, target: iqn.2023-03.storpool.com:os--volume-9f02787a-4f69-4834-af37-6cec9394f4ea, portal: 192.168.50.100,3260] successful.
May 28 01:52:19.600710 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:19.613767 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:19.614070 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:52:19.614336 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] <== disconnect_volume: return (297ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:52:19.614507 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:52:19.614922 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Deleting instance files /opt/stack/data/nova/instances/bfb723e1-a6b7-460b-b115-62d1f2922066_del
May 28 01:52:19.615973 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Deletion of /opt/stack/data/nova/instances/bfb723e1-a6b7-460b-b115-62d1f2922066_del complete
May 28 01:52:19.645805 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Compute_service record updated for np0000001583:np0000001583 {{(pid=98241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 01:52:19.645980 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.109s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:19.646482 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.536s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:19.649958 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:52:19.651140 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 59.74 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:52:19.651140 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Claim successful on node np0000001583
May 28 01:52:20.015782 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-816928b5-89df-499a-8d0a-f7894998ce25 req-38829c6e-ed98-4994-8163-8a5df5302911 service nova] Releasing lock "refresh_cache-d3a7c39a-f946-496d-9153-0a422e7f5350" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:52:20.016054 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e72b5c35-05d0-43f8-8724-c35bf5bc7998 req-383297cd-3e80-4628-914b-077880f3f59e service nova] Acquired lock "refresh_cache-d3a7c39a-f946-496d-9153-0a422e7f5350" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:52:20.016677 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-e72b5c35-05d0-43f8-8724-c35bf5bc7998 req-383297cd-3e80-4628-914b-077880f3f59e service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Refreshing network info cache for port f5e93ea0-a679-45fb-9178-3842154f2e4d {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:52:20.123101 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Took 1.68 seconds to destroy the instance on the hypervisor.
May 28 01:52:20.123101 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:52:20.123101 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:52:20.123101 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:52:20.123101 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:20.200428 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:20.387646 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Successfully updated port: a566955f-6906-4a3b-bdf1-2f55b31b6e21 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:52:20.481558 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a5da554d-aa47-4298-8336-0fbdd9cb9400 req-39b538db-43c6-4c8d-9371-2bb54745c438 service nova] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Received event network-vif-deleted-abeff3c8-2440-496e-b339-d23c6c7ad07e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:20.481861 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-a5da554d-aa47-4298-8336-0fbdd9cb9400 req-39b538db-43c6-4c8d-9371-2bb54745c438 service nova] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Neutron deleted interface abeff3c8-2440-496e-b339-d23c6c7ad07e; detaching it from the instance and deleting it from the info cache
May 28 01:52:20.482904 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a5da554d-aa47-4298-8336-0fbdd9cb9400 req-39b538db-43c6-4c8d-9371-2bb54745c438 service nova] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Detach interface failed, port_id=abeff3c8-2440-496e-b339-d23c6c7ad07e, reason: Instance bfb723e1-a6b7-460b-b115-62d1f2922066 could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:52:20.518692 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-e72b5c35-05d0-43f8-8724-c35bf5bc7998 req-383297cd-3e80-4628-914b-077880f3f59e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:20.607001 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-e72b5c35-05d0-43f8-8724-c35bf5bc7998 req-383297cd-3e80-4628-914b-077880f3f59e service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:52:20.770900 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-e72b5c35-05d0-43f8-8724-c35bf5bc7998 req-383297cd-3e80-4628-914b-077880f3f59e service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:52:20.890646 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Acquiring lock "refresh_cache-d3a7c39a-f946-496d-9153-0a422e7f5350" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:52:20.922091 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:52:21.158927 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:52:21.159211 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:52:21.204896 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2df540ea-53fd-4a8a-b5e1-c9fdfe94f003 req-80e742cb-0ca7-4f50-85a9-93ae6e1a114d service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-changed-9e08628c-1ff2-4d4b-9f3d-50231fa6ceec {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:21.205927 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2df540ea-53fd-4a8a-b5e1-c9fdfe94f003 req-80e742cb-0ca7-4f50-85a9-93ae6e1a114d service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Refreshing instance network info cache due to event network-changed-9e08628c-1ff2-4d4b-9f3d-50231fa6ceec. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:52:21.206134 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2df540ea-53fd-4a8a-b5e1-c9fdfe94f003 req-80e742cb-0ca7-4f50-85a9-93ae6e1a114d service nova] Acquiring lock "refresh_cache-d3a7c39a-f946-496d-9153-0a422e7f5350" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:52:21.272960 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e72b5c35-05d0-43f8-8724-c35bf5bc7998 req-383297cd-3e80-4628-914b-077880f3f59e service nova] Releasing lock "refresh_cache-d3a7c39a-f946-496d-9153-0a422e7f5350" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:52:21.273187 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e72b5c35-05d0-43f8-8724-c35bf5bc7998 req-383297cd-3e80-4628-914b-077880f3f59e service nova] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Received event network-vif-unplugged-abeff3c8-2440-496e-b339-d23c6c7ad07e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:21.273380 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e72b5c35-05d0-43f8-8724-c35bf5bc7998 req-383297cd-3e80-4628-914b-077880f3f59e service nova] Acquiring lock "bfb723e1-a6b7-460b-b115-62d1f2922066-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:21.273531 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e72b5c35-05d0-43f8-8724-c35bf5bc7998 req-383297cd-3e80-4628-914b-077880f3f59e service nova] Lock "bfb723e1-a6b7-460b-b115-62d1f2922066-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:21.273639 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e72b5c35-05d0-43f8-8724-c35bf5bc7998 req-383297cd-3e80-4628-914b-077880f3f59e service nova] Lock "bfb723e1-a6b7-460b-b115-62d1f2922066-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:21.273759 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e72b5c35-05d0-43f8-8724-c35bf5bc7998 req-383297cd-3e80-4628-914b-077880f3f59e service nova] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] No waiting events found dispatching network-vif-unplugged-abeff3c8-2440-496e-b339-d23c6c7ad07e {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:52:21.273877 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e72b5c35-05d0-43f8-8724-c35bf5bc7998 req-383297cd-3e80-4628-914b-077880f3f59e service nova] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Received event network-vif-unplugged-abeff3c8-2440-496e-b339-d23c6c7ad07e for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:52:21.273980 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e72b5c35-05d0-43f8-8724-c35bf5bc7998 req-383297cd-3e80-4628-914b-077880f3f59e service nova] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Received event network-vif-unplugged-abeff3c8-2440-496e-b339-d23c6c7ad07e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:21.274119 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e72b5c35-05d0-43f8-8724-c35bf5bc7998 req-383297cd-3e80-4628-914b-077880f3f59e service nova] Acquiring lock "bfb723e1-a6b7-460b-b115-62d1f2922066-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:21.274242 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e72b5c35-05d0-43f8-8724-c35bf5bc7998 req-383297cd-3e80-4628-914b-077880f3f59e service nova] Lock "bfb723e1-a6b7-460b-b115-62d1f2922066-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:21.274359 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e72b5c35-05d0-43f8-8724-c35bf5bc7998 req-383297cd-3e80-4628-914b-077880f3f59e service nova] Lock "bfb723e1-a6b7-460b-b115-62d1f2922066-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:21.274824 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Acquired lock "refresh_cache-d3a7c39a-f946-496d-9153-0a422e7f5350" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:52:21.275059 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e72b5c35-05d0-43f8-8724-c35bf5bc7998 req-383297cd-3e80-4628-914b-077880f3f59e service nova] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] No waiting events found dispatching network-vif-unplugged-abeff3c8-2440-496e-b339-d23c6c7ad07e {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:52:21.275662 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e72b5c35-05d0-43f8-8724-c35bf5bc7998 req-383297cd-3e80-4628-914b-077880f3f59e service nova] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Received event network-vif-unplugged-abeff3c8-2440-496e-b339-d23c6c7ad07e for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:52:21.275662 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:52:21.424453 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Took 1.30 seconds to deallocate network for instance.
May 28 01:52:21.661840 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:52:21.865283 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:52:22.014760 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Took 0.59 seconds to detach 1 volumes for instance.
May 28 01:52:22.095129 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:22.167599 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.521s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:22.167883 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:52:22.367430 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:22.522946 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:22.523185 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:22.683566 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:52:22.688111 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:52:22.688111 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:22.688111 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:22.753845 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:22.772421 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:22.787538 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bff6dc118f2e4efc8d499d4614565377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e37a40d1db45cba9235de04219a3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:52:23.115818 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:23.128251 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:52:23.128455 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:52:23.185828 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:52:23.317100 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Successfully created port: 6835d977-7c34-4bd7-8d12-208432ea45d3 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:52:23.492843 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:23.631040 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:52:23.690849 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:52:23.781129 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:23.836658 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Successfully updated port: 6835d977-7c34-4bd7-8d12-208432ea45d3 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:52:23.881999 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-aeee6d00-6e32-4e73-8ea1-7278609d3f9a req-092c6da7-8cae-4a3f-bf4a-f2556c9a819d service nova] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Received event network-changed-6835d977-7c34-4bd7-8d12-208432ea45d3 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:23.881999 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-aeee6d00-6e32-4e73-8ea1-7278609d3f9a req-092c6da7-8cae-4a3f-bf4a-f2556c9a819d service nova] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Refreshing instance network info cache due to event network-changed-6835d977-7c34-4bd7-8d12-208432ea45d3. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:52:23.882103 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-aeee6d00-6e32-4e73-8ea1-7278609d3f9a req-092c6da7-8cae-4a3f-bf4a-f2556c9a819d service nova] Acquiring lock "refresh_cache-f2805796-e531-4508-8585-0d110f4bd4e7" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:52:23.882467 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-aeee6d00-6e32-4e73-8ea1-7278609d3f9a req-092c6da7-8cae-4a3f-bf4a-f2556c9a819d service nova] Acquired lock "refresh_cache-f2805796-e531-4508-8585-0d110f4bd4e7" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:52:23.882614 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-aeee6d00-6e32-4e73-8ea1-7278609d3f9a req-092c6da7-8cae-4a3f-bf4a-f2556c9a819d service nova] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Refreshing network info cache for port 6835d977-7c34-4bd7-8d12-208432ea45d3 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:52:24.049085 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:24.137384 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.614s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:24.179780 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Updating instance_info_cache with network_info: [{"id": "0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8", "address": "fa:16:3e:54:87:27", "network": {"id": "f48f059f-2a4c-46cc-9281-c2a228bf4514", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-256433360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e04c6bd-fb", "ovs_interfaceid": "0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d994306-44d7-4407-94eb-49b142832ffc", "address": "fa:16:3e:ab:fd:ca", "network": {"id": "3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026701416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d994306-44", "ovs_interfaceid": "3d994306-44d7-4407-94eb-49b142832ffc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bf1e69e9-a858-4270-8c47-a209493f7e48", "address": "fa:16:3e:18:87:d6", "network": {"id": "3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026701416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf1e69e9-a8", "ovs_interfaceid": "bf1e69e9-a858-4270-8c47-a209493f7e48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f5e93ea0-a679-45fb-9178-3842154f2e4d", "address": "fa:16:3e:9a:c8:f6", "network": {"id": "3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026701416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e93ea0-a6", "ovs_interfaceid": "f5e93ea0-a679-45fb-9178-3842154f2e4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "91f6bd16-2cfa-44ca-a7ea-ef3ef4933092", "address": "fa:16:3e:ba:70:ee", "network": {"id": "3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026701416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f6bd16-2c", "ovs_interfaceid": "91f6bd16-2cfa-44ca-a7ea-ef3ef4933092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9e08628c-1ff2-4d4b-9f3d-50231fa6ceec", "address": "fa:16:3e:1d:f8:b7", "network": {"id": "450c1abf-c05a-46dc-9905-3fa42767a540", "bridge": "br-int", "label": "tempest-device-tagging-net2-594797377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e08628c-1f", "ovs_interfaceid": "9e08628c-1ff2-4d4b-9f3d-50231fa6ceec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a566955f-6906-4a3b-bdf1-2f55b31b6e21", "address": "fa:16:3e:cb:ff:df", "network": {"id": "450c1abf-c05a-46dc-9905-3fa42767a540", "bridge": "br-int", "label": "tempest-device-tagging-net2-594797377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa566955f-69", "ovs_interfaceid": "a566955f-6906-4a3b-bdf1-2f55b31b6e21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:52:24.194580 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Booting with volume ac79736b-8037-45cb-a9eb-510556b680f9 at /dev/vda
May 28 01:52:24.204847 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Deleted allocations for instance bfb723e1-a6b7-460b-b115-62d1f2922066
May 28 01:52:24.232861 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:52:24.242805 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:52:24.259125 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:52:24.276448 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:52:24.276876 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:52:24.283233 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:52:24.284350 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe22:2182', 'fe80::384c:7dff:fea8:707f', 'fe80::fc16:3eff:fef4:4b8c', 'fe80::e02a:5fff:fe52:f5a1', 'fe80::fc16:3eff:fed6:49ea', 'fe80::14ff:22ff:fe20:1ea1', 'fe80::fc16:3eff:fe45:c5fe', 'fe80::e05c:5bff:fea5:7965', 'fe80::fc16:3eff:fe52:6a'] 
May 28 01:52:24.284461 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:52:24.284566 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:52:24.284777 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] <== get_connector_properties: return (52ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:52:24.284967 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Updating existing volume attachment record: 58570f07-60cd-41fa-99f2-1e08d6c51b3e {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:52:24.325621 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:24.339406 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Acquiring lock "refresh_cache-f2805796-e531-4508-8585-0d110f4bd4e7" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:52:24.385221 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-aeee6d00-6e32-4e73-8ea1-7278609d3f9a req-092c6da7-8cae-4a3f-bf4a-f2556c9a819d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:24.463627 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-aeee6d00-6e32-4e73-8ea1-7278609d3f9a req-092c6da7-8cae-4a3f-bf4a-f2556c9a819d service nova] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:52:24.613372 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-aeee6d00-6e32-4e73-8ea1-7278609d3f9a req-092c6da7-8cae-4a3f-bf4a-f2556c9a819d service nova] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:52:24.682176 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Releasing lock "refresh_cache-d3a7c39a-f946-496d-9153-0a422e7f5350" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:52:24.683011 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Instance network_info: |[{"id": "0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8", "address": "fa:16:3e:54:87:27", "network": {"id": "f48f059f-2a4c-46cc-9281-c2a228bf4514", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-256433360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e04c6bd-fb", "ovs_interfaceid": "0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d994306-44d7-4407-94eb-49b142832ffc", "address": "fa:16:3e:ab:fd:ca", "network": {"id": "3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026701416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d994306-44", "ovs_interfaceid": "3d994306-44d7-4407-94eb-49b142832ffc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bf1e69e9-a858-4270-8c47-a209493f7e48", "address": "fa:16:3e:18:87:d6", "network": {"id": "3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026701416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf1e69e9-a8", "ovs_interfaceid": "bf1e69e9-a858-4270-8c47-a209493f7e48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f5e93ea0-a679-45fb-9178-3842154f2e4d", "address": "fa:16:3e:9a:c8:f6", "network": {"id": "3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026701416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e93ea0-a6", "ovs_interfaceid": "f5e93ea0-a679-45fb-9178-3842154f2e4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "91f6bd16-2cfa-44ca-a7ea-ef3ef4933092", "address": "fa:16:3e:ba:70:ee", "network": {"id": "3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026701416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f6bd16-2c", "ovs_interfaceid": "91f6bd16-2cfa-44ca-a7ea-ef3ef4933092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9e08628c-1ff2-4d4b-9f3d-50231fa6ceec", "address": "fa:16:3e:1d:f8:b7", "network": {"id": "450c1abf-c05a-46dc-9905-3fa42767a540", "bridge": "br-int", "label": "tempest-device-tagging-net2-594797377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e08628c-1f", "ovs_interfaceid": "9e08628c-1ff2-4d4b-9f3d-50231fa6ceec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a566955f-6906-4a3b-bdf1-2f55b31b6e21", "address": "fa:16:3e:cb:ff:df", "network": {"id": "450c1abf-c05a-46dc-9905-3fa42767a540", "bridge": "br-int", "label": "tempest-device-tagging-net2-594797377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa566955f-69", "ovs_interfaceid": "a566955f-6906-4a3b-bdf1-2f55b31b6e21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:52:24.684303 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2df540ea-53fd-4a8a-b5e1-c9fdfe94f003 req-80e742cb-0ca7-4f50-85a9-93ae6e1a114d service nova] Acquired lock "refresh_cache-d3a7c39a-f946-496d-9153-0a422e7f5350" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:52:24.684303 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-2df540ea-53fd-4a8a-b5e1-c9fdfe94f003 req-80e742cb-0ca7-4f50-85a9-93ae6e1a114d service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Refreshing network info cache for port 9e08628c-1ff2-4d4b-9f3d-50231fa6ceec {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:52:24.685423 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Start _get_guest_xml network_info=[{"id": "0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8", "address": "fa:16:3e:54:87:27", "network": {"id": "f48f059f-2a4c-46cc-9281-c2a228bf4514", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-256433360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e04c6bd-fb", "ovs_interfaceid": "0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d994306-44d7-4407-94eb-49b142832ffc", "address": "fa:16:3e:ab:fd:ca", "network": {"id": "3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026701416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d994306-44", "ovs_interfaceid": "3d994306-44d7-4407-94eb-49b142832ffc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bf1e69e9-a858-4270-8c47-a209493f7e48", "address": "fa:16:3e:18:87:d6", "network": {"id": "3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026701416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf1e69e9-a8", "ovs_interfaceid": "bf1e69e9-a858-4270-8c47-a209493f7e48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f5e93ea0-a679-45fb-9178-3842154f2e4d", "address": "fa:16:3e:9a:c8:f6", "network": {"id": "3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026701416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e93ea0-a6", "ovs_interfaceid": "f5e93ea0-a679-45fb-9178-3842154f2e4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "91f6bd16-2cfa-44ca-a7ea-ef3ef4933092", "address": "fa:16:3e:ba:70:ee", "network": {"id": "3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026701416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f6bd16-2c", "ovs_interfaceid": "91f6bd16-2cfa-44ca-a7ea-ef3ef4933092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9e08628c-1ff2-4d4b-9f3d-50231fa6ceec", "address": "fa:16:3e:1d:f8:b7", "network": {"id": "450c1abf-c05a-46dc-9905-3fa42767a540", "bridge": "br-int", "label": "tempest-device-tagging-net2-594797377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e08628c-1f", "ovs_interfaceid": "9e08628c-1ff2-4d4b-9f3d-50231fa6ceec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a566955f-6906-4a3b-bdf1-2f55b31b6e21", "address": "fa:16:3e:cb:ff:df", "network": {"id": "450c1abf-c05a-46dc-9905-3fa42767a540", "bridge": "br-int", "label": "tempest-device-tagging-net2-594797377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa566955f-69", "ovs_interfaceid": "a566955f-6906-4a3b-bdf1-2f55b31b6e21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8', 'iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5882db55-1e44-4bae-be6c-74bd366d0eb8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'd3a7c39a-f946-496d-9153-0a422e7f5350', 'attached_at': '', 'detached_at': '', 'volume_id': '5882db55-1e44-4bae-be6c-74bd366d0eb8', 'serial': '5882db55-1e44-4bae-be6c-74bd366d0eb8'}, 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'f8fdadcb-8574-487a-b18d-ae5b2ba45467', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02', 'iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7ddf6798-56b7-484e-8f23-b19628080e02', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'd3a7c39a-f946-496d-9153-0a422e7f5350', 'attached_at': '', 'detached_at': '', 'volume_id': '7ddf6798-56b7-484e-8f23-b19628080e02', 'serial': '7ddf6798-56b7-484e-8f23-b19628080e02'}, 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'boot_index': 1, 'attachment_id': '02dde8c1-81d0-493a-9946-d7279a3b2802', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb', 'iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fe81d64a-afda-41db-b18c-986ff2d9fbcb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'd3a7c39a-f946-496d-9153-0a422e7f5350', 'attached_at': '', 'detached_at': '', 'volume_id': 'fe81d64a-afda-41db-b18c-986ff2d9fbcb', 'serial': 'fe81d64a-afda-41db-b18c-986ff2d9fbcb'}, 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'boot_index': 2, 'attachment_id': '4e14cab6-17ad-4175-ae27-470d1e2f6a33', 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:52:24.689986 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:52:24.691166 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1355324420', uuid='d3a7c39a-f946-496d-9153-0a422e7f5350'), owner=OwnerMeta(userid='d5369516340f4495b7f29ffd82dd9654', username='tempest-TaggedBootDevicesTest-1330490836-project-member', projectid='e94701d7485c4c46adefaf3637f27990', projectname='tempest-TaggedBootDevicesTest-1330490836'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8", "address": "fa:16:3e:54:87:27", "network": {"id": "f48f059f-2a4c-46cc-9281-c2a228bf4514", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-256433360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e04c6bd-fb", "ovs_interfaceid": "0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d994306-44d7-4407-94eb-49b142832ffc", "address": "fa:16:3e:ab:fd:ca", "network": {"id": "3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026701416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d994306-44", "ovs_interfaceid": "3d994306-44d7-4407-94eb-49b142832ffc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bf1e69e9-a858-4270-8c47-a209493f7e48", "address": "fa:16:3e:18:87:d6", "network": {"id": "3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026701416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf1e69e9-a8", "ovs_interfaceid": "bf1e69e9-a858-4270-8c47-a209493f7e48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f5e93ea0-a679-45fb-9178-3842154f2e4d", "address": "fa:16:3e:9a:c8:f6", "network": {"id": "3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026701416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e93ea0-a6", "ovs_interfaceid": "f5e93ea0-a679-45fb-9178-3842154f2e4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "91f6bd16-2cfa-44ca-a7ea-ef3ef4933092", "address": "fa:16:3e:ba:70:ee", "network": {"id": "3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026701416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f6bd16-2c", "ovs_interfaceid": "91f6bd16-2cfa-44ca-a7ea-ef3ef4933092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9e08628c-1ff2-4d4b-9f3d-50231fa6ceec", "address": "fa:16:3e:1d:f8:b7", "network": {"id": "450c1abf-c05a-46dc-9905-3fa42767a540", "bridge": "br-int", "label": "tempest-device-tagging-net2-594797377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e08628c-1f", "ovs_interfaceid": "9e08628c-1ff2-4d4b-9f3d-50231fa6ceec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a566955f-6906-4a3b-bdf1-2f55b31b6e21", "address": "fa:16:3e:cb:ff:df", "network": {"id": "450c1abf-c05a-46dc-9905-3fa42767a540", "bridge": "br-int", "label": "tempest-device-tagging-net2-594797377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa566955f-69", "ovs_interfaceid": "a566955f-6906-4a3b-bdf1-2f55b31b6e21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933144.6906543) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:52:24.692449 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:52:24.693881 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:52:24.695165 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:52:24.695252 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:52:24.696266 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:52:24.696610 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:52:24.696704 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:52:24.696802 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:52:24.696916 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:52:24.697004 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:52:24.697107 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:52:24.697318 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:52:24.697415 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:52:24.697541 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:52:24.697665 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:52:24.697778 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:52:24.722226 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:52:24.722391 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8', 'iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5882db55-1e44-4bae-be6c-74bd366d0eb8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:52:24.722527 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:52:24.724501 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:52:24.724501 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8', 'iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5882db55-1e44-4bae-be6c-74bd366d0eb8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:52:24.739011 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:52:24.739351 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:52:24.739509 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:52:24.742251 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:52:24.742533 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:52:24.742662 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:52:24.752580 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:52:24.752580 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:24.757527 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:52:24.757527 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:24.766717 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8] added
May 28 01:52:24.766717 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:52:24.766717 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:52:24.766717 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:52:24.766717 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:52:24.766717 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:52:24.766717 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:24.767052 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:52:24.767115 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0275(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:52:24.767276 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:52:24.768147 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8] added
May 28 01:52:24.768147 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:52:24.768147 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:52:24.768147 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:52:24.768147 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:52:24.768147 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:52:24.768147 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:24.768384 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:52:24.768504 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0258(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:52:24.768630 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:52:25.116311 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-aeee6d00-6e32-4e73-8ea1-7278609d3f9a req-092c6da7-8cae-4a3f-bf4a-f2556c9a819d service nova] Releasing lock "refresh_cache-f2805796-e531-4508-8585-0d110f4bd4e7" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:52:25.117796 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Acquired lock "refresh_cache-f2805796-e531-4508-8585-0d110f4bd4e7" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:52:25.117796 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:52:25.190146 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-2df540ea-53fd-4a8a-b5e1-c9fdfe94f003 req-80e742cb-0ca7-4f50-85a9-93ae6e1a114d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:25.221569 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a03a288c-6038-40b0-a99b-783577993612 tempest-DeleteServersTestJSON-1865350861 tempest-DeleteServersTestJSON-1865350861-project-member] Lock "bfb723e1-a6b7-460b-b115-62d1f2922066" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.288s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:25.536163 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-2df540ea-53fd-4a8a-b5e1-c9fdfe94f003 req-80e742cb-0ca7-4f50-85a9-93ae6e1a114d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:25.702195 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-2df540ea-53fd-4a8a-b5e1-c9fdfe94f003 req-80e742cb-0ca7-4f50-85a9-93ae6e1a114d service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Updated VIF entry in instance network info cache for port 9e08628c-1ff2-4d4b-9f3d-50231fa6ceec. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:52:25.702898 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-2df540ea-53fd-4a8a-b5e1-c9fdfe94f003 req-80e742cb-0ca7-4f50-85a9-93ae6e1a114d service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Updating instance_info_cache with network_info: [{"id": "0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8", "address": "fa:16:3e:54:87:27", "network": {"id": "f48f059f-2a4c-46cc-9281-c2a228bf4514", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-256433360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e04c6bd-fb", "ovs_interfaceid": "0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d994306-44d7-4407-94eb-49b142832ffc", "address": "fa:16:3e:ab:fd:ca", "network": {"id": "3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026701416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d994306-44", "ovs_interfaceid": "3d994306-44d7-4407-94eb-49b142832ffc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bf1e69e9-a858-4270-8c47-a209493f7e48", "address": "fa:16:3e:18:87:d6", "network": {"id": "3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026701416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf1e69e9-a8", "ovs_interfaceid": "bf1e69e9-a858-4270-8c47-a209493f7e48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f5e93ea0-a679-45fb-9178-3842154f2e4d", "address": "fa:16:3e:9a:c8:f6", "network": {"id": "3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026701416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e93ea0-a6", "ovs_interfaceid": "f5e93ea0-a679-45fb-9178-3842154f2e4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "91f6bd16-2cfa-44ca-a7ea-ef3ef4933092", "address": "fa:16:3e:ba:70:ee", "network": {"id": "3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026701416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f6bd16-2c", "ovs_interfaceid": "91f6bd16-2cfa-44ca-a7ea-ef3ef4933092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9e08628c-1ff2-4d4b-9f3d-50231fa6ceec", "address": "fa:16:3e:1d:f8:b7", "network": {"id": "450c1abf-c05a-46dc-9905-3fa42767a540", "bridge": "br-int", "label": "tempest-device-tagging-net2-594797377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e08628c-1f", "ovs_interfaceid": "9e08628c-1ff2-4d4b-9f3d-50231fa6ceec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a566955f-6906-4a3b-bdf1-2f55b31b6e21", "address": "fa:16:3e:cb:ff:df", "network": {"id": "450c1abf-c05a-46dc-9905-3fa42767a540", "bridge": "br-int", "label": "tempest-device-tagging-net2-594797377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa566955f-69", "ovs_interfaceid": "a566955f-6906-4a3b-bdf1-2f55b31b6e21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:52:25.730940 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:52:25.767764 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:52:25.769020 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:52:25.784036 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:52:25.784036 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:52:25.787873 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:52:25.787873 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:25.799564 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:25.809070 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:25.810535 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 01:52:25.810535 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:52:25.810638 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 01:52:25.810638 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:52:25.810760 np0000001583 nova-compute[98241]: WARNING os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 01:52:25.810760 np0000001583 nova-compute[98241]: 
May 28 01:52:25.824720 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 01:52:25.824720 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:52:25.826241 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 01:52:25.826241 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:52:25.826241 np0000001583 nova-compute[98241]: WARNING os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 01:52:25.826241 np0000001583 nova-compute[98241]: 
May 28 01:52:25.844112 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8, portal: 192.168.50.100,3260]
May 28 01:52:25.844112 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8, portal: 192.168.50.100,3260] successful.
May 28 01:52:25.844112 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:25.858437 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:25.867674 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8, portal: 192.168.40.100,3260]
May 28 01:52:25.867674 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8, portal: 192.168.40.100,3260] successful.
May 28 01:52:25.867674 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:25.873687 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:25.873687 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:25.873687 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:52:25.873890 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsi session list stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:25.873890 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:25.873890 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:52:25.874221 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.132s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:52:25.874365 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:52:25.874840 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] HCTL ('7', '-', '-', 0) found on session 5 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:52:25.874947 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:52:25.882132 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:25.906473 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:25.906473 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:25.906473 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:52:25.907667 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsi session list stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:25.907667 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:25.907667 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:52:25.908284 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.169s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:52:25.908760 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:52:25.910091 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Searching for a device in session 5 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:52:25.910091 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '5882db55-1e44-4bae-be6c-74bd366d0eb8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:52:25.910536 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] HCTL ('8', '-', '-', 0) found on session 6 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:52:25.910536 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:52:25.930360 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Searching for a device in session 6 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:52:25.930360 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5882db55-1e44-4bae-be6c-74bd366d0eb8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:52:25.986599 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:26.178611 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Updating instance_info_cache with network_info: [{"id": "6835d977-7c34-4bd7-8d12-208432ea45d3", "address": "fa:16:3e:91:a6:69", "network": {"id": "2043727d-617f-4eff-98e6-5d58f439532d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1616658634-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e37a40d1db45cba9235de04219a3b4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6835d977-7c", "ovs_interfaceid": "6835d977-7c34-4bd7-8d12-208432ea45d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:52:26.205404 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2df540ea-53fd-4a8a-b5e1-c9fdfe94f003 req-80e742cb-0ca7-4f50-85a9-93ae6e1a114d service nova] Releasing lock "refresh_cache-d3a7c39a-f946-496d-9153-0a422e7f5350" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:52:26.205695 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2df540ea-53fd-4a8a-b5e1-c9fdfe94f003 req-80e742cb-0ca7-4f50-85a9-93ae6e1a114d service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-changed-a566955f-6906-4a3b-bdf1-2f55b31b6e21 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:26.205892 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2df540ea-53fd-4a8a-b5e1-c9fdfe94f003 req-80e742cb-0ca7-4f50-85a9-93ae6e1a114d service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Refreshing instance network info cache due to event network-changed-a566955f-6906-4a3b-bdf1-2f55b31b6e21. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:52:26.206206 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2df540ea-53fd-4a8a-b5e1-c9fdfe94f003 req-80e742cb-0ca7-4f50-85a9-93ae6e1a114d service nova] Acquiring lock "refresh_cache-d3a7c39a-f946-496d-9153-0a422e7f5350" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:52:26.206293 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2df540ea-53fd-4a8a-b5e1-c9fdfe94f003 req-80e742cb-0ca7-4f50-85a9-93ae6e1a114d service nova] Acquired lock "refresh_cache-d3a7c39a-f946-496d-9153-0a422e7f5350" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:52:26.206438 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-2df540ea-53fd-4a8a-b5e1-c9fdfe94f003 req-80e742cb-0ca7-4f50-85a9-93ae6e1a114d service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Refreshing network info cache for port a566955f-6906-4a3b-bdf1-2f55b31b6e21 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:52:26.409987 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:52:26.411343 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:52:26.411612 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Creating image(s)
May 28 01:52:26.411970 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Did not create local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 01:52:26.412278 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Ensure instance console log exists: /opt/stack/data/nova/instances/f2805796-e531-4508-8585-0d110f4bd4e7/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:52:26.412558 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:26.412772 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:26.412936 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:26.680686 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Releasing lock "refresh_cache-f2805796-e531-4508-8585-0d110f4bd4e7" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:52:26.680911 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Instance network_info: |[{"id": "6835d977-7c34-4bd7-8d12-208432ea45d3", "address": "fa:16:3e:91:a6:69", "network": {"id": "2043727d-617f-4eff-98e6-5d58f439532d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1616658634-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e37a40d1db45cba9235de04219a3b4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6835d977-7c", "ovs_interfaceid": "6835d977-7c34-4bd7-8d12-208432ea45d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:52:26.682095 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Start _get_guest_xml network_info=[{"id": "6835d977-7c34-4bd7-8d12-208432ea45d3", "address": "fa:16:3e:91:a6:69", "network": {"id": "2043727d-617f-4eff-98e6-5d58f439532d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1616658634-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e37a40d1db45cba9235de04219a3b4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6835d977-7c", "ovs_interfaceid": "6835d977-7c34-4bd7-8d12-208432ea45d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9', 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ac79736b-8037-45cb-a9eb-510556b680f9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'f2805796-e531-4508-8585-0d110f4bd4e7', 'attached_at': '', 'detached_at': '', 'volume_id': 'ac79736b-8037-45cb-a9eb-510556b680f9', 'serial': 'ac79736b-8037-45cb-a9eb-510556b680f9'}, 'delete_on_termination': True, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '58570f07-60cd-41fa-99f2-1e08d6c51b3e', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:52:26.684576 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:52:26.685415 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsV293TestJSON-server-2040873444', uuid='f2805796-e531-4508-8585-0d110f4bd4e7'), owner=OwnerMeta(userid='bff6dc118f2e4efc8d499d4614565377', username='tempest-ServerActionsV293TestJSON-716114863-project-member', projectid='23e37a40d1db45cba9235de04219a3b4', projectname='tempest-ServerActionsV293TestJSON-716114863'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6835d977-7c34-4bd7-8d12-208432ea45d3", "address": "fa:16:3e:91:a6:69", "network": {"id": "2043727d-617f-4eff-98e6-5d58f439532d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1616658634-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e37a40d1db45cba9235de04219a3b4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6835d977-7c", "ovs_interfaceid": "6835d977-7c34-4bd7-8d12-208432ea45d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933146.6851637) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:52:26.686068 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:52:26.686392 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:52:26.686978 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:52:26.687138 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:52:26.687774 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:52:26.688029 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:52:26.688170 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:52:26.688260 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:52:26.688385 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:52:26.688461 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:52:26.688545 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:52:26.688679 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:52:26.688793 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:52:26.688895 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:52:26.688994 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:52:26.689112 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:52:26.697968 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:52:26.698204 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9', 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ac79736b-8037-45cb-a9eb-510556b680f9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:52:26.698332 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:52:26.711594 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-2df540ea-53fd-4a8a-b5e1-c9fdfe94f003 req-80e742cb-0ca7-4f50-85a9-93ae6e1a114d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:26.744537 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:52:27.056486 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-2df540ea-53fd-4a8a-b5e1-c9fdfe94f003 req-80e742cb-0ca7-4f50-85a9-93ae6e1a114d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:27.251934 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-2df540ea-53fd-4a8a-b5e1-c9fdfe94f003 req-80e742cb-0ca7-4f50-85a9-93ae6e1a114d service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Updated VIF entry in instance network info cache for port a566955f-6906-4a3b-bdf1-2f55b31b6e21. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:52:27.252793 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-2df540ea-53fd-4a8a-b5e1-c9fdfe94f003 req-80e742cb-0ca7-4f50-85a9-93ae6e1a114d service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Updating instance_info_cache with network_info: [{"id": "0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8", "address": "fa:16:3e:54:87:27", "network": {"id": "f48f059f-2a4c-46cc-9281-c2a228bf4514", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-256433360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e04c6bd-fb", "ovs_interfaceid": "0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d994306-44d7-4407-94eb-49b142832ffc", "address": "fa:16:3e:ab:fd:ca", "network": {"id": "3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026701416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d994306-44", "ovs_interfaceid": "3d994306-44d7-4407-94eb-49b142832ffc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bf1e69e9-a858-4270-8c47-a209493f7e48", "address": "fa:16:3e:18:87:d6", "network": {"id": "3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026701416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf1e69e9-a8", "ovs_interfaceid": "bf1e69e9-a858-4270-8c47-a209493f7e48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f5e93ea0-a679-45fb-9178-3842154f2e4d", "address": "fa:16:3e:9a:c8:f6", "network": {"id": "3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026701416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e93ea0-a6", "ovs_interfaceid": "f5e93ea0-a679-45fb-9178-3842154f2e4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "91f6bd16-2cfa-44ca-a7ea-ef3ef4933092", "address": "fa:16:3e:ba:70:ee", "network": {"id": "3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026701416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f6bd16-2c", "ovs_interfaceid": "91f6bd16-2cfa-44ca-a7ea-ef3ef4933092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9e08628c-1ff2-4d4b-9f3d-50231fa6ceec", "address": "fa:16:3e:1d:f8:b7", "network": {"id": "450c1abf-c05a-46dc-9905-3fa42767a540", "bridge": "br-int", "label": "tempest-device-tagging-net2-594797377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e08628c-1f", "ovs_interfaceid": "9e08628c-1ff2-4d4b-9f3d-50231fa6ceec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a566955f-6906-4a3b-bdf1-2f55b31b6e21", "address": "fa:16:3e:cb:ff:df", "network": {"id": "450c1abf-c05a-46dc-9905-3fa42767a540", "bridge": "br-int", "label": "tempest-device-tagging-net2-594797377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa566955f-69", "ovs_interfaceid": "a566955f-6906-4a3b-bdf1-2f55b31b6e21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:52:27.755186 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2df540ea-53fd-4a8a-b5e1-c9fdfe94f003 req-80e742cb-0ca7-4f50-85a9-93ae6e1a114d service nova] Releasing lock "refresh_cache-d3a7c39a-f946-496d-9153-0a422e7f5350" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:52:27.759182 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Found WWN 3300000002a0693ae for multipath device dm-0 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:52:27.759182 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:52:27.759182 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] <== connect_volume: return (3036ms) {'type': 'block', 'scsi_wwn': '3300000002a0693ae', 'path': '/dev/dm-0', 'multipath_id': '3300000002a0693ae'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:52:27.759182 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002a0693ae', 'path': '/dev/dm-0', 'multipath_id': '3300000002a0693ae'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:52:27.759437 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.061s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:52:27.759626 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9', 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ac79736b-8037-45cb-a9eb-510556b680f9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:52:27.771257 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:52:27.771785 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:52:27.772375 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:52:27.772569 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:52:27.772858 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:52:27.773051 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:52:27.773973 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:27.785240 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:52:27.785240 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:27.789340 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:52:27.789340 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:27.797391 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9] added
May 28 01:52:27.797391 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:52:27.797391 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:52:27.797391 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:52:27.797391 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:52:27.797391 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:52:27.797391 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:27.797563 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:52:27.797671 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0251(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:52:27.797789 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:52:27.799581 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9] added
May 28 01:52:27.799581 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:52:27.799581 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:52:27.799581 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:52:27.799581 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:52:27.799581 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:52:27.799581 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:27.799780 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:52:27.799927 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0268(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:52:27.800062 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:52:28.265108 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:52:28.265108 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02', 'iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7ddf6798-56b7-484e-8f23-b19628080e02', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:52:28.265108 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:52:28.800605 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:52:28.803448 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:52:28.821814 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:52:28.821814 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:52:28.826757 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:52:28.826757 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:28.838721 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:28.845993 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:28.856629 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:28.856629 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:28.856629 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:52:28.856736 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsi session list stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:28.856736 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:28.856736 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:52:28.865683 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:28.865683 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:28.865683 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:52:28.865856 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsi session list stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:28.865856 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:28.865856 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:52:28.871049 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:28.897478 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9, portal: 192.168.50.100,3260]
May 28 01:52:28.897478 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9, portal: 192.168.50.100,3260] successful.
May 28 01:52:28.897478 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:28.908753 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:28.916176 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9, portal: 192.168.40.100,3260]
May 28 01:52:28.916176 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9, portal: 192.168.40.100,3260] successful.
May 28 01:52:28.916176 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:28.923202 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:28.923202 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:28.923202 np0000001583 nova-compute[98241]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:28.923202 np0000001583 nova-compute[98241]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:28.923202 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:52:28.923401 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsi session list stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:28.923401 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:28.923401 np0000001583 nova-compute[98241]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:28.923401 np0000001583 nova-compute[98241]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:28.923401 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:52:28.923610 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.151s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:52:28.923758 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:52:28.924542 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] HCTL ('9', '-', '-', 0) found on session 7 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:52:28.924697 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:52:28.929865 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:28.942911 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Searching for a device in session 7 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:52:28.942911 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ac79736b-8037-45cb-a9eb-510556b680f9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:52:28.946273 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:28.946273 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:28.946273 np0000001583 nova-compute[98241]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:28.946273 np0000001583 nova-compute[98241]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:28.946273 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:52:28.946849 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsi session list stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:28.946849 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:28.946849 np0000001583 nova-compute[98241]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:28.946849 np0000001583 nova-compute[98241]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:28.946849 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:52:28.947650 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.175s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:52:28.947650 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:52:28.948108 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] HCTL ('10', '-', '-', 0) found on session 8 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:52:28.948260 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:52:28.961136 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Searching for a device in session 8 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:52:28.961136 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ac79736b-8037-45cb-a9eb-510556b680f9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:52:29.332344 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:29.772892 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:52:30.800312 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Found WWN 330000000dd10e4b9 for multipath device dm-3 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:52:30.800312 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:52:30.800312 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] <== connect_volume: return (4101ms) {'type': 'block', 'scsi_wwn': '330000000dd10e4b9', 'path': '/dev/dm-3', 'multipath_id': '330000000dd10e4b9'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:52:30.800312 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000dd10e4b9', 'path': '/dev/dm-3', 'multipath_id': '330000000dd10e4b9'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:52:30.800818 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.537s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:52:30.800882 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02', 'iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7ddf6798-56b7-484e-8f23-b19628080e02', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:52:30.814831 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:52:30.815918 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:52:30.816429 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:52:30.817070 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:52:30.817564 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:52:30.817749 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:52:30.831571 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:52:30.831571 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:30.846260 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:52:30.846260 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:30.849862 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02] added
May 28 01:52:30.849862 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:52:30.849862 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:52:30.849862 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:52:30.849862 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:52:30.849862 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:52:30.849862 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:30.851043 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:52:30.851043 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0338(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:52:30.851043 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:52:30.863168 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02] added
May 28 01:52:30.863168 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:52:30.863168 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:52:30.863168 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:52:30.863168 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:52:30.863168 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:52:30.863168 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:30.863512 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:52:30.863570 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0462(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:52:30.863706 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:52:31.309367 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:52:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2040873444',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-serveractionsv293testjson-server-2040873444',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNU/wFJvIXv98vi6aYo5JdgOO26yK3H8M5Fwr9L6B9TgZZAeaxeYClgf/riTA9gRggFDSHAHQ2WWHr+BBFeB2YnkUvKZLTUbGagtUk9wt6ZgeubZXG0bqVpSP2PvleXU0w==',key_name='tempest-keypair-1710605134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23e37a40d1db45cba9235de04219a3b4',ramdisk_id='',reservation_id='r-0idxh519',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-716114863',owner_user_name='tempest-ServerActionsV293TestJSON-716114863-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:52:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bff6dc118f2e4efc8d499d4614565377',uuid=f2805796-e531-4508-8585-0d110f4bd4e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6835d977-7c34-4bd7-8d12-208432ea45d3", "address": "fa:16:3e:91:a6:69", "network": {"id": "2043727d-617f-4eff-98e6-5d58f439532d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1616658634-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e37a40d1db45cba9235de04219a3b4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6835d977-7c", "ovs_interfaceid": "6835d977-7c34-4bd7-8d12-208432ea45d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:52:31.309367 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Converting VIF {"id": "6835d977-7c34-4bd7-8d12-208432ea45d3", "address": "fa:16:3e:91:a6:69", "network": {"id": "2043727d-617f-4eff-98e6-5d58f439532d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1616658634-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e37a40d1db45cba9235de04219a3b4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6835d977-7c", "ovs_interfaceid": "6835d977-7c34-4bd7-8d12-208432ea45d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:52:31.309367 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:a6:69,bridge_name='br-int',has_traffic_filtering=True,id=6835d977-7c34-4bd7-8d12-208432ea45d3,network=Network(2043727d-617f-4eff-98e6-5d58f439532d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6835d977-7c') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:52:31.309367 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Lazy-loading 'pci_devices' on Instance uuid f2805796-e531-4508-8585-0d110f4bd4e7 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:52:31.816287 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] End _get_guest_xml xml=<domain type="qemu">
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:   <uuid>f2805796-e531-4508-8585-0d110f4bd4e7</uuid>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:   <name>instance-00000008</name>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:       <nova:name>tempest-ServerActionsV293TestJSON-server-2040873444</nova:name>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:52:26</nova:creationTime>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:       <nova:image uuid="">
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:         <nova:user uuid="bff6dc118f2e4efc8d499d4614565377">tempest-ServerActionsV293TestJSON-716114863-project-member</nova:user>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:         <nova:project uuid="23e37a40d1db45cba9235de04219a3b4">tempest-ServerActionsV293TestJSON-716114863</nova:project>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:       <nova:root type="volume" uuid=""/>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:         <nova:port uuid="6835d977-7c34-4bd7-8d12-208432ea45d3">
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:     <system>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:       <entry name="serial">f2805796-e531-4508-8585-0d110f4bd4e7</entry>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:       <entry name="uuid">f2805796-e531-4508-8585-0d110f4bd4e7</entry>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:     </system>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:   <os>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:   </os>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:   <features>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:   </features>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:   <devices>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/f2805796-e531-4508-8585-0d110f4bd4e7/disk.config"/>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:     </disk>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:     <disk type="block" device="disk">
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:       <alias name="ua-ac79736b-8037-45cb-a9eb-510556b680f9"/>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:       <source dev="/dev/dm-3"/>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:       <serial>ac79736b-8037-45cb-a9eb-510556b680f9</serial>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:     </disk>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:91:a6:69"/>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:       <target dev="tap6835d977-7c"/>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:     </interface>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/f2805796-e531-4508-8585-0d110f4bd4e7/console.log" append="off"/>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:     </serial>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:     <video>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:     </video>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:     </rng>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:   </devices>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]: </domain>
May 28 01:52:31.816287 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:52:31.820356 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Preparing to wait for external event network-vif-plugged-6835d977-7c34-4bd7-8d12-208432ea45d3 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:52:31.820356 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Acquiring lock "f2805796-e531-4508-8585-0d110f4bd4e7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:31.820356 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Lock "f2805796-e531-4508-8585-0d110f4bd4e7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:31.820356 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Lock "f2805796-e531-4508-8585-0d110f4bd4e7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:31.820356 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:52:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2040873444',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-serveractionsv293testjson-server-2040873444',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNU/wFJvIXv98vi6aYo5JdgOO26yK3H8M5Fwr9L6B9TgZZAeaxeYClgf/riTA9gRggFDSHAHQ2WWHr+BBFeB2YnkUvKZLTUbGagtUk9wt6ZgeubZXG0bqVpSP2PvleXU0w==',key_name='tempest-keypair-1710605134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23e37a40d1db45cba9235de04219a3b4',ramdisk_id='',reservation_id='r-0idxh519',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-716114863',owner_user_name='tempest-ServerActionsV293TestJSON-716114863-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:52:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bff6dc118f2e4efc8d499d4614565377',uuid=f2805796-e531-4508-8585-0d110f4bd4e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6835d977-7c34-4bd7-8d12-208432ea45d3", "address": "fa:16:3e:91:a6:69", "network": {"id": "2043727d-617f-4eff-98e6-5d58f439532d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1616658634-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e37a40d1db45cba9235de04219a3b4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6835d977-7c", "ovs_interfaceid": "6835d977-7c34-4bd7-8d12-208432ea45d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:52:31.820356 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Converting VIF {"id": "6835d977-7c34-4bd7-8d12-208432ea45d3", "address": "fa:16:3e:91:a6:69", "network": {"id": "2043727d-617f-4eff-98e6-5d58f439532d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1616658634-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e37a40d1db45cba9235de04219a3b4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6835d977-7c", "ovs_interfaceid": "6835d977-7c34-4bd7-8d12-208432ea45d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:52:31.820356 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:a6:69,bridge_name='br-int',has_traffic_filtering=True,id=6835d977-7c34-4bd7-8d12-208432ea45d3,network=Network(2043727d-617f-4eff-98e6-5d58f439532d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6835d977-7c') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:52:31.821420 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:a6:69,bridge_name='br-int',has_traffic_filtering=True,id=6835d977-7c34-4bd7-8d12-208432ea45d3,network=Network(2043727d-617f-4eff-98e6-5d58f439532d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6835d977-7c') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:52:31.821854 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:31.822168 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:31.822444 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:52:31.823157 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:31.823391 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4d9e3ddd-48da-5b7a-8d36-e614876a03df', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:31.824355 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:31.825334 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:52:31.827048 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:31.829754 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:31.830005 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6835d977-7c, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:31.830560 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6835d977-7c, col_values=(('qos', UUID('bae133a5-63ad-4b6b-b31c-782f08eef61c')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:31.830763 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6835d977-7c, col_values=(('external_ids', {'iface-id': '6835d977-7c34-4bd7-8d12-208432ea45d3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:a6:69', 'vm-uuid': 'f2805796-e531-4508-8585-0d110f4bd4e7'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:31.831692 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:31.833513 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:52:31.838670 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:31.839528 np0000001583 nova-compute[98241]: INFO os_vif [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:a6:69,bridge_name='br-int',has_traffic_filtering=True,id=6835d977-7c34-4bd7-8d12-208432ea45d3,network=Network(2043727d-617f-4eff-98e6-5d58f439532d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6835d977-7c')
May 28 01:52:31.851981 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:52:31.864118 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:52:31.868492 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:52:31.868492 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:52:31.879805 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:52:31.879805 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:31.886448 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:31.893017 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:31.900901 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:31.900901 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:31.900901 np0000001583 nova-compute[98241]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:31.900901 np0000001583 nova-compute[98241]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:31.900901 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:52:31.900901 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsi session list stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:31.900901 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:31.900901 np0000001583 nova-compute[98241]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:31.900901 np0000001583 nova-compute[98241]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:31.900901 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:52:31.910503 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:31.910503 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:31.910503 np0000001583 nova-compute[98241]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:31.910503 np0000001583 nova-compute[98241]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:31.910503 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:52:31.910725 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsi session list stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:31.910725 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:31.910725 np0000001583 nova-compute[98241]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:31.910725 np0000001583 nova-compute[98241]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:31.910725 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:52:31.949409 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02, portal: 192.168.50.100,3260]
May 28 01:52:31.949409 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02, portal: 192.168.50.100,3260] successful.
May 28 01:52:31.949409 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:31.960474 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:31.965754 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02, portal: 192.168.40.100,3260]
May 28 01:52:31.965754 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02, portal: 192.168.40.100,3260] successful.
May 28 01:52:31.965754 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:31.978118 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:52:31.978118 np0000001583 nova-compute[98241]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:31.978118 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:31.978118 np0000001583 nova-compute[98241]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:31.978118 np0000001583 nova-compute[98241]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:31.978118 np0000001583 nova-compute[98241]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:52:31.978118 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:52:31.979881 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:52:31.979881 np0000001583 nova-compute[98241]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:31.979881 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:31.979881 np0000001583 nova-compute[98241]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:31.979881 np0000001583 nova-compute[98241]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:31.979881 np0000001583 nova-compute[98241]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:52:31.979881 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:52:31.979881 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.163s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:52:31.979881 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:52:31.979881 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] HCTL ('11', '-', '-', 0) found on session 9 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:52:31.979881 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:52:31.985093 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:31.999452 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Searching for a device in session 9 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:52:31.999452 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7ddf6798-56b7-484e-8f23-b19628080e02', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:52:32.005845 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:52:32.005845 np0000001583 nova-compute[98241]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:32.005845 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:32.005845 np0000001583 nova-compute[98241]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:32.005845 np0000001583 nova-compute[98241]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:32.005845 np0000001583 nova-compute[98241]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:52:32.005845 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:52:32.005845 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:52:32.005845 np0000001583 nova-compute[98241]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:32.005845 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:32.005845 np0000001583 nova-compute[98241]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:32.005845 np0000001583 nova-compute[98241]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:32.005845 np0000001583 nova-compute[98241]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:52:32.005845 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:52:32.005845 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.189s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:52:32.005845 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:52:32.007338 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] HCTL ('12', '-', '-', 0) found on session 10 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:52:32.007497 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:52:32.031770 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Searching for a device in session 10 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:52:32.032393 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7ddf6798-56b7-484e-8f23-b19628080e02', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:52:32.776111 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:32.822646 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:52:33.358052 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:52:33.358270 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:52:33.358270 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] No VIF found with MAC fa:16:3e:91:a6:69, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:52:33.358612 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Using config drive
May 28 01:52:33.617307 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:33.791364 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0007484129998829303 future=<Future at 0x7724f844d970 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:52:33.791492 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:52:33.792659 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1779933138.790254, bfb723e1-a6b7-460b-b115-62d1f2922066 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:52:33.792659 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] VM Stopped (Lifecycle Event)
May 28 01:52:33.838368 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Found WWN 3300000002fcf1c98 for multipath device dm-6 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:52:33.838739 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:52:33.838739 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] <== connect_volume: return (5575ms) {'type': 'block', 'scsi_wwn': '3300000002fcf1c98', 'path': '/dev/dm-6', 'multipath_id': '3300000002fcf1c98'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:52:33.838873 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002fcf1c98', 'path': '/dev/dm-6', 'multipath_id': '3300000002fcf1c98'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:52:33.863067 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:33.976220 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Creating config drive at /opt/stack/data/nova/instances/f2805796-e531-4508-8585-0d110f4bd4e7/disk.config
May 28 01:52:33.980056 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f2805796-e531-4508-8585-0d110f4bd4e7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2f91ghs3 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:52:34.008654 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f2805796-e531-4508-8585-0d110f4bd4e7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2f91ghs3" returned: 0 in 0.028s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:52:34.295357 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-0ccf149b-6cfc-4eb2-b8eb-99d61b74aa7b None None] [instance: bfb723e1-a6b7-460b-b115-62d1f2922066] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:52:34.344933 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:52:34.345362 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb', 'iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fe81d64a-afda-41db-b18c-986ff2d9fbcb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:52:34.345538 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:52:34.457484 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:34.496848 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:34.584243 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:34.844511 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:34.846178 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:34.849038 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:34.850659 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:34.869915 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:35.327967 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933155.3275945, f2805796-e531-4508-8585-0d110f4bd4e7 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:52:35.328213 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] VM Started (Lifecycle Event)
May 28 01:52:35.832400 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:52:35.839711 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933155.8393717, f2805796-e531-4508-8585-0d110f4bd4e7 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:52:35.839871 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] VM Paused (Lifecycle Event)
May 28 01:52:35.964483 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:36.302895 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.957s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:52:36.302895 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb', 'iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fe81d64a-afda-41db-b18c-986ff2d9fbcb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:52:36.315636 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:52:36.316028 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:52:36.316453 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:52:36.316667 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:52:36.319251 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:52:36.319251 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:52:36.327476 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:52:36.327476 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:36.332171 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:52:36.332171 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:36.338209 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb] added
May 28 01:52:36.338209 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:52:36.338209 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:52:36.338209 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:52:36.338209 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:52:36.338209 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:52:36.338209 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:36.338568 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:52:36.338627 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0219(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:52:36.338812 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:52:36.341438 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb] added
May 28 01:52:36.341438 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:52:36.341438 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:52:36.341438 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:52:36.341438 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:52:36.341438 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:52:36.341438 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:36.341626 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:52:36.341733 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0231(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:52:36.341875 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:52:36.342446 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:52:36.343527 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:52:36.846033 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:52:36.846700 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:37.339340 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:52:37.342711 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:52:37.350806 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:52:37.350806 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:52:37.364023 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:52:37.364023 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:37.370025 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:37.376459 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:37.387548 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:52:37.387548 np0000001583 nova-compute[98241]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-44282e36-4214-4fc0-aa08-c7e71daca625 (non-flash)
May 28 01:52:37.387548 np0000001583 nova-compute[98241]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:37.387548 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:37.387548 np0000001583 nova-compute[98241]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:37.387548 np0000001583 nova-compute[98241]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:37.387548 np0000001583 nova-compute[98241]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:52:37.387548 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:52:37.387853 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:52:37.387853 np0000001583 nova-compute[98241]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-44282e36-4214-4fc0-aa08-c7e71daca625 (non-flash)
May 28 01:52:37.387853 np0000001583 nova-compute[98241]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:37.387853 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:37.387853 np0000001583 nova-compute[98241]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:37.387853 np0000001583 nova-compute[98241]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:37.387853 np0000001583 nova-compute[98241]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:52:37.387853 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:52:37.395744 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:52:37.395744 np0000001583 nova-compute[98241]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-44282e36-4214-4fc0-aa08-c7e71daca625 (non-flash)
May 28 01:52:37.395744 np0000001583 nova-compute[98241]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:37.395744 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:37.395744 np0000001583 nova-compute[98241]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:37.395744 np0000001583 nova-compute[98241]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:37.395744 np0000001583 nova-compute[98241]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:52:37.395744 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:52:37.396068 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:52:37.396068 np0000001583 nova-compute[98241]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-44282e36-4214-4fc0-aa08-c7e71daca625 (non-flash)
May 28 01:52:37.396068 np0000001583 nova-compute[98241]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:37.396068 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:37.396068 np0000001583 nova-compute[98241]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:37.396068 np0000001583 nova-compute[98241]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:37.396068 np0000001583 nova-compute[98241]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:52:37.396068 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:52:37.428212 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb, portal: 192.168.40.100,3260]
May 28 01:52:37.428212 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb, portal: 192.168.40.100,3260] successful.
May 28 01:52:37.428212 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:37.438087 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb, portal: 192.168.50.100,3260]
May 28 01:52:37.438087 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb, portal: 192.168.50.100,3260] successful.
May 28 01:52:37.438087 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:37.446866 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:37.453530 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:37.463935 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:52:37.463935 np0000001583 nova-compute[98241]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-44282e36-4214-4fc0-aa08-c7e71daca625 (non-flash)
May 28 01:52:37.463935 np0000001583 nova-compute[98241]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:52:37.463935 np0000001583 nova-compute[98241]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:52:37.463935 np0000001583 nova-compute[98241]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:37.463935 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:37.463935 np0000001583 nova-compute[98241]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:37.463935 np0000001583 nova-compute[98241]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:37.463935 np0000001583 nova-compute[98241]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:52:37.463935 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:52:37.464307 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:52:37.464307 np0000001583 nova-compute[98241]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-44282e36-4214-4fc0-aa08-c7e71daca625 (non-flash)
May 28 01:52:37.464307 np0000001583 nova-compute[98241]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:52:37.464307 np0000001583 nova-compute[98241]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:52:37.464307 np0000001583 nova-compute[98241]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:37.464307 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:37.464307 np0000001583 nova-compute[98241]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:37.464307 np0000001583 nova-compute[98241]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:37.464307 np0000001583 nova-compute[98241]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:52:37.464307 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:52:37.464490 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.148s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:52:37.464560 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:52:37.465657 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] HCTL ('14', '-', '-', 0) found on session 12 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:52:37.465793 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:52:37.473688 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:52:37.473688 np0000001583 nova-compute[98241]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-44282e36-4214-4fc0-aa08-c7e71daca625 (non-flash)
May 28 01:52:37.473688 np0000001583 nova-compute[98241]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:52:37.473688 np0000001583 nova-compute[98241]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:52:37.473688 np0000001583 nova-compute[98241]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:37.473688 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:37.473688 np0000001583 nova-compute[98241]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:37.473688 np0000001583 nova-compute[98241]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:37.473688 np0000001583 nova-compute[98241]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:52:37.473688 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:52:37.474038 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:52:37.474038 np0000001583 nova-compute[98241]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-44282e36-4214-4fc0-aa08-c7e71daca625 (non-flash)
May 28 01:52:37.474038 np0000001583 nova-compute[98241]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:52:37.474038 np0000001583 nova-compute[98241]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:52:37.474038 np0000001583 nova-compute[98241]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:37.474038 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:37.474038 np0000001583 nova-compute[98241]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:37.474038 np0000001583 nova-compute[98241]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:37.474038 np0000001583 nova-compute[98241]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:52:37.474038 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:52:37.474038 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.156s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:52:37.474487 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:52:37.475004 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] HCTL ('15', '-', '-', 0) found on session 13 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:52:37.475144 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:52:37.484231 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Searching for a device in session 12 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:52:37.485658 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fe81d64a-afda-41db-b18c-986ff2d9fbcb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:52:37.496031 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Searching for a device in session 13 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:52:37.499111 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'fe81d64a-afda-41db-b18c-986ff2d9fbcb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:52:37.779813 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:38.317603 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:52:38.660575 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-dacedcf8-0951-405d-8274-ab4146b1e487 req-3b55fc07-811a-485f-9beb-e49fcad43880 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-vif-unplugged-bf1e69e9-a858-4270-8c47-a209493f7e48 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:38.661007 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-dacedcf8-0951-405d-8274-ab4146b1e487 req-3b55fc07-811a-485f-9beb-e49fcad43880 service nova] Acquiring lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:38.661007 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-dacedcf8-0951-405d-8274-ab4146b1e487 req-3b55fc07-811a-485f-9beb-e49fcad43880 service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:38.661933 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-dacedcf8-0951-405d-8274-ab4146b1e487 req-3b55fc07-811a-485f-9beb-e49fcad43880 service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:38.661933 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-dacedcf8-0951-405d-8274-ab4146b1e487 req-3b55fc07-811a-485f-9beb-e49fcad43880 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] No waiting events found dispatching network-vif-unplugged-bf1e69e9-a858-4270-8c47-a209493f7e48 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:52:38.661933 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-dacedcf8-0951-405d-8274-ab4146b1e487 req-3b55fc07-811a-485f-9beb-e49fcad43880 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received unexpected event network-vif-unplugged-bf1e69e9-a858-4270-8c47-a209493f7e48 for instance with vm_state building and task_state spawning.
May 28 01:52:39.333721 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Found WWN 330000000958ebcf5 for multipath device dm-7 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:52:39.334100 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:52:39.334190 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] <== connect_volume: return (4988ms) {'type': 'block', 'scsi_wwn': '330000000958ebcf5', 'path': '/dev/dm-7', 'multipath_id': '330000000958ebcf5'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:52:39.334519 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000958ebcf5', 'path': '/dev/dm-7', 'multipath_id': '330000000958ebcf5'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:52:39.838887 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:52:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1355324420',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-device-tagging-server-1355324420',id=7,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvfiwJ1r27bnKNxDX4o62ctTDC6Ig/ylPWT9y3C0rnlXe7S/XjzMLOOboDVdfgZcI/qlz5Bn2JX3BBWTCO4qdcchSK7LR3FDT1K/XzjxBoEocraAGjdS8H/4gV7GCIjjQ==',key_name='tempest-keypair-734589143',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e94701d7485c4c46adefaf3637f27990',ramdisk_id='',reservation_id='r-r8kmnuo7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1330490836',owner_user_name='tempest-TaggedBootDevicesTest-1330490836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:52:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5369516340f4495b7f29ffd82dd9654',uuid=d3a7c39a-f946-496d-9153-0a422e7f5350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8", "address": "fa:16:3e:54:87:27", "network": {"id": "f48f059f-2a4c-46cc-9281-c2a228bf4514", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-256433360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e04c6bd-fb", "ovs_interfaceid": "0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:52:39.839423 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Converting VIF {"id": "0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8", "address": "fa:16:3e:54:87:27", "network": {"id": "f48f059f-2a4c-46cc-9281-c2a228bf4514", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-256433360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e04c6bd-fb", "ovs_interfaceid": "0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:52:39.839765 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:87:27,bridge_name='br-int',has_traffic_filtering=True,id=0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8,network=Network(f48f059f-2a4c-46cc-9281-c2a228bf4514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e04c6bd-fb') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:52:39.840457 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:52:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1355324420',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-device-tagging-server-1355324420',id=7,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvfiwJ1r27bnKNxDX4o62ctTDC6Ig/ylPWT9y3C0rnlXe7S/XjzMLOOboDVdfgZcI/qlz5Bn2JX3BBWTCO4qdcchSK7LR3FDT1K/XzjxBoEocraAGjdS8H/4gV7GCIjjQ==',key_name='tempest-keypair-734589143',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e94701d7485c4c46adefaf3637f27990',ramdisk_id='',reservation_id='r-r8kmnuo7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1330490836',owner_user_name='tempest-TaggedBootDevicesTest-1330490836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:52:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5369516340f4495b7f29ffd82dd9654',uuid=d3a7c39a-f946-496d-9153-0a422e7f5350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d994306-44d7-4407-94eb-49b142832ffc", "address": "fa:16:3e:ab:fd:ca", "network": {"id": "3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026701416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d994306-44", "ovs_interfaceid": "3d994306-44d7-4407-94eb-49b142832ffc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:52:39.840557 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Converting VIF {"id": "3d994306-44d7-4407-94eb-49b142832ffc", "address": "fa:16:3e:ab:fd:ca", "network": {"id": "3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026701416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d994306-44", "ovs_interfaceid": "3d994306-44d7-4407-94eb-49b142832ffc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:52:39.840877 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:fd:ca,bridge_name='br-int',has_traffic_filtering=True,id=3d994306-44d7-4407-94eb-49b142832ffc,network=Network(3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3d994306-44') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:52:39.841766 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:52:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1355324420',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-device-tagging-server-1355324420',id=7,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvfiwJ1r27bnKNxDX4o62ctTDC6Ig/ylPWT9y3C0rnlXe7S/XjzMLOOboDVdfgZcI/qlz5Bn2JX3BBWTCO4qdcchSK7LR3FDT1K/XzjxBoEocraAGjdS8H/4gV7GCIjjQ==',key_name='tempest-keypair-734589143',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e94701d7485c4c46adefaf3637f27990',ramdisk_id='',reservation_id='r-r8kmnuo7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1330490836',owner_user_name='tempest-TaggedBootDevicesTest-1330490836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:52:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5369516340f4495b7f29ffd82dd9654',uuid=d3a7c39a-f946-496d-9153-0a422e7f5350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf1e69e9-a858-4270-8c47-a209493f7e48", "address": "fa:16:3e:18:87:d6", "network": {"id": "3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026701416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf1e69e9-a8", "ovs_interfaceid": "bf1e69e9-a858-4270-8c47-a209493f7e48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:52:39.841891 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Converting VIF {"id": "bf1e69e9-a858-4270-8c47-a209493f7e48", "address": "fa:16:3e:18:87:d6", "network": {"id": "3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026701416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf1e69e9-a8", "ovs_interfaceid": "bf1e69e9-a858-4270-8c47-a209493f7e48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:52:39.842246 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:87:d6,bridge_name='br-int',has_traffic_filtering=True,id=bf1e69e9-a858-4270-8c47-a209493f7e48,network=Network(3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbf1e69e9-a8') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:52:39.842926 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:52:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1355324420',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-device-tagging-server-1355324420',id=7,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvfiwJ1r27bnKNxDX4o62ctTDC6Ig/ylPWT9y3C0rnlXe7S/XjzMLOOboDVdfgZcI/qlz5Bn2JX3BBWTCO4qdcchSK7LR3FDT1K/XzjxBoEocraAGjdS8H/4gV7GCIjjQ==',key_name='tempest-keypair-734589143',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e94701d7485c4c46adefaf3637f27990',ramdisk_id='',reservation_id='r-r8kmnuo7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1330490836',owner_user_name='tempest-TaggedBootDevicesTest-1330490836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:52:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5369516340f4495b7f29ffd82dd9654',uuid=d3a7c39a-f946-496d-9153-0a422e7f5350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5e93ea0-a679-45fb-9178-3842154f2e4d", "address": "fa:16:3e:9a:c8:f6", "network": {"id": "3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026701416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e93ea0-a6", "ovs_interfaceid": "f5e93ea0-a679-45fb-9178-3842154f2e4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:52:39.843152 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Converting VIF {"id": "f5e93ea0-a679-45fb-9178-3842154f2e4d", "address": "fa:16:3e:9a:c8:f6", "network": {"id": "3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026701416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e93ea0-a6", "ovs_interfaceid": "f5e93ea0-a679-45fb-9178-3842154f2e4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:52:39.843672 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:c8:f6,bridge_name='br-int',has_traffic_filtering=True,id=f5e93ea0-a679-45fb-9178-3842154f2e4d,network=Network(3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e93ea0-a6') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:52:39.844474 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:52:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1355324420',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-device-tagging-server-1355324420',id=7,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvfiwJ1r27bnKNxDX4o62ctTDC6Ig/ylPWT9y3C0rnlXe7S/XjzMLOOboDVdfgZcI/qlz5Bn2JX3BBWTCO4qdcchSK7LR3FDT1K/XzjxBoEocraAGjdS8H/4gV7GCIjjQ==',key_name='tempest-keypair-734589143',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e94701d7485c4c46adefaf3637f27990',ramdisk_id='',reservation_id='r-r8kmnuo7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1330490836',owner_user_name='tempest-TaggedBootDevicesTest-1330490836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:52:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5369516340f4495b7f29ffd82dd9654',uuid=d3a7c39a-f946-496d-9153-0a422e7f5350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91f6bd16-2cfa-44ca-a7ea-ef3ef4933092", "address": "fa:16:3e:ba:70:ee", "network": {"id": "3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026701416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f6bd16-2c", "ovs_interfaceid": "91f6bd16-2cfa-44ca-a7ea-ef3ef4933092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:52:39.844671 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Converting VIF {"id": "91f6bd16-2cfa-44ca-a7ea-ef3ef4933092", "address": "fa:16:3e:ba:70:ee", "network": {"id": "3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026701416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f6bd16-2c", "ovs_interfaceid": "91f6bd16-2cfa-44ca-a7ea-ef3ef4933092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:52:39.845169 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:70:ee,bridge_name='br-int',has_traffic_filtering=True,id=91f6bd16-2cfa-44ca-a7ea-ef3ef4933092,network=Network(3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f6bd16-2c') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:52:39.845885 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:52:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1355324420',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-device-tagging-server-1355324420',id=7,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvfiwJ1r27bnKNxDX4o62ctTDC6Ig/ylPWT9y3C0rnlXe7S/XjzMLOOboDVdfgZcI/qlz5Bn2JX3BBWTCO4qdcchSK7LR3FDT1K/XzjxBoEocraAGjdS8H/4gV7GCIjjQ==',key_name='tempest-keypair-734589143',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e94701d7485c4c46adefaf3637f27990',ramdisk_id='',reservation_id='r-r8kmnuo7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1330490836',owner_user_name='tempest-TaggedBootDevicesTest-1330490836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:52:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5369516340f4495b7f29ffd82dd9654',uuid=d3a7c39a-f946-496d-9153-0a422e7f5350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e08628c-1ff2-4d4b-9f3d-50231fa6ceec", "address": "fa:16:3e:1d:f8:b7", "network": {"id": "450c1abf-c05a-46dc-9905-3fa42767a540", "bridge": "br-int", "label": "tempest-device-tagging-net2-594797377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e08628c-1f", "ovs_interfaceid": "9e08628c-1ff2-4d4b-9f3d-50231fa6ceec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:52:39.846098 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Converting VIF {"id": "9e08628c-1ff2-4d4b-9f3d-50231fa6ceec", "address": "fa:16:3e:1d:f8:b7", "network": {"id": "450c1abf-c05a-46dc-9905-3fa42767a540", "bridge": "br-int", "label": "tempest-device-tagging-net2-594797377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e08628c-1f", "ovs_interfaceid": "9e08628c-1ff2-4d4b-9f3d-50231fa6ceec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:52:39.847485 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:f8:b7,bridge_name='br-int',has_traffic_filtering=True,id=9e08628c-1ff2-4d4b-9f3d-50231fa6ceec,network=Network(450c1abf-c05a-46dc-9905-3fa42767a540),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e08628c-1f') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:52:39.848332 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:52:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1355324420',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-device-tagging-server-1355324420',id=7,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvfiwJ1r27bnKNxDX4o62ctTDC6Ig/ylPWT9y3C0rnlXe7S/XjzMLOOboDVdfgZcI/qlz5Bn2JX3BBWTCO4qdcchSK7LR3FDT1K/XzjxBoEocraAGjdS8H/4gV7GCIjjQ==',key_name='tempest-keypair-734589143',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e94701d7485c4c46adefaf3637f27990',ramdisk_id='',reservation_id='r-r8kmnuo7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1330490836',owner_user_name='tempest-TaggedBootDevicesTest-1330490836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:52:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5369516340f4495b7f29ffd82dd9654',uuid=d3a7c39a-f946-496d-9153-0a422e7f5350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a566955f-6906-4a3b-bdf1-2f55b31b6e21", "address": "fa:16:3e:cb:ff:df", "network": {"id": "450c1abf-c05a-46dc-9905-3fa42767a540", "bridge": "br-int", "label": "tempest-device-tagging-net2-594797377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa566955f-69", "ovs_interfaceid": "a566955f-6906-4a3b-bdf1-2f55b31b6e21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:52:39.848544 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Converting VIF {"id": "a566955f-6906-4a3b-bdf1-2f55b31b6e21", "address": "fa:16:3e:cb:ff:df", "network": {"id": "450c1abf-c05a-46dc-9905-3fa42767a540", "bridge": "br-int", "label": "tempest-device-tagging-net2-594797377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa566955f-69", "ovs_interfaceid": "a566955f-6906-4a3b-bdf1-2f55b31b6e21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:52:39.849015 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:ff:df,bridge_name='br-int',has_traffic_filtering=True,id=a566955f-6906-4a3b-bdf1-2f55b31b6e21,network=Network(450c1abf-c05a-46dc-9905-3fa42767a540),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa566955f-69') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:52:39.849889 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Lazy-loading 'pci_devices' on Instance uuid d3a7c39a-f946-496d-9153-0a422e7f5350 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:52:40.044683 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Acquiring lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:40.044683 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:40.353595 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] End _get_guest_xml xml=<domain type="qemu">
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:   <uuid>d3a7c39a-f946-496d-9153-0a422e7f5350</uuid>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:   <name>instance-00000007</name>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <nova:name>tempest-device-tagging-server-1355324420</nova:name>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:52:24</nova:creationTime>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:         <nova:user uuid="d5369516340f4495b7f29ffd82dd9654">tempest-TaggedBootDevicesTest-1330490836-project-member</nova:user>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:         <nova:project uuid="e94701d7485c4c46adefaf3637f27990">tempest-TaggedBootDevicesTest-1330490836</nova:project>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:         <nova:port uuid="0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8">
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:         <nova:port uuid="3d994306-44d7-4407-94eb-49b142832ffc">
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.1.179" ipVersion="4"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:         <nova:port uuid="bf1e69e9-a858-4270-8c47-a209493f7e48">
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.1.223" ipVersion="4"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:         <nova:port uuid="f5e93ea0-a679-45fb-9178-3842154f2e4d">
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.1.77" ipVersion="4"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:         <nova:port uuid="91f6bd16-2cfa-44ca-a7ea-ef3ef4933092">
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.1.18" ipVersion="4"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:         <nova:port uuid="9e08628c-1ff2-4d4b-9f3d-50231fa6ceec">
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:         <nova:port uuid="a566955f-6906-4a3b-bdf1-2f55b31b6e21">
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:     <system>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <entry name="serial">d3a7c39a-f946-496d-9153-0a422e7f5350</entry>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <entry name="uuid">d3a7c39a-f946-496d-9153-0a422e7f5350</entry>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:     </system>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:   <os>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:   </os>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:   <features>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:   </features>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:   <devices>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/d3a7c39a-f946-496d-9153-0a422e7f5350/disk.config"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:     </disk>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:     <disk type="block" device="disk">
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <alias name="ua-5882db55-1e44-4bae-be6c-74bd366d0eb8"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <source dev="/dev/dm-0"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <serial>5882db55-1e44-4bae-be6c-74bd366d0eb8</serial>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:     </disk>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:     <disk type="block" device="disk">
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <alias name="ua-7ddf6798-56b7-484e-8f23-b19628080e02"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <source dev="/dev/dm-6"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <target dev="vdb" bus="virtio"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <serial>7ddf6798-56b7-484e-8f23-b19628080e02</serial>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:     </disk>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:     <disk type="block" device="disk">
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <alias name="ua-fe81d64a-afda-41db-b18c-986ff2d9fbcb"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <source dev="/dev/dm-7"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <target dev="vdc" bus="virtio"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <serial>fe81d64a-afda-41db-b18c-986ff2d9fbcb</serial>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:     </disk>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:54:87:27"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <target dev="tap0e04c6bd-fb"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:     </interface>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:ab:fd:ca"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <target dev="tap3d994306-44"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:     </interface>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:18:87:d6"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <target dev="tapbf1e69e9-a8"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:     </interface>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:9a:c8:f6"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <target dev="tapf5e93ea0-a6"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:     </interface>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:ba:70:ee"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <target dev="tap91f6bd16-2c"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:     </interface>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:1d:f8:b7"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <target dev="tap9e08628c-1f"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:     </interface>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:cb:ff:df"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <target dev="tapa566955f-69"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:     </interface>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/d3a7c39a-f946-496d-9153-0a422e7f5350/console.log" append="off"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:     </serial>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:     <video>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:     </video>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:     </rng>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:   </devices>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]: </domain>
May 28 01:52:40.353595 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:52:40.360602 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Preparing to wait for external event network-vif-plugged-0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:52:40.360602 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Acquiring lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:40.360602 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:40.360602 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:40.360602 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Preparing to wait for external event network-vif-plugged-3d994306-44d7-4407-94eb-49b142832ffc {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:52:40.360602 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Acquiring lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:40.360602 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:40.360602 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:40.360602 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Preparing to wait for external event network-vif-plugged-bf1e69e9-a858-4270-8c47-a209493f7e48 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:52:40.360602 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Acquiring lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:40.360602 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:40.360602 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:40.360602 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Preparing to wait for external event network-vif-plugged-f5e93ea0-a679-45fb-9178-3842154f2e4d {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:52:40.360602 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Acquiring lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:40.360602 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:40.360602 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:40.360602 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Preparing to wait for external event network-vif-plugged-91f6bd16-2cfa-44ca-a7ea-ef3ef4933092 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:52:40.360602 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Acquiring lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:40.360602 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:40.360602 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:40.360602 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Preparing to wait for external event network-vif-plugged-9e08628c-1ff2-4d4b-9f3d-50231fa6ceec {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:52:40.360602 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Acquiring lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:40.360602 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:40.360602 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:40.360602 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Preparing to wait for external event network-vif-plugged-a566955f-6906-4a3b-bdf1-2f55b31b6e21 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:52:40.360602 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Acquiring lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:40.360602 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:40.360602 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:40.361993 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:52:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1355324420',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-device-tagging-server-1355324420',id=7,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvfiwJ1r27bnKNxDX4o62ctTDC6Ig/ylPWT9y3C0rnlXe7S/XjzMLOOboDVdfgZcI/qlz5Bn2JX3BBWTCO4qdcchSK7LR3FDT1K/XzjxBoEocraAGjdS8H/4gV7GCIjjQ==',key_name='tempest-keypair-734589143',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e94701d7485c4c46adefaf3637f27990',ramdisk_id='',reservation_id='r-r8kmnuo7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1330490836',owner_user_name='tempest-TaggedBootDevicesTest-1330490836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:52:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5369516340f4495b7f29ffd82dd9654',uuid=d3a7c39a-f946-496d-9153-0a422e7f5350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8", "address": "fa:16:3e:54:87:27", "network": {"id": "f48f059f-2a4c-46cc-9281-c2a228bf4514", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-256433360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e04c6bd-fb", "ovs_interfaceid": "0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:52:40.361993 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Converting VIF {"id": "0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8", "address": "fa:16:3e:54:87:27", "network": {"id": "f48f059f-2a4c-46cc-9281-c2a228bf4514", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-256433360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e04c6bd-fb", "ovs_interfaceid": "0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:52:40.361993 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:87:27,bridge_name='br-int',has_traffic_filtering=True,id=0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8,network=Network(f48f059f-2a4c-46cc-9281-c2a228bf4514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e04c6bd-fb') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:52:40.361993 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:87:27,bridge_name='br-int',has_traffic_filtering=True,id=0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8,network=Network(f48f059f-2a4c-46cc-9281-c2a228bf4514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e04c6bd-fb') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:52:40.361993 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:40.361993 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:40.361993 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:52:40.362505 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:40.362505 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aebd2b79-2334-591a-9b7b-97b20065c682', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:40.363103 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:40.363726 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:52:40.365297 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:40.367435 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:40.367619 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0e04c6bd-fb, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:40.367936 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0e04c6bd-fb, col_values=(('qos', UUID('fe3f06df-a2cf-4166-8624-ee01c3afc2cf')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:40.368101 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0e04c6bd-fb, col_values=(('external_ids', {'iface-id': '0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:87:27', 'vm-uuid': 'd3a7c39a-f946-496d-9153-0a422e7f5350'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:40.368987 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:40.370095 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:52:40.374805 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:40.375725 np0000001583 nova-compute[98241]: INFO os_vif [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:87:27,bridge_name='br-int',has_traffic_filtering=True,id=0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8,network=Network(f48f059f-2a4c-46cc-9281-c2a228bf4514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e04c6bd-fb')
May 28 01:52:40.376420 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:52:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1355324420',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-device-tagging-server-1355324420',id=7,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvfiwJ1r27bnKNxDX4o62ctTDC6Ig/ylPWT9y3C0rnlXe7S/XjzMLOOboDVdfgZcI/qlz5Bn2JX3BBWTCO4qdcchSK7LR3FDT1K/XzjxBoEocraAGjdS8H/4gV7GCIjjQ==',key_name='tempest-keypair-734589143',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e94701d7485c4c46adefaf3637f27990',ramdisk_id='',reservation_id='r-r8kmnuo7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1330490836',owner_user_name='tempest-TaggedBootDevicesTest-1330490836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:52:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5369516340f4495b7f29ffd82dd9654',uuid=d3a7c39a-f946-496d-9153-0a422e7f5350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d994306-44d7-4407-94eb-49b142832ffc", "address": "fa:16:3e:ab:fd:ca", "network": {"id": "3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026701416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d994306-44", "ovs_interfaceid": "3d994306-44d7-4407-94eb-49b142832ffc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:52:40.376549 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Converting VIF {"id": "3d994306-44d7-4407-94eb-49b142832ffc", "address": "fa:16:3e:ab:fd:ca", "network": {"id": "3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026701416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d994306-44", "ovs_interfaceid": "3d994306-44d7-4407-94eb-49b142832ffc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:52:40.376996 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:fd:ca,bridge_name='br-int',has_traffic_filtering=True,id=3d994306-44d7-4407-94eb-49b142832ffc,network=Network(3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3d994306-44') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:52:40.377196 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:fd:ca,bridge_name='br-int',has_traffic_filtering=True,id=3d994306-44d7-4407-94eb-49b142832ffc,network=Network(3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3d994306-44') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:52:40.377535 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:40.377741 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:40.377900 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:52:40.378630 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:40.378800 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8e72378c-a502-52f9-9268-03dcbfa3f42a', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:40.379579 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:40.380291 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:52:40.386176 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:40.389829 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:40.390061 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d994306-44, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:40.390524 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3d994306-44, col_values=(('qos', UUID('0b3b0c02-6ee9-4ef7-8b98-6278e13d8d2d')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:40.390702 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3d994306-44, col_values=(('external_ids', {'iface-id': '3d994306-44d7-4407-94eb-49b142832ffc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:fd:ca', 'vm-uuid': 'd3a7c39a-f946-496d-9153-0a422e7f5350'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:40.391821 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:40.393674 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:52:40.403321 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:40.406771 np0000001583 nova-compute[98241]: INFO os_vif [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:fd:ca,bridge_name='br-int',has_traffic_filtering=True,id=3d994306-44d7-4407-94eb-49b142832ffc,network=Network(3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3d994306-44')
May 28 01:52:40.407615 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:52:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1355324420',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-device-tagging-server-1355324420',id=7,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvfiwJ1r27bnKNxDX4o62ctTDC6Ig/ylPWT9y3C0rnlXe7S/XjzMLOOboDVdfgZcI/qlz5Bn2JX3BBWTCO4qdcchSK7LR3FDT1K/XzjxBoEocraAGjdS8H/4gV7GCIjjQ==',key_name='tempest-keypair-734589143',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e94701d7485c4c46adefaf3637f27990',ramdisk_id='',reservation_id='r-r8kmnuo7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1330490836',owner_user_name='tempest-TaggedBootDevicesTest-1330490836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:52:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5369516340f4495b7f29ffd82dd9654',uuid=d3a7c39a-f946-496d-9153-0a422e7f5350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf1e69e9-a858-4270-8c47-a209493f7e48", "address": "fa:16:3e:18:87:d6", "network": {"id": "3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026701416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf1e69e9-a8", "ovs_interfaceid": "bf1e69e9-a858-4270-8c47-a209493f7e48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:52:40.407814 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Converting VIF {"id": "bf1e69e9-a858-4270-8c47-a209493f7e48", "address": "fa:16:3e:18:87:d6", "network": {"id": "3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026701416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf1e69e9-a8", "ovs_interfaceid": "bf1e69e9-a858-4270-8c47-a209493f7e48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:52:40.408455 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:87:d6,bridge_name='br-int',has_traffic_filtering=True,id=bf1e69e9-a858-4270-8c47-a209493f7e48,network=Network(3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbf1e69e9-a8') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:52:40.408739 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:87:d6,bridge_name='br-int',has_traffic_filtering=True,id=bf1e69e9-a858-4270-8c47-a209493f7e48,network=Network(3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbf1e69e9-a8') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:52:40.409037 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:40.409275 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:40.409452 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:52:40.411800 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:40.412013 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1d4d4e62-9de5-5d6f-8ae3-154384fb73f5', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:40.412790 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:40.413609 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:52:40.425007 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:40.429168 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:40.429168 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf1e69e9-a8, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:40.429168 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbf1e69e9-a8, col_values=(('qos', UUID('f35de14b-636c-448d-9b94-11a64d160206')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:40.429168 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbf1e69e9-a8, col_values=(('external_ids', {'iface-id': 'bf1e69e9-a858-4270-8c47-a209493f7e48', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:87:d6', 'vm-uuid': 'd3a7c39a-f946-496d-9153-0a422e7f5350'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:40.429985 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:40.431041 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:52:40.447245 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:40.448586 np0000001583 nova-compute[98241]: INFO os_vif [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:87:d6,bridge_name='br-int',has_traffic_filtering=True,id=bf1e69e9-a858-4270-8c47-a209493f7e48,network=Network(3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbf1e69e9-a8')
May 28 01:52:40.449392 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:52:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1355324420',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-device-tagging-server-1355324420',id=7,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvfiwJ1r27bnKNxDX4o62ctTDC6Ig/ylPWT9y3C0rnlXe7S/XjzMLOOboDVdfgZcI/qlz5Bn2JX3BBWTCO4qdcchSK7LR3FDT1K/XzjxBoEocraAGjdS8H/4gV7GCIjjQ==',key_name='tempest-keypair-734589143',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e94701d7485c4c46adefaf3637f27990',ramdisk_id='',reservation_id='r-r8kmnuo7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1330490836',owner_user_name='tempest-TaggedBootDevicesTest-1330490836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:52:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5369516340f4495b7f29ffd82dd9654',uuid=d3a7c39a-f946-496d-9153-0a422e7f5350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5e93ea0-a679-45fb-9178-3842154f2e4d", "address": "fa:16:3e:9a:c8:f6", "network": {"id": "3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026701416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e93ea0-a6", "ovs_interfaceid": "f5e93ea0-a679-45fb-9178-3842154f2e4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:52:40.449915 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Converting VIF {"id": "f5e93ea0-a679-45fb-9178-3842154f2e4d", "address": "fa:16:3e:9a:c8:f6", "network": {"id": "3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026701416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e93ea0-a6", "ovs_interfaceid": "f5e93ea0-a679-45fb-9178-3842154f2e4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:52:40.450469 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:c8:f6,bridge_name='br-int',has_traffic_filtering=True,id=f5e93ea0-a679-45fb-9178-3842154f2e4d,network=Network(3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e93ea0-a6') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:52:40.450777 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:c8:f6,bridge_name='br-int',has_traffic_filtering=True,id=f5e93ea0-a679-45fb-9178-3842154f2e4d,network=Network(3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e93ea0-a6') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:52:40.451214 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:40.451417 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:40.451565 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:52:40.456026 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:40.456290 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eb8641da-ad14-57ce-b6c9-19a11500fb11', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:40.456984 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:40.458022 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:52:40.471920 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:40.477346 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:40.477535 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5e93ea0-a6, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:40.477835 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf5e93ea0-a6, col_values=(('qos', UUID('4d387398-330d-4e7f-8a82-93e964bcfe91')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:40.477986 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf5e93ea0-a6, col_values=(('external_ids', {'iface-id': 'f5e93ea0-a679-45fb-9178-3842154f2e4d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:c8:f6', 'vm-uuid': 'd3a7c39a-f946-496d-9153-0a422e7f5350'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:40.480933 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:40.482147 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:52:40.496464 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:40.497499 np0000001583 nova-compute[98241]: INFO os_vif [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:c8:f6,bridge_name='br-int',has_traffic_filtering=True,id=f5e93ea0-a679-45fb-9178-3842154f2e4d,network=Network(3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e93ea0-a6')
May 28 01:52:40.498053 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:52:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1355324420',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-device-tagging-server-1355324420',id=7,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvfiwJ1r27bnKNxDX4o62ctTDC6Ig/ylPWT9y3C0rnlXe7S/XjzMLOOboDVdfgZcI/qlz5Bn2JX3BBWTCO4qdcchSK7LR3FDT1K/XzjxBoEocraAGjdS8H/4gV7GCIjjQ==',key_name='tempest-keypair-734589143',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e94701d7485c4c46adefaf3637f27990',ramdisk_id='',reservation_id='r-r8kmnuo7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1330490836',owner_user_name='tempest-TaggedBootDevicesTest-1330490836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:52:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5369516340f4495b7f29ffd82dd9654',uuid=d3a7c39a-f946-496d-9153-0a422e7f5350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91f6bd16-2cfa-44ca-a7ea-ef3ef4933092", "address": "fa:16:3e:ba:70:ee", "network": {"id": "3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026701416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f6bd16-2c", "ovs_interfaceid": "91f6bd16-2cfa-44ca-a7ea-ef3ef4933092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:52:40.498263 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Converting VIF {"id": "91f6bd16-2cfa-44ca-a7ea-ef3ef4933092", "address": "fa:16:3e:ba:70:ee", "network": {"id": "3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026701416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f6bd16-2c", "ovs_interfaceid": "91f6bd16-2cfa-44ca-a7ea-ef3ef4933092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:52:40.498738 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:70:ee,bridge_name='br-int',has_traffic_filtering=True,id=91f6bd16-2cfa-44ca-a7ea-ef3ef4933092,network=Network(3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f6bd16-2c') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:52:40.498936 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:70:ee,bridge_name='br-int',has_traffic_filtering=True,id=91f6bd16-2cfa-44ca-a7ea-ef3ef4933092,network=Network(3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f6bd16-2c') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:52:40.499114 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:40.499295 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:40.499457 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:52:40.502753 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:40.502922 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b2271b2d-d3ba-5850-9058-4766a45b573c', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:40.504330 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:40.505089 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:52:40.521102 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:40.527298 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:40.527512 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap91f6bd16-2c, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:40.527873 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap91f6bd16-2c, col_values=(('qos', UUID('0d15f96e-0cda-421b-9cae-64993edb4503')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:40.528040 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap91f6bd16-2c, col_values=(('external_ids', {'iface-id': '91f6bd16-2cfa-44ca-a7ea-ef3ef4933092', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:70:ee', 'vm-uuid': 'd3a7c39a-f946-496d-9153-0a422e7f5350'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:40.532438 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:40.533608 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:52:40.547832 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:52:40.557732 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:40.558864 np0000001583 nova-compute[98241]: INFO os_vif [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:70:ee,bridge_name='br-int',has_traffic_filtering=True,id=91f6bd16-2cfa-44ca-a7ea-ef3ef4933092,network=Network(3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f6bd16-2c')
May 28 01:52:40.559611 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:52:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1355324420',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-device-tagging-server-1355324420',id=7,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvfiwJ1r27bnKNxDX4o62ctTDC6Ig/ylPWT9y3C0rnlXe7S/XjzMLOOboDVdfgZcI/qlz5Bn2JX3BBWTCO4qdcchSK7LR3FDT1K/XzjxBoEocraAGjdS8H/4gV7GCIjjQ==',key_name='tempest-keypair-734589143',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e94701d7485c4c46adefaf3637f27990',ramdisk_id='',reservation_id='r-r8kmnuo7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1330490836',owner_user_name='tempest-TaggedBootDevicesTest-1330490836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:52:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5369516340f4495b7f29ffd82dd9654',uuid=d3a7c39a-f946-496d-9153-0a422e7f5350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e08628c-1ff2-4d4b-9f3d-50231fa6ceec", "address": "fa:16:3e:1d:f8:b7", "network": {"id": "450c1abf-c05a-46dc-9905-3fa42767a540", "bridge": "br-int", "label": "tempest-device-tagging-net2-594797377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e08628c-1f", "ovs_interfaceid": "9e08628c-1ff2-4d4b-9f3d-50231fa6ceec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:52:40.559746 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Converting VIF {"id": "9e08628c-1ff2-4d4b-9f3d-50231fa6ceec", "address": "fa:16:3e:1d:f8:b7", "network": {"id": "450c1abf-c05a-46dc-9905-3fa42767a540", "bridge": "br-int", "label": "tempest-device-tagging-net2-594797377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e08628c-1f", "ovs_interfaceid": "9e08628c-1ff2-4d4b-9f3d-50231fa6ceec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:52:40.560225 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:f8:b7,bridge_name='br-int',has_traffic_filtering=True,id=9e08628c-1ff2-4d4b-9f3d-50231fa6ceec,network=Network(450c1abf-c05a-46dc-9905-3fa42767a540),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e08628c-1f') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:52:40.560434 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:f8:b7,bridge_name='br-int',has_traffic_filtering=True,id=9e08628c-1ff2-4d4b-9f3d-50231fa6ceec,network=Network(450c1abf-c05a-46dc-9905-3fa42767a540),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e08628c-1f') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:52:40.560670 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:40.560864 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:40.561016 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:52:40.564159 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:40.564841 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '44ed2795-b148-5d0b-9304-454ecef76daf', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:40.566012 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:40.566939 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:52:40.600988 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:40.604735 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:40.605143 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e08628c-1f, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:40.605667 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9e08628c-1f, col_values=(('qos', UUID('38035ab8-4ee8-4802-b631-0c08b637d968')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:40.605667 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9e08628c-1f, col_values=(('external_ids', {'iface-id': '9e08628c-1ff2-4d4b-9f3d-50231fa6ceec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:f8:b7', 'vm-uuid': 'd3a7c39a-f946-496d-9153-0a422e7f5350'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:40.606390 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:40.607649 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:52:40.642307 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:40.643062 np0000001583 nova-compute[98241]: INFO os_vif [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:f8:b7,bridge_name='br-int',has_traffic_filtering=True,id=9e08628c-1ff2-4d4b-9f3d-50231fa6ceec,network=Network(450c1abf-c05a-46dc-9905-3fa42767a540),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e08628c-1f')
May 28 01:52:40.644067 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:52:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1355324420',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-device-tagging-server-1355324420',id=7,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvfiwJ1r27bnKNxDX4o62ctTDC6Ig/ylPWT9y3C0rnlXe7S/XjzMLOOboDVdfgZcI/qlz5Bn2JX3BBWTCO4qdcchSK7LR3FDT1K/XzjxBoEocraAGjdS8H/4gV7GCIjjQ==',key_name='tempest-keypair-734589143',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e94701d7485c4c46adefaf3637f27990',ramdisk_id='',reservation_id='r-r8kmnuo7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1330490836',owner_user_name='tempest-TaggedBootDevicesTest-1330490836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:52:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5369516340f4495b7f29ffd82dd9654',uuid=d3a7c39a-f946-496d-9153-0a422e7f5350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a566955f-6906-4a3b-bdf1-2f55b31b6e21", "address": "fa:16:3e:cb:ff:df", "network": {"id": "450c1abf-c05a-46dc-9905-3fa42767a540", "bridge": "br-int", "label": "tempest-device-tagging-net2-594797377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa566955f-69", "ovs_interfaceid": "a566955f-6906-4a3b-bdf1-2f55b31b6e21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:52:40.644067 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Converting VIF {"id": "a566955f-6906-4a3b-bdf1-2f55b31b6e21", "address": "fa:16:3e:cb:ff:df", "network": {"id": "450c1abf-c05a-46dc-9905-3fa42767a540", "bridge": "br-int", "label": "tempest-device-tagging-net2-594797377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa566955f-69", "ovs_interfaceid": "a566955f-6906-4a3b-bdf1-2f55b31b6e21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:52:40.644566 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:ff:df,bridge_name='br-int',has_traffic_filtering=True,id=a566955f-6906-4a3b-bdf1-2f55b31b6e21,network=Network(450c1abf-c05a-46dc-9905-3fa42767a540),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa566955f-69') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:52:40.645919 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:ff:df,bridge_name='br-int',has_traffic_filtering=True,id=a566955f-6906-4a3b-bdf1-2f55b31b6e21,network=Network(450c1abf-c05a-46dc-9905-3fa42767a540),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa566955f-69') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:52:40.646330 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:40.646546 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:40.646594 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:52:40.650669 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:40.650669 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e2e70bb7-8962-5520-8262-5c9e0d116e84', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:40.654148 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:40.656151 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:52:40.689352 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:40.693172 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:40.693172 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa566955f-69, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:40.693366 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa566955f-69, col_values=(('qos', UUID('851016b7-8a5d-4c5a-beb2-02c32d782655')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:40.693988 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa566955f-69, col_values=(('external_ids', {'iface-id': 'a566955f-6906-4a3b-bdf1-2f55b31b6e21', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:ff:df', 'vm-uuid': 'd3a7c39a-f946-496d-9153-0a422e7f5350'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:40.699494 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:40.700471 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:52:40.737061 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:40.739585 np0000001583 nova-compute[98241]: INFO os_vif [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:ff:df,bridge_name='br-int',has_traffic_filtering=True,id=a566955f-6906-4a3b-bdf1-2f55b31b6e21,network=Network(450c1abf-c05a-46dc-9905-3fa42767a540),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa566955f-69')
May 28 01:52:40.757532 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9cb67c3a-4abd-4616-b942-4e4e7eb0851f req-08787688-be7e-47ea-aaf2-5ab4638c2f2d service nova] [instance: 02b42340-8535-4682-98db-49f970ff5597] Received event network-vif-unplugged-0ac172e4-b81e-4014-bb42-bb91fe781adf {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:40.757532 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9cb67c3a-4abd-4616-b942-4e4e7eb0851f req-08787688-be7e-47ea-aaf2-5ab4638c2f2d service nova] Acquiring lock "02b42340-8535-4682-98db-49f970ff5597-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:40.757532 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9cb67c3a-4abd-4616-b942-4e4e7eb0851f req-08787688-be7e-47ea-aaf2-5ab4638c2f2d service nova] Lock "02b42340-8535-4682-98db-49f970ff5597-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:40.757532 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9cb67c3a-4abd-4616-b942-4e4e7eb0851f req-08787688-be7e-47ea-aaf2-5ab4638c2f2d service nova] Lock "02b42340-8535-4682-98db-49f970ff5597-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:40.757532 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9cb67c3a-4abd-4616-b942-4e4e7eb0851f req-08787688-be7e-47ea-aaf2-5ab4638c2f2d service nova] [instance: 02b42340-8535-4682-98db-49f970ff5597] No event matching network-vif-unplugged-0ac172e4-b81e-4014-bb42-bb91fe781adf in dict_keys([('network-vif-plugged', '0ac172e4-b81e-4014-bb42-bb91fe781adf')]) {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 01:52:40.757725 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-9cb67c3a-4abd-4616-b942-4e4e7eb0851f req-08787688-be7e-47ea-aaf2-5ab4638c2f2d service nova] [instance: 02b42340-8535-4682-98db-49f970ff5597] Received unexpected event network-vif-unplugged-0ac172e4-b81e-4014-bb42-bb91fe781adf for instance with vm_state building and task_state spawning.
May 28 01:52:40.758056 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9cb67c3a-4abd-4616-b942-4e4e7eb0851f req-08787688-be7e-47ea-aaf2-5ab4638c2f2d service nova] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Received event network-vif-unplugged-00a0837b-bced-48a4-84d6-8ba3fa1cccfc {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:40.758270 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9cb67c3a-4abd-4616-b942-4e4e7eb0851f req-08787688-be7e-47ea-aaf2-5ab4638c2f2d service nova] Acquiring lock "f342ed55-ce60-405b-bc09-856eced24bf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:40.758431 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9cb67c3a-4abd-4616-b942-4e4e7eb0851f req-08787688-be7e-47ea-aaf2-5ab4638c2f2d service nova] Lock "f342ed55-ce60-405b-bc09-856eced24bf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:40.758583 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9cb67c3a-4abd-4616-b942-4e4e7eb0851f req-08787688-be7e-47ea-aaf2-5ab4638c2f2d service nova] Lock "f342ed55-ce60-405b-bc09-856eced24bf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:40.759328 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9cb67c3a-4abd-4616-b942-4e4e7eb0851f req-08787688-be7e-47ea-aaf2-5ab4638c2f2d service nova] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] No event matching network-vif-unplugged-00a0837b-bced-48a4-84d6-8ba3fa1cccfc in dict_keys([('network-vif-plugged', '00a0837b-bced-48a4-84d6-8ba3fa1cccfc')]) {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 01:52:40.759328 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-9cb67c3a-4abd-4616-b942-4e4e7eb0851f req-08787688-be7e-47ea-aaf2-5ab4638c2f2d service nova] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Received unexpected event network-vif-unplugged-00a0837b-bced-48a4-84d6-8ba3fa1cccfc for instance with vm_state building and task_state spawning.
May 28 01:52:40.759417 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9cb67c3a-4abd-4616-b942-4e4e7eb0851f req-08787688-be7e-47ea-aaf2-5ab4638c2f2d service nova] [instance: 02b42340-8535-4682-98db-49f970ff5597] Received event network-vif-plugged-0ac172e4-b81e-4014-bb42-bb91fe781adf {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:40.759678 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9cb67c3a-4abd-4616-b942-4e4e7eb0851f req-08787688-be7e-47ea-aaf2-5ab4638c2f2d service nova] Acquiring lock "02b42340-8535-4682-98db-49f970ff5597-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:40.759881 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9cb67c3a-4abd-4616-b942-4e4e7eb0851f req-08787688-be7e-47ea-aaf2-5ab4638c2f2d service nova] Lock "02b42340-8535-4682-98db-49f970ff5597-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:40.760089 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9cb67c3a-4abd-4616-b942-4e4e7eb0851f req-08787688-be7e-47ea-aaf2-5ab4638c2f2d service nova] Lock "02b42340-8535-4682-98db-49f970ff5597-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:40.760287 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9cb67c3a-4abd-4616-b942-4e4e7eb0851f req-08787688-be7e-47ea-aaf2-5ab4638c2f2d service nova] [instance: 02b42340-8535-4682-98db-49f970ff5597] Processing event network-vif-plugged-0ac172e4-b81e-4014-bb42-bb91fe781adf {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:52:40.760514 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9cb67c3a-4abd-4616-b942-4e4e7eb0851f req-08787688-be7e-47ea-aaf2-5ab4638c2f2d service nova] [instance: 02b42340-8535-4682-98db-49f970ff5597] Received event network-vif-plugged-0ac172e4-b81e-4014-bb42-bb91fe781adf {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:40.760856 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] [instance: 02b42340-8535-4682-98db-49f970ff5597] Instance event wait completed in 32 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:52:40.761505 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9cb67c3a-4abd-4616-b942-4e4e7eb0851f req-08787688-be7e-47ea-aaf2-5ab4638c2f2d service nova] Acquiring lock "02b42340-8535-4682-98db-49f970ff5597-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:40.761505 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9cb67c3a-4abd-4616-b942-4e4e7eb0851f req-08787688-be7e-47ea-aaf2-5ab4638c2f2d service nova] Lock "02b42340-8535-4682-98db-49f970ff5597-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:40.761505 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9cb67c3a-4abd-4616-b942-4e4e7eb0851f req-08787688-be7e-47ea-aaf2-5ab4638c2f2d service nova] Lock "02b42340-8535-4682-98db-49f970ff5597-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:40.761505 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9cb67c3a-4abd-4616-b942-4e4e7eb0851f req-08787688-be7e-47ea-aaf2-5ab4638c2f2d service nova] [instance: 02b42340-8535-4682-98db-49f970ff5597] No waiting events found dispatching network-vif-plugged-0ac172e4-b81e-4014-bb42-bb91fe781adf {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:52:40.761781 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-9cb67c3a-4abd-4616-b942-4e4e7eb0851f req-08787688-be7e-47ea-aaf2-5ab4638c2f2d service nova] [instance: 02b42340-8535-4682-98db-49f970ff5597] Received unexpected event network-vif-plugged-0ac172e4-b81e-4014-bb42-bb91fe781adf for instance with vm_state building and task_state spawning.
May 28 01:52:40.762067 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9cb67c3a-4abd-4616-b942-4e4e7eb0851f req-08787688-be7e-47ea-aaf2-5ab4638c2f2d service nova] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Received event network-vif-unplugged-62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:40.762293 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9cb67c3a-4abd-4616-b942-4e4e7eb0851f req-08787688-be7e-47ea-aaf2-5ab4638c2f2d service nova] Acquiring lock "bad69594-f163-41a6-931f-d2fcda0cb7d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:40.762999 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9cb67c3a-4abd-4616-b942-4e4e7eb0851f req-08787688-be7e-47ea-aaf2-5ab4638c2f2d service nova] Lock "bad69594-f163-41a6-931f-d2fcda0cb7d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:40.763632 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9cb67c3a-4abd-4616-b942-4e4e7eb0851f req-08787688-be7e-47ea-aaf2-5ab4638c2f2d service nova] Lock "bad69594-f163-41a6-931f-d2fcda0cb7d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:40.763632 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9cb67c3a-4abd-4616-b942-4e4e7eb0851f req-08787688-be7e-47ea-aaf2-5ab4638c2f2d service nova] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] No event matching network-vif-unplugged-62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6 in dict_keys([('network-vif-plugged', '62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6')]) {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 01:52:40.763632 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-9cb67c3a-4abd-4616-b942-4e4e7eb0851f req-08787688-be7e-47ea-aaf2-5ab4638c2f2d service nova] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Received unexpected event network-vif-unplugged-62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6 for instance with vm_state building and task_state spawning.
May 28 01:52:40.764439 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] [instance: 02b42340-8535-4682-98db-49f970ff5597] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:52:40.766934 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933160.765122, 02b42340-8535-4682-98db-49f970ff5597 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:52:40.767067 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 02b42340-8535-4682-98db-49f970ff5597] Instance spawned successfully.
May 28 01:52:40.768109 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 02b42340-8535-4682-98db-49f970ff5597] VM Resumed (Lifecycle Event)
May 28 01:52:40.774277 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] [instance: 02b42340-8535-4682-98db-49f970ff5597] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:52:41.125035 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:41.125517 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:41.129736 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:52:41.129945 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Claim successful on node np0000001583
May 28 01:52:41.275340 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 02b42340-8535-4682-98db-49f970ff5597] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:52:41.279557 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 02b42340-8535-4682-98db-49f970ff5597] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:52:41.283923 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] [instance: 02b42340-8535-4682-98db-49f970ff5597] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:52:41.284020 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] [instance: 02b42340-8535-4682-98db-49f970ff5597] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:52:41.284441 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] [instance: 02b42340-8535-4682-98db-49f970ff5597] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:52:41.284765 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] [instance: 02b42340-8535-4682-98db-49f970ff5597] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:52:41.285059 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] [instance: 02b42340-8535-4682-98db-49f970ff5597] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:52:41.285398 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] [instance: 02b42340-8535-4682-98db-49f970ff5597] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:52:41.790880 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 02b42340-8535-4682-98db-49f970ff5597] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:52:41.795119 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] [instance: 02b42340-8535-4682-98db-49f970ff5597] Took 39.88 seconds to spawn the instance on the hypervisor.
May 28 01:52:41.795335 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] [instance: 02b42340-8535-4682-98db-49f970ff5597] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:52:42.274799 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:52:42.275394 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:52:42.275394 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] No VIF found with MAC fa:16:3e:54:87:27, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:52:42.275679 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] No VIF found with MAC fa:16:3e:ba:70:ee, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:52:42.276518 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Using config drive
May 28 01:52:42.308745 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] [instance: 02b42340-8535-4682-98db-49f970ff5597] Took 45.34 seconds to build instance.
May 28 01:52:42.666651 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:52:42.666938 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:52:42.780424 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:42.789697 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:42.810453 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f83e7d5d-5c3a-4f0d-900f-a4c4160df08c tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Lock "02b42340-8535-4682-98db-49f970ff5597" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 46.848s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:42.851336 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b42898ad-35ca-4912-b0b6-cec6ece53f92 req-b81dd156-0435-4f50-ba1b-25f4d43964e2 service nova] [instance: 02b42340-8535-4682-98db-49f970ff5597] Received event network-changed-0ac172e4-b81e-4014-bb42-bb91fe781adf {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:42.851988 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b42898ad-35ca-4912-b0b6-cec6ece53f92 req-b81dd156-0435-4f50-ba1b-25f4d43964e2 service nova] [instance: 02b42340-8535-4682-98db-49f970ff5597] Refreshing instance network info cache due to event network-changed-0ac172e4-b81e-4014-bb42-bb91fe781adf. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:52:42.851988 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b42898ad-35ca-4912-b0b6-cec6ece53f92 req-b81dd156-0435-4f50-ba1b-25f4d43964e2 service nova] Acquiring lock "refresh_cache-02b42340-8535-4682-98db-49f970ff5597" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:52:42.852299 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b42898ad-35ca-4912-b0b6-cec6ece53f92 req-b81dd156-0435-4f50-ba1b-25f4d43964e2 service nova] Acquired lock "refresh_cache-02b42340-8535-4682-98db-49f970ff5597" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:52:42.852360 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-b42898ad-35ca-4912-b0b6-cec6ece53f92 req-b81dd156-0435-4f50-ba1b-25f4d43964e2 service nova] [instance: 02b42340-8535-4682-98db-49f970ff5597] Refreshing network info cache for port 0ac172e4-b81e-4014-bb42-bb91fe781adf {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:52:42.955501 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Creating config drive at /opt/stack/data/nova/instances/d3a7c39a-f946-496d-9153-0a422e7f5350/disk.config
May 28 01:52:42.958418 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d3a7c39a-f946-496d-9153-0a422e7f5350/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpk3wn0zgo {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:52:43.021535 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d3a7c39a-f946-496d-9153-0a422e7f5350/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpk3wn0zgo" returned: 0 in 0.063s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:52:43.172158 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:52:43.355650 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-b42898ad-35ca-4912-b0b6-cec6ece53f92 req-b81dd156-0435-4f50-ba1b-25f4d43964e2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:43.536460 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:43.602203 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:43.603987 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:43.661842 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:43.689064 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.564s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:43.690223 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:52:43.785837 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:43.810335 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:43.814046 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:43.832201 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:43.834994 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:43.904040 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:43.938229 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:43.939307 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:43.952233 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:43.968507 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:43.971295 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:43.996113 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-30cb7865-676f-46d7-a35c-154b9ae2f05a req-cbc6a84c-fc30-43f2-9662-27f24b8ec723 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-vif-plugged-3d994306-44d7-4407-94eb-49b142832ffc {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:43.997225 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-30cb7865-676f-46d7-a35c-154b9ae2f05a req-cbc6a84c-fc30-43f2-9662-27f24b8ec723 service nova] Acquiring lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:43.997540 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-30cb7865-676f-46d7-a35c-154b9ae2f05a req-cbc6a84c-fc30-43f2-9662-27f24b8ec723 service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:43.997778 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-30cb7865-676f-46d7-a35c-154b9ae2f05a req-cbc6a84c-fc30-43f2-9662-27f24b8ec723 service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:43.997982 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-30cb7865-676f-46d7-a35c-154b9ae2f05a req-cbc6a84c-fc30-43f2-9662-27f24b8ec723 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Processing event network-vif-plugged-3d994306-44d7-4407-94eb-49b142832ffc {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:52:44.001791 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:44.020550 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:44.037456 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:44.072663 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:44.170001 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:44.180475 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:44.204642 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:52:44.204642 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:52:44.204642 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:44.206343 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:44.255750 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-b42898ad-35ca-4912-b0b6-cec6ece53f92 req-b81dd156-0435-4f50-ba1b-25f4d43964e2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:44.261661 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:44.333955 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:44.360497 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:44.362711 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:44.367547 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '312a198f7d3d4ce9b586d8f36cf58f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d31342458ec4ed2890a766f62facbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:52:44.463845 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:44.551634 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-b42898ad-35ca-4912-b0b6-cec6ece53f92 req-b81dd156-0435-4f50-ba1b-25f4d43964e2 service nova] [instance: 02b42340-8535-4682-98db-49f970ff5597] Updated VIF entry in instance network info cache for port 0ac172e4-b81e-4014-bb42-bb91fe781adf. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:52:44.551951 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-b42898ad-35ca-4912-b0b6-cec6ece53f92 req-b81dd156-0435-4f50-ba1b-25f4d43964e2 service nova] [instance: 02b42340-8535-4682-98db-49f970ff5597] Updating instance_info_cache with network_info: [{"id": "0ac172e4-b81e-4014-bb42-bb91fe781adf", "address": "fa:16:3e:f4:4b:8c", "network": {"id": "f0cd4ecd-6ce5-4118-a161-0bc234bc71f7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1347979747-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "43c294dcbfc5459898bb040ccdf1b52f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac172e4-b8", "ovs_interfaceid": "0ac172e4-b81e-4014-bb42-bb91fe781adf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:52:44.568020 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:44.574800 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:44.576798 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:44.600443 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:44.614772 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Acquiring lock "a4e5fc7a-978f-407f-9faf-7ec539b55e0e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:44.615449 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Lock "a4e5fc7a-978f-407f-9faf-7ec539b55e0e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:44.715581 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:52:44.868004 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:44.941895 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e4f0d14a-03c1-4539-bf0d-14b99ad4d772 req-bf42291d-3ef7-43af-b43e-3aa511e4c5b0 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-vif-plugged-0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:44.942041 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e4f0d14a-03c1-4539-bf0d-14b99ad4d772 req-bf42291d-3ef7-43af-b43e-3aa511e4c5b0 service nova] Acquiring lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:44.942217 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e4f0d14a-03c1-4539-bf0d-14b99ad4d772 req-bf42291d-3ef7-43af-b43e-3aa511e4c5b0 service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:44.942337 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e4f0d14a-03c1-4539-bf0d-14b99ad4d772 req-bf42291d-3ef7-43af-b43e-3aa511e4c5b0 service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:44.942396 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e4f0d14a-03c1-4539-bf0d-14b99ad4d772 req-bf42291d-3ef7-43af-b43e-3aa511e4c5b0 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Processing event network-vif-plugged-0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:52:44.942544 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e4f0d14a-03c1-4539-bf0d-14b99ad4d772 req-bf42291d-3ef7-43af-b43e-3aa511e4c5b0 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-vif-plugged-0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:44.942621 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e4f0d14a-03c1-4539-bf0d-14b99ad4d772 req-bf42291d-3ef7-43af-b43e-3aa511e4c5b0 service nova] Acquiring lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:44.946467 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e4f0d14a-03c1-4539-bf0d-14b99ad4d772 req-bf42291d-3ef7-43af-b43e-3aa511e4c5b0 service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:44.946593 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e4f0d14a-03c1-4539-bf0d-14b99ad4d772 req-bf42291d-3ef7-43af-b43e-3aa511e4c5b0 service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:44.946744 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e4f0d14a-03c1-4539-bf0d-14b99ad4d772 req-bf42291d-3ef7-43af-b43e-3aa511e4c5b0 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] No event matching network-vif-plugged-0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8 in dict_keys([('network-vif-plugged', 'bf1e69e9-a858-4270-8c47-a209493f7e48'), ('network-vif-plugged', 'f5e93ea0-a679-45fb-9178-3842154f2e4d'), ('network-vif-plugged', '91f6bd16-2cfa-44ca-a7ea-ef3ef4933092'), ('network-vif-plugged', '9e08628c-1ff2-4d4b-9f3d-50231fa6ceec'), ('network-vif-plugged', 'a566955f-6906-4a3b-bdf1-2f55b31b6e21')]) {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 01:52:44.947788 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-e4f0d14a-03c1-4539-bf0d-14b99ad4d772 req-bf42291d-3ef7-43af-b43e-3aa511e4c5b0 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received unexpected event network-vif-plugged-0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8 for instance with vm_state building and task_state spawning.
May 28 01:52:45.028379 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Successfully created port: 828d441a-570b-4f98-b093-4eb521ee2cf8 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:52:45.054281 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b42898ad-35ca-4912-b0b6-cec6ece53f92 req-b81dd156-0435-4f50-ba1b-25f4d43964e2 service nova] Releasing lock "refresh_cache-02b42340-8535-4682-98db-49f970ff5597" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:52:45.060933 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:45.063823 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:45.119749 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Lazy-loading 'flavor' on Instance uuid a4e5fc7a-978f-407f-9faf-7ec539b55e0e {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:52:45.217876 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:52:45.256401 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:45.258894 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:45.370633 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933165.3701963, d3a7c39a-f946-496d-9153-0a422e7f5350 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:52:45.371102 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] VM Started (Lifecycle Event)
May 28 01:52:45.656940 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:45.661059 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:45.665820 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:45.667520 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:45.688179 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:45.695910 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:45.708434 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0d028f82-311c-4231-b1da-d0bcd6e98987 req-b06f8279-5db2-42c4-9d37-d31ab8ea7912 service nova] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Received event network-vif-plugged-00a0837b-bced-48a4-84d6-8ba3fa1cccfc {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:45.708434 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0d028f82-311c-4231-b1da-d0bcd6e98987 req-b06f8279-5db2-42c4-9d37-d31ab8ea7912 service nova] Acquiring lock "f342ed55-ce60-405b-bc09-856eced24bf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:45.708434 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0d028f82-311c-4231-b1da-d0bcd6e98987 req-b06f8279-5db2-42c4-9d37-d31ab8ea7912 service nova] Lock "f342ed55-ce60-405b-bc09-856eced24bf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:45.708434 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0d028f82-311c-4231-b1da-d0bcd6e98987 req-b06f8279-5db2-42c4-9d37-d31ab8ea7912 service nova] Lock "f342ed55-ce60-405b-bc09-856eced24bf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:45.708434 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0d028f82-311c-4231-b1da-d0bcd6e98987 req-b06f8279-5db2-42c4-9d37-d31ab8ea7912 service nova] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Processing event network-vif-plugged-00a0837b-bced-48a4-84d6-8ba3fa1cccfc {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:52:45.708705 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Instance event wait completed in 33 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:52:45.713461 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:52:45.719007 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Instance spawned successfully.
May 28 01:52:45.719295 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:52:45.745795 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Successfully updated port: 828d441a-570b-4f98-b093-4eb521ee2cf8 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:52:45.878153 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:52:45.883152 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933165.8828073, d3a7c39a-f946-496d-9153-0a422e7f5350 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:52:45.883344 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] VM Paused (Lifecycle Event)
May 28 01:52:45.951797 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:45.953492 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:46.096372 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-eadb1e0b-fe5e-414d-8aa0-84a31a6234b5 req-79fa64c3-cdec-4c39-81ca-1327d29767ce service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-vif-plugged-3d994306-44d7-4407-94eb-49b142832ffc {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:46.096734 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-eadb1e0b-fe5e-414d-8aa0-84a31a6234b5 req-79fa64c3-cdec-4c39-81ca-1327d29767ce service nova] Acquiring lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:46.096894 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-eadb1e0b-fe5e-414d-8aa0-84a31a6234b5 req-79fa64c3-cdec-4c39-81ca-1327d29767ce service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:46.097395 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-eadb1e0b-fe5e-414d-8aa0-84a31a6234b5 req-79fa64c3-cdec-4c39-81ca-1327d29767ce service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:46.100363 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-eadb1e0b-fe5e-414d-8aa0-84a31a6234b5 req-79fa64c3-cdec-4c39-81ca-1327d29767ce service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] No event matching network-vif-plugged-3d994306-44d7-4407-94eb-49b142832ffc in dict_keys([('network-vif-plugged', 'bf1e69e9-a858-4270-8c47-a209493f7e48'), ('network-vif-plugged', 'f5e93ea0-a679-45fb-9178-3842154f2e4d'), ('network-vif-plugged', '91f6bd16-2cfa-44ca-a7ea-ef3ef4933092'), ('network-vif-plugged', '9e08628c-1ff2-4d4b-9f3d-50231fa6ceec'), ('network-vif-plugged', 'a566955f-6906-4a3b-bdf1-2f55b31b6e21')]) {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 01:52:46.100363 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-eadb1e0b-fe5e-414d-8aa0-84a31a6234b5 req-79fa64c3-cdec-4c39-81ca-1327d29767ce service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received unexpected event network-vif-plugged-3d994306-44d7-4407-94eb-49b142832ffc for instance with vm_state building and task_state spawning.
May 28 01:52:46.100363 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-eadb1e0b-fe5e-414d-8aa0-84a31a6234b5 req-79fa64c3-cdec-4c39-81ca-1327d29767ce service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-vif-plugged-a566955f-6906-4a3b-bdf1-2f55b31b6e21 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:46.100363 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-eadb1e0b-fe5e-414d-8aa0-84a31a6234b5 req-79fa64c3-cdec-4c39-81ca-1327d29767ce service nova] Acquiring lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:46.100363 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-eadb1e0b-fe5e-414d-8aa0-84a31a6234b5 req-79fa64c3-cdec-4c39-81ca-1327d29767ce service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:46.100363 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-eadb1e0b-fe5e-414d-8aa0-84a31a6234b5 req-79fa64c3-cdec-4c39-81ca-1327d29767ce service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:46.100363 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-eadb1e0b-fe5e-414d-8aa0-84a31a6234b5 req-79fa64c3-cdec-4c39-81ca-1327d29767ce service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Processing event network-vif-plugged-a566955f-6906-4a3b-bdf1-2f55b31b6e21 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:52:46.100363 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-eadb1e0b-fe5e-414d-8aa0-84a31a6234b5 req-79fa64c3-cdec-4c39-81ca-1327d29767ce service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-vif-plugged-a566955f-6906-4a3b-bdf1-2f55b31b6e21 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:46.100363 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-eadb1e0b-fe5e-414d-8aa0-84a31a6234b5 req-79fa64c3-cdec-4c39-81ca-1327d29767ce service nova] Acquiring lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:46.100363 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-eadb1e0b-fe5e-414d-8aa0-84a31a6234b5 req-79fa64c3-cdec-4c39-81ca-1327d29767ce service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:46.100363 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-eadb1e0b-fe5e-414d-8aa0-84a31a6234b5 req-79fa64c3-cdec-4c39-81ca-1327d29767ce service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:46.100363 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-eadb1e0b-fe5e-414d-8aa0-84a31a6234b5 req-79fa64c3-cdec-4c39-81ca-1327d29767ce service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] No event matching network-vif-plugged-a566955f-6906-4a3b-bdf1-2f55b31b6e21 in dict_keys([('network-vif-plugged', 'bf1e69e9-a858-4270-8c47-a209493f7e48'), ('network-vif-plugged', 'f5e93ea0-a679-45fb-9178-3842154f2e4d'), ('network-vif-plugged', '91f6bd16-2cfa-44ca-a7ea-ef3ef4933092'), ('network-vif-plugged', '9e08628c-1ff2-4d4b-9f3d-50231fa6ceec')]) {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 01:52:46.100363 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-eadb1e0b-fe5e-414d-8aa0-84a31a6234b5 req-79fa64c3-cdec-4c39-81ca-1327d29767ce service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received unexpected event network-vif-plugged-a566955f-6906-4a3b-bdf1-2f55b31b6e21 for instance with vm_state building and task_state spawning.
May 28 01:52:46.100363 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-eadb1e0b-fe5e-414d-8aa0-84a31a6234b5 req-79fa64c3-cdec-4c39-81ca-1327d29767ce service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Received event network-changed-828d441a-570b-4f98-b093-4eb521ee2cf8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:46.100363 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-eadb1e0b-fe5e-414d-8aa0-84a31a6234b5 req-79fa64c3-cdec-4c39-81ca-1327d29767ce service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Refreshing instance network info cache due to event network-changed-828d441a-570b-4f98-b093-4eb521ee2cf8. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:52:46.100363 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-eadb1e0b-fe5e-414d-8aa0-84a31a6234b5 req-79fa64c3-cdec-4c39-81ca-1327d29767ce service nova] Acquiring lock "refresh_cache-adfbfdf0-7c0f-4834-92ff-3b8d8c39e333" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:52:46.101015 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-eadb1e0b-fe5e-414d-8aa0-84a31a6234b5 req-79fa64c3-cdec-4c39-81ca-1327d29767ce service nova] Acquired lock "refresh_cache-adfbfdf0-7c0f-4834-92ff-3b8d8c39e333" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:52:46.101042 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-eadb1e0b-fe5e-414d-8aa0-84a31a6234b5 req-79fa64c3-cdec-4c39-81ca-1327d29767ce service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Refreshing network info cache for port 828d441a-570b-4f98-b093-4eb521ee2cf8 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:52:46.127147 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Lock "a4e5fc7a-978f-407f-9faf-7ec539b55e0e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:46.230223 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:52:46.234582 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:52:46.234966 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Creating image(s)
May 28 01:52:46.235385 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Acquiring lock "/opt/stack/data/nova/instances/adfbfdf0-7c0f-4834-92ff-3b8d8c39e333/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:46.235560 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "/opt/stack/data/nova/instances/adfbfdf0-7c0f-4834-92ff-3b8d8c39e333/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:46.236148 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "/opt/stack/data/nova/instances/adfbfdf0-7c0f-4834-92ff-3b8d8c39e333/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:46.237389 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:52:46.242450 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:52:46.242450 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:52:46.242450 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:52:46.242450 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:52:46.242960 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:52:46.244174 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:52:46.246194 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:52:46.248543 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:52:46.260324 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Acquiring lock "refresh_cache-adfbfdf0-7c0f-4834-92ff-3b8d8c39e333" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:52:46.343196 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.095s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:52:46.343621 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:46.344032 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:46.345374 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:52:46.349762 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:52:46.350142 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:52:46.388014 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:52:46.393470 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:52:46.422012 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.072s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:52:46.422781 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/adfbfdf0-7c0f-4834-92ff-3b8d8c39e333/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:52:46.457873 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/adfbfdf0-7c0f-4834-92ff-3b8d8c39e333/disk 1073741824" returned: 0 in 0.035s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:52:46.458410 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.114s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:46.458741 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:52:46.530199 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.071s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:52:46.530909 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Checking if we can resize image /opt/stack/data/nova/instances/adfbfdf0-7c0f-4834-92ff-3b8d8c39e333/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:52:46.531185 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adfbfdf0-7c0f-4834-92ff-3b8d8c39e333/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:52:46.605815 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-eadb1e0b-fe5e-414d-8aa0-84a31a6234b5 req-79fa64c3-cdec-4c39-81ca-1327d29767ce service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:46.612599 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adfbfdf0-7c0f-4834-92ff-3b8d8c39e333/disk --force-share --output=json" returned: 0 in 0.081s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:52:46.614189 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Cannot resize image /opt/stack/data/nova/instances/adfbfdf0-7c0f-4834-92ff-3b8d8c39e333/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:52:46.614571 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:52:46.615282 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Ensure instance console log exists: /opt/stack/data/nova/instances/adfbfdf0-7c0f-4834-92ff-3b8d8c39e333/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:52:46.615282 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:46.615282 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:46.615576 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:46.678405 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-eadb1e0b-fe5e-414d-8aa0-84a31a6234b5 req-79fa64c3-cdec-4c39-81ca-1327d29767ce service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:52:46.764160 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Took 42.36 seconds to spawn the instance on the hypervisor.
May 28 01:52:46.764930 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:52:46.897850 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:52:46.900064 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-eadb1e0b-fe5e-414d-8aa0-84a31a6234b5 req-79fa64c3-cdec-4c39-81ca-1327d29767ce service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:52:46.902663 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933166.9010367, f342ed55-ce60-405b-bc09-856eced24bf7 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:52:46.902663 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] VM Resumed (Lifecycle Event)
May 28 01:52:47.215061 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Acquiring lock "a4e5fc7a-978f-407f-9faf-7ec539b55e0e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:47.215329 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Lock "a4e5fc7a-978f-407f-9faf-7ec539b55e0e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:47.215592 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Attaching volume 26b10162-1269-4387-8112-744630da1b32 to /dev/sdc
May 28 01:52:47.268526 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:52:47.277780 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Took 50.03 seconds to build instance.
May 28 01:52:47.287752 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:52:47.311004 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:52:47.339505 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:52:47.339781 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:52:47.349751 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:52:47.351377 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe22:2182', 'fe80::384c:7dff:fea8:707f', 'fe80::fc16:3eff:fef4:4b8c', 'fe80::e02a:5fff:fe52:f5a1', 'fe80::fc16:3eff:fed6:49ea', 'fe80::14ff:22ff:fe20:1ea1', 'fe80::fc16:3eff:fe45:c5fe', 'fe80::e05c:5bff:fea5:7965', 'fe80::fc16:3eff:fe52:6a', 'fe80::fc16:3eff:fe91:a669', 'fe80::3051:94ff:fec8:bd13', 'fe80::fc16:3eff:fe54:8727', 'fe80::fc16:3eff:feab:fdca', 'fe80::e4ee:48ff:fe05:5865', 'fe80::fc16:3eff:fe18:87d6', 'fe80::fc16:3eff:fe9a:c8f6', 'fe80::fc16:3eff:feba:70ee', 'fe80::fc16:3eff:fe1d:f8b7', 'fe80::4890:45ff:fee9:3b86', 'fe80::fc16:3eff:fecb:ffdf', 'fe80::f413:99ff:fea1:4341'] 
May 28 01:52:47.351377 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:52:47.351726 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:52:47.351781 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] <== get_connector_properties: return (83ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:52:47.352062 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Updating existing volume attachment record: d7b1ab47-2126-4651-b275-9920fa1e7f4a {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:52:47.406632 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:52:47.407879 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-eadb1e0b-fe5e-414d-8aa0-84a31a6234b5 req-79fa64c3-cdec-4c39-81ca-1327d29767ce service nova] Releasing lock "refresh_cache-adfbfdf0-7c0f-4834-92ff-3b8d8c39e333" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:52:47.408747 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Acquired lock "refresh_cache-adfbfdf0-7c0f-4834-92ff-3b8d8c39e333" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:52:47.408966 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:52:47.411810 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:52:47.776377 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-be7b43ab-7082-40b8-9f05-80165f78fcd9 req-0f3f6843-bb74-4525-9b9d-3c8f9fb7891e service nova] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Received event network-vif-plugged-00a0837b-bced-48a4-84d6-8ba3fa1cccfc {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:47.776377 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-be7b43ab-7082-40b8-9f05-80165f78fcd9 req-0f3f6843-bb74-4525-9b9d-3c8f9fb7891e service nova] Acquiring lock "f342ed55-ce60-405b-bc09-856eced24bf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:47.776519 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-be7b43ab-7082-40b8-9f05-80165f78fcd9 req-0f3f6843-bb74-4525-9b9d-3c8f9fb7891e service nova] Lock "f342ed55-ce60-405b-bc09-856eced24bf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:47.776980 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-be7b43ab-7082-40b8-9f05-80165f78fcd9 req-0f3f6843-bb74-4525-9b9d-3c8f9fb7891e service nova] Lock "f342ed55-ce60-405b-bc09-856eced24bf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:47.777116 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-be7b43ab-7082-40b8-9f05-80165f78fcd9 req-0f3f6843-bb74-4525-9b9d-3c8f9fb7891e service nova] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] No waiting events found dispatching network-vif-plugged-00a0837b-bced-48a4-84d6-8ba3fa1cccfc {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:52:47.777234 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-be7b43ab-7082-40b8-9f05-80165f78fcd9 req-0f3f6843-bb74-4525-9b9d-3c8f9fb7891e service nova] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Received unexpected event network-vif-plugged-00a0837b-bced-48a4-84d6-8ba3fa1cccfc for instance with vm_state active and task_state None.
May 28 01:52:47.777401 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-be7b43ab-7082-40b8-9f05-80165f78fcd9 req-0f3f6843-bb74-4525-9b9d-3c8f9fb7891e service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-vif-unplugged-f5e93ea0-a679-45fb-9178-3842154f2e4d {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:47.777534 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-be7b43ab-7082-40b8-9f05-80165f78fcd9 req-0f3f6843-bb74-4525-9b9d-3c8f9fb7891e service nova] Acquiring lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:47.777666 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-be7b43ab-7082-40b8-9f05-80165f78fcd9 req-0f3f6843-bb74-4525-9b9d-3c8f9fb7891e service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:47.777803 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-be7b43ab-7082-40b8-9f05-80165f78fcd9 req-0f3f6843-bb74-4525-9b9d-3c8f9fb7891e service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:47.777918 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-be7b43ab-7082-40b8-9f05-80165f78fcd9 req-0f3f6843-bb74-4525-9b9d-3c8f9fb7891e service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] No event matching network-vif-unplugged-f5e93ea0-a679-45fb-9178-3842154f2e4d in dict_keys([('network-vif-plugged', 'bf1e69e9-a858-4270-8c47-a209493f7e48'), ('network-vif-plugged', 'f5e93ea0-a679-45fb-9178-3842154f2e4d'), ('network-vif-plugged', '91f6bd16-2cfa-44ca-a7ea-ef3ef4933092'), ('network-vif-plugged', '9e08628c-1ff2-4d4b-9f3d-50231fa6ceec')]) {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 01:52:47.778027 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-be7b43ab-7082-40b8-9f05-80165f78fcd9 req-0f3f6843-bb74-4525-9b9d-3c8f9fb7891e service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received unexpected event network-vif-unplugged-f5e93ea0-a679-45fb-9178-3842154f2e4d for instance with vm_state building and task_state spawning.
May 28 01:52:47.778140 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-be7b43ab-7082-40b8-9f05-80165f78fcd9 req-0f3f6843-bb74-4525-9b9d-3c8f9fb7891e service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-vif-unplugged-91f6bd16-2cfa-44ca-a7ea-ef3ef4933092 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:47.778289 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-be7b43ab-7082-40b8-9f05-80165f78fcd9 req-0f3f6843-bb74-4525-9b9d-3c8f9fb7891e service nova] Acquiring lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:47.778439 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-be7b43ab-7082-40b8-9f05-80165f78fcd9 req-0f3f6843-bb74-4525-9b9d-3c8f9fb7891e service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:47.778543 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-be7b43ab-7082-40b8-9f05-80165f78fcd9 req-0f3f6843-bb74-4525-9b9d-3c8f9fb7891e service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:47.778651 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-be7b43ab-7082-40b8-9f05-80165f78fcd9 req-0f3f6843-bb74-4525-9b9d-3c8f9fb7891e service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] No event matching network-vif-unplugged-91f6bd16-2cfa-44ca-a7ea-ef3ef4933092 in dict_keys([('network-vif-plugged', 'bf1e69e9-a858-4270-8c47-a209493f7e48'), ('network-vif-plugged', 'f5e93ea0-a679-45fb-9178-3842154f2e4d'), ('network-vif-plugged', '91f6bd16-2cfa-44ca-a7ea-ef3ef4933092'), ('network-vif-plugged', '9e08628c-1ff2-4d4b-9f3d-50231fa6ceec')]) {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 01:52:47.779144 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-be7b43ab-7082-40b8-9f05-80165f78fcd9 req-0f3f6843-bb74-4525-9b9d-3c8f9fb7891e service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received unexpected event network-vif-unplugged-91f6bd16-2cfa-44ca-a7ea-ef3ef4933092 for instance with vm_state building and task_state spawning.
May 28 01:52:47.779144 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-be7b43ab-7082-40b8-9f05-80165f78fcd9 req-0f3f6843-bb74-4525-9b9d-3c8f9fb7891e service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-vif-unplugged-9e08628c-1ff2-4d4b-9f3d-50231fa6ceec {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:47.779355 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-be7b43ab-7082-40b8-9f05-80165f78fcd9 req-0f3f6843-bb74-4525-9b9d-3c8f9fb7891e service nova] Acquiring lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:47.779387 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-be7b43ab-7082-40b8-9f05-80165f78fcd9 req-0f3f6843-bb74-4525-9b9d-3c8f9fb7891e service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:47.779521 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-be7b43ab-7082-40b8-9f05-80165f78fcd9 req-0f3f6843-bb74-4525-9b9d-3c8f9fb7891e service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:47.779673 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-be7b43ab-7082-40b8-9f05-80165f78fcd9 req-0f3f6843-bb74-4525-9b9d-3c8f9fb7891e service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] No event matching network-vif-unplugged-9e08628c-1ff2-4d4b-9f3d-50231fa6ceec in dict_keys([('network-vif-plugged', 'bf1e69e9-a858-4270-8c47-a209493f7e48'), ('network-vif-plugged', 'f5e93ea0-a679-45fb-9178-3842154f2e4d'), ('network-vif-plugged', '91f6bd16-2cfa-44ca-a7ea-ef3ef4933092'), ('network-vif-plugged', '9e08628c-1ff2-4d4b-9f3d-50231fa6ceec')]) {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 01:52:47.779825 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-be7b43ab-7082-40b8-9f05-80165f78fcd9 req-0f3f6843-bb74-4525-9b9d-3c8f9fb7891e service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received unexpected event network-vif-unplugged-9e08628c-1ff2-4d4b-9f3d-50231fa6ceec for instance with vm_state building and task_state spawning.
May 28 01:52:47.779973 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-be7b43ab-7082-40b8-9f05-80165f78fcd9 req-0f3f6843-bb74-4525-9b9d-3c8f9fb7891e service nova] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Received event network-vif-plugged-62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:47.780144 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-be7b43ab-7082-40b8-9f05-80165f78fcd9 req-0f3f6843-bb74-4525-9b9d-3c8f9fb7891e service nova] Acquiring lock "bad69594-f163-41a6-931f-d2fcda0cb7d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:47.780449 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-be7b43ab-7082-40b8-9f05-80165f78fcd9 req-0f3f6843-bb74-4525-9b9d-3c8f9fb7891e service nova] Lock "bad69594-f163-41a6-931f-d2fcda0cb7d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:47.780503 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-be7b43ab-7082-40b8-9f05-80165f78fcd9 req-0f3f6843-bb74-4525-9b9d-3c8f9fb7891e service nova] Lock "bad69594-f163-41a6-931f-d2fcda0cb7d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:47.780646 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-be7b43ab-7082-40b8-9f05-80165f78fcd9 req-0f3f6843-bb74-4525-9b9d-3c8f9fb7891e service nova] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Processing event network-vif-plugged-62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:52:47.780829 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-be7b43ab-7082-40b8-9f05-80165f78fcd9 req-0f3f6843-bb74-4525-9b9d-3c8f9fb7891e service nova] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Received event network-vif-plugged-62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:47.780979 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-be7b43ab-7082-40b8-9f05-80165f78fcd9 req-0f3f6843-bb74-4525-9b9d-3c8f9fb7891e service nova] Acquiring lock "bad69594-f163-41a6-931f-d2fcda0cb7d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:47.781159 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-be7b43ab-7082-40b8-9f05-80165f78fcd9 req-0f3f6843-bb74-4525-9b9d-3c8f9fb7891e service nova] Lock "bad69594-f163-41a6-931f-d2fcda0cb7d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:47.781302 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-be7b43ab-7082-40b8-9f05-80165f78fcd9 req-0f3f6843-bb74-4525-9b9d-3c8f9fb7891e service nova] Lock "bad69594-f163-41a6-931f-d2fcda0cb7d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:47.781442 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-be7b43ab-7082-40b8-9f05-80165f78fcd9 req-0f3f6843-bb74-4525-9b9d-3c8f9fb7891e service nova] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] No waiting events found dispatching network-vif-plugged-62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:52:47.781582 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-be7b43ab-7082-40b8-9f05-80165f78fcd9 req-0f3f6843-bb74-4525-9b9d-3c8f9fb7891e service nova] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Received unexpected event network-vif-plugged-62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6 for instance with vm_state building and task_state spawning.
May 28 01:52:47.781722 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-be7b43ab-7082-40b8-9f05-80165f78fcd9 req-0f3f6843-bb74-4525-9b9d-3c8f9fb7891e service nova] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Received event network-vif-unplugged-6835d977-7c34-4bd7-8d12-208432ea45d3 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:47.781866 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-be7b43ab-7082-40b8-9f05-80165f78fcd9 req-0f3f6843-bb74-4525-9b9d-3c8f9fb7891e service nova] Acquiring lock "f2805796-e531-4508-8585-0d110f4bd4e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:47.782031 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-be7b43ab-7082-40b8-9f05-80165f78fcd9 req-0f3f6843-bb74-4525-9b9d-3c8f9fb7891e service nova] Lock "f2805796-e531-4508-8585-0d110f4bd4e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:47.795133 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-be7b43ab-7082-40b8-9f05-80165f78fcd9 req-0f3f6843-bb74-4525-9b9d-3c8f9fb7891e service nova] Lock "f2805796-e531-4508-8585-0d110f4bd4e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:47.795529 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Instance event wait completed in 30 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:52:47.795835 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Lock "f342ed55-ce60-405b-bc09-856eced24bf7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 51.561s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:47.796138 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:47.801832 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-be7b43ab-7082-40b8-9f05-80165f78fcd9 req-0f3f6843-bb74-4525-9b9d-3c8f9fb7891e service nova] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] No event matching network-vif-unplugged-6835d977-7c34-4bd7-8d12-208432ea45d3 in dict_keys([('network-vif-plugged', '6835d977-7c34-4bd7-8d12-208432ea45d3')]) {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 01:52:47.802362 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:52:47.804843 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-be7b43ab-7082-40b8-9f05-80165f78fcd9 req-0f3f6843-bb74-4525-9b9d-3c8f9fb7891e service nova] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Received unexpected event network-vif-unplugged-6835d977-7c34-4bd7-8d12-208432ea45d3 for instance with vm_state building and task_state spawning.
May 28 01:52:47.805150 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-be7b43ab-7082-40b8-9f05-80165f78fcd9 req-0f3f6843-bb74-4525-9b9d-3c8f9fb7891e service nova] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Received event network-vif-plugged-6835d977-7c34-4bd7-8d12-208432ea45d3 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:47.805395 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-be7b43ab-7082-40b8-9f05-80165f78fcd9 req-0f3f6843-bb74-4525-9b9d-3c8f9fb7891e service nova] Acquiring lock "f2805796-e531-4508-8585-0d110f4bd4e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:47.805582 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-be7b43ab-7082-40b8-9f05-80165f78fcd9 req-0f3f6843-bb74-4525-9b9d-3c8f9fb7891e service nova] Lock "f2805796-e531-4508-8585-0d110f4bd4e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:47.805746 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-be7b43ab-7082-40b8-9f05-80165f78fcd9 req-0f3f6843-bb74-4525-9b9d-3c8f9fb7891e service nova] Lock "f2805796-e531-4508-8585-0d110f4bd4e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:47.805897 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-be7b43ab-7082-40b8-9f05-80165f78fcd9 req-0f3f6843-bb74-4525-9b9d-3c8f9fb7891e service nova] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Processing event network-vif-plugged-6835d977-7c34-4bd7-8d12-208432ea45d3 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:52:47.806090 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-be7b43ab-7082-40b8-9f05-80165f78fcd9 req-0f3f6843-bb74-4525-9b9d-3c8f9fb7891e service nova] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Received event network-vif-plugged-6835d977-7c34-4bd7-8d12-208432ea45d3 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:47.806269 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-be7b43ab-7082-40b8-9f05-80165f78fcd9 req-0f3f6843-bb74-4525-9b9d-3c8f9fb7891e service nova] Acquiring lock "f2805796-e531-4508-8585-0d110f4bd4e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:47.809913 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-be7b43ab-7082-40b8-9f05-80165f78fcd9 req-0f3f6843-bb74-4525-9b9d-3c8f9fb7891e service nova] Lock "f2805796-e531-4508-8585-0d110f4bd4e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:47.809913 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-be7b43ab-7082-40b8-9f05-80165f78fcd9 req-0f3f6843-bb74-4525-9b9d-3c8f9fb7891e service nova] Lock "f2805796-e531-4508-8585-0d110f4bd4e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:47.809913 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-be7b43ab-7082-40b8-9f05-80165f78fcd9 req-0f3f6843-bb74-4525-9b9d-3c8f9fb7891e service nova] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] No waiting events found dispatching network-vif-plugged-6835d977-7c34-4bd7-8d12-208432ea45d3 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:52:47.809913 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-be7b43ab-7082-40b8-9f05-80165f78fcd9 req-0f3f6843-bb74-4525-9b9d-3c8f9fb7891e service nova] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Received unexpected event network-vif-plugged-6835d977-7c34-4bd7-8d12-208432ea45d3 for instance with vm_state building and task_state spawning.
May 28 01:52:47.809913 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Instance event wait completed in 12 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:52:47.812186 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Instance spawned successfully.
May 28 01:52:47.812656 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:52:47.814339 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:52:47.816228 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Instance spawned successfully.
May 28 01:52:47.816651 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:52:47.916611 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933167.9162185, bad69594-f163-41a6-931f-d2fcda0cb7d1 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:52:47.917091 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] VM Resumed (Lifecycle Event)
May 28 01:52:47.932667 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:52:47.934683 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32', 'iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '26b10162-1269-4387-8112-744630da1b32', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:52:47.934683 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:52:47.934683 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:52:47.934683 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32', 'iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '26b10162-1269-4387-8112-744630da1b32', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:52:47.952761 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:52:47.953034 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:52:47.954101 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:52:47.954817 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:52:47.956694 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:52:47.958244 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:52:47.971126 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:52:47.971126 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:47.977775 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:52:47.977775 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:47.990024 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32] added
May 28 01:52:47.990024 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:52:47.990024 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:52:47.990024 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:52:47.990024 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:52:47.990024 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:52:47.990024 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:47.990289 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:52:47.990552 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0364(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:52:47.990784 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:52:47.992342 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32] added
May 28 01:52:47.992342 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:52:47.992342 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:52:47.992342 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:52:47.992342 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:52:47.992342 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:52:47.992342 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:47.992579 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:52:47.992816 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0346(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:52:47.993000 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:52:48.026853 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:52:48.224007 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:48.323105 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:52:48.323285 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:52:48.323702 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:52:48.324034 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:52:48.324389 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:52:48.324677 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:52:48.331884 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:52:48.332041 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:52:48.332362 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:52:48.332579 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:52:48.332796 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:52:48.333018 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:52:48.390850 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Updating instance_info_cache with network_info: [{"id": "828d441a-570b-4f98-b093-4eb521ee2cf8", "address": "fa:16:3e:f5:ed:7d", "network": {"id": "34ab0ff0-75dd-45e7-97f6-22f8e62a8149", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1222751470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d31342458ec4ed2890a766f62facbcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap828d441a-57", "ovs_interfaceid": "828d441a-570b-4f98-b093-4eb521ee2cf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:52:48.422253 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:52:48.423690 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:52:48.838589 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Took 22.43 seconds to spawn the instance on the hypervisor.
May 28 01:52:48.840387 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Took 39.39 seconds to spawn the instance on the hypervisor.
May 28 01:52:48.840556 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:52:48.840929 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:52:48.893655 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Releasing lock "refresh_cache-adfbfdf0-7c0f-4834-92ff-3b8d8c39e333" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:52:48.893972 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Instance network_info: |[{"id": "828d441a-570b-4f98-b093-4eb521ee2cf8", "address": "fa:16:3e:f5:ed:7d", "network": {"id": "34ab0ff0-75dd-45e7-97f6-22f8e62a8149", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1222751470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d31342458ec4ed2890a766f62facbcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap828d441a-57", "ovs_interfaceid": "828d441a-570b-4f98-b093-4eb521ee2cf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:52:48.897375 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Start _get_guest_xml network_info=[{"id": "828d441a-570b-4f98-b093-4eb521ee2cf8", "address": "fa:16:3e:f5:ed:7d", "network": {"id": "34ab0ff0-75dd-45e7-97f6-22f8e62a8149", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1222751470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d31342458ec4ed2890a766f62facbcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap828d441a-57", "ovs_interfaceid": "828d441a-570b-4f98-b093-4eb521ee2cf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:52:48.899434 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:52:48.900791 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-1548147209', uuid='adfbfdf0-7c0f-4834-92ff-3b8d8c39e333'), owner=OwnerMeta(userid='312a198f7d3d4ce9b586d8f36cf58f76', username='tempest-AttachVolumeShelveTestJSON-1906404591-project-member', projectid='0d31342458ec4ed2890a766f62facbcf', projectname='tempest-AttachVolumeShelveTestJSON-1906404591'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "828d441a-570b-4f98-b093-4eb521ee2cf8", "address": "fa:16:3e:f5:ed:7d", "network": {"id": "34ab0ff0-75dd-45e7-97f6-22f8e62a8149", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1222751470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d31342458ec4ed2890a766f62facbcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap828d441a-57", "ovs_interfaceid": "828d441a-570b-4f98-b093-4eb521ee2cf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933168.9004238) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:52:48.901792 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:52:48.902146 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:52:48.902914 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:52:48.903185 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:52:48.904029 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:52:48.904394 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:52:48.904542 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:52:48.904635 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:52:48.905019 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:52:48.905151 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:52:48.905255 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:52:48.905777 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:52:48.905908 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:52:48.906023 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:52:48.906148 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:52:48.906270 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:52:48.917378 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:52:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1548147209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-attachvolumeshelvetestjson-server-1548147209',id=9,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJwrMRD5wxwugzv1AEW5/hAzhH1YG3g6YQRM7Gj02COrqoTMUwOT7Qvj1PHahHsueYMlw286AH6SOiqmQpBGgCrC9ZUpIHXzJIpstHW4gbgJg8NYW8F6fN/ppNzWYnxsQ==',key_name='tempest-keypair-1047928115',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d31342458ec4ed2890a766f62facbcf',ramdisk_id='',reservation_id='r-ciexyebb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1906404591',owner_user_name='tempest-AttachVolumeShelveTestJSON-1906404591-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:52:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='312a198f7d3d4ce9b586d8f36cf58f76',uuid=adfbfdf0-7c0f-4834-92ff-3b8d8c39e333,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "828d441a-570b-4f98-b093-4eb521ee2cf8", "address": "fa:16:3e:f5:ed:7d", "network": {"id": "34ab0ff0-75dd-45e7-97f6-22f8e62a8149", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1222751470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d31342458ec4ed2890a766f62facbcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap828d441a-57", "ovs_interfaceid": "828d441a-570b-4f98-b093-4eb521ee2cf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:52:48.917560 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Converting VIF {"id": "828d441a-570b-4f98-b093-4eb521ee2cf8", "address": "fa:16:3e:f5:ed:7d", "network": {"id": "34ab0ff0-75dd-45e7-97f6-22f8e62a8149", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1222751470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d31342458ec4ed2890a766f62facbcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap828d441a-57", "ovs_interfaceid": "828d441a-570b-4f98-b093-4eb521ee2cf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:52:48.918104 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ed:7d,bridge_name='br-int',has_traffic_filtering=True,id=828d441a-570b-4f98-b093-4eb521ee2cf8,network=Network(34ab0ff0-75dd-45e7-97f6-22f8e62a8149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap828d441a-57') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:52:48.918720 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lazy-loading 'pci_devices' on Instance uuid adfbfdf0-7c0f-4834-92ff-3b8d8c39e333 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:52:48.928016 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:52:48.928016 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933168.9267633, f2805796-e531-4508-8585-0d110f4bd4e7 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:52:48.928016 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] VM Resumed (Lifecycle Event)
May 28 01:52:48.991902 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:52:48.994798 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:52:49.007535 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:52:49.007535 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:52:49.011400 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:52:49.011400 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:49.022383 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:49.026811 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:49.045743 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:52:49.045743 np0000001583 nova-compute[98241]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-44282e36-4214-4fc0-aa08-c7e71daca625 (non-flash)
May 28 01:52:49.045743 np0000001583 nova-compute[98241]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:52:49.045743 np0000001583 nova-compute[98241]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:52:49.045743 np0000001583 nova-compute[98241]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:49.045743 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:49.045743 np0000001583 nova-compute[98241]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:49.045743 np0000001583 nova-compute[98241]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:49.045743 np0000001583 nova-compute[98241]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:52:49.045743 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:52:49.045972 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:52:49.045972 np0000001583 nova-compute[98241]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-44282e36-4214-4fc0-aa08-c7e71daca625 (non-flash)
May 28 01:52:49.045972 np0000001583 nova-compute[98241]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:52:49.045972 np0000001583 nova-compute[98241]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:52:49.045972 np0000001583 nova-compute[98241]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:49.045972 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:49.045972 np0000001583 nova-compute[98241]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:49.045972 np0000001583 nova-compute[98241]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:49.045972 np0000001583 nova-compute[98241]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:52:49.045972 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:52:49.046601 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:52:49.046601 np0000001583 nova-compute[98241]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-44282e36-4214-4fc0-aa08-c7e71daca625 (non-flash)
May 28 01:52:49.046601 np0000001583 nova-compute[98241]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:52:49.046601 np0000001583 nova-compute[98241]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:52:49.046601 np0000001583 nova-compute[98241]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:49.046601 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:49.046601 np0000001583 nova-compute[98241]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:49.046601 np0000001583 nova-compute[98241]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:49.046601 np0000001583 nova-compute[98241]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:52:49.046601 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:52:49.046830 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:52:49.046830 np0000001583 nova-compute[98241]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-44282e36-4214-4fc0-aa08-c7e71daca625 (non-flash)
May 28 01:52:49.046830 np0000001583 nova-compute[98241]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:52:49.046830 np0000001583 nova-compute[98241]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:52:49.046830 np0000001583 nova-compute[98241]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:49.046830 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:49.046830 np0000001583 nova-compute[98241]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:49.046830 np0000001583 nova-compute[98241]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:49.046830 np0000001583 nova-compute[98241]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:52:49.046830 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:52:49.097542 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32, portal: 192.168.40.100,3260]
May 28 01:52:49.097542 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32, portal: 192.168.40.100,3260] successful.
May 28 01:52:49.097542 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:49.110328 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:49.123996 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32, portal: 192.168.50.100,3260]
May 28 01:52:49.123996 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32, portal: 192.168.50.100,3260] successful.
May 28 01:52:49.123996 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:49.134014 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:52:49.134014 np0000001583 nova-compute[98241]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-44282e36-4214-4fc0-aa08-c7e71daca625 (non-flash)
May 28 01:52:49.134014 np0000001583 nova-compute[98241]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:52:49.134014 np0000001583 nova-compute[98241]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:52:49.134014 np0000001583 nova-compute[98241]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32 (non-flash)
May 28 01:52:49.134014 np0000001583 nova-compute[98241]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32 (non-flash)
May 28 01:52:49.134014 np0000001583 nova-compute[98241]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:49.134014 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:49.134014 np0000001583 nova-compute[98241]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:49.134014 np0000001583 nova-compute[98241]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:49.134014 np0000001583 nova-compute[98241]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:52:49.134014 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:52:49.134014 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:52:49.134014 np0000001583 nova-compute[98241]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-44282e36-4214-4fc0-aa08-c7e71daca625 (non-flash)
May 28 01:52:49.134014 np0000001583 nova-compute[98241]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:52:49.134014 np0000001583 nova-compute[98241]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:52:49.134014 np0000001583 nova-compute[98241]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32 (non-flash)
May 28 01:52:49.134014 np0000001583 nova-compute[98241]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32 (non-flash)
May 28 01:52:49.134014 np0000001583 nova-compute[98241]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:49.134014 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:49.134014 np0000001583 nova-compute[98241]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:49.134014 np0000001583 nova-compute[98241]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:49.134014 np0000001583 nova-compute[98241]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:52:49.134014 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:52:49.134014 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.181s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:52:49.134014 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:52:49.135382 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:49.136841 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] HCTL ('16', '-', '-', 0) found on session 14 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:52:49.136841 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:52:49.160226 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Searching for a device in session 14 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:52:49.160226 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '26b10162-1269-4387-8112-744630da1b32', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:52:49.161821 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:52:49.161821 np0000001583 nova-compute[98241]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-44282e36-4214-4fc0-aa08-c7e71daca625 (non-flash)
May 28 01:52:49.161821 np0000001583 nova-compute[98241]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:52:49.161821 np0000001583 nova-compute[98241]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:52:49.161821 np0000001583 nova-compute[98241]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32 (non-flash)
May 28 01:52:49.161821 np0000001583 nova-compute[98241]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32 (non-flash)
May 28 01:52:49.161821 np0000001583 nova-compute[98241]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:49.161821 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:49.161821 np0000001583 nova-compute[98241]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:49.161821 np0000001583 nova-compute[98241]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:49.161821 np0000001583 nova-compute[98241]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:52:49.161821 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:52:49.162474 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:52:49.162474 np0000001583 nova-compute[98241]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-44282e36-4214-4fc0-aa08-c7e71daca625 (non-flash)
May 28 01:52:49.162474 np0000001583 nova-compute[98241]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:52:49.162474 np0000001583 nova-compute[98241]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:52:49.162474 np0000001583 nova-compute[98241]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32 (non-flash)
May 28 01:52:49.162474 np0000001583 nova-compute[98241]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32 (non-flash)
May 28 01:52:49.162474 np0000001583 nova-compute[98241]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:49.162474 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:49.162474 np0000001583 nova-compute[98241]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:49.162474 np0000001583 nova-compute[98241]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:49.162474 np0000001583 nova-compute[98241]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:52:49.162474 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:52:49.162474 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.207s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:52:49.162984 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:52:49.163642 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] HCTL ('17', '-', '-', 0) found on session 15 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:52:49.163759 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:52:49.185126 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Searching for a device in session 15 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:52:49.185196 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '26b10162-1269-4387-8112-744630da1b32', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:52:49.353878 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Took 51.59 seconds to build instance.
May 28 01:52:49.379538 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Took 32.34 seconds to build instance.
May 28 01:52:49.421220 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] End _get_guest_xml xml=<domain type="qemu">
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:   <uuid>adfbfdf0-7c0f-4834-92ff-3b8d8c39e333</uuid>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:   <name>instance-00000009</name>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1548147209</nova:name>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:52:48</nova:creationTime>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:         <nova:user uuid="312a198f7d3d4ce9b586d8f36cf58f76">tempest-AttachVolumeShelveTestJSON-1906404591-project-member</nova:user>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:         <nova:project uuid="0d31342458ec4ed2890a766f62facbcf">tempest-AttachVolumeShelveTestJSON-1906404591</nova:project>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:         <nova:port uuid="828d441a-570b-4f98-b093-4eb521ee2cf8">
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:     <system>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:       <entry name="serial">adfbfdf0-7c0f-4834-92ff-3b8d8c39e333</entry>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:       <entry name="uuid">adfbfdf0-7c0f-4834-92ff-3b8d8c39e333</entry>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:     </system>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:   <os>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:   </os>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:   <features>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:   </features>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:   <devices>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/adfbfdf0-7c0f-4834-92ff-3b8d8c39e333/disk"/>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:     </disk>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/adfbfdf0-7c0f-4834-92ff-3b8d8c39e333/disk.config"/>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:     </disk>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:f5:ed:7d"/>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:       <target dev="tap828d441a-57"/>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:     </interface>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/adfbfdf0-7c0f-4834-92ff-3b8d8c39e333/console.log" append="off"/>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:     </serial>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:     <video>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:     </video>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:     </rng>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:   </devices>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]: </domain>
May 28 01:52:49.421220 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:52:49.423565 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Preparing to wait for external event network-vif-plugged-828d441a-570b-4f98-b093-4eb521ee2cf8 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:52:49.423565 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Acquiring lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:49.423565 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:49.423565 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:49.423565 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:52:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1548147209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-attachvolumeshelvetestjson-server-1548147209',id=9,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJwrMRD5wxwugzv1AEW5/hAzhH1YG3g6YQRM7Gj02COrqoTMUwOT7Qvj1PHahHsueYMlw286AH6SOiqmQpBGgCrC9ZUpIHXzJIpstHW4gbgJg8NYW8F6fN/ppNzWYnxsQ==',key_name='tempest-keypair-1047928115',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d31342458ec4ed2890a766f62facbcf',ramdisk_id='',reservation_id='r-ciexyebb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1906404591',owner_user_name='tempest-AttachVolumeShelveTestJSON-1906404591-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:52:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='312a198f7d3d4ce9b586d8f36cf58f76',uuid=adfbfdf0-7c0f-4834-92ff-3b8d8c39e333,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "828d441a-570b-4f98-b093-4eb521ee2cf8", "address": "fa:16:3e:f5:ed:7d", "network": {"id": "34ab0ff0-75dd-45e7-97f6-22f8e62a8149", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1222751470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d31342458ec4ed2890a766f62facbcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap828d441a-57", "ovs_interfaceid": "828d441a-570b-4f98-b093-4eb521ee2cf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:52:49.423565 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Converting VIF {"id": "828d441a-570b-4f98-b093-4eb521ee2cf8", "address": "fa:16:3e:f5:ed:7d", "network": {"id": "34ab0ff0-75dd-45e7-97f6-22f8e62a8149", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1222751470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d31342458ec4ed2890a766f62facbcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap828d441a-57", "ovs_interfaceid": "828d441a-570b-4f98-b093-4eb521ee2cf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:52:49.423565 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ed:7d,bridge_name='br-int',has_traffic_filtering=True,id=828d441a-570b-4f98-b093-4eb521ee2cf8,network=Network(34ab0ff0-75dd-45e7-97f6-22f8e62a8149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap828d441a-57') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:52:49.423565 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ed:7d,bridge_name='br-int',has_traffic_filtering=True,id=828d441a-570b-4f98-b093-4eb521ee2cf8,network=Network(34ab0ff0-75dd-45e7-97f6-22f8e62a8149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap828d441a-57') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:52:49.424470 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:49.426350 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:49.426670 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:52:49.427851 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:49.428150 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '37b17fc0-88bf-5270-bdbb-4e8a7d63aa26', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:49.431675 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:52:49.433255 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:52:49.436013 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:49.436301 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap828d441a-57, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:49.436698 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap828d441a-57, col_values=(('qos', UUID('36ca5b03-9393-4b33-bdd8-ced5a5b77fee')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:49.436962 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap828d441a-57, col_values=(('external_ids', {'iface-id': '828d441a-570b-4f98-b093-4eb521ee2cf8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:ed:7d', 'vm-uuid': 'adfbfdf0-7c0f-4834-92ff-3b8d8c39e333'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:49.437806 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:52:49.441916 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:52:49.448129 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:49.448129 np0000001583 nova-compute[98241]: INFO os_vif [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ed:7d,bridge_name='br-int',has_traffic_filtering=True,id=828d441a-570b-4f98-b093-4eb521ee2cf8,network=Network(34ab0ff0-75dd-45e7-97f6-22f8e62a8149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap828d441a-57')
May 28 01:52:49.859104 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "bad69594-f163-41a6-931f-d2fcda0cb7d1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 53.105s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:49.882594 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Lock "f2805796-e531-4508-8585-0d110f4bd4e7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 33.857s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:49.958670 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:52:50.699868 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8033e9a0-e5a3-428b-b448-796c08e32904 tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Acquiring lock "f342ed55-ce60-405b-bc09-856eced24bf7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:50.700298 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8033e9a0-e5a3-428b-b448-796c08e32904 tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Lock "f342ed55-ce60-405b-bc09-856eced24bf7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:50.700298 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8033e9a0-e5a3-428b-b448-796c08e32904 tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Acquiring lock "f342ed55-ce60-405b-bc09-856eced24bf7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:50.700424 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8033e9a0-e5a3-428b-b448-796c08e32904 tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Lock "f342ed55-ce60-405b-bc09-856eced24bf7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:50.700568 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8033e9a0-e5a3-428b-b448-796c08e32904 tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Lock "f342ed55-ce60-405b-bc09-856eced24bf7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:50.702999 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-8033e9a0-e5a3-428b-b448-796c08e32904 tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Terminating instance
May 28 01:52:50.836837 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-bc3b63e6-759f-46ad-9b7b-060ff84e3bb5 req-f52fa09e-7dfa-4ba1-92ed-7f16d7cd3d72 service nova] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Received event network-changed-62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:50.836988 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-bc3b63e6-759f-46ad-9b7b-060ff84e3bb5 req-f52fa09e-7dfa-4ba1-92ed-7f16d7cd3d72 service nova] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Refreshing instance network info cache due to event network-changed-62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:52:50.837155 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bc3b63e6-759f-46ad-9b7b-060ff84e3bb5 req-f52fa09e-7dfa-4ba1-92ed-7f16d7cd3d72 service nova] Acquiring lock "refresh_cache-bad69594-f163-41a6-931f-d2fcda0cb7d1" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:52:50.837239 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bc3b63e6-759f-46ad-9b7b-060ff84e3bb5 req-f52fa09e-7dfa-4ba1-92ed-7f16d7cd3d72 service nova] Acquired lock "refresh_cache-bad69594-f163-41a6-931f-d2fcda0cb7d1" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:52:50.837326 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-bc3b63e6-759f-46ad-9b7b-060ff84e3bb5 req-f52fa09e-7dfa-4ba1-92ed-7f16d7cd3d72 service nova] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Refreshing network info cache for port 62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:52:50.967049 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:52:50.967049 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:52:50.967049 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] No VIF found with MAC fa:16:3e:f5:ed:7d, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:52:50.967049 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Using config drive
May 28 01:52:50.978149 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Found WWN 330000000c8bfe810 for multipath device dm-8 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:52:50.979095 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.045s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:52:50.979496 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] <== connect_volume: return (3045ms) {'type': 'block', 'scsi_wwn': '330000000c8bfe810', 'path': '/dev/dm-8', 'multipath_id': '330000000c8bfe810'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:52:50.979930 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c8bfe810', 'path': '/dev/dm-8', 'multipath_id': '330000000c8bfe810'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:52:50.982733 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Lazy-loading 'flavor' on Instance uuid a4e5fc7a-978f-407f-9faf-7ec539b55e0e {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:52:51.216655 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-8033e9a0-e5a3-428b-b448-796c08e32904 tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:52:51.241516 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:51.244141 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:51.272575 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:51.273980 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:51.302230 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:51.304350 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:51.339999 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-bc3b63e6-759f-46ad-9b7b-060ff84e3bb5 req-f52fa09e-7dfa-4ba1-92ed-7f16d7cd3d72 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:51.464678 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-10fdf312-afee-49db-8cd2-88dec950f357 req-78343a7c-860e-4f26-9af3-fa62294c80ab service nova] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Received event network-changed-6835d977-7c34-4bd7-8d12-208432ea45d3 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:51.465741 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-10fdf312-afee-49db-8cd2-88dec950f357 req-78343a7c-860e-4f26-9af3-fa62294c80ab service nova] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Refreshing instance network info cache due to event network-changed-6835d977-7c34-4bd7-8d12-208432ea45d3. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:52:51.466533 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-10fdf312-afee-49db-8cd2-88dec950f357 req-78343a7c-860e-4f26-9af3-fa62294c80ab service nova] Acquiring lock "refresh_cache-f2805796-e531-4508-8585-0d110f4bd4e7" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:52:51.466533 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-10fdf312-afee-49db-8cd2-88dec950f357 req-78343a7c-860e-4f26-9af3-fa62294c80ab service nova] Acquired lock "refresh_cache-f2805796-e531-4508-8585-0d110f4bd4e7" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:52:51.466533 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-10fdf312-afee-49db-8cd2-88dec950f357 req-78343a7c-860e-4f26-9af3-fa62294c80ab service nova] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Refreshing network info cache for port 6835d977-7c34-4bd7-8d12-208432ea45d3 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:52:51.475483 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:51.488903 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] attach device xml: <disk type="block" device="disk">
May 28 01:52:51.488903 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:52:51.488903 np0000001583 nova-compute[98241]:   <alias name="ua-26b10162-1269-4387-8112-744630da1b32"/>
May 28 01:52:51.488903 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-8"/>
May 28 01:52:51.488903 np0000001583 nova-compute[98241]:   <target dev="sdc" bus="scsi"/>
May 28 01:52:51.488903 np0000001583 nova-compute[98241]:   <serial>26b10162-1269-4387-8112-744630da1b32</serial>
May 28 01:52:51.488903 np0000001583 nova-compute[98241]:   <address type="drive" controller="0" unit="2"/>
May 28 01:52:51.488903 np0000001583 nova-compute[98241]: </disk>
May 28 01:52:51.488903 np0000001583 nova-compute[98241]:  {{(pid=98241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 01:52:51.646229 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Creating config drive at /opt/stack/data/nova/instances/adfbfdf0-7c0f-4834-92ff-3b8d8c39e333/disk.config
May 28 01:52:51.653125 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/adfbfdf0-7c0f-4834-92ff-3b8d8c39e333/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpik5u36dh {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:52:51.679697 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999273885000093 future=<Future at 0x7724f851dfd0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:52:51.681765 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.99716097999999 future=<Future at 0x7724f851dfd0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:52:51.684444 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.99448574500002 future=<Future at 0x7724f851dfd0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:52:51.693353 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/adfbfdf0-7c0f-4834-92ff-3b8d8c39e333/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpik5u36dh" returned: 0 in 0.042s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:52:51.697257 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Instance destroyed successfully.
May 28 01:52:51.697257 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-8033e9a0-e5a3-428b-b448-796c08e32904 tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Lazy-loading 'resources' on Instance uuid f342ed55-ce60-405b-bc09-856eced24bf7 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:52:51.749104 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-bc3b63e6-759f-46ad-9b7b-060ff84e3bb5 req-f52fa09e-7dfa-4ba1-92ed-7f16d7cd3d72 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:51.919639 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-bc3b63e6-759f-46ad-9b7b-060ff84e3bb5 req-f52fa09e-7dfa-4ba1-92ed-7f16d7cd3d72 service nova] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Updated VIF entry in instance network info cache for port 62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:52:51.919948 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-bc3b63e6-759f-46ad-9b7b-060ff84e3bb5 req-f52fa09e-7dfa-4ba1-92ed-7f16d7cd3d72 service nova] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Updating instance_info_cache with network_info: [{"id": "62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6", "address": "fa:16:3e:52:00:6a", "network": {"id": "1a3cc53e-d09d-45ba-a64b-48bf74dd1680", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-582528653-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "947f6e33004d49cdb05fe27674f9eea8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d17bf8-d7", "ovs_interfaceid": "62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:52:51.973106 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-10fdf312-afee-49db-8cd2-88dec950f357 req-78343a7c-860e-4f26-9af3-fa62294c80ab service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:52.206917 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-8033e9a0-e5a3-428b-b448-796c08e32904 tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:51:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1088022252',display_name='tempest-VolumesAdminNegativeTest-server-1088022252',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-volumesadminnegativetest-server-1088022252',id=4,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:52:46Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='745d9bd220de4beaab6c7561af376ae3',ramdisk_id='',reservation_id='r-d1widkbt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1603446702',owner_user_name='tempest-VolumesAdminNegativeTest-1603446702-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:52:47Z,user_data=None,user_id='8608d299c7e641c2a403907cb4674347',uuid=f342ed55-ce60-405b-bc09-856eced24bf7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "00a0837b-bced-48a4-84d6-8ba3fa1cccfc", "address": "fa:16:3e:d6:49:ea", "network": {"id": "429537a1-a364-4a80-a366-c295d81735e4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1730022347-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "745d9bd220de4beaab6c7561af376ae3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00a0837b-bc", "ovs_interfaceid": "00a0837b-bced-48a4-84d6-8ba3fa1cccfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:52:52.208006 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-8033e9a0-e5a3-428b-b448-796c08e32904 tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Converting VIF {"id": "00a0837b-bced-48a4-84d6-8ba3fa1cccfc", "address": "fa:16:3e:d6:49:ea", "network": {"id": "429537a1-a364-4a80-a366-c295d81735e4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1730022347-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "745d9bd220de4beaab6c7561af376ae3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00a0837b-bc", "ovs_interfaceid": "00a0837b-bced-48a4-84d6-8ba3fa1cccfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:52:52.213196 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-8033e9a0-e5a3-428b-b448-796c08e32904 tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:49:ea,bridge_name='br-int',has_traffic_filtering=True,id=00a0837b-bced-48a4-84d6-8ba3fa1cccfc,network=Network(429537a1-a364-4a80-a366-c295d81735e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00a0837b-bc') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:52:52.213864 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-8033e9a0-e5a3-428b-b448-796c08e32904 tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:49:ea,bridge_name='br-int',has_traffic_filtering=True,id=00a0837b-bced-48a4-84d6-8ba3fa1cccfc,network=Network(429537a1-a364-4a80-a366-c295d81735e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00a0837b-bc') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:52:52.218991 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:52.219140 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:52.220784 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap00a0837b-bc, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:52.225727 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:52:52.253104 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:52.253104 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:52.253104 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=880c91da-feb5-43b3-a940-5f89b453acf5) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:52:52.255668 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:52:52.256465 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:52.266544 np0000001583 nova-compute[98241]: INFO os_vif [None req-8033e9a0-e5a3-428b-b448-796c08e32904 tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:49:ea,bridge_name='br-int',has_traffic_filtering=True,id=00a0837b-bced-48a4-84d6-8ba3fa1cccfc,network=Network(429537a1-a364-4a80-a366-c295d81735e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00a0837b-bc')
May 28 01:52:52.266945 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-8033e9a0-e5a3-428b-b448-796c08e32904 tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Deleting instance files /opt/stack/data/nova/instances/f342ed55-ce60-405b-bc09-856eced24bf7_del
May 28 01:52:52.269158 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-8033e9a0-e5a3-428b-b448-796c08e32904 tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Deletion of /opt/stack/data/nova/instances/f342ed55-ce60-405b-bc09-856eced24bf7_del complete
May 28 01:52:52.354650 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:52.385548 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-10fdf312-afee-49db-8cd2-88dec950f357 req-78343a7c-860e-4f26-9af3-fa62294c80ab service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:52.422193 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bc3b63e6-759f-46ad-9b7b-060ff84e3bb5 req-f52fa09e-7dfa-4ba1-92ed-7f16d7cd3d72 service nova] Releasing lock "refresh_cache-bad69594-f163-41a6-931f-d2fcda0cb7d1" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:52:52.543104 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-10fdf312-afee-49db-8cd2-88dec950f357 req-78343a7c-860e-4f26-9af3-fa62294c80ab service nova] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Updated VIF entry in instance network info cache for port 6835d977-7c34-4bd7-8d12-208432ea45d3. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:52:52.543274 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-10fdf312-afee-49db-8cd2-88dec950f357 req-78343a7c-860e-4f26-9af3-fa62294c80ab service nova] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Updating instance_info_cache with network_info: [{"id": "6835d977-7c34-4bd7-8d12-208432ea45d3", "address": "fa:16:3e:91:a6:69", "network": {"id": "2043727d-617f-4eff-98e6-5d58f439532d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1616658634-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e37a40d1db45cba9235de04219a3b4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6835d977-7c", "ovs_interfaceid": "6835d977-7c34-4bd7-8d12-208432ea45d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:52:52.582192 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:52.586105 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:52.590833 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:52.622822 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:52.780484 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-8033e9a0-e5a3-428b-b448-796c08e32904 tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Took 1.56 seconds to destroy the instance on the hypervisor.
May 28 01:52:52.781006 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-8033e9a0-e5a3-428b-b448-796c08e32904 tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:52:52.781325 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:52:52.781458 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:52:52.781993 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:52.796267 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:52.861243 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:53.045318 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-10fdf312-afee-49db-8cd2-88dec950f357 req-78343a7c-860e-4f26-9af3-fa62294c80ab service nova] Releasing lock "refresh_cache-f2805796-e531-4508-8585-0d110f4bd4e7" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:52:53.097914 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933173.097496, adfbfdf0-7c0f-4834-92ff-3b8d8c39e333 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:52:53.098126 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] VM Started (Lifecycle Event)
May 28 01:52:53.273132 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] No BDM found with device name sda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:52:53.273254 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] No BDM found with device name sdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:52:53.273254 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] No BDM found with device name sdc, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:52:53.273368 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] No VIF found with MAC fa:16:3e:22:21:82, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:52:53.295459 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-579e1235-a9ee-44c1-99fd-ce12de728f2c req-b9f464c6-6252-49ae-9df6-999d6d3dbdc7 service nova] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Received event network-vif-deleted-00a0837b-bced-48a4-84d6-8ba3fa1cccfc {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:53.296171 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-579e1235-a9ee-44c1-99fd-ce12de728f2c req-b9f464c6-6252-49ae-9df6-999d6d3dbdc7 service nova] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Neutron deleted interface 00a0837b-bced-48a4-84d6-8ba3fa1cccfc; detaching it from the instance and deleting it from the info cache
May 28 01:52:53.297286 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-579e1235-a9ee-44c1-99fd-ce12de728f2c req-b9f464c6-6252-49ae-9df6-999d6d3dbdc7 service nova] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Detach interface failed, port_id=00a0837b-bced-48a4-84d6-8ba3fa1cccfc, reason: Instance f342ed55-ce60-405b-bc09-856eced24bf7 could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:52:53.600749 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:52:53.602817 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933173.6018386, adfbfdf0-7c0f-4834-92ff-3b8d8c39e333 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:52:53.602817 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] VM Paused (Lifecycle Event)
May 28 01:52:53.737320 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:52:54.104626 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:52:54.107407 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:52:54.240975 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Took 1.46 seconds to deallocate network for instance.
May 28 01:52:54.610462 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:52:54.751634 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8033e9a0-e5a3-428b-b448-796c08e32904 tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:54.751634 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8033e9a0-e5a3-428b-b448-796c08e32904 tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:54.843869 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-bff7569d-3113-48bf-b3d3-cd1bd91e4782 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Lock "a4e5fc7a-978f-407f-9faf-7ec539b55e0e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.629s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:55.171601 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-8033e9a0-e5a3-428b-b448-796c08e32904 tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:52:55.172020 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-8033e9a0-e5a3-428b-b448-796c08e32904 tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:52:55.254580 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4199f0dc-9557-4b58-bc6b-7ed652291426 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Acquiring lock "a4e5fc7a-978f-407f-9faf-7ec539b55e0e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:55.254746 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4199f0dc-9557-4b58-bc6b-7ed652291426 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Lock "a4e5fc7a-978f-407f-9faf-7ec539b55e0e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:55.363959 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-vif-plugged-bf1e69e9-a858-4270-8c47-a209493f7e48 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:55.365841 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] Acquiring lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:55.366039 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:55.366219 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:55.366376 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Processing event network-vif-plugged-bf1e69e9-a858-4270-8c47-a209493f7e48 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:52:55.366513 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-vif-plugged-bf1e69e9-a858-4270-8c47-a209493f7e48 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:55.366651 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] Acquiring lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:55.366929 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:55.367067 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:55.367218 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] No event matching network-vif-plugged-bf1e69e9-a858-4270-8c47-a209493f7e48 in dict_keys([('network-vif-plugged', 'f5e93ea0-a679-45fb-9178-3842154f2e4d'), ('network-vif-plugged', '91f6bd16-2cfa-44ca-a7ea-ef3ef4933092'), ('network-vif-plugged', '9e08628c-1ff2-4d4b-9f3d-50231fa6ceec')]) {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 01:52:55.367394 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received unexpected event network-vif-plugged-bf1e69e9-a858-4270-8c47-a209493f7e48 for instance with vm_state building and task_state spawning.
May 28 01:52:55.367505 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-vif-plugged-f5e93ea0-a679-45fb-9178-3842154f2e4d {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:55.367631 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] Acquiring lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:55.367744 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:55.368054 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:55.368218 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Processing event network-vif-plugged-f5e93ea0-a679-45fb-9178-3842154f2e4d {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:52:55.368359 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-vif-plugged-f5e93ea0-a679-45fb-9178-3842154f2e4d {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:55.368472 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] Acquiring lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:55.368581 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:55.368671 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:55.368816 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] No event matching network-vif-plugged-f5e93ea0-a679-45fb-9178-3842154f2e4d in dict_keys([('network-vif-plugged', '91f6bd16-2cfa-44ca-a7ea-ef3ef4933092'), ('network-vif-plugged', '9e08628c-1ff2-4d4b-9f3d-50231fa6ceec')]) {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 01:52:55.369011 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received unexpected event network-vif-plugged-f5e93ea0-a679-45fb-9178-3842154f2e4d for instance with vm_state building and task_state spawning.
May 28 01:52:55.369130 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-vif-plugged-91f6bd16-2cfa-44ca-a7ea-ef3ef4933092 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:55.369238 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] Acquiring lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:55.372609 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:55.372609 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:55.372609 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Processing event network-vif-plugged-91f6bd16-2cfa-44ca-a7ea-ef3ef4933092 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:52:55.372609 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-vif-plugged-91f6bd16-2cfa-44ca-a7ea-ef3ef4933092 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:55.372609 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] Acquiring lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:55.372609 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:55.372609 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:55.372609 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] No event matching network-vif-plugged-91f6bd16-2cfa-44ca-a7ea-ef3ef4933092 in dict_keys([('network-vif-plugged', '9e08628c-1ff2-4d4b-9f3d-50231fa6ceec')]) {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 01:52:55.372609 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received unexpected event network-vif-plugged-91f6bd16-2cfa-44ca-a7ea-ef3ef4933092 for instance with vm_state building and task_state spawning.
May 28 01:52:55.372609 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-vif-plugged-9e08628c-1ff2-4d4b-9f3d-50231fa6ceec {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:55.372609 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] Acquiring lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:55.372609 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:55.372609 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:55.372609 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Processing event network-vif-plugged-9e08628c-1ff2-4d4b-9f3d-50231fa6ceec {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:52:55.372609 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-vif-plugged-9e08628c-1ff2-4d4b-9f3d-50231fa6ceec {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:55.372609 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] Acquiring lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:55.372609 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:55.372609 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:55.373618 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Instance event wait completed in 10 seconds for network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:52:55.373618 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] No waiting events found dispatching network-vif-plugged-9e08628c-1ff2-4d4b-9f3d-50231fa6ceec {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:52:55.373618 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received unexpected event network-vif-plugged-9e08628c-1ff2-4d4b-9f3d-50231fa6ceec for instance with vm_state building and task_state spawning.
May 28 01:52:55.373618 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Received event network-vif-unplugged-828d441a-570b-4f98-b093-4eb521ee2cf8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:55.373791 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] Acquiring lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:55.373916 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] Lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:55.374065 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] Lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:55.374919 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] No event matching network-vif-unplugged-828d441a-570b-4f98-b093-4eb521ee2cf8 in dict_keys([('network-vif-plugged', '828d441a-570b-4f98-b093-4eb521ee2cf8')]) {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 01:52:55.374919 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Received unexpected event network-vif-unplugged-828d441a-570b-4f98-b093-4eb521ee2cf8 for instance with vm_state building and task_state spawning.
May 28 01:52:55.374919 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Received event network-vif-plugged-828d441a-570b-4f98-b093-4eb521ee2cf8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:55.374919 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] Acquiring lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:55.374919 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] Lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:55.374919 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] Lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:55.375117 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Processing event network-vif-plugged-828d441a-570b-4f98-b093-4eb521ee2cf8 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:52:55.375292 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Received event network-vif-plugged-828d441a-570b-4f98-b093-4eb521ee2cf8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:55.378096 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Instance event wait completed in 2 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:52:55.378096 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] Acquiring lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:55.378096 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] Lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:55.378096 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] Lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:55.378096 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] No waiting events found dispatching network-vif-plugged-828d441a-570b-4f98-b093-4eb521ee2cf8 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:52:55.378096 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-674a0972-7397-4cb9-9d5e-ea7927300bdd req-9d77c538-79a4-4e0e-a9c4-93fcfab7bd43 service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Received unexpected event network-vif-plugged-828d441a-570b-4f98-b093-4eb521ee2cf8 for instance with vm_state building and task_state spawning.
May 28 01:52:55.379814 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933175.3754923, d3a7c39a-f946-496d-9153-0a422e7f5350 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:52:55.379814 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] VM Resumed (Lifecycle Event)
May 28 01:52:55.380047 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:52:55.380572 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:52:55.385940 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Instance spawned successfully.
May 28 01:52:55.385940 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:52:55.388476 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Instance spawned successfully.
May 28 01:52:55.388684 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:52:55.674434 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-8033e9a0-e5a3-428b-b448-796c08e32904 tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:52:55.757355 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-4199f0dc-9557-4b58-bc6b-7ed652291426 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Detaching volume 26b10162-1269-4387-8112-744630da1b32
May 28 01:52:55.802049 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-4199f0dc-9557-4b58-bc6b-7ed652291426 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Attempting to driver detach volume 26b10162-1269-4387-8112-744630da1b32 from mountpoint /dev/sdc
May 28 01:52:55.804813 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4199f0dc-9557-4b58-bc6b-7ed652291426 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Found disk sdc by alias ua-26b10162-1269-4387-8112-744630da1b32 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:52:55.805874 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4199f0dc-9557-4b58-bc6b-7ed652291426 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Found disk sdc by alias ua-26b10162-1269-4387-8112-744630da1b32 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:52:55.805989 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4199f0dc-9557-4b58-bc6b-7ed652291426 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Attempting to detach device sdc from instance a4e5fc7a-978f-407f-9faf-7ec539b55e0e from the persistent domain config. {{(pid=98241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 01:52:55.806236 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-4199f0dc-9557-4b58-bc6b-7ed652291426 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:52:55.806236 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:52:55.806236 np0000001583 nova-compute[98241]:   <alias name="ua-26b10162-1269-4387-8112-744630da1b32"/>
May 28 01:52:55.806236 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-8"/>
May 28 01:52:55.806236 np0000001583 nova-compute[98241]:   <target dev="sdc" bus="scsi"/>
May 28 01:52:55.806236 np0000001583 nova-compute[98241]:   <serial>26b10162-1269-4387-8112-744630da1b32</serial>
May 28 01:52:55.806236 np0000001583 nova-compute[98241]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
May 28 01:52:55.806236 np0000001583 nova-compute[98241]: </disk>
May 28 01:52:55.806236 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:52:55.811529 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-4199f0dc-9557-4b58-bc6b-7ed652291426 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Successfully detached device sdc from instance a4e5fc7a-978f-407f-9faf-7ec539b55e0e from the persistent domain config.
May 28 01:52:55.811773 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4199f0dc-9557-4b58-bc6b-7ed652291426 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] (1/8): Attempting to detach device sdc with device alias ua-26b10162-1269-4387-8112-744630da1b32 from instance a4e5fc7a-978f-407f-9faf-7ec539b55e0e from the live domain config. {{(pid=98241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 01:52:55.811997 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-4199f0dc-9557-4b58-bc6b-7ed652291426 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:52:55.811997 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:52:55.811997 np0000001583 nova-compute[98241]:   <alias name="ua-26b10162-1269-4387-8112-744630da1b32"/>
May 28 01:52:55.811997 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-8"/>
May 28 01:52:55.811997 np0000001583 nova-compute[98241]:   <target dev="sdc" bus="scsi"/>
May 28 01:52:55.811997 np0000001583 nova-compute[98241]:   <serial>26b10162-1269-4387-8112-744630da1b32</serial>
May 28 01:52:55.811997 np0000001583 nova-compute[98241]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
May 28 01:52:55.811997 np0000001583 nova-compute[98241]: </disk>
May 28 01:52:55.811997 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:52:55.882239 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:52:55.884532 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:52:55.902386 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:52:55.902386 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:52:55.902386 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:52:55.902386 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:52:55.902386 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:52:55.904834 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:52:55.908593 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:52:55.909583 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:52:55.910157 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:52:55.910602 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:52:55.911041 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:52:55.911521 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:52:56.002582 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4199f0dc-9557-4b58-bc6b-7ed652291426 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Start waiting for the detach event from libvirt for device sdc with device alias ua-26b10162-1269-4387-8112-744630da1b32 for instance a4e5fc7a-978f-407f-9faf-7ec539b55e0e {{(pid=98241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 01:52:56.182301 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8033e9a0-e5a3-428b-b448-796c08e32904 tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.431s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:56.237520 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-8033e9a0-e5a3-428b-b448-796c08e32904 tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Deleted allocations for instance f342ed55-ce60-405b-bc09-856eced24bf7
May 28 01:52:56.387373 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:52:56.387526 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933176.3873122, adfbfdf0-7c0f-4834-92ff-3b8d8c39e333 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:52:56.387721 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] VM Resumed (Lifecycle Event)
May 28 01:52:56.418501 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Took 10.18 seconds to spawn the instance on the hypervisor.
May 28 01:52:56.422090 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Took 38.05 seconds to spawn the instance on the hypervisor.
May 28 01:52:56.422090 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:52:56.422090 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:52:56.890122 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:52:56.891973 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:52:56.946102 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Took 15.89 seconds to build instance.
May 28 01:52:56.946102 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Took 52.84 seconds to build instance.
May 28 01:52:57.247845 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8033e9a0-e5a3-428b-b448-796c08e32904 tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Lock "f342ed55-ce60-405b-bc09-856eced24bf7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.548s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:57.253830 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:57.400697 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Received event <DeviceRemovedEvent: 1779933177.3980515, a4e5fc7a-978f-407f-9faf-7ec539b55e0e => ua-26b10162-1269-4387-8112-744630da1b32> from libvirt while the driver is waiting for it; dispatched. {{(pid=98241) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 01:52:57.401238 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-4199f0dc-9557-4b58-bc6b-7ed652291426 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Successfully detached device sdc from instance a4e5fc7a-978f-407f-9faf-7ec539b55e0e from the live domain config.
May 28 01:52:57.402503 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4199f0dc-9557-4b58-bc6b-7ed652291426 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:52:57.402895 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4199f0dc-9557-4b58-bc6b-7ed652291426 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32', 'iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '26b10162-1269-4387-8112-744630da1b32', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': False}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:52:57.402895 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-4199f0dc-9557-4b58-bc6b-7ed652291426 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:52:57.403343 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-4199f0dc-9557-4b58-bc6b-7ed652291426 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:52:57.403719 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4199f0dc-9557-4b58-bc6b-7ed652291426 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32', 'iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '26b10162-1269-4387-8112-744630da1b32', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:52:57.404049 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4199f0dc-9557-4b58-bc6b-7ed652291426 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:52:57.435260 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4199f0dc-9557-4b58-bc6b-7ed652291426 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:52:57.435260 np0000001583 nova-compute[98241]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:52:57.435260 np0000001583 nova-compute[98241]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:52:57.435260 np0000001583 nova-compute[98241]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32 (non-flash)
May 28 01:52:57.435260 np0000001583 nova-compute[98241]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32 (non-flash)
May 28 01:52:57.435260 np0000001583 nova-compute[98241]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:57.435260 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:57.435260 np0000001583 nova-compute[98241]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:57.435260 np0000001583 nova-compute[98241]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:57.435260 np0000001583 nova-compute[98241]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:52:57.435260 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:52:57.435639 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4199f0dc-9557-4b58-bc6b-7ed652291426 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:52:57.435639 np0000001583 nova-compute[98241]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:52:57.435639 np0000001583 nova-compute[98241]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:52:57.435639 np0000001583 nova-compute[98241]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32 (non-flash)
May 28 01:52:57.435639 np0000001583 nova-compute[98241]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32 (non-flash)
May 28 01:52:57.435639 np0000001583 nova-compute[98241]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:57.435639 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:52:57.435639 np0000001583 nova-compute[98241]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:57.435639 np0000001583 nova-compute[98241]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:52:57.435639 np0000001583 nova-compute[98241]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:52:57.435639 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:52:57.435639 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4199f0dc-9557-4b58-bc6b-7ed652291426 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb', '13'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32', '14'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8', '5'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8', '6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9', '7'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9', '8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02', '9')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:52:57.435920 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4199f0dc-9557-4b58-bc6b-7ed652291426 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32', '14')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:52:57.437147 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4199f0dc-9557-4b58-bc6b-7ed652291426 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32', '15')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:52:57.438531 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4199f0dc-9557-4b58-bc6b-7ed652291426 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f817d260>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32'): ({'sdl'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:52:57.438845 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-4199f0dc-9557-4b58-bc6b-7ed652291426 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Removing multipathed devices sdk, sdl {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:52:57.439216 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-4199f0dc-9557-4b58-bc6b-7ed652291426 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Flush multipath device 330000000c8bfe810 {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:52:57.445097 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 54.352s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:57.447815 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.403s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:57.474981 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-4199f0dc-9557-4b58-bc6b-7ed652291426 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:52:57.524921 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-4199f0dc-9557-4b58-bc6b-7ed652291426 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:52:57.570239 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-4199f0dc-9557-4b58-bc6b-7ed652291426 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Checking to see if SCSI volumes sdk, sdl have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:52:57.570239 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-4199f0dc-9557-4b58-bc6b-7ed652291426 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] SCSI volumes sdk, sdl have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:52:57.571846 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-4199f0dc-9557-4b58-bc6b-7ed652291426 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Checking to see if device paths {'sdk', 'sdl'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:52:57.586862 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-4199f0dc-9557-4b58-bc6b-7ed652291426 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Device paths {'sdk', 'sdl'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:52:57.587164 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4199f0dc-9557-4b58-bc6b-7ed652291426 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:52:57.602468 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4199f0dc-9557-4b58-bc6b-7ed652291426 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:57.635997 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4199f0dc-9557-4b58-bc6b-7ed652291426 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32, portal: 192.168.40.100,3260]
May 28 01:52:57.635997 np0000001583 nova-compute[98241]: Logout of [sid: 14, target: iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32, portal: 192.168.40.100,3260] successful.
May 28 01:52:57.635997 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:57.653443 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4199f0dc-9557-4b58-bc6b-7ed652291426 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:57.655821 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-11893d8e-0dcb-4ae6-b14d-51ea0ea9dfd0 req-9b203ca8-c86c-4723-8ac2-87b035e1e15e service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Received event network-changed-828d441a-570b-4f98-b093-4eb521ee2cf8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:57.655968 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-11893d8e-0dcb-4ae6-b14d-51ea0ea9dfd0 req-9b203ca8-c86c-4723-8ac2-87b035e1e15e service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Refreshing instance network info cache due to event network-changed-828d441a-570b-4f98-b093-4eb521ee2cf8. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:52:57.656195 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-11893d8e-0dcb-4ae6-b14d-51ea0ea9dfd0 req-9b203ca8-c86c-4723-8ac2-87b035e1e15e service nova] Acquiring lock "refresh_cache-adfbfdf0-7c0f-4834-92ff-3b8d8c39e333" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:52:57.657386 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-11893d8e-0dcb-4ae6-b14d-51ea0ea9dfd0 req-9b203ca8-c86c-4723-8ac2-87b035e1e15e service nova] Acquired lock "refresh_cache-adfbfdf0-7c0f-4834-92ff-3b8d8c39e333" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:52:57.657501 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-11893d8e-0dcb-4ae6-b14d-51ea0ea9dfd0 req-9b203ca8-c86c-4723-8ac2-87b035e1e15e service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Refreshing network info cache for port 828d441a-570b-4f98-b093-4eb521ee2cf8 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:52:57.672154 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4199f0dc-9557-4b58-bc6b-7ed652291426 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:57.711246 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4199f0dc-9557-4b58-bc6b-7ed652291426 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32, portal: 192.168.50.100,3260]
May 28 01:52:57.711246 np0000001583 nova-compute[98241]: Logout of [sid: 15, target: iqn.2023-03.storpool.com:os--volume-26b10162-1269-4387-8112-744630da1b32, portal: 192.168.50.100,3260] successful.
May 28 01:52:57.711246 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:57.744155 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4199f0dc-9557-4b58-bc6b-7ed652291426 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:52:57.744155 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-4199f0dc-9557-4b58-bc6b-7ed652291426 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:52:57.744155 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4199f0dc-9557-4b58-bc6b-7ed652291426 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] <== disconnect_volume: return (339ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:52:57.744155 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4199f0dc-9557-4b58-bc6b-7ed652291426 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:52:57.795226 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:58.161045 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-11893d8e-0dcb-4ae6-b14d-51ea0ea9dfd0 req-9b203ca8-c86c-4723-8ac2-87b035e1e15e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:58.341826 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-4199f0dc-9557-4b58-bc6b-7ed652291426 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Lazy-loading 'flavor' on Instance uuid a4e5fc7a-978f-407f-9faf-7ec539b55e0e {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:52:58.583707 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-11893d8e-0dcb-4ae6-b14d-51ea0ea9dfd0 req-9b203ca8-c86c-4723-8ac2-87b035e1e15e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:52:58.748119 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-11893d8e-0dcb-4ae6-b14d-51ea0ea9dfd0 req-9b203ca8-c86c-4723-8ac2-87b035e1e15e service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Updated VIF entry in instance network info cache for port 828d441a-570b-4f98-b093-4eb521ee2cf8. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:52:58.748614 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-11893d8e-0dcb-4ae6-b14d-51ea0ea9dfd0 req-9b203ca8-c86c-4723-8ac2-87b035e1e15e service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Updating instance_info_cache with network_info: [{"id": "828d441a-570b-4f98-b093-4eb521ee2cf8", "address": "fa:16:3e:f5:ed:7d", "network": {"id": "34ab0ff0-75dd-45e7-97f6-22f8e62a8149", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1222751470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d31342458ec4ed2890a766f62facbcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap828d441a-57", "ovs_interfaceid": "828d441a-570b-4f98-b093-4eb521ee2cf8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:52:59.253414 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-11893d8e-0dcb-4ae6-b14d-51ea0ea9dfd0 req-9b203ca8-c86c-4723-8ac2-87b035e1e15e service nova] Releasing lock "refresh_cache-adfbfdf0-7c0f-4834-92ff-3b8d8c39e333" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:52:59.348951 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4199f0dc-9557-4b58-bc6b-7ed652291426 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Lock "a4e5fc7a-978f-407f-9faf-7ec539b55e0e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.094s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:59.496899 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:52:59.734225 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-1b5e91bb-0006-4633-819e-045b0c0d16b1 req-98c7b082-92e4-4b40-8771-d741e60f1513 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-changed-0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:52:59.734225 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-1b5e91bb-0006-4633-819e-045b0c0d16b1 req-98c7b082-92e4-4b40-8771-d741e60f1513 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Refreshing instance network info cache due to event network-changed-0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:52:59.734225 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-1b5e91bb-0006-4633-819e-045b0c0d16b1 req-98c7b082-92e4-4b40-8771-d741e60f1513 service nova] Acquiring lock "refresh_cache-d3a7c39a-f946-496d-9153-0a422e7f5350" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:52:59.734225 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-1b5e91bb-0006-4633-819e-045b0c0d16b1 req-98c7b082-92e4-4b40-8771-d741e60f1513 service nova] Acquired lock "refresh_cache-d3a7c39a-f946-496d-9153-0a422e7f5350" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:52:59.734225 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-1b5e91bb-0006-4633-819e-045b0c0d16b1 req-98c7b082-92e4-4b40-8771-d741e60f1513 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Refreshing network info cache for port 0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:52:59.744449 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a0ce83c5-150c-4f62-b940-56e67ba23ce3 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Acquiring lock "a4e5fc7a-978f-407f-9faf-7ec539b55e0e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:59.744705 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a0ce83c5-150c-4f62-b940-56e67ba23ce3 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Lock "a4e5fc7a-978f-407f-9faf-7ec539b55e0e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:59.746075 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a0ce83c5-150c-4f62-b940-56e67ba23ce3 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Acquiring lock "a4e5fc7a-978f-407f-9faf-7ec539b55e0e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:52:59.746266 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a0ce83c5-150c-4f62-b940-56e67ba23ce3 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Lock "a4e5fc7a-978f-407f-9faf-7ec539b55e0e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:52:59.746501 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a0ce83c5-150c-4f62-b940-56e67ba23ce3 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Lock "a4e5fc7a-978f-407f-9faf-7ec539b55e0e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:52:59.750326 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-a0ce83c5-150c-4f62-b940-56e67ba23ce3 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Terminating instance
May 28 01:53:00.237843 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-1b5e91bb-0006-4633-819e-045b0c0d16b1 req-98c7b082-92e4-4b40-8771-d741e60f1513 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:53:00.254635 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a0ce83c5-150c-4f62-b940-56e67ba23ce3 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:53:00.284871 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:00.288253 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:00.318285 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:00.326465 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:00.362703 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:00.554056 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ea08799d-e0db-4a32-8768-f96babaeb92d req-8a190666-11f1-40fc-a814-a18d74e5f2a3 service nova] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Received event network-vif-unplugged-b9924df6-f6a0-4dc6-a309-04713d02e8e2 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:53:00.556611 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ea08799d-e0db-4a32-8768-f96babaeb92d req-8a190666-11f1-40fc-a814-a18d74e5f2a3 service nova] Acquiring lock "a4e5fc7a-978f-407f-9faf-7ec539b55e0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:00.558703 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ea08799d-e0db-4a32-8768-f96babaeb92d req-8a190666-11f1-40fc-a814-a18d74e5f2a3 service nova] Lock "a4e5fc7a-978f-407f-9faf-7ec539b55e0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:00.559122 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ea08799d-e0db-4a32-8768-f96babaeb92d req-8a190666-11f1-40fc-a814-a18d74e5f2a3 service nova] Lock "a4e5fc7a-978f-407f-9faf-7ec539b55e0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:00.559415 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ea08799d-e0db-4a32-8768-f96babaeb92d req-8a190666-11f1-40fc-a814-a18d74e5f2a3 service nova] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] No waiting events found dispatching network-vif-unplugged-b9924df6-f6a0-4dc6-a309-04713d02e8e2 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:53:00.559685 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ea08799d-e0db-4a32-8768-f96babaeb92d req-8a190666-11f1-40fc-a814-a18d74e5f2a3 service nova] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Received event network-vif-unplugged-b9924df6-f6a0-4dc6-a309-04713d02e8e2 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:53:00.610903 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999639355999989 future=<Future at 0x7724f8697b00 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:53:00.616478 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Instance destroyed successfully.
May 28 01:53:00.618582 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-a0ce83c5-150c-4f62-b940-56e67ba23ce3 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Lazy-loading 'resources' on Instance uuid a4e5fc7a-978f-407f-9faf-7ec539b55e0e {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:53:00.866408 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-1b5e91bb-0006-4633-819e-045b0c0d16b1 req-98c7b082-92e4-4b40-8771-d741e60f1513 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:53:01.078884 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-1b5e91bb-0006-4633-819e-045b0c0d16b1 req-98c7b082-92e4-4b40-8771-d741e60f1513 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Updated VIF entry in instance network info cache for port 0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:53:01.082630 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-1b5e91bb-0006-4633-819e-045b0c0d16b1 req-98c7b082-92e4-4b40-8771-d741e60f1513 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Updating instance_info_cache with network_info: [{"id": "0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8", "address": "fa:16:3e:54:87:27", "network": {"id": "f48f059f-2a4c-46cc-9281-c2a228bf4514", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-256433360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e04c6bd-fb", "ovs_interfaceid": "0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d994306-44d7-4407-94eb-49b142832ffc", "address": "fa:16:3e:ab:fd:ca", "network": {"id": "3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026701416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d994306-44", "ovs_interfaceid": "3d994306-44d7-4407-94eb-49b142832ffc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bf1e69e9-a858-4270-8c47-a209493f7e48", "address": "fa:16:3e:18:87:d6", "network": {"id": "3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026701416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf1e69e9-a8", "ovs_interfaceid": "bf1e69e9-a858-4270-8c47-a209493f7e48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f5e93ea0-a679-45fb-9178-3842154f2e4d", "address": "fa:16:3e:9a:c8:f6", "network": {"id": "3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026701416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e93ea0-a6", "ovs_interfaceid": "f5e93ea0-a679-45fb-9178-3842154f2e4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "91f6bd16-2cfa-44ca-a7ea-ef3ef4933092", "address": "fa:16:3e:ba:70:ee", "network": {"id": "3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026701416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f6bd16-2c", "ovs_interfaceid": "91f6bd16-2cfa-44ca-a7ea-ef3ef4933092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9e08628c-1ff2-4d4b-9f3d-50231fa6ceec", "address": "fa:16:3e:1d:f8:b7", "network": {"id": "450c1abf-c05a-46dc-9905-3fa42767a540", "bridge": "br-int", "label": "tempest-device-tagging-net2-594797377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e08628c-1f", "ovs_interfaceid": "9e08628c-1ff2-4d4b-9f3d-50231fa6ceec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a566955f-6906-4a3b-bdf1-2f55b31b6e21", "address": "fa:16:3e:cb:ff:df", "network": {"id": "450c1abf-c05a-46dc-9905-3fa42767a540", "bridge": "br-int", "label": "tempest-device-tagging-net2-594797377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa566955f-69", "ovs_interfaceid": "a566955f-6906-4a3b-bdf1-2f55b31b6e21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:53:01.127479 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-a0ce83c5-150c-4f62-b940-56e67ba23ce3 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:51:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-487281858',display_name='tempest-AttachSCSIVolumeTestJSON-server-487281858',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-attachscsivolumetestjson-server-487281858',id=2,image_ref='6488f736-e196-4a2e-9046-5de055c9c47f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDDxYEogI39GVE1ytjzPZCHEmuELU1UW+fZK3pyz3CkN0pDevQL1svoDZ4T1x4I/E9WbzUiIJJwFQv9e9JqcsXBSbNanFhBjTuXiQlIXMWxG63KPiFRgJBtf5WE7TffNVA==',key_name='tempest-keypair-1342711016',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:52:05Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b525e2c2d9a9421da5a3eeb5af5958f7',ramdisk_id='',reservation_id='r-m4oa8nfr',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6488f736-e196-4a2e-9046-5de055c9c47f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-2104948228',owner_user_name='tempest-AttachSCSIVolumeTestJSON-2104948228-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:52:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44b82243cb2c4fe8af34d1300bc4ff69',uuid=a4e5fc7a-978f-407f-9faf-7ec539b55e0e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b9924df6-f6a0-4dc6-a309-04713d02e8e2", "address": "fa:16:3e:22:21:82", "network": {"id": "4524b467-4e05-4f3e-8b60-9d1df8eeab06", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1571320637-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b525e2c2d9a9421da5a3eeb5af5958f7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9924df6-f6", "ovs_interfaceid": "b9924df6-f6a0-4dc6-a309-04713d02e8e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:53:01.127657 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a0ce83c5-150c-4f62-b940-56e67ba23ce3 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Converting VIF {"id": "b9924df6-f6a0-4dc6-a309-04713d02e8e2", "address": "fa:16:3e:22:21:82", "network": {"id": "4524b467-4e05-4f3e-8b60-9d1df8eeab06", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1571320637-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b525e2c2d9a9421da5a3eeb5af5958f7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9924df6-f6", "ovs_interfaceid": "b9924df6-f6a0-4dc6-a309-04713d02e8e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:53:01.128189 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a0ce83c5-150c-4f62-b940-56e67ba23ce3 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:21:82,bridge_name='br-int',has_traffic_filtering=True,id=b9924df6-f6a0-4dc6-a309-04713d02e8e2,network=Network(4524b467-4e05-4f3e-8b60-9d1df8eeab06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9924df6-f6') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:53:01.128469 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-a0ce83c5-150c-4f62-b940-56e67ba23ce3 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:21:82,bridge_name='br-int',has_traffic_filtering=True,id=b9924df6-f6a0-4dc6-a309-04713d02e8e2,network=Network(4524b467-4e05-4f3e-8b60-9d1df8eeab06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9924df6-f6') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:53:01.129329 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:01.129541 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb9924df6-f6, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:53:01.130518 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:01.133338 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:53:01.134972 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:01.135146 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=33e42294-baca-42ed-8b99-cffe0ed5f5ab) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:53:01.135890 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:01.137806 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:53:01.139894 np0000001583 nova-compute[98241]: INFO os_vif [None req-a0ce83c5-150c-4f62-b940-56e67ba23ce3 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:21:82,bridge_name='br-int',has_traffic_filtering=True,id=b9924df6-f6a0-4dc6-a309-04713d02e8e2,network=Network(4524b467-4e05-4f3e-8b60-9d1df8eeab06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9924df6-f6')
May 28 01:53:01.140242 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-a0ce83c5-150c-4f62-b940-56e67ba23ce3 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Deleting instance files /opt/stack/data/nova/instances/a4e5fc7a-978f-407f-9faf-7ec539b55e0e_del
May 28 01:53:01.141073 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-a0ce83c5-150c-4f62-b940-56e67ba23ce3 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Deletion of /opt/stack/data/nova/instances/a4e5fc7a-978f-407f-9faf-7ec539b55e0e_del complete
May 28 01:53:01.585236 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-1b5e91bb-0006-4633-819e-045b0c0d16b1 req-98c7b082-92e4-4b40-8771-d741e60f1513 service nova] Releasing lock "refresh_cache-d3a7c39a-f946-496d-9153-0a422e7f5350" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:53:01.654172 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-a0ce83c5-150c-4f62-b940-56e67ba23ce3 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Took 1.40 seconds to destroy the instance on the hypervisor.
May 28 01:53:01.655550 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-a0ce83c5-150c-4f62-b940-56e67ba23ce3 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:53:01.657712 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:53:01.657712 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:53:01.657712 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:53:01.761983 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:53:01.838294 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:02.535561 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a3204538-8a38-4a8f-bce7-a6c31d4d1fb4 req-ef00a979-4b7c-444f-8cb1-699d6de1a6af service nova] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Received event network-vif-deleted-b9924df6-f6a0-4dc6-a309-04713d02e8e2 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:53:02.538738 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-a3204538-8a38-4a8f-bce7-a6c31d4d1fb4 req-ef00a979-4b7c-444f-8cb1-699d6de1a6af service nova] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Neutron deleted interface b9924df6-f6a0-4dc6-a309-04713d02e8e2; detaching it from the instance and deleting it from the info cache
May 28 01:53:02.539912 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a3204538-8a38-4a8f-bce7-a6c31d4d1fb4 req-ef00a979-4b7c-444f-8cb1-699d6de1a6af service nova] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Detach interface failed, port_id=b9924df6-f6a0-4dc6-a309-04713d02e8e2, reason: Instance a4e5fc7a-978f-407f-9faf-7ec539b55e0e could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:53:02.664533 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5f4040d0-9370-45b4-8778-798668af28ec req-63abee78-9797-4fc6-a1a6-71fb8622e9fe service nova] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Received event network-vif-unplugged-b9924df6-f6a0-4dc6-a309-04713d02e8e2 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:53:02.664978 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5f4040d0-9370-45b4-8778-798668af28ec req-63abee78-9797-4fc6-a1a6-71fb8622e9fe service nova] Acquiring lock "a4e5fc7a-978f-407f-9faf-7ec539b55e0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:02.664978 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5f4040d0-9370-45b4-8778-798668af28ec req-63abee78-9797-4fc6-a1a6-71fb8622e9fe service nova] Lock "a4e5fc7a-978f-407f-9faf-7ec539b55e0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:02.664978 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5f4040d0-9370-45b4-8778-798668af28ec req-63abee78-9797-4fc6-a1a6-71fb8622e9fe service nova] Lock "a4e5fc7a-978f-407f-9faf-7ec539b55e0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:02.665135 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5f4040d0-9370-45b4-8778-798668af28ec req-63abee78-9797-4fc6-a1a6-71fb8622e9fe service nova] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] No waiting events found dispatching network-vif-unplugged-b9924df6-f6a0-4dc6-a309-04713d02e8e2 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:53:02.665192 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5f4040d0-9370-45b4-8778-798668af28ec req-63abee78-9797-4fc6-a1a6-71fb8622e9fe service nova] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Received event network-vif-unplugged-b9924df6-f6a0-4dc6-a309-04713d02e8e2 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:53:02.797580 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:02.975576 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:53:03.476626 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Took 1.82 seconds to deallocate network for instance.
May 28 01:53:03.982827 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a0ce83c5-150c-4f62-b940-56e67ba23ce3 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:03.983408 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a0ce83c5-150c-4f62-b940-56e67ba23ce3 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:04.382502 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:04.450872 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a0ce83c5-150c-4f62-b940-56e67ba23ce3 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:53:04.451282 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-a0ce83c5-150c-4f62-b940-56e67ba23ce3 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:53:04.953998 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-a0ce83c5-150c-4f62-b940-56e67ba23ce3 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:53:05.464707 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a0ce83c5-150c-4f62-b940-56e67ba23ce3 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.482s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:05.554208 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-a0ce83c5-150c-4f62-b940-56e67ba23ce3 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Deleted allocations for instance a4e5fc7a-978f-407f-9faf-7ec539b55e0e
May 28 01:53:06.136507 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:06.566360 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a0ce83c5-150c-4f62-b940-56e67ba23ce3 tempest-AttachSCSIVolumeTestJSON-2104948228 tempest-AttachSCSIVolumeTestJSON-2104948228-project-member] Lock "a4e5fc7a-978f-407f-9faf-7ec539b55e0e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.822s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:06.680098 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.001119260999985272 future=<Future at 0x7724f851dfd0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:53:06.680933 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Emitting event <LifecycleEvent: 1779933171.6787982, f342ed55-ce60-405b-bc09-856eced24bf7 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:53:06.681235 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] VM Stopped (Lifecycle Event)
May 28 01:53:06.681541 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:53:06.682194 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=8.928285921999986 future=<Future at 0x7724f8697b00 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:53:06.682844 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=8.928072762000056 future=<Future at 0x7724f8697b00 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:53:07.183621 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-291439f0-2381-450a-a729-04962bf0a70a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: f342ed55-ce60-405b-bc09-856eced24bf7] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:53:07.803673 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:10.849270 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:11.137253 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:11.747827 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:12.807174 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:13.607728 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:13.887900 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:15.612629 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0019339630000558827 future=<Future at 0x7724f8697b00 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:53:15.612629 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:53:15.614168 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] Emitting event <LifecycleEvent: 1779933180.6104178, a4e5fc7a-978f-407f-9faf-7ec539b55e0e => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:53:15.614168 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] VM Stopped (Lifecycle Event)
May 28 01:53:16.117116 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-fac581b4-88c2-4f0b-aee1-c2aebc1e0bab tempest-VolumesAdminNegativeTest-1603446702 tempest-VolumesAdminNegativeTest-1603446702-project-member] [instance: a4e5fc7a-978f-407f-9faf-7ec539b55e0e] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:53:16.138766 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:17.813158 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:17.847801 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "5c36895c-9d2c-49be-b545-3658f535964a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:17.848207 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "5c36895c-9d2c-49be-b545-3658f535964a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:18.350496 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:53:18.928887 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:18.929356 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:18.932735 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:53:18.933184 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Claim successful on node np0000001583
May 28 01:53:19.279975 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Acquiring lock "02b42340-8535-4682-98db-49f970ff5597" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:19.280534 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Lock "02b42340-8535-4682-98db-49f970ff5597" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:19.393358 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:53:19.395437 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:53:19.395880 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:53:19.396009 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:53:19.396228 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:53:19.396416 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:53:19.396670 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:53:19.396784 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:53:19.396920 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 01:53:19.397127 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:53:19.786073 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Lazy-loading 'flavor' on Instance uuid 02b42340-8535-4682-98db-49f970ff5597 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:53:19.902431 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:20.171855 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:20.447931 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:53:20.448160 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:53:20.564310 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:20.794378 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Lock "02b42340-8535-4682-98db-49f970ff5597" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.513s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:20.952237 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:53:21.145913 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:21.465275 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.534s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:21.465275 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:53:21.466711 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 1.564s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:21.467289 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:21.467509 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Auditing locally available compute resources for np0000001583 (node: np0000001583) {{(pid=98241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 01:53:21.973056 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:53:21.973056 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:53:21.973056 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:53:21.973056 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:53:22.071020 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '27c90c0a8eb148fda8ae718f07ff1ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fbdf5ed38b4dc485a81c49b3303ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:53:22.467435 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Acquiring lock "02b42340-8535-4682-98db-49f970ff5597" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:22.467865 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Lock "02b42340-8535-4682-98db-49f970ff5597" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:22.467943 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] [instance: 02b42340-8535-4682-98db-49f970ff5597] Attaching volume c073d4e5-9ddf-44f8-9b3f-619c8b3e683e to /dev/vdb
May 28 01:53:22.475648 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:53:22.521772 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adfbfdf0-7c0f-4834-92ff-3b8d8c39e333/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:53:22.543678 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:53:22.558706 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:53:22.593473 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:53:22.620459 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adfbfdf0-7c0f-4834-92ff-3b8d8c39e333/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:53:22.624887 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adfbfdf0-7c0f-4834-92ff-3b8d8c39e333/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:53:22.640485 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:53:22.641231 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:53:22.656574 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:53:22.660398 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fef4:4b8c', 'fe80::e02a:5fff:fe52:f5a1', 'fe80::fc16:3eff:fe45:c5fe', 'fe80::e05c:5bff:fea5:7965', 'fe80::fc16:3eff:fe52:6a', 'fe80::fc16:3eff:fe91:a669', 'fe80::3051:94ff:fec8:bd13', 'fe80::fc16:3eff:fe54:8727', 'fe80::fc16:3eff:feab:fdca', 'fe80::e4ee:48ff:fe05:5865', 'fe80::fc16:3eff:fe18:87d6', 'fe80::fc16:3eff:fe9a:c8f6', 'fe80::fc16:3eff:feba:70ee', 'fe80::fc16:3eff:fe1d:f8b7', 'fe80::4890:45ff:fee9:3b86', 'fe80::fc16:3eff:fecb:ffdf', 'fe80::f413:99ff:fea1:4341', 'fe80::fc16:3eff:fef5:ed7d', 'fe80::c4dd:b4ff:fe11:7c8'] 
May 28 01:53:22.660398 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:53:22.660398 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:53:22.660814 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:53:22.661454 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] [instance: 02b42340-8535-4682-98db-49f970ff5597] Updating existing volume attachment record: dda36672-d64a-4a23-a404-81a6df0b8352 {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:53:22.750309 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adfbfdf0-7c0f-4834-92ff-3b8d8c39e333/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:53:22.754352 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:53:22.754352 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/dm-6 (vdb) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:53:22.754547 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/dm-7 (vdc) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:53:22.758122 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:53:22.760855 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad69594-f163-41a6-931f-d2fcda0cb7d1/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:53:22.797300 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Successfully created port: fcf662e6-60ad-4e4c-b3da-ce3edf11d15b {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:53:22.815642 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:22.856494 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad69594-f163-41a6-931f-d2fcda0cb7d1/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:53:22.856908 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad69594-f163-41a6-931f-d2fcda0cb7d1/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:53:22.944215 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad69594-f163-41a6-931f-d2fcda0cb7d1/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:53:22.947869 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1291c6e1-108e-46d1-85bc-0197f71eec1f/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:53:22.985114 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:53:23.054491 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1291c6e1-108e-46d1-85bc-0197f71eec1f/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:53:23.055560 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1291c6e1-108e-46d1-85bc-0197f71eec1f/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:53:23.168945 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1291c6e1-108e-46d1-85bc-0197f71eec1f/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:53:23.175839 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02b42340-8535-4682-98db-49f970ff5597/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:53:23.251429 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] [instance: 02b42340-8535-4682-98db-49f970ff5597] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:53:23.251969 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e', 'iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c073d4e5-9ddf-44f8-9b3f-619c8b3e683e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:53:23.252116 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:53:23.252702 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:53:23.253255 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e', 'iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c073d4e5-9ddf-44f8-9b3f-619c8b3e683e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:53:23.272073 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:53:23.273343 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02b42340-8535-4682-98db-49f970ff5597/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:53:23.273545 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02b42340-8535-4682-98db-49f970ff5597/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:53:23.274284 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:53:23.286411 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.013s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:53:23.287907 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:53:23.288864 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.015s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:53:23.289128 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:53:23.310972 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:53:23.310972 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:23.315154 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:53:23.315154 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:23.338901 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e] added
May 28 01:53:23.338901 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:53:23.338901 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:53:23.338901 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:53:23.338901 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:53:23.338901 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:53:23.338901 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:23.339350 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:53:23.339806 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0502(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:53:23.339806 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:53:23.345734 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e] added
May 28 01:53:23.345734 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:53:23.345734 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:53:23.345734 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:53:23.345734 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:53:23.345734 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:53:23.345734 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:23.346001 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:53:23.346245 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0585(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:53:23.346413 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:53:23.376697 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02b42340-8535-4682-98db-49f970ff5597/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:53:23.383334 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:53:23.387578 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:53:23.428853 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.041s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:53:23.430604 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Hypervisor/Node resource view: name=np0000001583 free_ram=12525MB free_disk=74.59968566894531GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 01:53:23.430811 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:23.431130 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:23.505333 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Successfully updated port: fcf662e6-60ad-4e4c-b3da-ce3edf11d15b {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:53:23.577008 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-984eab9c-e573-41a7-8274-ba7987de1329 req-590f0c75-3557-4f84-9741-7e76ab0f272f service nova] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Received event network-changed-fcf662e6-60ad-4e4c-b3da-ce3edf11d15b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:53:23.577189 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-984eab9c-e573-41a7-8274-ba7987de1329 req-590f0c75-3557-4f84-9741-7e76ab0f272f service nova] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Refreshing instance network info cache due to event network-changed-fcf662e6-60ad-4e4c-b3da-ce3edf11d15b. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:53:23.577390 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-984eab9c-e573-41a7-8274-ba7987de1329 req-590f0c75-3557-4f84-9741-7e76ab0f272f service nova] Acquiring lock "refresh_cache-5c36895c-9d2c-49be-b545-3658f535964a" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:53:23.577511 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-984eab9c-e573-41a7-8274-ba7987de1329 req-590f0c75-3557-4f84-9741-7e76ab0f272f service nova] Acquired lock "refresh_cache-5c36895c-9d2c-49be-b545-3658f535964a" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:53:23.577694 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-984eab9c-e573-41a7-8274-ba7987de1329 req-590f0c75-3557-4f84-9741-7e76ab0f272f service nova] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Refreshing network info cache for port fcf662e6-60ad-4e4c-b3da-ce3edf11d15b {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:53:23.881509 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:23.998568 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:53:24.002349 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:53:24.002772 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Creating image(s)
May 28 01:53:24.003528 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "/opt/stack/data/nova/instances/5c36895c-9d2c-49be-b545-3658f535964a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:24.003777 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "/opt/stack/data/nova/instances/5c36895c-9d2c-49be-b545-3658f535964a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:24.004394 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "/opt/stack/data/nova/instances/5c36895c-9d2c-49be-b545-3658f535964a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:24.005071 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:53:24.008151 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "refresh_cache-5c36895c-9d2c-49be-b545-3658f535964a" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:53:24.013749 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:53:24.014251 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:53:24.080782 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-984eab9c-e573-41a7-8274-ba7987de1329 req-590f0c75-3557-4f84-9741-7e76ab0f272f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:53:24.099348 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.085s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:53:24.100094 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:24.100741 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:24.102286 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:53:24.105011 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:53:24.105343 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:53:24.175137 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-984eab9c-e573-41a7-8274-ba7987de1329 req-590f0c75-3557-4f84-9741-7e76ab0f272f service nova] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:53:24.189783 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.084s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:53:24.190274 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/5c36895c-9d2c-49be-b545-3658f535964a/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:53:24.233104 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/5c36895c-9d2c-49be-b545-3658f535964a/disk 1073741824" returned: 0 in 0.042s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:53:24.233920 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.133s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:24.234339 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:53:24.322794 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.088s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:53:24.323287 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5c36895c-9d2c-49be-b545-3658f535964a/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:53:24.323563 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c36895c-9d2c-49be-b545-3658f535964a/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:53:24.346051 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:53:24.347014 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:53:24.361866 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:53:24.361866 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:53:24.364571 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:53:24.364571 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:24.376499 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:24.385928 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:24.396632 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:24.396632 np0000001583 nova-compute[98241]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:24.396632 np0000001583 nova-compute[98241]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:24.396632 np0000001583 nova-compute[98241]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3df87c19-1def-4ecd-a64b-3d9b5ce5dff2 (non-flash)
May 28 01:53:24.396632 np0000001583 nova-compute[98241]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:24.396632 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:24.396632 np0000001583 nova-compute[98241]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:24.396632 np0000001583 nova-compute[98241]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:24.396632 np0000001583 nova-compute[98241]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:24.396632 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:53:24.396632 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:24.396632 np0000001583 nova-compute[98241]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:24.396632 np0000001583 nova-compute[98241]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:24.396632 np0000001583 nova-compute[98241]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3df87c19-1def-4ecd-a64b-3d9b5ce5dff2 (non-flash)
May 28 01:53:24.396632 np0000001583 nova-compute[98241]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:24.396632 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:24.396632 np0000001583 nova-compute[98241]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:24.396632 np0000001583 nova-compute[98241]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:24.396632 np0000001583 nova-compute[98241]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:24.396632 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:53:24.405899 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:24.405899 np0000001583 nova-compute[98241]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:24.405899 np0000001583 nova-compute[98241]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:24.405899 np0000001583 nova-compute[98241]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3df87c19-1def-4ecd-a64b-3d9b5ce5dff2 (non-flash)
May 28 01:53:24.405899 np0000001583 nova-compute[98241]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:24.405899 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:24.405899 np0000001583 nova-compute[98241]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:24.405899 np0000001583 nova-compute[98241]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:24.405899 np0000001583 nova-compute[98241]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:24.405899 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:53:24.406722 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:24.406722 np0000001583 nova-compute[98241]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:24.406722 np0000001583 nova-compute[98241]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:24.406722 np0000001583 nova-compute[98241]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3df87c19-1def-4ecd-a64b-3d9b5ce5dff2 (non-flash)
May 28 01:53:24.406722 np0000001583 nova-compute[98241]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:24.406722 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:24.406722 np0000001583 nova-compute[98241]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:24.406722 np0000001583 nova-compute[98241]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:24.406722 np0000001583 nova-compute[98241]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:24.406722 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:53:24.410070 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c36895c-9d2c-49be-b545-3658f535964a/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:53:24.412568 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Cannot resize image /opt/stack/data/nova/instances/5c36895c-9d2c-49be-b545-3658f535964a/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:53:24.412568 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:53:24.412568 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Ensure instance console log exists: /opt/stack/data/nova/instances/5c36895c-9d2c-49be-b545-3658f535964a/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:53:24.412568 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:24.412568 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:24.412568 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:24.437916 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-984eab9c-e573-41a7-8274-ba7987de1329 req-590f0c75-3557-4f84-9741-7e76ab0f272f service nova] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:53:24.470542 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e, portal: 192.168.50.100,3260]
May 28 01:53:24.470542 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e, portal: 192.168.50.100,3260] successful.
May 28 01:53:24.470542 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:24.488889 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:24.519318 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:24.519318 np0000001583 nova-compute[98241]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:24.519318 np0000001583 nova-compute[98241]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:24.519318 np0000001583 nova-compute[98241]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3df87c19-1def-4ecd-a64b-3d9b5ce5dff2 (non-flash)
May 28 01:53:24.519318 np0000001583 nova-compute[98241]: tcp: [18] 192.168.40.100:3260,0 iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e (non-flash)
May 28 01:53:24.519318 np0000001583 nova-compute[98241]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e (non-flash)
May 28 01:53:24.519318 np0000001583 nova-compute[98241]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:24.519318 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:24.519318 np0000001583 nova-compute[98241]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:24.519318 np0000001583 nova-compute[98241]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:24.519318 np0000001583 nova-compute[98241]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:24.519318 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:53:24.521599 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:24.521599 np0000001583 nova-compute[98241]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:24.521599 np0000001583 nova-compute[98241]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:24.521599 np0000001583 nova-compute[98241]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3df87c19-1def-4ecd-a64b-3d9b5ce5dff2 (non-flash)
May 28 01:53:24.521599 np0000001583 nova-compute[98241]: tcp: [18] 192.168.40.100:3260,0 iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e (non-flash)
May 28 01:53:24.521599 np0000001583 nova-compute[98241]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e (non-flash)
May 28 01:53:24.521599 np0000001583 nova-compute[98241]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:24.521599 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:24.521599 np0000001583 nova-compute[98241]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:24.521599 np0000001583 nova-compute[98241]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:24.521599 np0000001583 nova-compute[98241]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:24.521599 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:53:24.521599 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.232s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:53:24.521599 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:53:24.524831 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] HCTL ('17', '-', '-', 0) found on session 19 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:53:24.527723 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 02b42340-8535-4682-98db-49f970ff5597 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:53:24.527888 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 1291c6e1-108e-46d1-85bc-0197f71eec1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:53:24.528069 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance bad69594-f163-41a6-931f-d2fcda0cb7d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:53:24.528248 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance d3a7c39a-f946-496d-9153-0a422e7f5350 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:53:24.528383 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance f2805796-e531-4508-8585-0d110f4bd4e7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:53:24.528511 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance adfbfdf0-7c0f-4834-92ff-3b8d8c39e333 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:53:24.528673 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 5c36895c-9d2c-49be-b545-3658f535964a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:53:24.529299 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Scanning host 17 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:53:24.529466 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 01:53:24.530368 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Final resource view: name=np0000001583 phys_ram=24030MB used_ram=1856MB phys_disk=95GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 01:53:23 up 29 min,  2 users,  load average: 7.10, 3.65, 1.74\n', 'num_instances': '7', 'num_vm_active': '6', 'num_task_None': '6', 'num_os_type_None': '7', 'num_proj_43c294dcbfc5459898bb040ccdf1b52f': '1', 'io_workload': '1', 'num_proj_947f6e33004d49cdb05fe27674f9eea8': '2', 'num_proj_e94701d7485c4c46adefaf3637f27990': '1', 'num_proj_23e37a40d1db45cba9235de04219a3b4': '1', 'num_proj_0d31342458ec4ed2890a766f62facbcf': '1', 'num_vm_building': '1', 'num_task_block_device_mapping': '1', 'num_proj_60fbdf5ed38b4dc485a81c49b3303ed2': '1'} {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 01:53:24.553020 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Searching for a device in session 19 and hctl ['17', '*', '*', 0] yield: None {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:53:24.941196 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-984eab9c-e573-41a7-8274-ba7987de1329 req-590f0c75-3557-4f84-9741-7e76ab0f272f service nova] Releasing lock "refresh_cache-5c36895c-9d2c-49be-b545-3658f535964a" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:53:24.941970 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquired lock "refresh_cache-5c36895c-9d2c-49be-b545-3658f535964a" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:53:24.942192 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:53:24.975869 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:53:24.976186 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:53:25.462970 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e, portal: 192.168.40.100,3260]
May 28 01:53:25.462970 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e, portal: 192.168.40.100,3260] successful.
May 28 01:53:25.462970 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:25.476055 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:25.479264 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:53:25.498419 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:25.498419 np0000001583 nova-compute[98241]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:25.498419 np0000001583 nova-compute[98241]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:25.498419 np0000001583 nova-compute[98241]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3df87c19-1def-4ecd-a64b-3d9b5ce5dff2 (non-flash)
May 28 01:53:25.498419 np0000001583 nova-compute[98241]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e (non-flash)
May 28 01:53:25.498419 np0000001583 nova-compute[98241]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e (non-flash)
May 28 01:53:25.498419 np0000001583 nova-compute[98241]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:25.498419 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:25.498419 np0000001583 nova-compute[98241]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:25.498419 np0000001583 nova-compute[98241]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:25.498419 np0000001583 nova-compute[98241]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:25.498419 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:53:25.498419 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:25.498419 np0000001583 nova-compute[98241]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:25.498419 np0000001583 nova-compute[98241]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:25.498419 np0000001583 nova-compute[98241]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3df87c19-1def-4ecd-a64b-3d9b5ce5dff2 (non-flash)
May 28 01:53:25.498419 np0000001583 nova-compute[98241]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e (non-flash)
May 28 01:53:25.498419 np0000001583 nova-compute[98241]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e (non-flash)
May 28 01:53:25.498419 np0000001583 nova-compute[98241]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:25.498419 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:25.498419 np0000001583 nova-compute[98241]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:25.498419 np0000001583 nova-compute[98241]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:25.498419 np0000001583 nova-compute[98241]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:25.498419 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:53:25.498419 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.213s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:53:25.498419 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:53:25.503369 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] HCTL ('16', '-', '-', 0) found on session 18 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:53:25.503556 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Scanning host 16 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:53:25.515204 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:53:25.522341 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Searching for a device in session 18 and hctl ['16', '*', '*', 0] yield: sdl {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:53:25.522341 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c073d4e5-9ddf-44f8-9b3f-619c8b3e683e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:53:25.553019 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Searching for a device in session 19 and hctl ['17', '*', '*', 0] yield: sdk {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:53:25.553019 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c073d4e5-9ddf-44f8-9b3f-619c8b3e683e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:53:25.749133 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:53:25.967179 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Updating instance_info_cache with network_info: [{"id": "fcf662e6-60ad-4e4c-b3da-ce3edf11d15b", "address": "fa:16:3e:63:2b:b1", "network": {"id": "b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-280876007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60fbdf5ed38b4dc485a81c49b3303ed2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf662e6-60", "ovs_interfaceid": "fcf662e6-60ad-4e4c-b3da-ce3edf11d15b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:53:25.986452 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Compute_service record updated for np0000001583:np0000001583 {{(pid=98241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 01:53:25.987013 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.556s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:25.987350 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 42.21 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:53:26.147674 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:26.285648 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:53:26.469287 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Releasing lock "refresh_cache-5c36895c-9d2c-49be-b545-3658f535964a" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:53:26.469786 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Instance network_info: |[{"id": "fcf662e6-60ad-4e4c-b3da-ce3edf11d15b", "address": "fa:16:3e:63:2b:b1", "network": {"id": "b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-280876007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60fbdf5ed38b4dc485a81c49b3303ed2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf662e6-60", "ovs_interfaceid": "fcf662e6-60ad-4e4c-b3da-ce3edf11d15b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:53:26.471825 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Start _get_guest_xml network_info=[{"id": "fcf662e6-60ad-4e4c-b3da-ce3edf11d15b", "address": "fa:16:3e:63:2b:b1", "network": {"id": "b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-280876007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60fbdf5ed38b4dc485a81c49b3303ed2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf662e6-60", "ovs_interfaceid": "fcf662e6-60ad-4e4c-b3da-ce3edf11d15b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:53:26.474751 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:53:26.476407 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-1021645679', uuid='5c36895c-9d2c-49be-b545-3658f535964a'), owner=OwnerMeta(userid='27c90c0a8eb148fda8ae718f07ff1ed4', username='tempest-ServerActionsTestOtherA-1714646345-project-member', projectid='60fbdf5ed38b4dc485a81c49b3303ed2', projectname='tempest-ServerActionsTestOtherA-1714646345'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "fcf662e6-60ad-4e4c-b3da-ce3edf11d15b", "address": "fa:16:3e:63:2b:b1", "network": {"id": "b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-280876007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60fbdf5ed38b4dc485a81c49b3303ed2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf662e6-60", "ovs_interfaceid": "fcf662e6-60ad-4e4c-b3da-ce3edf11d15b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933206.4759598) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:53:26.482482 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:53:26.482906 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:53:26.484346 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:53:26.484753 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:53:26.486266 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:53:26.486841 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:53:26.488056 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:53:26.488056 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:53:26.488460 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:53:26.488597 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:53:26.488787 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:53:26.488976 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:53:26.489131 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:53:26.489304 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:53:26.489460 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:53:26.489651 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:53:26.502766 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:53:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1021645679',display_name='tempest-ServerActionsTestOtherA-server-1021645679',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-serveractionstestothera-server-1021645679',id=10,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIePG0IU7S1SlFjpc/VmXFCBBKIijsN+gHQMlnhYfGPcl665nwX9JP0OwVOuueebU/mRc6FRuLr9ai0zvPAu2rDRN1UE1FBgnGgOOoImTJFqPL9BfFXoi8JNvWclsGpwzg==',key_name='tempest-keypair-1911990843',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60fbdf5ed38b4dc485a81c49b3303ed2',ramdisk_id='',reservation_id='r-pciy66au',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1714646345',owner_user_name='tempest-ServerActionsTestOtherA-1714646345-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:53:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27c90c0a8eb148fda8ae718f07ff1ed4',uuid=5c36895c-9d2c-49be-b545-3658f535964a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fcf662e6-60ad-4e4c-b3da-ce3edf11d15b", "address": "fa:16:3e:63:2b:b1", "network": {"id": "b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-280876007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60fbdf5ed38b4dc485a81c49b3303ed2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf662e6-60", "ovs_interfaceid": "fcf662e6-60ad-4e4c-b3da-ce3edf11d15b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:53:26.503041 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Converting VIF {"id": "fcf662e6-60ad-4e4c-b3da-ce3edf11d15b", "address": "fa:16:3e:63:2b:b1", "network": {"id": "b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-280876007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60fbdf5ed38b4dc485a81c49b3303ed2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf662e6-60", "ovs_interfaceid": "fcf662e6-60ad-4e4c-b3da-ce3edf11d15b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:53:26.503415 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:2b:b1,bridge_name='br-int',has_traffic_filtering=True,id=fcf662e6-60ad-4e4c-b3da-ce3edf11d15b,network=Network(b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf662e6-60') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:53:26.504129 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lazy-loading 'pci_devices' on Instance uuid 5c36895c-9d2c-49be-b545-3658f535964a {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:53:27.007041 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] End _get_guest_xml xml=<domain type="qemu">
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:   <uuid>5c36895c-9d2c-49be-b545-3658f535964a</uuid>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:   <name>instance-0000000a</name>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:       <nova:name>tempest-ServerActionsTestOtherA-server-1021645679</nova:name>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:53:26</nova:creationTime>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:         <nova:user uuid="27c90c0a8eb148fda8ae718f07ff1ed4">tempest-ServerActionsTestOtherA-1714646345-project-member</nova:user>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:         <nova:project uuid="60fbdf5ed38b4dc485a81c49b3303ed2">tempest-ServerActionsTestOtherA-1714646345</nova:project>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:         <nova:port uuid="fcf662e6-60ad-4e4c-b3da-ce3edf11d15b">
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:     <system>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:       <entry name="serial">5c36895c-9d2c-49be-b545-3658f535964a</entry>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:       <entry name="uuid">5c36895c-9d2c-49be-b545-3658f535964a</entry>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:     </system>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:   <os>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:   </os>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:   <features>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:   </features>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:   <devices>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/5c36895c-9d2c-49be-b545-3658f535964a/disk"/>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:     </disk>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/5c36895c-9d2c-49be-b545-3658f535964a/disk.config"/>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:     </disk>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:63:2b:b1"/>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:       <target dev="tapfcf662e6-60"/>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:     </interface>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/5c36895c-9d2c-49be-b545-3658f535964a/console.log" append="off"/>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:     </serial>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:     <video>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:     </video>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:     </rng>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:   </devices>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]: </domain>
May 28 01:53:27.007041 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:53:27.011068 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Preparing to wait for external event network-vif-plugged-fcf662e6-60ad-4e4c-b3da-ce3edf11d15b {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:53:27.011068 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "5c36895c-9d2c-49be-b545-3658f535964a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:27.011068 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "5c36895c-9d2c-49be-b545-3658f535964a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:27.011068 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "5c36895c-9d2c-49be-b545-3658f535964a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:27.011068 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:53:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1021645679',display_name='tempest-ServerActionsTestOtherA-server-1021645679',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-serveractionstestothera-server-1021645679',id=10,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIePG0IU7S1SlFjpc/VmXFCBBKIijsN+gHQMlnhYfGPcl665nwX9JP0OwVOuueebU/mRc6FRuLr9ai0zvPAu2rDRN1UE1FBgnGgOOoImTJFqPL9BfFXoi8JNvWclsGpwzg==',key_name='tempest-keypair-1911990843',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60fbdf5ed38b4dc485a81c49b3303ed2',ramdisk_id='',reservation_id='r-pciy66au',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1714646345',owner_user_name='tempest-ServerActionsTestOtherA-1714646345-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:53:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27c90c0a8eb148fda8ae718f07ff1ed4',uuid=5c36895c-9d2c-49be-b545-3658f535964a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fcf662e6-60ad-4e4c-b3da-ce3edf11d15b", "address": "fa:16:3e:63:2b:b1", "network": {"id": "b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-280876007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60fbdf5ed38b4dc485a81c49b3303ed2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf662e6-60", "ovs_interfaceid": "fcf662e6-60ad-4e4c-b3da-ce3edf11d15b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:53:27.011068 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Converting VIF {"id": "fcf662e6-60ad-4e4c-b3da-ce3edf11d15b", "address": "fa:16:3e:63:2b:b1", "network": {"id": "b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-280876007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60fbdf5ed38b4dc485a81c49b3303ed2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf662e6-60", "ovs_interfaceid": "fcf662e6-60ad-4e4c-b3da-ce3edf11d15b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:53:27.011068 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:2b:b1,bridge_name='br-int',has_traffic_filtering=True,id=fcf662e6-60ad-4e4c-b3da-ce3edf11d15b,network=Network(b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf662e6-60') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:53:27.011068 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:2b:b1,bridge_name='br-int',has_traffic_filtering=True,id=fcf662e6-60ad-4e4c-b3da-ce3edf11d15b,network=Network(b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf662e6-60') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:53:27.011068 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:27.011068 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:53:27.011068 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:53:27.011792 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:27.011792 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5684edf4-8f06-5ff1-ae43-249859d5b01b', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:53:27.012409 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:27.013234 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:53:27.015479 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:27.017764 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:27.017933 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfcf662e6-60, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:53:27.018323 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfcf662e6-60, col_values=(('qos', UUID('eb81a700-791a-4e2b-aab5-13101fb07214')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:53:27.018519 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfcf662e6-60, col_values=(('external_ids', {'iface-id': 'fcf662e6-60ad-4e4c-b3da-ce3edf11d15b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:2b:b1', 'vm-uuid': '5c36895c-9d2c-49be-b545-3658f535964a'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:53:27.020144 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:27.022298 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:53:27.027457 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:27.028646 np0000001583 nova-compute[98241]: INFO os_vif [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:2b:b1,bridge_name='br-int',has_traffic_filtering=True,id=fcf662e6-60ad-4e4c-b3da-ce3edf11d15b,network=Network(b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf662e6-60')
May 28 01:53:27.304901 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Found WWN 33000000002692fd1 for multipath device dm-8 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:53:27.305698 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.053s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:53:27.305698 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] <== connect_volume: return (4053ms) {'type': 'block', 'scsi_wwn': '33000000002692fd1', 'path': '/dev/dm-8', 'multipath_id': '33000000002692fd1'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:53:27.305698 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] [instance: 02b42340-8535-4682-98db-49f970ff5597] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000002692fd1', 'path': '/dev/dm-8', 'multipath_id': '33000000002692fd1'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:53:27.307818 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Lazy-loading 'flavor' on Instance uuid 02b42340-8535-4682-98db-49f970ff5597 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:53:27.541333 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ead74db2-4e6d-4e80-a543-d78f6a0ddabe req-e997e6d9-fa26-422b-aed0-6e6754acd037 service nova] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Received event network-changed-62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:53:27.541333 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ead74db2-4e6d-4e80-a543-d78f6a0ddabe req-e997e6d9-fa26-422b-aed0-6e6754acd037 service nova] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Refreshing instance network info cache due to event network-changed-62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:53:27.541333 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ead74db2-4e6d-4e80-a543-d78f6a0ddabe req-e997e6d9-fa26-422b-aed0-6e6754acd037 service nova] Acquiring lock "refresh_cache-bad69594-f163-41a6-931f-d2fcda0cb7d1" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:53:27.541333 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ead74db2-4e6d-4e80-a543-d78f6a0ddabe req-e997e6d9-fa26-422b-aed0-6e6754acd037 service nova] Acquired lock "refresh_cache-bad69594-f163-41a6-931f-d2fcda0cb7d1" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:53:27.541333 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-ead74db2-4e6d-4e80-a543-d78f6a0ddabe req-e997e6d9-fa26-422b-aed0-6e6754acd037 service nova] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Refreshing network info cache for port 62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:53:27.810992 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] [instance: 02b42340-8535-4682-98db-49f970ff5597] Attempting to attach volume c073d4e5-9ddf-44f8-9b3f-619c8b3e683e with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98241) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 01:53:27.812330 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] attach device xml: <disk type="block" device="disk">
May 28 01:53:27.812330 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:53:27.812330 np0000001583 nova-compute[98241]:   <alias name="ua-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e"/>
May 28 01:53:27.812330 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-8"/>
May 28 01:53:27.812330 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 01:53:27.812330 np0000001583 nova-compute[98241]:   <serial>c073d4e5-9ddf-44f8-9b3f-619c8b3e683e</serial>
May 28 01:53:27.812330 np0000001583 nova-compute[98241]: </disk>
May 28 01:53:27.812330 np0000001583 nova-compute[98241]:  {{(pid=98241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 01:53:27.822681 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:27.956835 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:28.045908 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-ead74db2-4e6d-4e80-a543-d78f6a0ddabe req-e997e6d9-fa26-422b-aed0-6e6754acd037 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:53:28.327877 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Acquiring lock "1291c6e1-108e-46d1-85bc-0197f71eec1f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:28.328274 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "1291c6e1-108e-46d1-85bc-0197f71eec1f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:28.440268 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-ead74db2-4e6d-4e80-a543-d78f6a0ddabe req-e997e6d9-fa26-422b-aed0-6e6754acd037 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:53:28.587828 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:53:28.588110 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:53:28.588235 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] No VIF found with MAC fa:16:3e:63:2b:b1, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:53:28.588787 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Using config drive
May 28 01:53:28.619884 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-ead74db2-4e6d-4e80-a543-d78f6a0ddabe req-e997e6d9-fa26-422b-aed0-6e6754acd037 service nova] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Updated VIF entry in instance network info cache for port 62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:53:28.620143 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-ead74db2-4e6d-4e80-a543-d78f6a0ddabe req-e997e6d9-fa26-422b-aed0-6e6754acd037 service nova] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Updating instance_info_cache with network_info: [{"id": "62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6", "address": "fa:16:3e:52:00:6a", "network": {"id": "1a3cc53e-d09d-45ba-a64b-48bf74dd1680", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-582528653-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "947f6e33004d49cdb05fe27674f9eea8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d17bf8-d7", "ovs_interfaceid": "62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:53:28.833666 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lazy-loading 'flavor' on Instance uuid 1291c6e1-108e-46d1-85bc-0197f71eec1f {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:53:29.095066 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:53:29.122807 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ead74db2-4e6d-4e80-a543-d78f6a0ddabe req-e997e6d9-fa26-422b-aed0-6e6754acd037 service nova] Releasing lock "refresh_cache-bad69594-f163-41a6-931f-d2fcda0cb7d1" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:53:29.261751 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Creating config drive at /opt/stack/data/nova/instances/5c36895c-9d2c-49be-b545-3658f535964a/disk.config
May 28 01:53:29.264121 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5c36895c-9d2c-49be-b545-3658f535964a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_z9usdc5 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:53:29.309224 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5c36895c-9d2c-49be-b545-3658f535964a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_z9usdc5" returned: 0 in 0.045s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:53:29.475055 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:53:29.475266 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:53:29.475446 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:53:29.475596 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] No VIF found with MAC fa:16:3e:f4:4b:8c, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:53:29.844617 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:29.852283 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "1291c6e1-108e-46d1-85bc-0197f71eec1f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.524s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:29.861254 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-06a3838c-b42d-4886-b33f-ef11e5c5e4d5 req-0d9109f1-e702-4d20-bfdc-c06bec79917c service nova] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Received event network-changed-ba06c38a-7287-4a4b-b2d9-015659e538a0 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:53:29.861587 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-06a3838c-b42d-4886-b33f-ef11e5c5e4d5 req-0d9109f1-e702-4d20-bfdc-c06bec79917c service nova] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Refreshing instance network info cache due to event network-changed-ba06c38a-7287-4a4b-b2d9-015659e538a0. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:53:29.861720 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-06a3838c-b42d-4886-b33f-ef11e5c5e4d5 req-0d9109f1-e702-4d20-bfdc-c06bec79917c service nova] Acquiring lock "refresh_cache-1291c6e1-108e-46d1-85bc-0197f71eec1f" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:53:29.861922 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-06a3838c-b42d-4886-b33f-ef11e5c5e4d5 req-0d9109f1-e702-4d20-bfdc-c06bec79917c service nova] Acquired lock "refresh_cache-1291c6e1-108e-46d1-85bc-0197f71eec1f" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:53:29.861983 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-06a3838c-b42d-4886-b33f-ef11e5c5e4d5 req-0d9109f1-e702-4d20-bfdc-c06bec79917c service nova] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Refreshing network info cache for port ba06c38a-7287-4a4b-b2d9-015659e538a0 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:53:29.874680 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:29.877467 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:29.990433 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:30.272707 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:30.275391 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:30.280221 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:30.305857 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:30.370821 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-06a3838c-b42d-4886-b33f-ef11e5c5e4d5 req-0d9109f1-e702-4d20-bfdc-c06bec79917c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:53:30.676214 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Rebuilding instance
May 28 01:53:30.902863 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-06a3838c-b42d-4886-b33f-ef11e5c5e4d5 req-0d9109f1-e702-4d20-bfdc-c06bec79917c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:53:30.924286 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933210.9236865, 5c36895c-9d2c-49be-b545-3658f535964a => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:53:30.924590 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] VM Started (Lifecycle Event)
May 28 01:53:30.957272 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:53:30.978421 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Acquiring lock "1291c6e1-108e-46d1-85bc-0197f71eec1f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:30.978565 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "1291c6e1-108e-46d1-85bc-0197f71eec1f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:30.980701 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Attaching volume d64c94a0-49df-4115-a2f7-19f68645f860 to /dev/vdb
May 28 01:53:31.037432 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:53:31.052533 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:53:31.058355 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-558e291a-5d24-4064-a6ac-ff9a30866a2c tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Lock "02b42340-8535-4682-98db-49f970ff5597" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.591s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:31.080389 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:53:31.105687 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-06a3838c-b42d-4886-b33f-ef11e5c5e4d5 req-0d9109f1-e702-4d20-bfdc-c06bec79917c service nova] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Updated VIF entry in instance network info cache for port ba06c38a-7287-4a4b-b2d9-015659e538a0. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:53:31.106405 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-06a3838c-b42d-4886-b33f-ef11e5c5e4d5 req-0d9109f1-e702-4d20-bfdc-c06bec79917c service nova] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Updating instance_info_cache with network_info: [{"id": "ba06c38a-7287-4a4b-b2d9-015659e538a0", "address": "fa:16:3e:45:c5:fe", "network": {"id": "1a3cc53e-d09d-45ba-a64b-48bf74dd1680", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-582528653-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "947f6e33004d49cdb05fe27674f9eea8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba06c38a-72", "ovs_interfaceid": "ba06c38a-7287-4a4b-b2d9-015659e538a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:53:31.119588 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:53:31.119936 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:53:31.130034 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:53:31.133433 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fef4:4b8c', 'fe80::e02a:5fff:fe52:f5a1', 'fe80::fc16:3eff:fe45:c5fe', 'fe80::e05c:5bff:fea5:7965', 'fe80::fc16:3eff:fe52:6a', 'fe80::fc16:3eff:fe91:a669', 'fe80::3051:94ff:fec8:bd13', 'fe80::fc16:3eff:fe54:8727', 'fe80::fc16:3eff:feab:fdca', 'fe80::e4ee:48ff:fe05:5865', 'fe80::fc16:3eff:fe18:87d6', 'fe80::fc16:3eff:fe9a:c8f6', 'fe80::fc16:3eff:feba:70ee', 'fe80::fc16:3eff:fe1d:f8b7', 'fe80::4890:45ff:fee9:3b86', 'fe80::fc16:3eff:fecb:ffdf', 'fe80::f413:99ff:fea1:4341', 'fe80::fc16:3eff:fef5:ed7d', 'fe80::c4dd:b4ff:fe11:7c8', 'fe80::fc16:3eff:fe63:2bb1', 'fe80::e43a:d5ff:fecc:27fe'] 
May 28 01:53:31.133706 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:53:31.133977 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:53:31.134305 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] <== get_connector_properties: return (96ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:53:31.134570 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Updating existing volume attachment record: af191aa9-21fb-45e7-a3fe-a365e7b7557d {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:53:31.265660 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f7bb71d8-47c7-4fc8-acff-e33ca3f1ae0f tempest-VolumesAssistedSnapshotsTest-142891947 tempest-VolumesAssistedSnapshotsTest-142891947-project] [instance: 02b42340-8535-4682-98db-49f970ff5597] volume_snapshot_create: create_info: {'snapshot_id': 'fda25b5e-cf65-4024-aa0a-c80b643bd866', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=98241) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3769}}
May 28 01:53:31.270422 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f7bb71d8-47c7-4fc8-acff-e33ca3f1ae0f tempest-VolumesAssistedSnapshotsTest-142891947 tempest-VolumesAssistedSnapshotsTest-142891947-project] [instance: 02b42340-8535-4682-98db-49f970ff5597] snap xml: <domainsnapshot>
May 28 01:53:31.270422 np0000001583 nova-compute[98241]:   <disks>
May 28 01:53:31.270422 np0000001583 nova-compute[98241]:     <disk name="/dev/dm-8" snapshot="external" type="file">
May 28 01:53:31.270422 np0000001583 nova-compute[98241]:       <source file="/dev/new_file"/>
May 28 01:53:31.270422 np0000001583 nova-compute[98241]:     </disk>
May 28 01:53:31.270422 np0000001583 nova-compute[98241]:     <disk name="vda" snapshot="no"/>
May 28 01:53:31.270422 np0000001583 nova-compute[98241]:     <disk name="hda" snapshot="no"/>
May 28 01:53:31.270422 np0000001583 nova-compute[98241]:   </disks>
May 28 01:53:31.270422 np0000001583 nova-compute[98241]: </domainsnapshot>
May 28 01:53:31.270422 np0000001583 nova-compute[98241]:  {{(pid=98241) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3710}}
May 28 01:53:31.271196 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-f7bb71d8-47c7-4fc8-acff-e33ca3f1ae0f tempest-VolumesAssistedSnapshotsTest-142891947 tempest-VolumesAssistedSnapshotsTest-142891947-project] Lazy-loading 'system_metadata' on Instance uuid 02b42340-8535-4682-98db-49f970ff5597 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:53:31.322633 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-73808190-d057-4786-9879-4f2c480ba00a tempest-VolumesAssistedSnapshotsTest-142891947 tempest-VolumesAssistedSnapshotsTest-142891947-project] [instance: 02b42340-8535-4682-98db-49f970ff5597] volume_snapshot_delete: delete_info: {'volume_id': 'c073d4e5-9ddf-44f8-9b3f-619c8b3e683e'} {{(pid=98241) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3877}}
May 28 01:53:31.326609 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver [None req-73808190-d057-4786-9879-4f2c480ba00a tempest-VolumesAssistedSnapshotsTest-142891947 tempest-VolumesAssistedSnapshotsTest-142891947-project] [instance: 02b42340-8535-4682-98db-49f970ff5597] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
May 28 01:53:31.326609 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver [instance: 02b42340-8535-4682-98db-49f970ff5597] Traceback (most recent call last):
May 28 01:53:31.326609 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver [instance: 02b42340-8535-4682-98db-49f970ff5597]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4050, in volume_snapshot_delete
May 28 01:53:31.326609 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver [instance: 02b42340-8535-4682-98db-49f970ff5597]     self._volume_snapshot_delete(context, instance, volume_id,
May 28 01:53:31.326609 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver [instance: 02b42340-8535-4682-98db-49f970ff5597]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3880, in _volume_snapshot_delete
May 28 01:53:31.326609 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver [instance: 02b42340-8535-4682-98db-49f970ff5597]     if delete_info['type'] != 'qcow2':
May 28 01:53:31.326609 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver [instance: 02b42340-8535-4682-98db-49f970ff5597]        ~~~~~~~~~~~^^^^^^^^
May 28 01:53:31.326609 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver [instance: 02b42340-8535-4682-98db-49f970ff5597] KeyError: 'type'
May 28 01:53:31.326609 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver [instance: 02b42340-8535-4682-98db-49f970ff5597] 
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver [None req-73808190-d057-4786-9879-4f2c480ba00a tempest-VolumesAssistedSnapshotsTest-142891947 tempest-VolumesAssistedSnapshotsTest-142891947-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4050, in volume_snapshot_delete
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3880, in _volume_snapshot_delete
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver        ~~~~~~~~~~~^^^^^^^^
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver KeyError: 'type'
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver 
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver 
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-394f2d58-d9e0-46f5-9343-ccbcfbb9cbbf)
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver 
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver 
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3609, in _volume_snapshot_update_status
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 376, in wrapper
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 447, in wrapper
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 467, in _reraise
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
May 28 01:53:31.382674 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver 
May 28 01:53:31.415709 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server [None req-73808190-d057-4786-9879-4f2c480ba00a tempest-VolumesAssistedSnapshotsTest-142891947 tempest-VolumesAssistedSnapshotsTest-142891947-project] Exception during message handling: KeyError: 'type'
May 28 01:53:31.415709 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
May 28 01:53:31.415709 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming
May 28 01:53:31.415709 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
May 28 01:53:31.415709 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 01:53:31.415709 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
May 28 01:53:31.415709 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
May 28 01:53:31.415709 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 01:53:31.415709 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
May 28 01:53:31.415709 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
May 28 01:53:31.415709 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
May 28 01:53:31.415709 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 269, in inner
May 28 01:53:31.415709 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
May 28 01:53:31.415709 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^
May 28 01:53:31.415709 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
May 28 01:53:31.415709 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 28 01:53:31.415709 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 28 01:53:31.415709 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 28 01:53:31.415709 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 28 01:53:31.415709 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server     raise self.value
May 28 01:53:31.415709 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
May 28 01:53:31.415709 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
May 28 01:53:31.415709 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 01:53:31.415709 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4829, in volume_snapshot_delete
May 28 01:53:31.415709 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
May 28 01:53:31.415709 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4053, in volume_snapshot_delete
May 28 01:53:31.415709 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 28 01:53:31.415709 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 28 01:53:31.415709 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 28 01:53:31.415709 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 28 01:53:31.415709 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server     raise self.value
May 28 01:53:31.415709 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4050, in volume_snapshot_delete
May 28 01:53:31.415709 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
May 28 01:53:31.415709 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3880, in _volume_snapshot_delete
May 28 01:53:31.415709 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
May 28 01:53:31.415709 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server        ~~~~~~~~~~~^^^^^^^^
May 28 01:53:31.415709 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server KeyError: 'type'
May 28 01:53:31.415709 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server 
May 28 01:53:31.430602 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:53:31.435876 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933211.4351952, 5c36895c-9d2c-49be-b545-3658f535964a => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:53:31.435876 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] VM Paused (Lifecycle Event)
May 28 01:53:31.610041 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-06a3838c-b42d-4886-b33f-ef11e5c5e4d5 req-0d9109f1-e702-4d20-bfdc-c06bec79917c service nova] Releasing lock "refresh_cache-1291c6e1-108e-46d1-85bc-0197f71eec1f" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:53:31.696697 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:53:31.696945 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860', 'iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd64c94a0-49df-4115-a2f7-19f68645f860', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:53:31.697115 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:53:31.697534 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:53:31.697779 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860', 'iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd64c94a0-49df-4115-a2f7-19f68645f860', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:53:31.712544 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:53:31.713297 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:53:31.713644 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:53:31.713850 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:53:31.714397 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:53:31.715139 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:53:31.736237 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:53:31.736237 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:31.743221 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:53:31.743221 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:31.749233 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860] added
May 28 01:53:31.749233 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:53:31.749233 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:53:31.749233 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:53:31.749233 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:53:31.749233 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:53:31.749233 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:31.749422 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:53:31.749690 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.035(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:53:31.749917 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:53:31.754891 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860] added
May 28 01:53:31.754891 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:53:31.754891 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:53:31.754891 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:53:31.754891 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:53:31.754891 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:53:31.754891 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:31.755228 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:53:31.755276 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0414(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:53:31.755453 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:53:31.775259 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-f7bb71d8-47c7-4fc8-acff-e33ca3f1ae0f tempest-VolumesAssistedSnapshotsTest-142891947 tempest-VolumesAssistedSnapshotsTest-142891947-project] [instance: 02b42340-8535-4682-98db-49f970ff5597] Skipping quiescing instance: QEMU guest agent is not enabled.
May 28 01:53:31.786560 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver [None req-f7bb71d8-47c7-4fc8-acff-e33ca3f1ae0f tempest-VolumesAssistedSnapshotsTest-142891947 tempest-VolumesAssistedSnapshotsTest-142891947-project] [instance: 02b42340-8535-4682-98db-49f970ff5597] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 28 01:53:31.786560 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver [instance: 02b42340-8535-4682-98db-49f970ff5597] Traceback (most recent call last):
May 28 01:53:31.786560 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver [instance: 02b42340-8535-4682-98db-49f970ff5597]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 28 01:53:31.786560 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver [instance: 02b42340-8535-4682-98db-49f970ff5597]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 28 01:53:31.786560 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver [instance: 02b42340-8535-4682-98db-49f970ff5597]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 28 01:53:31.786560 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver [instance: 02b42340-8535-4682-98db-49f970ff5597]     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 28 01:53:31.786560 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver [instance: 02b42340-8535-4682-98db-49f970ff5597]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 28 01:53:31.786560 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver [instance: 02b42340-8535-4682-98db-49f970ff5597]     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 28 01:53:31.786560 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver [instance: 02b42340-8535-4682-98db-49f970ff5597] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 28 01:53:31.786560 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver [instance: 02b42340-8535-4682-98db-49f970ff5597] 
May 28 01:53:31.789539 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver [None req-f7bb71d8-47c7-4fc8-acff-e33ca3f1ae0f tempest-VolumesAssistedSnapshotsTest-142891947 tempest-VolumesAssistedSnapshotsTest-142891947-project] [instance: 02b42340-8535-4682-98db-49f970ff5597] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 28 01:53:31.789539 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver [instance: 02b42340-8535-4682-98db-49f970ff5597] Traceback (most recent call last):
May 28 01:53:31.789539 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver [instance: 02b42340-8535-4682-98db-49f970ff5597]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3787, in volume_snapshot_create
May 28 01:53:31.789539 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver [instance: 02b42340-8535-4682-98db-49f970ff5597]     self._volume_snapshot_create(context, instance, guest,
May 28 01:53:31.789539 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver [instance: 02b42340-8535-4682-98db-49f970ff5597]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 28 01:53:31.789539 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver [instance: 02b42340-8535-4682-98db-49f970ff5597]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 28 01:53:31.789539 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver [instance: 02b42340-8535-4682-98db-49f970ff5597]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 28 01:53:31.789539 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver [instance: 02b42340-8535-4682-98db-49f970ff5597]     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 28 01:53:31.789539 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver [instance: 02b42340-8535-4682-98db-49f970ff5597]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 28 01:53:31.789539 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver [instance: 02b42340-8535-4682-98db-49f970ff5597]     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 28 01:53:31.789539 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver [instance: 02b42340-8535-4682-98db-49f970ff5597] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 28 01:53:31.789539 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver [instance: 02b42340-8535-4682-98db-49f970ff5597] 
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver [None req-f7bb71d8-47c7-4fc8-acff-e33ca3f1ae0f tempest-VolumesAssistedSnapshotsTest-142891947 tempest-VolumesAssistedSnapshotsTest-142891947-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot fda25b5e-cf65-4024-aa0a-c80b643bd866 could not be found.
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3787, in volume_snapshot_create
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver 
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver 
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot fda25b5e-cf65-4024-aa0a-c80b643bd866 could not be found. (HTTP 404) (Request-ID: req-fb35d43d-b206-45ae-b618-e80f5c8ccf30)
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver 
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver 
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3609, in _volume_snapshot_update_status
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 376, in wrapper
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 447, in wrapper
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 467, in _reraise
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot fda25b5e-cf65-4024-aa0a-c80b643bd866 could not be found.
May 28 01:53:31.829107 np0000001583 nova-compute[98241]: ERROR nova.virt.libvirt.driver 
May 28 01:53:31.832707 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server [None req-f7bb71d8-47c7-4fc8-acff-e33ca3f1ae0f tempest-VolumesAssistedSnapshotsTest-142891947 tempest-VolumesAssistedSnapshotsTest-142891947-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 28 01:53:31.832707 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
May 28 01:53:31.832707 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming
May 28 01:53:31.832707 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
May 28 01:53:31.832707 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 01:53:31.832707 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
May 28 01:53:31.832707 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
May 28 01:53:31.832707 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 01:53:31.832707 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
May 28 01:53:31.832707 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
May 28 01:53:31.832707 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
May 28 01:53:31.832707 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 269, in inner
May 28 01:53:31.832707 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
May 28 01:53:31.832707 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^
May 28 01:53:31.832707 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
May 28 01:53:31.832707 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 28 01:53:31.832707 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 28 01:53:31.832707 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 28 01:53:31.832707 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 28 01:53:31.832707 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server     raise self.value
May 28 01:53:31.832707 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
May 28 01:53:31.832707 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
May 28 01:53:31.832707 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 01:53:31.832707 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4817, in volume_snapshot_create
May 28 01:53:31.832707 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
May 28 01:53:31.832707 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3790, in volume_snapshot_create
May 28 01:53:31.832707 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 28 01:53:31.832707 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 28 01:53:31.832707 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 28 01:53:31.832707 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 28 01:53:31.832707 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server     raise self.value
May 28 01:53:31.832707 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3787, in volume_snapshot_create
May 28 01:53:31.832707 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
May 28 01:53:31.832707 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 28 01:53:31.832707 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 28 01:53:31.832707 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 28 01:53:31.832707 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 28 01:53:31.832707 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 28 01:53:31.832707 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 28 01:53:31.832707 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 28 01:53:31.832707 np0000001583 nova-compute[98241]: ERROR oslo_messaging.rpc.server 
May 28 01:53:31.942111 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:53:31.942111 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:53:31.975973 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-fc997dbc-40c2-4372-aaab-86a1c24dd389 req-ab3b257d-9722-4664-8370-fd69d13d442c service nova] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Received event network-vif-plugged-fcf662e6-60ad-4e4c-b3da-ce3edf11d15b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:53:31.976275 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-fc997dbc-40c2-4372-aaab-86a1c24dd389 req-ab3b257d-9722-4664-8370-fd69d13d442c service nova] Acquiring lock "5c36895c-9d2c-49be-b545-3658f535964a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:31.976507 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-fc997dbc-40c2-4372-aaab-86a1c24dd389 req-ab3b257d-9722-4664-8370-fd69d13d442c service nova] Lock "5c36895c-9d2c-49be-b545-3658f535964a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:31.978475 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-fc997dbc-40c2-4372-aaab-86a1c24dd389 req-ab3b257d-9722-4664-8370-fd69d13d442c service nova] Lock "5c36895c-9d2c-49be-b545-3658f535964a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:31.982132 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-fc997dbc-40c2-4372-aaab-86a1c24dd389 req-ab3b257d-9722-4664-8370-fd69d13d442c service nova] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Processing event network-vif-plugged-fcf662e6-60ad-4e4c-b3da-ce3edf11d15b {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:53:31.982132 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:53:31.982610 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:53:31.987321 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Instance spawned successfully.
May 28 01:53:31.987321 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:53:32.005562 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:32.013228 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:32.019549 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:32.039612 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:32.050107 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:32.076317 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3f290dc6-d1a7-4a90-bee1-1b41b3d56c9b tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Acquiring lock "02b42340-8535-4682-98db-49f970ff5597" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:32.076503 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3f290dc6-d1a7-4a90-bee1-1b41b3d56c9b tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Lock "02b42340-8535-4682-98db-49f970ff5597" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:32.084352 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:32.262780 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-82e47931-7f4e-4349-aa10-5f18a4c6ddb9 req-67d2631a-482e-4598-aeee-fd45d973e284 service nova] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Received event network-vif-unplugged-6835d977-7c34-4bd7-8d12-208432ea45d3 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:53:32.264531 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-82e47931-7f4e-4349-aa10-5f18a4c6ddb9 req-67d2631a-482e-4598-aeee-fd45d973e284 service nova] Acquiring lock "f2805796-e531-4508-8585-0d110f4bd4e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:32.264742 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-82e47931-7f4e-4349-aa10-5f18a4c6ddb9 req-67d2631a-482e-4598-aeee-fd45d973e284 service nova] Lock "f2805796-e531-4508-8585-0d110f4bd4e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:32.264827 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-82e47931-7f4e-4349-aa10-5f18a4c6ddb9 req-67d2631a-482e-4598-aeee-fd45d973e284 service nova] Lock "f2805796-e531-4508-8585-0d110f4bd4e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:32.265006 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-82e47931-7f4e-4349-aa10-5f18a4c6ddb9 req-67d2631a-482e-4598-aeee-fd45d973e284 service nova] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] No waiting events found dispatching network-vif-unplugged-6835d977-7c34-4bd7-8d12-208432ea45d3 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:53:32.265309 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-82e47931-7f4e-4349-aa10-5f18a4c6ddb9 req-67d2631a-482e-4598-aeee-fd45d973e284 service nova] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Received unexpected event network-vif-unplugged-6835d977-7c34-4bd7-8d12-208432ea45d3 for instance with vm_state active and task_state rebuilding.
May 28 01:53:32.332000 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Instance destroyed successfully.
May 28 01:53:32.346036 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Instance destroyed successfully.
May 28 01:53:32.348319 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:52:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1075767386',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-serveractionsv293testjson-server-2040873444',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNU/wFJvIXv98vi6aYo5JdgOO26yK3H8M5Fwr9L6B9TgZZAeaxeYClgf/riTA9gRggFDSHAHQ2WWHr+BBFeB2YnkUvKZLTUbGagtUk9wt6ZgeubZXG0bqVpSP2PvleXU0w==',key_name='tempest-keypair-1710605134',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:52:48Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='23e37a40d1db45cba9235de04219a3b4',ramdisk_id='',reservation_id='r-0idxh519',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='160eac6b-3e35-4339-bdf4-c5b84e5687ff',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-716114863',owner_user_name='tempest-ServerActionsV293TestJSON-716114863-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:53:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bff6dc118f2e4efc8d499d4614565377',uuid=f2805796-e531-4508-8585-0d110f4bd4e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6835d977-7c34-4bd7-8d12-208432ea45d3", "address": "fa:16:3e:91:a6:69", "network": {"id": "2043727d-617f-4eff-98e6-5d58f439532d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1616658634-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e37a40d1db45cba9235de04219a3b4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6835d977-7c", "ovs_interfaceid": "6835d977-7c34-4bd7-8d12-208432ea45d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:53:32.348319 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Converting VIF {"id": "6835d977-7c34-4bd7-8d12-208432ea45d3", "address": "fa:16:3e:91:a6:69", "network": {"id": "2043727d-617f-4eff-98e6-5d58f439532d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1616658634-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e37a40d1db45cba9235de04219a3b4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6835d977-7c", "ovs_interfaceid": "6835d977-7c34-4bd7-8d12-208432ea45d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:53:32.348659 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:a6:69,bridge_name='br-int',has_traffic_filtering=True,id=6835d977-7c34-4bd7-8d12-208432ea45d3,network=Network(2043727d-617f-4eff-98e6-5d58f439532d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6835d977-7c') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:53:32.349199 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:a6:69,bridge_name='br-int',has_traffic_filtering=True,id=6835d977-7c34-4bd7-8d12-208432ea45d3,network=Network(2043727d-617f-4eff-98e6-5d58f439532d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6835d977-7c') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:53:32.353971 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:32.353971 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6835d977-7c, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:53:32.355446 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:32.357616 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:53:32.358873 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:32.359028 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bae133a5-63ad-4b6b-b31c-782f08eef61c) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:53:32.362306 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:32.363569 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:53:32.364906 np0000001583 nova-compute[98241]: INFO os_vif [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:a6:69,bridge_name='br-int',has_traffic_filtering=True,id=6835d977-7c34-4bd7-8d12-208432ea45d3,network=Network(2043727d-617f-4eff-98e6-5d58f439532d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6835d977-7c')
May 28 01:53:32.368895 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:53:32.369066 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9', 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ac79736b-8037-45cb-a9eb-510556b680f9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:53:32.369208 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:53:32.444188 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:53:32.445832 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933212.4443064, 5c36895c-9d2c-49be-b545-3658f535964a => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:53:32.445832 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] VM Resumed (Lifecycle Event)
May 28 01:53:32.498143 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:53:32.500241 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:53:32.500572 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:53:32.501122 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:53:32.502097 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:53:32.502097 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:53:32.579424 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-3f290dc6-d1a7-4a90-bee1-1b41b3d56c9b tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] [instance: 02b42340-8535-4682-98db-49f970ff5597] Detaching volume c073d4e5-9ddf-44f8-9b3f-619c8b3e683e
May 28 01:53:32.651421 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-3f290dc6-d1a7-4a90-bee1-1b41b3d56c9b tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] [instance: 02b42340-8535-4682-98db-49f970ff5597] Attempting to driver detach volume c073d4e5-9ddf-44f8-9b3f-619c8b3e683e from mountpoint /dev/vdb
May 28 01:53:32.658243 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3f290dc6-d1a7-4a90-bee1-1b41b3d56c9b tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Found disk vdb by alias ua-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:53:32.660395 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3f290dc6-d1a7-4a90-bee1-1b41b3d56c9b tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Found disk vdb by alias ua-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:53:32.660585 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3f290dc6-d1a7-4a90-bee1-1b41b3d56c9b tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Attempting to detach device vdb from instance 02b42340-8535-4682-98db-49f970ff5597 from the persistent domain config. {{(pid=98241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 01:53:32.660987 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-3f290dc6-d1a7-4a90-bee1-1b41b3d56c9b tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] detach device xml: <disk type="block" device="disk">
May 28 01:53:32.660987 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:53:32.660987 np0000001583 nova-compute[98241]:   <alias name="ua-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e"/>
May 28 01:53:32.660987 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-8"/>
May 28 01:53:32.660987 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 01:53:32.660987 np0000001583 nova-compute[98241]:   <serial>c073d4e5-9ddf-44f8-9b3f-619c8b3e683e</serial>
May 28 01:53:32.660987 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:53:32.660987 np0000001583 nova-compute[98241]: </disk>
May 28 01:53:32.660987 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:53:32.668169 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-3f290dc6-d1a7-4a90-bee1-1b41b3d56c9b tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Successfully detached device vdb from instance 02b42340-8535-4682-98db-49f970ff5597 from the persistent domain config.
May 28 01:53:32.668383 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3f290dc6-d1a7-4a90-bee1-1b41b3d56c9b tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] (1/8): Attempting to detach device vdb with device alias ua-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e from instance 02b42340-8535-4682-98db-49f970ff5597 from the live domain config. {{(pid=98241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 01:53:32.668756 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-3f290dc6-d1a7-4a90-bee1-1b41b3d56c9b tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] detach device xml: <disk type="block" device="disk">
May 28 01:53:32.668756 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:53:32.668756 np0000001583 nova-compute[98241]:   <alias name="ua-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e"/>
May 28 01:53:32.668756 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-8"/>
May 28 01:53:32.668756 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 01:53:32.668756 np0000001583 nova-compute[98241]:   <serial>c073d4e5-9ddf-44f8-9b3f-619c8b3e683e</serial>
May 28 01:53:32.668756 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:53:32.668756 np0000001583 nova-compute[98241]: </disk>
May 28 01:53:32.668756 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:53:32.671589 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:32.750519 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:53:32.755953 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:53:32.766492 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:53:32.766492 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:53:32.775950 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:53:32.775950 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:32.786214 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:32.791955 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:32.805373 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:32.805373 np0000001583 nova-compute[98241]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:32.805373 np0000001583 nova-compute[98241]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:32.805373 np0000001583 nova-compute[98241]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3df87c19-1def-4ecd-a64b-3d9b5ce5dff2 (non-flash)
May 28 01:53:32.805373 np0000001583 nova-compute[98241]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e (non-flash)
May 28 01:53:32.805373 np0000001583 nova-compute[98241]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e (non-flash)
May 28 01:53:32.805373 np0000001583 nova-compute[98241]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:32.805373 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:32.805373 np0000001583 nova-compute[98241]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:32.805373 np0000001583 nova-compute[98241]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:32.805373 np0000001583 nova-compute[98241]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:32.805373 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:53:32.805373 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:32.805373 np0000001583 nova-compute[98241]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:32.805373 np0000001583 nova-compute[98241]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:32.805373 np0000001583 nova-compute[98241]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3df87c19-1def-4ecd-a64b-3d9b5ce5dff2 (non-flash)
May 28 01:53:32.805373 np0000001583 nova-compute[98241]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e (non-flash)
May 28 01:53:32.805373 np0000001583 nova-compute[98241]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e (non-flash)
May 28 01:53:32.805373 np0000001583 nova-compute[98241]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:32.805373 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:32.805373 np0000001583 nova-compute[98241]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:32.805373 np0000001583 nova-compute[98241]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:32.805373 np0000001583 nova-compute[98241]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:32.805373 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:53:32.812530 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:32.812530 np0000001583 nova-compute[98241]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:32.812530 np0000001583 nova-compute[98241]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:32.812530 np0000001583 nova-compute[98241]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3df87c19-1def-4ecd-a64b-3d9b5ce5dff2 (non-flash)
May 28 01:53:32.812530 np0000001583 nova-compute[98241]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e (non-flash)
May 28 01:53:32.812530 np0000001583 nova-compute[98241]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e (non-flash)
May 28 01:53:32.812530 np0000001583 nova-compute[98241]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:32.812530 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:32.812530 np0000001583 nova-compute[98241]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:32.812530 np0000001583 nova-compute[98241]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:32.812530 np0000001583 nova-compute[98241]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:32.812530 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:53:32.812841 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:32.812841 np0000001583 nova-compute[98241]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:32.812841 np0000001583 nova-compute[98241]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:32.812841 np0000001583 nova-compute[98241]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3df87c19-1def-4ecd-a64b-3d9b5ce5dff2 (non-flash)
May 28 01:53:32.812841 np0000001583 nova-compute[98241]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e (non-flash)
May 28 01:53:32.812841 np0000001583 nova-compute[98241]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e (non-flash)
May 28 01:53:32.812841 np0000001583 nova-compute[98241]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:32.812841 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:32.812841 np0000001583 nova-compute[98241]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:32.812841 np0000001583 nova-compute[98241]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:32.812841 np0000001583 nova-compute[98241]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:32.812841 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:53:32.825103 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:32.866354 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860, portal: 192.168.50.100,3260]
May 28 01:53:32.866354 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860, portal: 192.168.50.100,3260] successful.
May 28 01:53:32.866354 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:32.875624 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860, portal: 192.168.40.100,3260]
May 28 01:53:32.875624 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860, portal: 192.168.40.100,3260] successful.
May 28 01:53:32.875624 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:32.879246 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:32.892131 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:32.909599 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:32.909599 np0000001583 nova-compute[98241]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:32.909599 np0000001583 nova-compute[98241]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:32.909599 np0000001583 nova-compute[98241]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3df87c19-1def-4ecd-a64b-3d9b5ce5dff2 (non-flash)
May 28 01:53:32.909599 np0000001583 nova-compute[98241]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e (non-flash)
May 28 01:53:32.909599 np0000001583 nova-compute[98241]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e (non-flash)
May 28 01:53:32.909599 np0000001583 nova-compute[98241]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:32.909599 np0000001583 nova-compute[98241]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:32.909599 np0000001583 nova-compute[98241]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:32.909599 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:32.909599 np0000001583 nova-compute[98241]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:32.909599 np0000001583 nova-compute[98241]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:32.909599 np0000001583 nova-compute[98241]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:32.909599 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:53:32.910609 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:32.910609 np0000001583 nova-compute[98241]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:32.910609 np0000001583 nova-compute[98241]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:32.910609 np0000001583 nova-compute[98241]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3df87c19-1def-4ecd-a64b-3d9b5ce5dff2 (non-flash)
May 28 01:53:32.910609 np0000001583 nova-compute[98241]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e (non-flash)
May 28 01:53:32.910609 np0000001583 nova-compute[98241]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e (non-flash)
May 28 01:53:32.910609 np0000001583 nova-compute[98241]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:32.910609 np0000001583 nova-compute[98241]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:32.910609 np0000001583 nova-compute[98241]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:32.910609 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:32.910609 np0000001583 nova-compute[98241]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:32.910609 np0000001583 nova-compute[98241]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:32.910609 np0000001583 nova-compute[98241]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:32.910609 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:53:32.910609 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.196s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:53:32.910609 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:53:32.913673 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] HCTL ('18', '-', '-', 0) found on session 20 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:53:32.913844 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:53:32.914320 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:32.914320 np0000001583 nova-compute[98241]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:32.914320 np0000001583 nova-compute[98241]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:32.914320 np0000001583 nova-compute[98241]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3df87c19-1def-4ecd-a64b-3d9b5ce5dff2 (non-flash)
May 28 01:53:32.914320 np0000001583 nova-compute[98241]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e (non-flash)
May 28 01:53:32.914320 np0000001583 nova-compute[98241]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e (non-flash)
May 28 01:53:32.914320 np0000001583 nova-compute[98241]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:32.914320 np0000001583 nova-compute[98241]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:32.914320 np0000001583 nova-compute[98241]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:32.914320 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:32.914320 np0000001583 nova-compute[98241]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:32.914320 np0000001583 nova-compute[98241]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:32.914320 np0000001583 nova-compute[98241]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:32.914320 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:53:32.916198 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:32.916198 np0000001583 nova-compute[98241]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:32.916198 np0000001583 nova-compute[98241]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:32.916198 np0000001583 nova-compute[98241]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3df87c19-1def-4ecd-a64b-3d9b5ce5dff2 (non-flash)
May 28 01:53:32.916198 np0000001583 nova-compute[98241]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e (non-flash)
May 28 01:53:32.916198 np0000001583 nova-compute[98241]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e (non-flash)
May 28 01:53:32.916198 np0000001583 nova-compute[98241]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:32.916198 np0000001583 nova-compute[98241]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:32.916198 np0000001583 nova-compute[98241]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:32.916198 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:32.916198 np0000001583 nova-compute[98241]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:32.916198 np0000001583 nova-compute[98241]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:32.916198 np0000001583 nova-compute[98241]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:32.916198 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:53:32.916198 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.201s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:53:32.916198 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:53:32.916198 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] HCTL ('19', '-', '-', 0) found on session 21 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:53:32.918890 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:53:32.931643 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Searching for a device in session 20 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:53:32.931643 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd64c94a0-49df-4115-a2f7-19f68645f860', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:53:32.943963 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Searching for a device in session 21 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:53:32.943963 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd64c94a0-49df-4115-a2f7-19f68645f860', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:53:32.949220 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:53:32.955934 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:53:33.008986 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Took 9.01 seconds to spawn the instance on the hypervisor.
May 28 01:53:33.009212 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:53:33.208785 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3f290dc6-d1a7-4a90-bee1-1b41b3d56c9b tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias ua-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e for instance 02b42340-8535-4682-98db-49f970ff5597 {{(pid=98241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 01:53:33.459537 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:53:33.460037 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999694265000016 future=<Future at 0x7724f8459040 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:53:33.460417 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Received event <DeviceRemovedEvent: 1779933213.4601474, 02b42340-8535-4682-98db-49f970ff5597 => ua-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e> from libvirt while the driver is waiting for it; dispatched. {{(pid=98241) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 01:53:33.460888 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.99884487899999 future=<Future at 0x7724f8459040 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:53:33.460975 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.998707319999994 future=<Future at 0x7724f8459040 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:53:33.463099 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-3f290dc6-d1a7-4a90-bee1-1b41b3d56c9b tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Successfully detached device vdb from instance 02b42340-8535-4682-98db-49f970ff5597 from the live domain config.
May 28 01:53:33.463893 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f290dc6-d1a7-4a90-bee1-1b41b3d56c9b tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] [instance: 02b42340-8535-4682-98db-49f970ff5597] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:53:33.464516 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f290dc6-d1a7-4a90-bee1-1b41b3d56c9b tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e', 'iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c073d4e5-9ddf-44f8-9b3f-619c8b3e683e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': False}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:53:33.464516 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-3f290dc6-d1a7-4a90-bee1-1b41b3d56c9b tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:53:33.519713 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Took 14.66 seconds to build instance.
May 28 01:53:33.716170 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:53:34.022159 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "5c36895c-9d2c-49be-b545-3658f535964a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.174s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:34.100736 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0da3fda2-6266-4d6a-a7ba-fbe15d37ee81 req-7b5a349a-7ce5-425b-a5be-4ab1ffad6796 service nova] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Received event network-vif-plugged-fcf662e6-60ad-4e4c-b3da-ce3edf11d15b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:53:34.101279 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0da3fda2-6266-4d6a-a7ba-fbe15d37ee81 req-7b5a349a-7ce5-425b-a5be-4ab1ffad6796 service nova] Acquiring lock "5c36895c-9d2c-49be-b545-3658f535964a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:34.101598 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0da3fda2-6266-4d6a-a7ba-fbe15d37ee81 req-7b5a349a-7ce5-425b-a5be-4ab1ffad6796 service nova] Lock "5c36895c-9d2c-49be-b545-3658f535964a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:34.101736 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0da3fda2-6266-4d6a-a7ba-fbe15d37ee81 req-7b5a349a-7ce5-425b-a5be-4ab1ffad6796 service nova] Lock "5c36895c-9d2c-49be-b545-3658f535964a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:34.101898 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0da3fda2-6266-4d6a-a7ba-fbe15d37ee81 req-7b5a349a-7ce5-425b-a5be-4ab1ffad6796 service nova] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] No waiting events found dispatching network-vif-plugged-fcf662e6-60ad-4e4c-b3da-ce3edf11d15b {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:53:34.102043 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-0da3fda2-6266-4d6a-a7ba-fbe15d37ee81 req-7b5a349a-7ce5-425b-a5be-4ab1ffad6796 service nova] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Received unexpected event network-vif-plugged-fcf662e6-60ad-4e4c-b3da-ce3edf11d15b for instance with vm_state active and task_state None.
May 28 01:53:34.305196 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:53:34.335239 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-1fe559b1-9cc0-4a20-b706-ebcdc73321d4 req-f094b805-0de5-4e29-af63-3a344a65505d service nova] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Received event network-vif-unplugged-6835d977-7c34-4bd7-8d12-208432ea45d3 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:53:34.335463 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-1fe559b1-9cc0-4a20-b706-ebcdc73321d4 req-f094b805-0de5-4e29-af63-3a344a65505d service nova] Acquiring lock "f2805796-e531-4508-8585-0d110f4bd4e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:34.335638 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-1fe559b1-9cc0-4a20-b706-ebcdc73321d4 req-f094b805-0de5-4e29-af63-3a344a65505d service nova] Lock "f2805796-e531-4508-8585-0d110f4bd4e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:34.335803 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-1fe559b1-9cc0-4a20-b706-ebcdc73321d4 req-f094b805-0de5-4e29-af63-3a344a65505d service nova] Lock "f2805796-e531-4508-8585-0d110f4bd4e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:34.335960 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-1fe559b1-9cc0-4a20-b706-ebcdc73321d4 req-f094b805-0de5-4e29-af63-3a344a65505d service nova] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] No waiting events found dispatching network-vif-unplugged-6835d977-7c34-4bd7-8d12-208432ea45d3 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:53:34.336426 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-1fe559b1-9cc0-4a20-b706-ebcdc73321d4 req-f094b805-0de5-4e29-af63-3a344a65505d service nova] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Received unexpected event network-vif-unplugged-6835d977-7c34-4bd7-8d12-208432ea45d3 for instance with vm_state active and task_state rebuilding.
May 28 01:53:34.733069 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Found WWN 3300000005550511b for multipath device dm-9 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:53:34.733500 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:53:34.735061 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] <== connect_volume: return (3036ms) {'type': 'block', 'scsi_wwn': '3300000005550511b', 'path': '/dev/dm-9', 'multipath_id': '3300000005550511b'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:53:34.735061 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000005550511b', 'path': '/dev/dm-9', 'multipath_id': '3300000005550511b'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:53:34.735993 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lazy-loading 'flavor' on Instance uuid 1291c6e1-108e-46d1-85bc-0197f71eec1f {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:53:34.738619 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.369s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:53:34.739011 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9', 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ac79736b-8037-45cb-a9eb-510556b680f9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:53:34.739172 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:53:34.772963 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:34.772963 np0000001583 nova-compute[98241]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:34.772963 np0000001583 nova-compute[98241]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:34.772963 np0000001583 nova-compute[98241]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3df87c19-1def-4ecd-a64b-3d9b5ce5dff2 (non-flash)
May 28 01:53:34.772963 np0000001583 nova-compute[98241]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e (non-flash)
May 28 01:53:34.772963 np0000001583 nova-compute[98241]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e (non-flash)
May 28 01:53:34.772963 np0000001583 nova-compute[98241]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:34.772963 np0000001583 nova-compute[98241]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:34.772963 np0000001583 nova-compute[98241]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:34.772963 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:34.772963 np0000001583 nova-compute[98241]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:34.772963 np0000001583 nova-compute[98241]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:34.772963 np0000001583 nova-compute[98241]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:34.772963 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:53:34.773453 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:34.773453 np0000001583 nova-compute[98241]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:34.773453 np0000001583 nova-compute[98241]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:34.773453 np0000001583 nova-compute[98241]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3df87c19-1def-4ecd-a64b-3d9b5ce5dff2 (non-flash)
May 28 01:53:34.773453 np0000001583 nova-compute[98241]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e (non-flash)
May 28 01:53:34.773453 np0000001583 nova-compute[98241]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e (non-flash)
May 28 01:53:34.773453 np0000001583 nova-compute[98241]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:34.773453 np0000001583 nova-compute[98241]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:34.773453 np0000001583 nova-compute[98241]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:34.773453 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:34.773453 np0000001583 nova-compute[98241]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:34.773453 np0000001583 nova-compute[98241]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:34.773453 np0000001583 nova-compute[98241]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:34.773453 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:53:34.773453 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb', '13'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3df87c19-1def-4ecd-a64b-3d9b5ce5dff2', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8', '5'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8', '6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9', '7'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9', '8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02', '9')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:53:34.774007 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9', '8')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:53:34.774704 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9', '7')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:53:34.775776 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f83d7a60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9'): ({'sdd'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:53:34.776035 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Removing multipathed devices sdd, sde {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:53:34.776581 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Flush multipath device 330000000dd10e4b9 {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:53:34.844003 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:53:34.882727 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:53:34.953638 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:53:34.953904 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:53:34.955238 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:53:34.968577 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:53:34.968903 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:53:34.984225 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:35.026467 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9, portal: 192.168.40.100,3260]
May 28 01:53:35.026467 np0000001583 nova-compute[98241]: Logout of [sid: 8, target: iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9, portal: 192.168.40.100,3260] successful.
May 28 01:53:35.026467 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:35.047868 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:35.062169 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:35.103910 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9, portal: 192.168.50.100,3260]
May 28 01:53:35.103910 np0000001583 nova-compute[98241]: Logout of [sid: 7, target: iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9, portal: 192.168.50.100,3260] successful.
May 28 01:53:35.103910 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:35.125943 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:35.126186 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:53:35.126313 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] <== disconnect_volume: return (2756ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:53:35.126457 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:53:35.126904 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Deleting instance files /opt/stack/data/nova/instances/f2805796-e531-4508-8585-0d110f4bd4e7_del
May 28 01:53:35.127462 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-3f290dc6-d1a7-4a90-bee1-1b41b3d56c9b tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.663s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:53:35.127803 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f290dc6-d1a7-4a90-bee1-1b41b3d56c9b tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e', 'iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c073d4e5-9ddf-44f8-9b3f-619c8b3e683e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:53:35.127968 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f290dc6-d1a7-4a90-bee1-1b41b3d56c9b tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:53:35.128275 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Deletion of /opt/stack/data/nova/instances/f2805796-e531-4508-8585-0d110f4bd4e7_del complete
May 28 01:53:35.165693 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f290dc6-d1a7-4a90-bee1-1b41b3d56c9b tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:35.165693 np0000001583 nova-compute[98241]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:35.165693 np0000001583 nova-compute[98241]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:35.165693 np0000001583 nova-compute[98241]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3df87c19-1def-4ecd-a64b-3d9b5ce5dff2 (non-flash)
May 28 01:53:35.165693 np0000001583 nova-compute[98241]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e (non-flash)
May 28 01:53:35.165693 np0000001583 nova-compute[98241]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e (non-flash)
May 28 01:53:35.165693 np0000001583 nova-compute[98241]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:35.165693 np0000001583 nova-compute[98241]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:35.165693 np0000001583 nova-compute[98241]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:35.165693 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:35.165693 np0000001583 nova-compute[98241]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:35.165693 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:53:35.166170 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f290dc6-d1a7-4a90-bee1-1b41b3d56c9b tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:35.166170 np0000001583 nova-compute[98241]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:35.166170 np0000001583 nova-compute[98241]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:35.166170 np0000001583 nova-compute[98241]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3df87c19-1def-4ecd-a64b-3d9b5ce5dff2 (non-flash)
May 28 01:53:35.166170 np0000001583 nova-compute[98241]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e (non-flash)
May 28 01:53:35.166170 np0000001583 nova-compute[98241]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e (non-flash)
May 28 01:53:35.166170 np0000001583 nova-compute[98241]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:35.166170 np0000001583 nova-compute[98241]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:35.166170 np0000001583 nova-compute[98241]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:35.166170 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:35.166170 np0000001583 nova-compute[98241]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:35.166170 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:53:35.166170 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f290dc6-d1a7-4a90-bee1-1b41b3d56c9b tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb', '13'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3df87c19-1def-4ecd-a64b-3d9b5ce5dff2', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8', '5'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8', '6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02', '9')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:53:35.166543 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f290dc6-d1a7-4a90-bee1-1b41b3d56c9b tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e', '18')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:53:35.167490 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f290dc6-d1a7-4a90-bee1-1b41b3d56c9b tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e', '19')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:53:35.168572 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f290dc6-d1a7-4a90-bee1-1b41b3d56c9b tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f8307560>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e'): ({'sdk'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:53:35.168772 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3f290dc6-d1a7-4a90-bee1-1b41b3d56c9b tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Removing multipathed devices sdl, sdk {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:53:35.169011 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3f290dc6-d1a7-4a90-bee1-1b41b3d56c9b tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Flush multipath device 33000000002692fd1 {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:53:35.206847 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3f290dc6-d1a7-4a90-bee1-1b41b3d56c9b tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:53:35.239235 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Attempting to attach volume d64c94a0-49df-4115-a2f7-19f68645f860 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98241) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 01:53:35.240602 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] attach device xml: <disk type="block" device="disk">
May 28 01:53:35.240602 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:53:35.240602 np0000001583 nova-compute[98241]:   <alias name="ua-d64c94a0-49df-4115-a2f7-19f68645f860"/>
May 28 01:53:35.240602 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-9"/>
May 28 01:53:35.240602 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 01:53:35.240602 np0000001583 nova-compute[98241]:   <serial>d64c94a0-49df-4115-a2f7-19f68645f860</serial>
May 28 01:53:35.240602 np0000001583 nova-compute[98241]:   <shareable/>
May 28 01:53:35.240602 np0000001583 nova-compute[98241]: </disk>
May 28 01:53:35.240602 np0000001583 nova-compute[98241]:  {{(pid=98241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 01:53:35.246053 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3f290dc6-d1a7-4a90-bee1-1b41b3d56c9b tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:53:35.285499 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3f290dc6-d1a7-4a90-bee1-1b41b3d56c9b tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Checking to see if SCSI volumes sdl, sdk have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:53:35.285699 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3f290dc6-d1a7-4a90-bee1-1b41b3d56c9b tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] SCSI volumes sdl, sdk have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:53:35.287440 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3f290dc6-d1a7-4a90-bee1-1b41b3d56c9b tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Checking to see if device paths {'sdl', 'sdk'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:53:35.306516 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3f290dc6-d1a7-4a90-bee1-1b41b3d56c9b tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Device paths {'sdl', 'sdk'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:53:35.306772 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f290dc6-d1a7-4a90-bee1-1b41b3d56c9b tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:53:35.319518 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f290dc6-d1a7-4a90-bee1-1b41b3d56c9b tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:35.359740 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f290dc6-d1a7-4a90-bee1-1b41b3d56c9b tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e, portal: 192.168.40.100,3260]
May 28 01:53:35.359740 np0000001583 nova-compute[98241]: Logout of [sid: 18, target: iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e, portal: 192.168.40.100,3260] successful.
May 28 01:53:35.359740 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:35.380058 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f290dc6-d1a7-4a90-bee1-1b41b3d56c9b tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:35.396021 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f290dc6-d1a7-4a90-bee1-1b41b3d56c9b tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:35.439755 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f290dc6-d1a7-4a90-bee1-1b41b3d56c9b tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e, portal: 192.168.50.100,3260]
May 28 01:53:35.439755 np0000001583 nova-compute[98241]: Logout of [sid: 19, target: iqn.2023-03.storpool.com:os--volume-c073d4e5-9ddf-44f8-9b3f-619c8b3e683e, portal: 192.168.50.100,3260] successful.
May 28 01:53:35.439755 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:35.462008 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f290dc6-d1a7-4a90-bee1-1b41b3d56c9b tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:35.462306 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-3f290dc6-d1a7-4a90-bee1-1b41b3d56c9b tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:53:35.462522 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f290dc6-d1a7-4a90-bee1-1b41b3d56c9b tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] <== disconnect_volume: return (1997ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:53:35.462723 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f290dc6-d1a7-4a90-bee1-1b41b3d56c9b tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] [instance: 02b42340-8535-4682-98db-49f970ff5597] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:53:35.732773 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance f2805796-e531-4508-8585-0d110f4bd4e7 could not be found.
May 28 01:53:35.735737 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:53:35.736151 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9', 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ac79736b-8037-45cb-a9eb-510556b680f9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:53:35.737748 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:53:35.737748 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:53:35.737748 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9', 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ac79736b-8037-45cb-a9eb-510556b680f9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:53:35.737748 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:53:35.769932 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:35.769932 np0000001583 nova-compute[98241]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:35.769932 np0000001583 nova-compute[98241]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:35.769932 np0000001583 nova-compute[98241]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:35.769932 np0000001583 nova-compute[98241]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:35.769932 np0000001583 nova-compute[98241]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:35.769932 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:35.769932 np0000001583 nova-compute[98241]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:35.769932 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:53:35.770311 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:35.770311 np0000001583 nova-compute[98241]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:35.770311 np0000001583 nova-compute[98241]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:35.770311 np0000001583 nova-compute[98241]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:35.770311 np0000001583 nova-compute[98241]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:35.770311 np0000001583 nova-compute[98241]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:35.770311 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:35.770311 np0000001583 nova-compute[98241]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:35.770311 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:53:35.770465 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8', '5'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8', '6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02', '9')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:53:35.770465 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9, 0): [] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:53:35.771200 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9') {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 28 01:53:35.771327 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9, 0): [] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:53:35.771792 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9') {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 28 01:53:35.771792 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f827f380>, {}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:53:35.771792 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Disconnecting from: [] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:53:35.771909 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.035s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:53:35.771996 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] <== disconnect_volume: return (35ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:53:35.772153 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:53:36.028475 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-3f290dc6-d1a7-4a90-bee1-1b41b3d56c9b tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Lazy-loading 'flavor' on Instance uuid 02b42340-8535-4682-98db-49f970ff5597 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:53:36.190572 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-4f70fd9a-fd44-4469-9b44-58edc606dd4a req-6f6cde91-886d-44c0-8425-a937d08057fc service nova] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Received event network-changed-fcf662e6-60ad-4e4c-b3da-ce3edf11d15b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:53:36.191014 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-4f70fd9a-fd44-4469-9b44-58edc606dd4a req-6f6cde91-886d-44c0-8425-a937d08057fc service nova] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Refreshing instance network info cache due to event network-changed-fcf662e6-60ad-4e4c-b3da-ce3edf11d15b. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:53:36.191014 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-4f70fd9a-fd44-4469-9b44-58edc606dd4a req-6f6cde91-886d-44c0-8425-a937d08057fc service nova] Acquiring lock "refresh_cache-5c36895c-9d2c-49be-b545-3658f535964a" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:53:36.191242 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-4f70fd9a-fd44-4469-9b44-58edc606dd4a req-6f6cde91-886d-44c0-8425-a937d08057fc service nova] Acquired lock "refresh_cache-5c36895c-9d2c-49be-b545-3658f535964a" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:53:36.191292 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-4f70fd9a-fd44-4469-9b44-58edc606dd4a req-6f6cde91-886d-44c0-8425-a937d08057fc service nova] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Refreshing network info cache for port fcf662e6-60ad-4e4c-b3da-ce3edf11d15b {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:53:36.693579 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-4f70fd9a-fd44-4469-9b44-58edc606dd4a req-6f6cde91-886d-44c0-8425-a937d08057fc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:53:36.907284 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:53:36.907732 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:53:36.907732 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:53:36.907732 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] No VIF found with MAC fa:16:3e:45:c5:fe, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:53:37.009609 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Preparing to wait for external event volume-reimaged-ac79736b-8037-45cb-a9eb-510556b680f9 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:53:37.009814 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Acquiring lock "f2805796-e531-4508-8585-0d110f4bd4e7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:37.010184 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Lock "f2805796-e531-4508-8585-0d110f4bd4e7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:37.010291 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Lock "f2805796-e531-4508-8585-0d110f4bd4e7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:37.037674 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3f290dc6-d1a7-4a90-bee1-1b41b3d56c9b tempest-VolumesAssistedSnapshotsTest-544466683 tempest-VolumesAssistedSnapshotsTest-544466683-project-admin] Lock "02b42340-8535-4682-98db-49f970ff5597" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.958s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:37.197032 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-4f70fd9a-fd44-4469-9b44-58edc606dd4a req-6f6cde91-886d-44c0-8425-a937d08057fc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:53:37.295562 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-75022dff-efb4-4d23-a2ab-0319a3ac9415 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Acquiring lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:37.295836 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-75022dff-efb4-4d23-a2ab-0319a3ac9415 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:37.296038 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-75022dff-efb4-4d23-a2ab-0319a3ac9415 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Shelving
May 28 01:53:37.362245 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-4f70fd9a-fd44-4469-9b44-58edc606dd4a req-6f6cde91-886d-44c0-8425-a937d08057fc service nova] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Updated VIF entry in instance network info cache for port fcf662e6-60ad-4e4c-b3da-ce3edf11d15b. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:53:37.362859 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:37.363249 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-4f70fd9a-fd44-4469-9b44-58edc606dd4a req-6f6cde91-886d-44c0-8425-a937d08057fc service nova] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Updating instance_info_cache with network_info: [{"id": "fcf662e6-60ad-4e4c-b3da-ce3edf11d15b", "address": "fa:16:3e:63:2b:b1", "network": {"id": "b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-280876007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60fbdf5ed38b4dc485a81c49b3303ed2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf662e6-60", "ovs_interfaceid": "fcf662e6-60ad-4e4c-b3da-ce3edf11d15b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:53:37.825242 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:37.867594 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-4f70fd9a-fd44-4469-9b44-58edc606dd4a req-6f6cde91-886d-44c0-8425-a937d08057fc service nova] Releasing lock "refresh_cache-5c36895c-9d2c-49be-b545-3658f535964a" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:53:38.339405 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:38.345689 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:38.372049 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:38.401024 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:38.401985 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:38.498629 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-aa4f940f-c990-4ae1-b68e-75f5461eb31a tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "1291c6e1-108e-46d1-85bc-0197f71eec1f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.520s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:38.593597 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Acquiring lock "bad69594-f163-41a6-931f-d2fcda0cb7d1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:38.594431 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "bad69594-f163-41a6-931f-d2fcda0cb7d1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:38.643154 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-bceec53f-4bbf-4d1e-b5de-4ed49527a96e req-618cb327-1e19-472b-bf17-eb2db6406afb service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Received event network-vif-unplugged-828d441a-570b-4f98-b093-4eb521ee2cf8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:53:38.643154 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bceec53f-4bbf-4d1e-b5de-4ed49527a96e req-618cb327-1e19-472b-bf17-eb2db6406afb service nova] Acquiring lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:38.643154 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bceec53f-4bbf-4d1e-b5de-4ed49527a96e req-618cb327-1e19-472b-bf17-eb2db6406afb service nova] Lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:38.643154 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bceec53f-4bbf-4d1e-b5de-4ed49527a96e req-618cb327-1e19-472b-bf17-eb2db6406afb service nova] Lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:38.643154 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-bceec53f-4bbf-4d1e-b5de-4ed49527a96e req-618cb327-1e19-472b-bf17-eb2db6406afb service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] No waiting events found dispatching network-vif-unplugged-828d441a-570b-4f98-b093-4eb521ee2cf8 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:53:38.643154 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-bceec53f-4bbf-4d1e-b5de-4ed49527a96e req-618cb327-1e19-472b-bf17-eb2db6406afb service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Received unexpected event network-vif-unplugged-828d441a-570b-4f98-b093-4eb521ee2cf8 for instance with vm_state active and task_state shelving.
May 28 01:53:38.657260 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:38.669446 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:38.695331 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999698233000117 future=<Future at 0x7724f831b980 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:53:38.697943 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Instance destroyed successfully.
May 28 01:53:38.699319 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-75022dff-efb4-4d23-a2ab-0319a3ac9415 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lazy-loading 'numa_topology' on Instance uuid adfbfdf0-7c0f-4834-92ff-3b8d8c39e333 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:53:38.718126 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-eb81bc86-d418-4575-a6ef-832af7392d17 tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Acquiring lock "02b42340-8535-4682-98db-49f970ff5597" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:38.718126 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-eb81bc86-d418-4575-a6ef-832af7392d17 tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Lock "02b42340-8535-4682-98db-49f970ff5597" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:38.718424 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-eb81bc86-d418-4575-a6ef-832af7392d17 tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Acquiring lock "02b42340-8535-4682-98db-49f970ff5597-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:38.718590 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-eb81bc86-d418-4575-a6ef-832af7392d17 tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Lock "02b42340-8535-4682-98db-49f970ff5597-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:38.718750 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-eb81bc86-d418-4575-a6ef-832af7392d17 tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Lock "02b42340-8535-4682-98db-49f970ff5597-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:38.721175 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-eb81bc86-d418-4575-a6ef-832af7392d17 tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] [instance: 02b42340-8535-4682-98db-49f970ff5597] Terminating instance
May 28 01:53:39.091431 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Acquiring lock "e73ac672-0911-4e4d-8a85-9b635a9e836f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:39.091628 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Lock "e73ac672-0911-4e4d-8a85-9b635a9e836f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:39.103564 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lazy-loading 'flavor' on Instance uuid bad69594-f163-41a6-931f-d2fcda0cb7d1 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:53:39.227614 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-eb81bc86-d418-4575-a6ef-832af7392d17 tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] [instance: 02b42340-8535-4682-98db-49f970ff5597] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:53:39.259338 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:39.280588 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:39.288694 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:39.320395 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:39.352771 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-75022dff-efb4-4d23-a2ab-0319a3ac9415 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Beginning cold snapshot process
May 28 01:53:39.579319 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999636796999994 future=<Future at 0x7724f844ffe0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:53:39.583302 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 02b42340-8535-4682-98db-49f970ff5597] Instance destroyed successfully.
May 28 01:53:39.583840 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-eb81bc86-d418-4575-a6ef-832af7392d17 tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Lazy-loading 'resources' on Instance uuid 02b42340-8535-4682-98db-49f970ff5597 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:53:39.593541 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:53:40.087540 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-eb81bc86-d418-4575-a6ef-832af7392d17 tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:51:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1927554545',display_name='tempest-VolumesAssistedSnapshotsTest-server-1927554545',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-volumesassistedsnapshotstest-server-1927554545',id=3,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH1ORm2bAC9pSCTpqpq7/6dHWgWHkyWvTbf7nsO5W9cbBimklfTaLLCh0LO3WyPmGHgBJdATEdQsWMtaZ6MmaEfH+7e9mN1r4DAQ/4Ii2Cqci/tTUM79p8JHrbTb/CvUcg==',key_name='tempest-keypair-29474514',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:52:41Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='43c294dcbfc5459898bb040ccdf1b52f',ramdisk_id='',reservation_id='r-yxkej6ix',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-167698526',owner_user_name='tempest-VolumesAssistedSnapshotsTest-167698526-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:52:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6397db19b6ed41699a9dce1a95a8471a',uuid=02b42340-8535-4682-98db-49f970ff5597,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ac172e4-b81e-4014-bb42-bb91fe781adf", "address": "fa:16:3e:f4:4b:8c", "network": {"id": "f0cd4ecd-6ce5-4118-a161-0bc234bc71f7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1347979747-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "43c294dcbfc5459898bb040ccdf1b52f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac172e4-b8", "ovs_interfaceid": "0ac172e4-b81e-4014-bb42-bb91fe781adf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:53:40.087540 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-eb81bc86-d418-4575-a6ef-832af7392d17 tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Converting VIF {"id": "0ac172e4-b81e-4014-bb42-bb91fe781adf", "address": "fa:16:3e:f4:4b:8c", "network": {"id": "f0cd4ecd-6ce5-4118-a161-0bc234bc71f7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1347979747-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "43c294dcbfc5459898bb040ccdf1b52f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac172e4-b8", "ovs_interfaceid": "0ac172e4-b81e-4014-bb42-bb91fe781adf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:53:40.088034 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-eb81bc86-d418-4575-a6ef-832af7392d17 tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:4b:8c,bridge_name='br-int',has_traffic_filtering=True,id=0ac172e4-b81e-4014-bb42-bb91fe781adf,network=Network(f0cd4ecd-6ce5-4118-a161-0bc234bc71f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ac172e4-b8') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:53:40.088282 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-eb81bc86-d418-4575-a6ef-832af7392d17 tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:4b:8c,bridge_name='br-int',has_traffic_filtering=True,id=0ac172e4-b81e-4014-bb42-bb91fe781adf,network=Network(f0cd4ecd-6ce5-4118-a161-0bc234bc71f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ac172e4-b8') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:53:40.089325 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:40.091610 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ac172e4-b8, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:53:40.091610 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:40.091610 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:53:40.099137 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:40.102178 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:40.102411 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b2843d80-6179-4e43-8db7-a0d0965237ea) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:53:40.103225 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:40.103691 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:53:40.109804 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:40.112272 np0000001583 nova-compute[98241]: INFO os_vif [None req-eb81bc86-d418-4575-a6ef-832af7392d17 tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:4b:8c,bridge_name='br-int',has_traffic_filtering=True,id=0ac172e4-b81e-4014-bb42-bb91fe781adf,network=Network(f0cd4ecd-6ce5-4118-a161-0bc234bc71f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ac172e4-b8')
May 28 01:53:40.112684 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-eb81bc86-d418-4575-a6ef-832af7392d17 tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] [instance: 02b42340-8535-4682-98db-49f970ff5597] Deleting instance files /opt/stack/data/nova/instances/02b42340-8535-4682-98db-49f970ff5597_del
May 28 01:53:40.113233 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-eb81bc86-d418-4575-a6ef-832af7392d17 tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] [instance: 02b42340-8535-4682-98db-49f970ff5597] Deletion of /opt/stack/data/nova/instances/02b42340-8535-4682-98db-49f970ff5597_del complete
May 28 01:53:40.126990 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "bad69594-f163-41a6-931f-d2fcda0cb7d1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.533s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:40.155035 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:40.155702 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:40.159823 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:53:40.159823 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Claim successful on node np0000001583
May 28 01:53:40.619446 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-eb81bc86-d418-4575-a6ef-832af7392d17 tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] [instance: 02b42340-8535-4682-98db-49f970ff5597] Took 1.39 seconds to destroy the instance on the hypervisor.
May 28 01:53:40.620483 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-eb81bc86-d418-4575-a6ef-832af7392d17 tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:53:40.622131 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: 02b42340-8535-4682-98db-49f970ff5597] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:53:40.622131 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 02b42340-8535-4682-98db-49f970ff5597] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:53:40.622131 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:53:40.715235 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:53:40.730168 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5e389b2e-4af1-4fe9-9ae6-0cdf36894602 req-bb932b71-7fd0-47ed-8cd5-1075aad152d2 service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Received event network-vif-unplugged-828d441a-570b-4f98-b093-4eb521ee2cf8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:53:40.730358 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5e389b2e-4af1-4fe9-9ae6-0cdf36894602 req-bb932b71-7fd0-47ed-8cd5-1075aad152d2 service nova] Acquiring lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:40.730513 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5e389b2e-4af1-4fe9-9ae6-0cdf36894602 req-bb932b71-7fd0-47ed-8cd5-1075aad152d2 service nova] Lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:40.730583 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5e389b2e-4af1-4fe9-9ae6-0cdf36894602 req-bb932b71-7fd0-47ed-8cd5-1075aad152d2 service nova] Lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:40.731058 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5e389b2e-4af1-4fe9-9ae6-0cdf36894602 req-bb932b71-7fd0-47ed-8cd5-1075aad152d2 service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] No waiting events found dispatching network-vif-unplugged-828d441a-570b-4f98-b093-4eb521ee2cf8 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:53:40.731234 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-5e389b2e-4af1-4fe9-9ae6-0cdf36894602 req-bb932b71-7fd0-47ed-8cd5-1075aad152d2 service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Received unexpected event network-vif-unplugged-828d441a-570b-4f98-b093-4eb521ee2cf8 for instance with vm_state active and task_state shelving_image_pending_upload.
May 28 01:53:40.731341 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5e389b2e-4af1-4fe9-9ae6-0cdf36894602 req-bb932b71-7fd0-47ed-8cd5-1075aad152d2 service nova] [instance: 02b42340-8535-4682-98db-49f970ff5597] Received event network-vif-unplugged-0ac172e4-b81e-4014-bb42-bb91fe781adf {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:53:40.731491 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5e389b2e-4af1-4fe9-9ae6-0cdf36894602 req-bb932b71-7fd0-47ed-8cd5-1075aad152d2 service nova] Acquiring lock "02b42340-8535-4682-98db-49f970ff5597-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:40.731634 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5e389b2e-4af1-4fe9-9ae6-0cdf36894602 req-bb932b71-7fd0-47ed-8cd5-1075aad152d2 service nova] Lock "02b42340-8535-4682-98db-49f970ff5597-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:40.732172 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5e389b2e-4af1-4fe9-9ae6-0cdf36894602 req-bb932b71-7fd0-47ed-8cd5-1075aad152d2 service nova] Lock "02b42340-8535-4682-98db-49f970ff5597-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:40.732172 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5e389b2e-4af1-4fe9-9ae6-0cdf36894602 req-bb932b71-7fd0-47ed-8cd5-1075aad152d2 service nova] [instance: 02b42340-8535-4682-98db-49f970ff5597] No waiting events found dispatching network-vif-unplugged-0ac172e4-b81e-4014-bb42-bb91fe781adf {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:53:40.732172 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5e389b2e-4af1-4fe9-9ae6-0cdf36894602 req-bb932b71-7fd0-47ed-8cd5-1075aad152d2 service nova] [instance: 02b42340-8535-4682-98db-49f970ff5597] Received event network-vif-unplugged-0ac172e4-b81e-4014-bb42-bb91fe781adf for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:53:40.732314 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5e389b2e-4af1-4fe9-9ae6-0cdf36894602 req-bb932b71-7fd0-47ed-8cd5-1075aad152d2 service nova] [instance: 02b42340-8535-4682-98db-49f970ff5597] Received event network-vif-unplugged-0ac172e4-b81e-4014-bb42-bb91fe781adf {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:53:40.732453 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5e389b2e-4af1-4fe9-9ae6-0cdf36894602 req-bb932b71-7fd0-47ed-8cd5-1075aad152d2 service nova] Acquiring lock "02b42340-8535-4682-98db-49f970ff5597-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:40.732629 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5e389b2e-4af1-4fe9-9ae6-0cdf36894602 req-bb932b71-7fd0-47ed-8cd5-1075aad152d2 service nova] Lock "02b42340-8535-4682-98db-49f970ff5597-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:40.733225 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5e389b2e-4af1-4fe9-9ae6-0cdf36894602 req-bb932b71-7fd0-47ed-8cd5-1075aad152d2 service nova] Lock "02b42340-8535-4682-98db-49f970ff5597-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:40.733341 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5e389b2e-4af1-4fe9-9ae6-0cdf36894602 req-bb932b71-7fd0-47ed-8cd5-1075aad152d2 service nova] [instance: 02b42340-8535-4682-98db-49f970ff5597] No waiting events found dispatching network-vif-unplugged-0ac172e4-b81e-4014-bb42-bb91fe781adf {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:53:40.733479 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5e389b2e-4af1-4fe9-9ae6-0cdf36894602 req-bb932b71-7fd0-47ed-8cd5-1075aad152d2 service nova] [instance: 02b42340-8535-4682-98db-49f970ff5597] Received event network-vif-unplugged-0ac172e4-b81e-4014-bb42-bb91fe781adf for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:53:40.870461 np0000001583 nova-compute[98241]: DEBUG nova.privsep.utils [None req-75022dff-efb4-4d23-a2ab-0319a3ac9415 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98241) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 01:53:40.870927 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-75022dff-efb4-4d23-a2ab-0319a3ac9415 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/adfbfdf0-7c0f-4834-92ff-3b8d8c39e333/disk /opt/stack/data/nova/instances/snapshots/tmpmic6vdmn/2909737f47524d8db925e5ef14e347e4 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:53:41.206603 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-75022dff-efb4-4d23-a2ab-0319a3ac9415 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/adfbfdf0-7c0f-4834-92ff-3b8d8c39e333/disk /opt/stack/data/nova/instances/snapshots/tmpmic6vdmn/2909737f47524d8db925e5ef14e347e4" returned: 0 in 0.335s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:53:41.207665 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Acquiring lock "bad69594-f163-41a6-931f-d2fcda0cb7d1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:41.207983 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "bad69594-f163-41a6-931f-d2fcda0cb7d1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:41.208203 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Attaching volume d64c94a0-49df-4115-a2f7-19f68645f860 to /dev/vdb
May 28 01:53:41.209562 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-75022dff-efb4-4d23-a2ab-0319a3ac9415 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Snapshot extracted, beginning image upload
May 28 01:53:41.293631 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:53:41.308417 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:53:41.333345 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:53:41.384769 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:53:41.385909 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:53:41.401147 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:53:41.401147 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe45:c5fe', 'fe80::e05c:5bff:fea5:7965', 'fe80::fc16:3eff:fe52:6a', 'fe80::fc16:3eff:fe54:8727', 'fe80::fc16:3eff:feab:fdca', 'fe80::e4ee:48ff:fe05:5865', 'fe80::fc16:3eff:fe18:87d6', 'fe80::fc16:3eff:fe9a:c8f6', 'fe80::fc16:3eff:feba:70ee', 'fe80::fc16:3eff:fe1d:f8b7', 'fe80::4890:45ff:fee9:3b86', 'fe80::fc16:3eff:fecb:ffdf', 'fe80::f413:99ff:fea1:4341', 'fe80::fc16:3eff:fe63:2bb1', 'fe80::e43a:d5ff:fecc:27fe'] 
May 28 01:53:41.401147 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:53:41.401147 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:53:41.402291 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:53:41.402981 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Updating existing volume attachment record: d75c5e0c-ab44-48fb-b145-059bac9e6ad1 {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:53:41.549049 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-cddeb98b-1fab-47c4-819b-943e8490090e req-f8953323-c135-4bcb-8995-f621e28cf059 service nova] [instance: 02b42340-8535-4682-98db-49f970ff5597] Received event network-vif-deleted-0ac172e4-b81e-4014-bb42-bb91fe781adf {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:53:41.549297 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-cddeb98b-1fab-47c4-819b-943e8490090e req-f8953323-c135-4bcb-8995-f621e28cf059 service nova] [instance: 02b42340-8535-4682-98db-49f970ff5597] Neutron deleted interface 0ac172e4-b81e-4014-bb42-bb91fe781adf; detaching it from the instance and deleting it from the info cache
May 28 01:53:41.552302 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-cddeb98b-1fab-47c4-819b-943e8490090e req-f8953323-c135-4bcb-8995-f621e28cf059 service nova] [instance: 02b42340-8535-4682-98db-49f970ff5597] Detach interface failed, port_id=0ac172e4-b81e-4014-bb42-bb91fe781adf, reason: Instance 02b42340-8535-4682-98db-49f970ff5597 could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:53:41.823481 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:53:41.823481 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:53:41.964161 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 02b42340-8535-4682-98db-49f970ff5597] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:53:41.984941 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:53:41.985962 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860', 'iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd64c94a0-49df-4115-a2f7-19f68645f860', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:53:41.986178 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:53:41.986692 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:53:41.986976 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860', 'iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd64c94a0-49df-4115-a2f7-19f68645f860', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:53:42.002107 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:53:42.002951 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:53:42.004048 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:53:42.004363 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:53:42.005061 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:53:42.005429 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: node.startup = automatic
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: node.session.scan = manual
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:53:42.020331 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:53:42.020331 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: node.startup = automatic
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: node.session.scan = manual
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:53:42.027605 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:53:42.027605 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:42.034485 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:42.045106 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:42.058862 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:42.058862 np0000001583 nova-compute[98241]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:42.058862 np0000001583 nova-compute[98241]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:42.058862 np0000001583 nova-compute[98241]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:42.058862 np0000001583 nova-compute[98241]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:42.058862 np0000001583 nova-compute[98241]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:42.058862 np0000001583 nova-compute[98241]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:42.058862 np0000001583 nova-compute[98241]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:42.058862 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:42.058862 np0000001583 nova-compute[98241]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:42.058862 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:53:42.059178 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:42.059178 np0000001583 nova-compute[98241]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:42.059178 np0000001583 nova-compute[98241]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:42.059178 np0000001583 nova-compute[98241]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:42.059178 np0000001583 nova-compute[98241]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:42.059178 np0000001583 nova-compute[98241]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:42.059178 np0000001583 nova-compute[98241]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:42.059178 np0000001583 nova-compute[98241]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:42.059178 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:42.059178 np0000001583 nova-compute[98241]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:42.059178 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:53:42.059826 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.056s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:53:42.059826 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:53:42.060725 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] HCTL ('19', '0', '0', 0) found on session 21 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:53:42.060866 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Scanning host 19 c: 0, t: 0, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:53:42.062330 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:42.062330 np0000001583 nova-compute[98241]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:42.062330 np0000001583 nova-compute[98241]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:42.062330 np0000001583 nova-compute[98241]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:42.062330 np0000001583 nova-compute[98241]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:42.062330 np0000001583 nova-compute[98241]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:42.062330 np0000001583 nova-compute[98241]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:42.062330 np0000001583 nova-compute[98241]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:42.062330 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:42.062330 np0000001583 nova-compute[98241]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:42.062330 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:53:42.062695 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:42.062695 np0000001583 nova-compute[98241]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:42.062695 np0000001583 nova-compute[98241]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:42.062695 np0000001583 nova-compute[98241]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:42.062695 np0000001583 nova-compute[98241]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:42.062695 np0000001583 nova-compute[98241]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:42.062695 np0000001583 nova-compute[98241]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:42.062695 np0000001583 nova-compute[98241]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:42.062695 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:42.062695 np0000001583 nova-compute[98241]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:42.062695 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:53:42.063055 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.058s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:53:42.063055 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:53:42.063525 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] HCTL ('18', '0', '0', 0) found on session 20 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:53:42.063525 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Scanning host 18 c: 0, t: 0, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:53:42.073691 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Searching for a device in session 21 and hctl ('19', '0', '0', 0) yield: sdn {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:53:42.076719 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd64c94a0-49df-4115-a2f7-19f68645f860', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:53:42.079405 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Searching for a device in session 20 and hctl ('18', '0', '0', 0) yield: sdm {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:53:42.079570 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd64c94a0-49df-4115-a2f7-19f68645f860', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:53:42.327750 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:53:42.470773 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: 02b42340-8535-4682-98db-49f970ff5597] Took 1.85 seconds to deallocate network for instance.
May 28 01:53:42.830468 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:42.839448 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.684s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:42.840232 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:53:42.986347 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-eb81bc86-d418-4575-a6ef-832af7392d17 tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:42.986561 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-eb81bc86-d418-4575-a6ef-832af7392d17 tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:43.004867 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:53:43.346931 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:53:43.348044 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:53:43.348471 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:53:43.348856 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:53:43.573491 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-eb81bc86-d418-4575-a6ef-832af7392d17 tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:53:43.573491 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-eb81bc86-d418-4575-a6ef-832af7392d17 tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:53:43.849294 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:53:44.028518 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Found WWN 3300000005550511b for multipath device dm-9 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:53:44.031870 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.042s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:53:44.031870 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] <== connect_volume: return (2043ms) {'type': 'block', 'scsi_wwn': '3300000005550511b', 'path': '/dev/dm-9', 'multipath_id': '3300000005550511b'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:53:44.031870 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000005550511b', 'path': '/dev/dm-9', 'multipath_id': '3300000005550511b'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:53:44.031870 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lazy-loading 'flavor' on Instance uuid bad69594-f163-41a6-931f-d2fcda0cb7d1 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:53:44.076909 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-eb81bc86-d418-4575-a6ef-832af7392d17 tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:53:44.086877 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8df1e628989946dbafa89116b196c65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ba6b7c1fd84a7c8ed4e9f086f83fa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:53:44.355043 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:53:44.394736 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-75022dff-efb4-4d23-a2ab-0319a3ac9415 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Snapshot image upload complete
May 28 01:53:44.395223 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-75022dff-efb4-4d23-a2ab-0319a3ac9415 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:53:44.535182 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Attempting to attach volume d64c94a0-49df-4115-a2f7-19f68645f860 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98241) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 01:53:44.536595 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] attach device xml: <disk type="block" device="disk">
May 28 01:53:44.536595 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:53:44.536595 np0000001583 nova-compute[98241]:   <alias name="ua-d64c94a0-49df-4115-a2f7-19f68645f860"/>
May 28 01:53:44.536595 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-9"/>
May 28 01:53:44.536595 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 01:53:44.536595 np0000001583 nova-compute[98241]:   <serial>d64c94a0-49df-4115-a2f7-19f68645f860</serial>
May 28 01:53:44.536595 np0000001583 nova-compute[98241]:   <shareable/>
May 28 01:53:44.536595 np0000001583 nova-compute[98241]: </disk>
May 28 01:53:44.536595 np0000001583 nova-compute[98241]:  {{(pid=98241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 01:53:44.594104 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-eb81bc86-d418-4575-a6ef-832af7392d17 tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.605s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:44.670736 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-eb81bc86-d418-4575-a6ef-832af7392d17 tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Deleted allocations for instance 02b42340-8535-4682-98db-49f970ff5597
May 28 01:53:44.733000 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Successfully created port: ae1eb56b-d3c2-441b-9339-b2d96192924c {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:53:44.906821 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-75022dff-efb4-4d23-a2ab-0319a3ac9415 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Shelve offloading
May 28 01:53:45.103794 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:45.372289 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:53:45.373530 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:53:45.373864 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Creating image(s)
May 28 01:53:45.374900 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Acquiring lock "/opt/stack/data/nova/instances/e73ac672-0911-4e4d-8a85-9b635a9e836f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:45.375483 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Lock "/opt/stack/data/nova/instances/e73ac672-0911-4e4d-8a85-9b635a9e836f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:45.376271 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Lock "/opt/stack/data/nova/instances/e73ac672-0911-4e4d-8a85-9b635a9e836f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:45.377176 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:53:45.381894 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:53:45.384291 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:53:45.424738 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Instance destroyed successfully.
May 28 01:53:45.425283 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-75022dff-efb4-4d23-a2ab-0319a3ac9415 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:53:45.427141 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-75022dff-efb4-4d23-a2ab-0319a3ac9415 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Acquiring lock "refresh_cache-adfbfdf0-7c0f-4834-92ff-3b8d8c39e333" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:53:45.427281 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-75022dff-efb4-4d23-a2ab-0319a3ac9415 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Acquired lock "refresh_cache-adfbfdf0-7c0f-4834-92ff-3b8d8c39e333" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:53:45.427437 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-75022dff-efb4-4d23-a2ab-0319a3ac9415 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:53:45.481326 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.097s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:53:45.481326 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:45.481575 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:45.482287 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:53:45.485619 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:53:45.486039 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:53:45.520931 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Successfully updated port: ae1eb56b-d3c2-441b-9339-b2d96192924c {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:53:45.590304 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7400dbdd-eceb-4d77-9508-bf05cb35bbb4 req-5acf1a51-aa37-4cf1-ad3e-e703860511f4 service nova] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Received event network-changed-ae1eb56b-d3c2-441b-9339-b2d96192924c {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:53:45.591805 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7400dbdd-eceb-4d77-9508-bf05cb35bbb4 req-5acf1a51-aa37-4cf1-ad3e-e703860511f4 service nova] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Refreshing instance network info cache due to event network-changed-ae1eb56b-d3c2-441b-9339-b2d96192924c. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:53:45.592118 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7400dbdd-eceb-4d77-9508-bf05cb35bbb4 req-5acf1a51-aa37-4cf1-ad3e-e703860511f4 service nova] Acquiring lock "refresh_cache-e73ac672-0911-4e4d-8a85-9b635a9e836f" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:53:45.592207 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7400dbdd-eceb-4d77-9508-bf05cb35bbb4 req-5acf1a51-aa37-4cf1-ad3e-e703860511f4 service nova] Acquired lock "refresh_cache-e73ac672-0911-4e4d-8a85-9b635a9e836f" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:53:45.592476 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-7400dbdd-eceb-4d77-9508-bf05cb35bbb4 req-5acf1a51-aa37-4cf1-ad3e-e703860511f4 service nova] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Refreshing network info cache for port ae1eb56b-d3c2-441b-9339-b2d96192924c {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:53:45.595482 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.109s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:53:45.597019 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/e73ac672-0911-4e4d-8a85-9b635a9e836f/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:53:45.643581 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/e73ac672-0911-4e4d-8a85-9b635a9e836f/disk 1073741824" returned: 0 in 0.046s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:53:45.643799 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.162s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:45.644194 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:53:45.686186 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-eb81bc86-d418-4575-a6ef-832af7392d17 tempest-VolumesAssistedSnapshotsTest-167698526 tempest-VolumesAssistedSnapshotsTest-167698526-project-member] Lock "02b42340-8535-4682-98db-49f970ff5597" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.968s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:45.739808 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.096s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:53:45.740731 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e73ac672-0911-4e4d-8a85-9b635a9e836f/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:53:45.740731 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e73ac672-0911-4e4d-8a85-9b635a9e836f/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:53:45.827726 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e73ac672-0911-4e4d-8a85-9b635a9e836f/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:53:45.827726 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Cannot resize image /opt/stack/data/nova/instances/e73ac672-0911-4e4d-8a85-9b635a9e836f/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:53:45.828204 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:53:45.828463 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Ensure instance console log exists: /opt/stack/data/nova/instances/e73ac672-0911-4e4d-8a85-9b635a9e836f/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:53:45.828792 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:45.829133 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:45.829379 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:45.931813 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-75022dff-efb4-4d23-a2ab-0319a3ac9415 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:53:46.029599 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Acquiring lock "refresh_cache-e73ac672-0911-4e4d-8a85-9b635a9e836f" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:53:46.080486 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Acquiring lock "d3a7c39a-f946-496d-9153-0a422e7f5350" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:46.080678 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:46.080898 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Acquiring lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:46.081035 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:46.081173 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:46.085816 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Terminating instance
May 28 01:53:46.097702 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-7400dbdd-eceb-4d77-9508-bf05cb35bbb4 req-5acf1a51-aa37-4cf1-ad3e-e703860511f4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:53:46.227824 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-7400dbdd-eceb-4d77-9508-bf05cb35bbb4 req-5acf1a51-aa37-4cf1-ad3e-e703860511f4 service nova] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:53:46.244389 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:53:46.244389 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:53:46.244389 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:53:46.244389 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] No VIF found with MAC fa:16:3e:52:00:6a, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:53:46.382826 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-75022dff-efb4-4d23-a2ab-0319a3ac9415 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:53:46.535396 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-7400dbdd-eceb-4d77-9508-bf05cb35bbb4 req-5acf1a51-aa37-4cf1-ad3e-e703860511f4 service nova] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:53:46.592812 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:53:46.626484 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:46.631531 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:46.661526 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:46.670197 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:46.691260 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:46.719015 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:46.765697 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-75022dff-efb4-4d23-a2ab-0319a3ac9415 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Updating instance_info_cache with network_info: [{"id": "828d441a-570b-4f98-b093-4eb521ee2cf8", "address": "fa:16:3e:f5:ed:7d", "network": {"id": "34ab0ff0-75dd-45e7-97f6-22f8e62a8149", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1222751470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d31342458ec4ed2890a766f62facbcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap828d441a-57", "ovs_interfaceid": "828d441a-570b-4f98-b093-4eb521ee2cf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:53:46.808291 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:46.813953 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:46.820340 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:46.826642 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-fa74dcda-98fe-45a4-8ec3-fce12948906b req-23e70f16-84db-4463-86d8-79e6288153a7 service nova] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Received event volume-reimaged-ac79736b-8037-45cb-a9eb-510556b680f9 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:53:46.828343 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-fa74dcda-98fe-45a4-8ec3-fce12948906b req-23e70f16-84db-4463-86d8-79e6288153a7 service nova] Acquiring lock "f2805796-e531-4508-8585-0d110f4bd4e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:46.828343 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-fa74dcda-98fe-45a4-8ec3-fce12948906b req-23e70f16-84db-4463-86d8-79e6288153a7 service nova] Lock "f2805796-e531-4508-8585-0d110f4bd4e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:46.828343 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-fa74dcda-98fe-45a4-8ec3-fce12948906b req-23e70f16-84db-4463-86d8-79e6288153a7 service nova] Lock "f2805796-e531-4508-8585-0d110f4bd4e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:46.828343 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-fa74dcda-98fe-45a4-8ec3-fce12948906b req-23e70f16-84db-4463-86d8-79e6288153a7 service nova] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Processing event volume-reimaged-ac79736b-8037-45cb-a9eb-510556b680f9 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:53:46.830070 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Instance event wait completed in 9 seconds for volume-reimaged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:53:46.911887 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:46.926029 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:46.932915 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:46.949578 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-6795a34b-0788-4e05-9bb6-5edb95295644 req-5c0473fb-e4af-437b-88dd-f200a6deff56 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-vif-unplugged-0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:53:46.951025 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-6795a34b-0788-4e05-9bb6-5edb95295644 req-5c0473fb-e4af-437b-88dd-f200a6deff56 service nova] Acquiring lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:46.951302 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-6795a34b-0788-4e05-9bb6-5edb95295644 req-5c0473fb-e4af-437b-88dd-f200a6deff56 service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:46.951903 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-6795a34b-0788-4e05-9bb6-5edb95295644 req-5c0473fb-e4af-437b-88dd-f200a6deff56 service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:46.951903 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-6795a34b-0788-4e05-9bb6-5edb95295644 req-5c0473fb-e4af-437b-88dd-f200a6deff56 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] No waiting events found dispatching network-vif-unplugged-0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:53:46.952123 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-6795a34b-0788-4e05-9bb6-5edb95295644 req-5c0473fb-e4af-437b-88dd-f200a6deff56 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-vif-unplugged-0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:53:46.977506 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:46.980291 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:47.003047 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:47.037655 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7400dbdd-eceb-4d77-9508-bf05cb35bbb4 req-5acf1a51-aa37-4cf1-ad3e-e703860511f4 service nova] Releasing lock "refresh_cache-e73ac672-0911-4e4d-8a85-9b635a9e836f" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:53:47.038787 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Acquired lock "refresh_cache-e73ac672-0911-4e4d-8a85-9b635a9e836f" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:53:47.038787 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:53:47.075065 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:47.107715 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:47.155452 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:47.160896 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9a4aeb65-06ab-4c0a-8d8e-b3b0904d5823 req-a5ae10bf-dd3a-4d76-844a-517659f3ff9b service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-vif-unplugged-3d994306-44d7-4407-94eb-49b142832ffc {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:53:47.161375 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9a4aeb65-06ab-4c0a-8d8e-b3b0904d5823 req-a5ae10bf-dd3a-4d76-844a-517659f3ff9b service nova] Acquiring lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:47.161375 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9a4aeb65-06ab-4c0a-8d8e-b3b0904d5823 req-a5ae10bf-dd3a-4d76-844a-517659f3ff9b service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:47.161721 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9a4aeb65-06ab-4c0a-8d8e-b3b0904d5823 req-a5ae10bf-dd3a-4d76-844a-517659f3ff9b service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:47.161721 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9a4aeb65-06ab-4c0a-8d8e-b3b0904d5823 req-a5ae10bf-dd3a-4d76-844a-517659f3ff9b service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] No waiting events found dispatching network-vif-unplugged-3d994306-44d7-4407-94eb-49b142832ffc {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:53:47.162805 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9a4aeb65-06ab-4c0a-8d8e-b3b0904d5823 req-a5ae10bf-dd3a-4d76-844a-517659f3ff9b service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-vif-unplugged-3d994306-44d7-4407-94eb-49b142832ffc for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:53:47.210583 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:47.261168 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999626728000067 future=<Future at 0x7724f82a2120 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:53:47.267142 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Instance destroyed successfully.
May 28 01:53:47.268768 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-75022dff-efb4-4d23-a2ab-0319a3ac9415 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Releasing lock "refresh_cache-adfbfdf0-7c0f-4834-92ff-3b8d8c39e333" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:53:47.269327 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-75022dff-efb4-4d23-a2ab-0319a3ac9415 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:53:47.269391 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-75022dff-efb4-4d23-a2ab-0319a3ac9415 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:53:47.272218 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:47.273716 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Lazy-loading 'resources' on Instance uuid d3a7c39a-f946-496d-9153-0a422e7f5350 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:53:47.337823 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Booting with volume ac79736b-8037-45cb-a9eb-510556b680f9 at /dev/vda
May 28 01:53:47.396507 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:53:47.419294 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:53:47.444278 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:53:47.475017 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:53:47.475427 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:53:47.497832 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:53:47.500050 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe45:c5fe', 'fe80::e05c:5bff:fea5:7965', 'fe80::fc16:3eff:fe52:6a', 'fe80::fc16:3eff:fe63:2bb1', 'fe80::e43a:d5ff:fecc:27fe'] 
May 28 01:53:47.500050 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:53:47.500326 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:53:47.502308 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] <== get_connector_properties: return (103ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:53:47.502308 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Updating existing volume attachment record: b5431df4-6fce-402e-98be-8f579f04df53 {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:53:47.742850 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-cf08471b-24b9-4a33-a902-c43a5d5dfdd6 req-eddfd1eb-77f3-4cbd-a433-45d8f6cd5255 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-vif-unplugged-bf1e69e9-a858-4270-8c47-a209493f7e48 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:53:47.745693 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-cf08471b-24b9-4a33-a902-c43a5d5dfdd6 req-eddfd1eb-77f3-4cbd-a433-45d8f6cd5255 service nova] Acquiring lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:47.745794 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-cf08471b-24b9-4a33-a902-c43a5d5dfdd6 req-eddfd1eb-77f3-4cbd-a433-45d8f6cd5255 service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:47.745987 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-cf08471b-24b9-4a33-a902-c43a5d5dfdd6 req-eddfd1eb-77f3-4cbd-a433-45d8f6cd5255 service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:47.746383 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-cf08471b-24b9-4a33-a902-c43a5d5dfdd6 req-eddfd1eb-77f3-4cbd-a433-45d8f6cd5255 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] No waiting events found dispatching network-vif-unplugged-bf1e69e9-a858-4270-8c47-a209493f7e48 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:53:47.746383 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-cf08471b-24b9-4a33-a902-c43a5d5dfdd6 req-eddfd1eb-77f3-4cbd-a433-45d8f6cd5255 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-vif-unplugged-bf1e69e9-a858-4270-8c47-a209493f7e48 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:53:47.746383 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-cf08471b-24b9-4a33-a902-c43a5d5dfdd6 req-eddfd1eb-77f3-4cbd-a433-45d8f6cd5255 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-vif-unplugged-bf1e69e9-a858-4270-8c47-a209493f7e48 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:53:47.746611 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-cf08471b-24b9-4a33-a902-c43a5d5dfdd6 req-eddfd1eb-77f3-4cbd-a433-45d8f6cd5255 service nova] Acquiring lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:47.746611 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-cf08471b-24b9-4a33-a902-c43a5d5dfdd6 req-eddfd1eb-77f3-4cbd-a433-45d8f6cd5255 service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:47.746744 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-cf08471b-24b9-4a33-a902-c43a5d5dfdd6 req-eddfd1eb-77f3-4cbd-a433-45d8f6cd5255 service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:47.746997 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-cf08471b-24b9-4a33-a902-c43a5d5dfdd6 req-eddfd1eb-77f3-4cbd-a433-45d8f6cd5255 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] No waiting events found dispatching network-vif-unplugged-bf1e69e9-a858-4270-8c47-a209493f7e48 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:53:47.746997 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-cf08471b-24b9-4a33-a902-c43a5d5dfdd6 req-eddfd1eb-77f3-4cbd-a433-45d8f6cd5255 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-vif-unplugged-bf1e69e9-a858-4270-8c47-a209493f7e48 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:53:47.752103 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:53:47.779475 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:52:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1355324420',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-device-tagging-server-1355324420',id=7,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvfiwJ1r27bnKNxDX4o62ctTDC6Ig/ylPWT9y3C0rnlXe7S/XjzMLOOboDVdfgZcI/qlz5Bn2JX3BBWTCO4qdcchSK7LR3FDT1K/XzjxBoEocraAGjdS8H/4gV7GCIjjQ==',key_name='tempest-keypair-734589143',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:52:56Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e94701d7485c4c46adefaf3637f27990',ramdisk_id='',reservation_id='r-r8kmnuo7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1330490836',owner_user_name='tempest-TaggedBootDevicesTest-1330490836-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:52:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5369516340f4495b7f29ffd82dd9654',uuid=d3a7c39a-f946-496d-9153-0a422e7f5350,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8", "address": "fa:16:3e:54:87:27", "network": {"id": "f48f059f-2a4c-46cc-9281-c2a228bf4514", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-256433360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e04c6bd-fb", "ovs_interfaceid": "0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:53:47.779830 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Converting VIF {"id": "0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8", "address": "fa:16:3e:54:87:27", "network": {"id": "f48f059f-2a4c-46cc-9281-c2a228bf4514", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-256433360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e04c6bd-fb", "ovs_interfaceid": "0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:53:47.781808 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:87:27,bridge_name='br-int',has_traffic_filtering=True,id=0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8,network=Network(f48f059f-2a4c-46cc-9281-c2a228bf4514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e04c6bd-fb') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:53:47.781808 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:87:27,bridge_name='br-int',has_traffic_filtering=True,id=0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8,network=Network(f48f059f-2a4c-46cc-9281-c2a228bf4514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e04c6bd-fb') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:53:47.782494 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:47.783072 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0e04c6bd-fb, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:53:47.788338 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:53:47.832301 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:47.836306 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:47.836541 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fe3f06df-a2cf-4166-8624-ee01c3afc2cf) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:53:47.837909 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:47.838762 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:53:47.848599 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-de8aaafe-93d7-4c37-b97e-4abaa9e27c0f tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "bad69594-f163-41a6-931f-d2fcda0cb7d1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.641s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:47.885923 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:47.890358 np0000001583 nova-compute[98241]: INFO os_vif [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:87:27,bridge_name='br-int',has_traffic_filtering=True,id=0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8,network=Network(f48f059f-2a4c-46cc-9281-c2a228bf4514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e04c6bd-fb')
May 28 01:53:47.890978 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:52:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1355324420',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-device-tagging-server-1355324420',id=7,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvfiwJ1r27bnKNxDX4o62ctTDC6Ig/ylPWT9y3C0rnlXe7S/XjzMLOOboDVdfgZcI/qlz5Bn2JX3BBWTCO4qdcchSK7LR3FDT1K/XzjxBoEocraAGjdS8H/4gV7GCIjjQ==',key_name='tempest-keypair-734589143',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:52:56Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e94701d7485c4c46adefaf3637f27990',ramdisk_id='',reservation_id='r-r8kmnuo7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1330490836',owner_user_name='tempest-TaggedBootDevicesTest-1330490836-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:52:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5369516340f4495b7f29ffd82dd9654',uuid=d3a7c39a-f946-496d-9153-0a422e7f5350,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d994306-44d7-4407-94eb-49b142832ffc", "address": "fa:16:3e:ab:fd:ca", "network": {"id": "3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026701416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d994306-44", "ovs_interfaceid": "3d994306-44d7-4407-94eb-49b142832ffc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:53:47.891292 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Converting VIF {"id": "3d994306-44d7-4407-94eb-49b142832ffc", "address": "fa:16:3e:ab:fd:ca", "network": {"id": "3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026701416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d994306-44", "ovs_interfaceid": "3d994306-44d7-4407-94eb-49b142832ffc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:53:47.891676 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:fd:ca,bridge_name='br-int',has_traffic_filtering=True,id=3d994306-44d7-4407-94eb-49b142832ffc,network=Network(3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3d994306-44') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:53:47.891883 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:fd:ca,bridge_name='br-int',has_traffic_filtering=True,id=3d994306-44d7-4407-94eb-49b142832ffc,network=Network(3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3d994306-44') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:53:47.892763 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:47.893162 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d994306-44, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:53:47.897745 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:53:47.928032 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:47.930233 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:47.930479 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0b3b0c02-6ee9-4ef7-8b98-6278e13d8d2d) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:53:47.931252 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:47.931900 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:53:47.964473 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:47.966733 np0000001583 nova-compute[98241]: INFO os_vif [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:fd:ca,bridge_name='br-int',has_traffic_filtering=True,id=3d994306-44d7-4407-94eb-49b142832ffc,network=Network(3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3d994306-44')
May 28 01:53:47.967428 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:52:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1355324420',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-device-tagging-server-1355324420',id=7,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvfiwJ1r27bnKNxDX4o62ctTDC6Ig/ylPWT9y3C0rnlXe7S/XjzMLOOboDVdfgZcI/qlz5Bn2JX3BBWTCO4qdcchSK7LR3FDT1K/XzjxBoEocraAGjdS8H/4gV7GCIjjQ==',key_name='tempest-keypair-734589143',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:52:56Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e94701d7485c4c46adefaf3637f27990',ramdisk_id='',reservation_id='r-r8kmnuo7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1330490836',owner_user_name='tempest-TaggedBootDevicesTest-1330490836-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:52:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5369516340f4495b7f29ffd82dd9654',uuid=d3a7c39a-f946-496d-9153-0a422e7f5350,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf1e69e9-a858-4270-8c47-a209493f7e48", "address": "fa:16:3e:18:87:d6", "network": {"id": "3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026701416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf1e69e9-a8", "ovs_interfaceid": "bf1e69e9-a858-4270-8c47-a209493f7e48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:53:47.967709 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Converting VIF {"id": "bf1e69e9-a858-4270-8c47-a209493f7e48", "address": "fa:16:3e:18:87:d6", "network": {"id": "3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026701416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf1e69e9-a8", "ovs_interfaceid": "bf1e69e9-a858-4270-8c47-a209493f7e48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:53:47.968048 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:87:d6,bridge_name='br-int',has_traffic_filtering=True,id=bf1e69e9-a858-4270-8c47-a209493f7e48,network=Network(3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbf1e69e9-a8') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:53:47.968287 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:87:d6,bridge_name='br-int',has_traffic_filtering=True,id=bf1e69e9-a858-4270-8c47-a209493f7e48,network=Network(3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbf1e69e9-a8') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:53:47.969972 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:47.971935 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf1e69e9-a8, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:53:47.974291 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:47.975562 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:53:48.004054 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:48.004936 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:48.005152 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f35de14b-636c-448d-9b94-11a64d160206) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:53:48.005800 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:48.006476 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:53:48.035680 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:48.038338 np0000001583 nova-compute[98241]: INFO os_vif [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:87:d6,bridge_name='br-int',has_traffic_filtering=True,id=bf1e69e9-a858-4270-8c47-a209493f7e48,network=Network(3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbf1e69e9-a8')
May 28 01:53:48.039191 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:52:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1355324420',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-device-tagging-server-1355324420',id=7,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvfiwJ1r27bnKNxDX4o62ctTDC6Ig/ylPWT9y3C0rnlXe7S/XjzMLOOboDVdfgZcI/qlz5Bn2JX3BBWTCO4qdcchSK7LR3FDT1K/XzjxBoEocraAGjdS8H/4gV7GCIjjQ==',key_name='tempest-keypair-734589143',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:52:56Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e94701d7485c4c46adefaf3637f27990',ramdisk_id='',reservation_id='r-r8kmnuo7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1330490836',owner_user_name='tempest-TaggedBootDevicesTest-1330490836-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:52:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5369516340f4495b7f29ffd82dd9654',uuid=d3a7c39a-f946-496d-9153-0a422e7f5350,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5e93ea0-a679-45fb-9178-3842154f2e4d", "address": "fa:16:3e:9a:c8:f6", "network": {"id": "3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026701416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e93ea0-a6", "ovs_interfaceid": "f5e93ea0-a679-45fb-9178-3842154f2e4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:53:48.039365 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Converting VIF {"id": "f5e93ea0-a679-45fb-9178-3842154f2e4d", "address": "fa:16:3e:9a:c8:f6", "network": {"id": "3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026701416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e93ea0-a6", "ovs_interfaceid": "f5e93ea0-a679-45fb-9178-3842154f2e4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:53:48.039871 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:c8:f6,bridge_name='br-int',has_traffic_filtering=True,id=f5e93ea0-a679-45fb-9178-3842154f2e4d,network=Network(3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e93ea0-a6') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:53:48.040162 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:c8:f6,bridge_name='br-int',has_traffic_filtering=True,id=f5e93ea0-a679-45fb-9178-3842154f2e4d,network=Network(3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e93ea0-a6') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:53:48.042292 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:48.042500 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5e93ea0-a6, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:53:48.043644 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:48.044433 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:53:48.069027 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:48.070791 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:48.070936 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4d387398-330d-4e7f-8a82-93e964bcfe91) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:53:48.081005 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:53:48.098935 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:48.104518 np0000001583 nova-compute[98241]: INFO os_vif [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:c8:f6,bridge_name='br-int',has_traffic_filtering=True,id=f5e93ea0-a679-45fb-9178-3842154f2e4d,network=Network(3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e93ea0-a6')
May 28 01:53:48.105556 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:52:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1355324420',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-device-tagging-server-1355324420',id=7,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvfiwJ1r27bnKNxDX4o62ctTDC6Ig/ylPWT9y3C0rnlXe7S/XjzMLOOboDVdfgZcI/qlz5Bn2JX3BBWTCO4qdcchSK7LR3FDT1K/XzjxBoEocraAGjdS8H/4gV7GCIjjQ==',key_name='tempest-keypair-734589143',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:52:56Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e94701d7485c4c46adefaf3637f27990',ramdisk_id='',reservation_id='r-r8kmnuo7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1330490836',owner_user_name='tempest-TaggedBootDevicesTest-1330490836-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:52:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5369516340f4495b7f29ffd82dd9654',uuid=d3a7c39a-f946-496d-9153-0a422e7f5350,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "91f6bd16-2cfa-44ca-a7ea-ef3ef4933092", "address": "fa:16:3e:ba:70:ee", "network": {"id": "3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026701416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f6bd16-2c", "ovs_interfaceid": "91f6bd16-2cfa-44ca-a7ea-ef3ef4933092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:53:48.105825 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Converting VIF {"id": "91f6bd16-2cfa-44ca-a7ea-ef3ef4933092", "address": "fa:16:3e:ba:70:ee", "network": {"id": "3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026701416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f6bd16-2c", "ovs_interfaceid": "91f6bd16-2cfa-44ca-a7ea-ef3ef4933092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:53:48.106545 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:70:ee,bridge_name='br-int',has_traffic_filtering=True,id=91f6bd16-2cfa-44ca-a7ea-ef3ef4933092,network=Network(3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f6bd16-2c') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:53:48.111072 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:70:ee,bridge_name='br-int',has_traffic_filtering=True,id=91f6bd16-2cfa-44ca-a7ea-ef3ef4933092,network=Network(3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f6bd16-2c') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:53:48.112622 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:48.112622 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap91f6bd16-2c, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:53:48.113707 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:48.114602 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:53:48.131381 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:48.132297 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:48.132574 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0d15f96e-0cda-421b-9cae-64993edb4503) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:53:48.134347 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:48.135295 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:53:48.151623 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Instance destroyed successfully.
May 28 01:53:48.152950 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-75022dff-efb4-4d23-a2ab-0319a3ac9415 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lazy-loading 'resources' on Instance uuid adfbfdf0-7c0f-4834-92ff-3b8d8c39e333 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:53:48.155471 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:48.162622 np0000001583 nova-compute[98241]: INFO os_vif [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:70:ee,bridge_name='br-int',has_traffic_filtering=True,id=91f6bd16-2cfa-44ca-a7ea-ef3ef4933092,network=Network(3fd2f50d-2b8d-4a7c-ac01-c4ee056343c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f6bd16-2c')
May 28 01:53:48.165538 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:52:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1355324420',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-device-tagging-server-1355324420',id=7,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvfiwJ1r27bnKNxDX4o62ctTDC6Ig/ylPWT9y3C0rnlXe7S/XjzMLOOboDVdfgZcI/qlz5Bn2JX3BBWTCO4qdcchSK7LR3FDT1K/XzjxBoEocraAGjdS8H/4gV7GCIjjQ==',key_name='tempest-keypair-734589143',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:52:56Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e94701d7485c4c46adefaf3637f27990',ramdisk_id='',reservation_id='r-r8kmnuo7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1330490836',owner_user_name='tempest-TaggedBootDevicesTest-1330490836-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:52:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5369516340f4495b7f29ffd82dd9654',uuid=d3a7c39a-f946-496d-9153-0a422e7f5350,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e08628c-1ff2-4d4b-9f3d-50231fa6ceec", "address": "fa:16:3e:1d:f8:b7", "network": {"id": "450c1abf-c05a-46dc-9905-3fa42767a540", "bridge": "br-int", "label": "tempest-device-tagging-net2-594797377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e08628c-1f", "ovs_interfaceid": "9e08628c-1ff2-4d4b-9f3d-50231fa6ceec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:53:48.165538 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Converting VIF {"id": "9e08628c-1ff2-4d4b-9f3d-50231fa6ceec", "address": "fa:16:3e:1d:f8:b7", "network": {"id": "450c1abf-c05a-46dc-9905-3fa42767a540", "bridge": "br-int", "label": "tempest-device-tagging-net2-594797377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e08628c-1f", "ovs_interfaceid": "9e08628c-1ff2-4d4b-9f3d-50231fa6ceec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:53:48.165538 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:f8:b7,bridge_name='br-int',has_traffic_filtering=True,id=9e08628c-1ff2-4d4b-9f3d-50231fa6ceec,network=Network(450c1abf-c05a-46dc-9905-3fa42767a540),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e08628c-1f') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:53:48.165538 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:f8:b7,bridge_name='br-int',has_traffic_filtering=True,id=9e08628c-1ff2-4d4b-9f3d-50231fa6ceec,network=Network(450c1abf-c05a-46dc-9905-3fa42767a540),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e08628c-1f') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:53:48.167577 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:48.167788 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e08628c-1f, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:53:48.168881 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:48.169656 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:53:48.180616 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:48.181512 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:48.181751 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=38035ab8-4ee8-4802-b631-0c08b637d968) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:53:48.182594 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:48.183590 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:53:48.194452 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:48.197620 np0000001583 nova-compute[98241]: INFO os_vif [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:f8:b7,bridge_name='br-int',has_traffic_filtering=True,id=9e08628c-1ff2-4d4b-9f3d-50231fa6ceec,network=Network(450c1abf-c05a-46dc-9905-3fa42767a540),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e08628c-1f')
May 28 01:53:48.197620 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:52:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1355324420',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-device-tagging-server-1355324420',id=7,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvfiwJ1r27bnKNxDX4o62ctTDC6Ig/ylPWT9y3C0rnlXe7S/XjzMLOOboDVdfgZcI/qlz5Bn2JX3BBWTCO4qdcchSK7LR3FDT1K/XzjxBoEocraAGjdS8H/4gV7GCIjjQ==',key_name='tempest-keypair-734589143',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:52:56Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e94701d7485c4c46adefaf3637f27990',ramdisk_id='',reservation_id='r-r8kmnuo7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1330490836',owner_user_name='tempest-TaggedBootDevicesTest-1330490836-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:52:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5369516340f4495b7f29ffd82dd9654',uuid=d3a7c39a-f946-496d-9153-0a422e7f5350,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a566955f-6906-4a3b-bdf1-2f55b31b6e21", "address": "fa:16:3e:cb:ff:df", "network": {"id": "450c1abf-c05a-46dc-9905-3fa42767a540", "bridge": "br-int", "label": "tempest-device-tagging-net2-594797377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa566955f-69", "ovs_interfaceid": "a566955f-6906-4a3b-bdf1-2f55b31b6e21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:53:48.198149 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Converting VIF {"id": "a566955f-6906-4a3b-bdf1-2f55b31b6e21", "address": "fa:16:3e:cb:ff:df", "network": {"id": "450c1abf-c05a-46dc-9905-3fa42767a540", "bridge": "br-int", "label": "tempest-device-tagging-net2-594797377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e94701d7485c4c46adefaf3637f27990", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa566955f-69", "ovs_interfaceid": "a566955f-6906-4a3b-bdf1-2f55b31b6e21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:53:48.198810 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:ff:df,bridge_name='br-int',has_traffic_filtering=True,id=a566955f-6906-4a3b-bdf1-2f55b31b6e21,network=Network(450c1abf-c05a-46dc-9905-3fa42767a540),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa566955f-69') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:53:48.199227 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:ff:df,bridge_name='br-int',has_traffic_filtering=True,id=a566955f-6906-4a3b-bdf1-2f55b31b6e21,network=Network(450c1abf-c05a-46dc-9905-3fa42767a540),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa566955f-69') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:53:48.200362 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:48.200589 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa566955f-69, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:53:48.201735 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:48.202765 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:53:48.214364 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:48.214962 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:48.215566 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=851016b7-8a5d-4c5a-beb2-02c32d782655) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:53:48.215691 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:48.216337 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:53:48.222469 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:48.224524 np0000001583 nova-compute[98241]: INFO os_vif [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:ff:df,bridge_name='br-int',has_traffic_filtering=True,id=a566955f-6906-4a3b-bdf1-2f55b31b6e21,network=Network(450c1abf-c05a-46dc-9905-3fa42767a540),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa566955f-69')
May 28 01:53:48.226329 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:53:48.226329 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8', 'iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5882db55-1e44-4bae-be6c-74bd366d0eb8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:53:48.226329 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:53:48.227522 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:53:48.227522 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8', 'iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5882db55-1e44-4bae-be6c-74bd366d0eb8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:53:48.227522 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:53:48.267193 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:48.267193 np0000001583 nova-compute[98241]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:48.267193 np0000001583 nova-compute[98241]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:48.267193 np0000001583 nova-compute[98241]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:48.267193 np0000001583 nova-compute[98241]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:48.267193 np0000001583 nova-compute[98241]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:48.267193 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:48.267193 np0000001583 nova-compute[98241]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:48.267193 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:53:48.267193 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:48.267193 np0000001583 nova-compute[98241]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:48.267193 np0000001583 nova-compute[98241]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:48.267193 np0000001583 nova-compute[98241]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:48.267193 np0000001583 nova-compute[98241]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:48.267193 np0000001583 nova-compute[98241]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:48.267193 np0000001583 nova-compute[98241]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8 (non-flash)
May 28 01:53:48.267193 np0000001583 nova-compute[98241]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:48.267193 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:53:48.267193 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8', '5'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8', '6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02', '9')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:53:48.267193 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8', '6')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:53:48.267193 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8', '5')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:53:48.267193 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f83e7ba0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8'): ({'sdb'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:53:48.267193 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Removing multipathed devices sdc, sdb {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:53:48.268355 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Flush multipath device 3300000002a0693ae {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:53:48.326956 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:53:48.382035 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:53:48.401708 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:53:48.432188 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:53:48.432188 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:53:48.432188 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:53:48.447345 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:53:48.447345 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:53:48.460163 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:48.460755 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.001013026999999056 future=<Future at 0x7724f8459040 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:53:48.461387 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:53:48.461558 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=5.233430374000136 future=<Future at 0x7724f831b980 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:53:48.461928 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=5.233291732999987 future=<Future at 0x7724f831b980 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:53:48.465145 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Emitting event <LifecycleEvent: 1779933213.4596229, f2805796-e531-4508-8585-0d110f4bd4e7 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:53:48.465145 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] VM Stopped (Lifecycle Event)
May 28 01:53:48.501869 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8, portal: 192.168.40.100,3260]
May 28 01:53:48.501869 np0000001583 nova-compute[98241]: Logout of [sid: 6, target: iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8, portal: 192.168.40.100,3260] successful.
May 28 01:53:48.501869 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:48.522511 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:48.535867 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:48.568550 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8, portal: 192.168.50.100,3260]
May 28 01:53:48.568550 np0000001583 nova-compute[98241]: Logout of [sid: 5, target: iqn.2023-03.storpool.com:os--volume-5882db55-1e44-4bae-be6c-74bd366d0eb8, portal: 192.168.50.100,3260] successful.
May 28 01:53:48.568550 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:48.576496 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Updating instance_info_cache with network_info: [{"id": "ae1eb56b-d3c2-441b-9339-b2d96192924c", "address": "fa:16:3e:ca:36:a6", "network": {"id": "a6357868-368f-400d-b8c9-8e8843bdfdda", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1753538248-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "02ba6b7c1fd84a7c8ed4e9f086f83fa0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae1eb56b-d3", "ovs_interfaceid": "ae1eb56b-d3c2-441b-9339-b2d96192924c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:53:48.586409 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:48.586409 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:53:48.586409 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] <== disconnect_volume: return (360ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:53:48.586409 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:53:48.587656 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:53:48.589356 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02', 'iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7ddf6798-56b7-484e-8f23-b19628080e02', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:53:48.589356 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:53:48.590029 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:53:48.590799 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02', 'iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7ddf6798-56b7-484e-8f23-b19628080e02', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:53:48.591416 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:53:48.621113 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:48.621113 np0000001583 nova-compute[98241]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:48.621113 np0000001583 nova-compute[98241]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:48.621113 np0000001583 nova-compute[98241]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:48.621113 np0000001583 nova-compute[98241]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:48.621113 np0000001583 nova-compute[98241]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:48.621113 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:53:48.621113 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:48.621113 np0000001583 nova-compute[98241]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:48.621113 np0000001583 nova-compute[98241]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:48.621113 np0000001583 nova-compute[98241]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:48.621113 np0000001583 nova-compute[98241]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:48.621113 np0000001583 nova-compute[98241]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02 (non-flash)
May 28 01:53:48.621113 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:53:48.621113 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02', '9')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:53:48.621113 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02', '10')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:53:48.621113 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02', '9')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:53:48.621113 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f817e5c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02'): ({'sdf'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:53:48.622803 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Removing multipathed devices sdf, sdg {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:53:48.623371 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Flush multipath device 3300000002fcf1c98 {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:53:48.660300 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:53:48.666122 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-75022dff-efb4-4d23-a2ab-0319a3ac9415 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Object Instance<adfbfdf0-7c0f-4834-92ff-3b8d8c39e333> lazy-loaded attributes: numa_topology,resources {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:53:48.666122 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-75022dff-efb4-4d23-a2ab-0319a3ac9415 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:52:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1548147209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-attachvolumeshelvetestjson-server-1548147209',id=9,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJwrMRD5wxwugzv1AEW5/hAzhH1YG3g6YQRM7Gj02COrqoTMUwOT7Qvj1PHahHsueYMlw286AH6SOiqmQpBGgCrC9ZUpIHXzJIpstHW4gbgJg8NYW8F6fN/ppNzWYnxsQ==',key_name='tempest-keypair-1047928115',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:52:56Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0d31342458ec4ed2890a766f62facbcf',ramdisk_id='',reservation_id='r-ciexyebb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1906404591',owner_user_name='tempest-AttachVolumeShelveTestJSON-1906404591-project-member',shelved_at='2026-05-28T01:53:44.394801',shelved_host='np0000001583',shelved_image_id='b12462e2-1eb9-45d2-a9ac-02ca39dc37ad'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:53:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='312a198f7d3d4ce9b586d8f36cf58f76',uuid=adfbfdf0-7c0f-4834-92ff-3b8d8c39e333,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "828d441a-570b-4f98-b093-4eb521ee2cf8", "address": "fa:16:3e:f5:ed:7d", "network": {"id": "34ab0ff0-75dd-45e7-97f6-22f8e62a8149", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1222751470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d31342458ec4ed2890a766f62facbcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap828d441a-57", "ovs_interfaceid": "828d441a-570b-4f98-b093-4eb521ee2cf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:53:48.666122 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-75022dff-efb4-4d23-a2ab-0319a3ac9415 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Converting VIF {"id": "828d441a-570b-4f98-b093-4eb521ee2cf8", "address": "fa:16:3e:f5:ed:7d", "network": {"id": "34ab0ff0-75dd-45e7-97f6-22f8e62a8149", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1222751470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d31342458ec4ed2890a766f62facbcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap828d441a-57", "ovs_interfaceid": "828d441a-570b-4f98-b093-4eb521ee2cf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:53:48.666122 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-75022dff-efb4-4d23-a2ab-0319a3ac9415 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ed:7d,bridge_name='br-int',has_traffic_filtering=True,id=828d441a-570b-4f98-b093-4eb521ee2cf8,network=Network(34ab0ff0-75dd-45e7-97f6-22f8e62a8149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap828d441a-57') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:53:48.666122 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-75022dff-efb4-4d23-a2ab-0319a3ac9415 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ed:7d,bridge_name='br-int',has_traffic_filtering=True,id=828d441a-570b-4f98-b093-4eb521ee2cf8,network=Network(34ab0ff0-75dd-45e7-97f6-22f8e62a8149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap828d441a-57') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:53:48.667661 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:48.668020 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap828d441a-57, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:53:48.669708 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:48.672147 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:53:48.673828 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:48.674244 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=36ca5b03-9393-4b33-bdd8-ced5a5b77fee) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:53:48.677002 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:48.677913 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:53:48.679825 np0000001583 nova-compute[98241]: INFO os_vif [None req-75022dff-efb4-4d23-a2ab-0319a3ac9415 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ed:7d,bridge_name='br-int',has_traffic_filtering=True,id=828d441a-570b-4f98-b093-4eb521ee2cf8,network=Network(34ab0ff0-75dd-45e7-97f6-22f8e62a8149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap828d441a-57')
May 28 01:53:48.680398 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-75022dff-efb4-4d23-a2ab-0319a3ac9415 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Deleting instance files /opt/stack/data/nova/instances/adfbfdf0-7c0f-4834-92ff-3b8d8c39e333_del
May 28 01:53:48.685940 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-75022dff-efb4-4d23-a2ab-0319a3ac9415 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Deletion of /opt/stack/data/nova/instances/adfbfdf0-7c0f-4834-92ff-3b8d8c39e333_del complete
May 28 01:53:48.730964 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:53:48.776370 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:53:48.776370 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:53:48.778270 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:53:48.795292 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:53:48.795523 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:53:48.803696 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3ef0aaa7-b40a-43cf-95b9-e2373b1b395e tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Acquiring lock "bad69594-f163-41a6-931f-d2fcda0cb7d1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:48.803830 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3ef0aaa7-b40a-43cf-95b9-e2373b1b395e tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "bad69594-f163-41a6-931f-d2fcda0cb7d1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:48.807331 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:48.811843 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:48.847339 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02, portal: 192.168.40.100,3260]
May 28 01:53:48.847339 np0000001583 nova-compute[98241]: Logout of [sid: 10, target: iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02, portal: 192.168.40.100,3260] successful.
May 28 01:53:48.847339 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:48.867032 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:48.880873 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:48.926676 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02, portal: 192.168.50.100,3260]
May 28 01:53:48.926676 np0000001583 nova-compute[98241]: Logout of [sid: 9, target: iqn.2023-03.storpool.com:os--volume-7ddf6798-56b7-484e-8f23-b19628080e02, portal: 192.168.50.100,3260] successful.
May 28 01:53:48.926676 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:48.942438 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:48.942711 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:53:48.943743 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] <== disconnect_volume: return (354ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:53:48.943743 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:53:48.944648 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:53:48.945048 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb', 'iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fe81d64a-afda-41db-b18c-986ff2d9fbcb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:53:48.945211 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:53:48.945971 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:53:48.945971 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb', 'iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fe81d64a-afda-41db-b18c-986ff2d9fbcb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:53:48.946154 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:53:48.968954 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-6d29c100-87b0-485b-87b0-d9c290b5f44c tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:53:48.976433 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:48.976433 np0000001583 nova-compute[98241]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:48.976433 np0000001583 nova-compute[98241]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:48.976433 np0000001583 nova-compute[98241]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:48.976433 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:53:48.976672 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsi session list stdout=tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:48.976672 np0000001583 nova-compute[98241]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb (non-flash)
May 28 01:53:48.976672 np0000001583 nova-compute[98241]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:48.976672 np0000001583 nova-compute[98241]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:48.976672 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:53:48.976865 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860', '21')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:53:48.977068 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb', '12')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:53:48.978011 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb', '13')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:53:48.978814 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f82e84a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb'): ({'sdj'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:53:48.979035 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Removing multipathed devices sdj, sdi {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:53:48.979475 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Flush multipath device 330000000958ebcf5 {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:53:49.009615 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:53:49.057990 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:53:49.078973 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Releasing lock "refresh_cache-e73ac672-0911-4e4d-8a85-9b635a9e836f" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:53:49.079437 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Instance network_info: |[{"id": "ae1eb56b-d3c2-441b-9339-b2d96192924c", "address": "fa:16:3e:ca:36:a6", "network": {"id": "a6357868-368f-400d-b8c9-8e8843bdfdda", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1753538248-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "02ba6b7c1fd84a7c8ed4e9f086f83fa0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae1eb56b-d3", "ovs_interfaceid": "ae1eb56b-d3c2-441b-9339-b2d96192924c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:53:49.081188 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Start _get_guest_xml network_info=[{"id": "ae1eb56b-d3c2-441b-9339-b2d96192924c", "address": "fa:16:3e:ca:36:a6", "network": {"id": "a6357868-368f-400d-b8c9-8e8843bdfdda", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1753538248-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "02ba6b7c1fd84a7c8ed4e9f086f83fa0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae1eb56b-d3", "ovs_interfaceid": "ae1eb56b-d3c2-441b-9339-b2d96192924c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:53:49.087637 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:53:49.087637 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-2127810450', uuid='e73ac672-0911-4e4d-8a85-9b635a9e836f'), owner=OwnerMeta(userid='8df1e628989946dbafa89116b196c65b', username='tempest-TaggedAttachmentsTest-1060566416-project-member', projectid='02ba6b7c1fd84a7c8ed4e9f086f83fa0', projectname='tempest-TaggedAttachmentsTest-1060566416'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ae1eb56b-d3c2-441b-9339-b2d96192924c", "address": "fa:16:3e:ca:36:a6", "network": {"id": "a6357868-368f-400d-b8c9-8e8843bdfdda", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1753538248-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "02ba6b7c1fd84a7c8ed4e9f086f83fa0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae1eb56b-d3", "ovs_interfaceid": "ae1eb56b-d3c2-441b-9339-b2d96192924c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933229.0868971) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:53:49.090538 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e69db70d-074b-4882-8d3d-88b56b8c493f req-9dbb0bb6-4fcd-4aae-8f0d-abc2842cad3d service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-vif-unplugged-0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:53:49.092811 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e69db70d-074b-4882-8d3d-88b56b8c493f req-9dbb0bb6-4fcd-4aae-8f0d-abc2842cad3d service nova] Acquiring lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:49.093688 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e69db70d-074b-4882-8d3d-88b56b8c493f req-9dbb0bb6-4fcd-4aae-8f0d-abc2842cad3d service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:49.093972 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e69db70d-074b-4882-8d3d-88b56b8c493f req-9dbb0bb6-4fcd-4aae-8f0d-abc2842cad3d service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:49.094211 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e69db70d-074b-4882-8d3d-88b56b8c493f req-9dbb0bb6-4fcd-4aae-8f0d-abc2842cad3d service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] No waiting events found dispatching network-vif-unplugged-0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:53:49.095062 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e69db70d-074b-4882-8d3d-88b56b8c493f req-9dbb0bb6-4fcd-4aae-8f0d-abc2842cad3d service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-vif-unplugged-0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:53:49.096247 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:53:49.096557 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e69db70d-074b-4882-8d3d-88b56b8c493f req-9dbb0bb6-4fcd-4aae-8f0d-abc2842cad3d service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Received event network-changed-828d441a-570b-4f98-b093-4eb521ee2cf8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:53:49.096873 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e69db70d-074b-4882-8d3d-88b56b8c493f req-9dbb0bb6-4fcd-4aae-8f0d-abc2842cad3d service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Refreshing instance network info cache due to event network-changed-828d441a-570b-4f98-b093-4eb521ee2cf8. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:53:49.097439 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e69db70d-074b-4882-8d3d-88b56b8c493f req-9dbb0bb6-4fcd-4aae-8f0d-abc2842cad3d service nova] Acquiring lock "refresh_cache-adfbfdf0-7c0f-4834-92ff-3b8d8c39e333" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:53:49.097486 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e69db70d-074b-4882-8d3d-88b56b8c493f req-9dbb0bb6-4fcd-4aae-8f0d-abc2842cad3d service nova] Acquired lock "refresh_cache-adfbfdf0-7c0f-4834-92ff-3b8d8c39e333" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:53:49.097610 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-e69db70d-074b-4882-8d3d-88b56b8c493f req-9dbb0bb6-4fcd-4aae-8f0d-abc2842cad3d service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Refreshing network info cache for port 828d441a-570b-4f98-b093-4eb521ee2cf8 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:53:49.098784 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:53:49.102157 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:53:49.102157 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:53:49.102157 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:53:49.102157 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:53:49.102157 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:53:49.102157 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:53:49.102157 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:53:49.102157 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:53:49.102675 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:53:49.102675 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:53:49.102675 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:53:49.102771 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:53:49.102849 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:53:49.103015 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:53:49.109570 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Checking to see if SCSI volumes sdj, sdi have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:53:49.112065 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] SCSI volumes sdj, sdi have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:53:49.117714 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:53:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2127810450',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-device-tagging-server-2127810450',id=11,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOgLraTEi6SiWvo5jslayVOBAKtkEEjh1jVuNw35Hn8cUQoGuB8wzuMiOMlFTlRtSvwVvTOnGa8VK88dE01Yrnrej50o+Hw4uQhAmKYoDt2ubT7eWDD6mkiN/JuIg389w==',key_name='tempest-keypair-1856182923',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02ba6b7c1fd84a7c8ed4e9f086f83fa0',ramdisk_id='',reservation_id='r-htc032mq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1060566416',owner_user_name='tempest-TaggedAttachmentsTest-1060566416-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:53:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8df1e628989946dbafa89116b196c65b',uuid=e73ac672-0911-4e4d-8a85-9b635a9e836f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae1eb56b-d3c2-441b-9339-b2d96192924c", "address": "fa:16:3e:ca:36:a6", "network": {"id": "a6357868-368f-400d-b8c9-8e8843bdfdda", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1753538248-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "02ba6b7c1fd84a7c8ed4e9f086f83fa0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae1eb56b-d3", "ovs_interfaceid": "ae1eb56b-d3c2-441b-9339-b2d96192924c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:53:49.118441 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Converting VIF {"id": "ae1eb56b-d3c2-441b-9339-b2d96192924c", "address": "fa:16:3e:ca:36:a6", "network": {"id": "a6357868-368f-400d-b8c9-8e8843bdfdda", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1753538248-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "02ba6b7c1fd84a7c8ed4e9f086f83fa0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae1eb56b-d3", "ovs_interfaceid": "ae1eb56b-d3c2-441b-9339-b2d96192924c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:53:49.119197 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:36:a6,bridge_name='br-int',has_traffic_filtering=True,id=ae1eb56b-d3c2-441b-9339-b2d96192924c,network=Network(a6357868-368f-400d-b8c9-8e8843bdfdda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae1eb56b-d3') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:53:49.120155 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Lazy-loading 'pci_devices' on Instance uuid e73ac672-0911-4e4d-8a85-9b635a9e836f {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:53:49.121267 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Checking to see if device paths {'sdj', 'sdi'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:53:49.134906 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Device paths {'sdj', 'sdi'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:53:49.135522 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:53:49.149935 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:49.183350 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb, portal: 192.168.40.100,3260]
May 28 01:53:49.183350 np0000001583 nova-compute[98241]: Logout of [sid: 12, target: iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb, portal: 192.168.40.100,3260] successful.
May 28 01:53:49.183350 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:49.201521 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:49.218941 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:49.251780 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb, portal: 192.168.50.100,3260]
May 28 01:53:49.251780 np0000001583 nova-compute[98241]: Logout of [sid: 13, target: iqn.2023-03.storpool.com:os--volume-fe81d64a-afda-41db-b18c-986ff2d9fbcb, portal: 192.168.50.100,3260] successful.
May 28 01:53:49.251780 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:49.265057 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:49.265399 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:53:49.265595 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] <== disconnect_volume: return (320ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:53:49.265772 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:53:49.266105 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Deleting instance files /opt/stack/data/nova/instances/d3a7c39a-f946-496d-9153-0a422e7f5350_del
May 28 01:53:49.266741 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Deletion of /opt/stack/data/nova/instances/d3a7c39a-f946-496d-9153-0a422e7f5350_del complete
May 28 01:53:49.275215 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-75022dff-efb4-4d23-a2ab-0319a3ac9415 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Deleted allocations for instance adfbfdf0-7c0f-4834-92ff-3b8d8c39e333
May 28 01:53:49.288902 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a44ccb08-7ced-436b-8808-7c74e7c0de9c req-28211ee5-af4b-48ce-9ea0-13529e704470 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-vif-unplugged-3d994306-44d7-4407-94eb-49b142832ffc {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:53:49.289196 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a44ccb08-7ced-436b-8808-7c74e7c0de9c req-28211ee5-af4b-48ce-9ea0-13529e704470 service nova] Acquiring lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:49.289353 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a44ccb08-7ced-436b-8808-7c74e7c0de9c req-28211ee5-af4b-48ce-9ea0-13529e704470 service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:49.289493 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a44ccb08-7ced-436b-8808-7c74e7c0de9c req-28211ee5-af4b-48ce-9ea0-13529e704470 service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:49.289669 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a44ccb08-7ced-436b-8808-7c74e7c0de9c req-28211ee5-af4b-48ce-9ea0-13529e704470 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] No waiting events found dispatching network-vif-unplugged-3d994306-44d7-4407-94eb-49b142832ffc {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:53:49.292645 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a44ccb08-7ced-436b-8808-7c74e7c0de9c req-28211ee5-af4b-48ce-9ea0-13529e704470 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-vif-unplugged-3d994306-44d7-4407-94eb-49b142832ffc for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:53:49.292852 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a44ccb08-7ced-436b-8808-7c74e7c0de9c req-28211ee5-af4b-48ce-9ea0-13529e704470 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-vif-unplugged-a566955f-6906-4a3b-bdf1-2f55b31b6e21 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:53:49.292983 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a44ccb08-7ced-436b-8808-7c74e7c0de9c req-28211ee5-af4b-48ce-9ea0-13529e704470 service nova] Acquiring lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:49.293208 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a44ccb08-7ced-436b-8808-7c74e7c0de9c req-28211ee5-af4b-48ce-9ea0-13529e704470 service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:49.293348 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a44ccb08-7ced-436b-8808-7c74e7c0de9c req-28211ee5-af4b-48ce-9ea0-13529e704470 service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:49.293490 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a44ccb08-7ced-436b-8808-7c74e7c0de9c req-28211ee5-af4b-48ce-9ea0-13529e704470 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] No waiting events found dispatching network-vif-unplugged-a566955f-6906-4a3b-bdf1-2f55b31b6e21 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:53:49.293630 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a44ccb08-7ced-436b-8808-7c74e7c0de9c req-28211ee5-af4b-48ce-9ea0-13529e704470 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-vif-unplugged-a566955f-6906-4a3b-bdf1-2f55b31b6e21 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:53:49.293776 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a44ccb08-7ced-436b-8808-7c74e7c0de9c req-28211ee5-af4b-48ce-9ea0-13529e704470 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-vif-unplugged-a566955f-6906-4a3b-bdf1-2f55b31b6e21 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:53:49.293937 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a44ccb08-7ced-436b-8808-7c74e7c0de9c req-28211ee5-af4b-48ce-9ea0-13529e704470 service nova] Acquiring lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:49.294146 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a44ccb08-7ced-436b-8808-7c74e7c0de9c req-28211ee5-af4b-48ce-9ea0-13529e704470 service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:49.294250 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a44ccb08-7ced-436b-8808-7c74e7c0de9c req-28211ee5-af4b-48ce-9ea0-13529e704470 service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:49.294388 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a44ccb08-7ced-436b-8808-7c74e7c0de9c req-28211ee5-af4b-48ce-9ea0-13529e704470 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] No waiting events found dispatching network-vif-unplugged-a566955f-6906-4a3b-bdf1-2f55b31b6e21 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:53:49.295325 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a44ccb08-7ced-436b-8808-7c74e7c0de9c req-28211ee5-af4b-48ce-9ea0-13529e704470 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-vif-unplugged-a566955f-6906-4a3b-bdf1-2f55b31b6e21 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:53:49.307206 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-3ef0aaa7-b40a-43cf-95b9-e2373b1b395e tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Detaching volume d64c94a0-49df-4115-a2f7-19f68645f860
May 28 01:53:49.369978 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-3ef0aaa7-b40a-43cf-95b9-e2373b1b395e tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Attempting to driver detach volume d64c94a0-49df-4115-a2f7-19f68645f860 from mountpoint /dev/vdb
May 28 01:53:49.376402 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3ef0aaa7-b40a-43cf-95b9-e2373b1b395e tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Found disk vdb by alias ua-d64c94a0-49df-4115-a2f7-19f68645f860 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:53:49.377884 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3ef0aaa7-b40a-43cf-95b9-e2373b1b395e tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Found disk vdb by alias ua-d64c94a0-49df-4115-a2f7-19f68645f860 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:53:49.378170 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3ef0aaa7-b40a-43cf-95b9-e2373b1b395e tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Attempting to detach device vdb from instance bad69594-f163-41a6-931f-d2fcda0cb7d1 from the persistent domain config. {{(pid=98241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 01:53:49.378684 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-3ef0aaa7-b40a-43cf-95b9-e2373b1b395e tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:53:49.378684 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:53:49.378684 np0000001583 nova-compute[98241]:   <alias name="ua-d64c94a0-49df-4115-a2f7-19f68645f860"/>
May 28 01:53:49.378684 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-9"/>
May 28 01:53:49.378684 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 01:53:49.378684 np0000001583 nova-compute[98241]:   <serial>d64c94a0-49df-4115-a2f7-19f68645f860</serial>
May 28 01:53:49.378684 np0000001583 nova-compute[98241]:   <shareable/>
May 28 01:53:49.378684 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:53:49.378684 np0000001583 nova-compute[98241]: </disk>
May 28 01:53:49.378684 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:53:49.385299 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-3ef0aaa7-b40a-43cf-95b9-e2373b1b395e tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Successfully detached device vdb from instance bad69594-f163-41a6-931f-d2fcda0cb7d1 from the persistent domain config.
May 28 01:53:49.385546 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3ef0aaa7-b40a-43cf-95b9-e2373b1b395e tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] (1/8): Attempting to detach device vdb with device alias ua-d64c94a0-49df-4115-a2f7-19f68645f860 from instance bad69594-f163-41a6-931f-d2fcda0cb7d1 from the live domain config. {{(pid=98241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 01:53:49.385908 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-3ef0aaa7-b40a-43cf-95b9-e2373b1b395e tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:53:49.385908 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:53:49.385908 np0000001583 nova-compute[98241]:   <alias name="ua-d64c94a0-49df-4115-a2f7-19f68645f860"/>
May 28 01:53:49.385908 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-9"/>
May 28 01:53:49.385908 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 01:53:49.385908 np0000001583 nova-compute[98241]:   <serial>d64c94a0-49df-4115-a2f7-19f68645f860</serial>
May 28 01:53:49.385908 np0000001583 nova-compute[98241]:   <shareable/>
May 28 01:53:49.385908 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:53:49.385908 np0000001583 nova-compute[98241]: </disk>
May 28 01:53:49.385908 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:53:49.600852 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-e69db70d-074b-4882-8d3d-88b56b8c493f req-9dbb0bb6-4fcd-4aae-8f0d-abc2842cad3d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:53:49.625624 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] End _get_guest_xml xml=<domain type="qemu">
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:   <uuid>e73ac672-0911-4e4d-8a85-9b635a9e836f</uuid>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:   <name>instance-0000000b</name>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:       <nova:name>tempest-device-tagging-server-2127810450</nova:name>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:53:49</nova:creationTime>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:         <nova:user uuid="8df1e628989946dbafa89116b196c65b">tempest-TaggedAttachmentsTest-1060566416-project-member</nova:user>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:         <nova:project uuid="02ba6b7c1fd84a7c8ed4e9f086f83fa0">tempest-TaggedAttachmentsTest-1060566416</nova:project>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:         <nova:port uuid="ae1eb56b-d3c2-441b-9339-b2d96192924c">
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:     <system>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:       <entry name="serial">e73ac672-0911-4e4d-8a85-9b635a9e836f</entry>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:       <entry name="uuid">e73ac672-0911-4e4d-8a85-9b635a9e836f</entry>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:     </system>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:   <os>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:   </os>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:   <features>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:   </features>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:   <devices>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/e73ac672-0911-4e4d-8a85-9b635a9e836f/disk"/>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:     </disk>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/e73ac672-0911-4e4d-8a85-9b635a9e836f/disk.config"/>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:     </disk>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:ca:36:a6"/>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:       <target dev="tapae1eb56b-d3"/>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:     </interface>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/e73ac672-0911-4e4d-8a85-9b635a9e836f/console.log" append="off"/>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:     </serial>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:     <video>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:     </video>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:     </rng>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:   </devices>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]: </domain>
May 28 01:53:49.625624 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:53:49.631836 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Preparing to wait for external event network-vif-plugged-ae1eb56b-d3c2-441b-9339-b2d96192924c {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:53:49.631836 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Acquiring lock "e73ac672-0911-4e4d-8a85-9b635a9e836f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:49.631836 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Lock "e73ac672-0911-4e4d-8a85-9b635a9e836f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:49.631836 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Lock "e73ac672-0911-4e4d-8a85-9b635a9e836f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:49.631836 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:53:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2127810450',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-device-tagging-server-2127810450',id=11,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOgLraTEi6SiWvo5jslayVOBAKtkEEjh1jVuNw35Hn8cUQoGuB8wzuMiOMlFTlRtSvwVvTOnGa8VK88dE01Yrnrej50o+Hw4uQhAmKYoDt2ubT7eWDD6mkiN/JuIg389w==',key_name='tempest-keypair-1856182923',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02ba6b7c1fd84a7c8ed4e9f086f83fa0',ramdisk_id='',reservation_id='r-htc032mq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1060566416',owner_user_name='tempest-TaggedAttachmentsTest-1060566416-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:53:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8df1e628989946dbafa89116b196c65b',uuid=e73ac672-0911-4e4d-8a85-9b635a9e836f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae1eb56b-d3c2-441b-9339-b2d96192924c", "address": "fa:16:3e:ca:36:a6", "network": {"id": "a6357868-368f-400d-b8c9-8e8843bdfdda", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1753538248-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "02ba6b7c1fd84a7c8ed4e9f086f83fa0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae1eb56b-d3", "ovs_interfaceid": "ae1eb56b-d3c2-441b-9339-b2d96192924c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:53:49.631836 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Converting VIF {"id": "ae1eb56b-d3c2-441b-9339-b2d96192924c", "address": "fa:16:3e:ca:36:a6", "network": {"id": "a6357868-368f-400d-b8c9-8e8843bdfdda", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1753538248-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "02ba6b7c1fd84a7c8ed4e9f086f83fa0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae1eb56b-d3", "ovs_interfaceid": "ae1eb56b-d3c2-441b-9339-b2d96192924c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:53:49.631836 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:36:a6,bridge_name='br-int',has_traffic_filtering=True,id=ae1eb56b-d3c2-441b-9339-b2d96192924c,network=Network(a6357868-368f-400d-b8c9-8e8843bdfdda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae1eb56b-d3') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:53:49.631836 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:36:a6,bridge_name='br-int',has_traffic_filtering=True,id=ae1eb56b-d3c2-441b-9339-b2d96192924c,network=Network(a6357868-368f-400d-b8c9-8e8843bdfdda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae1eb56b-d3') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:53:49.632425 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:49.632425 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:53:49.632716 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:53:49.633487 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:49.633712 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '438bdf1e-baca-5563-a44a-18f6eaaee6bf', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:53:49.634573 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:49.635363 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:53:49.637245 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:49.643660 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:49.643898 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae1eb56b-d3, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:53:49.644359 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapae1eb56b-d3, col_values=(('qos', UUID('45f760f8-a222-45d4-9eba-7efaf402c1ed')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:53:49.644518 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapae1eb56b-d3, col_values=(('external_ids', {'iface-id': 'ae1eb56b-d3c2-441b-9339-b2d96192924c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:36:a6', 'vm-uuid': 'e73ac672-0911-4e4d-8a85-9b635a9e836f'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:53:49.647606 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:49.648932 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:53:49.651583 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:53:49.651583 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Creating image(s)
May 28 01:53:49.652691 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Did not create local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 01:53:49.652892 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Ensure instance console log exists: /opt/stack/data/nova/instances/f2805796-e531-4508-8585-0d110f4bd4e7/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:53:49.653289 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:49.653473 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:49.653632 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:49.654263 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Start _get_guest_xml network_info=[{"id": "6835d977-7c34-4bd7-8d12-208432ea45d3", "address": "fa:16:3e:91:a6:69", "network": {"id": "2043727d-617f-4eff-98e6-5d58f439532d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1616658634-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e37a40d1db45cba9235de04219a3b4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6835d977-7c", "ovs_interfaceid": "6835d977-7c34-4bd7-8d12-208432ea45d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-28T01:49:31Z,direct_url=<?>,disk_format='qcow2',id=160eac6b-3e35-4339-bdf4-c5b84e5687ff,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-28T01:49:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9', 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ac79736b-8037-45cb-a9eb-510556b680f9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'f2805796-e531-4508-8585-0d110f4bd4e7', 'attached_at': '', 'detached_at': '', 'volume_id': 'ac79736b-8037-45cb-a9eb-510556b680f9', 'serial': 'ac79736b-8037-45cb-a9eb-510556b680f9'}, 'delete_on_termination': True, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'b5431df4-6fce-402e-98be-8f579f04df53', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:53:49.654583 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:49.655697 np0000001583 nova-compute[98241]: INFO os_vif [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:36:a6,bridge_name='br-int',has_traffic_filtering=True,id=ae1eb56b-d3c2-441b-9339-b2d96192924c,network=Network(a6357868-368f-400d-b8c9-8e8843bdfdda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae1eb56b-d3')
May 28 01:53:49.667169 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
May 28 01:53:49.667169 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='160eac6b-3e35-4339-bdf4-c5b84e5687ff', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsV293TestJSON-server-1075767386', uuid='f2805796-e531-4508-8585-0d110f4bd4e7'), owner=OwnerMeta(userid='bff6dc118f2e4efc8d499d4614565377', username='tempest-ServerActionsV293TestJSON-716114863-project-member', projectid='23e37a40d1db45cba9235de04219a3b4', projectname='tempest-ServerActionsV293TestJSON-716114863'), image=ImageMeta(id='', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6835d977-7c34-4bd7-8d12-208432ea45d3", "address": "fa:16:3e:91:a6:69", "network": {"id": "2043727d-617f-4eff-98e6-5d58f439532d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1616658634-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e37a40d1db45cba9235de04219a3b4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6835d977-7c", "ovs_interfaceid": "6835d977-7c34-4bd7-8d12-208432ea45d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933229.665701) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:53:49.668827 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:53:49.670433 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:53:49.673018 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:53:49.674408 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:53:49.675598 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:53:49.675944 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-28T01:49:31Z,direct_url=<?>,disk_format='qcow2',id=160eac6b-3e35-4339-bdf4-c5b84e5687ff,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-28T01:49:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:53:49.676152 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:53:49.677948 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:53:49.677948 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:53:49.677948 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:53:49.677948 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:53:49.678217 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:53:49.678386 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:53:49.679165 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:53:49.679297 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:53:49.679439 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:53:49.679625 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Lazy-loading 'vcpu_model' on Instance uuid f2805796-e531-4508-8585-0d110f4bd4e7 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:53:49.776543 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Took 3.18 seconds to destroy the instance on the hypervisor.
May 28 01:53:49.778639 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:53:49.778639 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:53:49.778639 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:53:49.778639 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:53:49.787037 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-75022dff-efb4-4d23-a2ab-0319a3ac9415 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:49.787269 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-75022dff-efb4-4d23-a2ab-0319a3ac9415 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:49.835687 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7294ca7e-92c1-4410-9956-efebe876d3a1 req-9f75d8a5-9bd7-46c1-b47d-aa9a16e813d0 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-vif-unplugged-9e08628c-1ff2-4d4b-9f3d-50231fa6ceec {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:53:49.836858 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7294ca7e-92c1-4410-9956-efebe876d3a1 req-9f75d8a5-9bd7-46c1-b47d-aa9a16e813d0 service nova] Acquiring lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:49.836964 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7294ca7e-92c1-4410-9956-efebe876d3a1 req-9f75d8a5-9bd7-46c1-b47d-aa9a16e813d0 service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:49.838924 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7294ca7e-92c1-4410-9956-efebe876d3a1 req-9f75d8a5-9bd7-46c1-b47d-aa9a16e813d0 service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:49.838924 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7294ca7e-92c1-4410-9956-efebe876d3a1 req-9f75d8a5-9bd7-46c1-b47d-aa9a16e813d0 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] No waiting events found dispatching network-vif-unplugged-9e08628c-1ff2-4d4b-9f3d-50231fa6ceec {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:53:49.838924 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7294ca7e-92c1-4410-9956-efebe876d3a1 req-9f75d8a5-9bd7-46c1-b47d-aa9a16e813d0 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-vif-unplugged-9e08628c-1ff2-4d4b-9f3d-50231fa6ceec for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:53:49.838924 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7294ca7e-92c1-4410-9956-efebe876d3a1 req-9f75d8a5-9bd7-46c1-b47d-aa9a16e813d0 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-vif-unplugged-9e08628c-1ff2-4d4b-9f3d-50231fa6ceec {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:53:49.838924 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7294ca7e-92c1-4410-9956-efebe876d3a1 req-9f75d8a5-9bd7-46c1-b47d-aa9a16e813d0 service nova] Acquiring lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:49.838924 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7294ca7e-92c1-4410-9956-efebe876d3a1 req-9f75d8a5-9bd7-46c1-b47d-aa9a16e813d0 service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:49.838924 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7294ca7e-92c1-4410-9956-efebe876d3a1 req-9f75d8a5-9bd7-46c1-b47d-aa9a16e813d0 service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:49.838924 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7294ca7e-92c1-4410-9956-efebe876d3a1 req-9f75d8a5-9bd7-46c1-b47d-aa9a16e813d0 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] No waiting events found dispatching network-vif-unplugged-9e08628c-1ff2-4d4b-9f3d-50231fa6ceec {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:53:49.838924 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7294ca7e-92c1-4410-9956-efebe876d3a1 req-9f75d8a5-9bd7-46c1-b47d-aa9a16e813d0 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-vif-unplugged-9e08628c-1ff2-4d4b-9f3d-50231fa6ceec for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:53:49.838924 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7294ca7e-92c1-4410-9956-efebe876d3a1 req-9f75d8a5-9bd7-46c1-b47d-aa9a16e813d0 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-vif-unplugged-f5e93ea0-a679-45fb-9178-3842154f2e4d {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:53:49.838924 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7294ca7e-92c1-4410-9956-efebe876d3a1 req-9f75d8a5-9bd7-46c1-b47d-aa9a16e813d0 service nova] Acquiring lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:49.838924 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7294ca7e-92c1-4410-9956-efebe876d3a1 req-9f75d8a5-9bd7-46c1-b47d-aa9a16e813d0 service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:49.839441 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7294ca7e-92c1-4410-9956-efebe876d3a1 req-9f75d8a5-9bd7-46c1-b47d-aa9a16e813d0 service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:49.839663 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7294ca7e-92c1-4410-9956-efebe876d3a1 req-9f75d8a5-9bd7-46c1-b47d-aa9a16e813d0 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] No waiting events found dispatching network-vif-unplugged-f5e93ea0-a679-45fb-9178-3842154f2e4d {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:53:49.839838 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7294ca7e-92c1-4410-9956-efebe876d3a1 req-9f75d8a5-9bd7-46c1-b47d-aa9a16e813d0 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-vif-unplugged-f5e93ea0-a679-45fb-9178-3842154f2e4d for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:53:49.840022 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7294ca7e-92c1-4410-9956-efebe876d3a1 req-9f75d8a5-9bd7-46c1-b47d-aa9a16e813d0 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-vif-unplugged-f5e93ea0-a679-45fb-9178-3842154f2e4d {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:53:49.840418 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7294ca7e-92c1-4410-9956-efebe876d3a1 req-9f75d8a5-9bd7-46c1-b47d-aa9a16e813d0 service nova] Acquiring lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:49.840647 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7294ca7e-92c1-4410-9956-efebe876d3a1 req-9f75d8a5-9bd7-46c1-b47d-aa9a16e813d0 service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:49.840783 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7294ca7e-92c1-4410-9956-efebe876d3a1 req-9f75d8a5-9bd7-46c1-b47d-aa9a16e813d0 service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:49.840963 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7294ca7e-92c1-4410-9956-efebe876d3a1 req-9f75d8a5-9bd7-46c1-b47d-aa9a16e813d0 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] No waiting events found dispatching network-vif-unplugged-f5e93ea0-a679-45fb-9178-3842154f2e4d {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:53:49.841127 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7294ca7e-92c1-4410-9956-efebe876d3a1 req-9f75d8a5-9bd7-46c1-b47d-aa9a16e813d0 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-vif-unplugged-f5e93ea0-a679-45fb-9178-3842154f2e4d for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:53:49.841333 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7294ca7e-92c1-4410-9956-efebe876d3a1 req-9f75d8a5-9bd7-46c1-b47d-aa9a16e813d0 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-vif-unplugged-91f6bd16-2cfa-44ca-a7ea-ef3ef4933092 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:53:49.841470 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7294ca7e-92c1-4410-9956-efebe876d3a1 req-9f75d8a5-9bd7-46c1-b47d-aa9a16e813d0 service nova] Acquiring lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:49.841558 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7294ca7e-92c1-4410-9956-efebe876d3a1 req-9f75d8a5-9bd7-46c1-b47d-aa9a16e813d0 service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:49.841672 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7294ca7e-92c1-4410-9956-efebe876d3a1 req-9f75d8a5-9bd7-46c1-b47d-aa9a16e813d0 service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:49.841808 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7294ca7e-92c1-4410-9956-efebe876d3a1 req-9f75d8a5-9bd7-46c1-b47d-aa9a16e813d0 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] No waiting events found dispatching network-vif-unplugged-91f6bd16-2cfa-44ca-a7ea-ef3ef4933092 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:53:49.841936 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7294ca7e-92c1-4410-9956-efebe876d3a1 req-9f75d8a5-9bd7-46c1-b47d-aa9a16e813d0 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-vif-unplugged-91f6bd16-2cfa-44ca-a7ea-ef3ef4933092 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:53:49.842057 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7294ca7e-92c1-4410-9956-efebe876d3a1 req-9f75d8a5-9bd7-46c1-b47d-aa9a16e813d0 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-vif-unplugged-91f6bd16-2cfa-44ca-a7ea-ef3ef4933092 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:53:49.842676 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7294ca7e-92c1-4410-9956-efebe876d3a1 req-9f75d8a5-9bd7-46c1-b47d-aa9a16e813d0 service nova] Acquiring lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:49.842880 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7294ca7e-92c1-4410-9956-efebe876d3a1 req-9f75d8a5-9bd7-46c1-b47d-aa9a16e813d0 service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:49.843051 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7294ca7e-92c1-4410-9956-efebe876d3a1 req-9f75d8a5-9bd7-46c1-b47d-aa9a16e813d0 service nova] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:49.843857 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7294ca7e-92c1-4410-9956-efebe876d3a1 req-9f75d8a5-9bd7-46c1-b47d-aa9a16e813d0 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] No waiting events found dispatching network-vif-unplugged-91f6bd16-2cfa-44ca-a7ea-ef3ef4933092 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:53:49.844012 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7294ca7e-92c1-4410-9956-efebe876d3a1 req-9f75d8a5-9bd7-46c1-b47d-aa9a16e813d0 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-vif-unplugged-91f6bd16-2cfa-44ca-a7ea-ef3ef4933092 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:53:50.002345 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:50.080618 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Received event <DeviceRemovedEvent: 1779933230.0802765, bad69594-f163-41a6-931f-d2fcda0cb7d1 => ua-d64c94a0-49df-4115-a2f7-19f68645f860> from libvirt while the driver is waiting for it; dispatched. {{(pid=98241) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 01:53:50.082423 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3ef0aaa7-b40a-43cf-95b9-e2373b1b395e tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-d64c94a0-49df-4115-a2f7-19f68645f860 for instance bad69594-f163-41a6-931f-d2fcda0cb7d1 {{(pid=98241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 01:53:50.085801 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-3ef0aaa7-b40a-43cf-95b9-e2373b1b395e tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Successfully detached device vdb from instance bad69594-f163-41a6-931f-d2fcda0cb7d1 from the live domain config.
May 28 01:53:50.164923 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:53:50.202866 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:53:50.203589 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9', 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ac79736b-8037-45cb-a9eb-510556b680f9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:53:50.203894 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:53:50.205066 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:53:50.205066 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9', 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ac79736b-8037-45cb-a9eb-510556b680f9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:53:50.217126 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:53:50.217455 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:53:50.217613 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:53:50.218365 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:53:50.218891 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:53:50.219064 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:53:50.230952 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:53:50.230952 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:50.247610 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9] added
May 28 01:53:50.247610 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:53:50.247610 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:53:50.247610 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:53:50.247610 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:53:50.247610 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:53:50.247610 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:50.250236 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:53:50.250517 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:53:50.250517 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:50.250718 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0328(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:53:50.251275 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:53:50.265532 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9] added
May 28 01:53:50.265532 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:53:50.265532 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:53:50.265532 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:53:50.265532 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:53:50.265532 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:53:50.265532 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:50.265860 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:53:50.265977 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0468(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:53:50.266245 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:53:50.315794 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-75022dff-efb4-4d23-a2ab-0319a3ac9415 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:53:50.315794 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-75022dff-efb4-4d23-a2ab-0319a3ac9415 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:53:50.493449 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-e69db70d-074b-4882-8d3d-88b56b8c493f req-9dbb0bb6-4fcd-4aae-8f0d-abc2842cad3d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:53:50.653667 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-3ef0aaa7-b40a-43cf-95b9-e2373b1b395e tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Detected multiple connections on this host for volume: d64c94a0-49df-4115-a2f7-19f68645f860, skipping target disconnect.
May 28 01:53:50.822992 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-75022dff-efb4-4d23-a2ab-0319a3ac9415 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:53:51.187932 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-e69db70d-074b-4882-8d3d-88b56b8c493f req-9dbb0bb6-4fcd-4aae-8f0d-abc2842cad3d service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Updated VIF entry in instance network info cache for port 828d441a-570b-4f98-b093-4eb521ee2cf8. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:53:51.188476 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-e69db70d-074b-4882-8d3d-88b56b8c493f req-9dbb0bb6-4fcd-4aae-8f0d-abc2842cad3d service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Updating instance_info_cache with network_info: [{"id": "828d441a-570b-4f98-b093-4eb521ee2cf8", "address": "fa:16:3e:f5:ed:7d", "network": {"id": "34ab0ff0-75dd-45e7-97f6-22f8e62a8149", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1222751470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d31342458ec4ed2890a766f62facbcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap828d441a-57", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:53:51.192528 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:53:51.192528 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:53:51.192528 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] No VIF found with MAC fa:16:3e:ca:36:a6, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:53:51.192528 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Using config drive
May 28 01:53:51.226705 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-3ef0aaa7-b40a-43cf-95b9-e2373b1b395e tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lazy-loading 'flavor' on Instance uuid bad69594-f163-41a6-931f-d2fcda0cb7d1 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:53:51.251476 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:53:51.268760 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:53:51.279375 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:53:51.279375 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:53:51.290621 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:53:51.290621 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:51.301541 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:51.306510 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:51.323866 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:51.323866 np0000001583 nova-compute[98241]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:51.323866 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:53:51.323866 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsi session list stdout=tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:51.323866 np0000001583 nova-compute[98241]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:51.323866 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:53:51.324459 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:51.324459 np0000001583 nova-compute[98241]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:51.324459 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:53:51.324665 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsi session list stdout=tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:51.324665 np0000001583 nova-compute[98241]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:51.324665 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:53:51.333782 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-75022dff-efb4-4d23-a2ab-0319a3ac9415 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.546s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:51.342356 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:51.367322 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9, portal: 192.168.40.100,3260]
May 28 01:53:51.367322 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9, portal: 192.168.40.100,3260] successful.
May 28 01:53:51.367322 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:51.383898 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:51.384367 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9, portal: 192.168.50.100,3260]
May 28 01:53:51.384367 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9, portal: 192.168.50.100,3260] successful.
May 28 01:53:51.384367 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:51.400010 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:51.411668 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:51.411668 np0000001583 nova-compute[98241]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:51.411668 np0000001583 nova-compute[98241]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:51.411668 np0000001583 nova-compute[98241]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:51.411668 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:53:51.411986 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsi session list stdout=tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:51.411986 np0000001583 nova-compute[98241]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:51.411986 np0000001583 nova-compute[98241]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:51.411986 np0000001583 nova-compute[98241]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:51.411986 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:53:51.412217 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.195s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:53:51.412308 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:53:51.413046 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] HCTL ('7', '-', '-', 0) found on session 24 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:53:51.413536 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:53:51.423051 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:51.423051 np0000001583 nova-compute[98241]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:51.423051 np0000001583 nova-compute[98241]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:51.423051 np0000001583 nova-compute[98241]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:51.423051 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:53:51.424275 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsi session list stdout=tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:51.424275 np0000001583 nova-compute[98241]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:51.424275 np0000001583 nova-compute[98241]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:51.424275 np0000001583 nova-compute[98241]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:51.424275 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:53:51.424901 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.206s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:53:51.425335 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:53:51.426911 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] HCTL ('8', '-', '-', 0) found on session 25 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:53:51.426911 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:53:51.437655 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Searching for a device in session 24 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:53:51.437655 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ac79736b-8037-45cb-a9eb-510556b680f9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:53:51.450025 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Searching for a device in session 25 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:53:51.450025 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ac79736b-8037-45cb-a9eb-510556b680f9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:53:51.691588 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e69db70d-074b-4882-8d3d-88b56b8c493f req-9dbb0bb6-4fcd-4aae-8f0d-abc2842cad3d service nova] Releasing lock "refresh_cache-adfbfdf0-7c0f-4834-92ff-3b8d8c39e333" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:53:51.698279 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:53:51.839547 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-75022dff-efb4-4d23-a2ab-0319a3ac9415 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 14.544s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:51.883423 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Creating config drive at /opt/stack/data/nova/instances/e73ac672-0911-4e4d-8a85-9b635a9e836f/disk.config
May 28 01:53:51.888321 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e73ac672-0911-4e4d-8a85-9b635a9e836f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_okqluwh {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:53:51.937458 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e73ac672-0911-4e4d-8a85-9b635a9e836f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_okqluwh" returned: 0 in 0.049s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:53:52.179724 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-56968c6e-261d-4b6f-a7ff-e4d700abd54c req-b15b37cb-2f7d-4f09-ba2a-07fa29155e54 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-vif-deleted-a566955f-6906-4a3b-bdf1-2f55b31b6e21 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:53:52.179932 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-56968c6e-261d-4b6f-a7ff-e4d700abd54c req-b15b37cb-2f7d-4f09-ba2a-07fa29155e54 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Neutron deleted interface a566955f-6906-4a3b-bdf1-2f55b31b6e21; detaching it from the instance and deleting it from the info cache
May 28 01:53:52.182619 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-56968c6e-261d-4b6f-a7ff-e4d700abd54c req-b15b37cb-2f7d-4f09-ba2a-07fa29155e54 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Detach interface failed, port_id=a566955f-6906-4a3b-bdf1-2f55b31b6e21, reason: Instance d3a7c39a-f946-496d-9153-0a422e7f5350 could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:53:52.220048 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:53:52.238468 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3ef0aaa7-b40a-43cf-95b9-e2373b1b395e tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "bad69594-f163-41a6-931f-d2fcda0cb7d1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.434s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:52.356520 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Acquiring lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:52.356520 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:52.356520 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Unshelving
May 28 01:53:52.436482 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:52.465972 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:52.466821 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:52.582571 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:52.835017 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:52.866892 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:52.870439 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:52.874500 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:52.896452 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:52.897692 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:52.906694 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2a6c78c2-e784-4c85-87d6-90adae964bc7 req-a821213a-b6d6-4baf-9b3b-0ece4f92416e service nova] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Received event network-vif-plugged-ae1eb56b-d3c2-441b-9339-b2d96192924c {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:53:52.906694 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2a6c78c2-e784-4c85-87d6-90adae964bc7 req-a821213a-b6d6-4baf-9b3b-0ece4f92416e service nova] Acquiring lock "e73ac672-0911-4e4d-8a85-9b635a9e836f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:52.906694 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2a6c78c2-e784-4c85-87d6-90adae964bc7 req-a821213a-b6d6-4baf-9b3b-0ece4f92416e service nova] Lock "e73ac672-0911-4e4d-8a85-9b635a9e836f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:52.906694 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2a6c78c2-e784-4c85-87d6-90adae964bc7 req-a821213a-b6d6-4baf-9b3b-0ece4f92416e service nova] Lock "e73ac672-0911-4e4d-8a85-9b635a9e836f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:52.906694 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2a6c78c2-e784-4c85-87d6-90adae964bc7 req-a821213a-b6d6-4baf-9b3b-0ece4f92416e service nova] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Processing event network-vif-plugged-ae1eb56b-d3c2-441b-9339-b2d96192924c {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:53:53.241932 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Found WWN 330000000dd10e4b9 for multipath device dm-0 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:53:53.242464 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:53:53.242703 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] <== connect_volume: return (3038ms) {'type': 'block', 'scsi_wwn': '330000000dd10e4b9', 'path': '/dev/dm-0', 'multipath_id': '330000000dd10e4b9'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:53:53.242882 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000dd10e4b9', 'path': '/dev/dm-0', 'multipath_id': '330000000dd10e4b9'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:53:53.450332 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:53:53.451122 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933233.450627, e73ac672-0911-4e4d-8a85-9b635a9e836f => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:53:53.451370 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] VM Started (Lifecycle Event)
May 28 01:53:53.457225 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:53:53.459439 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Instance spawned successfully.
May 28 01:53:53.460395 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:53:53.618652 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7926c433-e9a1-4297-869a-5ba20ebf8ec0 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Acquiring lock "1291c6e1-108e-46d1-85bc-0197f71eec1f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:53.618874 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7926c433-e9a1-4297-869a-5ba20ebf8ec0 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "1291c6e1-108e-46d1-85bc-0197f71eec1f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:53.697679 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0026686930000323628 future=<Future at 0x7724f831b980 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:53:53.697909 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:53:53.697967 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=0.8809344539999984 future=<Future at 0x7724f844ffe0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:53:53.698093 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=0.8808375109999815 future=<Future at 0x7724f844ffe0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:53:53.698280 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1779933218.6949112, adfbfdf0-7c0f-4834-92ff-3b8d8c39e333 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:53:53.698379 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] VM Stopped (Lifecycle Event)
May 28 01:53:53.749035 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T01:52:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1075767386',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-serveractionsv293testjson-server-2040873444',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNU/wFJvIXv98vi6aYo5JdgOO26yK3H8M5Fwr9L6B9TgZZAeaxeYClgf/riTA9gRggFDSHAHQ2WWHr+BBFeB2YnkUvKZLTUbGagtUk9wt6ZgeubZXG0bqVpSP2PvleXU0w==',key_name='tempest-keypair-1710605134',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:52:48Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='23e37a40d1db45cba9235de04219a3b4',ramdisk_id='',reservation_id='r-0idxh519',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='160eac6b-3e35-4339-bdf4-c5b84e5687ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-716114863',owner_user_name='tempest-ServerActionsV293TestJSON-716114863-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:53:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bff6dc118f2e4efc8d499d4614565377',uuid=f2805796-e531-4508-8585-0d110f4bd4e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6835d977-7c34-4bd7-8d12-208432ea45d3", "address": "fa:16:3e:91:a6:69", "network": {"id": "2043727d-617f-4eff-98e6-5d58f439532d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1616658634-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e37a40d1db45cba9235de04219a3b4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6835d977-7c", "ovs_interfaceid": "6835d977-7c34-4bd7-8d12-208432ea45d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:53:53.749322 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Converting VIF {"id": "6835d977-7c34-4bd7-8d12-208432ea45d3", "address": "fa:16:3e:91:a6:69", "network": {"id": "2043727d-617f-4eff-98e6-5d58f439532d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1616658634-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e37a40d1db45cba9235de04219a3b4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6835d977-7c", "ovs_interfaceid": "6835d977-7c34-4bd7-8d12-208432ea45d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:53:53.749909 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:a6:69,bridge_name='br-int',has_traffic_filtering=True,id=6835d977-7c34-4bd7-8d12-208432ea45d3,network=Network(2043727d-617f-4eff-98e6-5d58f439532d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6835d977-7c') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:53:53.752405 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] End _get_guest_xml xml=<domain type="qemu">
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:   <uuid>f2805796-e531-4508-8585-0d110f4bd4e7</uuid>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:   <name>instance-00000008</name>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1075767386</nova:name>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:53:49</nova:creationTime>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:       <nova:image uuid="160eac6b-3e35-4339-bdf4-c5b84e5687ff">
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:         <nova:user uuid="bff6dc118f2e4efc8d499d4614565377">tempest-ServerActionsV293TestJSON-716114863-project-member</nova:user>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:         <nova:project uuid="23e37a40d1db45cba9235de04219a3b4">tempest-ServerActionsV293TestJSON-716114863</nova:project>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:       <nova:root type="volume" uuid="160eac6b-3e35-4339-bdf4-c5b84e5687ff"/>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:         <nova:port uuid="6835d977-7c34-4bd7-8d12-208432ea45d3">
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:     <system>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:       <entry name="serial">f2805796-e531-4508-8585-0d110f4bd4e7</entry>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:       <entry name="uuid">f2805796-e531-4508-8585-0d110f4bd4e7</entry>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:     </system>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:   <os>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:   </os>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:   <features>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:   </features>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:   <devices>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/f2805796-e531-4508-8585-0d110f4bd4e7/disk.config"/>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:     </disk>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:     <disk type="block" device="disk">
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:       <alias name="ua-ac79736b-8037-45cb-a9eb-510556b680f9"/>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:       <source dev="/dev/dm-0"/>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:       <serial>ac79736b-8037-45cb-a9eb-510556b680f9</serial>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:     </disk>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:91:a6:69"/>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:       <target dev="tap6835d977-7c"/>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:     </interface>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/f2805796-e531-4508-8585-0d110f4bd4e7/console.log" append="off"/>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:     </serial>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:     <video>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:     </video>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:     </rng>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:   </devices>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]: </domain>
May 28 01:53:53.752405 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:53:53.755218 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T01:52:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1075767386',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-serveractionsv293testjson-server-2040873444',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNU/wFJvIXv98vi6aYo5JdgOO26yK3H8M5Fwr9L6B9TgZZAeaxeYClgf/riTA9gRggFDSHAHQ2WWHr+BBFeB2YnkUvKZLTUbGagtUk9wt6ZgeubZXG0bqVpSP2PvleXU0w==',key_name='tempest-keypair-1710605134',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:52:48Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='23e37a40d1db45cba9235de04219a3b4',ramdisk_id='',reservation_id='r-0idxh519',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='160eac6b-3e35-4339-bdf4-c5b84e5687ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-716114863',owner_user_name='tempest-ServerActionsV293TestJSON-716114863-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:53:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bff6dc118f2e4efc8d499d4614565377',uuid=f2805796-e531-4508-8585-0d110f4bd4e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6835d977-7c34-4bd7-8d12-208432ea45d3", "address": "fa:16:3e:91:a6:69", "network": {"id": "2043727d-617f-4eff-98e6-5d58f439532d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1616658634-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e37a40d1db45cba9235de04219a3b4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6835d977-7c", "ovs_interfaceid": "6835d977-7c34-4bd7-8d12-208432ea45d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:53:53.755218 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Converting VIF {"id": "6835d977-7c34-4bd7-8d12-208432ea45d3", "address": "fa:16:3e:91:a6:69", "network": {"id": "2043727d-617f-4eff-98e6-5d58f439532d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1616658634-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e37a40d1db45cba9235de04219a3b4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6835d977-7c", "ovs_interfaceid": "6835d977-7c34-4bd7-8d12-208432ea45d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:53:53.755218 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:a6:69,bridge_name='br-int',has_traffic_filtering=True,id=6835d977-7c34-4bd7-8d12-208432ea45d3,network=Network(2043727d-617f-4eff-98e6-5d58f439532d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6835d977-7c') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:53:53.755218 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:a6:69,bridge_name='br-int',has_traffic_filtering=True,id=6835d977-7c34-4bd7-8d12-208432ea45d3,network=Network(2043727d-617f-4eff-98e6-5d58f439532d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6835d977-7c') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:53:53.755218 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:53.755218 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:53:53.755218 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:53:53.757595 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:53.757871 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4d9e3ddd-48da-5b7a-8d36-e614876a03df', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:53:53.759360 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:53.760361 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:53:53.762185 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:53.768792 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:53.769047 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6835d977-7c, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:53:53.769561 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6835d977-7c, col_values=(('qos', UUID('b4cd9a3e-c2e1-4964-b9d1-413cc2e0a383')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:53:53.769795 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6835d977-7c, col_values=(('external_ids', {'iface-id': '6835d977-7c34-4bd7-8d12-208432ea45d3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:a6:69', 'vm-uuid': 'f2805796-e531-4508-8585-0d110f4bd4e7'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:53:53.771462 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:53.772640 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:53:53.870199 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Booting with volume a2c5c258-e7db-4399-802e-b94d13fd2b42 at /dev/vdc
May 28 01:53:53.892515 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:53.896458 np0000001583 nova-compute[98241]: INFO os_vif [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:a6:69,bridge_name='br-int',has_traffic_filtering=True,id=6835d977-7c34-4bd7-8d12-208432ea45d3,network=Network(2043727d-617f-4eff-98e6-5d58f439532d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6835d977-7c')
May 28 01:53:53.899795 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:53.946412 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:53:53.955128 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:53:53.961232 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:53:53.962857 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:53:53.973092 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:53:53.973565 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:53:53.974006 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:53:53.974661 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:53:53.975019 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:53:53.975546 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:53:53.998664 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:53:54.037061 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:53:54.037574 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:53:54.053108 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:53:54.057619 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe45:c5fe', 'fe80::e05c:5bff:fea5:7965', 'fe80::fc16:3eff:fe52:6a', 'fe80::fc16:3eff:fe63:2bb1', 'fe80::e43a:d5ff:fecc:27fe', 'fe80::fc16:3eff:feca:36a6', 'fe80::dc2c:bbff:fe55:4bf7'] 
May 28 01:53:54.057619 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:53:54.058642 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:53:54.058642 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:53:54.058642 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Updating existing volume attachment record: fcf9c1e2-6989-4fff-b74c-ad0c43974e1b {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:53:54.124072 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-7926c433-e9a1-4297-869a-5ba20ebf8ec0 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Detaching volume d64c94a0-49df-4115-a2f7-19f68645f860
May 28 01:53:54.188004 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-7926c433-e9a1-4297-869a-5ba20ebf8ec0 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Attempting to driver detach volume d64c94a0-49df-4115-a2f7-19f68645f860 from mountpoint /dev/vdb
May 28 01:53:54.192942 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-7926c433-e9a1-4297-869a-5ba20ebf8ec0 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Found disk vdb by alias ua-d64c94a0-49df-4115-a2f7-19f68645f860 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:53:54.194711 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-7926c433-e9a1-4297-869a-5ba20ebf8ec0 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Found disk vdb by alias ua-d64c94a0-49df-4115-a2f7-19f68645f860 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:53:54.195013 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-7926c433-e9a1-4297-869a-5ba20ebf8ec0 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Attempting to detach device vdb from instance 1291c6e1-108e-46d1-85bc-0197f71eec1f from the persistent domain config. {{(pid=98241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 01:53:54.195555 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-7926c433-e9a1-4297-869a-5ba20ebf8ec0 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:53:54.195555 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:53:54.195555 np0000001583 nova-compute[98241]:   <alias name="ua-d64c94a0-49df-4115-a2f7-19f68645f860"/>
May 28 01:53:54.195555 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-9"/>
May 28 01:53:54.195555 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 01:53:54.195555 np0000001583 nova-compute[98241]:   <serial>d64c94a0-49df-4115-a2f7-19f68645f860</serial>
May 28 01:53:54.195555 np0000001583 nova-compute[98241]:   <shareable/>
May 28 01:53:54.195555 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:53:54.195555 np0000001583 nova-compute[98241]: </disk>
May 28 01:53:54.195555 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:53:54.203155 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-7926c433-e9a1-4297-869a-5ba20ebf8ec0 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Successfully detached device vdb from instance 1291c6e1-108e-46d1-85bc-0197f71eec1f from the persistent domain config.
May 28 01:53:54.203367 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-7926c433-e9a1-4297-869a-5ba20ebf8ec0 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] (1/8): Attempting to detach device vdb with device alias ua-d64c94a0-49df-4115-a2f7-19f68645f860 from instance 1291c6e1-108e-46d1-85bc-0197f71eec1f from the live domain config. {{(pid=98241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 01:53:54.203704 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-7926c433-e9a1-4297-869a-5ba20ebf8ec0 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:53:54.203704 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:53:54.203704 np0000001583 nova-compute[98241]:   <alias name="ua-d64c94a0-49df-4115-a2f7-19f68645f860"/>
May 28 01:53:54.203704 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-9"/>
May 28 01:53:54.203704 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 01:53:54.203704 np0000001583 nova-compute[98241]:   <serial>d64c94a0-49df-4115-a2f7-19f68645f860</serial>
May 28 01:53:54.203704 np0000001583 nova-compute[98241]:   <shareable/>
May 28 01:53:54.203704 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:53:54.203704 np0000001583 nova-compute[98241]: </disk>
May 28 01:53:54.203704 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:53:54.205831 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a48597d6-d1e4-4992-8756-342c7ee11329 None None] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:53:54.274595 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-8856baab-4054-423c-bbd0-8d796875292f req-361b1e20-7e53-48dd-b585-bf917d757188 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-vif-deleted-f5e93ea0-a679-45fb-9178-3842154f2e4d {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:53:54.276587 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-8856baab-4054-423c-bbd0-8d796875292f req-361b1e20-7e53-48dd-b585-bf917d757188 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Neutron deleted interface f5e93ea0-a679-45fb-9178-3842154f2e4d; detaching it from the instance and deleting it from the info cache
May 28 01:53:54.276888 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-8856baab-4054-423c-bbd0-8d796875292f req-361b1e20-7e53-48dd-b585-bf917d757188 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Detach interface failed, port_id=f5e93ea0-a679-45fb-9178-3842154f2e4d, reason: Instance d3a7c39a-f946-496d-9153-0a422e7f5350 could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:53:54.277376 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-8856baab-4054-423c-bbd0-8d796875292f req-361b1e20-7e53-48dd-b585-bf917d757188 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-vif-deleted-91f6bd16-2cfa-44ca-a7ea-ef3ef4933092 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:53:54.277376 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-8856baab-4054-423c-bbd0-8d796875292f req-361b1e20-7e53-48dd-b585-bf917d757188 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Neutron deleted interface 91f6bd16-2cfa-44ca-a7ea-ef3ef4933092; detaching it from the instance and deleting it from the info cache
May 28 01:53:54.277937 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-8856baab-4054-423c-bbd0-8d796875292f req-361b1e20-7e53-48dd-b585-bf917d757188 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Detach interface failed, port_id=91f6bd16-2cfa-44ca-a7ea-ef3ef4933092, reason: Instance d3a7c39a-f946-496d-9153-0a422e7f5350 could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:53:54.278050 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-8856baab-4054-423c-bbd0-8d796875292f req-361b1e20-7e53-48dd-b585-bf917d757188 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-vif-deleted-0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:53:54.278167 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-8856baab-4054-423c-bbd0-8d796875292f req-361b1e20-7e53-48dd-b585-bf917d757188 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Neutron deleted interface 0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8; detaching it from the instance and deleting it from the info cache
May 28 01:53:54.279875 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-8856baab-4054-423c-bbd0-8d796875292f req-361b1e20-7e53-48dd-b585-bf917d757188 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Detach interface failed, port_id=0e04c6bd-fbbd-44e0-b08e-99fc1f2a70c8, reason: Instance d3a7c39a-f946-496d-9153-0a422e7f5350 could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:53:54.463653 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:53:54.464034 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933234.4636972, e73ac672-0911-4e4d-8a85-9b635a9e836f => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:53:54.464197 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] VM Paused (Lifecycle Event)
May 28 01:53:54.484546 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Took 9.11 seconds to spawn the instance on the hypervisor.
May 28 01:53:54.484760 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:53:54.571484 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:53:54.579397 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.000438672999962364 future=<Future at 0x7724f844ffe0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:53:54.579516 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:53:54.579582 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=7.681033672000012 future=<Future at 0x7724f82a2120 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:53:54.579728 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=7.680956987000172 future=<Future at 0x7724f82a2120 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:53:54.580064 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Emitting event <LifecycleEvent: 1779933219.5788522, 02b42340-8535-4682-98db-49f970ff5597 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:53:54.580298 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: 02b42340-8535-4682-98db-49f970ff5597] VM Stopped (Lifecycle Event)
May 28 01:53:54.972817 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:53:54.974960 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933234.9747126, e73ac672-0911-4e4d-8a85-9b635a9e836f => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:53:54.975222 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] VM Resumed (Lifecycle Event)
May 28 01:53:54.981307 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-43b724f2-1baf-4985-b1bf-20f6b28fec5d req-279e704d-536c-430d-913c-58ba19c32bf0 service nova] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Received event network-vif-plugged-ae1eb56b-d3c2-441b-9339-b2d96192924c {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:53:54.981730 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-43b724f2-1baf-4985-b1bf-20f6b28fec5d req-279e704d-536c-430d-913c-58ba19c32bf0 service nova] Acquiring lock "e73ac672-0911-4e4d-8a85-9b635a9e836f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:54.982013 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-43b724f2-1baf-4985-b1bf-20f6b28fec5d req-279e704d-536c-430d-913c-58ba19c32bf0 service nova] Lock "e73ac672-0911-4e4d-8a85-9b635a9e836f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:54.982013 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-43b724f2-1baf-4985-b1bf-20f6b28fec5d req-279e704d-536c-430d-913c-58ba19c32bf0 service nova] Lock "e73ac672-0911-4e4d-8a85-9b635a9e836f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:54.982148 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-43b724f2-1baf-4985-b1bf-20f6b28fec5d req-279e704d-536c-430d-913c-58ba19c32bf0 service nova] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] No waiting events found dispatching network-vif-plugged-ae1eb56b-d3c2-441b-9339-b2d96192924c {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:53:54.982313 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-43b724f2-1baf-4985-b1bf-20f6b28fec5d req-279e704d-536c-430d-913c-58ba19c32bf0 service nova] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Received unexpected event network-vif-plugged-ae1eb56b-d3c2-441b-9339-b2d96192924c for instance with vm_state active and task_state None.
May 28 01:53:54.982400 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-43b724f2-1baf-4985-b1bf-20f6b28fec5d req-279e704d-536c-430d-913c-58ba19c32bf0 service nova] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Received event network-vif-deleted-9e08628c-1ff2-4d4b-9f3d-50231fa6ceec {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:53:54.996289 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Took 14.90 seconds to build instance.
May 28 01:53:55.073628 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Took 5.30 seconds to deallocate network for instance.
May 28 01:53:55.082536 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: 02b42340-8535-4682-98db-49f970ff5597] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:53:55.098707 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:55.432105 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:53:55.432105 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:53:55.432105 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] No VIF found with MAC fa:16:3e:91:a6:69, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:53:55.432105 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Using config drive
May 28 01:53:55.481047 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:53:55.482591 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:53:55.498652 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Lock "e73ac672-0911-4e4d-8a85-9b635a9e836f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.406s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:55.775291 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:55.775482 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:55.779295 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lazy-loading 'pci_requests' on Instance uuid adfbfdf0-7c0f-4834-92ff-3b8d8c39e333 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:53:55.934286 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Lazy-loading 'ec2_ids' on Instance uuid f2805796-e531-4508-8585-0d110f4bd4e7 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:53:56.282448 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lazy-loading 'numa_topology' on Instance uuid adfbfdf0-7c0f-4834-92ff-3b8d8c39e333 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:53:56.394578 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Received event <DeviceRemovedEvent: 1779933236.3941946, 1291c6e1-108e-46d1-85bc-0197f71eec1f => ua-d64c94a0-49df-4115-a2f7-19f68645f860> from libvirt while the driver is waiting for it; dispatched. {{(pid=98241) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 01:53:56.396426 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-7926c433-e9a1-4297-869a-5ba20ebf8ec0 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-d64c94a0-49df-4115-a2f7-19f68645f860 for instance 1291c6e1-108e-46d1-85bc-0197f71eec1f {{(pid=98241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 01:53:56.398601 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-7926c433-e9a1-4297-869a-5ba20ebf8ec0 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Successfully detached device vdb from instance 1291c6e1-108e-46d1-85bc-0197f71eec1f from the live domain config.
May 28 01:53:56.431458 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7926c433-e9a1-4297-869a-5ba20ebf8ec0 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:53:56.431458 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7926c433-e9a1-4297-869a-5ba20ebf8ec0 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860', 'iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd64c94a0-49df-4115-a2f7-19f68645f860', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': False}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:53:56.431458 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-7926c433-e9a1-4297-869a-5ba20ebf8ec0 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:53:56.433862 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-7926c433-e9a1-4297-869a-5ba20ebf8ec0 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:53:56.433862 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7926c433-e9a1-4297-869a-5ba20ebf8ec0 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860', 'iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd64c94a0-49df-4115-a2f7-19f68645f860', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:53:56.434687 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7926c433-e9a1-4297-869a-5ba20ebf8ec0 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:53:56.438263 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Object Instance<f2805796-e531-4508-8585-0d110f4bd4e7> lazy-loaded attributes: vcpu_model,ec2_ids {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:53:56.438388 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Lazy-loading 'keypairs' on Instance uuid f2805796-e531-4508-8585-0d110f4bd4e7 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:53:56.467363 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7926c433-e9a1-4297-869a-5ba20ebf8ec0 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:56.467363 np0000001583 nova-compute[98241]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:56.467363 np0000001583 nova-compute[98241]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:56.467363 np0000001583 nova-compute[98241]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:56.467363 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:53:56.467704 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7926c433-e9a1-4297-869a-5ba20ebf8ec0 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] iscsi session list stdout=tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:56.467704 np0000001583 nova-compute[98241]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860 (non-flash)
May 28 01:53:56.467704 np0000001583 nova-compute[98241]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:56.467704 np0000001583 nova-compute[98241]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:53:56.467704 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:53:56.467704 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7926c433-e9a1-4297-869a-5ba20ebf8ec0 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860', '21'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9', '24'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9', '25')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:53:56.467960 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7926c433-e9a1-4297-869a-5ba20ebf8ec0 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860', '21')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:53:56.469133 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7926c433-e9a1-4297-869a-5ba20ebf8ec0 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860', '20')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:53:56.470792 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7926c433-e9a1-4297-869a-5ba20ebf8ec0 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f829fba0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860'): ({'sdn'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860'): ({'sdm'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:53:56.470925 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-7926c433-e9a1-4297-869a-5ba20ebf8ec0 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Removing multipathed devices sdm, sdn {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:53:56.471514 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-7926c433-e9a1-4297-869a-5ba20ebf8ec0 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Flush multipath device 3300000005550511b {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:53:56.508899 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-7926c433-e9a1-4297-869a-5ba20ebf8ec0 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:53:56.566241 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-7926c433-e9a1-4297-869a-5ba20ebf8ec0 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:53:56.613878 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-7926c433-e9a1-4297-869a-5ba20ebf8ec0 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Checking to see if SCSI volumes sdm, sdn have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:53:56.613878 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-7926c433-e9a1-4297-869a-5ba20ebf8ec0 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] SCSI volumes sdm, sdn have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:53:56.613878 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-7926c433-e9a1-4297-869a-5ba20ebf8ec0 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Checking to see if device paths {'sdm', 'sdn'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:53:56.627694 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-7926c433-e9a1-4297-869a-5ba20ebf8ec0 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Device paths {'sdm', 'sdn'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:53:56.627694 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7926c433-e9a1-4297-869a-5ba20ebf8ec0 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:53:56.650813 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7926c433-e9a1-4297-869a-5ba20ebf8ec0 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:56.678801 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7926c433-e9a1-4297-869a-5ba20ebf8ec0 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860, portal: 192.168.40.100,3260]
May 28 01:53:56.678801 np0000001583 nova-compute[98241]: Logout of [sid: 21, target: iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860, portal: 192.168.40.100,3260] successful.
May 28 01:53:56.678801 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:56.709531 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7926c433-e9a1-4297-869a-5ba20ebf8ec0 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:56.725714 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7926c433-e9a1-4297-869a-5ba20ebf8ec0 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:56.761999 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7926c433-e9a1-4297-869a-5ba20ebf8ec0 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860, portal: 192.168.50.100,3260]
May 28 01:53:56.761999 np0000001583 nova-compute[98241]: Logout of [sid: 20, target: iqn.2023-03.storpool.com:os--volume-d64c94a0-49df-4115-a2f7-19f68645f860, portal: 192.168.50.100,3260] successful.
May 28 01:53:56.761999 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:56.780622 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7926c433-e9a1-4297-869a-5ba20ebf8ec0 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:53:56.780980 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-7926c433-e9a1-4297-869a-5ba20ebf8ec0 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:53:56.781099 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7926c433-e9a1-4297-869a-5ba20ebf8ec0 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] <== disconnect_volume: return (349ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:53:56.781175 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7926c433-e9a1-4297-869a-5ba20ebf8ec0 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:53:56.786592 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:53:56.786592 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Claim successful on node np0000001583
May 28 01:53:56.793230 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:56.811529 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Took 1.74 seconds to detach 3 volumes for instance.
May 28 01:53:56.885765 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9d48009c-2947-4666-b5ac-d072187a3a69 req-64e13919-90f9-40e2-8bdd-2085ffb6d8c8 service nova] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Received event network-changed-ae1eb56b-d3c2-441b-9339-b2d96192924c {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:53:56.886719 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9d48009c-2947-4666-b5ac-d072187a3a69 req-64e13919-90f9-40e2-8bdd-2085ffb6d8c8 service nova] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Refreshing instance network info cache due to event network-changed-ae1eb56b-d3c2-441b-9339-b2d96192924c. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:53:56.886895 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9d48009c-2947-4666-b5ac-d072187a3a69 req-64e13919-90f9-40e2-8bdd-2085ffb6d8c8 service nova] Acquiring lock "refresh_cache-e73ac672-0911-4e4d-8a85-9b635a9e836f" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:53:56.887021 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9d48009c-2947-4666-b5ac-d072187a3a69 req-64e13919-90f9-40e2-8bdd-2085ffb6d8c8 service nova] Acquired lock "refresh_cache-e73ac672-0911-4e4d-8a85-9b635a9e836f" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:53:56.888253 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-9d48009c-2947-4666-b5ac-d072187a3a69 req-64e13919-90f9-40e2-8bdd-2085ffb6d8c8 service nova] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Refreshing network info cache for port ae1eb56b-d3c2-441b-9339-b2d96192924c {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:53:56.941733 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Object Instance<f2805796-e531-4508-8585-0d110f4bd4e7> lazy-loaded attributes: vcpu_model,ec2_ids,keypairs {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:53:56.944508 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.: NotImplementedError
May 28 01:53:57.081001 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Creating config drive at /opt/stack/data/nova/instances/f2805796-e531-4508-8585-0d110f4bd4e7/disk.config
May 28 01:53:57.086654 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f2805796-e531-4508-8585-0d110f4bd4e7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpk9swjbxb {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:53:57.125819 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f2805796-e531-4508-8585-0d110f4bd4e7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpk9swjbxb" returned: 0 in 0.039s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:53:57.317945 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:57.351440 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-7926c433-e9a1-4297-869a-5ba20ebf8ec0 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lazy-loading 'flavor' on Instance uuid 1291c6e1-108e-46d1-85bc-0197f71eec1f {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:53:57.390608 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-9d48009c-2947-4666-b5ac-d072187a3a69 req-64e13919-90f9-40e2-8bdd-2085ffb6d8c8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:53:57.632025 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:57.655765 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:57.657656 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:57.784406 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:57.839504 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:57.937635 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-9d48009c-2947-4666-b5ac-d072187a3a69 req-64e13919-90f9-40e2-8bdd-2085ffb6d8c8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:53:57.956665 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:58.072017 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:58.105591 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:58.183436 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-9d48009c-2947-4666-b5ac-d072187a3a69 req-64e13919-90f9-40e2-8bdd-2085ffb6d8c8 service nova] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Updated VIF entry in instance network info cache for port ae1eb56b-d3c2-441b-9339-b2d96192924c. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:53:58.183436 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-9d48009c-2947-4666-b5ac-d072187a3a69 req-64e13919-90f9-40e2-8bdd-2085ffb6d8c8 service nova] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Updating instance_info_cache with network_info: [{"id": "ae1eb56b-d3c2-441b-9339-b2d96192924c", "address": "fa:16:3e:ca:36:a6", "network": {"id": "a6357868-368f-400d-b8c9-8e8843bdfdda", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1753538248-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "02ba6b7c1fd84a7c8ed4e9f086f83fa0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae1eb56b-d3", "ovs_interfaceid": "ae1eb56b-d3c2-441b-9339-b2d96192924c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:53:58.357551 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7926c433-e9a1-4297-869a-5ba20ebf8ec0 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "1291c6e1-108e-46d1-85bc-0197f71eec1f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.738s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:58.373551 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:53:58.374109 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:53:58.564459 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933238.5639899, f2805796-e531-4508-8585-0d110f4bd4e7 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:53:58.564971 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] VM Resumed (Lifecycle Event)
May 28 01:53:58.565803 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Instance event wait completed in 0 seconds for  {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:53:58.566111 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:53:58.571405 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Instance spawned successfully.
May 28 01:53:58.571937 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:53:58.685291 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9d48009c-2947-4666-b5ac-d072187a3a69 req-64e13919-90f9-40e2-8bdd-2085ffb6d8c8 service nova] Releasing lock "refresh_cache-e73ac672-0911-4e4d-8a85-9b635a9e836f" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:53:58.776344 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:53:58.876929 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:53:59.069653 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:53:59.076319 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:53:59.085580 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:53:59.085743 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:53:59.086145 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:53:59.086569 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:53:59.086943 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:53:59.088596 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:53:59.388208 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.610s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:59.389826 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.070s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:59.392312 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:53:59.527917 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1fda1839-43ac-4794-9720-5286ea91b80d tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Acquiring lock "1291c6e1-108e-46d1-85bc-0197f71eec1f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:59.528249 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1fda1839-43ac-4794-9720-5286ea91b80d tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "1291c6e1-108e-46d1-85bc-0197f71eec1f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:59.529984 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1fda1839-43ac-4794-9720-5286ea91b80d tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Acquiring lock "1291c6e1-108e-46d1-85bc-0197f71eec1f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:59.530187 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1fda1839-43ac-4794-9720-5286ea91b80d tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "1291c6e1-108e-46d1-85bc-0197f71eec1f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:59.530447 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1fda1839-43ac-4794-9720-5286ea91b80d tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "1291c6e1-108e-46d1-85bc-0197f71eec1f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:59.535278 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-1fda1839-43ac-4794-9720-5286ea91b80d tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Terminating instance
May 28 01:53:59.548536 np0000001583 nova-compute[98241]: INFO nova.network.neutron [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Updating port 828d441a-570b-4f98-b093-4eb521ee2cf8 with attributes {'binding:host_id': 'np0000001583', 'device_owner': 'compute:nova'}
May 28 01:53:59.582631 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
May 28 01:53:59.582907 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933239.5827062, f2805796-e531-4508-8585-0d110f4bd4e7 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:53:59.583036 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] VM Started (Lifecycle Event)
May 28 01:53:59.597918 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:53:59.689011 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a1ac8ba3-b841-475e-af86-e6865df47bb9 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Acquiring lock "bad69594-f163-41a6-931f-d2fcda0cb7d1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:59.689011 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a1ac8ba3-b841-475e-af86-e6865df47bb9 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "bad69594-f163-41a6-931f-d2fcda0cb7d1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:59.690745 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a1ac8ba3-b841-475e-af86-e6865df47bb9 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Acquiring lock "bad69594-f163-41a6-931f-d2fcda0cb7d1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:53:59.690745 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a1ac8ba3-b841-475e-af86-e6865df47bb9 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "bad69594-f163-41a6-931f-d2fcda0cb7d1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:53:59.690745 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a1ac8ba3-b841-475e-af86-e6865df47bb9 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "bad69594-f163-41a6-931f-d2fcda0cb7d1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:53:59.693017 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-a1ac8ba3-b841-475e-af86-e6865df47bb9 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Terminating instance
May 28 01:53:59.945016 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:53:59.945337 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:54:00.043121 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1fda1839-43ac-4794-9720-5286ea91b80d tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:54:00.065109 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:00.069094 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:00.087067 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:54:00.091764 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:54:00.094949 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:00.114129 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:00.197825 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a1ac8ba3-b841-475e-af86-e6865df47bb9 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:54:00.230953 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:00.257610 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:00.288308 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:00.301137 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:00.327943 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:00.367994 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:00.404277 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-98e8fcd0-d8d7-4d49-9b58-6904825746ed req-1710a03e-c52d-4284-9226-225b2801bb22 service nova] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Received event network-vif-unplugged-ba06c38a-7287-4a4b-b2d9-015659e538a0 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:54:00.404277 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-98e8fcd0-d8d7-4d49-9b58-6904825746ed req-1710a03e-c52d-4284-9226-225b2801bb22 service nova] Acquiring lock "1291c6e1-108e-46d1-85bc-0197f71eec1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:00.404277 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-98e8fcd0-d8d7-4d49-9b58-6904825746ed req-1710a03e-c52d-4284-9226-225b2801bb22 service nova] Lock "1291c6e1-108e-46d1-85bc-0197f71eec1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:00.404277 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-98e8fcd0-d8d7-4d49-9b58-6904825746ed req-1710a03e-c52d-4284-9226-225b2801bb22 service nova] Lock "1291c6e1-108e-46d1-85bc-0197f71eec1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:00.404277 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-98e8fcd0-d8d7-4d49-9b58-6904825746ed req-1710a03e-c52d-4284-9226-225b2801bb22 service nova] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] No waiting events found dispatching network-vif-unplugged-ba06c38a-7287-4a4b-b2d9-015659e538a0 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:54:00.404277 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-98e8fcd0-d8d7-4d49-9b58-6904825746ed req-1710a03e-c52d-4284-9226-225b2801bb22 service nova] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Received event network-vif-unplugged-ba06c38a-7287-4a4b-b2d9-015659e538a0 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:54:00.416265 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Instance destroyed successfully.
May 28 01:54:00.417310 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-1fda1839-43ac-4794-9720-5286ea91b80d tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lazy-loading 'resources' on Instance uuid 1291c6e1-108e-46d1-85bc-0197f71eec1f {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:54:00.451444 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:54:00.529514 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Acquiring lock "refresh_cache-adfbfdf0-7c0f-4834-92ff-3b8d8c39e333" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:54:00.529647 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Acquired lock "refresh_cache-adfbfdf0-7c0f-4834-92ff-3b8d8c39e333" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:54:00.529810 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:54:00.578596 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Instance destroyed successfully.
May 28 01:54:00.580552 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-a1ac8ba3-b841-475e-af86-e6865df47bb9 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lazy-loading 'resources' on Instance uuid bad69594-f163-41a6-931f-d2fcda0cb7d1 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:54:00.596216 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999749105999854 future=<Future at 0x7724f8341a90 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:54:00.596817 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.99977621700009 future=<Future at 0x7724f82f15e0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:54:00.921171 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-1fda1839-43ac-4794-9720-5286ea91b80d tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:51:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1270524779-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testmultiattachvolumeswap-server-1270524779-1',id=5,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9T0jFy877GDUIXf8XLwKi1a8geNpNqHXybbcwc8hk9OWvDAevATdpbJCrejEqP1SYlxqf+1qQGfUGM9hrgOtGGbFh3nMI3KqgwiYl59qZQV/o6QSLmhZ8QN57QO0pJzA==',key_name='tempest-keypair-2135479035',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:52:14Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='947f6e33004d49cdb05fe27674f9eea8',ramdisk_id='',reservation_id='r-uv6dleay',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestMultiAttachVolumeSwap-2109764512',owner_user_name='tempest-TestMultiAttachVolumeSwap-2109764512-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:52:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c4695d222b84104999cd5793122458a',uuid=1291c6e1-108e-46d1-85bc-0197f71eec1f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba06c38a-7287-4a4b-b2d9-015659e538a0", "address": "fa:16:3e:45:c5:fe", "network": {"id": "1a3cc53e-d09d-45ba-a64b-48bf74dd1680", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-582528653-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "947f6e33004d49cdb05fe27674f9eea8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba06c38a-72", "ovs_interfaceid": "ba06c38a-7287-4a4b-b2d9-015659e538a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:54:00.921871 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-1fda1839-43ac-4794-9720-5286ea91b80d tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Converting VIF {"id": "ba06c38a-7287-4a4b-b2d9-015659e538a0", "address": "fa:16:3e:45:c5:fe", "network": {"id": "1a3cc53e-d09d-45ba-a64b-48bf74dd1680", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-582528653-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "947f6e33004d49cdb05fe27674f9eea8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba06c38a-72", "ovs_interfaceid": "ba06c38a-7287-4a4b-b2d9-015659e538a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:54:00.922172 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-1fda1839-43ac-4794-9720-5286ea91b80d tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:c5:fe,bridge_name='br-int',has_traffic_filtering=True,id=ba06c38a-7287-4a4b-b2d9-015659e538a0,network=Network(1a3cc53e-d09d-45ba-a64b-48bf74dd1680),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba06c38a-72') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:54:00.922393 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-1fda1839-43ac-4794-9720-5286ea91b80d tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:c5:fe,bridge_name='br-int',has_traffic_filtering=True,id=ba06c38a-7287-4a4b-b2d9-015659e538a0,network=Network(1a3cc53e-d09d-45ba-a64b-48bf74dd1680),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba06c38a-72') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:54:00.924791 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:00.924791 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba06c38a-72, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:54:00.926685 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:00.926685 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:54:00.933287 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:00.934978 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:00.934978 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=effa126e-be10-4afb-9524-a0b3e3012c4b) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:54:00.935322 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:00.936949 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:54:00.941283 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:00.944239 np0000001583 nova-compute[98241]: INFO os_vif [None req-1fda1839-43ac-4794-9720-5286ea91b80d tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:c5:fe,bridge_name='br-int',has_traffic_filtering=True,id=ba06c38a-7287-4a4b-b2d9-015659e538a0,network=Network(1a3cc53e-d09d-45ba-a64b-48bf74dd1680),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba06c38a-72')
May 28 01:54:00.944639 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-1fda1839-43ac-4794-9720-5286ea91b80d tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Deleting instance files /opt/stack/data/nova/instances/1291c6e1-108e-46d1-85bc-0197f71eec1f_del
May 28 01:54:00.945524 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-1fda1839-43ac-4794-9720-5286ea91b80d tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Deletion of /opt/stack/data/nova/instances/1291c6e1-108e-46d1-85bc-0197f71eec1f_del complete
May 28 01:54:00.975990 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.588s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:00.977632 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.864s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:00.978304 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Trying to apply a migration context that does not seem to be set for this instance {{(pid=98241) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1074}}
May 28 01:54:01.033445 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:54:01.085242 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Deleted allocations for instance d3a7c39a-f946-496d-9153-0a422e7f5350
May 28 01:54:01.091727 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-a1ac8ba3-b841-475e-af86-e6865df47bb9 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:51:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1270524779-2',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testmultiattachvolumeswap-server-1270524779-2',id=6,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9T0jFy877GDUIXf8XLwKi1a8geNpNqHXybbcwc8hk9OWvDAevATdpbJCrejEqP1SYlxqf+1qQGfUGM9hrgOtGGbFh3nMI3KqgwiYl59qZQV/o6QSLmhZ8QN57QO0pJzA==',key_name='tempest-keypair-2135479035',keypairs=<?>,launch_index=1,launched_at=2026-05-28T01:52:48Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='947f6e33004d49cdb05fe27674f9eea8',ramdisk_id='',reservation_id='r-uv6dleay',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestMultiAttachVolumeSwap-2109764512',owner_user_name='tempest-TestMultiAttachVolumeSwap-2109764512-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:52:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c4695d222b84104999cd5793122458a',uuid=bad69594-f163-41a6-931f-d2fcda0cb7d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6", "address": "fa:16:3e:52:00:6a", "network": {"id": "1a3cc53e-d09d-45ba-a64b-48bf74dd1680", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-582528653-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "947f6e33004d49cdb05fe27674f9eea8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d17bf8-d7", "ovs_interfaceid": "62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:54:01.091727 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a1ac8ba3-b841-475e-af86-e6865df47bb9 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Converting VIF {"id": "62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6", "address": "fa:16:3e:52:00:6a", "network": {"id": "1a3cc53e-d09d-45ba-a64b-48bf74dd1680", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-582528653-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "947f6e33004d49cdb05fe27674f9eea8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d17bf8-d7", "ovs_interfaceid": "62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:54:01.091727 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a1ac8ba3-b841-475e-af86-e6865df47bb9 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:00:6a,bridge_name='br-int',has_traffic_filtering=True,id=62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6,network=Network(1a3cc53e-d09d-45ba-a64b-48bf74dd1680),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62d17bf8-d7') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:54:01.091727 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-a1ac8ba3-b841-475e-af86-e6865df47bb9 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:00:6a,bridge_name='br-int',has_traffic_filtering=True,id=62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6,network=Network(1a3cc53e-d09d-45ba-a64b-48bf74dd1680),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62d17bf8-d7') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:54:01.093232 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:01.094195 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap62d17bf8-d7, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:54:01.095149 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:01.097736 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:54:01.098878 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:01.098878 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c544154f-a670-40bf-891f-cb90a794cbda) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:54:01.099218 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:01.101244 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:54:01.103323 np0000001583 nova-compute[98241]: INFO os_vif [None req-a1ac8ba3-b841-475e-af86-e6865df47bb9 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:00:6a,bridge_name='br-int',has_traffic_filtering=True,id=62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6,network=Network(1a3cc53e-d09d-45ba-a64b-48bf74dd1680),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62d17bf8-d7')
May 28 01:54:01.105405 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-a1ac8ba3-b841-475e-af86-e6865df47bb9 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Deleting instance files /opt/stack/data/nova/instances/bad69594-f163-41a6-931f-d2fcda0cb7d1_del
May 28 01:54:01.105405 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-a1ac8ba3-b841-475e-af86-e6865df47bb9 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Deletion of /opt/stack/data/nova/instances/bad69594-f163-41a6-931f-d2fcda0cb7d1_del complete
May 28 01:54:01.454199 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-1fda1839-43ac-4794-9720-5286ea91b80d tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Took 1.41 seconds to destroy the instance on the hypervisor.
May 28 01:54:01.456747 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-1fda1839-43ac-4794-9720-5286ea91b80d tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:54:01.457009 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:54:01.457148 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:54:01.457513 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:54:01.466616 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:54:01.618891 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:54:01.623574 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-a1ac8ba3-b841-475e-af86-e6865df47bb9 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Took 1.43 seconds to destroy the instance on the hypervisor.
May 28 01:54:01.628231 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-a1ac8ba3-b841-475e-af86-e6865df47bb9 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:54:01.628231 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:54:01.628231 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:54:01.628231 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:54:01.709479 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Updating instance_info_cache with network_info: [{"id": "828d441a-570b-4f98-b093-4eb521ee2cf8", "address": "fa:16:3e:f5:ed:7d", "network": {"id": "34ab0ff0-75dd-45e7-97f6-22f8e62a8149", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1222751470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d31342458ec4ed2890a766f62facbcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap828d441a-57", "ovs_interfaceid": "828d441a-570b-4f98-b093-4eb521ee2cf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:54:01.742443 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:54:02.002488 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fa74dcda-98fe-45a4-8ec3-fce12948906b tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 1.025s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:02.109161 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6b9c7d87-5bf1-42f1-a5be-2b16d1d476e0 tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Lock "d3a7c39a-f946-496d-9153-0a422e7f5350" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 16.028s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:02.194306 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-dea82acf-1803-4211-b23b-9251d65895c8 req-f380cc40-694f-414c-9ec5-ec93c0617c3c service nova] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Received event network-vif-deleted-ba06c38a-7287-4a4b-b2d9-015659e538a0 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:54:02.196518 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-dea82acf-1803-4211-b23b-9251d65895c8 req-f380cc40-694f-414c-9ec5-ec93c0617c3c service nova] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Neutron deleted interface ba06c38a-7287-4a4b-b2d9-015659e538a0; detaching it from the instance and deleting it from the info cache
May 28 01:54:02.197540 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-dea82acf-1803-4211-b23b-9251d65895c8 req-f380cc40-694f-414c-9ec5-ec93c0617c3c service nova] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Detach interface failed, port_id=ba06c38a-7287-4a4b-b2d9-015659e538a0, reason: Instance 1291c6e1-108e-46d1-85bc-0197f71eec1f could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:54:02.211940 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Releasing lock "refresh_cache-adfbfdf0-7c0f-4834-92ff-3b8d8c39e333" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:54:02.213067 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:54:02.213374 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Creating image(s)
May 28 01:54:02.213847 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Acquiring lock "/opt/stack/data/nova/instances/adfbfdf0-7c0f-4834-92ff-3b8d8c39e333/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:02.214050 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "/opt/stack/data/nova/instances/adfbfdf0-7c0f-4834-92ff-3b8d8c39e333/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:02.214533 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "/opt/stack/data/nova/instances/adfbfdf0-7c0f-4834-92ff-3b8d8c39e333/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:02.214760 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lazy-loading 'trusted_certs' on Instance uuid adfbfdf0-7c0f-4834-92ff-3b8d8c39e333 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:54:02.261067 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0003958810000312951 future=<Future at 0x7724f82a2120 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:54:02.261221 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:54:02.261427 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=13.334518350999815 future=<Future at 0x7724f8341a90 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:54:02.261488 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=13.334395940999912 future=<Future at 0x7724f8341a90 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:54:02.261635 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1779933227.260554, d3a7c39a-f946-496d-9153-0a422e7f5350 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:54:02.261733 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] VM Stopped (Lifecycle Event)
May 28 01:54:02.504509 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-c63c6f44-bc17-4767-aca4-6fa9889c058f req-c68db158-f793-43b8-a96f-ac6443279965 service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Received event network-changed-828d441a-570b-4f98-b093-4eb521ee2cf8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:54:02.504735 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-c63c6f44-bc17-4767-aca4-6fa9889c058f req-c68db158-f793-43b8-a96f-ac6443279965 service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Refreshing instance network info cache due to event network-changed-828d441a-570b-4f98-b093-4eb521ee2cf8. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:54:02.504948 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c63c6f44-bc17-4767-aca4-6fa9889c058f req-c68db158-f793-43b8-a96f-ac6443279965 service nova] Acquiring lock "refresh_cache-adfbfdf0-7c0f-4834-92ff-3b8d8c39e333" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:54:02.505441 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c63c6f44-bc17-4767-aca4-6fa9889c058f req-c68db158-f793-43b8-a96f-ac6443279965 service nova] Acquired lock "refresh_cache-adfbfdf0-7c0f-4834-92ff-3b8d8c39e333" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:54:02.506308 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-c63c6f44-bc17-4767-aca4-6fa9889c058f req-c68db158-f793-43b8-a96f-ac6443279965 service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Refreshing network info cache for port 828d441a-570b-4f98-b093-4eb521ee2cf8 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:54:02.577752 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:54:02.621865 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:54:02.717243 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Object Instance<adfbfdf0-7c0f-4834-92ff-3b8d8c39e333> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:54:02.717612 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Acquiring lock "e818dcc4c16250e7a92d5e7941fabccdfcdc862c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:02.718033 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "e818dcc4c16250e7a92d5e7941fabccdfcdc862c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:02.765603 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-64bedf15-96c0-460d-81e5-7cbf1c70d1ae None None] [instance: d3a7c39a-f946-496d-9153-0a422e7f5350] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:54:02.841616 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:02.908645 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e31fa352-a9d4-4121-9d86-8d941fc8ac49 req-e536cb7c-f7e5-4c6f-9b85-4343dc5a7fcb service nova] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Received event network-vif-plugged-6835d977-7c34-4bd7-8d12-208432ea45d3 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:54:02.910736 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e31fa352-a9d4-4121-9d86-8d941fc8ac49 req-e536cb7c-f7e5-4c6f-9b85-4343dc5a7fcb service nova] Acquiring lock "f2805796-e531-4508-8585-0d110f4bd4e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:02.910963 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e31fa352-a9d4-4121-9d86-8d941fc8ac49 req-e536cb7c-f7e5-4c6f-9b85-4343dc5a7fcb service nova] Lock "f2805796-e531-4508-8585-0d110f4bd4e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:02.911504 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e31fa352-a9d4-4121-9d86-8d941fc8ac49 req-e536cb7c-f7e5-4c6f-9b85-4343dc5a7fcb service nova] Lock "f2805796-e531-4508-8585-0d110f4bd4e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:02.912253 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e31fa352-a9d4-4121-9d86-8d941fc8ac49 req-e536cb7c-f7e5-4c6f-9b85-4343dc5a7fcb service nova] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] No waiting events found dispatching network-vif-plugged-6835d977-7c34-4bd7-8d12-208432ea45d3 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:54:02.912687 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-e31fa352-a9d4-4121-9d86-8d941fc8ac49 req-e536cb7c-f7e5-4c6f-9b85-4343dc5a7fcb service nova] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Received unexpected event network-vif-plugged-6835d977-7c34-4bd7-8d12-208432ea45d3 for instance with vm_state active and task_state None.
May 28 01:54:03.008969 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-c63c6f44-bc17-4767-aca4-6fa9889c058f req-c68db158-f793-43b8-a96f-ac6443279965 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:54:03.079722 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Took 1.45 seconds to deallocate network for instance.
May 28 01:54:03.130604 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Took 1.67 seconds to deallocate network for instance.
May 28 01:54:03.591101 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a1ac8ba3-b841-475e-af86-e6865df47bb9 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:03.591526 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a1ac8ba3-b841-475e-af86-e6865df47bb9 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:03.605845 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-c63c6f44-bc17-4767-aca4-6fa9889c058f req-c68db158-f793-43b8-a96f-ac6443279965 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:54:03.645246 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1fda1839-43ac-4794-9720-5286ea91b80d tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:03.782434 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:54:03.782434 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:54:03.782434 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e818dcc4c16250e7a92d5e7941fabccdfcdc862c.part --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:54:03.876412 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-c63c6f44-bc17-4767-aca4-6fa9889c058f req-c68db158-f793-43b8-a96f-ac6443279965 service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Updated VIF entry in instance network info cache for port 828d441a-570b-4f98-b093-4eb521ee2cf8. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:54:03.877032 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-c63c6f44-bc17-4767-aca4-6fa9889c058f req-c68db158-f793-43b8-a96f-ac6443279965 service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Updating instance_info_cache with network_info: [{"id": "828d441a-570b-4f98-b093-4eb521ee2cf8", "address": "fa:16:3e:f5:ed:7d", "network": {"id": "34ab0ff0-75dd-45e7-97f6-22f8e62a8149", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1222751470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d31342458ec4ed2890a766f62facbcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap828d441a-57", "ovs_interfaceid": "828d441a-570b-4f98-b093-4eb521ee2cf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:54:03.928507 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e818dcc4c16250e7a92d5e7941fabccdfcdc862c.part --force-share --output=json" returned: 0 in 0.140s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:54:03.928507 np0000001583 nova-compute[98241]: DEBUG nova.virt.images [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] b12462e2-1eb9-45d2-a9ac-02ca39dc37ad was qcow2, converting to raw {{(pid=98241) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 01:54:03.928507 np0000001583 nova-compute[98241]: DEBUG nova.privsep.utils [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98241) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 01:54:03.928507 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e818dcc4c16250e7a92d5e7941fabccdfcdc862c.part /opt/stack/data/nova/instances/_base/e818dcc4c16250e7a92d5e7941fabccdfcdc862c.converted {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:54:03.948606 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:04.104613 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a1ac8ba3-b841-475e-af86-e6865df47bb9 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:54:04.104613 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-a1ac8ba3-b841-475e-af86-e6865df47bb9 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:54:04.109886 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e818dcc4c16250e7a92d5e7941fabccdfcdc862c.part /opt/stack/data/nova/instances/_base/e818dcc4c16250e7a92d5e7941fabccdfcdc862c.converted" returned: 0 in 0.186s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:54:04.134171 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e818dcc4c16250e7a92d5e7941fabccdfcdc862c.converted --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:54:04.218027 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e818dcc4c16250e7a92d5e7941fabccdfcdc862c.converted --force-share --output=json" returned: 0 in 0.085s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:54:04.218973 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "e818dcc4c16250e7a92d5e7941fabccdfcdc862c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.501s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:04.219637 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:54:04.223891 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:54:04.225437 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e818dcc4c16250e7a92d5e7941fabccdfcdc862c --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:54:04.305895 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e818dcc4c16250e7a92d5e7941fabccdfcdc862c --force-share --output=json" returned: 0 in 0.080s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:54:04.306703 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Acquiring lock "e818dcc4c16250e7a92d5e7941fabccdfcdc862c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:04.307404 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "e818dcc4c16250e7a92d5e7941fabccdfcdc862c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:04.308116 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:54:04.314445 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:54:04.314445 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e818dcc4c16250e7a92d5e7941fabccdfcdc862c --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:54:04.385050 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c63c6f44-bc17-4767-aca4-6fa9889c058f req-c68db158-f793-43b8-a96f-ac6443279965 service nova] Releasing lock "refresh_cache-adfbfdf0-7c0f-4834-92ff-3b8d8c39e333" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:54:04.385485 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-c63c6f44-bc17-4767-aca4-6fa9889c058f req-c68db158-f793-43b8-a96f-ac6443279965 service nova] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Received event network-vif-unplugged-ba06c38a-7287-4a4b-b2d9-015659e538a0 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:54:04.385848 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c63c6f44-bc17-4767-aca4-6fa9889c058f req-c68db158-f793-43b8-a96f-ac6443279965 service nova] Acquiring lock "1291c6e1-108e-46d1-85bc-0197f71eec1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:04.386143 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c63c6f44-bc17-4767-aca4-6fa9889c058f req-c68db158-f793-43b8-a96f-ac6443279965 service nova] Lock "1291c6e1-108e-46d1-85bc-0197f71eec1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:04.386295 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c63c6f44-bc17-4767-aca4-6fa9889c058f req-c68db158-f793-43b8-a96f-ac6443279965 service nova] Lock "1291c6e1-108e-46d1-85bc-0197f71eec1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:04.386435 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-c63c6f44-bc17-4767-aca4-6fa9889c058f req-c68db158-f793-43b8-a96f-ac6443279965 service nova] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] No waiting events found dispatching network-vif-unplugged-ba06c38a-7287-4a4b-b2d9-015659e538a0 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:54:04.386596 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-c63c6f44-bc17-4767-aca4-6fa9889c058f req-c68db158-f793-43b8-a96f-ac6443279965 service nova] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Received event network-vif-unplugged-ba06c38a-7287-4a4b-b2d9-015659e538a0 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:54:04.389597 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-c63c6f44-bc17-4767-aca4-6fa9889c058f req-c68db158-f793-43b8-a96f-ac6443279965 service nova] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Received event network-vif-deleted-62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:54:04.391446 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-c63c6f44-bc17-4767-aca4-6fa9889c058f req-c68db158-f793-43b8-a96f-ac6443279965 service nova] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Neutron deleted interface 62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6; detaching it from the instance and deleting it from the info cache
May 28 01:54:04.395713 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-c63c6f44-bc17-4767-aca4-6fa9889c058f req-c68db158-f793-43b8-a96f-ac6443279965 service nova] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Detach interface failed, port_id=62d17bf8-d7b2-4f18-9a2a-1e94b3707bb6, reason: Instance bad69594-f163-41a6-931f-d2fcda0cb7d1 could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:54:04.418792 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e818dcc4c16250e7a92d5e7941fabccdfcdc862c --force-share --output=json" returned: 0 in 0.104s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:54:04.419839 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e818dcc4c16250e7a92d5e7941fabccdfcdc862c,backing_fmt=raw /opt/stack/data/nova/instances/adfbfdf0-7c0f-4834-92ff-3b8d8c39e333/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:54:04.481168 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e818dcc4c16250e7a92d5e7941fabccdfcdc862c,backing_fmt=raw /opt/stack/data/nova/instances/adfbfdf0-7c0f-4834-92ff-3b8d8c39e333/disk 1073741824" returned: 0 in 0.061s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:54:04.484000 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "e818dcc4c16250e7a92d5e7941fabccdfcdc862c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.175s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:04.484000 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e818dcc4c16250e7a92d5e7941fabccdfcdc862c --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:54:04.593500 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e818dcc4c16250e7a92d5e7941fabccdfcdc862c --force-share --output=json" returned: 0 in 0.110s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:54:04.594178 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lazy-loading 'migration_context' on Instance uuid adfbfdf0-7c0f-4834-92ff-3b8d8c39e333 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:54:04.609440 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-a1ac8ba3-b841-475e-af86-e6865df47bb9 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:54:04.995230 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-6ca2ae91-fe5c-4aac-ae7c-0739091cea34 req-e07fb47f-9749-46c8-8a9d-04f582ab6d1c service nova] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Received event network-vif-plugged-6835d977-7c34-4bd7-8d12-208432ea45d3 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:54:04.996025 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-6ca2ae91-fe5c-4aac-ae7c-0739091cea34 req-e07fb47f-9749-46c8-8a9d-04f582ab6d1c service nova] Acquiring lock "f2805796-e531-4508-8585-0d110f4bd4e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:04.996238 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-6ca2ae91-fe5c-4aac-ae7c-0739091cea34 req-e07fb47f-9749-46c8-8a9d-04f582ab6d1c service nova] Lock "f2805796-e531-4508-8585-0d110f4bd4e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:04.997201 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-6ca2ae91-fe5c-4aac-ae7c-0739091cea34 req-e07fb47f-9749-46c8-8a9d-04f582ab6d1c service nova] Lock "f2805796-e531-4508-8585-0d110f4bd4e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:04.997201 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-6ca2ae91-fe5c-4aac-ae7c-0739091cea34 req-e07fb47f-9749-46c8-8a9d-04f582ab6d1c service nova] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] No waiting events found dispatching network-vif-plugged-6835d977-7c34-4bd7-8d12-208432ea45d3 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:54:04.997201 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-6ca2ae91-fe5c-4aac-ae7c-0739091cea34 req-e07fb47f-9749-46c8-8a9d-04f582ab6d1c service nova] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Received unexpected event network-vif-plugged-6835d977-7c34-4bd7-8d12-208432ea45d3 for instance with vm_state active and task_state None.
May 28 01:54:05.097187 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Object Instance<adfbfdf0-7c0f-4834-92ff-3b8d8c39e333> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:54:05.097629 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Rebasing disk image.
May 28 01:54:05.097908 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:54:05.125534 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a1ac8ba3-b841-475e-af86-e6865df47bb9 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.534s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:05.131231 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1fda1839-43ac-4794-9720-5286ea91b80d tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.488s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:05.186101 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.088s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:54:05.187132 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 -F raw /opt/stack/data/nova/instances/adfbfdf0-7c0f-4834-92ff-3b8d8c39e333/disk {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:54:05.211316 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-a1ac8ba3-b841-475e-af86-e6865df47bb9 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Deleted allocations for instance bad69594-f163-41a6-931f-d2fcda0cb7d1
May 28 01:54:05.550958 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1fda1839-43ac-4794-9720-5286ea91b80d tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:54:05.551256 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-1fda1839-43ac-4794-9720-5286ea91b80d tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:54:06.055049 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-1fda1839-43ac-4794-9720-5286ea91b80d tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:54:06.099444 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:06.162068 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 -F raw /opt/stack/data/nova/instances/adfbfdf0-7c0f-4834-92ff-3b8d8c39e333/disk" returned: 0 in 0.975s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:54:06.162679 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:54:06.162679 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Ensure instance console log exists: /opt/stack/data/nova/instances/adfbfdf0-7c0f-4834-92ff-3b8d8c39e333/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:54:06.163015 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:06.163271 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:06.163463 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:06.166523 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Start _get_guest_xml network_info=[{"id": "828d441a-570b-4f98-b093-4eb521ee2cf8", "address": "fa:16:3e:f5:ed:7d", "network": {"id": "34ab0ff0-75dd-45e7-97f6-22f8e62a8149", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1222751470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d31342458ec4ed2890a766f62facbcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap828d441a-57", "ovs_interfaceid": "828d441a-570b-4f98-b093-4eb521ee2cf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='8acf77871517a79717c61409deca8e76',container_format='bare',created_at=2026-05-28T01:53:37Z,direct_url=<?>,disk_format='qcow2',id=b12462e2-1eb9-45d2-a9ac-02ca39dc37ad,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1548147209-shelved',owner='0d31342458ec4ed2890a766f62facbcf',properties=ImageMetaProps,protected=<?>,size=53673984,status='active',tags=<?>,updated_at=2026-05-28T01:53:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42', 'iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a2c5c258-e7db-4399-802e-b94d13fd2b42', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attached', 'instance': 'adfbfdf0-7c0f-4834-92ff-3b8d8c39e333', 'attached_at': '', 'detached_at': '', 'volume_id': 'a2c5c258-e7db-4399-802e-b94d13fd2b42', 'serial': 'a2c5c258-e7db-4399-802e-b94d13fd2b42'}, 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'attachment_id': 'fcf9c1e2-6989-4fff-b74c-ad0c43974e1b', 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:54:06.168694 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:54:06.170541 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-1548147209', uuid='adfbfdf0-7c0f-4834-92ff-3b8d8c39e333'), owner=OwnerMeta(userid='312a198f7d3d4ce9b586d8f36cf58f76', username='tempest-AttachVolumeShelveTestJSON-1906404591-project-member', projectid='0d31342458ec4ed2890a766f62facbcf', projectname='tempest-AttachVolumeShelveTestJSON-1906404591'), image=ImageMeta(id='b12462e2-1eb9-45d2-a9ac-02ca39dc37ad', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "828d441a-570b-4f98-b093-4eb521ee2cf8", "address": "fa:16:3e:f5:ed:7d", "network": {"id": "34ab0ff0-75dd-45e7-97f6-22f8e62a8149", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1222751470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d31342458ec4ed2890a766f62facbcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap828d441a-57", "ovs_interfaceid": "828d441a-570b-4f98-b093-4eb521ee2cf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933246.170046) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:54:06.172601 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:54:06.173051 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:54:06.174622 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:54:06.174904 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:54:06.176256 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:54:06.176794 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='8acf77871517a79717c61409deca8e76',container_format='bare',created_at=2026-05-28T01:53:37Z,direct_url=<?>,disk_format='qcow2',id=b12462e2-1eb9-45d2-a9ac-02ca39dc37ad,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1548147209-shelved',owner='0d31342458ec4ed2890a766f62facbcf',properties=ImageMetaProps,protected=<?>,size=53673984,status='active',tags=<?>,updated_at=2026-05-28T01:53:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:54:06.177259 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:54:06.177431 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:54:06.177752 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:54:06.178046 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:54:06.178329 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:54:06.178610 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:54:06.178828 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:54:06.179038 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:54:06.179263 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:54:06.179477 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:54:06.179748 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lazy-loading 'vcpu_model' on Instance uuid adfbfdf0-7c0f-4834-92ff-3b8d8c39e333 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:54:06.226611 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a1ac8ba3-b841-475e-af86-e6865df47bb9 tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "bad69594-f163-41a6-931f-d2fcda0cb7d1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.538s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:06.523485 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:06.561682 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1fda1839-43ac-4794-9720-5286ea91b80d tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.430s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:06.623898 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-1fda1839-43ac-4794-9720-5286ea91b80d tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Deleted allocations for instance 1291c6e1-108e-46d1-85bc-0197f71eec1f
May 28 01:54:06.682288 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Object Instance<adfbfdf0-7c0f-4834-92ff-3b8d8c39e333> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:54:06.702466 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:54:06.702920 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42', 'iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a2c5c258-e7db-4399-802e-b94d13fd2b42', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:54:06.703121 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:54:06.703544 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:54:06.703791 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42', 'iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a2c5c258-e7db-4399-802e-b94d13fd2b42', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:54:06.716167 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:54:06.716933 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:54:06.717676 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:54:06.717894 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:54:06.718379 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:54:06.718695 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:54:06.734463 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:54:06.734463 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:54:06.734891 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:54:06.734891 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:54:06.755087 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42] added
May 28 01:54:06.755087 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:54:06.755087 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:54:06.755087 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:54:06.755087 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:54:06.755087 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:54:06.755087 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:54:06.755087 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42] added
May 28 01:54:06.755087 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:54:06.755087 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:54:06.755087 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:54:06.755087 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:54:06.755087 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:54:06.755087 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:54:06.755087 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:54:06.755600 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:54:06.755600 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0371(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:54:06.755931 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0368(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:54:06.756227 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:54:06.756438 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:54:07.633449 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1fda1839-43ac-4794-9720-5286ea91b80d tempest-TestMultiAttachVolumeSwap-2109764512 tempest-TestMultiAttachVolumeSwap-2109764512-project-member] Lock "1291c6e1-108e-46d1-85bc-0197f71eec1f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.105s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:07.757471 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:54:07.757803 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:54:07.770726 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:54:07.770726 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:54:07.777495 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:54:07.777495 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:54:07.787915 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:54:07.794434 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:54:07.805117 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:54:07.805117 np0000001583 nova-compute[98241]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:54:07.805117 np0000001583 nova-compute[98241]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:54:07.805117 np0000001583 nova-compute[98241]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:54:07.805117 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:54:07.806271 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] iscsi session list stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:54:07.806271 np0000001583 nova-compute[98241]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:54:07.806271 np0000001583 nova-compute[98241]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:54:07.806271 np0000001583 nova-compute[98241]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:54:07.806271 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:54:07.812240 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:54:07.812240 np0000001583 nova-compute[98241]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:54:07.812240 np0000001583 nova-compute[98241]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:54:07.812240 np0000001583 nova-compute[98241]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:54:07.812240 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:54:07.812486 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] iscsi session list stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:54:07.812486 np0000001583 nova-compute[98241]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:54:07.812486 np0000001583 nova-compute[98241]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:54:07.812486 np0000001583 nova-compute[98241]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:54:07.812486 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:54:07.845383 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:07.852545 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42, portal: 192.168.40.100,3260]
May 28 01:54:07.852545 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42, portal: 192.168.40.100,3260] successful.
May 28 01:54:07.852545 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:54:07.859199 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42, portal: 192.168.50.100,3260]
May 28 01:54:07.859199 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42, portal: 192.168.50.100,3260] successful.
May 28 01:54:07.859199 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:54:07.868179 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:54:07.877099 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:54:07.887746 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:54:07.887746 np0000001583 nova-compute[98241]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:54:07.887746 np0000001583 nova-compute[98241]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:54:07.887746 np0000001583 nova-compute[98241]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:54:07.887746 np0000001583 nova-compute[98241]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42 (non-flash)
May 28 01:54:07.887746 np0000001583 nova-compute[98241]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42 (non-flash)
May 28 01:54:07.887746 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:54:07.888491 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] iscsi session list stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:54:07.888491 np0000001583 nova-compute[98241]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:54:07.888491 np0000001583 nova-compute[98241]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:54:07.888491 np0000001583 nova-compute[98241]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:54:07.888491 np0000001583 nova-compute[98241]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42 (non-flash)
May 28 01:54:07.888491 np0000001583 nova-compute[98241]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42 (non-flash)
May 28 01:54:07.888491 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:54:07.889290 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.172s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:54:07.889838 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:54:07.891356 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] HCTL ('11', '-', '-', 0) found on session 28 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:54:07.891356 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:54:07.902948 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:54:07.902948 np0000001583 nova-compute[98241]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:54:07.902948 np0000001583 nova-compute[98241]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:54:07.902948 np0000001583 nova-compute[98241]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:54:07.902948 np0000001583 nova-compute[98241]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42 (non-flash)
May 28 01:54:07.902948 np0000001583 nova-compute[98241]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42 (non-flash)
May 28 01:54:07.902948 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:54:07.903261 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] iscsi session list stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:54:07.903261 np0000001583 nova-compute[98241]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:54:07.903261 np0000001583 nova-compute[98241]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:54:07.903261 np0000001583 nova-compute[98241]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:54:07.903261 np0000001583 nova-compute[98241]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42 (non-flash)
May 28 01:54:07.903261 np0000001583 nova-compute[98241]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42 (non-flash)
May 28 01:54:07.903261 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:54:07.903703 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.185s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:54:07.903788 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:54:07.904724 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] HCTL ('12', '-', '-', 0) found on session 29 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:54:07.904899 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:54:07.921517 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Searching for a device in session 28 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:54:07.921835 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a2c5c258-e7db-4399-802e-b94d13fd2b42', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:54:07.927922 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Searching for a device in session 29 and hctl ['12', '*', '*', 0] yield: None {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:54:08.193765 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:54:08.193966 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Cleaning up deleted instances {{(pid=98241) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}}
May 28 01:54:08.699346 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] There are 0 instances to clean {{(pid=98241) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}}
May 28 01:54:08.699848 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:54:08.699848 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98241) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}}
May 28 01:54:08.928631 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Searching for a device in session 29 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:54:08.928907 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a2c5c258-e7db-4399-802e-b94d13fd2b42', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:54:09.201986 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:54:09.699661 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:09.703648 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:54:09.738401 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Found WWN 330000000ecc150af for multipath device dm-6 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:54:09.739681 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:54:09.739681 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] <== connect_volume: return (3036ms) {'type': 'block', 'scsi_wwn': '330000000ecc150af', 'path': '/dev/dm-6', 'multipath_id': '330000000ecc150af'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:54:09.739681 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ecc150af', 'path': '/dev/dm-6', 'multipath_id': '330000000ecc150af'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:54:10.249910 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T01:52:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1548147209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-attachvolumeshelvetestjson-server-1548147209',id=9,image_ref='b12462e2-1eb9-45d2-a9ac-02ca39dc37ad',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1047928115',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:52:56Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0d31342458ec4ed2890a766f62facbcf',ramdisk_id='',reservation_id='r-ciexyebb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1906404591',owner_user_name='tempest-AttachVolumeShelveTestJSON-1906404591-project-member',shelved_at='2026-05-28T01:53:44.394801',shelved_host='np0000001583',shelved_image_id='b12462e2-1eb9-45d2-a9ac-02ca39dc37ad'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:53:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='312a198f7d3d4ce9b586d8f36cf58f76',uuid=adfbfdf0-7c0f-4834-92ff-3b8d8c39e333,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "828d441a-570b-4f98-b093-4eb521ee2cf8", "address": "fa:16:3e:f5:ed:7d", "network": {"id": "34ab0ff0-75dd-45e7-97f6-22f8e62a8149", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1222751470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d31342458ec4ed2890a766f62facbcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap828d441a-57", "ovs_interfaceid": "828d441a-570b-4f98-b093-4eb521ee2cf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:54:10.250181 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Converting VIF {"id": "828d441a-570b-4f98-b093-4eb521ee2cf8", "address": "fa:16:3e:f5:ed:7d", "network": {"id": "34ab0ff0-75dd-45e7-97f6-22f8e62a8149", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1222751470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d31342458ec4ed2890a766f62facbcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap828d441a-57", "ovs_interfaceid": "828d441a-570b-4f98-b093-4eb521ee2cf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:54:10.250951 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ed:7d,bridge_name='br-int',has_traffic_filtering=True,id=828d441a-570b-4f98-b093-4eb521ee2cf8,network=Network(34ab0ff0-75dd-45e7-97f6-22f8e62a8149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap828d441a-57') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:54:10.251538 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lazy-loading 'pci_devices' on Instance uuid adfbfdf0-7c0f-4834-92ff-3b8d8c39e333 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:54:10.303479 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:10.757533 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Object Instance<adfbfdf0-7c0f-4834-92ff-3b8d8c39e333> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:54:10.758386 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] End _get_guest_xml xml=<domain type="qemu">
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:   <uuid>adfbfdf0-7c0f-4834-92ff-3b8d8c39e333</uuid>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:   <name>instance-00000009</name>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1548147209</nova:name>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:54:06</nova:creationTime>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:         <nova:user uuid="312a198f7d3d4ce9b586d8f36cf58f76">tempest-AttachVolumeShelveTestJSON-1906404591-project-member</nova:user>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:         <nova:project uuid="0d31342458ec4ed2890a766f62facbcf">tempest-AttachVolumeShelveTestJSON-1906404591</nova:project>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:         <nova:port uuid="828d441a-570b-4f98-b093-4eb521ee2cf8">
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:     <system>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:       <entry name="serial">adfbfdf0-7c0f-4834-92ff-3b8d8c39e333</entry>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:       <entry name="uuid">adfbfdf0-7c0f-4834-92ff-3b8d8c39e333</entry>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:     </system>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:   <os>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:   </os>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:   <features>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:   </features>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:   <devices>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/adfbfdf0-7c0f-4834-92ff-3b8d8c39e333/disk"/>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:     </disk>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/adfbfdf0-7c0f-4834-92ff-3b8d8c39e333/disk.config"/>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:     </disk>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:     <disk type="block" device="disk">
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:       <alias name="ua-a2c5c258-e7db-4399-802e-b94d13fd2b42"/>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:       <source dev="/dev/dm-6"/>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:       <target dev="vdc" bus="virtio"/>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:       <serial>a2c5c258-e7db-4399-802e-b94d13fd2b42</serial>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:     </disk>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:f5:ed:7d"/>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:       <target dev="tap828d441a-57"/>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:     </interface>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/adfbfdf0-7c0f-4834-92ff-3b8d8c39e333/console.log" append="off"/>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:     </serial>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:     <video>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:     </video>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:     </rng>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:   </devices>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]: </domain>
May 28 01:54:10.758386 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:54:10.763613 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Preparing to wait for external event network-vif-plugged-828d441a-570b-4f98-b093-4eb521ee2cf8 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:54:10.763613 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Acquiring lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:10.763613 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:10.763613 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:10.763613 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T01:52:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1548147209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-attachvolumeshelvetestjson-server-1548147209',id=9,image_ref='b12462e2-1eb9-45d2-a9ac-02ca39dc37ad',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1047928115',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:52:56Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0d31342458ec4ed2890a766f62facbcf',ramdisk_id='',reservation_id='r-ciexyebb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1906404591',owner_user_name='tempest-AttachVolumeShelveTestJSON-1906404591-project-member',shelved_at='2026-05-28T01:53:44.394801',shelved_host='np0000001583',shelved_image_id='b12462e2-1eb9-45d2-a9ac-02ca39dc37ad'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:53:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='312a198f7d3d4ce9b586d8f36cf58f76',uuid=adfbfdf0-7c0f-4834-92ff-3b8d8c39e333,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "828d441a-570b-4f98-b093-4eb521ee2cf8", "address": "fa:16:3e:f5:ed:7d", "network": {"id": "34ab0ff0-75dd-45e7-97f6-22f8e62a8149", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1222751470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d31342458ec4ed2890a766f62facbcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap828d441a-57", "ovs_interfaceid": "828d441a-570b-4f98-b093-4eb521ee2cf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:54:10.763613 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Converting VIF {"id": "828d441a-570b-4f98-b093-4eb521ee2cf8", "address": "fa:16:3e:f5:ed:7d", "network": {"id": "34ab0ff0-75dd-45e7-97f6-22f8e62a8149", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1222751470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d31342458ec4ed2890a766f62facbcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap828d441a-57", "ovs_interfaceid": "828d441a-570b-4f98-b093-4eb521ee2cf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:54:10.763613 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ed:7d,bridge_name='br-int',has_traffic_filtering=True,id=828d441a-570b-4f98-b093-4eb521ee2cf8,network=Network(34ab0ff0-75dd-45e7-97f6-22f8e62a8149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap828d441a-57') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:54:10.763613 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ed:7d,bridge_name='br-int',has_traffic_filtering=True,id=828d441a-570b-4f98-b093-4eb521ee2cf8,network=Network(34ab0ff0-75dd-45e7-97f6-22f8e62a8149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap828d441a-57') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:54:10.763613 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:10.763613 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:54:10.763613 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:54:10.764461 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:10.764663 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '37b17fc0-88bf-5270-bdbb-4e8a7d63aa26', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:54:10.767371 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:10.768191 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:54:10.771822 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:10.771822 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap828d441a-57, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:54:10.771822 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap828d441a-57, col_values=(('qos', UUID('a38f5b3f-87be-468d-98f1-c094f40319e7')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:54:10.771822 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap828d441a-57, col_values=(('external_ids', {'iface-id': '828d441a-570b-4f98-b093-4eb521ee2cf8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:ed:7d', 'vm-uuid': 'adfbfdf0-7c0f-4834-92ff-3b8d8c39e333'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:54:10.778381 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:10.779675 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:54:10.786704 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:10.788675 np0000001583 nova-compute[98241]: INFO os_vif [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ed:7d,bridge_name='br-int',has_traffic_filtering=True,id=828d441a-570b-4f98-b093-4eb521ee2cf8,network=Network(34ab0ff0-75dd-45e7-97f6-22f8e62a8149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap828d441a-57')
May 28 01:54:11.703173 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:54:11.703376 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:54:11.703973 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.49 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:54:12.086118 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:12.189799 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:54:12.189994 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:54:12.193003 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:54:12.193206 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:54:12.193371 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:54:12.193482 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 01:54:12.193698 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:54:12.310463 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:54:12.310638 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:54:12.310844 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:54:12.311005 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] No VIF found with MAC fa:16:3e:f5:ed:7d, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:54:12.311768 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Using config drive
May 28 01:54:12.815480 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lazy-loading 'ec2_ids' on Instance uuid adfbfdf0-7c0f-4834-92ff-3b8d8c39e333 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:54:12.843707 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:13.128849 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:13.319247 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Object Instance<adfbfdf0-7c0f-4834-92ff-3b8d8c39e333> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:54:13.319537 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lazy-loading 'keypairs' on Instance uuid adfbfdf0-7c0f-4834-92ff-3b8d8c39e333 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:54:13.581739 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:13.822200 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Object Instance<adfbfdf0-7c0f-4834-92ff-3b8d8c39e333> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:54:13.827405 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:54:14.190091 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Creating config drive at /opt/stack/data/nova/instances/adfbfdf0-7c0f-4834-92ff-3b8d8c39e333/disk.config
May 28 01:54:14.193290 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:54:14.193553 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:54:14.194938 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/adfbfdf0-7c0f-4834-92ff-3b8d8c39e333/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbbplcjja {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:54:14.247965 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/adfbfdf0-7c0f-4834-92ff-3b8d8c39e333/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbbplcjja" returned: 0 in 0.053s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:54:14.447624 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Acquiring lock "df5768dc-874f-4725-b2a2-e007aebc11a9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:14.447862 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Lock "df5768dc-874f-4725-b2a2-e007aebc11a9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:14.714844 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:14.715862 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:14.715862 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:14.715862 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Auditing locally available compute resources for np0000001583 (node: np0000001583) {{(pid=98241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 01:54:14.730150 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:14.759344 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:14.763114 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:14.847927 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:14.951744 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:54:15.004393 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-88d5337f-6ff6-412b-9d90-4364f9d9ff66 req-91de53e5-1c70-49a9-9875-418866765f37 service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Received event network-vif-plugged-828d441a-570b-4f98-b093-4eb521ee2cf8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:54:15.004642 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-88d5337f-6ff6-412b-9d90-4364f9d9ff66 req-91de53e5-1c70-49a9-9875-418866765f37 service nova] Acquiring lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:15.004883 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-88d5337f-6ff6-412b-9d90-4364f9d9ff66 req-91de53e5-1c70-49a9-9875-418866765f37 service nova] Lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:15.005139 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-88d5337f-6ff6-412b-9d90-4364f9d9ff66 req-91de53e5-1c70-49a9-9875-418866765f37 service nova] Lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:15.005286 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-88d5337f-6ff6-412b-9d90-4364f9d9ff66 req-91de53e5-1c70-49a9-9875-418866765f37 service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Processing event network-vif-plugged-828d441a-570b-4f98-b093-4eb521ee2cf8 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:54:15.120543 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:15.126109 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:15.150395 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:15.252101 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "587a002a-2b9c-4865-8ce2-088ad567c81b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:15.252487 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "587a002a-2b9c-4865-8ce2-088ad567c81b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:15.523615 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:15.523795 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:15.531772 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:54:15.532017 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Claim successful on node np0000001583
May 28 01:54:15.540230 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:15.596891 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.00044940300017515256 future=<Future at 0x7724f8341a90 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:54:15.596891 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:54:15.596891 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-4.592400000547059e-05 future=<Future at 0x7724f82f15e0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:54:15.596891 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.00019569699998100987 future=<Future at 0x7724f82f15e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:54:15.596891 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:54:15.597606 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Emitting event <LifecycleEvent: 1779933240.5957925, 1291c6e1-108e-46d1-85bc-0197f71eec1f => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:54:15.597606 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] VM Stopped (Lifecycle Event)
May 28 01:54:15.598654 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-64bedf15-96c0-460d-81e5-7cbf1c70d1ae None None] Emitting event <LifecycleEvent: 1779933240.5965195, bad69594-f163-41a6-931f-d2fcda0cb7d1 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:54:15.598803 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-64bedf15-96c0-460d-81e5-7cbf1c70d1ae None None] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] VM Stopped (Lifecycle Event)
May 28 01:54:15.662868 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933255.6621447, adfbfdf0-7c0f-4834-92ff-3b8d8c39e333 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:54:15.663105 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:54:15.663320 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] VM Started (Lifecycle Event)
May 28 01:54:15.667301 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:54:15.670471 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Instance spawned successfully.
May 28 01:54:15.754419 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:54:15.777181 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:15.957685 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adfbfdf0-7c0f-4834-92ff-3b8d8c39e333/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:54:16.056248 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adfbfdf0-7c0f-4834-92ff-3b8d8c39e333/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:54:16.057312 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adfbfdf0-7c0f-4834-92ff-3b8d8c39e333/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:54:16.102959 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-64bedf15-96c0-460d-81e5-7cbf1c70d1ae None None] [instance: bad69594-f163-41a6-931f-d2fcda0cb7d1] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:54:16.104236 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f14f241f-614b-4a05-a044-6b062b914833 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: 1291c6e1-108e-46d1-85bc-0197f71eec1f] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:54:16.150109 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adfbfdf0-7c0f-4834-92ff-3b8d8c39e333/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:54:16.150605 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/dm-6 (vdc) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:54:16.153446 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e73ac672-0911-4e4d-8a85-9b635a9e836f/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:54:16.168214 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:54:16.170973 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:54:16.269473 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:54:16.270182 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e73ac672-0911-4e4d-8a85-9b635a9e836f/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:54:16.270819 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e73ac672-0911-4e4d-8a85-9b635a9e836f/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:54:16.345461 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:16.365053 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e73ac672-0911-4e4d-8a85-9b635a9e836f/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:54:16.367784 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:54:16.369217 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c36895c-9d2c-49be-b545-3658f535964a/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:54:16.464450 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c36895c-9d2c-49be-b545-3658f535964a/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:54:16.468412 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c36895c-9d2c-49be-b545-3658f535964a/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:54:16.560851 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c36895c-9d2c-49be-b545-3658f535964a/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:54:16.565458 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:54:16.566946 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:54:16.604884 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.038s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:54:16.605434 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Hypervisor/Node resource view: name=np0000001583 free_ram=13352MB free_disk=74.40675354003906GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 01:54:16.606458 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:16.675546 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:54:16.675988 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933256.6757255, adfbfdf0-7c0f-4834-92ff-3b8d8c39e333 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:54:16.676154 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] VM Paused (Lifecycle Event)
May 28 01:54:16.786640 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:16.800936 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-45582084-41dd-45a5-bdaa-960fc0674312 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 24.446s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:16.945290 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:54:16.945731 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:54:17.100257 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-3565b6db-c2a2-4148-b58c-be9937461aa3 req-c8ca7c68-1d84-4ede-ae42-27276fe0eec9 service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Received event network-vif-plugged-828d441a-570b-4f98-b093-4eb521ee2cf8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:54:17.100257 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-3565b6db-c2a2-4148-b58c-be9937461aa3 req-c8ca7c68-1d84-4ede-ae42-27276fe0eec9 service nova] Acquiring lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:17.100257 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-3565b6db-c2a2-4148-b58c-be9937461aa3 req-c8ca7c68-1d84-4ede-ae42-27276fe0eec9 service nova] Lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:17.100257 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-3565b6db-c2a2-4148-b58c-be9937461aa3 req-c8ca7c68-1d84-4ede-ae42-27276fe0eec9 service nova] Lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:17.100601 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-3565b6db-c2a2-4148-b58c-be9937461aa3 req-c8ca7c68-1d84-4ede-ae42-27276fe0eec9 service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] No waiting events found dispatching network-vif-plugged-828d441a-570b-4f98-b093-4eb521ee2cf8 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:54:17.100601 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-3565b6db-c2a2-4148-b58c-be9937461aa3 req-c8ca7c68-1d84-4ede-ae42-27276fe0eec9 service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Received unexpected event network-vif-plugged-828d441a-570b-4f98-b093-4eb521ee2cf8 for instance with vm_state active and task_state None.
May 28 01:54:17.179522 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:54:17.181761 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933257.1806934, adfbfdf0-7c0f-4834-92ff-3b8d8c39e333 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:54:17.181761 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] VM Resumed (Lifecycle Event)
May 28 01:54:17.449528 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:54:17.686481 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:54:17.688025 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:54:17.846393 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:17.962586 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.438s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:17.964736 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.618s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:17.964833 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:54:17.971340 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:54:17.973098 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Claim successful on node np0000001583
May 28 01:54:18.473977 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:54:18.474391 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:54:18.474483 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:54:18.474687 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:54:18.664161 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:18.701144 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '21c5bf800ee04e06a7ce6dfd95173502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa147b7a97664129bc2922ee1e8debc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:54:18.945178 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:18.976568 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:54:19.198329 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:19.439163 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:54:19.439362 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:54:19.478646 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:54:19.705462 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Successfully created port: d6c3c5f3-e20b-4b3e-abac-62f21007a7ad {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:54:19.943686 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:54:19.986851 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Booting with volume 9b421209-954a-413c-bf2c-892d99f40d2d at /dev/vda
May 28 01:54:20.058355 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:54:20.072391 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:54:20.105622 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:54:20.144943 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:54:20.145254 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:54:20.161111 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:54:20.161111 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe63:2bb1', 'fe80::e43a:d5ff:fecc:27fe', 'fe80::fc16:3eff:feca:36a6', 'fe80::dc2c:bbff:fe55:4bf7', 'fe80::fc16:3eff:fe91:a669', 'fe80::3051:94ff:fec8:bd13', 'fe80::fc16:3eff:fef5:ed7d', 'fe80::c4dd:b4ff:fe11:7c8'] 
May 28 01:54:20.161111 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:54:20.161111 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:54:20.161111 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] <== get_connector_properties: return (103ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:54:20.161514 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Updating existing volume attachment record: 7bc7b841-c27f-4f64-ae08-dfa0a5927d75 {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:54:20.452285 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.489s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:20.453015 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:54:20.458438 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 3.852s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:20.628920 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:20.729066 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Successfully updated port: d6c3c5f3-e20b-4b3e-abac-62f21007a7ad {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:54:20.778734 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:20.811984 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-985f1e5f-759b-4e88-ae21-76b28177f27e req-0246671b-a1b7-4658-a267-b297ee221f08 service nova] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Received event network-changed-d6c3c5f3-e20b-4b3e-abac-62f21007a7ad {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:54:20.812185 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-985f1e5f-759b-4e88-ae21-76b28177f27e req-0246671b-a1b7-4658-a267-b297ee221f08 service nova] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Refreshing instance network info cache due to event network-changed-d6c3c5f3-e20b-4b3e-abac-62f21007a7ad. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:54:20.812364 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-985f1e5f-759b-4e88-ae21-76b28177f27e req-0246671b-a1b7-4658-a267-b297ee221f08 service nova] Acquiring lock "refresh_cache-df5768dc-874f-4725-b2a2-e007aebc11a9" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:54:20.812487 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-985f1e5f-759b-4e88-ae21-76b28177f27e req-0246671b-a1b7-4658-a267-b297ee221f08 service nova] Acquired lock "refresh_cache-df5768dc-874f-4725-b2a2-e007aebc11a9" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:54:20.822195 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-985f1e5f-759b-4e88-ae21-76b28177f27e req-0246671b-a1b7-4658-a267-b297ee221f08 service nova] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Refreshing network info cache for port d6c3c5f3-e20b-4b3e-abac-62f21007a7ad {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:54:20.964825 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:54:20.966168 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:54:20.970449 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:54:20.974584 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:54:21.062386 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '27c90c0a8eb148fda8ae718f07ff1ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fbdf5ed38b4dc485a81c49b3303ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:54:21.234728 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Acquiring lock "refresh_cache-df5768dc-874f-4725-b2a2-e007aebc11a9" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:54:21.326634 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-985f1e5f-759b-4e88-ae21-76b28177f27e req-0246671b-a1b7-4658-a267-b297ee221f08 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:54:21.477145 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:54:21.536866 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance f2805796-e531-4508-8585-0d110f4bd4e7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:54:21.539918 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 5c36895c-9d2c-49be-b545-3658f535964a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:54:21.539918 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance e73ac672-0911-4e4d-8a85-9b635a9e836f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:54:21.539918 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance adfbfdf0-7c0f-4834-92ff-3b8d8c39e333 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:54:21.539918 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance df5768dc-874f-4725-b2a2-e007aebc11a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:54:21.539918 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 587a002a-2b9c-4865-8ce2-088ad567c81b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:54:21.539918 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 01:54:21.539918 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Final resource view: name=np0000001583 phys_ram=24030MB used_ram=1664MB phys_disk=95GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 01:54:16 up 30 min,  2 users,  load average: 8.17, 4.39, 2.09\n', 'num_instances': '6', 'num_vm_active': '4', 'num_task_None': '5', 'num_os_type_None': '6', 'num_proj_60fbdf5ed38b4dc485a81c49b3303ed2': '2', 'io_workload': '2', 'num_proj_02ba6b7c1fd84a7c8ed4e9f086f83fa0': '1', 'num_vm_building': '2', 'num_task_block_device_mapping': '1', 'num_proj_fa147b7a97664129bc2922ee1e8debc6': '1', 'num_proj_23e37a40d1db45cba9235de04219a3b4': '1', 'num_proj_0d31342458ec4ed2890a766f62facbcf': '1'} {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 01:54:21.940670 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:54:21.941210 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:54:21.974183 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:21.980836 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:54:22.001800 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-985f1e5f-759b-4e88-ae21-76b28177f27e req-0246671b-a1b7-4658-a267-b297ee221f08 service nova] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:54:22.301861 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:54:22.305014 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:54:22.306441 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Creating image(s)
May 28 01:54:22.306441 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Did not create local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 01:54:22.306441 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Ensure instance console log exists: /opt/stack/data/nova/instances/df5768dc-874f-4725-b2a2-e007aebc11a9/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:54:22.306633 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:22.307145 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:22.307145 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:22.380151 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Successfully created port: 6ddf64a7-099d-4ef6-8dfc-7377446b66f7 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:54:22.390914 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-985f1e5f-759b-4e88-ae21-76b28177f27e req-0246671b-a1b7-4658-a267-b297ee221f08 service nova] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:54:22.444396 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:54:22.630616 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:22.847221 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:22.889194 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-36291cfa-769e-447f-ba6e-d3442e671be7 req-b6146ed3-cdaf-4e08-8ff5-8234311ea5e6 service nova] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Received event network-vif-unplugged-d6c3c5f3-e20b-4b3e-abac-62f21007a7ad {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:54:22.889453 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-36291cfa-769e-447f-ba6e-d3442e671be7 req-b6146ed3-cdaf-4e08-8ff5-8234311ea5e6 service nova] Acquiring lock "df5768dc-874f-4725-b2a2-e007aebc11a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:22.889596 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-36291cfa-769e-447f-ba6e-d3442e671be7 req-b6146ed3-cdaf-4e08-8ff5-8234311ea5e6 service nova] Lock "df5768dc-874f-4725-b2a2-e007aebc11a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:22.889720 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-36291cfa-769e-447f-ba6e-d3442e671be7 req-b6146ed3-cdaf-4e08-8ff5-8234311ea5e6 service nova] Lock "df5768dc-874f-4725-b2a2-e007aebc11a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:22.889853 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-36291cfa-769e-447f-ba6e-d3442e671be7 req-b6146ed3-cdaf-4e08-8ff5-8234311ea5e6 service nova] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] No waiting events found dispatching network-vif-unplugged-d6c3c5f3-e20b-4b3e-abac-62f21007a7ad {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:54:22.889994 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-36291cfa-769e-447f-ba6e-d3442e671be7 req-b6146ed3-cdaf-4e08-8ff5-8234311ea5e6 service nova] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Received unexpected event network-vif-unplugged-d6c3c5f3-e20b-4b3e-abac-62f21007a7ad for instance with vm_state building and task_state spawning.
May 28 01:54:22.894871 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-985f1e5f-759b-4e88-ae21-76b28177f27e req-0246671b-a1b7-4658-a267-b297ee221f08 service nova] Releasing lock "refresh_cache-df5768dc-874f-4725-b2a2-e007aebc11a9" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:54:22.900479 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Acquired lock "refresh_cache-df5768dc-874f-4725-b2a2-e007aebc11a9" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:54:22.900711 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:54:22.954062 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Compute_service record updated for np0000001583:np0000001583 {{(pid=98241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 01:54:22.954431 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.496s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:22.957623 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 56.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:54:22.993251 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:54:22.994419 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:54:22.994730 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Creating image(s)
May 28 01:54:22.996316 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "/opt/stack/data/nova/instances/587a002a-2b9c-4865-8ce2-088ad567c81b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:22.996565 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "/opt/stack/data/nova/instances/587a002a-2b9c-4865-8ce2-088ad567c81b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:22.997349 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "/opt/stack/data/nova/instances/587a002a-2b9c-4865-8ce2-088ad567c81b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:22.998007 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:54:23.003284 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:54:23.004931 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:54:23.046193 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Successfully updated port: 6ddf64a7-099d-4ef6-8dfc-7377446b66f7 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:54:23.123424 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.118s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:54:23.123938 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:23.124558 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:23.125062 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:54:23.129187 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:54:23.129743 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:54:23.223923 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.094s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:54:23.224427 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/587a002a-2b9c-4865-8ce2-088ad567c81b/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:54:23.267384 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/587a002a-2b9c-4865-8ce2-088ad567c81b/disk 1073741824" returned: 0 in 0.042s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:54:23.268301 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.144s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:23.268656 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:54:23.370963 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.102s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:54:23.371638 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Checking if we can resize image /opt/stack/data/nova/instances/587a002a-2b9c-4865-8ce2-088ad567c81b/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:54:23.372020 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/587a002a-2b9c-4865-8ce2-088ad567c81b/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:54:23.476174 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/587a002a-2b9c-4865-8ce2-088ad567c81b/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:54:23.476679 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Cannot resize image /opt/stack/data/nova/instances/587a002a-2b9c-4865-8ce2-088ad567c81b/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:54:23.477146 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:54:23.477370 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Ensure instance console log exists: /opt/stack/data/nova/instances/587a002a-2b9c-4865-8ce2-088ad567c81b/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:54:23.477698 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:23.477993 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:23.478196 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:23.551753 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "refresh_cache-587a002a-2b9c-4865-8ce2-088ad567c81b" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:54:23.551896 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquired lock "refresh_cache-587a002a-2b9c-4865-8ce2-088ad567c81b" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:54:23.552069 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:54:23.901494 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:54:24.520775 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:54:24.992094 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ae12a667-b56f-44ee-b390-fbc871591b49 req-71ae17d0-8727-4057-b3b4-53ad03977719 service nova] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Received event network-changed-6ddf64a7-099d-4ef6-8dfc-7377446b66f7 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:54:24.992094 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ae12a667-b56f-44ee-b390-fbc871591b49 req-71ae17d0-8727-4057-b3b4-53ad03977719 service nova] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Refreshing instance network info cache due to event network-changed-6ddf64a7-099d-4ef6-8dfc-7377446b66f7. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:54:24.992094 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ae12a667-b56f-44ee-b390-fbc871591b49 req-71ae17d0-8727-4057-b3b4-53ad03977719 service nova] Acquiring lock "refresh_cache-587a002a-2b9c-4865-8ce2-088ad567c81b" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:54:25.195910 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:54:25.328443 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:25.385811 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:25.779326 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:25.932580 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-81015127-8013-4cbe-8fca-30f2ba524f9e req-cdbdc1d4-97d0-4660-b445-9e97a1eeab0c service nova] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Received event network-vif-unplugged-6ddf64a7-099d-4ef6-8dfc-7377446b66f7 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:54:25.932842 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-81015127-8013-4cbe-8fca-30f2ba524f9e req-cdbdc1d4-97d0-4660-b445-9e97a1eeab0c service nova] Acquiring lock "587a002a-2b9c-4865-8ce2-088ad567c81b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:25.933375 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-81015127-8013-4cbe-8fca-30f2ba524f9e req-cdbdc1d4-97d0-4660-b445-9e97a1eeab0c service nova] Lock "587a002a-2b9c-4865-8ce2-088ad567c81b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:25.933547 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-81015127-8013-4cbe-8fca-30f2ba524f9e req-cdbdc1d4-97d0-4660-b445-9e97a1eeab0c service nova] Lock "587a002a-2b9c-4865-8ce2-088ad567c81b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:25.933728 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-81015127-8013-4cbe-8fca-30f2ba524f9e req-cdbdc1d4-97d0-4660-b445-9e97a1eeab0c service nova] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] No waiting events found dispatching network-vif-unplugged-6ddf64a7-099d-4ef6-8dfc-7377446b66f7 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:54:25.933905 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-81015127-8013-4cbe-8fca-30f2ba524f9e req-cdbdc1d4-97d0-4660-b445-9e97a1eeab0c service nova] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Received unexpected event network-vif-unplugged-6ddf64a7-099d-4ef6-8dfc-7377446b66f7 for instance with vm_state building and task_state spawning.
May 28 01:54:26.098562 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:26.321690 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:54:26.329453 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Updating instance_info_cache with network_info: [{"id": "d6c3c5f3-e20b-4b3e-abac-62f21007a7ad", "address": "fa:16:3e:28:95:8e", "network": {"id": "5e77962e-bcd9-4ce2-89c8-2a3c2cbd75a0", "bridge": "br-int", "label": "tempest-TestShelveInstance-351174513-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fa147b7a97664129bc2922ee1e8debc6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c3c5f3-e2", "ovs_interfaceid": "d6c3c5f3-e20b-4b3e-abac-62f21007a7ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:54:26.833112 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Releasing lock "refresh_cache-df5768dc-874f-4725-b2a2-e007aebc11a9" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:54:26.833112 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Instance network_info: |[{"id": "d6c3c5f3-e20b-4b3e-abac-62f21007a7ad", "address": "fa:16:3e:28:95:8e", "network": {"id": "5e77962e-bcd9-4ce2-89c8-2a3c2cbd75a0", "bridge": "br-int", "label": "tempest-TestShelveInstance-351174513-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fa147b7a97664129bc2922ee1e8debc6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c3c5f3-e2", "ovs_interfaceid": "d6c3c5f3-e20b-4b3e-abac-62f21007a7ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:54:26.834457 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Start _get_guest_xml network_info=[{"id": "d6c3c5f3-e20b-4b3e-abac-62f21007a7ad", "address": "fa:16:3e:28:95:8e", "network": {"id": "5e77962e-bcd9-4ce2-89c8-2a3c2cbd75a0", "bridge": "br-int", "label": "tempest-TestShelveInstance-351174513-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fa147b7a97664129bc2922ee1e8debc6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c3c5f3-e2", "ovs_interfaceid": "d6c3c5f3-e20b-4b3e-abac-62f21007a7ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d', 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9b421209-954a-413c-bf2c-892d99f40d2d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'df5768dc-874f-4725-b2a2-e007aebc11a9', 'attached_at': '', 'detached_at': '', 'volume_id': '9b421209-954a-413c-bf2c-892d99f40d2d', 'serial': '9b421209-954a-413c-bf2c-892d99f40d2d'}, 'delete_on_termination': True, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '7bc7b841-c27f-4f64-ae08-dfa0a5927d75', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:54:26.840892 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:54:26.842382 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestShelveInstance-server-2097870267', uuid='df5768dc-874f-4725-b2a2-e007aebc11a9'), owner=OwnerMeta(userid='21c5bf800ee04e06a7ce6dfd95173502', username='tempest-TestShelveInstance-1732527786-project-member', projectid='fa147b7a97664129bc2922ee1e8debc6', projectname='tempest-TestShelveInstance-1732527786'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d6c3c5f3-e20b-4b3e-abac-62f21007a7ad", "address": "fa:16:3e:28:95:8e", "network": {"id": "5e77962e-bcd9-4ce2-89c8-2a3c2cbd75a0", "bridge": "br-int", "label": "tempest-TestShelveInstance-351174513-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fa147b7a97664129bc2922ee1e8debc6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c3c5f3-e2", "ovs_interfaceid": "d6c3c5f3-e20b-4b3e-abac-62f21007a7ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933266.8418622) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:54:26.844010 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:54:26.844607 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:54:26.846671 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:54:26.846981 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:54:26.848016 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:54:26.848406 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:54:26.848577 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:54:26.848866 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:54:26.848866 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:54:26.849323 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:54:26.849323 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:54:26.849323 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:54:26.849438 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:54:26.849581 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:54:26.851545 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:54:26.852311 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:54:26.873408 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:54:26.874624 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d', 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9b421209-954a-413c-bf2c-892d99f40d2d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:54:26.874624 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:54:26.874624 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:54:26.874844 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d', 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9b421209-954a-413c-bf2c-892d99f40d2d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:54:26.889215 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:54:26.890517 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:54:26.890517 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:54:26.890646 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:54:26.891192 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:54:26.891481 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:54:26.906458 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:54:26.906458 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:54:26.913292 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:54:26.913292 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:54:26.922632 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d] added
May 28 01:54:26.922632 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:54:26.922632 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:54:26.922632 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:54:26.922632 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:54:26.922632 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:54:26.922632 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:54:26.922910 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:54:26.923121 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0332(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:54:26.923306 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:54:26.930901 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d] added
May 28 01:54:26.930901 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:54:26.930901 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:54:26.930901 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:54:26.930901 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:54:26.930901 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:54:26.930901 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:54:26.931178 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:54:26.931256 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0398(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:54:26.931400 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:54:27.627927 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:27.849880 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:27.864805 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Updating instance_info_cache with network_info: [{"id": "6ddf64a7-099d-4ef6-8dfc-7377446b66f7", "address": "fa:16:3e:94:75:97", "network": {"id": "b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-280876007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60fbdf5ed38b4dc485a81c49b3303ed2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddf64a7-09", "ovs_interfaceid": "6ddf64a7-099d-4ef6-8dfc-7377446b66f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:54:27.923953 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:54:27.932284 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:54:27.941433 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:54:27.941433 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:54:27.949744 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:54:27.949744 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:54:27.956585 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:54:27.964373 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:54:27.972147 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:54:27.972147 np0000001583 nova-compute[98241]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:54:27.972147 np0000001583 nova-compute[98241]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42 (non-flash)
May 28 01:54:27.972147 np0000001583 nova-compute[98241]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42 (non-flash)
May 28 01:54:27.972147 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:54:27.972640 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsi session list stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:54:27.972640 np0000001583 nova-compute[98241]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:54:27.972640 np0000001583 nova-compute[98241]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42 (non-flash)
May 28 01:54:27.972640 np0000001583 nova-compute[98241]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42 (non-flash)
May 28 01:54:27.972640 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:54:27.979800 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:54:27.979800 np0000001583 nova-compute[98241]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:54:27.979800 np0000001583 nova-compute[98241]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42 (non-flash)
May 28 01:54:27.979800 np0000001583 nova-compute[98241]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42 (non-flash)
May 28 01:54:27.979800 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:54:27.980340 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsi session list stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:54:27.980340 np0000001583 nova-compute[98241]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:54:27.980340 np0000001583 nova-compute[98241]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42 (non-flash)
May 28 01:54:27.980340 np0000001583 nova-compute[98241]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42 (non-flash)
May 28 01:54:27.980340 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:54:28.014757 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d, portal: 192.168.40.100,3260]
May 28 01:54:28.014757 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d, portal: 192.168.40.100,3260] successful.
May 28 01:54:28.014757 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:54:28.017580 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d, portal: 192.168.50.100,3260]
May 28 01:54:28.017580 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d, portal: 192.168.50.100,3260] successful.
May 28 01:54:28.017580 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:54:28.030429 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:54:28.038219 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:54:28.051987 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:54:28.051987 np0000001583 nova-compute[98241]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:54:28.051987 np0000001583 nova-compute[98241]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42 (non-flash)
May 28 01:54:28.051987 np0000001583 nova-compute[98241]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42 (non-flash)
May 28 01:54:28.051987 np0000001583 nova-compute[98241]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:54:28.051987 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:54:28.051987 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:54:28.054946 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsi session list stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:54:28.054946 np0000001583 nova-compute[98241]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:54:28.054946 np0000001583 nova-compute[98241]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42 (non-flash)
May 28 01:54:28.054946 np0000001583 nova-compute[98241]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42 (non-flash)
May 28 01:54:28.054946 np0000001583 nova-compute[98241]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:54:28.054946 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:54:28.054946 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:54:28.054946 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.163s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:54:28.054946 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:54:28.054946 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] HCTL ('9', '-', '-', 0) found on session 30 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:54:28.054946 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:54:28.060780 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:54:28.060780 np0000001583 nova-compute[98241]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:54:28.060780 np0000001583 nova-compute[98241]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42 (non-flash)
May 28 01:54:28.060780 np0000001583 nova-compute[98241]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42 (non-flash)
May 28 01:54:28.060780 np0000001583 nova-compute[98241]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:54:28.060780 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:54:28.060780 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:54:28.061017 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsi session list stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:54:28.061017 np0000001583 nova-compute[98241]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:54:28.061017 np0000001583 nova-compute[98241]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42 (non-flash)
May 28 01:54:28.061017 np0000001583 nova-compute[98241]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42 (non-flash)
May 28 01:54:28.061017 np0000001583 nova-compute[98241]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:54:28.061017 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:54:28.061017 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:54:28.061452 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.170s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:54:28.061598 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:54:28.062466 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] HCTL ('10', '-', '-', 0) found on session 31 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:54:28.062623 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:54:28.075847 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Searching for a device in session 30 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:54:28.076271 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9b421209-954a-413c-bf2c-892d99f40d2d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:54:28.093415 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Searching for a device in session 31 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:54:28.093415 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9b421209-954a-413c-bf2c-892d99f40d2d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:54:28.369863 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Releasing lock "refresh_cache-587a002a-2b9c-4865-8ce2-088ad567c81b" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:54:28.369863 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Instance network_info: |[{"id": "6ddf64a7-099d-4ef6-8dfc-7377446b66f7", "address": "fa:16:3e:94:75:97", "network": {"id": "b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-280876007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60fbdf5ed38b4dc485a81c49b3303ed2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddf64a7-09", "ovs_interfaceid": "6ddf64a7-099d-4ef6-8dfc-7377446b66f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:54:28.369863 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ae12a667-b56f-44ee-b390-fbc871591b49 req-71ae17d0-8727-4057-b3b4-53ad03977719 service nova] Acquired lock "refresh_cache-587a002a-2b9c-4865-8ce2-088ad567c81b" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:54:28.371350 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-ae12a667-b56f-44ee-b390-fbc871591b49 req-71ae17d0-8727-4057-b3b4-53ad03977719 service nova] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Refreshing network info cache for port 6ddf64a7-099d-4ef6-8dfc-7377446b66f7 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:54:28.372445 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Start _get_guest_xml network_info=[{"id": "6ddf64a7-099d-4ef6-8dfc-7377446b66f7", "address": "fa:16:3e:94:75:97", "network": {"id": "b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-280876007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60fbdf5ed38b4dc485a81c49b3303ed2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddf64a7-09", "ovs_interfaceid": "6ddf64a7-099d-4ef6-8dfc-7377446b66f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:54:28.380285 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:54:28.381422 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-tempest.common.compute-instance-307669431', uuid='587a002a-2b9c-4865-8ce2-088ad567c81b'), owner=OwnerMeta(userid='27c90c0a8eb148fda8ae718f07ff1ed4', username='tempest-ServerActionsTestOtherA-1714646345-project-member', projectid='60fbdf5ed38b4dc485a81c49b3303ed2', projectname='tempest-ServerActionsTestOtherA-1714646345'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6ddf64a7-099d-4ef6-8dfc-7377446b66f7", "address": "fa:16:3e:94:75:97", "network": {"id": "b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-280876007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60fbdf5ed38b4dc485a81c49b3303ed2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddf64a7-09", "ovs_interfaceid": "6ddf64a7-099d-4ef6-8dfc-7377446b66f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933268.3808367) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:54:28.383340 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:54:28.383745 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:54:28.386207 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:54:28.386207 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:54:28.386721 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:54:28.388003 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:54:28.388248 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:54:28.388600 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:54:28.388787 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:54:28.390052 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:54:28.390052 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:54:28.390052 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:54:28.390052 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:54:28.390358 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:54:28.390556 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:54:28.390732 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:54:28.402823 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:54:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-307669431',display_name='tempest-tempest.common.compute-instance-307669431',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-tempest-common-compute-instance-307669431',id=13,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+uj6sYtPnyFWQs1nCcEuZB/a15TtoxueiMzmbIyATZcok2qJukDOEiuQPENacqvJA6yFSDD4IVNTN5EdbtPeAegQv2a08BDT/l0Bf9OlKlI25U/AVBDkLghlYu/vY6eg==',key_name='tempest-keypair-374991287',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60fbdf5ed38b4dc485a81c49b3303ed2',ramdisk_id='',reservation_id='r-m7y4i9cj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1714646345',owner_user_name='tempest-ServerActionsTestOtherA-1714646345-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:54:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27c90c0a8eb148fda8ae718f07ff1ed4',uuid=587a002a-2b9c-4865-8ce2-088ad567c81b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ddf64a7-099d-4ef6-8dfc-7377446b66f7", "address": "fa:16:3e:94:75:97", "network": {"id": "b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-280876007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60fbdf5ed38b4dc485a81c49b3303ed2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddf64a7-09", "ovs_interfaceid": "6ddf64a7-099d-4ef6-8dfc-7377446b66f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:54:28.403049 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Converting VIF {"id": "6ddf64a7-099d-4ef6-8dfc-7377446b66f7", "address": "fa:16:3e:94:75:97", "network": {"id": "b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-280876007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60fbdf5ed38b4dc485a81c49b3303ed2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddf64a7-09", "ovs_interfaceid": "6ddf64a7-099d-4ef6-8dfc-7377446b66f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:54:28.403666 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:75:97,bridge_name='br-int',has_traffic_filtering=True,id=6ddf64a7-099d-4ef6-8dfc-7377446b66f7,network=Network(b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ddf64a7-09') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:54:28.404487 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lazy-loading 'pci_devices' on Instance uuid 587a002a-2b9c-4865-8ce2-088ad567c81b {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:54:28.874833 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-ae12a667-b56f-44ee-b390-fbc871591b49 req-71ae17d0-8727-4057-b3b4-53ad03977719 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:54:28.892031 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:54:28.892278 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:28.907761 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] End _get_guest_xml xml=<domain type="qemu">
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:   <uuid>587a002a-2b9c-4865-8ce2-088ad567c81b</uuid>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:   <name>instance-0000000d</name>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:       <nova:name>tempest-tempest.common.compute-instance-307669431</nova:name>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:54:28</nova:creationTime>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:         <nova:user uuid="27c90c0a8eb148fda8ae718f07ff1ed4">tempest-ServerActionsTestOtherA-1714646345-project-member</nova:user>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:         <nova:project uuid="60fbdf5ed38b4dc485a81c49b3303ed2">tempest-ServerActionsTestOtherA-1714646345</nova:project>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:         <nova:port uuid="6ddf64a7-099d-4ef6-8dfc-7377446b66f7">
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:     <system>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:       <entry name="serial">587a002a-2b9c-4865-8ce2-088ad567c81b</entry>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:       <entry name="uuid">587a002a-2b9c-4865-8ce2-088ad567c81b</entry>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:     </system>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:   <os>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:   </os>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:   <features>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:   </features>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:   <devices>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/587a002a-2b9c-4865-8ce2-088ad567c81b/disk"/>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:     </disk>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/587a002a-2b9c-4865-8ce2-088ad567c81b/disk.config"/>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:     </disk>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:94:75:97"/>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:       <target dev="tap6ddf64a7-09"/>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:     </interface>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/587a002a-2b9c-4865-8ce2-088ad567c81b/console.log" append="off"/>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:     </serial>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:     <video>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:     </video>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:     </rng>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:   </devices>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]: </domain>
May 28 01:54:28.907761 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:54:28.909623 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Preparing to wait for external event network-vif-plugged-6ddf64a7-099d-4ef6-8dfc-7377446b66f7 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:54:28.909623 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "587a002a-2b9c-4865-8ce2-088ad567c81b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:28.909623 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "587a002a-2b9c-4865-8ce2-088ad567c81b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:28.909623 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "587a002a-2b9c-4865-8ce2-088ad567c81b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:28.911386 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:54:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-307669431',display_name='tempest-tempest.common.compute-instance-307669431',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-tempest-common-compute-instance-307669431',id=13,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+uj6sYtPnyFWQs1nCcEuZB/a15TtoxueiMzmbIyATZcok2qJukDOEiuQPENacqvJA6yFSDD4IVNTN5EdbtPeAegQv2a08BDT/l0Bf9OlKlI25U/AVBDkLghlYu/vY6eg==',key_name='tempest-keypair-374991287',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60fbdf5ed38b4dc485a81c49b3303ed2',ramdisk_id='',reservation_id='r-m7y4i9cj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1714646345',owner_user_name='tempest-ServerActionsTestOtherA-1714646345-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:54:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27c90c0a8eb148fda8ae718f07ff1ed4',uuid=587a002a-2b9c-4865-8ce2-088ad567c81b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ddf64a7-099d-4ef6-8dfc-7377446b66f7", "address": "fa:16:3e:94:75:97", "network": {"id": "b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-280876007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60fbdf5ed38b4dc485a81c49b3303ed2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddf64a7-09", "ovs_interfaceid": "6ddf64a7-099d-4ef6-8dfc-7377446b66f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:54:28.911386 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Converting VIF {"id": "6ddf64a7-099d-4ef6-8dfc-7377446b66f7", "address": "fa:16:3e:94:75:97", "network": {"id": "b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-280876007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60fbdf5ed38b4dc485a81c49b3303ed2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddf64a7-09", "ovs_interfaceid": "6ddf64a7-099d-4ef6-8dfc-7377446b66f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:54:28.911386 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:75:97,bridge_name='br-int',has_traffic_filtering=True,id=6ddf64a7-099d-4ef6-8dfc-7377446b66f7,network=Network(b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ddf64a7-09') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:54:28.912331 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:75:97,bridge_name='br-int',has_traffic_filtering=True,id=6ddf64a7-099d-4ef6-8dfc-7377446b66f7,network=Network(b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ddf64a7-09') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:54:28.912599 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:28.913981 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:54:28.913981 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:54:28.914871 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:28.915097 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4d7078cd-b62c-567e-8e1d-12562936b86c', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:54:28.916046 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:28.917611 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:54:28.925005 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:28.925401 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6ddf64a7-09, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:54:28.925763 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6ddf64a7-09, col_values=(('qos', UUID('df6738ab-f6cd-4ca0-af5b-9e8b86ab16ef')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:54:28.926220 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6ddf64a7-09, col_values=(('external_ids', {'iface-id': '6ddf64a7-099d-4ef6-8dfc-7377446b66f7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:75:97', 'vm-uuid': '587a002a-2b9c-4865-8ce2-088ad567c81b'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:54:28.930406 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:28.934871 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:54:28.937344 np0000001583 nova-compute[98241]: INFO os_vif [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:75:97,bridge_name='br-int',has_traffic_filtering=True,id=6ddf64a7-099d-4ef6-8dfc-7377446b66f7,network=Network(b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ddf64a7-09')
May 28 01:54:29.423012 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-ae12a667-b56f-44ee-b390-fbc871591b49 req-71ae17d0-8727-4057-b3b4-53ad03977719 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:54:29.560293 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:29.736458 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-ae12a667-b56f-44ee-b390-fbc871591b49 req-71ae17d0-8727-4057-b3b4-53ad03977719 service nova] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Updated VIF entry in instance network info cache for port 6ddf64a7-099d-4ef6-8dfc-7377446b66f7. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:54:29.736458 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-ae12a667-b56f-44ee-b390-fbc871591b49 req-71ae17d0-8727-4057-b3b4-53ad03977719 service nova] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Updating instance_info_cache with network_info: [{"id": "6ddf64a7-099d-4ef6-8dfc-7377446b66f7", "address": "fa:16:3e:94:75:97", "network": {"id": "b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-280876007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60fbdf5ed38b4dc485a81c49b3303ed2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddf64a7-09", "ovs_interfaceid": "6ddf64a7-099d-4ef6-8dfc-7377446b66f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:54:29.908912 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Found WWN 3300000001305f420 for multipath device dm-3 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:54:29.909345 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:54:29.909345 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '3300000001305f420', 'path': '/dev/dm-3', 'multipath_id': '3300000001305f420'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:54:29.909449 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000001305f420', 'path': '/dev/dm-3', 'multipath_id': '3300000001305f420'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:54:30.237992 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ae12a667-b56f-44ee-b390-fbc871591b49 req-71ae17d0-8727-4057-b3b4-53ad03977719 service nova] Releasing lock "refresh_cache-587a002a-2b9c-4865-8ce2-088ad567c81b" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:54:30.416036 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:54:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2097870267',display_name='tempest-TestShelveInstance-server-2097870267',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testshelveinstance-server-2097870267',id=12,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL46Secb60DFBeK7FYqoi8EyIkwOHDasdwHPDEkahIVyxNd9me+C0BL02CY5OdHq98hox5RGNtNExMA3lQLKOE6SZ9TSLqEp13Ql4Ayf4q9cLQMDfsak90PHfcn9GypAaA==',key_name='tempest-TestShelveInstance-1311460250',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa147b7a97664129bc2922ee1e8debc6',ramdisk_id='',reservation_id='r-yyloknk0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1732527786',owner_user_name='tempest-TestShelveInstance-1732527786-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:54:20Z,user_data=None,user_id='21c5bf800ee04e06a7ce6dfd95173502',uuid=df5768dc-874f-4725-b2a2-e007aebc11a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6c3c5f3-e20b-4b3e-abac-62f21007a7ad", "address": "fa:16:3e:28:95:8e", "network": {"id": "5e77962e-bcd9-4ce2-89c8-2a3c2cbd75a0", "bridge": "br-int", "label": "tempest-TestShelveInstance-351174513-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fa147b7a97664129bc2922ee1e8debc6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c3c5f3-e2", "ovs_interfaceid": "d6c3c5f3-e20b-4b3e-abac-62f21007a7ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:54:30.416036 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Converting VIF {"id": "d6c3c5f3-e20b-4b3e-abac-62f21007a7ad", "address": "fa:16:3e:28:95:8e", "network": {"id": "5e77962e-bcd9-4ce2-89c8-2a3c2cbd75a0", "bridge": "br-int", "label": "tempest-TestShelveInstance-351174513-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fa147b7a97664129bc2922ee1e8debc6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c3c5f3-e2", "ovs_interfaceid": "d6c3c5f3-e20b-4b3e-abac-62f21007a7ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:54:30.417657 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:95:8e,bridge_name='br-int',has_traffic_filtering=True,id=d6c3c5f3-e20b-4b3e-abac-62f21007a7ad,network=Network(5e77962e-bcd9-4ce2-89c8-2a3c2cbd75a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6c3c5f3-e2') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:54:30.418326 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Lazy-loading 'pci_devices' on Instance uuid df5768dc-874f-4725-b2a2-e007aebc11a9 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:54:30.456270 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:54:30.456503 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:54:30.456716 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] No VIF found with MAC fa:16:3e:94:75:97, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:54:30.457224 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Using config drive
May 28 01:54:30.923645 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] End _get_guest_xml xml=<domain type="qemu">
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:   <uuid>df5768dc-874f-4725-b2a2-e007aebc11a9</uuid>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:   <name>instance-0000000c</name>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:       <nova:name>tempest-TestShelveInstance-server-2097870267</nova:name>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:54:26</nova:creationTime>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:       <nova:image uuid="">
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:         <nova:user uuid="21c5bf800ee04e06a7ce6dfd95173502">tempest-TestShelveInstance-1732527786-project-member</nova:user>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:         <nova:project uuid="fa147b7a97664129bc2922ee1e8debc6">tempest-TestShelveInstance-1732527786</nova:project>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:       <nova:root type="volume" uuid=""/>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:         <nova:port uuid="d6c3c5f3-e20b-4b3e-abac-62f21007a7ad">
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:     <system>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:       <entry name="serial">df5768dc-874f-4725-b2a2-e007aebc11a9</entry>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:       <entry name="uuid">df5768dc-874f-4725-b2a2-e007aebc11a9</entry>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:     </system>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:   <os>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:   </os>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:   <features>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:   </features>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:   <devices>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/df5768dc-874f-4725-b2a2-e007aebc11a9/disk.config"/>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:     </disk>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:     <disk type="block" device="disk">
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:       <alias name="ua-9b421209-954a-413c-bf2c-892d99f40d2d"/>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:       <source dev="/dev/dm-3"/>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:       <serial>9b421209-954a-413c-bf2c-892d99f40d2d</serial>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:     </disk>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:28:95:8e"/>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:       <target dev="tapd6c3c5f3-e2"/>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:     </interface>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/df5768dc-874f-4725-b2a2-e007aebc11a9/console.log" append="off"/>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:     </serial>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:     <video>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:     </video>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:     </rng>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:   </devices>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]: </domain>
May 28 01:54:30.923645 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:54:30.925824 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Preparing to wait for external event network-vif-plugged-d6c3c5f3-e20b-4b3e-abac-62f21007a7ad {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:54:30.925824 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Acquiring lock "df5768dc-874f-4725-b2a2-e007aebc11a9-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:30.925824 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Lock "df5768dc-874f-4725-b2a2-e007aebc11a9-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:30.925824 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Lock "df5768dc-874f-4725-b2a2-e007aebc11a9-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:30.925824 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:54:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2097870267',display_name='tempest-TestShelveInstance-server-2097870267',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testshelveinstance-server-2097870267',id=12,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL46Secb60DFBeK7FYqoi8EyIkwOHDasdwHPDEkahIVyxNd9me+C0BL02CY5OdHq98hox5RGNtNExMA3lQLKOE6SZ9TSLqEp13Ql4Ayf4q9cLQMDfsak90PHfcn9GypAaA==',key_name='tempest-TestShelveInstance-1311460250',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa147b7a97664129bc2922ee1e8debc6',ramdisk_id='',reservation_id='r-yyloknk0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1732527786',owner_user_name='tempest-TestShelveInstance-1732527786-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:54:20Z,user_data=None,user_id='21c5bf800ee04e06a7ce6dfd95173502',uuid=df5768dc-874f-4725-b2a2-e007aebc11a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6c3c5f3-e20b-4b3e-abac-62f21007a7ad", "address": "fa:16:3e:28:95:8e", "network": {"id": "5e77962e-bcd9-4ce2-89c8-2a3c2cbd75a0", "bridge": "br-int", "label": "tempest-TestShelveInstance-351174513-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fa147b7a97664129bc2922ee1e8debc6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c3c5f3-e2", "ovs_interfaceid": "d6c3c5f3-e20b-4b3e-abac-62f21007a7ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:54:30.925824 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Converting VIF {"id": "d6c3c5f3-e20b-4b3e-abac-62f21007a7ad", "address": "fa:16:3e:28:95:8e", "network": {"id": "5e77962e-bcd9-4ce2-89c8-2a3c2cbd75a0", "bridge": "br-int", "label": "tempest-TestShelveInstance-351174513-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fa147b7a97664129bc2922ee1e8debc6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c3c5f3-e2", "ovs_interfaceid": "d6c3c5f3-e20b-4b3e-abac-62f21007a7ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:54:30.926030 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:95:8e,bridge_name='br-int',has_traffic_filtering=True,id=d6c3c5f3-e20b-4b3e-abac-62f21007a7ad,network=Network(5e77962e-bcd9-4ce2-89c8-2a3c2cbd75a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6c3c5f3-e2') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:54:30.931694 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:95:8e,bridge_name='br-int',has_traffic_filtering=True,id=d6c3c5f3-e20b-4b3e-abac-62f21007a7ad,network=Network(5e77962e-bcd9-4ce2-89c8-2a3c2cbd75a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6c3c5f3-e2') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:54:30.931981 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:30.932196 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:54:30.932452 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:54:30.933252 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:30.933417 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cf685a94-2be5-510f-b153-aecbbc731b8e', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:54:30.935378 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:30.938303 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:54:30.939778 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:30.941251 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:30.941384 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6c3c5f3-e2, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:54:30.942098 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd6c3c5f3-e2, col_values=(('qos', UUID('9e94340f-4d4c-4e43-9269-86dae813fb57')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:54:30.942098 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd6c3c5f3-e2, col_values=(('external_ids', {'iface-id': 'd6c3c5f3-e20b-4b3e-abac-62f21007a7ad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:95:8e', 'vm-uuid': 'df5768dc-874f-4725-b2a2-e007aebc11a9'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:54:30.943483 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:30.943483 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:54:30.954745 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:30.955763 np0000001583 nova-compute[98241]: INFO os_vif [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:95:8e,bridge_name='br-int',has_traffic_filtering=True,id=d6c3c5f3-e20b-4b3e-abac-62f21007a7ad,network=Network(5e77962e-bcd9-4ce2-89c8-2a3c2cbd75a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6c3c5f3-e2')
May 28 01:54:30.966190 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:54:31.125571 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Creating config drive at /opt/stack/data/nova/instances/587a002a-2b9c-4865-8ce2-088ad567c81b/disk.config
May 28 01:54:31.132733 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/587a002a-2b9c-4865-8ce2-088ad567c81b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmph2ia4xta {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:54:31.174531 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/587a002a-2b9c-4865-8ce2-088ad567c81b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmph2ia4xta" returned: 0 in 0.041s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:54:31.650775 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:31.686529 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:31.692262 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:31.742008 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "75c911c7-ae44-4902-989f-3f0655243f3f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:31.742304 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "75c911c7-ae44-4902-989f-3f0655243f3f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:31.771818 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:31.829468 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:31.835771 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:32.002558 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9b9aa974-ca9f-4604-ab60-17a5d0cc8b1a req-6f58b222-f306-489b-a21d-c134cd726623 service nova] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Received event network-vif-plugged-6ddf64a7-099d-4ef6-8dfc-7377446b66f7 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:54:32.003715 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9b9aa974-ca9f-4604-ab60-17a5d0cc8b1a req-6f58b222-f306-489b-a21d-c134cd726623 service nova] Acquiring lock "587a002a-2b9c-4865-8ce2-088ad567c81b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:32.004572 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9b9aa974-ca9f-4604-ab60-17a5d0cc8b1a req-6f58b222-f306-489b-a21d-c134cd726623 service nova] Lock "587a002a-2b9c-4865-8ce2-088ad567c81b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:32.004712 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9b9aa974-ca9f-4604-ab60-17a5d0cc8b1a req-6f58b222-f306-489b-a21d-c134cd726623 service nova] Lock "587a002a-2b9c-4865-8ce2-088ad567c81b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:32.004847 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9b9aa974-ca9f-4604-ab60-17a5d0cc8b1a req-6f58b222-f306-489b-a21d-c134cd726623 service nova] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Processing event network-vif-plugged-6ddf64a7-099d-4ef6-8dfc-7377446b66f7 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:54:32.245902 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:54:32.448446 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933272.4479015, 587a002a-2b9c-4865-8ce2-088ad567c81b => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:54:32.450444 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] VM Started (Lifecycle Event)
May 28 01:54:32.451766 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:54:32.455768 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:54:32.464560 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Instance spawned successfully.
May 28 01:54:32.464821 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:54:32.479913 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:54:32.480109 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:54:32.480304 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] No VIF found with MAC fa:16:3e:28:95:8e, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:54:32.480799 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Using config drive
May 28 01:54:32.852798 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:32.956023 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:54:32.960979 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:54:32.974779 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:54:32.974915 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:54:32.975385 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:54:32.975698 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:54:32.975954 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:54:32.976260 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:54:32.986289 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:54:33.039386 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:33.039970 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:33.045460 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:54:33.045660 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Claim successful on node np0000001583
May 28 01:54:33.209273 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Creating config drive at /opt/stack/data/nova/instances/df5768dc-874f-4725-b2a2-e007aebc11a9/disk.config
May 28 01:54:33.213445 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/df5768dc-874f-4725-b2a2-e007aebc11a9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbrs73tkl {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:54:33.264308 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/df5768dc-874f-4725-b2a2-e007aebc11a9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbrs73tkl" returned: 0 in 0.050s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:54:33.464167 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:54:33.464574 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933273.4642766, 587a002a-2b9c-4865-8ce2-088ad567c81b => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:54:33.464700 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] VM Paused (Lifecycle Event)
May 28 01:54:33.486917 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Took 10.49 seconds to spawn the instance on the hypervisor.
May 28 01:54:33.487979 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:54:33.779449 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:33.781425 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:33.783666 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c2c27d9f-908f-4d6b-8d63-ae7b1ca7892c tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Acquiring lock "interface-e73ac672-0911-4e4d-8a85-9b635a9e836f-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:33.783912 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c2c27d9f-908f-4d6b-8d63-ae7b1ca7892c tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Lock "interface-e73ac672-0911-4e4d-8a85-9b635a9e836f-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:33.786277 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-c2c27d9f-908f-4d6b-8d63-ae7b1ca7892c tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Lazy-loading 'flavor' on Instance uuid e73ac672-0911-4e4d-8a85-9b635a9e836f {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:54:33.805176 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:33.887281 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:33.967977 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:54:33.976582 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933273.9762444, 587a002a-2b9c-4865-8ce2-088ad567c81b => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:54:33.976775 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] VM Resumed (Lifecycle Event)
May 28 01:54:34.005912 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Took 17.74 seconds to build instance.
May 28 01:54:34.094474 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-de4f81de-0e59-4d44-a23c-e54bcf85fe30 req-a85231f7-1915-4436-a4d6-ac84c3fde185 service nova] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Received event network-vif-plugged-6ddf64a7-099d-4ef6-8dfc-7377446b66f7 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:54:34.096345 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-de4f81de-0e59-4d44-a23c-e54bcf85fe30 req-a85231f7-1915-4436-a4d6-ac84c3fde185 service nova] Acquiring lock "587a002a-2b9c-4865-8ce2-088ad567c81b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:34.096345 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-de4f81de-0e59-4d44-a23c-e54bcf85fe30 req-a85231f7-1915-4436-a4d6-ac84c3fde185 service nova] Lock "587a002a-2b9c-4865-8ce2-088ad567c81b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:34.096345 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-de4f81de-0e59-4d44-a23c-e54bcf85fe30 req-a85231f7-1915-4436-a4d6-ac84c3fde185 service nova] Lock "587a002a-2b9c-4865-8ce2-088ad567c81b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:34.096477 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-de4f81de-0e59-4d44-a23c-e54bcf85fe30 req-a85231f7-1915-4436-a4d6-ac84c3fde185 service nova] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] No waiting events found dispatching network-vif-plugged-6ddf64a7-099d-4ef6-8dfc-7377446b66f7 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:54:34.096628 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-de4f81de-0e59-4d44-a23c-e54bcf85fe30 req-a85231f7-1915-4436-a4d6-ac84c3fde185 service nova] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Received unexpected event network-vif-plugged-6ddf64a7-099d-4ef6-8dfc-7377446b66f7 for instance with vm_state active and task_state None.
May 28 01:54:34.129858 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Refreshing inventories for resource provider cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 28 01:54:34.186904 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:34.209600 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Updating ProviderTree inventory for provider cfa1af79-477d-460a-869d-84a19fa91765 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 28 01:54:34.209843 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Updating inventory in ProviderTree for provider cfa1af79-477d-460a-869d-84a19fa91765 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 28 01:54:34.238333 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:34.242433 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:34.270208 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:34.285547 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Refreshing aggregate associations for resource provider cfa1af79-477d-460a-869d-84a19fa91765, aggregates: None {{(pid=98241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 28 01:54:34.294487 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-c2c27d9f-908f-4d6b-8d63-ae7b1ca7892c tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:54:34.374556 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Refreshing trait associations for resource provider cfa1af79-477d-460a-869d-84a19fa91765, traits: COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_NET_VIF_MODEL_IGB,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_ARCH_AARCH64,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_ARCH_S390X,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ARCH_MIPSEL,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,COMPUTE_SOUND_MODEL_USB,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ARCH_X86_64,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ARCH_RISCV64,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ARCH_PPC64LE,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_SOUND_MODEL_SB16,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_SOUND_MODEL_AC97,COMPUTE_RESCUE_BFV,HW_ARCH_X86_64,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=98241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 28 01:54:34.484262 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:54:34.491125 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:54:34.509217 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2cdf2355-95dd-424d-8aa0-a43a7ef028b1 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "587a002a-2b9c-4865-8ce2-088ad567c81b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.257s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:34.653106 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-c2c27d9f-908f-4d6b-8d63-ae7b1ca7892c tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Lazy-loading 'pci_requests' on Instance uuid e73ac672-0911-4e4d-8a85-9b635a9e836f {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:54:34.903063 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:54:34.903415 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:54:34.994712 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933274.9940474, df5768dc-874f-4725-b2a2-e007aebc11a9 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:54:34.994712 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] VM Started (Lifecycle Event)
May 28 01:54:35.143505 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-6d3752b1-1d19-49f9-a54d-2a1e4df6dca5 req-ea9b580e-907c-4a50-bb78-78e02602632e service nova] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Received event network-vif-plugged-d6c3c5f3-e20b-4b3e-abac-62f21007a7ad {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:54:35.145328 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-6d3752b1-1d19-49f9-a54d-2a1e4df6dca5 req-ea9b580e-907c-4a50-bb78-78e02602632e service nova] Acquiring lock "df5768dc-874f-4725-b2a2-e007aebc11a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:35.145465 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-6d3752b1-1d19-49f9-a54d-2a1e4df6dca5 req-ea9b580e-907c-4a50-bb78-78e02602632e service nova] Lock "df5768dc-874f-4725-b2a2-e007aebc11a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:35.145648 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-6d3752b1-1d19-49f9-a54d-2a1e4df6dca5 req-ea9b580e-907c-4a50-bb78-78e02602632e service nova] Lock "df5768dc-874f-4725-b2a2-e007aebc11a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:35.145779 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-6d3752b1-1d19-49f9-a54d-2a1e4df6dca5 req-ea9b580e-907c-4a50-bb78-78e02602632e service nova] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Processing event network-vif-plugged-d6c3c5f3-e20b-4b3e-abac-62f21007a7ad {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:54:35.146390 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:54:35.150833 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:54:35.153869 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Instance spawned successfully.
May 28 01:54:35.154322 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:54:35.156236 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-c2c27d9f-908f-4d6b-8d63-ae7b1ca7892c tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Object Instance<e73ac672-0911-4e4d-8a85-9b635a9e836f> lazy-loaded attributes: flavor,pci_requests {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:54:35.156430 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-c2c27d9f-908f-4d6b-8d63-ae7b1ca7892c tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:54:35.156678 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-c2c27d9f-908f-4d6b-8d63-ae7b1ca7892c tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:54:35.156963 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-c2c27d9f-908f-4d6b-8d63-ae7b1ca7892c tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:54:35.407277 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:54:35.430018 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-c2c27d9f-908f-4d6b-8d63-ae7b1ca7892c tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8df1e628989946dbafa89116b196c65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ba6b7c1fd84a7c8ed4e9f086f83fa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:54:35.498184 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:54:35.500968 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:54:35.665828 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:54:35.665929 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:54:35.666163 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:54:35.666374 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:54:35.666606 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:54:35.666843 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:54:35.918838 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.879s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:35.919742 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:54:35.943781 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:36.003644 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:54:36.003973 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933276.0036898, df5768dc-874f-4725-b2a2-e007aebc11a9 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:54:36.005269 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] VM Paused (Lifecycle Event)
May 28 01:54:36.172454 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Took 13.87 seconds to spawn the instance on the hypervisor.
May 28 01:54:36.173141 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:54:36.385067 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-c2c27d9f-908f-4d6b-8d63-ae7b1ca7892c tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Successfully created port: 0af5589b-ed4a-40e6-b1f9-1e52f80285b9 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:54:36.427885 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:54:36.427885 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:54:36.428093 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:54:36.428327 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:54:36.436702 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ea494c90-bc1a-4f68-a37a-f2552aa7a5e9 req-b0f1008e-1429-4fd9-ae48-4da4d28ca963 service nova] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Received event network-changed-6ddf64a7-099d-4ef6-8dfc-7377446b66f7 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:54:36.436867 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ea494c90-bc1a-4f68-a37a-f2552aa7a5e9 req-b0f1008e-1429-4fd9-ae48-4da4d28ca963 service nova] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Refreshing instance network info cache due to event network-changed-6ddf64a7-099d-4ef6-8dfc-7377446b66f7. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:54:36.437006 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ea494c90-bc1a-4f68-a37a-f2552aa7a5e9 req-b0f1008e-1429-4fd9-ae48-4da4d28ca963 service nova] Acquiring lock "refresh_cache-587a002a-2b9c-4865-8ce2-088ad567c81b" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:54:36.438577 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ea494c90-bc1a-4f68-a37a-f2552aa7a5e9 req-b0f1008e-1429-4fd9-ae48-4da4d28ca963 service nova] Acquired lock "refresh_cache-587a002a-2b9c-4865-8ce2-088ad567c81b" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:54:36.438740 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-ea494c90-bc1a-4f68-a37a-f2552aa7a5e9 req-b0f1008e-1429-4fd9-ae48-4da4d28ca963 service nova] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Refreshing network info cache for port 6ddf64a7-099d-4ef6-8dfc-7377446b66f7 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:54:36.509578 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:54:36.511419 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933276.5110543, df5768dc-874f-4725-b2a2-e007aebc11a9 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:54:36.511563 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] VM Resumed (Lifecycle Event)
May 28 01:54:36.686419 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Took 21.23 seconds to build instance.
May 28 01:54:36.702858 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c3a7b14e31ee40cf9e4f4bba084ccaa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba381dad8364a488a98b80c04cce8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:54:36.932386 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:54:36.943916 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-ea494c90-bc1a-4f68-a37a-f2552aa7a5e9 req-b0f1008e-1429-4fd9-ae48-4da4d28ca963 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:54:37.014490 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:54:37.018766 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:54:37.128066 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-c2c27d9f-908f-4d6b-8d63-ae7b1ca7892c tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Successfully updated port: 0af5589b-ed4a-40e6-b1f9-1e52f80285b9 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:54:37.191105 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4bdaacb8-4607-4746-a105-2da16afcf853 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Lock "df5768dc-874f-4725-b2a2-e007aebc11a9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.742s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:37.251383 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-46c3951a-685c-4c10-97d5-906268510d6e req-9f3a20ba-0083-4285-866f-0ec9d746667c service nova] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Received event network-vif-plugged-d6c3c5f3-e20b-4b3e-abac-62f21007a7ad {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:54:37.251834 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-46c3951a-685c-4c10-97d5-906268510d6e req-9f3a20ba-0083-4285-866f-0ec9d746667c service nova] Acquiring lock "df5768dc-874f-4725-b2a2-e007aebc11a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:37.251997 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-46c3951a-685c-4c10-97d5-906268510d6e req-9f3a20ba-0083-4285-866f-0ec9d746667c service nova] Lock "df5768dc-874f-4725-b2a2-e007aebc11a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:37.252132 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-46c3951a-685c-4c10-97d5-906268510d6e req-9f3a20ba-0083-4285-866f-0ec9d746667c service nova] Lock "df5768dc-874f-4725-b2a2-e007aebc11a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:37.252286 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-46c3951a-685c-4c10-97d5-906268510d6e req-9f3a20ba-0083-4285-866f-0ec9d746667c service nova] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] No waiting events found dispatching network-vif-plugged-d6c3c5f3-e20b-4b3e-abac-62f21007a7ad {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:54:37.252518 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-46c3951a-685c-4c10-97d5-906268510d6e req-9f3a20ba-0083-4285-866f-0ec9d746667c service nova] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Received unexpected event network-vif-plugged-d6c3c5f3-e20b-4b3e-abac-62f21007a7ad for instance with vm_state active and task_state None.
May 28 01:54:37.270216 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Successfully created port: ba6c883b-68ef-4562-9163-932ef65f675c {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:54:37.319364 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:37.436287 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:54:37.632696 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c2c27d9f-908f-4d6b-8d63-ae7b1ca7892c tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Acquiring lock "refresh_cache-e73ac672-0911-4e4d-8a85-9b635a9e836f" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:54:37.632858 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c2c27d9f-908f-4d6b-8d63-ae7b1ca7892c tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Acquired lock "refresh_cache-e73ac672-0911-4e4d-8a85-9b635a9e836f" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:54:37.633026 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-c2c27d9f-908f-4d6b-8d63-ae7b1ca7892c tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:54:37.857265 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:37.868382 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Successfully updated port: ba6c883b-68ef-4562-9163-932ef65f675c {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:54:37.890362 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-ea494c90-bc1a-4f68-a37a-f2552aa7a5e9 req-b0f1008e-1429-4fd9-ae48-4da4d28ca963 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:54:38.066507 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-ea494c90-bc1a-4f68-a37a-f2552aa7a5e9 req-b0f1008e-1429-4fd9-ae48-4da4d28ca963 service nova] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Updated VIF entry in instance network info cache for port 6ddf64a7-099d-4ef6-8dfc-7377446b66f7. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:54:38.066507 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-ea494c90-bc1a-4f68-a37a-f2552aa7a5e9 req-b0f1008e-1429-4fd9-ae48-4da4d28ca963 service nova] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Updating instance_info_cache with network_info: [{"id": "6ddf64a7-099d-4ef6-8dfc-7377446b66f7", "address": "fa:16:3e:94:75:97", "network": {"id": "b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-280876007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60fbdf5ed38b4dc485a81c49b3303ed2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddf64a7-09", "ovs_interfaceid": "6ddf64a7-099d-4ef6-8dfc-7377446b66f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:54:38.357178 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Acquiring lock "f2805796-e531-4508-8585-0d110f4bd4e7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:38.357719 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Lock "f2805796-e531-4508-8585-0d110f4bd4e7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:38.357719 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Acquiring lock "f2805796-e531-4508-8585-0d110f4bd4e7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:38.357955 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Lock "f2805796-e531-4508-8585-0d110f4bd4e7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:38.358125 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Lock "f2805796-e531-4508-8585-0d110f4bd4e7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:38.360838 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Terminating instance
May 28 01:54:38.372357 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "refresh_cache-75c911c7-ae44-4902-989f-3f0655243f3f" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:54:38.373229 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquired lock "refresh_cache-75c911c7-ae44-4902-989f-3f0655243f3f" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:54:38.373706 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:54:38.402750 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-c2c27d9f-908f-4d6b-8d63-ae7b1ca7892c tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:54:38.453389 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:54:38.454489 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:54:38.455137 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Creating image(s)
May 28 01:54:38.455318 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "/opt/stack/data/nova/instances/75c911c7-ae44-4902-989f-3f0655243f3f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:38.457025 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "/opt/stack/data/nova/instances/75c911c7-ae44-4902-989f-3f0655243f3f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:38.457025 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "/opt/stack/data/nova/instances/75c911c7-ae44-4902-989f-3f0655243f3f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:38.458917 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:54:38.462905 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:54:38.465812 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:54:38.567294 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.101s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:54:38.567540 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:38.568938 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ea494c90-bc1a-4f68-a37a-f2552aa7a5e9 req-b0f1008e-1429-4fd9-ae48-4da4d28ca963 service nova] Releasing lock "refresh_cache-587a002a-2b9c-4865-8ce2-088ad567c81b" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:54:38.570699 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:38.570699 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:54:38.573201 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:54:38.573647 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:54:38.667773 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.094s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:54:38.668464 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/75c911c7-ae44-4902-989f-3f0655243f3f/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:54:38.728866 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/75c911c7-ae44-4902-989f-3f0655243f3f/disk 1073741824" returned: 0 in 0.060s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:54:38.729574 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.160s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:38.730068 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:54:38.807251 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.077s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:54:38.807676 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Checking if we can resize image /opt/stack/data/nova/instances/75c911c7-ae44-4902-989f-3f0655243f3f/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:54:38.807994 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c911c7-ae44-4902-989f-3f0655243f3f/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:54:38.855820 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-c2c27d9f-908f-4d6b-8d63-ae7b1ca7892c tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:54:38.861254 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0eda68a9-78b7-4f89-8877-4b32f8e2cb71 req-21f6446a-8d2d-4483-8afc-0cc159aabe98 service nova] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Received event network-changed-0af5589b-ed4a-40e6-b1f9-1e52f80285b9 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:54:38.861391 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0eda68a9-78b7-4f89-8877-4b32f8e2cb71 req-21f6446a-8d2d-4483-8afc-0cc159aabe98 service nova] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Refreshing instance network info cache due to event network-changed-0af5589b-ed4a-40e6-b1f9-1e52f80285b9. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:54:38.861597 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0eda68a9-78b7-4f89-8877-4b32f8e2cb71 req-21f6446a-8d2d-4483-8afc-0cc159aabe98 service nova] Acquiring lock "refresh_cache-e73ac672-0911-4e4d-8a85-9b635a9e836f" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:54:38.866500 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:54:38.890624 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:38.891477 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:38.918502 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:38.931625 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:38.934316 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c911c7-ae44-4902-989f-3f0655243f3f/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:54:38.935135 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Cannot resize image /opt/stack/data/nova/instances/75c911c7-ae44-4902-989f-3f0655243f3f/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:54:38.936619 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:54:38.936823 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Ensure instance console log exists: /opt/stack/data/nova/instances/75c911c7-ae44-4902-989f-3f0655243f3f/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:54:38.937064 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:38.937250 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:38.937371 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:38.959673 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:38.963906 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:54:39.089627 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-c2c27d9f-908f-4d6b-8d63-ae7b1ca7892c tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Updating instance_info_cache with network_info: [{"id": "ae1eb56b-d3c2-441b-9339-b2d96192924c", "address": "fa:16:3e:ca:36:a6", "network": {"id": "a6357868-368f-400d-b8c9-8e8843bdfdda", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1753538248-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "02ba6b7c1fd84a7c8ed4e9f086f83fa0", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae1eb56b-d3", "ovs_interfaceid": "ae1eb56b-d3c2-441b-9339-b2d96192924c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0af5589b-ed4a-40e6-b1f9-1e52f80285b9", "address": "fa:16:3e:07:0c:64", "network": {"id": "d6da1280-87e1-42bb-b434-c401417302e8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1261237232", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "02ba6b7c1fd84a7c8ed4e9f086f83fa0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0af5589b-ed", "ovs_interfaceid": "0af5589b-ed4a-40e6-b1f9-1e52f80285b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:54:39.171814 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:39.180160 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:39.195367 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:54:39.198738 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999568313000054 future=<Future at 0x7724f83b1bb0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:54:39.199268 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999052745999961 future=<Future at 0x7724f83b1bb0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:54:39.201420 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.99750552799992 future=<Future at 0x7724f83b1bb0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:54:39.205191 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Instance destroyed successfully.
May 28 01:54:39.205729 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Lazy-loading 'resources' on Instance uuid f2805796-e531-4508-8585-0d110f4bd4e7 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:54:39.385124 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Updating instance_info_cache with network_info: [{"id": "ba6c883b-68ef-4562-9163-932ef65f675c", "address": "fa:16:3e:27:be:54", "network": {"id": "2ee43c4e-569f-4726-9700-add40d768203", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ba381dad8364a488a98b80c04cce8fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba6c883b-68", "ovs_interfaceid": "ba6c883b-68ef-4562-9163-932ef65f675c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:54:39.479227 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Acquiring lock "96a4bb3b-0482-4b14-bb23-772d295b972e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:39.479500 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Lock "96a4bb3b-0482-4b14-bb23-772d295b972e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:39.592003 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c2c27d9f-908f-4d6b-8d63-ae7b1ca7892c tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Releasing lock "refresh_cache-e73ac672-0911-4e4d-8a85-9b635a9e836f" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:54:39.592966 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0eda68a9-78b7-4f89-8877-4b32f8e2cb71 req-21f6446a-8d2d-4483-8afc-0cc159aabe98 service nova] Acquired lock "refresh_cache-e73ac672-0911-4e4d-8a85-9b635a9e836f" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:54:39.593427 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-0eda68a9-78b7-4f89-8877-4b32f8e2cb71 req-21f6446a-8d2d-4483-8afc-0cc159aabe98 service nova] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Refreshing network info cache for port 0af5589b-ed4a-40e6-b1f9-1e52f80285b9 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:54:39.595730 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-c2c27d9f-908f-4d6b-8d63-ae7b1ca7892c tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:53:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2127810450',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-device-tagging-server-2127810450',id=11,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOgLraTEi6SiWvo5jslayVOBAKtkEEjh1jVuNw35Hn8cUQoGuB8wzuMiOMlFTlRtSvwVvTOnGa8VK88dE01Yrnrej50o+Hw4uQhAmKYoDt2ubT7eWDD6mkiN/JuIg389w==',key_name='tempest-keypair-1856182923',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:53:54Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='02ba6b7c1fd84a7c8ed4e9f086f83fa0',ramdisk_id='',reservation_id='r-htc032mq',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1060566416',owner_user_name='tempest-TaggedAttachmentsTest-1060566416-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:53:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8df1e628989946dbafa89116b196c65b',uuid=e73ac672-0911-4e4d-8a85-9b635a9e836f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0af5589b-ed4a-40e6-b1f9-1e52f80285b9", "address": "fa:16:3e:07:0c:64", "network": {"id": "d6da1280-87e1-42bb-b434-c401417302e8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1261237232", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "02ba6b7c1fd84a7c8ed4e9f086f83fa0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0af5589b-ed", "ovs_interfaceid": "0af5589b-ed4a-40e6-b1f9-1e52f80285b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:54:39.595992 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-c2c27d9f-908f-4d6b-8d63-ae7b1ca7892c tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Converting VIF {"id": "0af5589b-ed4a-40e6-b1f9-1e52f80285b9", "address": "fa:16:3e:07:0c:64", "network": {"id": "d6da1280-87e1-42bb-b434-c401417302e8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1261237232", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "02ba6b7c1fd84a7c8ed4e9f086f83fa0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0af5589b-ed", "ovs_interfaceid": "0af5589b-ed4a-40e6-b1f9-1e52f80285b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:54:39.598719 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-c2c27d9f-908f-4d6b-8d63-ae7b1ca7892c tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:0c:64,bridge_name='br-int',has_traffic_filtering=True,id=0af5589b-ed4a-40e6-b1f9-1e52f80285b9,network=Network(d6da1280-87e1-42bb-b434-c401417302e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0af5589b-ed') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:54:39.599011 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-c2c27d9f-908f-4d6b-8d63-ae7b1ca7892c tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:0c:64,bridge_name='br-int',has_traffic_filtering=True,id=0af5589b-ed4a-40e6-b1f9-1e52f80285b9,network=Network(d6da1280-87e1-42bb-b434-c401417302e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0af5589b-ed') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:54:39.599987 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:39.600953 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:54:39.600953 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:54:39.603313 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-507443fa-3076-43d1-81e3-5889dfa422d1 req-57289181-7566-4dc6-8413-3172dfca02df service nova] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Received event network-changed-d6c3c5f3-e20b-4b3e-abac-62f21007a7ad {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:54:39.603475 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-507443fa-3076-43d1-81e3-5889dfa422d1 req-57289181-7566-4dc6-8413-3172dfca02df service nova] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Refreshing instance network info cache due to event network-changed-d6c3c5f3-e20b-4b3e-abac-62f21007a7ad. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:54:39.603671 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-507443fa-3076-43d1-81e3-5889dfa422d1 req-57289181-7566-4dc6-8413-3172dfca02df service nova] Acquiring lock "refresh_cache-df5768dc-874f-4725-b2a2-e007aebc11a9" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:54:39.603811 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-507443fa-3076-43d1-81e3-5889dfa422d1 req-57289181-7566-4dc6-8413-3172dfca02df service nova] Acquired lock "refresh_cache-df5768dc-874f-4725-b2a2-e007aebc11a9" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:54:39.603960 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-507443fa-3076-43d1-81e3-5889dfa422d1 req-57289181-7566-4dc6-8413-3172dfca02df service nova] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Refreshing network info cache for port d6c3c5f3-e20b-4b3e-abac-62f21007a7ad {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:54:39.607345 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:39.607930 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '301b901a-c0a6-5ea9-b205-7691c4df5c3c', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:54:39.609381 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:39.610106 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:54:39.614939 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:39.618920 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:39.619089 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0af5589b-ed, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:54:39.619380 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0af5589b-ed, col_values=(('qos', UUID('999112f6-a2e9-4923-9753-2911df090832')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:54:39.619540 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0af5589b-ed, col_values=(('external_ids', {'iface-id': '0af5589b-ed4a-40e6-b1f9-1e52f80285b9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:0c:64', 'vm-uuid': 'e73ac672-0911-4e4d-8a85-9b635a9e836f'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:54:39.622007 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:54:39.632101 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:39.632950 np0000001583 nova-compute[98241]: INFO os_vif [None req-c2c27d9f-908f-4d6b-8d63-ae7b1ca7892c tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:0c:64,bridge_name='br-int',has_traffic_filtering=True,id=0af5589b-ed4a-40e6-b1f9-1e52f80285b9,network=Network(d6da1280-87e1-42bb-b434-c401417302e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0af5589b-ed')
May 28 01:54:39.633683 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-c2c27d9f-908f-4d6b-8d63-ae7b1ca7892c tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:53:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2127810450',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-device-tagging-server-2127810450',id=11,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOgLraTEi6SiWvo5jslayVOBAKtkEEjh1jVuNw35Hn8cUQoGuB8wzuMiOMlFTlRtSvwVvTOnGa8VK88dE01Yrnrej50o+Hw4uQhAmKYoDt2ubT7eWDD6mkiN/JuIg389w==',key_name='tempest-keypair-1856182923',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:53:54Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='02ba6b7c1fd84a7c8ed4e9f086f83fa0',ramdisk_id='',reservation_id='r-htc032mq',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1060566416',owner_user_name='tempest-TaggedAttachmentsTest-1060566416-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:53:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8df1e628989946dbafa89116b196c65b',uuid=e73ac672-0911-4e4d-8a85-9b635a9e836f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0af5589b-ed4a-40e6-b1f9-1e52f80285b9", "address": "fa:16:3e:07:0c:64", "network": {"id": "d6da1280-87e1-42bb-b434-c401417302e8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1261237232", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "02ba6b7c1fd84a7c8ed4e9f086f83fa0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0af5589b-ed", "ovs_interfaceid": "0af5589b-ed4a-40e6-b1f9-1e52f80285b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:54:39.633863 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-c2c27d9f-908f-4d6b-8d63-ae7b1ca7892c tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Converting VIF {"id": "0af5589b-ed4a-40e6-b1f9-1e52f80285b9", "address": "fa:16:3e:07:0c:64", "network": {"id": "d6da1280-87e1-42bb-b434-c401417302e8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1261237232", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "02ba6b7c1fd84a7c8ed4e9f086f83fa0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0af5589b-ed", "ovs_interfaceid": "0af5589b-ed4a-40e6-b1f9-1e52f80285b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:54:39.634301 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-c2c27d9f-908f-4d6b-8d63-ae7b1ca7892c tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:0c:64,bridge_name='br-int',has_traffic_filtering=True,id=0af5589b-ed4a-40e6-b1f9-1e52f80285b9,network=Network(d6da1280-87e1-42bb-b434-c401417302e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0af5589b-ed') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:54:39.636217 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-c2c27d9f-908f-4d6b-8d63-ae7b1ca7892c tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] attach device xml: <interface type="ethernet">
May 28 01:54:39.636217 np0000001583 nova-compute[98241]:   <mac address="fa:16:3e:07:0c:64"/>
May 28 01:54:39.636217 np0000001583 nova-compute[98241]:   <model type="virtio"/>
May 28 01:54:39.636217 np0000001583 nova-compute[98241]:   <driver name="qemu"/>
May 28 01:54:39.636217 np0000001583 nova-compute[98241]:   <mtu size="1372"/>
May 28 01:54:39.636217 np0000001583 nova-compute[98241]:   <target dev="tap0af5589b-ed"/>
May 28 01:54:39.636217 np0000001583 nova-compute[98241]: </interface>
May 28 01:54:39.636217 np0000001583 nova-compute[98241]:  {{(pid=98241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 01:54:39.654059 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:39.707905 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T01:52:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1075767386',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-serveractionsv293testjson-server-2040873444',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNU/wFJvIXv98vi6aYo5JdgOO26yK3H8M5Fwr9L6B9TgZZAeaxeYClgf/riTA9gRggFDSHAHQ2WWHr+BBFeB2YnkUvKZLTUbGagtUk9wt6ZgeubZXG0bqVpSP2PvleXU0w==',key_name='tempest-keypair-1710605134',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:53:59Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='23e37a40d1db45cba9235de04219a3b4',ramdisk_id='',reservation_id='r-0idxh519',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='160eac6b-3e35-4339-bdf4-c5b84e5687ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-716114863',owner_user_name='tempest-ServerActionsV293TestJSON-716114863-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:54:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bff6dc118f2e4efc8d499d4614565377',uuid=f2805796-e531-4508-8585-0d110f4bd4e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6835d977-7c34-4bd7-8d12-208432ea45d3", "address": "fa:16:3e:91:a6:69", "network": {"id": "2043727d-617f-4eff-98e6-5d58f439532d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1616658634-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e37a40d1db45cba9235de04219a3b4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6835d977-7c", "ovs_interfaceid": "6835d977-7c34-4bd7-8d12-208432ea45d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:54:39.708138 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Converting VIF {"id": "6835d977-7c34-4bd7-8d12-208432ea45d3", "address": "fa:16:3e:91:a6:69", "network": {"id": "2043727d-617f-4eff-98e6-5d58f439532d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1616658634-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e37a40d1db45cba9235de04219a3b4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6835d977-7c", "ovs_interfaceid": "6835d977-7c34-4bd7-8d12-208432ea45d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:54:39.708735 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:a6:69,bridge_name='br-int',has_traffic_filtering=True,id=6835d977-7c34-4bd7-8d12-208432ea45d3,network=Network(2043727d-617f-4eff-98e6-5d58f439532d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6835d977-7c') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:54:39.708994 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:a6:69,bridge_name='br-int',has_traffic_filtering=True,id=6835d977-7c34-4bd7-8d12-208432ea45d3,network=Network(2043727d-617f-4eff-98e6-5d58f439532d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6835d977-7c') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:54:39.710209 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:39.710405 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6835d977-7c, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:54:39.712157 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:39.713166 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:54:39.719832 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:39.720897 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:39.721467 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b4cd9a3e-c2e1-4964-b9d1-413cc2e0a383) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:54:39.722001 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:39.722893 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:54:39.725669 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:39.732643 np0000001583 nova-compute[98241]: INFO os_vif [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:a6:69,bridge_name='br-int',has_traffic_filtering=True,id=6835d977-7c34-4bd7-8d12-208432ea45d3,network=Network(2043727d-617f-4eff-98e6-5d58f439532d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6835d977-7c')
May 28 01:54:39.734794 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:54:39.737141 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9', 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ac79736b-8037-45cb-a9eb-510556b680f9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:54:39.737141 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:54:39.737141 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:54:39.737141 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9', 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ac79736b-8037-45cb-a9eb-510556b680f9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:54:39.737141 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:54:39.767792 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:54:39.767792 np0000001583 nova-compute[98241]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:54:39.767792 np0000001583 nova-compute[98241]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42 (non-flash)
May 28 01:54:39.767792 np0000001583 nova-compute[98241]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42 (non-flash)
May 28 01:54:39.767792 np0000001583 nova-compute[98241]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:54:39.767792 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:54:39.767792 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:54:39.769441 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsi session list stdout=tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:54:39.769441 np0000001583 nova-compute[98241]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9 (non-flash)
May 28 01:54:39.769441 np0000001583 nova-compute[98241]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42 (non-flash)
May 28 01:54:39.769441 np0000001583 nova-compute[98241]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42 (non-flash)
May 28 01:54:39.769441 np0000001583 nova-compute[98241]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:54:39.769441 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:54:39.769441 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:54:39.769441 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9', '24'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9', '25'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42', '28'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d', '31')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:54:39.769441 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9', '24')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:54:39.770059 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9', '25')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:54:39.771704 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f8461800>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9'): ({'sdc'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:54:39.772003 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Removing multipathed devices sdc, sdb {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:54:39.772964 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Flush multipath device 330000000dd10e4b9 {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:54:39.796845 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:39.832395 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:54:39.874210 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:54:39.887278 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Releasing lock "refresh_cache-75c911c7-ae44-4902-989f-3f0655243f3f" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:54:39.887636 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Instance network_info: |[{"id": "ba6c883b-68ef-4562-9163-932ef65f675c", "address": "fa:16:3e:27:be:54", "network": {"id": "2ee43c4e-569f-4726-9700-add40d768203", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ba381dad8364a488a98b80c04cce8fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba6c883b-68", "ovs_interfaceid": "ba6c883b-68ef-4562-9163-932ef65f675c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:54:39.889746 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Start _get_guest_xml network_info=[{"id": "ba6c883b-68ef-4562-9163-932ef65f675c", "address": "fa:16:3e:27:be:54", "network": {"id": "2ee43c4e-569f-4726-9700-add40d768203", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ba381dad8364a488a98b80c04cce8fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba6c883b-68", "ovs_interfaceid": "ba6c883b-68ef-4562-9163-932ef65f675c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:54:39.893402 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:54:39.894424 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-447134881', uuid='75c911c7-ae44-4902-989f-3f0655243f3f'), owner=OwnerMeta(userid='c3a7b14e31ee40cf9e4f4bba084ccaa5', username='tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member', projectid='2ba381dad8364a488a98b80c04cce8fb', projectname='tempest-ServerBootFromVolumeStableRescueTest-1211567633'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ba6c883b-68ef-4562-9163-932ef65f675c", "address": "fa:16:3e:27:be:54", "network": {"id": "2ee43c4e-569f-4726-9700-add40d768203", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ba381dad8364a488a98b80c04cce8fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba6c883b-68", "ovs_interfaceid": "ba6c883b-68ef-4562-9163-932ef65f675c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933279.893981) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:54:39.896190 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:54:39.896553 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:54:39.898682 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:54:39.898682 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:54:39.898682 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:54:39.899034 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:54:39.899256 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:54:39.899384 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:54:39.899578 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:54:39.899708 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:54:39.899853 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:54:39.900111 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:54:39.900452 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:54:39.900630 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:54:39.900773 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:54:39.900932 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:54:39.916197 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:54:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-447134881',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-serverbootfromvolumestablerescuetest-server-447134881',id=14,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ba381dad8364a488a98b80c04cce8fb',ramdisk_id='',reservation_id='r-15vrmhqd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1211567633',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:54:37Z,user_data=None,user_id='c3a7b14e31ee40cf9e4f4bba084ccaa5',uuid=75c911c7-ae44-4902-989f-3f0655243f3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba6c883b-68ef-4562-9163-932ef65f675c", "address": "fa:16:3e:27:be:54", "network": {"id": "2ee43c4e-569f-4726-9700-add40d768203", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ba381dad8364a488a98b80c04cce8fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba6c883b-68", "ovs_interfaceid": "ba6c883b-68ef-4562-9163-932ef65f675c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:54:39.916376 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Converting VIF {"id": "ba6c883b-68ef-4562-9163-932ef65f675c", "address": "fa:16:3e:27:be:54", "network": {"id": "2ee43c4e-569f-4726-9700-add40d768203", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ba381dad8364a488a98b80c04cce8fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba6c883b-68", "ovs_interfaceid": "ba6c883b-68ef-4562-9163-932ef65f675c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:54:39.916817 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:be:54,bridge_name='br-int',has_traffic_filtering=True,id=ba6c883b-68ef-4562-9163-932ef65f675c,network=Network(2ee43c4e-569f-4726-9700-add40d768203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba6c883b-68') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:54:39.917371 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lazy-loading 'pci_devices' on Instance uuid 75c911c7-ae44-4902-989f-3f0655243f3f {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:54:39.926028 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:54:39.926299 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:54:39.927865 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:54:39.943593 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:54:39.943886 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:54:39.958647 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:54:39.983145 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:54:39.992121 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9, portal: 192.168.40.100,3260]
May 28 01:54:39.992121 np0000001583 nova-compute[98241]: Logout of [sid: 24, target: iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9, portal: 192.168.40.100,3260] successful.
May 28 01:54:39.992121 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:54:40.011109 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:54:40.023673 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:54:40.039741 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:40.051456 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9, portal: 192.168.50.100,3260]
May 28 01:54:40.051456 np0000001583 nova-compute[98241]: Logout of [sid: 25, target: iqn.2023-03.storpool.com:os--volume-ac79736b-8037-45cb-a9eb-510556b680f9, portal: 192.168.50.100,3260] successful.
May 28 01:54:40.051456 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:54:40.051865 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:40.053040 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:40.067588 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:54:40.067886 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:54:40.068021 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] <== disconnect_volume: return (332ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:54:40.068195 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:54:40.068517 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Deleting instance files /opt/stack/data/nova/instances/f2805796-e531-4508-8585-0d110f4bd4e7_del
May 28 01:54:40.069167 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Deletion of /opt/stack/data/nova/instances/f2805796-e531-4508-8585-0d110f4bd4e7_del complete
May 28 01:54:40.072734 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:40.104173 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-0eda68a9-78b7-4f89-8877-4b32f8e2cb71 req-21f6446a-8d2d-4483-8afc-0cc159aabe98 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:54:40.109469 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-507443fa-3076-43d1-81e3-5889dfa422d1 req-57289181-7566-4dc6-8413-3172dfca02df service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:54:40.422631 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] End _get_guest_xml xml=<domain type="qemu">
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:   <uuid>75c911c7-ae44-4902-989f-3f0655243f3f</uuid>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:   <name>instance-0000000e</name>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-447134881</nova:name>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:54:39</nova:creationTime>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:         <nova:user uuid="c3a7b14e31ee40cf9e4f4bba084ccaa5">tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member</nova:user>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:         <nova:project uuid="2ba381dad8364a488a98b80c04cce8fb">tempest-ServerBootFromVolumeStableRescueTest-1211567633</nova:project>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:         <nova:port uuid="ba6c883b-68ef-4562-9163-932ef65f675c">
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:     <system>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:       <entry name="serial">75c911c7-ae44-4902-989f-3f0655243f3f</entry>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:       <entry name="uuid">75c911c7-ae44-4902-989f-3f0655243f3f</entry>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:     </system>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:   <os>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:   </os>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:   <features>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:   </features>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:   <devices>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/75c911c7-ae44-4902-989f-3f0655243f3f/disk"/>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:     </disk>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/75c911c7-ae44-4902-989f-3f0655243f3f/disk.config"/>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:     </disk>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:27:be:54"/>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:       <target dev="tapba6c883b-68"/>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:     </interface>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/75c911c7-ae44-4902-989f-3f0655243f3f/console.log" append="off"/>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:     </serial>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:     <video>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:     </video>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:     </rng>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:   </devices>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]: </domain>
May 28 01:54:40.422631 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:54:40.430344 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Preparing to wait for external event network-vif-plugged-ba6c883b-68ef-4562-9163-932ef65f675c {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:54:40.430344 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "75c911c7-ae44-4902-989f-3f0655243f3f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:40.430344 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "75c911c7-ae44-4902-989f-3f0655243f3f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:40.430344 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "75c911c7-ae44-4902-989f-3f0655243f3f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:40.430344 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:54:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-447134881',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-serverbootfromvolumestablerescuetest-server-447134881',id=14,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ba381dad8364a488a98b80c04cce8fb',ramdisk_id='',reservation_id='r-15vrmhqd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1211567633',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:54:37Z,user_data=None,user_id='c3a7b14e31ee40cf9e4f4bba084ccaa5',uuid=75c911c7-ae44-4902-989f-3f0655243f3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba6c883b-68ef-4562-9163-932ef65f675c", "address": "fa:16:3e:27:be:54", "network": {"id": "2ee43c4e-569f-4726-9700-add40d768203", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ba381dad8364a488a98b80c04cce8fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba6c883b-68", "ovs_interfaceid": "ba6c883b-68ef-4562-9163-932ef65f675c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:54:40.430344 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Converting VIF {"id": "ba6c883b-68ef-4562-9163-932ef65f675c", "address": "fa:16:3e:27:be:54", "network": {"id": "2ee43c4e-569f-4726-9700-add40d768203", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ba381dad8364a488a98b80c04cce8fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba6c883b-68", "ovs_interfaceid": "ba6c883b-68ef-4562-9163-932ef65f675c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:54:40.430344 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:be:54,bridge_name='br-int',has_traffic_filtering=True,id=ba6c883b-68ef-4562-9163-932ef65f675c,network=Network(2ee43c4e-569f-4726-9700-add40d768203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba6c883b-68') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:54:40.430344 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:be:54,bridge_name='br-int',has_traffic_filtering=True,id=ba6c883b-68ef-4562-9163-932ef65f675c,network=Network(2ee43c4e-569f-4726-9700-add40d768203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba6c883b-68') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:54:40.430344 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:40.430344 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:54:40.430344 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:54:40.431668 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:40.431668 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5c684c8c-6a21-53db-84ca-9fb110dc035f', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:54:40.432378 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:40.432959 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:54:40.435118 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:40.438137 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:40.438348 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba6c883b-68, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:54:40.438654 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapba6c883b-68, col_values=(('qos', UUID('3b591eb5-b029-4de8-9a67-070c552d86d4')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:54:40.438788 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapba6c883b-68, col_values=(('external_ids', {'iface-id': 'ba6c883b-68ef-4562-9163-932ef65f675c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:be:54', 'vm-uuid': '75c911c7-ae44-4902-989f-3f0655243f3f'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:54:40.439643 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:40.440769 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:54:40.447865 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:40.449164 np0000001583 nova-compute[98241]: INFO os_vif [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:be:54,bridge_name='br-int',has_traffic_filtering=True,id=ba6c883b-68ef-4562-9163-932ef65f675c,network=Network(2ee43c4e-569f-4726-9700-add40d768203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba6c883b-68')
May 28 01:54:40.481596 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-0eda68a9-78b7-4f89-8877-4b32f8e2cb71 req-21f6446a-8d2d-4483-8afc-0cc159aabe98 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:54:40.566543 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-507443fa-3076-43d1-81e3-5889dfa422d1 req-57289181-7566-4dc6-8413-3172dfca02df service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:54:40.572240 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:40.572240 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:40.577099 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:54:40.577099 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Claim successful on node np0000001583
May 28 01:54:40.583251 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Took 1.72 seconds to destroy the instance on the hypervisor.
May 28 01:54:40.584447 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:54:40.585489 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:54:40.585701 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:54:40.586033 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:54:40.690257 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-0eda68a9-78b7-4f89-8877-4b32f8e2cb71 req-21f6446a-8d2d-4483-8afc-0cc159aabe98 service nova] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Updated VIF entry in instance network info cache for port 0af5589b-ed4a-40e6-b1f9-1e52f80285b9. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:54:40.690632 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-0eda68a9-78b7-4f89-8877-4b32f8e2cb71 req-21f6446a-8d2d-4483-8afc-0cc159aabe98 service nova] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Updating instance_info_cache with network_info: [{"id": "ae1eb56b-d3c2-441b-9339-b2d96192924c", "address": "fa:16:3e:ca:36:a6", "network": {"id": "a6357868-368f-400d-b8c9-8e8843bdfdda", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1753538248-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "02ba6b7c1fd84a7c8ed4e9f086f83fa0", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae1eb56b-d3", "ovs_interfaceid": "ae1eb56b-d3c2-441b-9339-b2d96192924c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0af5589b-ed4a-40e6-b1f9-1e52f80285b9", "address": "fa:16:3e:07:0c:64", "network": {"id": "d6da1280-87e1-42bb-b434-c401417302e8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1261237232", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "02ba6b7c1fd84a7c8ed4e9f086f83fa0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0af5589b-ed", "ovs_interfaceid": "0af5589b-ed4a-40e6-b1f9-1e52f80285b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:54:40.699232 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:54:40.735012 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-507443fa-3076-43d1-81e3-5889dfa422d1 req-57289181-7566-4dc6-8413-3172dfca02df service nova] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Updated VIF entry in instance network info cache for port d6c3c5f3-e20b-4b3e-abac-62f21007a7ad. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:54:40.735329 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-507443fa-3076-43d1-81e3-5889dfa422d1 req-57289181-7566-4dc6-8413-3172dfca02df service nova] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Updating instance_info_cache with network_info: [{"id": "d6c3c5f3-e20b-4b3e-abac-62f21007a7ad", "address": "fa:16:3e:28:95:8e", "network": {"id": "5e77962e-bcd9-4ce2-89c8-2a3c2cbd75a0", "bridge": "br-int", "label": "tempest-TestShelveInstance-351174513-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fa147b7a97664129bc2922ee1e8debc6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c3c5f3-e2", "ovs_interfaceid": "d6c3c5f3-e20b-4b3e-abac-62f21007a7ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:54:41.192807 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0eda68a9-78b7-4f89-8877-4b32f8e2cb71 req-21f6446a-8d2d-4483-8afc-0cc159aabe98 service nova] Releasing lock "refresh_cache-e73ac672-0911-4e4d-8a85-9b635a9e836f" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:54:41.192807 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0eda68a9-78b7-4f89-8877-4b32f8e2cb71 req-21f6446a-8d2d-4483-8afc-0cc159aabe98 service nova] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Received event network-changed-ba6c883b-68ef-4562-9163-932ef65f675c {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:54:41.192973 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0eda68a9-78b7-4f89-8877-4b32f8e2cb71 req-21f6446a-8d2d-4483-8afc-0cc159aabe98 service nova] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Refreshing instance network info cache due to event network-changed-ba6c883b-68ef-4562-9163-932ef65f675c. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:54:41.193268 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0eda68a9-78b7-4f89-8877-4b32f8e2cb71 req-21f6446a-8d2d-4483-8afc-0cc159aabe98 service nova] Acquiring lock "refresh_cache-75c911c7-ae44-4902-989f-3f0655243f3f" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:54:41.193387 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0eda68a9-78b7-4f89-8877-4b32f8e2cb71 req-21f6446a-8d2d-4483-8afc-0cc159aabe98 service nova] Acquired lock "refresh_cache-75c911c7-ae44-4902-989f-3f0655243f3f" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:54:41.193521 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-0eda68a9-78b7-4f89-8877-4b32f8e2cb71 req-21f6446a-8d2d-4483-8afc-0cc159aabe98 service nova] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Refreshing network info cache for port ba6c883b-68ef-4562-9163-932ef65f675c {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:54:41.237410 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-507443fa-3076-43d1-81e3-5889dfa422d1 req-57289181-7566-4dc6-8413-3172dfca02df service nova] Releasing lock "refresh_cache-df5768dc-874f-4725-b2a2-e007aebc11a9" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:54:41.329527 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-c2c27d9f-908f-4d6b-8d63-ae7b1ca7892c tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:54:41.329719 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-c2c27d9f-908f-4d6b-8d63-ae7b1ca7892c tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:54:41.329846 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-c2c27d9f-908f-4d6b-8d63-ae7b1ca7892c tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] No VIF found with MAC fa:16:3e:ca:36:a6, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:54:41.629663 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:54:41.666716 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0cdf06f4-f91f-468b-84c2-1ced820be42f req-b5e8475b-d8a9-46c7-bb58-de5a8dc664bb service nova] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Received event network-vif-deleted-6835d977-7c34-4bd7-8d12-208432ea45d3 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:54:41.696111 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-0eda68a9-78b7-4f89-8877-4b32f8e2cb71 req-21f6446a-8d2d-4483-8afc-0cc159aabe98 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:54:41.835170 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-c2c27d9f-908f-4d6b-8d63-ae7b1ca7892c tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-2127810450', uuid='e73ac672-0911-4e4d-8a85-9b635a9e836f'), owner=OwnerMeta(userid='8df1e628989946dbafa89116b196c65b', username='tempest-TaggedAttachmentsTest-1060566416-project-member', projectid='02ba6b7c1fd84a7c8ed4e9f086f83fa0', projectname='tempest-TaggedAttachmentsTest-1060566416'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ae1eb56b-d3c2-441b-9339-b2d96192924c", "address": "fa:16:3e:ca:36:a6", "network": {"id": "a6357868-368f-400d-b8c9-8e8843bdfdda", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1753538248-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "02ba6b7c1fd84a7c8ed4e9f086f83fa0", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae1eb56b-d3", "ovs_interfaceid": "ae1eb56b-d3c2-441b-9339-b2d96192924c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0af5589b-ed4a-40e6-b1f9-1e52f80285b9", "address": "fa:16:3e:07:0c:64", "network": {"id": "d6da1280-87e1-42bb-b434-c401417302e8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1261237232", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "02ba6b7c1fd84a7c8ed4e9f086f83fa0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0af5589b-ed", "ovs_interfaceid": "0af5589b-ed4a-40e6-b1f9-1e52f80285b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933281.8347986) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:54:41.835884 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-c2c27d9f-908f-4d6b-8d63-ae7b1ca7892c tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:54:41.835884 np0000001583 nova-compute[98241]:   <nova:package version="33.1.0"/>
May 28 01:54:41.835884 np0000001583 nova-compute[98241]:   <nova:name>tempest-device-tagging-server-2127810450</nova:name>
May 28 01:54:41.835884 np0000001583 nova-compute[98241]:   <nova:creationTime>2026-05-28 01:54:41</nova:creationTime>
May 28 01:54:41.835884 np0000001583 nova-compute[98241]:   <nova:flavor name="m1.nano" id="42">
May 28 01:54:41.835884 np0000001583 nova-compute[98241]:     <nova:memory>192</nova:memory>
May 28 01:54:41.835884 np0000001583 nova-compute[98241]:     <nova:disk>1</nova:disk>
May 28 01:54:41.835884 np0000001583 nova-compute[98241]:     <nova:swap>0</nova:swap>
May 28 01:54:41.835884 np0000001583 nova-compute[98241]:     <nova:ephemeral>0</nova:ephemeral>
May 28 01:54:41.835884 np0000001583 nova-compute[98241]:     <nova:vcpus>1</nova:vcpus>
May 28 01:54:41.835884 np0000001583 nova-compute[98241]:     <nova:extraSpecs>
May 28 01:54:41.835884 np0000001583 nova-compute[98241]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:54:41.835884 np0000001583 nova-compute[98241]:     </nova:extraSpecs>
May 28 01:54:41.835884 np0000001583 nova-compute[98241]:   </nova:flavor>
May 28 01:54:41.835884 np0000001583 nova-compute[98241]:   <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 01:54:41.835884 np0000001583 nova-compute[98241]:     <nova:containerFormat>bare</nova:containerFormat>
May 28 01:54:41.835884 np0000001583 nova-compute[98241]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:54:41.835884 np0000001583 nova-compute[98241]:     <nova:minDisk>1</nova:minDisk>
May 28 01:54:41.835884 np0000001583 nova-compute[98241]:     <nova:minRam>0</nova:minRam>
May 28 01:54:41.835884 np0000001583 nova-compute[98241]:     <nova:properties>
May 28 01:54:41.835884 np0000001583 nova-compute[98241]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 01:54:41.835884 np0000001583 nova-compute[98241]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 01:54:41.835884 np0000001583 nova-compute[98241]:       <nova:property name="hw_machine_type">pc</nova:property>
May 28 01:54:41.835884 np0000001583 nova-compute[98241]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:54:41.835884 np0000001583 nova-compute[98241]:       <nova:property name="hw_video_model">virtio</nova:property>
May 28 01:54:41.835884 np0000001583 nova-compute[98241]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 28 01:54:41.835884 np0000001583 nova-compute[98241]:     </nova:properties>
May 28 01:54:41.835884 np0000001583 nova-compute[98241]:   </nova:image>
May 28 01:54:41.835884 np0000001583 nova-compute[98241]:   <nova:owner>
May 28 01:54:41.835884 np0000001583 nova-compute[98241]:     <nova:user uuid="8df1e628989946dbafa89116b196c65b">tempest-TaggedAttachmentsTest-1060566416-project-member</nova:user>
May 28 01:54:41.835884 np0000001583 nova-compute[98241]:     <nova:project uuid="02ba6b7c1fd84a7c8ed4e9f086f83fa0">tempest-TaggedAttachmentsTest-1060566416</nova:project>
May 28 01:54:41.835884 np0000001583 nova-compute[98241]:   </nova:owner>
May 28 01:54:41.835884 np0000001583 nova-compute[98241]:   <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 01:54:41.835884 np0000001583 nova-compute[98241]:   <nova:ports>
May 28 01:54:41.835884 np0000001583 nova-compute[98241]:     <nova:port uuid="ae1eb56b-d3c2-441b-9339-b2d96192924c">
May 28 01:54:41.835884 np0000001583 nova-compute[98241]:       <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 28 01:54:41.835884 np0000001583 nova-compute[98241]:     </nova:port>
May 28 01:54:41.835884 np0000001583 nova-compute[98241]:     <nova:port uuid="0af5589b-ed4a-40e6-b1f9-1e52f80285b9">
May 28 01:54:41.835884 np0000001583 nova-compute[98241]:       <nova:ip type="fixed" address="10.10.10.226" ipVersion="4"/>
May 28 01:54:41.835884 np0000001583 nova-compute[98241]:     </nova:port>
May 28 01:54:41.835884 np0000001583 nova-compute[98241]:   </nova:ports>
May 28 01:54:41.835884 np0000001583 nova-compute[98241]: </nova:instance>
May 28 01:54:41.835884 np0000001583 nova-compute[98241]:  {{(pid=98241) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}}
May 28 01:54:41.968952 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:54:41.969162 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:54:41.969256 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] No VIF found with MAC fa:16:3e:27:be:54, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:54:41.969767 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Using config drive
May 28 01:54:42.056129 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-0eda68a9-78b7-4f89-8877-4b32f8e2cb71 req-21f6446a-8d2d-4483-8afc-0cc159aabe98 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:54:42.097971 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:54:42.098290 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:54:42.133702 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Took 1.55 seconds to deallocate network for instance.
May 28 01:54:42.194384 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-0eda68a9-78b7-4f89-8877-4b32f8e2cb71 req-21f6446a-8d2d-4483-8afc-0cc159aabe98 service nova] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Updated VIF entry in instance network info cache for port ba6c883b-68ef-4562-9163-932ef65f675c. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:54:42.194739 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-0eda68a9-78b7-4f89-8877-4b32f8e2cb71 req-21f6446a-8d2d-4483-8afc-0cc159aabe98 service nova] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Updating instance_info_cache with network_info: [{"id": "ba6c883b-68ef-4562-9163-932ef65f675c", "address": "fa:16:3e:27:be:54", "network": {"id": "2ee43c4e-569f-4726-9700-add40d768203", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ba381dad8364a488a98b80c04cce8fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba6c883b-68", "ovs_interfaceid": "ba6c883b-68ef-4562-9163-932ef65f675c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:54:42.344491 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c2c27d9f-908f-4d6b-8d63-ae7b1ca7892c tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Lock "interface-e73ac672-0911-4e4d-8a85-9b635a9e836f-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 8.560s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:42.468707 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Acquiring lock "0cca8054-2a26-436f-93b8-ef28e452bd65" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:42.468707 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:42.477123 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:54:42.603594 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:54:42.671151 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Creating config drive at /opt/stack/data/nova/instances/75c911c7-ae44-4902-989f-3f0655243f3f/disk.config
May 28 01:54:42.680165 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/75c911c7-ae44-4902-989f-3f0655243f3f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp36hegrob {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:54:42.705650 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0eda68a9-78b7-4f89-8877-4b32f8e2cb71 req-21f6446a-8d2d-4483-8afc-0cc159aabe98 service nova] Releasing lock "refresh_cache-75c911c7-ae44-4902-989f-3f0655243f3f" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:54:42.708369 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Took 0.57 seconds to detach 1 volumes for instance.
May 28 01:54:42.712544 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Deleting volume: ac79736b-8037-45cb-a9eb-510556b680f9 {{(pid=98241) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 28 01:54:42.749062 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/75c911c7-ae44-4902-989f-3f0655243f3f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp36hegrob" returned: 0 in 0.069s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:54:42.859240 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:42.970877 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:54:43.111488 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.539s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:43.111488 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:54:43.232745 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:43.259018 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:43.265143 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:43.268363 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:43.268650 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:43.366383 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:43.558219 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:43.619098 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:54:43.620237 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:54:43.620530 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:54:43.621315 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:54:43.628478 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:43.635415 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:43.639801 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Acquiring lock "e73ac672-0911-4e4d-8a85-9b635a9e836f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:43.639996 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Lock "e73ac672-0911-4e4d-8a85-9b635a9e836f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:43.660653 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:43.729763 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c9dd13ea0f744864b4c48f99b39b6436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c32da4f768f48179b4be0509a25a704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:54:43.782038 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b2b0e379-2a0c-4713-9c74-d88d0621018e req-725ecbd0-c69d-4d3b-a7b0-da9f864be8d3 service nova] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Received event network-vif-unplugged-ba6c883b-68ef-4562-9163-932ef65f675c {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:54:43.782350 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b2b0e379-2a0c-4713-9c74-d88d0621018e req-725ecbd0-c69d-4d3b-a7b0-da9f864be8d3 service nova] Acquiring lock "75c911c7-ae44-4902-989f-3f0655243f3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:43.782845 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b2b0e379-2a0c-4713-9c74-d88d0621018e req-725ecbd0-c69d-4d3b-a7b0-da9f864be8d3 service nova] Lock "75c911c7-ae44-4902-989f-3f0655243f3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:43.782980 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b2b0e379-2a0c-4713-9c74-d88d0621018e req-725ecbd0-c69d-4d3b-a7b0-da9f864be8d3 service nova] Lock "75c911c7-ae44-4902-989f-3f0655243f3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:43.783167 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b2b0e379-2a0c-4713-9c74-d88d0621018e req-725ecbd0-c69d-4d3b-a7b0-da9f864be8d3 service nova] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] No event matching network-vif-unplugged-ba6c883b-68ef-4562-9163-932ef65f675c in dict_keys([('network-vif-plugged', 'ba6c883b-68ef-4562-9163-932ef65f675c')]) {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 01:54:43.783306 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-b2b0e379-2a0c-4713-9c74-d88d0621018e req-725ecbd0-c69d-4d3b-a7b0-da9f864be8d3 service nova] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Received unexpected event network-vif-unplugged-ba6c883b-68ef-4562-9163-932ef65f675c for instance with vm_state building and task_state spawning.
May 28 01:54:43.783410 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b2b0e379-2a0c-4713-9c74-d88d0621018e req-725ecbd0-c69d-4d3b-a7b0-da9f864be8d3 service nova] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Received event network-vif-plugged-0af5589b-ed4a-40e6-b1f9-1e52f80285b9 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:54:43.783568 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b2b0e379-2a0c-4713-9c74-d88d0621018e req-725ecbd0-c69d-4d3b-a7b0-da9f864be8d3 service nova] Acquiring lock "e73ac672-0911-4e4d-8a85-9b635a9e836f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:43.783697 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b2b0e379-2a0c-4713-9c74-d88d0621018e req-725ecbd0-c69d-4d3b-a7b0-da9f864be8d3 service nova] Lock "e73ac672-0911-4e4d-8a85-9b635a9e836f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:43.783824 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b2b0e379-2a0c-4713-9c74-d88d0621018e req-725ecbd0-c69d-4d3b-a7b0-da9f864be8d3 service nova] Lock "e73ac672-0911-4e4d-8a85-9b635a9e836f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:43.783989 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b2b0e379-2a0c-4713-9c74-d88d0621018e req-725ecbd0-c69d-4d3b-a7b0-da9f864be8d3 service nova] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] No waiting events found dispatching network-vif-plugged-0af5589b-ed4a-40e6-b1f9-1e52f80285b9 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:54:43.784064 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-b2b0e379-2a0c-4713-9c74-d88d0621018e req-725ecbd0-c69d-4d3b-a7b0-da9f864be8d3 service nova] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Received unexpected event network-vif-plugged-0af5589b-ed4a-40e6-b1f9-1e52f80285b9 for instance with vm_state active and task_state None.
May 28 01:54:43.784196 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b2b0e379-2a0c-4713-9c74-d88d0621018e req-725ecbd0-c69d-4d3b-a7b0-da9f864be8d3 service nova] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Received event network-vif-plugged-0af5589b-ed4a-40e6-b1f9-1e52f80285b9 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:54:43.784330 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b2b0e379-2a0c-4713-9c74-d88d0621018e req-725ecbd0-c69d-4d3b-a7b0-da9f864be8d3 service nova] Acquiring lock "e73ac672-0911-4e4d-8a85-9b635a9e836f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:43.784417 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b2b0e379-2a0c-4713-9c74-d88d0621018e req-725ecbd0-c69d-4d3b-a7b0-da9f864be8d3 service nova] Lock "e73ac672-0911-4e4d-8a85-9b635a9e836f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:43.784613 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b2b0e379-2a0c-4713-9c74-d88d0621018e req-725ecbd0-c69d-4d3b-a7b0-da9f864be8d3 service nova] Lock "e73ac672-0911-4e4d-8a85-9b635a9e836f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:43.784686 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b2b0e379-2a0c-4713-9c74-d88d0621018e req-725ecbd0-c69d-4d3b-a7b0-da9f864be8d3 service nova] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] No waiting events found dispatching network-vif-plugged-0af5589b-ed4a-40e6-b1f9-1e52f80285b9 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:54:43.784794 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-b2b0e379-2a0c-4713-9c74-d88d0621018e req-725ecbd0-c69d-4d3b-a7b0-da9f864be8d3 service nova] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Received unexpected event network-vif-plugged-0af5589b-ed4a-40e6-b1f9-1e52f80285b9 for instance with vm_state active and task_state None.
May 28 01:54:43.784899 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b2b0e379-2a0c-4713-9c74-d88d0621018e req-725ecbd0-c69d-4d3b-a7b0-da9f864be8d3 service nova] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Received event network-vif-plugged-ba6c883b-68ef-4562-9163-932ef65f675c {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:54:43.785001 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b2b0e379-2a0c-4713-9c74-d88d0621018e req-725ecbd0-c69d-4d3b-a7b0-da9f864be8d3 service nova] Acquiring lock "75c911c7-ae44-4902-989f-3f0655243f3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:43.785123 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b2b0e379-2a0c-4713-9c74-d88d0621018e req-725ecbd0-c69d-4d3b-a7b0-da9f864be8d3 service nova] Lock "75c911c7-ae44-4902-989f-3f0655243f3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:43.785236 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b2b0e379-2a0c-4713-9c74-d88d0621018e req-725ecbd0-c69d-4d3b-a7b0-da9f864be8d3 service nova] Lock "75c911c7-ae44-4902-989f-3f0655243f3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:43.785336 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b2b0e379-2a0c-4713-9c74-d88d0621018e req-725ecbd0-c69d-4d3b-a7b0-da9f864be8d3 service nova] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Processing event network-vif-plugged-ba6c883b-68ef-4562-9163-932ef65f675c {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:54:43.785447 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b2b0e379-2a0c-4713-9c74-d88d0621018e req-725ecbd0-c69d-4d3b-a7b0-da9f864be8d3 service nova] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Received event network-vif-plugged-ba6c883b-68ef-4562-9163-932ef65f675c {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:54:43.785544 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b2b0e379-2a0c-4713-9c74-d88d0621018e req-725ecbd0-c69d-4d3b-a7b0-da9f864be8d3 service nova] Acquiring lock "75c911c7-ae44-4902-989f-3f0655243f3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:43.785652 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b2b0e379-2a0c-4713-9c74-d88d0621018e req-725ecbd0-c69d-4d3b-a7b0-da9f864be8d3 service nova] Lock "75c911c7-ae44-4902-989f-3f0655243f3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:43.785741 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b2b0e379-2a0c-4713-9c74-d88d0621018e req-725ecbd0-c69d-4d3b-a7b0-da9f864be8d3 service nova] Lock "75c911c7-ae44-4902-989f-3f0655243f3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:43.785829 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b2b0e379-2a0c-4713-9c74-d88d0621018e req-725ecbd0-c69d-4d3b-a7b0-da9f864be8d3 service nova] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] No waiting events found dispatching network-vif-plugged-ba6c883b-68ef-4562-9163-932ef65f675c {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:54:43.785919 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-b2b0e379-2a0c-4713-9c74-d88d0621018e req-725ecbd0-c69d-4d3b-a7b0-da9f864be8d3 service nova] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Received unexpected event network-vif-plugged-ba6c883b-68ef-4562-9163-932ef65f675c for instance with vm_state building and task_state spawning.
May 28 01:54:43.903898 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:54:43.904132 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:54:44.128868 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:54:44.145554 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Lazy-loading 'flavor' on Instance uuid e73ac672-0911-4e4d-8a85-9b635a9e836f {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:54:44.252731 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933284.2522933, 75c911c7-ae44-4902-989f-3f0655243f3f => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:54:44.252915 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] VM Started (Lifecycle Event)
May 28 01:54:44.254088 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:54:44.256759 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:54:44.259917 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Instance spawned successfully.
May 28 01:54:44.260261 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:54:44.351394 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Successfully created port: 6de78290-8f64-4484-a954-276fe211b28a {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:54:44.407179 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:54:44.632171 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:54:44.756024 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:54:44.758882 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:54:44.770546 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:54:44.770883 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:54:44.771265 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:54:44.771820 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:54:44.773653 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:54:44.773653 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:54:44.909552 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Successfully updated port: 6de78290-8f64-4484-a954-276fe211b28a {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:54:44.915922 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.647s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:44.917489 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.359s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:44.924596 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:54:44.924596 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Claim successful on node np0000001583
May 28 01:54:44.980469 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Deleted allocations for instance f2805796-e531-4508-8585-0d110f4bd4e7
May 28 01:54:44.983382 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7abc900b-5ea2-46a4-8b9f-3dae765f4a09 req-33aa1ade-6035-4e93-a6c7-291fb71db31d service nova] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Received event network-changed-6de78290-8f64-4484-a954-276fe211b28a {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:54:44.983936 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7abc900b-5ea2-46a4-8b9f-3dae765f4a09 req-33aa1ade-6035-4e93-a6c7-291fb71db31d service nova] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Refreshing instance network info cache due to event network-changed-6de78290-8f64-4484-a954-276fe211b28a. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:54:44.984143 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7abc900b-5ea2-46a4-8b9f-3dae765f4a09 req-33aa1ade-6035-4e93-a6c7-291fb71db31d service nova] Acquiring lock "refresh_cache-96a4bb3b-0482-4b14-bb23-772d295b972e" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:54:44.984271 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7abc900b-5ea2-46a4-8b9f-3dae765f4a09 req-33aa1ade-6035-4e93-a6c7-291fb71db31d service nova] Acquired lock "refresh_cache-96a4bb3b-0482-4b14-bb23-772d295b972e" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:54:44.984533 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-7abc900b-5ea2-46a4-8b9f-3dae765f4a09 req-33aa1ade-6035-4e93-a6c7-291fb71db31d service nova] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Refreshing network info cache for port 6de78290-8f64-4484-a954-276fe211b28a {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:54:45.155192 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Lock "e73ac672-0911-4e4d-8a85-9b635a9e836f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.515s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:45.261349 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:54:45.261614 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933285.261434, 75c911c7-ae44-4902-989f-3f0655243f3f => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:54:45.261757 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] VM Paused (Lifecycle Event)
May 28 01:54:45.279145 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Took 6.83 seconds to spawn the instance on the hypervisor.
May 28 01:54:45.279530 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:54:45.414451 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Acquiring lock "refresh_cache-96a4bb3b-0482-4b14-bb23-772d295b972e" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:54:45.440668 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:45.487419 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-7abc900b-5ea2-46a4-8b9f-3dae765f4a09 req-33aa1ade-6035-4e93-a6c7-291fb71db31d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:54:45.541900 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-7abc900b-5ea2-46a4-8b9f-3dae765f4a09 req-33aa1ade-6035-4e93-a6c7-291fb71db31d service nova] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:54:45.641219 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:54:45.642123 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:54:45.642373 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Creating image(s)
May 28 01:54:45.642835 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Acquiring lock "/opt/stack/data/nova/instances/96a4bb3b-0482-4b14-bb23-772d295b972e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:45.642971 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Lock "/opt/stack/data/nova/instances/96a4bb3b-0482-4b14-bb23-772d295b972e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:45.643584 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Lock "/opt/stack/data/nova/instances/96a4bb3b-0482-4b14-bb23-772d295b972e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:45.644174 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:54:45.646747 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:54:45.647867 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:54:45.684995 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-7abc900b-5ea2-46a4-8b9f-3dae765f4a09 req-33aa1ade-6035-4e93-a6c7-291fb71db31d service nova] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:54:45.739659 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.092s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:54:45.740385 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:45.740821 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:45.741193 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:54:45.744433 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:54:45.745255 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:54:45.765098 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:54:45.768050 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933285.7676497, 75c911c7-ae44-4902-989f-3f0655243f3f => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:54:45.768249 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] VM Resumed (Lifecycle Event)
May 28 01:54:45.787571 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Took 13.04 seconds to build instance.
May 28 01:54:45.814319 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.069s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:54:45.814756 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/96a4bb3b-0482-4b14-bb23-772d295b972e/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:54:45.853092 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/96a4bb3b-0482-4b14-bb23-772d295b972e/disk 1073741824" returned: 0 in 0.038s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:54:45.853651 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.113s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:45.853928 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:54:45.931972 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.078s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:54:45.937151 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Checking if we can resize image /opt/stack/data/nova/instances/96a4bb3b-0482-4b14-bb23-772d295b972e/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:54:45.937666 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a4bb3b-0482-4b14-bb23-772d295b972e/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:54:45.991118 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c0d00ff4-a6d0-4d3c-8c08-0e0e7ebd41b1 tempest-ServerActionsV293TestJSON-716114863 tempest-ServerActionsV293TestJSON-716114863-project-member] Lock "f2805796-e531-4508-8585-0d110f4bd4e7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.634s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:46.018114 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a4bb3b-0482-4b14-bb23-772d295b972e/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:54:46.018114 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Cannot resize image /opt/stack/data/nova/instances/96a4bb3b-0482-4b14-bb23-772d295b972e/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:54:46.018114 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:54:46.018114 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Ensure instance console log exists: /opt/stack/data/nova/instances/96a4bb3b-0482-4b14-bb23-772d295b972e/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:54:46.018114 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:46.018114 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:46.018406 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:46.189105 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7abc900b-5ea2-46a4-8b9f-3dae765f4a09 req-33aa1ade-6035-4e93-a6c7-291fb71db31d service nova] Releasing lock "refresh_cache-96a4bb3b-0482-4b14-bb23-772d295b972e" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:54:46.189417 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Acquired lock "refresh_cache-96a4bb3b-0482-4b14-bb23-772d295b972e" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:54:46.189606 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:54:46.236046 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Acquiring lock "e73ac672-0911-4e4d-8a85-9b635a9e836f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:46.238188 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Lock "e73ac672-0911-4e4d-8a85-9b635a9e836f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:46.238188 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Attaching volume df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15 to /dev/vdb
May 28 01:54:46.272790 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:54:46.273244 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:54:46.280124 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:54:46.292918 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-72a195e0-7c9a-4129-849d-a8811327b35f tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "75c911c7-ae44-4902-989f-3f0655243f3f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.550s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:46.298649 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:54:46.354359 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:54:46.394131 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:54:46.394626 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:54:46.403620 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:54:46.405092 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe63:2bb1', 'fe80::e43a:d5ff:fecc:27fe', 'fe80::fc16:3eff:feca:36a6', 'fe80::dc2c:bbff:fe55:4bf7', 'fe80::fc16:3eff:fef5:ed7d', 'fe80::c4dd:b4ff:fe11:7c8', 'fe80::fc16:3eff:fe94:7597', 'fe80::fc16:3eff:fe28:958e', 'fe80::3cc0:d1ff:fe7f:6a8', 'fe80::fc16:3eff:fe07:c64', 'fe80::a0e1:3ff:fe5a:db2c', 'fe80::fc16:3eff:fe27:be54', 'fe80::a0e4:60ff:fe3f:73d6'] 
May 28 01:54:46.405256 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:54:46.405410 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:54:46.405624 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:54:46.405904 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Updating existing volume attachment record: 6847e651-d14c-4b9a-a921-ad5743201bb6 {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:54:46.512741 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:54:46.512888 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:54:46.780089 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:54:46.941786 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:54:46.983517 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:54:46.984244 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15', 'iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:54:46.984450 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:54:46.984950 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:54:46.985376 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15', 'iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:54:46.999887 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:54:47.001538 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:54:47.001538 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:54:47.001538 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:54:47.002159 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:54:47.002406 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:54:47.014639 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:54:47.014639 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:54:47.016789 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:54:47.026859 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:54:47.026859 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:54:47.031347 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15] added
May 28 01:54:47.031347 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:54:47.031347 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:54:47.031347 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:54:47.031347 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:54:47.031347 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:54:47.031347 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:54:47.031657 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:54:47.034102 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0293(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:54:47.034102 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:54:47.042728 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15] added
May 28 01:54:47.042728 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:54:47.042728 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:54:47.042728 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:54:47.042728 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:54:47.042728 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:54:47.042728 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:54:47.042728 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:54:47.042728 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.041(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:54:47.043071 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:54:47.124969 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Updating instance_info_cache with network_info: [{"id": "6de78290-8f64-4484-a954-276fe211b28a", "address": "fa:16:3e:cc:f6:fa", "network": {"id": "9fe2c990-23ca-4988-b674-c9825c3616af", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-419738907-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c32da4f768f48179b4be0509a25a704", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6de78290-8f", "ovs_interfaceid": "6de78290-8f64-4484-a954-276fe211b28a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:54:47.527657 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.610s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:47.528693 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:54:47.636567 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Releasing lock "refresh_cache-96a4bb3b-0482-4b14-bb23-772d295b972e" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:54:47.636775 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Instance network_info: |[{"id": "6de78290-8f64-4484-a954-276fe211b28a", "address": "fa:16:3e:cc:f6:fa", "network": {"id": "9fe2c990-23ca-4988-b674-c9825c3616af", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-419738907-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c32da4f768f48179b4be0509a25a704", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6de78290-8f", "ovs_interfaceid": "6de78290-8f64-4484-a954-276fe211b28a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:54:47.638913 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Start _get_guest_xml network_info=[{"id": "6de78290-8f64-4484-a954-276fe211b28a", "address": "fa:16:3e:cc:f6:fa", "network": {"id": "9fe2c990-23ca-4988-b674-c9825c3616af", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-419738907-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c32da4f768f48179b4be0509a25a704", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6de78290-8f", "ovs_interfaceid": "6de78290-8f64-4484-a954-276fe211b28a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:54:47.643286 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:54:47.644973 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-ServersNegativeTestJSON-server-600450366', uuid='96a4bb3b-0482-4b14-bb23-772d295b972e'), owner=OwnerMeta(userid='c9dd13ea0f744864b4c48f99b39b6436', username='tempest-ServersNegativeTestJSON-1232315525-project-member', projectid='6c32da4f768f48179b4be0509a25a704', projectname='tempest-ServersNegativeTestJSON-1232315525'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6de78290-8f64-4484-a954-276fe211b28a", "address": "fa:16:3e:cc:f6:fa", "network": {"id": "9fe2c990-23ca-4988-b674-c9825c3616af", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-419738907-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c32da4f768f48179b4be0509a25a704", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6de78290-8f", "ovs_interfaceid": "6de78290-8f64-4484-a954-276fe211b28a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933287.6445131) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:54:47.646697 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:54:47.647370 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:54:47.648224 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:54:47.648645 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:54:47.649964 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:54:47.650454 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:54:47.650829 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:54:47.651031 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:54:47.651259 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:54:47.651463 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:54:47.652021 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:54:47.652021 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:54:47.652021 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:54:47.652338 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:54:47.652557 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:54:47.652793 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:54:47.669349 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:54:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-600450366',display_name='tempest-ServersNegativeTestJSON-server-600450366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-serversnegativetestjson-server-600450366',id=15,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c32da4f768f48179b4be0509a25a704',ramdisk_id='',reservation_id='r-tt0bwxky',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1232315525',owner_user_name='tempest-ServersNegativeTestJSON-1232315525-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:54:45Z,user_data=None,user_id='c9dd13ea0f744864b4c48f99b39b6436',uuid=96a4bb3b-0482-4b14-bb23-772d295b972e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6de78290-8f64-4484-a954-276fe211b28a", "address": "fa:16:3e:cc:f6:fa", "network": {"id": "9fe2c990-23ca-4988-b674-c9825c3616af", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-419738907-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c32da4f768f48179b4be0509a25a704", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6de78290-8f", "ovs_interfaceid": "6de78290-8f64-4484-a954-276fe211b28a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:54:47.669577 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Converting VIF {"id": "6de78290-8f64-4484-a954-276fe211b28a", "address": "fa:16:3e:cc:f6:fa", "network": {"id": "9fe2c990-23ca-4988-b674-c9825c3616af", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-419738907-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c32da4f768f48179b4be0509a25a704", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6de78290-8f", "ovs_interfaceid": "6de78290-8f64-4484-a954-276fe211b28a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:54:47.670392 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f6:fa,bridge_name='br-int',has_traffic_filtering=True,id=6de78290-8f64-4484-a954-276fe211b28a,network=Network(9fe2c990-23ca-4988-b674-c9825c3616af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6de78290-8f') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:54:47.672086 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Lazy-loading 'pci_devices' on Instance uuid 96a4bb3b-0482-4b14-bb23-772d295b972e {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:54:47.871004 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:48.034356 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:54:48.035129 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:54:48.035319 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:54:48.035607 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:54:48.036761 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:54:48.044335 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:54:48.055467 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:54:48.055467 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:54:48.063802 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:54:48.063802 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:54:48.074268 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:54:48.075676 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:54:48.090713 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42 (non-flash)
May 28 01:54:48.090713 np0000001583 nova-compute[98241]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42 (non-flash)
May 28 01:54:48.090713 np0000001583 nova-compute[98241]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:54:48.090713 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:54:48.090713 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:54:48.090982 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] iscsi session list stdout=tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42 (non-flash)
May 28 01:54:48.090982 np0000001583 nova-compute[98241]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42 (non-flash)
May 28 01:54:48.090982 np0000001583 nova-compute[98241]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:54:48.090982 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:54:48.090982 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:54:48.091889 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42 (non-flash)
May 28 01:54:48.091889 np0000001583 nova-compute[98241]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42 (non-flash)
May 28 01:54:48.091889 np0000001583 nova-compute[98241]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:54:48.091889 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:54:48.091889 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:54:48.091889 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] iscsi session list stdout=tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42 (non-flash)
May 28 01:54:48.091889 np0000001583 nova-compute[98241]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42 (non-flash)
May 28 01:54:48.091889 np0000001583 nova-compute[98241]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:54:48.091889 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:54:48.091889 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:54:48.124489 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15, portal: 192.168.50.100,3260]
May 28 01:54:48.124489 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15, portal: 192.168.50.100,3260] successful.
May 28 01:54:48.124489 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:54:48.129912 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15, portal: 192.168.40.100,3260]
May 28 01:54:48.129912 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15, portal: 192.168.40.100,3260] successful.
May 28 01:54:48.129912 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:54:48.137678 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:54:48.144101 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:54:48.154894 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42 (non-flash)
May 28 01:54:48.154894 np0000001583 nova-compute[98241]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42 (non-flash)
May 28 01:54:48.154894 np0000001583 nova-compute[98241]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:54:48.154894 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:54:48.154894 np0000001583 nova-compute[98241]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15 (non-flash)
May 28 01:54:48.154894 np0000001583 nova-compute[98241]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15 (non-flash)
May 28 01:54:48.154894 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:54:48.155206 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] iscsi session list stdout=tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42 (non-flash)
May 28 01:54:48.155206 np0000001583 nova-compute[98241]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42 (non-flash)
May 28 01:54:48.155206 np0000001583 nova-compute[98241]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:54:48.155206 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:54:48.155206 np0000001583 nova-compute[98241]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15 (non-flash)
May 28 01:54:48.155206 np0000001583 nova-compute[98241]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15 (non-flash)
May 28 01:54:48.155206 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:54:48.156663 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.155s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:54:48.156839 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:54:48.158327 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] HCTL ('7', '-', '-', 0) found on session 32 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:54:48.158474 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:54:48.159710 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42 (non-flash)
May 28 01:54:48.159710 np0000001583 nova-compute[98241]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42 (non-flash)
May 28 01:54:48.159710 np0000001583 nova-compute[98241]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:54:48.159710 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:54:48.159710 np0000001583 nova-compute[98241]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15 (non-flash)
May 28 01:54:48.159710 np0000001583 nova-compute[98241]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15 (non-flash)
May 28 01:54:48.159710 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:54:48.159710 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] iscsi session list stdout=tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42 (non-flash)
May 28 01:54:48.159710 np0000001583 nova-compute[98241]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42 (non-flash)
May 28 01:54:48.159710 np0000001583 nova-compute[98241]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:54:48.159710 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:54:48.159710 np0000001583 nova-compute[98241]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15 (non-flash)
May 28 01:54:48.159710 np0000001583 nova-compute[98241]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15 (non-flash)
May 28 01:54:48.159710 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:54:48.162320 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.160s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:54:48.162320 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:54:48.162320 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] HCTL ('8', '-', '-', 0) found on session 33 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:54:48.162320 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:54:48.181874 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Searching for a device in session 32 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:54:48.181874 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:54:48.181874 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] End _get_guest_xml xml=<domain type="qemu">
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:   <uuid>96a4bb3b-0482-4b14-bb23-772d295b972e</uuid>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:   <name>instance-0000000f</name>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:       <nova:name>tempest-ServersNegativeTestJSON-server-600450366</nova:name>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:54:47</nova:creationTime>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:         <nova:user uuid="c9dd13ea0f744864b4c48f99b39b6436">tempest-ServersNegativeTestJSON-1232315525-project-member</nova:user>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:         <nova:project uuid="6c32da4f768f48179b4be0509a25a704">tempest-ServersNegativeTestJSON-1232315525</nova:project>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:         <nova:port uuid="6de78290-8f64-4484-a954-276fe211b28a">
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:     <system>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:       <entry name="serial">96a4bb3b-0482-4b14-bb23-772d295b972e</entry>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:       <entry name="uuid">96a4bb3b-0482-4b14-bb23-772d295b972e</entry>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:     </system>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:   <os>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:   </os>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:   <features>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:   </features>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:   <devices>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/96a4bb3b-0482-4b14-bb23-772d295b972e/disk"/>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:     </disk>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/96a4bb3b-0482-4b14-bb23-772d295b972e/disk.config"/>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:     </disk>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:cc:f6:fa"/>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:       <target dev="tap6de78290-8f"/>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:     </interface>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/96a4bb3b-0482-4b14-bb23-772d295b972e/console.log" append="off"/>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:     </serial>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:     <video>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:     </video>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:     </rng>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:   </devices>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]: </domain>
May 28 01:54:48.181874 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:54:48.181874 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Preparing to wait for external event network-vif-plugged-6de78290-8f64-4484-a954-276fe211b28a {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:54:48.181874 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Acquiring lock "96a4bb3b-0482-4b14-bb23-772d295b972e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:48.181874 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Lock "96a4bb3b-0482-4b14-bb23-772d295b972e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:48.181874 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Lock "96a4bb3b-0482-4b14-bb23-772d295b972e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:48.189231 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:54:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-600450366',display_name='tempest-ServersNegativeTestJSON-server-600450366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-serversnegativetestjson-server-600450366',id=15,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c32da4f768f48179b4be0509a25a704',ramdisk_id='',reservation_id='r-tt0bwxky',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1232315525',owner_user_name='tempest-ServersNegativeTestJSON-1232315525-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:54:45Z,user_data=None,user_id='c9dd13ea0f744864b4c48f99b39b6436',uuid=96a4bb3b-0482-4b14-bb23-772d295b972e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6de78290-8f64-4484-a954-276fe211b28a", "address": "fa:16:3e:cc:f6:fa", "network": {"id": "9fe2c990-23ca-4988-b674-c9825c3616af", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-419738907-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c32da4f768f48179b4be0509a25a704", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6de78290-8f", "ovs_interfaceid": "6de78290-8f64-4484-a954-276fe211b28a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:54:48.189231 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Converting VIF {"id": "6de78290-8f64-4484-a954-276fe211b28a", "address": "fa:16:3e:cc:f6:fa", "network": {"id": "9fe2c990-23ca-4988-b674-c9825c3616af", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-419738907-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c32da4f768f48179b4be0509a25a704", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6de78290-8f", "ovs_interfaceid": "6de78290-8f64-4484-a954-276fe211b28a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:54:48.189231 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f6:fa,bridge_name='br-int',has_traffic_filtering=True,id=6de78290-8f64-4484-a954-276fe211b28a,network=Network(9fe2c990-23ca-4988-b674-c9825c3616af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6de78290-8f') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:54:48.189231 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f6:fa,bridge_name='br-int',has_traffic_filtering=True,id=6de78290-8f64-4484-a954-276fe211b28a,network=Network(9fe2c990-23ca-4988-b674-c9825c3616af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6de78290-8f') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:54:48.189231 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:48.189231 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:54:48.189231 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:54:48.189231 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:48.189231 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'befb0ab6-9320-50d7-b2b8-3fb7cd630c07', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:54:48.189231 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:48.189867 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:54:48.190815 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Searching for a device in session 33 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:54:48.190815 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:54:48.192575 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:48.194031 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:48.194224 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6de78290-8f, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:54:48.194540 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6de78290-8f, col_values=(('qos', UUID('c0af93fe-320b-4aba-8523-ab45b1fb3b90')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:54:48.194695 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6de78290-8f, col_values=(('external_ids', {'iface-id': '6de78290-8f64-4484-a954-276fe211b28a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:f6:fa', 'vm-uuid': '96a4bb3b-0482-4b14-bb23-772d295b972e'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:54:48.196115 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:48.197467 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:54:48.203042 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:48.205054 np0000001583 nova-compute[98241]: INFO os_vif [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f6:fa,bridge_name='br-int',has_traffic_filtering=True,id=6de78290-8f64-4484-a954-276fe211b28a,network=Network(9fe2c990-23ca-4988-b674-c9825c3616af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6de78290-8f')
May 28 01:54:48.341178 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3628360fdd1044689e5e94535d1b7fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeed1ca793154290b3390c9300844303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:54:48.513518 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-4d316171-3ba2-41c8-912a-36ca9ae14f01 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:54:48.536402 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:54:48.894418 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Successfully created port: dfa132bb-afe8-4b97-909b-816f3e916bfd {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:54:48.899666 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:49.001632 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:54:49.026187 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-4d316171-3ba2-41c8-912a-36ca9ae14f01 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] instance snapshotting
May 28 01:54:49.148150 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-4d316171-3ba2-41c8-912a-36ca9ae14f01 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Beginning live snapshot process
May 28 01:54:49.377635 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Successfully created port: 78c3c570-3a3b-484e-bc76-7d91862ff0d4 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:54:49.739608 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:54:49.739886 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:54:49.739886 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] No VIF found with MAC fa:16:3e:cc:f6:fa, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:54:49.740945 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Using config drive
May 28 01:54:49.833858 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Successfully created port: 766c9d77-3578-4071-b0eb-f2a929ee0445 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:54:50.022051 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Found WWN 3300000007f4816eb for multipath device dm-0 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:54:50.022571 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:54:50.022571 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '3300000007f4816eb', 'path': '/dev/dm-0', 'multipath_id': '3300000007f4816eb'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:54:50.022681 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007f4816eb', 'path': '/dev/dm-0', 'multipath_id': '3300000007f4816eb'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:54:50.031685 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Lazy-loading 'flavor' on Instance uuid e73ac672-0911-4e4d-8a85-9b635a9e836f {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:54:50.045777 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:54:50.247501 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:54:50.317409 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Successfully created port: d868b893-10e8-42d1-872f-bf4b9e8d3659 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:54:50.418818 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Creating config drive at /opt/stack/data/nova/instances/96a4bb3b-0482-4b14-bb23-772d295b972e/disk.config
May 28 01:54:50.423209 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/96a4bb3b-0482-4b14-bb23-772d295b972e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpvweruqu8 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:54:50.478374 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/96a4bb3b-0482-4b14-bb23-772d295b972e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpvweruqu8" returned: 0 in 0.055s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:54:50.536366 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Attempting to attach volume df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98241) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 01:54:50.538804 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] attach device xml: <disk type="block" device="disk">
May 28 01:54:50.538804 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:54:50.538804 np0000001583 nova-compute[98241]:   <alias name="ua-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15"/>
May 28 01:54:50.538804 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-0"/>
May 28 01:54:50.538804 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 01:54:50.538804 np0000001583 nova-compute[98241]:   <serial>df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15</serial>
May 28 01:54:50.538804 np0000001583 nova-compute[98241]: </disk>
May 28 01:54:50.538804 np0000001583 nova-compute[98241]:  {{(pid=98241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 01:54:50.551715 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Booting with volume cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 at /dev/vda
May 28 01:54:50.616376 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:54:50.634784 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:54:50.664124 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-4d316171-3ba2-41c8-912a-36ca9ae14f01 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c911c7-ae44-4902-989f-3f0655243f3f/disk --force-share --output=json -f qcow2 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:54:50.677612 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:54:50.715337 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:54:50.716176 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:54:50.725071 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:54:50.731246 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe63:2bb1', 'fe80::e43a:d5ff:fecc:27fe', 'fe80::fc16:3eff:feca:36a6', 'fe80::dc2c:bbff:fe55:4bf7', 'fe80::fc16:3eff:fef5:ed7d', 'fe80::c4dd:b4ff:fe11:7c8', 'fe80::fc16:3eff:fe94:7597', 'fe80::fc16:3eff:fe28:958e', 'fe80::3cc0:d1ff:fe7f:6a8', 'fe80::fc16:3eff:fe07:c64', 'fe80::a0e1:3ff:fe5a:db2c', 'fe80::fc16:3eff:fe27:be54', 'fe80::a0e4:60ff:fe3f:73d6'] 
May 28 01:54:50.731246 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:54:50.731430 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:54:50.732096 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:54:50.732096 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Updating existing volume attachment record: 1987c72c-c619-45e7-a733-6665194b55dd {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:54:50.768303 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-4d316171-3ba2-41c8-912a-36ca9ae14f01 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c911c7-ae44-4902-989f-3f0655243f3f/disk --force-share --output=json -f qcow2" returned: 0 in 0.104s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:54:50.769629 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-4d316171-3ba2-41c8-912a-36ca9ae14f01 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c911c7-ae44-4902-989f-3f0655243f3f/disk --force-share --output=json -f qcow2 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:54:50.869165 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-4d316171-3ba2-41c8-912a-36ca9ae14f01 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c911c7-ae44-4902-989f-3f0655243f3f/disk --force-share --output=json -f qcow2" returned: 0 in 0.099s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:54:50.870055 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-4d316171-3ba2-41c8-912a-36ca9ae14f01 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:54:50.873395 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-4d316171-3ba2-41c8-912a-36ca9ae14f01 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:54:50.873764 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-4d316171-3ba2-41c8-912a-36ca9ae14f01 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:54:50.896472 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Successfully created port: 9ca5546d-4b44-4470-92d7-08800876e89b {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:54:50.963756 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-4d316171-3ba2-41c8-912a-36ca9ae14f01 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.090s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:54:50.966749 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-4d316171-3ba2-41c8-912a-36ca9ae14f01 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp23af8id6/2eec1b9318b94d31a80410991c4ca745.delta 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:54:51.030963 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-4d316171-3ba2-41c8-912a-36ca9ae14f01 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp23af8id6/2eec1b9318b94d31a80410991c4ca745.delta 1073741824" returned: 0 in 0.064s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:54:51.032939 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-4d316171-3ba2-41c8-912a-36ca9ae14f01 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Quiescing instance not available: QEMU guest agent is not enabled.
May 28 01:54:51.130891 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:51.159506 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:51.409394 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-4d316171-3ba2-41c8-912a-36ca9ae14f01 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] COPY block job progress, current cursor: 1 final cursor: 1 {{(pid=98241) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 28 01:54:51.413112 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-4d316171-3ba2-41c8-912a-36ca9ae14f01 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Skipping quiescing instance: QEMU guest agent is not enabled.
May 28 01:54:51.423859 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-04b8e0df-0cc6-4562-a2c2-fe1047c289c9 req-3dbfdc28-2bd1-42a6-8e64-1c382b013d56 service nova] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Received event network-vif-plugged-6de78290-8f64-4484-a954-276fe211b28a {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:54:51.427349 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-04b8e0df-0cc6-4562-a2c2-fe1047c289c9 req-3dbfdc28-2bd1-42a6-8e64-1c382b013d56 service nova] Acquiring lock "96a4bb3b-0482-4b14-bb23-772d295b972e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:51.427349 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-04b8e0df-0cc6-4562-a2c2-fe1047c289c9 req-3dbfdc28-2bd1-42a6-8e64-1c382b013d56 service nova] Lock "96a4bb3b-0482-4b14-bb23-772d295b972e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:51.427349 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-04b8e0df-0cc6-4562-a2c2-fe1047c289c9 req-3dbfdc28-2bd1-42a6-8e64-1c382b013d56 service nova] Lock "96a4bb3b-0482-4b14-bb23-772d295b972e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:51.427349 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-04b8e0df-0cc6-4562-a2c2-fe1047c289c9 req-3dbfdc28-2bd1-42a6-8e64-1c382b013d56 service nova] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Processing event network-vif-plugged-6de78290-8f64-4484-a954-276fe211b28a {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:54:51.568538 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:51.579327 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Successfully updated port: dfa132bb-afe8-4b97-909b-816f3e916bfd {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:54:51.583449 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:51.583449 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:51.599632 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:51.616987 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:51.622620 np0000001583 nova-compute[98241]: DEBUG nova.privsep.utils [None req-4d316171-3ba2-41c8-912a-36ca9ae14f01 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98241) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 01:54:51.623020 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-4d316171-3ba2-41c8-912a-36ca9ae14f01 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp23af8id6/2eec1b9318b94d31a80410991c4ca745.delta /opt/stack/data/nova/instances/snapshots/tmp23af8id6/2eec1b9318b94d31a80410991c4ca745 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:54:51.658227 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-539a76ea-5097-4940-a91e-3aa1e559090e req-c1afd7bd-f547-4098-9236-97b578d27976 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-changed-dfa132bb-afe8-4b97-909b-816f3e916bfd {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:54:51.658227 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-539a76ea-5097-4940-a91e-3aa1e559090e req-c1afd7bd-f547-4098-9236-97b578d27976 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Refreshing instance network info cache due to event network-changed-dfa132bb-afe8-4b97-909b-816f3e916bfd. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:54:51.658227 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-539a76ea-5097-4940-a91e-3aa1e559090e req-c1afd7bd-f547-4098-9236-97b578d27976 service nova] Acquiring lock "refresh_cache-0cca8054-2a26-436f-93b8-ef28e452bd65" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:54:51.658227 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-539a76ea-5097-4940-a91e-3aa1e559090e req-c1afd7bd-f547-4098-9236-97b578d27976 service nova] Acquired lock "refresh_cache-0cca8054-2a26-436f-93b8-ef28e452bd65" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:54:51.658929 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-539a76ea-5097-4940-a91e-3aa1e559090e req-c1afd7bd-f547-4098-9236-97b578d27976 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Refreshing network info cache for port dfa132bb-afe8-4b97-909b-816f3e916bfd {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:54:51.717610 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-4d316171-3ba2-41c8-912a-36ca9ae14f01 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp23af8id6/2eec1b9318b94d31a80410991c4ca745.delta /opt/stack/data/nova/instances/snapshots/tmp23af8id6/2eec1b9318b94d31a80410991c4ca745" returned: 0 in 0.094s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:54:51.719622 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-4d316171-3ba2-41c8-912a-36ca9ae14f01 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Snapshot extracted, beginning image upload
May 28 01:54:52.162034 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-539a76ea-5097-4940-a91e-3aa1e559090e req-c1afd7bd-f547-4098-9236-97b578d27976 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:54:52.261599 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-539a76ea-5097-4940-a91e-3aa1e559090e req-c1afd7bd-f547-4098-9236-97b578d27976 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:54:52.279759 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:54:52.280185 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:54:52.280402 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] No VIF found with MAC fa:16:3e:ca:36:a6, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:54:52.357384 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:54:52.358508 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933292.3574402, 96a4bb3b-0482-4b14-bb23-772d295b972e => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:54:52.358508 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] VM Started (Lifecycle Event)
May 28 01:54:52.363306 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:54:52.365727 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Instance spawned successfully.
May 28 01:54:52.366220 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:54:52.387274 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Booting with volume 7d62e380-a6af-45e6-aefa-214f97c0760b at /dev/vdb
May 28 01:54:52.461901 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:54:52.484497 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:54:52.524195 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:54:52.549540 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-539a76ea-5097-4940-a91e-3aa1e559090e req-c1afd7bd-f547-4098-9236-97b578d27976 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:54:52.561618 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:54:52.562151 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:54:52.579149 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:54:52.579149 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe63:2bb1', 'fe80::e43a:d5ff:fecc:27fe', 'fe80::fc16:3eff:feca:36a6', 'fe80::dc2c:bbff:fe55:4bf7', 'fe80::fc16:3eff:fef5:ed7d', 'fe80::c4dd:b4ff:fe11:7c8', 'fe80::fc16:3eff:fe94:7597', 'fe80::fc16:3eff:fe28:958e', 'fe80::3cc0:d1ff:fe7f:6a8', 'fe80::fc16:3eff:fe07:c64', 'fe80::a0e1:3ff:fe5a:db2c', 'fe80::fc16:3eff:fe27:be54', 'fe80::a0e4:60ff:fe3f:73d6', 'fe80::fc16:3eff:fecc:f6fa', 'fe80::d4f7:45ff:fed0:14ad'] 
May 28 01:54:52.579149 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:54:52.579149 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:54:52.579149 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:54:52.579149 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Updating existing volume attachment record: 29d3d63b-a3d1-4623-b493-db8560f9c3fd {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:54:52.840665 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Successfully updated port: 939862e4-4e68-484c-bbcd-95faf922a641 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:54:52.865318 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:54:52.867697 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:54:52.874482 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:52.888778 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:54:52.889052 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:54:52.889431 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:54:52.889718 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:54:52.890062 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:54:52.891570 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:54:53.053969 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-539a76ea-5097-4940-a91e-3aa1e559090e req-c1afd7bd-f547-4098-9236-97b578d27976 service nova] Releasing lock "refresh_cache-0cca8054-2a26-436f-93b8-ef28e452bd65" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:54:53.205321 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:53.377975 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:54:53.378992 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933293.378627, 96a4bb3b-0482-4b14-bb23-772d295b972e => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:54:53.379173 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] VM Paused (Lifecycle Event)
May 28 01:54:53.397692 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Took 7.76 seconds to spawn the instance on the hypervisor.
May 28 01:54:53.397909 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:54:53.518569 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-59afc1b0-e92b-4e4a-9394-6c4e1fc24856 req-0217a6cb-87c9-4608-b159-bd8b2b3657e9 service nova] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Received event network-vif-plugged-6de78290-8f64-4484-a954-276fe211b28a {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:54:53.518996 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-59afc1b0-e92b-4e4a-9394-6c4e1fc24856 req-0217a6cb-87c9-4608-b159-bd8b2b3657e9 service nova] Acquiring lock "96a4bb3b-0482-4b14-bb23-772d295b972e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:53.518996 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-59afc1b0-e92b-4e4a-9394-6c4e1fc24856 req-0217a6cb-87c9-4608-b159-bd8b2b3657e9 service nova] Lock "96a4bb3b-0482-4b14-bb23-772d295b972e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:53.519143 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-59afc1b0-e92b-4e4a-9394-6c4e1fc24856 req-0217a6cb-87c9-4608-b159-bd8b2b3657e9 service nova] Lock "96a4bb3b-0482-4b14-bb23-772d295b972e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:53.519313 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-59afc1b0-e92b-4e4a-9394-6c4e1fc24856 req-0217a6cb-87c9-4608-b159-bd8b2b3657e9 service nova] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] No waiting events found dispatching network-vif-plugged-6de78290-8f64-4484-a954-276fe211b28a {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:54:53.519385 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-59afc1b0-e92b-4e4a-9394-6c4e1fc24856 req-0217a6cb-87c9-4608-b159-bd8b2b3657e9 service nova] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Received unexpected event network-vif-plugged-6de78290-8f64-4484-a954-276fe211b28a for instance with vm_state active and task_state None.
May 28 01:54:53.519431 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-59afc1b0-e92b-4e4a-9394-6c4e1fc24856 req-0217a6cb-87c9-4608-b159-bd8b2b3657e9 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-changed-939862e4-4e68-484c-bbcd-95faf922a641 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:54:53.519739 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-59afc1b0-e92b-4e4a-9394-6c4e1fc24856 req-0217a6cb-87c9-4608-b159-bd8b2b3657e9 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Refreshing instance network info cache due to event network-changed-939862e4-4e68-484c-bbcd-95faf922a641. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:54:53.520382 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-59afc1b0-e92b-4e4a-9394-6c4e1fc24856 req-0217a6cb-87c9-4608-b159-bd8b2b3657e9 service nova] Acquiring lock "refresh_cache-0cca8054-2a26-436f-93b8-ef28e452bd65" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:54:53.521101 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-59afc1b0-e92b-4e4a-9394-6c4e1fc24856 req-0217a6cb-87c9-4608-b159-bd8b2b3657e9 service nova] Acquired lock "refresh_cache-0cca8054-2a26-436f-93b8-ef28e452bd65" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:54:53.521101 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-59afc1b0-e92b-4e4a-9394-6c4e1fc24856 req-0217a6cb-87c9-4608-b159-bd8b2b3657e9 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Refreshing network info cache for port 939862e4-4e68-484c-bbcd-95faf922a641 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:54:53.817243 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:53.840425 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2967bdbd-6ebf-47c6-b965-99cb7fe58288 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Lock "e73ac672-0911-4e4d-8a85-9b635a9e836f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.604s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:53.886544 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:54:53.887867 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933293.887643, 96a4bb3b-0482-4b14-bb23-772d295b972e => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:54:53.888050 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] VM Resumed (Lifecycle Event)
May 28 01:54:53.907561 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Took 13.42 seconds to build instance.
May 28 01:54:54.023706 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-59afc1b0-e92b-4e4a-9394-6c4e1fc24856 req-0217a6cb-87c9-4608-b159-bd8b2b3657e9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:54:54.100608 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c3ee381b-5de9-4563-888c-7b5427cfa9c5 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Acquiring lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:54.100752 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c3ee381b-5de9-4563-888c-7b5427cfa9c5 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:54.154148 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-59afc1b0-e92b-4e4a-9394-6c4e1fc24856 req-0217a6cb-87c9-4608-b159-bd8b2b3657e9 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:54:54.199135 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.000644687999965754 future=<Future at 0x7724f83b1bb0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:54:54.199135 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:54:54.200409 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-a48597d6-d1e4-4992-8756-342c7ee11329 None None] Emitting event <LifecycleEvent: 1779933279.1981945, f2805796-e531-4508-8585-0d110f4bd4e7 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:54:54.201154 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-a48597d6-d1e4-4992-8756-342c7ee11329 None None] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] VM Stopped (Lifecycle Event)
May 28 01:54:54.237134 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Booting with volume 1319d85a-02ed-497c-a138-d2b9a5b28c6e at /dev/vdc
May 28 01:54:54.321691 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:54:54.343750 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:54:54.375615 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:54:54.394101 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:54:54.397117 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:54:54.410301 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ccaf9ff1-9830-44af-aa8a-65c6d71fd89f tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Lock "96a4bb3b-0482-4b14-bb23-772d295b972e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.930s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:54.412374 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:54:54.413660 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:54:54.424203 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:54:54.426250 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe63:2bb1', 'fe80::e43a:d5ff:fecc:27fe', 'fe80::fc16:3eff:feca:36a6', 'fe80::dc2c:bbff:fe55:4bf7', 'fe80::fc16:3eff:fef5:ed7d', 'fe80::c4dd:b4ff:fe11:7c8', 'fe80::fc16:3eff:fe94:7597', 'fe80::fc16:3eff:fe28:958e', 'fe80::3cc0:d1ff:fe7f:6a8', 'fe80::fc16:3eff:fe07:c64', 'fe80::a0e1:3ff:fe5a:db2c', 'fe80::fc16:3eff:fe27:be54', 'fe80::a0e4:60ff:fe3f:73d6', 'fe80::fc16:3eff:fecc:f6fa', 'fe80::d4f7:45ff:fed0:14ad'] 
May 28 01:54:54.426445 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:54:54.426619 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:54:54.426936 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] <== get_connector_properties: return (105ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:54:54.427327 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Updating existing volume attachment record: 5ac71183-0519-4f77-a7d4-d98fe5c32b76 {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:54:54.550118 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-59afc1b0-e92b-4e4a-9394-6c4e1fc24856 req-0217a6cb-87c9-4608-b159-bd8b2b3657e9 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:54:54.606301 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-c3ee381b-5de9-4563-888c-7b5427cfa9c5 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Detaching volume a2c5c258-e7db-4399-802e-b94d13fd2b42
May 28 01:54:54.679771 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-c3ee381b-5de9-4563-888c-7b5427cfa9c5 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Attempting to driver detach volume a2c5c258-e7db-4399-802e-b94d13fd2b42 from mountpoint /dev/vdc
May 28 01:54:54.683477 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-c3ee381b-5de9-4563-888c-7b5427cfa9c5 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Found disk vdc by alias ua-a2c5c258-e7db-4399-802e-b94d13fd2b42 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:54:54.685156 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-c3ee381b-5de9-4563-888c-7b5427cfa9c5 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Found disk vdc by alias ua-a2c5c258-e7db-4399-802e-b94d13fd2b42 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:54:54.685156 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-c3ee381b-5de9-4563-888c-7b5427cfa9c5 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Attempting to detach device vdc from instance adfbfdf0-7c0f-4834-92ff-3b8d8c39e333 from the persistent domain config. {{(pid=98241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 01:54:54.685156 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-c3ee381b-5de9-4563-888c-7b5427cfa9c5 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:54:54.685156 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:54:54.685156 np0000001583 nova-compute[98241]:   <alias name="ua-a2c5c258-e7db-4399-802e-b94d13fd2b42"/>
May 28 01:54:54.685156 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-6"/>
May 28 01:54:54.685156 np0000001583 nova-compute[98241]:   <target dev="vdc" bus="virtio"/>
May 28 01:54:54.685156 np0000001583 nova-compute[98241]:   <serial>a2c5c258-e7db-4399-802e-b94d13fd2b42</serial>
May 28 01:54:54.685156 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 01:54:54.685156 np0000001583 nova-compute[98241]: </disk>
May 28 01:54:54.685156 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:54:54.695386 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-c3ee381b-5de9-4563-888c-7b5427cfa9c5 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Successfully detached device vdc from instance adfbfdf0-7c0f-4834-92ff-3b8d8c39e333 from the persistent domain config.
May 28 01:54:54.697783 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-c3ee381b-5de9-4563-888c-7b5427cfa9c5 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] (1/8): Attempting to detach device vdc with device alias ua-a2c5c258-e7db-4399-802e-b94d13fd2b42 from instance adfbfdf0-7c0f-4834-92ff-3b8d8c39e333 from the live domain config. {{(pid=98241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 01:54:54.697783 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-c3ee381b-5de9-4563-888c-7b5427cfa9c5 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:54:54.697783 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:54:54.697783 np0000001583 nova-compute[98241]:   <alias name="ua-a2c5c258-e7db-4399-802e-b94d13fd2b42"/>
May 28 01:54:54.697783 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-6"/>
May 28 01:54:54.697783 np0000001583 nova-compute[98241]:   <target dev="vdc" bus="virtio"/>
May 28 01:54:54.697783 np0000001583 nova-compute[98241]:   <serial>a2c5c258-e7db-4399-802e-b94d13fd2b42</serial>
May 28 01:54:54.697783 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 01:54:54.697783 np0000001583 nova-compute[98241]: </disk>
May 28 01:54:54.697783 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:54:54.706114 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a48597d6-d1e4-4992-8756-342c7ee11329 None None] [instance: f2805796-e531-4508-8585-0d110f4bd4e7] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:54:54.786460 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-4d316171-3ba2-41c8-912a-36ca9ae14f01 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Snapshot image upload complete
May 28 01:54:54.786460 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-4d316171-3ba2-41c8-912a-36ca9ae14f01 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Took 5.76 seconds to snapshot the instance on the hypervisor.
May 28 01:54:54.816473 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Successfully updated port: 7896c8d5-ea83-4141-8344-6b557e45d6d1 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:54:54.909978 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f893a48d-9a7e-430e-b83b-a15610aadc37 req-e06c6334-54a5-4654-955e-a708d4ab2077 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-changed-7896c8d5-ea83-4141-8344-6b557e45d6d1 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:54:54.910978 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f893a48d-9a7e-430e-b83b-a15610aadc37 req-e06c6334-54a5-4654-955e-a708d4ab2077 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Refreshing instance network info cache due to event network-changed-7896c8d5-ea83-4141-8344-6b557e45d6d1. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:54:54.911261 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f893a48d-9a7e-430e-b83b-a15610aadc37 req-e06c6334-54a5-4654-955e-a708d4ab2077 service nova] Acquiring lock "refresh_cache-0cca8054-2a26-436f-93b8-ef28e452bd65" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:54:55.053439 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-59afc1b0-e92b-4e4a-9394-6c4e1fc24856 req-0217a6cb-87c9-4608-b159-bd8b2b3657e9 service nova] Releasing lock "refresh_cache-0cca8054-2a26-436f-93b8-ef28e452bd65" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:54:55.053959 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f893a48d-9a7e-430e-b83b-a15610aadc37 req-e06c6334-54a5-4654-955e-a708d4ab2077 service nova] Acquired lock "refresh_cache-0cca8054-2a26-436f-93b8-ef28e452bd65" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:54:55.054241 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-f893a48d-9a7e-430e-b83b-a15610aadc37 req-e06c6334-54a5-4654-955e-a708d4ab2077 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Refreshing network info cache for port 7896c8d5-ea83-4141-8344-6b557e45d6d1 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:54:55.373387 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Received event <DeviceRemovedEvent: 1779933295.373012, adfbfdf0-7c0f-4834-92ff-3b8d8c39e333 => ua-a2c5c258-e7db-4399-802e-b94d13fd2b42> from libvirt while the driver is waiting for it; dispatched. {{(pid=98241) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 01:54:55.375322 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-c3ee381b-5de9-4563-888c-7b5427cfa9c5 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-a2c5c258-e7db-4399-802e-b94d13fd2b42 for instance adfbfdf0-7c0f-4834-92ff-3b8d8c39e333 {{(pid=98241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 01:54:55.380245 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-c3ee381b-5de9-4563-888c-7b5427cfa9c5 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Successfully detached device vdc from instance adfbfdf0-7c0f-4834-92ff-3b8d8c39e333 from the live domain config.
May 28 01:54:55.381185 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3ee381b-5de9-4563-888c-7b5427cfa9c5 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:54:55.381682 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ee381b-5de9-4563-888c-7b5427cfa9c5 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42', 'iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a2c5c258-e7db-4399-802e-b94d13fd2b42', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': False}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:54:55.381682 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-c3ee381b-5de9-4563-888c-7b5427cfa9c5 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:54:55.382108 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-c3ee381b-5de9-4563-888c-7b5427cfa9c5 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:54:55.382399 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ee381b-5de9-4563-888c-7b5427cfa9c5 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42', 'iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a2c5c258-e7db-4399-802e-b94d13fd2b42', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:54:55.382539 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ee381b-5de9-4563-888c-7b5427cfa9c5 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:54:55.417711 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ee381b-5de9-4563-888c-7b5427cfa9c5 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42 (non-flash)
May 28 01:54:55.417711 np0000001583 nova-compute[98241]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42 (non-flash)
May 28 01:54:55.417711 np0000001583 nova-compute[98241]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:54:55.417711 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:54:55.417711 np0000001583 nova-compute[98241]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15 (non-flash)
May 28 01:54:55.417711 np0000001583 nova-compute[98241]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15 (non-flash)
May 28 01:54:55.417711 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:54:55.418245 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ee381b-5de9-4563-888c-7b5427cfa9c5 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] iscsi session list stdout=tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42 (non-flash)
May 28 01:54:55.418245 np0000001583 nova-compute[98241]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42 (non-flash)
May 28 01:54:55.418245 np0000001583 nova-compute[98241]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:54:55.418245 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:54:55.418245 np0000001583 nova-compute[98241]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15 (non-flash)
May 28 01:54:55.418245 np0000001583 nova-compute[98241]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15 (non-flash)
May 28 01:54:55.418245 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:54:55.418645 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ee381b-5de9-4563-888c-7b5427cfa9c5 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42', '28'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15', '32'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15', '33')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:54:55.418882 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ee381b-5de9-4563-888c-7b5427cfa9c5 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42', '28')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:54:55.420311 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ee381b-5de9-4563-888c-7b5427cfa9c5 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42', '29')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:54:55.421099 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ee381b-5de9-4563-888c-7b5427cfa9c5 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f81545e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42'): ({'sdg'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:54:55.421390 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-c3ee381b-5de9-4563-888c-7b5427cfa9c5 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Removing multipathed devices sdf, sdg {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:54:55.421667 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-c3ee381b-5de9-4563-888c-7b5427cfa9c5 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Flush multipath device 330000000ecc150af {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:54:55.449578 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-c3ee381b-5de9-4563-888c-7b5427cfa9c5 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:54:55.487520 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-c3ee381b-5de9-4563-888c-7b5427cfa9c5 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:54:55.539535 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-c3ee381b-5de9-4563-888c-7b5427cfa9c5 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:54:55.539535 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-c3ee381b-5de9-4563-888c-7b5427cfa9c5 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:54:55.540609 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-c3ee381b-5de9-4563-888c-7b5427cfa9c5 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:54:55.557214 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-c3ee381b-5de9-4563-888c-7b5427cfa9c5 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:54:55.557728 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ee381b-5de9-4563-888c-7b5427cfa9c5 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:54:55.558458 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-f893a48d-9a7e-430e-b83b-a15610aadc37 req-e06c6334-54a5-4654-955e-a708d4ab2077 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:54:55.576761 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ee381b-5de9-4563-888c-7b5427cfa9c5 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:54:55.609939 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ee381b-5de9-4563-888c-7b5427cfa9c5 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42, portal: 192.168.40.100,3260]
May 28 01:54:55.609939 np0000001583 nova-compute[98241]: Logout of [sid: 28, target: iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42, portal: 192.168.40.100,3260] successful.
May 28 01:54:55.609939 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:54:55.630447 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ee381b-5de9-4563-888c-7b5427cfa9c5 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:54:55.641150 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ee381b-5de9-4563-888c-7b5427cfa9c5 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:54:55.677440 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-f893a48d-9a7e-430e-b83b-a15610aadc37 req-e06c6334-54a5-4654-955e-a708d4ab2077 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:54:55.679185 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ee381b-5de9-4563-888c-7b5427cfa9c5 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42, portal: 192.168.50.100,3260]
May 28 01:54:55.679185 np0000001583 nova-compute[98241]: Logout of [sid: 29, target: iqn.2023-03.storpool.com:os--volume-a2c5c258-e7db-4399-802e-b94d13fd2b42, portal: 192.168.50.100,3260] successful.
May 28 01:54:55.679185 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:54:55.695485 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ee381b-5de9-4563-888c-7b5427cfa9c5 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:54:55.695824 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-c3ee381b-5de9-4563-888c-7b5427cfa9c5 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:54:55.696089 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ee381b-5de9-4563-888c-7b5427cfa9c5 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] <== disconnect_volume: return (314ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:54:55.696369 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3ee381b-5de9-4563-888c-7b5427cfa9c5 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:54:55.855808 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-cdae0a68-5931-477b-93d9-787e488dbadc tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Acquiring lock "e73ac672-0911-4e4d-8a85-9b635a9e836f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:55.856251 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-cdae0a68-5931-477b-93d9-787e488dbadc tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Lock "e73ac672-0911-4e4d-8a85-9b635a9e836f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:55.897239 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Acquiring lock "d3135bb7-29cf-4819-9e83-1c45211901eb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:55.898776 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Lock "d3135bb7-29cf-4819-9e83-1c45211901eb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:56.037860 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-f893a48d-9a7e-430e-b83b-a15610aadc37 req-e06c6334-54a5-4654-955e-a708d4ab2077 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:54:56.270574 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:56.274805 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-c3ee381b-5de9-4563-888c-7b5427cfa9c5 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lazy-loading 'flavor' on Instance uuid adfbfdf0-7c0f-4834-92ff-3b8d8c39e333 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:54:56.359424 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cdae0a68-5931-477b-93d9-787e488dbadc tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Detaching volume df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15
May 28 01:54:56.401255 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:54:56.412544 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Successfully updated port: 78c3c570-3a3b-484e-bc76-7d91862ff0d4 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:54:56.419907 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-cdae0a68-5931-477b-93d9-787e488dbadc tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Attempting to driver detach volume df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15 from mountpoint /dev/vdb
May 28 01:54:56.427923 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cdae0a68-5931-477b-93d9-787e488dbadc tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Found disk vdb by alias ua-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:54:56.429178 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cdae0a68-5931-477b-93d9-787e488dbadc tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Found disk vdb by alias ua-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:54:56.429339 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cdae0a68-5931-477b-93d9-787e488dbadc tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Attempting to detach device vdb from instance e73ac672-0911-4e4d-8a85-9b635a9e836f from the persistent domain config. {{(pid=98241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 01:54:56.429633 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-cdae0a68-5931-477b-93d9-787e488dbadc tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:54:56.429633 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:54:56.429633 np0000001583 nova-compute[98241]:   <alias name="ua-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15"/>
May 28 01:54:56.429633 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-0"/>
May 28 01:54:56.429633 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 01:54:56.429633 np0000001583 nova-compute[98241]:   <serial>df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15</serial>
May 28 01:54:56.429633 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 28 01:54:56.429633 np0000001583 nova-compute[98241]: </disk>
May 28 01:54:56.429633 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:54:56.440929 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-cdae0a68-5931-477b-93d9-787e488dbadc tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Successfully detached device vdb from instance e73ac672-0911-4e4d-8a85-9b635a9e836f from the persistent domain config.
May 28 01:54:56.441192 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cdae0a68-5931-477b-93d9-787e488dbadc tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] (1/8): Attempting to detach device vdb with device alias ua-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15 from instance e73ac672-0911-4e4d-8a85-9b635a9e836f from the live domain config. {{(pid=98241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 01:54:56.441495 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-cdae0a68-5931-477b-93d9-787e488dbadc tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:54:56.441495 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:54:56.441495 np0000001583 nova-compute[98241]:   <alias name="ua-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15"/>
May 28 01:54:56.441495 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-0"/>
May 28 01:54:56.441495 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 01:54:56.441495 np0000001583 nova-compute[98241]:   <serial>df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15</serial>
May 28 01:54:56.441495 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 28 01:54:56.441495 np0000001583 nova-compute[98241]: </disk>
May 28 01:54:56.441495 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:54:56.540539 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f893a48d-9a7e-430e-b83b-a15610aadc37 req-e06c6334-54a5-4654-955e-a708d4ab2077 service nova] Releasing lock "refresh_cache-0cca8054-2a26-436f-93b8-ef28e452bd65" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:54:56.614426 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:54:56.615441 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:54:56.615657 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Creating image(s)
May 28 01:54:56.615937 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Did not create local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 01:54:56.616102 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Ensure instance console log exists: /opt/stack/data/nova/instances/0cca8054-2a26-436f-93b8-ef28e452bd65/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:54:56.616297 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:56.616439 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:56.616545 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:56.993913 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-40625f2c-47ca-4228-bc61-2237aed4f888 req-16d274f3-4ba7-48e0-b076-388ce353e86c service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-changed-78c3c570-3a3b-484e-bc76-7d91862ff0d4 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:54:56.994607 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-40625f2c-47ca-4228-bc61-2237aed4f888 req-16d274f3-4ba7-48e0-b076-388ce353e86c service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Refreshing instance network info cache due to event network-changed-78c3c570-3a3b-484e-bc76-7d91862ff0d4. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:54:56.994806 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-40625f2c-47ca-4228-bc61-2237aed4f888 req-16d274f3-4ba7-48e0-b076-388ce353e86c service nova] Acquiring lock "refresh_cache-0cca8054-2a26-436f-93b8-ef28e452bd65" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:54:56.994946 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-40625f2c-47ca-4228-bc61-2237aed4f888 req-16d274f3-4ba7-48e0-b076-388ce353e86c service nova] Acquired lock "refresh_cache-0cca8054-2a26-436f-93b8-ef28e452bd65" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:54:56.995171 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-40625f2c-47ca-4228-bc61-2237aed4f888 req-16d274f3-4ba7-48e0-b076-388ce353e86c service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Refreshing network info cache for port 78c3c570-3a3b-484e-bc76-7d91862ff0d4 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:54:57.007115 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:57.007670 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:57.014173 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:54:57.014557 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Claim successful on node np0000001583
May 28 01:54:57.046066 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Received event <DeviceRemovedEvent: 1779933297.04561, e73ac672-0911-4e4d-8a85-9b635a9e836f => ua-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15> from libvirt while the driver is waiting for it; dispatched. {{(pid=98241) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 01:54:57.048123 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cdae0a68-5931-477b-93d9-787e488dbadc tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15 for instance e73ac672-0911-4e4d-8a85-9b635a9e836f {{(pid=98241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 01:54:57.051636 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-cdae0a68-5931-477b-93d9-787e488dbadc tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Successfully detached device vdb from instance e73ac672-0911-4e4d-8a85-9b635a9e836f from the live domain config.
May 28 01:54:57.053228 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdae0a68-5931-477b-93d9-787e488dbadc tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:54:57.055625 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdae0a68-5931-477b-93d9-787e488dbadc tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15', 'iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:54:57.055625 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-cdae0a68-5931-477b-93d9-787e488dbadc tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:54:57.055625 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-cdae0a68-5931-477b-93d9-787e488dbadc tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:54:57.055625 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdae0a68-5931-477b-93d9-787e488dbadc tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15', 'iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:54:57.056487 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdae0a68-5931-477b-93d9-787e488dbadc tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:54:57.087222 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdae0a68-5931-477b-93d9-787e488dbadc tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:54:57.087222 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:54:57.087222 np0000001583 nova-compute[98241]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15 (non-flash)
May 28 01:54:57.087222 np0000001583 nova-compute[98241]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15 (non-flash)
May 28 01:54:57.087222 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:54:57.087222 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdae0a68-5931-477b-93d9-787e488dbadc tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] iscsi session list stdout=tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:54:57.087222 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:54:57.087222 np0000001583 nova-compute[98241]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15 (non-flash)
May 28 01:54:57.087222 np0000001583 nova-compute[98241]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15 (non-flash)
May 28 01:54:57.087222 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:54:57.087222 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdae0a68-5931-477b-93d9-787e488dbadc tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15', '32'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15', '33')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:54:57.087222 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdae0a68-5931-477b-93d9-787e488dbadc tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15', '33')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:54:57.087789 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdae0a68-5931-477b-93d9-787e488dbadc tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15', '32')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:54:57.088826 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdae0a68-5931-477b-93d9-787e488dbadc tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f8460040>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15'): ({'sdb'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:54:57.090066 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-cdae0a68-5931-477b-93d9-787e488dbadc tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Removing multipathed devices sdc, sdb {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:54:57.090066 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-cdae0a68-5931-477b-93d9-787e488dbadc tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Flush multipath device 3300000007f4816eb {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:54:57.126003 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-cdae0a68-5931-477b-93d9-787e488dbadc tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:54:57.168966 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-cdae0a68-5931-477b-93d9-787e488dbadc tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:54:57.214488 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-cdae0a68-5931-477b-93d9-787e488dbadc tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:54:57.214698 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-cdae0a68-5931-477b-93d9-787e488dbadc tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:54:57.215930 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-cdae0a68-5931-477b-93d9-787e488dbadc tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:54:57.230834 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-cdae0a68-5931-477b-93d9-787e488dbadc tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:54:57.234110 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdae0a68-5931-477b-93d9-787e488dbadc tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:54:57.248455 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdae0a68-5931-477b-93d9-787e488dbadc tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:54:57.276833 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdae0a68-5931-477b-93d9-787e488dbadc tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15, portal: 192.168.40.100,3260]
May 28 01:54:57.276833 np0000001583 nova-compute[98241]: Logout of [sid: 33, target: iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15, portal: 192.168.40.100,3260] successful.
May 28 01:54:57.276833 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:54:57.285892 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c3ee381b-5de9-4563-888c-7b5427cfa9c5 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.185s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:57.292073 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdae0a68-5931-477b-93d9-787e488dbadc tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:54:57.308269 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdae0a68-5931-477b-93d9-787e488dbadc tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:54:57.344443 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdae0a68-5931-477b-93d9-787e488dbadc tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15, portal: 192.168.50.100,3260]
May 28 01:54:57.344443 np0000001583 nova-compute[98241]: Logout of [sid: 32, target: iqn.2023-03.storpool.com:os--volume-df1ba0c2-a3a4-437d-97c9-acb6a8ebaf15, portal: 192.168.50.100,3260] successful.
May 28 01:54:57.344443 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:54:57.359124 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdae0a68-5931-477b-93d9-787e488dbadc tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:54:57.359378 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-cdae0a68-5931-477b-93d9-787e488dbadc tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:54:57.359526 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdae0a68-5931-477b-93d9-787e488dbadc tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] <== disconnect_volume: return (304ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:54:57.359669 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdae0a68-5931-477b-93d9-787e488dbadc tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:54:57.489122 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-28e60d25-0be3-4584-b3a7-5981bbb71f5a tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Acquiring lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:57.489540 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-28e60d25-0be3-4584-b3a7-5981bbb71f5a tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:57.489583 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-28e60d25-0be3-4584-b3a7-5981bbb71f5a tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Acquiring lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:57.489863 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-28e60d25-0be3-4584-b3a7-5981bbb71f5a tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:57.489863 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-28e60d25-0be3-4584-b3a7-5981bbb71f5a tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:57.495307 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-28e60d25-0be3-4584-b3a7-5981bbb71f5a tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Terminating instance
May 28 01:54:57.501170 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-40625f2c-47ca-4228-bc61-2237aed4f888 req-16d274f3-4ba7-48e0-b076-388ce353e86c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:54:57.625649 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Successfully updated port: 766c9d77-3578-4071-b0eb-f2a929ee0445 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:54:57.639350 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-40625f2c-47ca-4228-bc61-2237aed4f888 req-16d274f3-4ba7-48e0-b076-388ce353e86c service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:54:57.800652 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-40625f2c-47ca-4228-bc61-2237aed4f888 req-16d274f3-4ba7-48e0-b076-388ce353e86c service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:54:57.845525 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "533f5dcc-2e48-4280-84b3-facb02dea136" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:57.847556 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "533f5dcc-2e48-4280-84b3-facb02dea136" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:57.877763 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:57.925799 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-cdae0a68-5931-477b-93d9-787e488dbadc tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Lazy-loading 'flavor' on Instance uuid e73ac672-0911-4e4d-8a85-9b635a9e836f {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:54:58.003828 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-28e60d25-0be3-4584-b3a7-5981bbb71f5a tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:54:58.024034 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:58.054713 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:58.082344 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:58.209447 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:58.304428 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-40625f2c-47ca-4228-bc61-2237aed4f888 req-16d274f3-4ba7-48e0-b076-388ce353e86c service nova] Releasing lock "refresh_cache-0cca8054-2a26-436f-93b8-ef28e452bd65" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:54:58.313942 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:58.340568 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999755426000092 future=<Future at 0x7724f816f740 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:54:58.341121 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.998778133000087 future=<Future at 0x7724f816f740 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:54:58.341265 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.998598313000002 future=<Future at 0x7724f816f740 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:54:58.345055 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Instance destroyed successfully.
May 28 01:54:58.346639 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-28e60d25-0be3-4584-b3a7-5981bbb71f5a tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lazy-loading 'resources' on Instance uuid adfbfdf0-7c0f-4834-92ff-3b8d8c39e333 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:54:58.356700 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:58.356700 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:54:58.365338 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:58.386107 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:58.720280 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:54:58.720728 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:54:58.770217 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:58.780392 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:58.783615 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:58.810711 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:58.819574 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:58.864607 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-28e60d25-0be3-4584-b3a7-5981bbb71f5a tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T01:52:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1548147209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-attachvolumeshelvetestjson-server-1548147209',id=9,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJwrMRD5wxwugzv1AEW5/hAzhH1YG3g6YQRM7Gj02COrqoTMUwOT7Qvj1PHahHsueYMlw286AH6SOiqmQpBGgCrC9ZUpIHXzJIpstHW4gbgJg8NYW8F6fN/ppNzWYnxsQ==',key_name='tempest-keypair-1047928115',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:54:16Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d31342458ec4ed2890a766f62facbcf',ramdisk_id='',reservation_id='r-ciexyebb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1906404591',owner_user_name='tempest-AttachVolumeShelveTestJSON-1906404591-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:54:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='312a198f7d3d4ce9b586d8f36cf58f76',uuid=adfbfdf0-7c0f-4834-92ff-3b8d8c39e333,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "828d441a-570b-4f98-b093-4eb521ee2cf8", "address": "fa:16:3e:f5:ed:7d", "network": {"id": "34ab0ff0-75dd-45e7-97f6-22f8e62a8149", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1222751470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d31342458ec4ed2890a766f62facbcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap828d441a-57", "ovs_interfaceid": "828d441a-570b-4f98-b093-4eb521ee2cf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:54:58.864800 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-28e60d25-0be3-4584-b3a7-5981bbb71f5a tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Converting VIF {"id": "828d441a-570b-4f98-b093-4eb521ee2cf8", "address": "fa:16:3e:f5:ed:7d", "network": {"id": "34ab0ff0-75dd-45e7-97f6-22f8e62a8149", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1222751470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d31342458ec4ed2890a766f62facbcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap828d441a-57", "ovs_interfaceid": "828d441a-570b-4f98-b093-4eb521ee2cf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:54:58.865844 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-28e60d25-0be3-4584-b3a7-5981bbb71f5a tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ed:7d,bridge_name='br-int',has_traffic_filtering=True,id=828d441a-570b-4f98-b093-4eb521ee2cf8,network=Network(34ab0ff0-75dd-45e7-97f6-22f8e62a8149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap828d441a-57') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:54:58.866088 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-28e60d25-0be3-4584-b3a7-5981bbb71f5a tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ed:7d,bridge_name='br-int',has_traffic_filtering=True,id=828d441a-570b-4f98-b093-4eb521ee2cf8,network=Network(34ab0ff0-75dd-45e7-97f6-22f8e62a8149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap828d441a-57') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:54:58.872324 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:58.872407 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap828d441a-57, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:54:58.878057 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:58.878057 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:54:58.878057 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:58.878623 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:58.878623 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a38f5b3f-87be-468d-98f1-c094f40319e7) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:54:58.883527 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Successfully updated port: d868b893-10e8-42d1-872f-bf4b9e8d3659 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:54:58.884865 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:54:58.887194 np0000001583 nova-compute[98241]: INFO os_vif [None req-28e60d25-0be3-4584-b3a7-5981bbb71f5a tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ed:7d,bridge_name='br-int',has_traffic_filtering=True,id=828d441a-570b-4f98-b093-4eb521ee2cf8,network=Network(34ab0ff0-75dd-45e7-97f6-22f8e62a8149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap828d441a-57')
May 28 01:54:58.888528 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-28e60d25-0be3-4584-b3a7-5981bbb71f5a tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Deleting instance files /opt/stack/data/nova/instances/adfbfdf0-7c0f-4834-92ff-3b8d8c39e333_del
May 28 01:54:58.897271 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-28e60d25-0be3-4584-b3a7-5981bbb71f5a tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Deletion of /opt/stack/data/nova/instances/adfbfdf0-7c0f-4834-92ff-3b8d8c39e333_del complete
May 28 01:54:58.921738 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:58.923841 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:58.931813 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:58.945246 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:54:58.964228 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-868d8693-6b2a-4e20-b257-985161ec5b52 req-d8146447-81f1-439c-b611-778d639c05e2 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-changed-d868b893-10e8-42d1-872f-bf4b9e8d3659 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:54:58.964751 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-868d8693-6b2a-4e20-b257-985161ec5b52 req-d8146447-81f1-439c-b611-778d639c05e2 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Refreshing instance network info cache due to event network-changed-d868b893-10e8-42d1-872f-bf4b9e8d3659. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:54:58.964751 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-868d8693-6b2a-4e20-b257-985161ec5b52 req-d8146447-81f1-439c-b611-778d639c05e2 service nova] Acquiring lock "refresh_cache-0cca8054-2a26-436f-93b8-ef28e452bd65" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:54:58.964751 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-868d8693-6b2a-4e20-b257-985161ec5b52 req-d8146447-81f1-439c-b611-778d639c05e2 service nova] Acquired lock "refresh_cache-0cca8054-2a26-436f-93b8-ef28e452bd65" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:54:58.964751 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-868d8693-6b2a-4e20-b257-985161ec5b52 req-d8146447-81f1-439c-b611-778d639c05e2 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Refreshing network info cache for port d868b893-10e8-42d1-872f-bf4b9e8d3659 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:54:59.087799 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ee9c479b-0e71-4068-8ee0-030c63102494 req-d1fa901b-912e-4ca2-8dd1-c548ad6feea5 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-changed-766c9d77-3578-4071-b0eb-f2a929ee0445 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:54:59.087799 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ee9c479b-0e71-4068-8ee0-030c63102494 req-d1fa901b-912e-4ca2-8dd1-c548ad6feea5 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Refreshing instance network info cache due to event network-changed-766c9d77-3578-4071-b0eb-f2a929ee0445. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:54:59.087799 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ee9c479b-0e71-4068-8ee0-030c63102494 req-d1fa901b-912e-4ca2-8dd1-c548ad6feea5 service nova] Acquiring lock "refresh_cache-0cca8054-2a26-436f-93b8-ef28e452bd65" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:54:59.180356 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4a1856a2-e351-40ce-bfe6-f7cb16a61687 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Acquiring lock "interface-e73ac672-0911-4e4d-8a85-9b635a9e836f-0af5589b-ed4a-40e6-b1f9-1e52f80285b9" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:54:59.180520 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4a1856a2-e351-40ce-bfe6-f7cb16a61687 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Lock "interface-e73ac672-0911-4e4d-8a85-9b635a9e836f-0af5589b-ed4a-40e6-b1f9-1e52f80285b9" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:59.223479 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:54:59.405343 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-28e60d25-0be3-4584-b3a7-5981bbb71f5a tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Took 1.40 seconds to destroy the instance on the hypervisor.
May 28 01:54:59.406821 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-28e60d25-0be3-4584-b3a7-5981bbb71f5a tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:54:59.406976 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:54:59.407058 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:54:59.407299 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:54:59.445014 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-cdae0a68-5931-477b-93d9-787e488dbadc tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Lock "e73ac672-0911-4e4d-8a85-9b635a9e836f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.589s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:59.469894 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-868d8693-6b2a-4e20-b257-985161ec5b52 req-d8146447-81f1-439c-b611-778d639c05e2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:54:59.482983 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:54:59.571481 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-868d8693-6b2a-4e20-b257-985161ec5b52 req-d8146447-81f1-439c-b611-778d639c05e2 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:54:59.685052 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-4a1856a2-e351-40ce-bfe6-f7cb16a61687 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Lazy-loading 'flavor' on Instance uuid e73ac672-0911-4e4d-8a85-9b635a9e836f {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:54:59.733744 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.726s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:54:59.734363 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:54:59.740986 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.808s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:54:59.743126 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:54:59.743517 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Claim successful on node np0000001583
May 28 01:54:59.788614 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-868d8693-6b2a-4e20-b257-985161ec5b52 req-d8146447-81f1-439c-b611-778d639c05e2 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:55:00.004549 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-11267c63-0c58-4be0-9277-9ad394e3d172 req-51ea0ebe-d807-4152-aaed-3271add3b672 service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Received event network-vif-deleted-828d441a-570b-4f98-b093-4eb521ee2cf8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:00.004762 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-11267c63-0c58-4be0-9277-9ad394e3d172 req-51ea0ebe-d807-4152-aaed-3271add3b672 service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Neutron deleted interface 828d441a-570b-4f98-b093-4eb521ee2cf8; detaching it from the instance and deleting it from the info cache
May 28 01:55:00.006757 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-11267c63-0c58-4be0-9277-9ad394e3d172 req-51ea0ebe-d807-4152-aaed-3271add3b672 service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Detach interface failed, port_id=828d441a-570b-4f98-b093-4eb521ee2cf8, reason: Instance adfbfdf0-7c0f-4834-92ff-3b8d8c39e333 could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:55:00.061503 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Successfully updated port: 9ca5546d-4b44-4470-92d7-08800876e89b {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:55:00.190471 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-4a1856a2-e351-40ce-bfe6-f7cb16a61687 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:53:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2127810450',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-device-tagging-server-2127810450',id=11,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOgLraTEi6SiWvo5jslayVOBAKtkEEjh1jVuNw35Hn8cUQoGuB8wzuMiOMlFTlRtSvwVvTOnGa8VK88dE01Yrnrej50o+Hw4uQhAmKYoDt2ubT7eWDD6mkiN/JuIg389w==',key_name='tempest-keypair-1856182923',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:53:54Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='02ba6b7c1fd84a7c8ed4e9f086f83fa0',ramdisk_id='',reservation_id='r-htc032mq',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1060566416',owner_user_name='tempest-TaggedAttachmentsTest-1060566416-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:53:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8df1e628989946dbafa89116b196c65b',uuid=e73ac672-0911-4e4d-8a85-9b635a9e836f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0af5589b-ed4a-40e6-b1f9-1e52f80285b9", "address": "fa:16:3e:07:0c:64", "network": {"id": "d6da1280-87e1-42bb-b434-c401417302e8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1261237232", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "02ba6b7c1fd84a7c8ed4e9f086f83fa0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0af5589b-ed", "ovs_interfaceid": "0af5589b-ed4a-40e6-b1f9-1e52f80285b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:55:00.190695 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-4a1856a2-e351-40ce-bfe6-f7cb16a61687 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Converting VIF {"id": "0af5589b-ed4a-40e6-b1f9-1e52f80285b9", "address": "fa:16:3e:07:0c:64", "network": {"id": "d6da1280-87e1-42bb-b434-c401417302e8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1261237232", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "02ba6b7c1fd84a7c8ed4e9f086f83fa0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0af5589b-ed", "ovs_interfaceid": "0af5589b-ed4a-40e6-b1f9-1e52f80285b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:55:00.191342 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-4a1856a2-e351-40ce-bfe6-f7cb16a61687 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:0c:64,bridge_name='br-int',has_traffic_filtering=True,id=0af5589b-ed4a-40e6-b1f9-1e52f80285b9,network=Network(d6da1280-87e1-42bb-b434-c401417302e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0af5589b-ed') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:55:00.193185 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-4a1856a2-e351-40ce-bfe6-f7cb16a61687 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:07:0c:64"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap0af5589b-ed"/></interface> {{(pid=98241) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 28 01:55:00.194317 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-4a1856a2-e351-40ce-bfe6-f7cb16a61687 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:07:0c:64"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap0af5589b-ed"/></interface> {{(pid=98241) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 28 01:55:00.195545 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4a1856a2-e351-40ce-bfe6-f7cb16a61687 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Attempting to detach device tap0af5589b-ed from instance e73ac672-0911-4e4d-8a85-9b635a9e836f from the persistent domain config. {{(pid=98241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 01:55:00.195751 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-4a1856a2-e351-40ce-bfe6-f7cb16a61687 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] detach device xml: <interface type="ethernet">
May 28 01:55:00.195751 np0000001583 nova-compute[98241]:   <mac address="fa:16:3e:07:0c:64"/>
May 28 01:55:00.195751 np0000001583 nova-compute[98241]:   <model type="virtio"/>
May 28 01:55:00.195751 np0000001583 nova-compute[98241]:   <driver name="qemu"/>
May 28 01:55:00.195751 np0000001583 nova-compute[98241]:   <mtu size="1372"/>
May 28 01:55:00.195751 np0000001583 nova-compute[98241]:   <target dev="tap0af5589b-ed"/>
May 28 01:55:00.195751 np0000001583 nova-compute[98241]: </interface>
May 28 01:55:00.195751 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:55:00.199822 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-4a1856a2-e351-40ce-bfe6-f7cb16a61687 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:07:0c:64"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap0af5589b-ed"/></interface> {{(pid=98241) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 28 01:55:00.201724 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-4a1856a2-e351-40ce-bfe6-f7cb16a61687 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:07:0c:64"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap0af5589b-ed"/></interface>not found in domain: <domain type='qemu' id='11'>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:   <name>instance-0000000b</name>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:   <uuid>e73ac672-0911-4e4d-8a85-9b635a9e836f</uuid>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:   <nova:package version="33.1.0"/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:   <nova:name>tempest-device-tagging-server-2127810450</nova:name>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:   <nova:creationTime>2026-05-28 01:54:41</nova:creationTime>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:   <nova:flavor name="m1.nano" id="42">
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     <nova:memory>192</nova:memory>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     <nova:disk>1</nova:disk>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     <nova:swap>0</nova:swap>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     <nova:ephemeral>0</nova:ephemeral>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     <nova:vcpus>1</nova:vcpus>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     <nova:extraSpecs>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     </nova:extraSpecs>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:   </nova:flavor>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:   <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     <nova:containerFormat>bare</nova:containerFormat>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     <nova:minDisk>1</nova:minDisk>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     <nova:minRam>0</nova:minRam>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     <nova:properties>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <nova:property name="hw_machine_type">pc</nova:property>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <nova:property name="hw_video_model">virtio</nova:property>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     </nova:properties>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:   </nova:image>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:   <nova:owner>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     <nova:user uuid="8df1e628989946dbafa89116b196c65b">tempest-TaggedAttachmentsTest-1060566416-project-member</nova:user>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     <nova:project uuid="02ba6b7c1fd84a7c8ed4e9f086f83fa0">tempest-TaggedAttachmentsTest-1060566416</nova:project>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:   </nova:owner>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:   <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:   <nova:ports>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     <nova:port uuid="ae1eb56b-d3c2-441b-9339-b2d96192924c">
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     </nova:port>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     <nova:port uuid="0af5589b-ed4a-40e6-b1f9-1e52f80285b9">
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <nova:ip type="fixed" address="10.10.10.226" ipVersion="4"/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     </nova:port>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:   </nova:ports>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]: </nova:instance>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:   <memory unit='KiB'>196608</memory>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:   <currentMemory unit='KiB'>196608</currentMemory>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:   <vcpu placement='static'>1</vcpu>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:   <resource>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     <partition>/machine</partition>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:   </resource>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:   <sysinfo type='smbios'>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     <system>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <entry name='product'>OpenStack Nova</entry>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <entry name='version'>33.1.0</entry>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <entry name='serial'>e73ac672-0911-4e4d-8a85-9b635a9e836f</entry>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <entry name='uuid'>e73ac672-0911-4e4d-8a85-9b635a9e836f</entry>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <entry name='family'>Virtual Machine</entry>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     </system>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:   <os>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     <boot dev='hd'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     <smbios mode='sysinfo'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:   </os>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:   <features>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     <vmcoreinfo state='on'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <tb-cache unit='KiB'>131072</tb-cache>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:   </features>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:   <cpu mode='custom' match='exact' check='full'>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     <model fallback='forbid'>Nehalem</model>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     <feature policy='require' name='hypervisor'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:   <clock offset='utc'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:   <on_poweroff>destroy</on_poweroff>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:   <on_reboot>restart</on_reboot>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:   <on_crash>destroy</on_crash>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:   <devices>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     <disk type='file' device='disk'>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <driver name='qemu' type='qcow2' cache='none'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <source file='/opt/stack/data/nova/instances/e73ac672-0911-4e4d-8a85-9b635a9e836f/disk' index='2'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <backingStore type='file' index='3'>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:         <format type='raw'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:         <source file='/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:         <backingStore/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       </backingStore>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <target dev='vda' bus='virtio'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <alias name='virtio-disk0'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     </disk>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     <disk type='file' device='cdrom'>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <driver name='qemu' type='raw' cache='none'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <source file='/opt/stack/data/nova/instances/e73ac672-0911-4e4d-8a85-9b635a9e836f/disk.config' index='1'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <backingStore/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <target dev='hda' bus='ide'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <readonly/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <alias name='ide0-0-0'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     </disk>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     <controller type='usb' index='0' model='none'>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <alias name='usb'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     </controller>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     <controller type='pci' index='0' model='pci-root'>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <alias name='pci.0'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     </controller>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     <controller type='ide' index='0'>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <alias name='ide'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     </controller>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     <interface type='ethernet'>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <mac address='fa:16:3e:ca:36:a6'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <target dev='tapae1eb56b-d3'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <model type='virtio'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <driver name='qemu'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <mtu size='1372'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <alias name='net0'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     </interface>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     <interface type='ethernet'>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <mac address='fa:16:3e:07:0c:64'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <target dev='tap0af5589b-ed'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <model type='virtio'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <driver name='qemu'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <mtu size='1372'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <alias name='net1'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     </interface>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     <serial type='pty'>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <source path='/dev/pts/0'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <log file='/opt/stack/data/nova/instances/e73ac672-0911-4e4d-8a85-9b635a9e836f/console.log' append='off'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <target type='isa-serial' port='0'>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:         <model name='isa-serial'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       </target>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <alias name='serial0'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     </serial>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     <console type='pty' tty='/dev/pts/0'>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <source path='/dev/pts/0'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <log file='/opt/stack/data/nova/instances/e73ac672-0911-4e4d-8a85-9b635a9e836f/console.log' append='off'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <target type='serial' port='0'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <alias name='serial0'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     </console>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     <input type='mouse' bus='ps2'>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <alias name='input0'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     </input>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     <input type='keyboard' bus='ps2'>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <alias name='input1'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     </input>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     <graphics type='vnc' port='5900' autoport='yes' listen='0.0.0.0'>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <listen type='address' address='0.0.0.0'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     </graphics>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     <audio id='1' type='none'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     <video>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <model type='virtio' heads='1' primary='yes'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <alias name='video0'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     </video>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <stats period='10'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <alias name='balloon0'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     <rng model='virtio'>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <backend model='random'>/dev/urandom</backend>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <alias name='rng0'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     </rng>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:   </devices>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     <label>libvirt-e73ac672-0911-4e4d-8a85-9b635a9e836f</label>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     <imagelabel>libvirt-e73ac672-0911-4e4d-8a85-9b635a9e836f</imagelabel>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:   </seclabel>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     <label>+64055:+993</label>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:     <imagelabel>+64055:+993</imagelabel>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:   </seclabel>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]: </domain>
May 28 01:55:00.201724 np0000001583 nova-compute[98241]:  {{(pid=98241) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 28 01:55:00.204738 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-4a1856a2-e351-40ce-bfe6-f7cb16a61687 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Successfully detached device tap0af5589b-ed from instance e73ac672-0911-4e4d-8a85-9b635a9e836f from the persistent domain config.
May 28 01:55:00.204738 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4a1856a2-e351-40ce-bfe6-f7cb16a61687 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] (1/8): Attempting to detach device tap0af5589b-ed with device alias net1 from instance e73ac672-0911-4e4d-8a85-9b635a9e836f from the live domain config. {{(pid=98241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 01:55:00.204738 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-4a1856a2-e351-40ce-bfe6-f7cb16a61687 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] detach device xml: <interface type="ethernet">
May 28 01:55:00.204738 np0000001583 nova-compute[98241]:   <mac address="fa:16:3e:07:0c:64"/>
May 28 01:55:00.204738 np0000001583 nova-compute[98241]:   <model type="virtio"/>
May 28 01:55:00.204738 np0000001583 nova-compute[98241]:   <driver name="qemu"/>
May 28 01:55:00.204738 np0000001583 nova-compute[98241]:   <mtu size="1372"/>
May 28 01:55:00.204738 np0000001583 nova-compute[98241]:   <target dev="tap0af5589b-ed"/>
May 28 01:55:00.204738 np0000001583 nova-compute[98241]: </interface>
May 28 01:55:00.204738 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:55:00.240845 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:55:00.241584 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:55:00.241924 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:00.242215 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:00.290420 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-868d8693-6b2a-4e20-b257-985161ec5b52 req-d8146447-81f1-439c-b611-778d639c05e2 service nova] Releasing lock "refresh_cache-0cca8054-2a26-436f-93b8-ef28e452bd65" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:55:00.293338 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ee9c479b-0e71-4068-8ee0-030c63102494 req-d1fa901b-912e-4ca2-8dd1-c548ad6feea5 service nova] Acquired lock "refresh_cache-0cca8054-2a26-436f-93b8-ef28e452bd65" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:55:00.293699 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-ee9c479b-0e71-4068-8ee0-030c63102494 req-d1fa901b-912e-4ca2-8dd1-c548ad6feea5 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Refreshing network info cache for port 766c9d77-3578-4071-b0eb-f2a929ee0445 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:55:00.344975 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Acquiring lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:00.345567 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:00.356615 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c9dd13ea0f744864b4c48f99b39b6436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c32da4f768f48179b4be0509a25a704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:55:00.439650 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:55:00.563645 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Acquiring lock "refresh_cache-0cca8054-2a26-436f-93b8-ef28e452bd65" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:55:00.746507 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:55:00.797085 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-ee9c479b-0e71-4068-8ee0-030c63102494 req-d1fa901b-912e-4ca2-8dd1-c548ad6feea5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:00.847812 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:55:00.883123 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Successfully created port: 2ab83417-6d0d-4eb5-a96a-398a30c193d2 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:55:00.914069 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-ee9c479b-0e71-4068-8ee0-030c63102494 req-d1fa901b-912e-4ca2-8dd1-c548ad6feea5 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:55:00.941581 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Took 1.53 seconds to deallocate network for instance.
May 28 01:55:01.102290 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-ee9c479b-0e71-4068-8ee0-030c63102494 req-d1fa901b-912e-4ca2-8dd1-c548ad6feea5 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:55:01.200633 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f7f1cd54-d7fd-4687-a46b-5f0dfcbf3369 req-94aac93c-c719-42ff-83e4-d1ceea48c63e service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Received event network-vif-plugged-828d441a-570b-4f98-b093-4eb521ee2cf8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:01.200808 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f7f1cd54-d7fd-4687-a46b-5f0dfcbf3369 req-94aac93c-c719-42ff-83e4-d1ceea48c63e service nova] Acquiring lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:01.202036 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f7f1cd54-d7fd-4687-a46b-5f0dfcbf3369 req-94aac93c-c719-42ff-83e4-d1ceea48c63e service nova] Lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:01.202036 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f7f1cd54-d7fd-4687-a46b-5f0dfcbf3369 req-94aac93c-c719-42ff-83e4-d1ceea48c63e service nova] Lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:01.202036 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f7f1cd54-d7fd-4687-a46b-5f0dfcbf3369 req-94aac93c-c719-42ff-83e4-d1ceea48c63e service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] No waiting events found dispatching network-vif-plugged-828d441a-570b-4f98-b093-4eb521ee2cf8 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:55:01.202036 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-f7f1cd54-d7fd-4687-a46b-5f0dfcbf3369 req-94aac93c-c719-42ff-83e4-d1ceea48c63e service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Received unexpected event network-vif-plugged-828d441a-570b-4f98-b093-4eb521ee2cf8 for instance with vm_state deleted and task_state None.
May 28 01:55:01.202036 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f7f1cd54-d7fd-4687-a46b-5f0dfcbf3369 req-94aac93c-c719-42ff-83e4-d1ceea48c63e service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Received event network-vif-unplugged-828d441a-570b-4f98-b093-4eb521ee2cf8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:01.202036 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f7f1cd54-d7fd-4687-a46b-5f0dfcbf3369 req-94aac93c-c719-42ff-83e4-d1ceea48c63e service nova] Acquiring lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:01.202036 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f7f1cd54-d7fd-4687-a46b-5f0dfcbf3369 req-94aac93c-c719-42ff-83e4-d1ceea48c63e service nova] Lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:01.202036 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f7f1cd54-d7fd-4687-a46b-5f0dfcbf3369 req-94aac93c-c719-42ff-83e4-d1ceea48c63e service nova] Lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:01.202036 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f7f1cd54-d7fd-4687-a46b-5f0dfcbf3369 req-94aac93c-c719-42ff-83e4-d1ceea48c63e service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] No waiting events found dispatching network-vif-unplugged-828d441a-570b-4f98-b093-4eb521ee2cf8 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:55:01.202036 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-f7f1cd54-d7fd-4687-a46b-5f0dfcbf3369 req-94aac93c-c719-42ff-83e4-d1ceea48c63e service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Received unexpected event network-vif-unplugged-828d441a-570b-4f98-b093-4eb521ee2cf8 for instance with vm_state deleted and task_state None.
May 28 01:55:01.204981 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f7f1cd54-d7fd-4687-a46b-5f0dfcbf3369 req-94aac93c-c719-42ff-83e4-d1ceea48c63e service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Received event network-vif-unplugged-828d441a-570b-4f98-b093-4eb521ee2cf8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:01.210999 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f7f1cd54-d7fd-4687-a46b-5f0dfcbf3369 req-94aac93c-c719-42ff-83e4-d1ceea48c63e service nova] Acquiring lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:01.211294 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f7f1cd54-d7fd-4687-a46b-5f0dfcbf3369 req-94aac93c-c719-42ff-83e4-d1ceea48c63e service nova] Lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:01.211482 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f7f1cd54-d7fd-4687-a46b-5f0dfcbf3369 req-94aac93c-c719-42ff-83e4-d1ceea48c63e service nova] Lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:01.211745 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f7f1cd54-d7fd-4687-a46b-5f0dfcbf3369 req-94aac93c-c719-42ff-83e4-d1ceea48c63e service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] No waiting events found dispatching network-vif-unplugged-828d441a-570b-4f98-b093-4eb521ee2cf8 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:55:01.213316 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-f7f1cd54-d7fd-4687-a46b-5f0dfcbf3369 req-94aac93c-c719-42ff-83e4-d1ceea48c63e service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Received unexpected event network-vif-unplugged-828d441a-570b-4f98-b093-4eb521ee2cf8 for instance with vm_state deleted and task_state None.
May 28 01:55:01.213316 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f7f1cd54-d7fd-4687-a46b-5f0dfcbf3369 req-94aac93c-c719-42ff-83e4-d1ceea48c63e service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-changed-9ca5546d-4b44-4470-92d7-08800876e89b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:01.213468 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f7f1cd54-d7fd-4687-a46b-5f0dfcbf3369 req-94aac93c-c719-42ff-83e4-d1ceea48c63e service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Refreshing instance network info cache due to event network-changed-9ca5546d-4b44-4470-92d7-08800876e89b. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:55:01.213522 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f7f1cd54-d7fd-4687-a46b-5f0dfcbf3369 req-94aac93c-c719-42ff-83e4-d1ceea48c63e service nova] Acquiring lock "refresh_cache-0cca8054-2a26-436f-93b8-ef28e452bd65" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:55:01.249469 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:55:01.288332 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:01.289682 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:01.304960 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Received event <DeviceRemovedEvent: 1779933301.3045316, e73ac672-0911-4e4d-8a85-9b635a9e836f => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=98241) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 01:55:01.309643 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4a1856a2-e351-40ce-bfe6-f7cb16a61687 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Start waiting for the detach event from libvirt for device tap0af5589b-ed with device alias net1 for instance e73ac672-0911-4e4d-8a85-9b635a9e836f {{(pid=98241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 01:55:01.310020 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-4a1856a2-e351-40ce-bfe6-f7cb16a61687 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:07:0c:64"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap0af5589b-ed"/></interface> {{(pid=98241) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 28 01:55:01.311839 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:01.316689 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-4a1856a2-e351-40ce-bfe6-f7cb16a61687 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:07:0c:64"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap0af5589b-ed"/></interface>not found in domain: <domain type='qemu' id='11'>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:   <name>instance-0000000b</name>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:   <uuid>e73ac672-0911-4e4d-8a85-9b635a9e836f</uuid>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:   <nova:package version="33.1.0"/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:   <nova:name>tempest-device-tagging-server-2127810450</nova:name>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:   <nova:creationTime>2026-05-28 01:54:41</nova:creationTime>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:   <nova:flavor name="m1.nano" id="42">
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     <nova:memory>192</nova:memory>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     <nova:disk>1</nova:disk>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     <nova:swap>0</nova:swap>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     <nova:ephemeral>0</nova:ephemeral>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     <nova:vcpus>1</nova:vcpus>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     <nova:extraSpecs>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     </nova:extraSpecs>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:   </nova:flavor>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:   <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     <nova:containerFormat>bare</nova:containerFormat>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     <nova:minDisk>1</nova:minDisk>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     <nova:minRam>0</nova:minRam>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     <nova:properties>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <nova:property name="hw_machine_type">pc</nova:property>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <nova:property name="hw_video_model">virtio</nova:property>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     </nova:properties>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:   </nova:image>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:   <nova:owner>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     <nova:user uuid="8df1e628989946dbafa89116b196c65b">tempest-TaggedAttachmentsTest-1060566416-project-member</nova:user>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     <nova:project uuid="02ba6b7c1fd84a7c8ed4e9f086f83fa0">tempest-TaggedAttachmentsTest-1060566416</nova:project>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:   </nova:owner>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:   <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:   <nova:ports>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     <nova:port uuid="ae1eb56b-d3c2-441b-9339-b2d96192924c">
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     </nova:port>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     <nova:port uuid="0af5589b-ed4a-40e6-b1f9-1e52f80285b9">
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <nova:ip type="fixed" address="10.10.10.226" ipVersion="4"/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     </nova:port>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:   </nova:ports>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]: </nova:instance>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:   <memory unit='KiB'>196608</memory>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:   <currentMemory unit='KiB'>196608</currentMemory>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:   <vcpu placement='static'>1</vcpu>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:   <resource>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     <partition>/machine</partition>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:   </resource>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:   <sysinfo type='smbios'>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     <system>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <entry name='product'>OpenStack Nova</entry>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <entry name='version'>33.1.0</entry>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <entry name='serial'>e73ac672-0911-4e4d-8a85-9b635a9e836f</entry>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <entry name='uuid'>e73ac672-0911-4e4d-8a85-9b635a9e836f</entry>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <entry name='family'>Virtual Machine</entry>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     </system>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:   <os>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     <boot dev='hd'/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     <smbios mode='sysinfo'/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:   </os>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:   <features>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     <vmcoreinfo state='on'/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <tb-cache unit='KiB'>131072</tb-cache>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:   </features>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:   <cpu mode='custom' match='exact' check='full'>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     <model fallback='forbid'>Nehalem</model>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     <feature policy='require' name='hypervisor'/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:   <clock offset='utc'/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:   <on_poweroff>destroy</on_poweroff>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:   <on_reboot>restart</on_reboot>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:   <on_crash>destroy</on_crash>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:   <devices>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     <disk type='file' device='disk'>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <driver name='qemu' type='qcow2' cache='none'/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <source file='/opt/stack/data/nova/instances/e73ac672-0911-4e4d-8a85-9b635a9e836f/disk' index='2'/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <backingStore type='file' index='3'>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:         <format type='raw'/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:         <source file='/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899'/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:         <backingStore/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       </backingStore>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <target dev='vda' bus='virtio'/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <alias name='virtio-disk0'/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     </disk>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     <disk type='file' device='cdrom'>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <driver name='qemu' type='raw' cache='none'/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <source file='/opt/stack/data/nova/instances/e73ac672-0911-4e4d-8a85-9b635a9e836f/disk.config' index='1'/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <backingStore/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <target dev='hda' bus='ide'/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <readonly/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <alias name='ide0-0-0'/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     </disk>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     <controller type='usb' index='0' model='none'>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <alias name='usb'/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     </controller>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     <controller type='pci' index='0' model='pci-root'>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <alias name='pci.0'/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     </controller>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     <controller type='ide' index='0'>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <alias name='ide'/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     </controller>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     <interface type='ethernet'>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <mac address='fa:16:3e:ca:36:a6'/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <target dev='tapae1eb56b-d3'/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <model type='virtio'/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <driver name='qemu'/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <mtu size='1372'/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <alias name='net0'/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     </interface>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     <serial type='pty'>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <source path='/dev/pts/0'/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <log file='/opt/stack/data/nova/instances/e73ac672-0911-4e4d-8a85-9b635a9e836f/console.log' append='off'/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <target type='isa-serial' port='0'>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:         <model name='isa-serial'/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       </target>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <alias name='serial0'/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     </serial>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     <console type='pty' tty='/dev/pts/0'>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <source path='/dev/pts/0'/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <log file='/opt/stack/data/nova/instances/e73ac672-0911-4e4d-8a85-9b635a9e836f/console.log' append='off'/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <target type='serial' port='0'/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <alias name='serial0'/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     </console>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     <input type='mouse' bus='ps2'>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <alias name='input0'/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     </input>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     <input type='keyboard' bus='ps2'>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <alias name='input1'/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     </input>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     <graphics type='vnc' port='5900' autoport='yes' listen='0.0.0.0'>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <listen type='address' address='0.0.0.0'/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     </graphics>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     <audio id='1' type='none'/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     <video>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <model type='virtio' heads='1' primary='yes'/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <alias name='video0'/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     </video>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <stats period='10'/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <alias name='balloon0'/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     <rng model='virtio'>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <backend model='random'>/dev/urandom</backend>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <alias name='rng0'/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     </rng>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:   </devices>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     <label>libvirt-e73ac672-0911-4e4d-8a85-9b635a9e836f</label>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     <imagelabel>libvirt-e73ac672-0911-4e4d-8a85-9b635a9e836f</imagelabel>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:   </seclabel>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     <label>+64055:+993</label>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:     <imagelabel>+64055:+993</imagelabel>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:   </seclabel>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]: </domain>
May 28 01:55:01.316689 np0000001583 nova-compute[98241]:  {{(pid=98241) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 28 01:55:01.327840 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-4a1856a2-e351-40ce-bfe6-f7cb16a61687 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Successfully detached device tap0af5589b-ed from instance e73ac672-0911-4e4d-8a85-9b635a9e836f from the live domain config.
May 28 01:55:01.327840 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-4a1856a2-e351-40ce-bfe6-f7cb16a61687 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:53:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2127810450',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-device-tagging-server-2127810450',id=11,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOgLraTEi6SiWvo5jslayVOBAKtkEEjh1jVuNw35Hn8cUQoGuB8wzuMiOMlFTlRtSvwVvTOnGa8VK88dE01Yrnrej50o+Hw4uQhAmKYoDt2ubT7eWDD6mkiN/JuIg389w==',key_name='tempest-keypair-1856182923',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:53:54Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='02ba6b7c1fd84a7c8ed4e9f086f83fa0',ramdisk_id='',reservation_id='r-htc032mq',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1060566416',owner_user_name='tempest-TaggedAttachmentsTest-1060566416-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:53:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8df1e628989946dbafa89116b196c65b',uuid=e73ac672-0911-4e4d-8a85-9b635a9e836f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0af5589b-ed4a-40e6-b1f9-1e52f80285b9", "address": "fa:16:3e:07:0c:64", "network": {"id": "d6da1280-87e1-42bb-b434-c401417302e8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1261237232", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "02ba6b7c1fd84a7c8ed4e9f086f83fa0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0af5589b-ed", "ovs_interfaceid": "0af5589b-ed4a-40e6-b1f9-1e52f80285b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:55:01.327840 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-4a1856a2-e351-40ce-bfe6-f7cb16a61687 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Converting VIF {"id": "0af5589b-ed4a-40e6-b1f9-1e52f80285b9", "address": "fa:16:3e:07:0c:64", "network": {"id": "d6da1280-87e1-42bb-b434-c401417302e8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1261237232", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "02ba6b7c1fd84a7c8ed4e9f086f83fa0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0af5589b-ed", "ovs_interfaceid": "0af5589b-ed4a-40e6-b1f9-1e52f80285b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:55:01.327840 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-4a1856a2-e351-40ce-bfe6-f7cb16a61687 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:0c:64,bridge_name='br-int',has_traffic_filtering=True,id=0af5589b-ed4a-40e6-b1f9-1e52f80285b9,network=Network(d6da1280-87e1-42bb-b434-c401417302e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0af5589b-ed') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:55:01.327840 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-4a1856a2-e351-40ce-bfe6-f7cb16a61687 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:0c:64,bridge_name='br-int',has_traffic_filtering=True,id=0af5589b-ed4a-40e6-b1f9-1e52f80285b9,network=Network(d6da1280-87e1-42bb-b434-c401417302e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0af5589b-ed') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:55:01.327840 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:01.327840 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0af5589b-ed, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:01.327840 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:01.327840 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:55:01.330338 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:01.335111 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:01.335111 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=999112f6-a2e9-4923-9753-2911df090832) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:01.335111 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:01.335111 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:55:01.357176 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:01.365401 np0000001583 nova-compute[98241]: INFO os_vif [None req-4a1856a2-e351-40ce-bfe6-f7cb16a61687 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:0c:64,bridge_name='br-int',has_traffic_filtering=True,id=0af5589b-ed4a-40e6-b1f9-1e52f80285b9,network=Network(d6da1280-87e1-42bb-b434-c401417302e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0af5589b-ed')
May 28 01:55:01.365609 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-4a1856a2-e351-40ce-bfe6-f7cb16a61687 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-2127810450', uuid='e73ac672-0911-4e4d-8a85-9b635a9e836f'), owner=OwnerMeta(userid='8df1e628989946dbafa89116b196c65b', username='tempest-TaggedAttachmentsTest-1060566416-project-member', projectid='02ba6b7c1fd84a7c8ed4e9f086f83fa0', projectname='tempest-TaggedAttachmentsTest-1060566416'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ae1eb56b-d3c2-441b-9339-b2d96192924c", "address": "fa:16:3e:ca:36:a6", "network": {"id": "a6357868-368f-400d-b8c9-8e8843bdfdda", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1753538248-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "02ba6b7c1fd84a7c8ed4e9f086f83fa0", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae1eb56b-d3", "ovs_interfaceid": "ae1eb56b-d3c2-441b-9339-b2d96192924c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933301.3650458) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:55:01.366827 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-4a1856a2-e351-40ce-bfe6-f7cb16a61687 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:55:01.366827 np0000001583 nova-compute[98241]:   <nova:package version="33.1.0"/>
May 28 01:55:01.366827 np0000001583 nova-compute[98241]:   <nova:name>tempest-device-tagging-server-2127810450</nova:name>
May 28 01:55:01.366827 np0000001583 nova-compute[98241]:   <nova:creationTime>2026-05-28 01:55:01</nova:creationTime>
May 28 01:55:01.366827 np0000001583 nova-compute[98241]:   <nova:flavor name="m1.nano" id="42">
May 28 01:55:01.366827 np0000001583 nova-compute[98241]:     <nova:memory>192</nova:memory>
May 28 01:55:01.366827 np0000001583 nova-compute[98241]:     <nova:disk>1</nova:disk>
May 28 01:55:01.366827 np0000001583 nova-compute[98241]:     <nova:swap>0</nova:swap>
May 28 01:55:01.366827 np0000001583 nova-compute[98241]:     <nova:ephemeral>0</nova:ephemeral>
May 28 01:55:01.366827 np0000001583 nova-compute[98241]:     <nova:vcpus>1</nova:vcpus>
May 28 01:55:01.366827 np0000001583 nova-compute[98241]:     <nova:extraSpecs>
May 28 01:55:01.366827 np0000001583 nova-compute[98241]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:55:01.366827 np0000001583 nova-compute[98241]:     </nova:extraSpecs>
May 28 01:55:01.366827 np0000001583 nova-compute[98241]:   </nova:flavor>
May 28 01:55:01.366827 np0000001583 nova-compute[98241]:   <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 01:55:01.366827 np0000001583 nova-compute[98241]:     <nova:containerFormat>bare</nova:containerFormat>
May 28 01:55:01.366827 np0000001583 nova-compute[98241]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:55:01.366827 np0000001583 nova-compute[98241]:     <nova:minDisk>1</nova:minDisk>
May 28 01:55:01.366827 np0000001583 nova-compute[98241]:     <nova:minRam>0</nova:minRam>
May 28 01:55:01.366827 np0000001583 nova-compute[98241]:     <nova:properties>
May 28 01:55:01.366827 np0000001583 nova-compute[98241]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 01:55:01.366827 np0000001583 nova-compute[98241]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 01:55:01.366827 np0000001583 nova-compute[98241]:       <nova:property name="hw_machine_type">pc</nova:property>
May 28 01:55:01.366827 np0000001583 nova-compute[98241]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:55:01.366827 np0000001583 nova-compute[98241]:       <nova:property name="hw_video_model">virtio</nova:property>
May 28 01:55:01.366827 np0000001583 nova-compute[98241]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 28 01:55:01.366827 np0000001583 nova-compute[98241]:     </nova:properties>
May 28 01:55:01.366827 np0000001583 nova-compute[98241]:   </nova:image>
May 28 01:55:01.366827 np0000001583 nova-compute[98241]:   <nova:owner>
May 28 01:55:01.366827 np0000001583 nova-compute[98241]:     <nova:user uuid="8df1e628989946dbafa89116b196c65b">tempest-TaggedAttachmentsTest-1060566416-project-member</nova:user>
May 28 01:55:01.366827 np0000001583 nova-compute[98241]:     <nova:project uuid="02ba6b7c1fd84a7c8ed4e9f086f83fa0">tempest-TaggedAttachmentsTest-1060566416</nova:project>
May 28 01:55:01.366827 np0000001583 nova-compute[98241]:   </nova:owner>
May 28 01:55:01.366827 np0000001583 nova-compute[98241]:   <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 01:55:01.366827 np0000001583 nova-compute[98241]:   <nova:ports>
May 28 01:55:01.366827 np0000001583 nova-compute[98241]:     <nova:port uuid="ae1eb56b-d3c2-441b-9339-b2d96192924c">
May 28 01:55:01.366827 np0000001583 nova-compute[98241]:       <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 28 01:55:01.366827 np0000001583 nova-compute[98241]:     </nova:port>
May 28 01:55:01.366827 np0000001583 nova-compute[98241]:   </nova:ports>
May 28 01:55:01.366827 np0000001583 nova-compute[98241]: </nova:instance>
May 28 01:55:01.366827 np0000001583 nova-compute[98241]:  {{(pid=98241) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}}
May 28 01:55:01.370103 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-4a1856a2-e351-40ce-bfe6-f7cb16a61687 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:01.370103 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-4a1856a2-e351-40ce-bfe6-f7cb16a61687 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:01.454217 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-28e60d25-0be3-4584-b3a7-5981bbb71f5a tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:01.458884 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:01.607627 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ee9c479b-0e71-4068-8ee0-030c63102494 req-d1fa901b-912e-4ca2-8dd1-c548ad6feea5 service nova] Releasing lock "refresh_cache-0cca8054-2a26-436f-93b8-ef28e452bd65" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:55:01.607893 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ee9c479b-0e71-4068-8ee0-030c63102494 req-d1fa901b-912e-4ca2-8dd1-c548ad6feea5 service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Received event network-vif-unplugged-828d441a-570b-4f98-b093-4eb521ee2cf8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:01.608092 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ee9c479b-0e71-4068-8ee0-030c63102494 req-d1fa901b-912e-4ca2-8dd1-c548ad6feea5 service nova] Acquiring lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:01.608327 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ee9c479b-0e71-4068-8ee0-030c63102494 req-d1fa901b-912e-4ca2-8dd1-c548ad6feea5 service nova] Lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:01.608490 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ee9c479b-0e71-4068-8ee0-030c63102494 req-d1fa901b-912e-4ca2-8dd1-c548ad6feea5 service nova] Lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:01.608652 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ee9c479b-0e71-4068-8ee0-030c63102494 req-d1fa901b-912e-4ca2-8dd1-c548ad6feea5 service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] No waiting events found dispatching network-vif-unplugged-828d441a-570b-4f98-b093-4eb521ee2cf8 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:55:01.608808 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ee9c479b-0e71-4068-8ee0-030c63102494 req-d1fa901b-912e-4ca2-8dd1-c548ad6feea5 service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Received event network-vif-unplugged-828d441a-570b-4f98-b093-4eb521ee2cf8 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:55:01.608984 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ee9c479b-0e71-4068-8ee0-030c63102494 req-d1fa901b-912e-4ca2-8dd1-c548ad6feea5 service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Received event network-vif-unplugged-828d441a-570b-4f98-b093-4eb521ee2cf8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:01.609207 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ee9c479b-0e71-4068-8ee0-030c63102494 req-d1fa901b-912e-4ca2-8dd1-c548ad6feea5 service nova] Acquiring lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:01.609401 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ee9c479b-0e71-4068-8ee0-030c63102494 req-d1fa901b-912e-4ca2-8dd1-c548ad6feea5 service nova] Lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:01.613558 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ee9c479b-0e71-4068-8ee0-030c63102494 req-d1fa901b-912e-4ca2-8dd1-c548ad6feea5 service nova] Lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:01.613871 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Acquired lock "refresh_cache-0cca8054-2a26-436f-93b8-ef28e452bd65" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:55:01.614204 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ee9c479b-0e71-4068-8ee0-030c63102494 req-d1fa901b-912e-4ca2-8dd1-c548ad6feea5 service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] No waiting events found dispatching network-vif-unplugged-828d441a-570b-4f98-b093-4eb521ee2cf8 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:55:01.614435 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ee9c479b-0e71-4068-8ee0-030c63102494 req-d1fa901b-912e-4ca2-8dd1-c548ad6feea5 service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Received event network-vif-unplugged-828d441a-570b-4f98-b093-4eb521ee2cf8 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:55:01.614637 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ee9c479b-0e71-4068-8ee0-030c63102494 req-d1fa901b-912e-4ca2-8dd1-c548ad6feea5 service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Received event network-vif-plugged-828d441a-570b-4f98-b093-4eb521ee2cf8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:01.614855 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ee9c479b-0e71-4068-8ee0-030c63102494 req-d1fa901b-912e-4ca2-8dd1-c548ad6feea5 service nova] Acquiring lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:01.615040 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ee9c479b-0e71-4068-8ee0-030c63102494 req-d1fa901b-912e-4ca2-8dd1-c548ad6feea5 service nova] Lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:01.615384 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:55:01.619520 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ee9c479b-0e71-4068-8ee0-030c63102494 req-d1fa901b-912e-4ca2-8dd1-c548ad6feea5 service nova] Lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:01.619678 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ee9c479b-0e71-4068-8ee0-030c63102494 req-d1fa901b-912e-4ca2-8dd1-c548ad6feea5 service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] No waiting events found dispatching network-vif-plugged-828d441a-570b-4f98-b093-4eb521ee2cf8 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:55:01.619774 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-ee9c479b-0e71-4068-8ee0-030c63102494 req-d1fa901b-912e-4ca2-8dd1-c548ad6feea5 service nova] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Received unexpected event network-vif-plugged-828d441a-570b-4f98-b093-4eb521ee2cf8 for instance with vm_state active and task_state deleting.
May 28 01:55:01.633941 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:55:01.634611 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:55:01.641121 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Successfully updated port: 2ab83417-6d0d-4eb5-a96a-398a30c193d2 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:55:01.721438 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-823e28f3-e5b1-4992-95e7-ed562d1ef4d4 req-92f07d7c-2466-4827-9100-9918d4160974 service nova] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Received event network-changed-2ab83417-6d0d-4eb5-a96a-398a30c193d2 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:01.721438 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-823e28f3-e5b1-4992-95e7-ed562d1ef4d4 req-92f07d7c-2466-4827-9100-9918d4160974 service nova] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Refreshing instance network info cache due to event network-changed-2ab83417-6d0d-4eb5-a96a-398a30c193d2. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:55:01.723458 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-823e28f3-e5b1-4992-95e7-ed562d1ef4d4 req-92f07d7c-2466-4827-9100-9918d4160974 service nova] Acquiring lock "refresh_cache-d3135bb7-29cf-4819-9e83-1c45211901eb" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:55:01.723692 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-823e28f3-e5b1-4992-95e7-ed562d1ef4d4 req-92f07d7c-2466-4827-9100-9918d4160974 service nova] Acquired lock "refresh_cache-d3135bb7-29cf-4819-9e83-1c45211901eb" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:55:01.723923 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-823e28f3-e5b1-4992-95e7-ed562d1ef4d4 req-92f07d7c-2466-4827-9100-9918d4160974 service nova] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Refreshing network info cache for port 2ab83417-6d0d-4eb5-a96a-398a30c193d2 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:55:02.092952 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ba978802-1832-4137-9014-d801c3c57281 req-d543f106-d9e1-4f5c-9131-75e4616db9c4 service nova] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Received event network-vif-deleted-0af5589b-ed4a-40e6-b1f9-1e52f80285b9 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:02.094044 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-ba978802-1832-4137-9014-d801c3c57281 req-d543f106-d9e1-4f5c-9131-75e4616db9c4 service nova] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Neutron deleted interface 0af5589b-ed4a-40e6-b1f9-1e52f80285b9; detaching it from the instance and deleting it from the info cache
May 28 01:55:02.095001 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [req-ba978802-1832-4137-9014-d801c3c57281 req-d543f106-d9e1-4f5c-9131-75e4616db9c4 service nova] Lazy-loading 'system_metadata' on Instance uuid e73ac672-0911-4e4d-8a85-9b635a9e836f {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:55:02.144789 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:55:02.150429 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Acquiring lock "refresh_cache-d3135bb7-29cf-4819-9e83-1c45211901eb" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:55:02.228253 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-823e28f3-e5b1-4992-95e7-ed562d1ef4d4 req-92f07d7c-2466-4827-9100-9918d4160974 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:02.240143 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:55:02.266034 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:55:02.269152 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:55:02.270938 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Creating image(s)
May 28 01:55:02.271551 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Acquiring lock "/opt/stack/data/nova/instances/d3135bb7-29cf-4819-9e83-1c45211901eb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:02.271772 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Lock "/opt/stack/data/nova/instances/d3135bb7-29cf-4819-9e83-1c45211901eb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:02.274595 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Lock "/opt/stack/data/nova/instances/d3135bb7-29cf-4819-9e83-1c45211901eb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:02.275511 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:55:02.280449 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:55:02.281668 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:02.348053 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-823e28f3-e5b1-4992-95e7-ed562d1ef4d4 req-92f07d7c-2466-4827-9100-9918d4160974 service nova] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:55:02.379773 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.098s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:02.380141 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:02.380606 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:02.381004 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:55:02.384330 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:55:02.384330 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:02.464774 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.080s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:02.466288 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/d3135bb7-29cf-4819-9e83-1c45211901eb/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:02.483836 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:02.521327 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/d3135bb7-29cf-4819-9e83-1c45211901eb/disk 1073741824" returned: 0 in 0.055s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:02.522538 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.142s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:02.523236 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:02.600149 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-823e28f3-e5b1-4992-95e7-ed562d1ef4d4 req-92f07d7c-2466-4827-9100-9918d4160974 service nova] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:55:02.602017 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [req-ba978802-1832-4137-9014-d801c3c57281 req-d543f106-d9e1-4f5c-9131-75e4616db9c4 service nova] Lazy-loading 'flavor' on Instance uuid e73ac672-0911-4e4d-8a85-9b635a9e836f {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:55:02.615836 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.093s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:02.616428 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d3135bb7-29cf-4819-9e83-1c45211901eb/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:55:02.616687 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3135bb7-29cf-4819-9e83-1c45211901eb/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:02.653520 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.913s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:02.655707 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-28e60d25-0be3-4584-b3a7-5981bbb71f5a tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.200s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:02.655707 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:55:02.692704 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3135bb7-29cf-4819-9e83-1c45211901eb/disk --force-share --output=json" returned: 0 in 0.076s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:02.694328 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Cannot resize image /opt/stack/data/nova/instances/d3135bb7-29cf-4819-9e83-1c45211901eb/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:55:02.694328 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:55:02.694328 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Ensure instance console log exists: /opt/stack/data/nova/instances/d3135bb7-29cf-4819-9e83-1c45211901eb/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:55:02.694328 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:02.694328 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:02.694328 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:02.878356 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:02.910873 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:03.104291 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-823e28f3-e5b1-4992-95e7-ed562d1ef4d4 req-92f07d7c-2466-4827-9100-9918d4160974 service nova] Releasing lock "refresh_cache-d3135bb7-29cf-4819-9e83-1c45211901eb" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:55:03.106030 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [req-ba978802-1832-4137-9014-d801c3c57281 req-d543f106-d9e1-4f5c-9131-75e4616db9c4 service nova] Object Instance<e73ac672-0911-4e4d-8a85-9b635a9e836f> lazy-loaded attributes: system_metadata,flavor {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:55:03.106663 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [req-ba978802-1832-4137-9014-d801c3c57281 req-d543f106-d9e1-4f5c-9131-75e4616db9c4 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:53:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2127810450',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-device-tagging-server-2127810450',id=11,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOgLraTEi6SiWvo5jslayVOBAKtkEEjh1jVuNw35Hn8cUQoGuB8wzuMiOMlFTlRtSvwVvTOnGa8VK88dE01Yrnrej50o+Hw4uQhAmKYoDt2ubT7eWDD6mkiN/JuIg389w==',key_name='tempest-keypair-1856182923',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:53:54Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata=<?>,migration_context=None,new_flavor=None,node='np0000001583',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='02ba6b7c1fd84a7c8ed4e9f086f83fa0',ramdisk_id='',reservation_id='r-htc032mq',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1060566416',owner_user_name='tempest-TaggedAttachmentsTest-1060566416-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:53:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8df1e628989946dbafa89116b196c65b',uuid=e73ac672-0911-4e4d-8a85-9b635a9e836f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0af5589b-ed4a-40e6-b1f9-1e52f80285b9", "address": "fa:16:3e:07:0c:64", "network": {"id": "d6da1280-87e1-42bb-b434-c401417302e8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1261237232", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "02ba6b7c1fd84a7c8ed4e9f086f83fa0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0af5589b-ed", "ovs_interfaceid": "0af5589b-ed4a-40e6-b1f9-1e52f80285b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:55:03.106857 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [req-ba978802-1832-4137-9014-d801c3c57281 req-d543f106-d9e1-4f5c-9131-75e4616db9c4 service nova] Converting VIF {"id": "0af5589b-ed4a-40e6-b1f9-1e52f80285b9", "address": "fa:16:3e:07:0c:64", "network": {"id": "d6da1280-87e1-42bb-b434-c401417302e8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1261237232", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "02ba6b7c1fd84a7c8ed4e9f086f83fa0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0af5589b-ed", "ovs_interfaceid": "0af5589b-ed4a-40e6-b1f9-1e52f80285b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:55:03.107446 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [req-ba978802-1832-4137-9014-d801c3c57281 req-d543f106-d9e1-4f5c-9131-75e4616db9c4 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:0c:64,bridge_name='br-int',has_traffic_filtering=True,id=0af5589b-ed4a-40e6-b1f9-1e52f80285b9,network=Network(d6da1280-87e1-42bb-b434-c401417302e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0af5589b-ed') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:55:03.116421 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Acquired lock "refresh_cache-d3135bb7-29cf-4819-9e83-1c45211901eb" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:55:03.116601 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:55:03.120740 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [req-ba978802-1832-4137-9014-d801c3c57281 req-d543f106-d9e1-4f5c-9131-75e4616db9c4 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:07:0c:64"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap0af5589b-ed"/></interface> {{(pid=98241) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 28 01:55:03.127778 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [req-ba978802-1832-4137-9014-d801c3c57281 req-d543f106-d9e1-4f5c-9131-75e4616db9c4 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:07:0c:64"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap0af5589b-ed"/></interface>not found in domain: <domain type='qemu' id='11'>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:   <name>instance-0000000b</name>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:   <uuid>e73ac672-0911-4e4d-8a85-9b635a9e836f</uuid>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:   <nova:package version="33.1.0"/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:   <nova:name>tempest-device-tagging-server-2127810450</nova:name>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:   <nova:creationTime>2026-05-28 01:55:01</nova:creationTime>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:   <nova:flavor name="m1.nano" id="42">
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     <nova:memory>192</nova:memory>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     <nova:disk>1</nova:disk>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     <nova:swap>0</nova:swap>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     <nova:ephemeral>0</nova:ephemeral>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     <nova:vcpus>1</nova:vcpus>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     <nova:extraSpecs>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     </nova:extraSpecs>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:   </nova:flavor>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:   <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     <nova:containerFormat>bare</nova:containerFormat>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     <nova:minDisk>1</nova:minDisk>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     <nova:minRam>0</nova:minRam>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     <nova:properties>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <nova:property name="hw_machine_type">pc</nova:property>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <nova:property name="hw_video_model">virtio</nova:property>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     </nova:properties>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:   </nova:image>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:   <nova:owner>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     <nova:user uuid="8df1e628989946dbafa89116b196c65b">tempest-TaggedAttachmentsTest-1060566416-project-member</nova:user>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     <nova:project uuid="02ba6b7c1fd84a7c8ed4e9f086f83fa0">tempest-TaggedAttachmentsTest-1060566416</nova:project>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:   </nova:owner>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:   <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:   <nova:ports>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     <nova:port uuid="ae1eb56b-d3c2-441b-9339-b2d96192924c">
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     </nova:port>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:   </nova:ports>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]: </nova:instance>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:   <memory unit='KiB'>196608</memory>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:   <currentMemory unit='KiB'>196608</currentMemory>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:   <vcpu placement='static'>1</vcpu>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:   <resource>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     <partition>/machine</partition>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:   </resource>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:   <sysinfo type='smbios'>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     <system>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <entry name='product'>OpenStack Nova</entry>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <entry name='version'>33.1.0</entry>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <entry name='serial'>e73ac672-0911-4e4d-8a85-9b635a9e836f</entry>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <entry name='uuid'>e73ac672-0911-4e4d-8a85-9b635a9e836f</entry>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <entry name='family'>Virtual Machine</entry>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     </system>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:   <os>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     <boot dev='hd'/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     <smbios mode='sysinfo'/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:   </os>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:   <features>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     <vmcoreinfo state='on'/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <tb-cache unit='KiB'>131072</tb-cache>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:   </features>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:   <cpu mode='custom' match='exact' check='full'>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     <model fallback='forbid'>Nehalem</model>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     <feature policy='require' name='hypervisor'/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:   <clock offset='utc'/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:   <on_poweroff>destroy</on_poweroff>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:   <on_reboot>restart</on_reboot>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:   <on_crash>destroy</on_crash>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:   <devices>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     <disk type='file' device='disk'>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <driver name='qemu' type='qcow2' cache='none'/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <source file='/opt/stack/data/nova/instances/e73ac672-0911-4e4d-8a85-9b635a9e836f/disk' index='2'/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <backingStore type='file' index='3'>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:         <format type='raw'/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:         <source file='/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899'/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:         <backingStore/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       </backingStore>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <target dev='vda' bus='virtio'/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <alias name='virtio-disk0'/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     </disk>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     <disk type='file' device='cdrom'>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <driver name='qemu' type='raw' cache='none'/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <source file='/opt/stack/data/nova/instances/e73ac672-0911-4e4d-8a85-9b635a9e836f/disk.config' index='1'/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <backingStore/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <target dev='hda' bus='ide'/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <readonly/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <alias name='ide0-0-0'/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     </disk>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     <controller type='usb' index='0' model='none'>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <alias name='usb'/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     </controller>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     <controller type='pci' index='0' model='pci-root'>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <alias name='pci.0'/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     </controller>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     <controller type='ide' index='0'>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <alias name='ide'/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     </controller>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     <interface type='ethernet'>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <mac address='fa:16:3e:ca:36:a6'/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <target dev='tapae1eb56b-d3'/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <model type='virtio'/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <driver name='qemu'/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <mtu size='1372'/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <alias name='net0'/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     </interface>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     <serial type='pty'>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <source path='/dev/pts/0'/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <log file='/opt/stack/data/nova/instances/e73ac672-0911-4e4d-8a85-9b635a9e836f/console.log' append='off'/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <target type='isa-serial' port='0'>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:         <model name='isa-serial'/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       </target>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <alias name='serial0'/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     </serial>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     <console type='pty' tty='/dev/pts/0'>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <source path='/dev/pts/0'/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <log file='/opt/stack/data/nova/instances/e73ac672-0911-4e4d-8a85-9b635a9e836f/console.log' append='off'/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <target type='serial' port='0'/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <alias name='serial0'/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     </console>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     <input type='mouse' bus='ps2'>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <alias name='input0'/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     </input>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     <input type='keyboard' bus='ps2'>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <alias name='input1'/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     </input>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     <graphics type='vnc' port='5900' autoport='yes' listen='0.0.0.0'>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <listen type='address' address='0.0.0.0'/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     </graphics>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     <audio id='1' type='none'/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     <video>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <model type='virtio' heads='1' primary='yes'/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <alias name='video0'/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     </video>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <stats period='10'/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <alias name='balloon0'/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     <rng model='virtio'>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <backend model='random'>/dev/urandom</backend>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <alias name='rng0'/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     </rng>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:   </devices>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     <label>libvirt-e73ac672-0911-4e4d-8a85-9b635a9e836f</label>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     <imagelabel>libvirt-e73ac672-0911-4e4d-8a85-9b635a9e836f</imagelabel>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:   </seclabel>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     <label>+64055:+993</label>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:     <imagelabel>+64055:+993</imagelabel>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:   </seclabel>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]: </domain>
May 28 01:55:03.127778 np0000001583 nova-compute[98241]:  {{(pid=98241) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 28 01:55:03.130725 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [req-ba978802-1832-4137-9014-d801c3c57281 req-d543f106-d9e1-4f5c-9131-75e4616db9c4 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:07:0c:64"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap0af5589b-ed"/></interface> {{(pid=98241) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 28 01:55:03.131247 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [req-ba978802-1832-4137-9014-d801c3c57281 req-d543f106-d9e1-4f5c-9131-75e4616db9c4 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:07:0c:64"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap0af5589b-ed"/></interface>not found in domain: <domain type='qemu' id='11'>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:   <name>instance-0000000b</name>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:   <uuid>e73ac672-0911-4e4d-8a85-9b635a9e836f</uuid>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:   <nova:package version="33.1.0"/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:   <nova:name>tempest-device-tagging-server-2127810450</nova:name>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:   <nova:creationTime>2026-05-28 01:55:01</nova:creationTime>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:   <nova:flavor name="m1.nano" id="42">
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     <nova:memory>192</nova:memory>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     <nova:disk>1</nova:disk>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     <nova:swap>0</nova:swap>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     <nova:ephemeral>0</nova:ephemeral>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     <nova:vcpus>1</nova:vcpus>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     <nova:extraSpecs>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     </nova:extraSpecs>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:   </nova:flavor>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:   <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     <nova:containerFormat>bare</nova:containerFormat>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     <nova:minDisk>1</nova:minDisk>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     <nova:minRam>0</nova:minRam>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     <nova:properties>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <nova:property name="hw_machine_type">pc</nova:property>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <nova:property name="hw_video_model">virtio</nova:property>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     </nova:properties>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:   </nova:image>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:   <nova:owner>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     <nova:user uuid="8df1e628989946dbafa89116b196c65b">tempest-TaggedAttachmentsTest-1060566416-project-member</nova:user>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     <nova:project uuid="02ba6b7c1fd84a7c8ed4e9f086f83fa0">tempest-TaggedAttachmentsTest-1060566416</nova:project>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:   </nova:owner>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:   <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:   <nova:ports>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     <nova:port uuid="ae1eb56b-d3c2-441b-9339-b2d96192924c">
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     </nova:port>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:   </nova:ports>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]: </nova:instance>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:   <memory unit='KiB'>196608</memory>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:   <currentMemory unit='KiB'>196608</currentMemory>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:   <vcpu placement='static'>1</vcpu>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:   <resource>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     <partition>/machine</partition>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:   </resource>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:   <sysinfo type='smbios'>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     <system>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <entry name='product'>OpenStack Nova</entry>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <entry name='version'>33.1.0</entry>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <entry name='serial'>e73ac672-0911-4e4d-8a85-9b635a9e836f</entry>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <entry name='uuid'>e73ac672-0911-4e4d-8a85-9b635a9e836f</entry>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <entry name='family'>Virtual Machine</entry>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     </system>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:   <os>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     <boot dev='hd'/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     <smbios mode='sysinfo'/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:   </os>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:   <features>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     <vmcoreinfo state='on'/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <tb-cache unit='KiB'>131072</tb-cache>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:   </features>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:   <cpu mode='custom' match='exact' check='full'>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     <model fallback='forbid'>Nehalem</model>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     <feature policy='require' name='hypervisor'/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:   <clock offset='utc'/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:   <on_poweroff>destroy</on_poweroff>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:   <on_reboot>restart</on_reboot>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:   <on_crash>destroy</on_crash>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:   <devices>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     <disk type='file' device='disk'>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <driver name='qemu' type='qcow2' cache='none'/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <source file='/opt/stack/data/nova/instances/e73ac672-0911-4e4d-8a85-9b635a9e836f/disk' index='2'/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <backingStore type='file' index='3'>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:         <format type='raw'/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:         <source file='/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899'/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:         <backingStore/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       </backingStore>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <target dev='vda' bus='virtio'/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <alias name='virtio-disk0'/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     </disk>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     <disk type='file' device='cdrom'>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <driver name='qemu' type='raw' cache='none'/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <source file='/opt/stack/data/nova/instances/e73ac672-0911-4e4d-8a85-9b635a9e836f/disk.config' index='1'/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <backingStore/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <target dev='hda' bus='ide'/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <readonly/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <alias name='ide0-0-0'/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     </disk>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     <controller type='usb' index='0' model='none'>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <alias name='usb'/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     </controller>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     <controller type='pci' index='0' model='pci-root'>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <alias name='pci.0'/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     </controller>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     <controller type='ide' index='0'>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <alias name='ide'/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     </controller>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     <interface type='ethernet'>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <mac address='fa:16:3e:ca:36:a6'/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <target dev='tapae1eb56b-d3'/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <model type='virtio'/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <driver name='qemu'/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <mtu size='1372'/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <alias name='net0'/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     </interface>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     <serial type='pty'>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <source path='/dev/pts/0'/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <log file='/opt/stack/data/nova/instances/e73ac672-0911-4e4d-8a85-9b635a9e836f/console.log' append='off'/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <target type='isa-serial' port='0'>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:         <model name='isa-serial'/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       </target>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <alias name='serial0'/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     </serial>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     <console type='pty' tty='/dev/pts/0'>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <source path='/dev/pts/0'/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <log file='/opt/stack/data/nova/instances/e73ac672-0911-4e4d-8a85-9b635a9e836f/console.log' append='off'/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <target type='serial' port='0'/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <alias name='serial0'/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     </console>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     <input type='mouse' bus='ps2'>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <alias name='input0'/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     </input>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     <input type='keyboard' bus='ps2'>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <alias name='input1'/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     </input>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     <graphics type='vnc' port='5900' autoport='yes' listen='0.0.0.0'>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <listen type='address' address='0.0.0.0'/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     </graphics>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     <audio id='1' type='none'/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     <video>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <model type='virtio' heads='1' primary='yes'/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <alias name='video0'/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     </video>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <stats period='10'/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <alias name='balloon0'/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     <rng model='virtio'>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <backend model='random'>/dev/urandom</backend>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <alias name='rng0'/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     </rng>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:   </devices>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     <label>libvirt-e73ac672-0911-4e4d-8a85-9b635a9e836f</label>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     <imagelabel>libvirt-e73ac672-0911-4e4d-8a85-9b635a9e836f</imagelabel>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:   </seclabel>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     <label>+64055:+993</label>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:     <imagelabel>+64055:+993</imagelabel>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:   </seclabel>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]: </domain>
May 28 01:55:03.131247 np0000001583 nova-compute[98241]:  {{(pid=98241) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 28 01:55:03.134626 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [req-ba978802-1832-4137-9014-d801c3c57281 req-d543f106-d9e1-4f5c-9131-75e4616db9c4 service nova] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Detaching interface fa:16:3e:07:0c:64 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap0af5589b-ed' not found.
May 28 01:55:03.134626 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [req-ba978802-1832-4137-9014-d801c3c57281 req-d543f106-d9e1-4f5c-9131-75e4616db9c4 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:53:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2127810450',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-device-tagging-server-2127810450',id=11,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOgLraTEi6SiWvo5jslayVOBAKtkEEjh1jVuNw35Hn8cUQoGuB8wzuMiOMlFTlRtSvwVvTOnGa8VK88dE01Yrnrej50o+Hw4uQhAmKYoDt2ubT7eWDD6mkiN/JuIg389w==',key_name='tempest-keypair-1856182923',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:53:54Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata=<?>,migration_context=None,new_flavor=None,node='np0000001583',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='02ba6b7c1fd84a7c8ed4e9f086f83fa0',ramdisk_id='',reservation_id='r-htc032mq',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1060566416',owner_user_name='tempest-TaggedAttachmentsTest-1060566416-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:53:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8df1e628989946dbafa89116b196c65b',uuid=e73ac672-0911-4e4d-8a85-9b635a9e836f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0af5589b-ed4a-40e6-b1f9-1e52f80285b9", "address": "fa:16:3e:07:0c:64", "network": {"id": "d6da1280-87e1-42bb-b434-c401417302e8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1261237232", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "02ba6b7c1fd84a7c8ed4e9f086f83fa0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0af5589b-ed", "ovs_interfaceid": "0af5589b-ed4a-40e6-b1f9-1e52f80285b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:55:03.134626 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [req-ba978802-1832-4137-9014-d801c3c57281 req-d543f106-d9e1-4f5c-9131-75e4616db9c4 service nova] Converting VIF {"id": "0af5589b-ed4a-40e6-b1f9-1e52f80285b9", "address": "fa:16:3e:07:0c:64", "network": {"id": "d6da1280-87e1-42bb-b434-c401417302e8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1261237232", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "02ba6b7c1fd84a7c8ed4e9f086f83fa0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0af5589b-ed", "ovs_interfaceid": "0af5589b-ed4a-40e6-b1f9-1e52f80285b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:55:03.134626 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [req-ba978802-1832-4137-9014-d801c3c57281 req-d543f106-d9e1-4f5c-9131-75e4616db9c4 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:0c:64,bridge_name='br-int',has_traffic_filtering=True,id=0af5589b-ed4a-40e6-b1f9-1e52f80285b9,network=Network(d6da1280-87e1-42bb-b434-c401417302e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0af5589b-ed') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:55:03.134626 np0000001583 nova-compute[98241]: DEBUG os_vif [req-ba978802-1832-4137-9014-d801c3c57281 req-d543f106-d9e1-4f5c-9131-75e4616db9c4 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:0c:64,bridge_name='br-int',has_traffic_filtering=True,id=0af5589b-ed4a-40e6-b1f9-1e52f80285b9,network=Network(d6da1280-87e1-42bb-b434-c401417302e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0af5589b-ed') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:55:03.134914 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:03.134947 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0af5589b-ed, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:03.135138 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:55:03.139595 np0000001583 nova-compute[98241]: INFO os_vif [req-ba978802-1832-4137-9014-d801c3c57281 req-d543f106-d9e1-4f5c-9131-75e4616db9c4 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:0c:64,bridge_name='br-int',has_traffic_filtering=True,id=0af5589b-ed4a-40e6-b1f9-1e52f80285b9,network=Network(d6da1280-87e1-42bb-b434-c401417302e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0af5589b-ed')
May 28 01:55:03.141383 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [req-ba978802-1832-4137-9014-d801c3c57281 req-d543f106-d9e1-4f5c-9131-75e4616db9c4 service nova] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-2127810450', uuid='e73ac672-0911-4e4d-8a85-9b635a9e836f'), owner=OwnerMeta(userid='8df1e628989946dbafa89116b196c65b', username='tempest-TaggedAttachmentsTest-1060566416-project-member', projectid='02ba6b7c1fd84a7c8ed4e9f086f83fa0', projectname='tempest-TaggedAttachmentsTest-1060566416'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ae1eb56b-d3c2-441b-9339-b2d96192924c", "address": "fa:16:3e:ca:36:a6", "network": {"id": "a6357868-368f-400d-b8c9-8e8843bdfdda", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1753538248-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "02ba6b7c1fd84a7c8ed4e9f086f83fa0", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae1eb56b-d3", "ovs_interfaceid": "ae1eb56b-d3c2-441b-9339-b2d96192924c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933303.140108) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:55:03.142293 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [req-ba978802-1832-4137-9014-d801c3c57281 req-d543f106-d9e1-4f5c-9131-75e4616db9c4 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:55:03.142293 np0000001583 nova-compute[98241]:   <nova:package version="33.1.0"/>
May 28 01:55:03.142293 np0000001583 nova-compute[98241]:   <nova:name>tempest-device-tagging-server-2127810450</nova:name>
May 28 01:55:03.142293 np0000001583 nova-compute[98241]:   <nova:creationTime>2026-05-28 01:55:03</nova:creationTime>
May 28 01:55:03.142293 np0000001583 nova-compute[98241]:   <nova:flavor name="m1.nano" id="42">
May 28 01:55:03.142293 np0000001583 nova-compute[98241]:     <nova:memory>192</nova:memory>
May 28 01:55:03.142293 np0000001583 nova-compute[98241]:     <nova:disk>1</nova:disk>
May 28 01:55:03.142293 np0000001583 nova-compute[98241]:     <nova:swap>0</nova:swap>
May 28 01:55:03.142293 np0000001583 nova-compute[98241]:     <nova:ephemeral>0</nova:ephemeral>
May 28 01:55:03.142293 np0000001583 nova-compute[98241]:     <nova:vcpus>1</nova:vcpus>
May 28 01:55:03.142293 np0000001583 nova-compute[98241]:     <nova:extraSpecs>
May 28 01:55:03.142293 np0000001583 nova-compute[98241]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:55:03.142293 np0000001583 nova-compute[98241]:     </nova:extraSpecs>
May 28 01:55:03.142293 np0000001583 nova-compute[98241]:   </nova:flavor>
May 28 01:55:03.142293 np0000001583 nova-compute[98241]:   <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 01:55:03.142293 np0000001583 nova-compute[98241]:     <nova:containerFormat>bare</nova:containerFormat>
May 28 01:55:03.142293 np0000001583 nova-compute[98241]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:55:03.142293 np0000001583 nova-compute[98241]:     <nova:minDisk>1</nova:minDisk>
May 28 01:55:03.142293 np0000001583 nova-compute[98241]:     <nova:minRam>0</nova:minRam>
May 28 01:55:03.142293 np0000001583 nova-compute[98241]:     <nova:properties>
May 28 01:55:03.142293 np0000001583 nova-compute[98241]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 01:55:03.142293 np0000001583 nova-compute[98241]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 01:55:03.142293 np0000001583 nova-compute[98241]:       <nova:property name="hw_machine_type">pc</nova:property>
May 28 01:55:03.142293 np0000001583 nova-compute[98241]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:55:03.142293 np0000001583 nova-compute[98241]:       <nova:property name="hw_video_model">virtio</nova:property>
May 28 01:55:03.142293 np0000001583 nova-compute[98241]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 28 01:55:03.142293 np0000001583 nova-compute[98241]:     </nova:properties>
May 28 01:55:03.142293 np0000001583 nova-compute[98241]:   </nova:image>
May 28 01:55:03.142293 np0000001583 nova-compute[98241]:   <nova:owner>
May 28 01:55:03.142293 np0000001583 nova-compute[98241]:     <nova:user uuid="8df1e628989946dbafa89116b196c65b">tempest-TaggedAttachmentsTest-1060566416-project-member</nova:user>
May 28 01:55:03.142293 np0000001583 nova-compute[98241]:     <nova:project uuid="02ba6b7c1fd84a7c8ed4e9f086f83fa0">tempest-TaggedAttachmentsTest-1060566416</nova:project>
May 28 01:55:03.142293 np0000001583 nova-compute[98241]:   </nova:owner>
May 28 01:55:03.142293 np0000001583 nova-compute[98241]:   <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 01:55:03.142293 np0000001583 nova-compute[98241]:   <nova:ports>
May 28 01:55:03.142293 np0000001583 nova-compute[98241]:     <nova:port uuid="ae1eb56b-d3c2-441b-9339-b2d96192924c">
May 28 01:55:03.142293 np0000001583 nova-compute[98241]:       <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 28 01:55:03.142293 np0000001583 nova-compute[98241]:     </nova:port>
May 28 01:55:03.142293 np0000001583 nova-compute[98241]:   </nova:ports>
May 28 01:55:03.142293 np0000001583 nova-compute[98241]: </nova:instance>
May 28 01:55:03.142293 np0000001583 nova-compute[98241]:  {{(pid=98241) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}}
May 28 01:55:03.144040 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-ba978802-1832-4137-9014-d801c3c57281 req-d543f106-d9e1-4f5c-9131-75e4616db9c4 service nova] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Updating instance_info_cache with network_info: [{"id": "ae1eb56b-d3c2-441b-9339-b2d96192924c", "address": "fa:16:3e:ca:36:a6", "network": {"id": "a6357868-368f-400d-b8c9-8e8843bdfdda", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1753538248-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "02ba6b7c1fd84a7c8ed4e9f086f83fa0", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae1eb56b-d3", "ovs_interfaceid": "ae1eb56b-d3c2-441b-9339-b2d96192924c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:55:03.164386 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:55:03.164717 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:55:03.165002 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:03.165263 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:03.272195 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c3a7b14e31ee40cf9e4f4bba084ccaa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba381dad8364a488a98b80c04cce8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:55:03.275292 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a8bb3963-b808-4240-a6e8-3c71ed980c7e req-9236dd72-9b23-4b8e-831c-5e133ccf50d3 service nova] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Received event network-vif-unplugged-0af5589b-ed4a-40e6-b1f9-1e52f80285b9 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:03.275758 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a8bb3963-b808-4240-a6e8-3c71ed980c7e req-9236dd72-9b23-4b8e-831c-5e133ccf50d3 service nova] Acquiring lock "e73ac672-0911-4e4d-8a85-9b635a9e836f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:03.275946 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a8bb3963-b808-4240-a6e8-3c71ed980c7e req-9236dd72-9b23-4b8e-831c-5e133ccf50d3 service nova] Lock "e73ac672-0911-4e4d-8a85-9b635a9e836f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:03.276100 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a8bb3963-b808-4240-a6e8-3c71ed980c7e req-9236dd72-9b23-4b8e-831c-5e133ccf50d3 service nova] Lock "e73ac672-0911-4e4d-8a85-9b635a9e836f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:03.276342 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a8bb3963-b808-4240-a6e8-3c71ed980c7e req-9236dd72-9b23-4b8e-831c-5e133ccf50d3 service nova] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] No waiting events found dispatching network-vif-unplugged-0af5589b-ed4a-40e6-b1f9-1e52f80285b9 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:55:03.276536 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-a8bb3963-b808-4240-a6e8-3c71ed980c7e req-9236dd72-9b23-4b8e-831c-5e133ccf50d3 service nova] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Received unexpected event network-vif-unplugged-0af5589b-ed4a-40e6-b1f9-1e52f80285b9 for instance with vm_state active and task_state None.
May 28 01:55:03.276673 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a8bb3963-b808-4240-a6e8-3c71ed980c7e req-9236dd72-9b23-4b8e-831c-5e133ccf50d3 service nova] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Received event network-vif-unplugged-0af5589b-ed4a-40e6-b1f9-1e52f80285b9 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:03.276885 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a8bb3963-b808-4240-a6e8-3c71ed980c7e req-9236dd72-9b23-4b8e-831c-5e133ccf50d3 service nova] Acquiring lock "e73ac672-0911-4e4d-8a85-9b635a9e836f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:03.277036 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a8bb3963-b808-4240-a6e8-3c71ed980c7e req-9236dd72-9b23-4b8e-831c-5e133ccf50d3 service nova] Lock "e73ac672-0911-4e4d-8a85-9b635a9e836f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:03.277235 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a8bb3963-b808-4240-a6e8-3c71ed980c7e req-9236dd72-9b23-4b8e-831c-5e133ccf50d3 service nova] Lock "e73ac672-0911-4e4d-8a85-9b635a9e836f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:03.277724 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a8bb3963-b808-4240-a6e8-3c71ed980c7e req-9236dd72-9b23-4b8e-831c-5e133ccf50d3 service nova] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] No waiting events found dispatching network-vif-unplugged-0af5589b-ed4a-40e6-b1f9-1e52f80285b9 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:55:03.278325 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-a8bb3963-b808-4240-a6e8-3c71ed980c7e req-9236dd72-9b23-4b8e-831c-5e133ccf50d3 service nova] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Received unexpected event network-vif-unplugged-0af5589b-ed4a-40e6-b1f9-1e52f80285b9 for instance with vm_state active and task_state None.
May 28 01:55:03.355664 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-28e60d25-0be3-4584-b3a7-5981bbb71f5a tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:55:03.356400 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-28e60d25-0be3-4584-b3a7-5981bbb71f5a tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:55:03.360285 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:03.383778 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4a1856a2-e351-40ce-bfe6-f7cb16a61687 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Acquiring lock "refresh_cache-e73ac672-0911-4e4d-8a85-9b635a9e836f" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:55:03.384313 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4a1856a2-e351-40ce-bfe6-f7cb16a61687 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Acquired lock "refresh_cache-e73ac672-0911-4e4d-8a85-9b635a9e836f" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:55:03.384548 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-4a1856a2-e351-40ce-bfe6-f7cb16a61687 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:55:03.644870 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:03.664721 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:55:03.720407 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Successfully created port: b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:55:03.727105 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:55:03.864847 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-28e60d25-0be3-4584-b3a7-5981bbb71f5a tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:55:03.887007 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-4a1856a2-e351-40ce-bfe6-f7cb16a61687 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:03.925143 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:04.070186 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:04.120844 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Updating instance_info_cache with network_info: [{"id": "2ab83417-6d0d-4eb5-a96a-398a30c193d2", "address": "fa:16:3e:76:82:b0", "network": {"id": "9fe2c990-23ca-4988-b674-c9825c3616af", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-419738907-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c32da4f768f48179b4be0509a25a704", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab83417-6d", "ovs_interfaceid": "2ab83417-6d0d-4eb5-a96a-398a30c193d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:55:04.171371 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:55:04.309592 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Successfully updated port: b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:55:04.352717 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-4a1856a2-e351-40ce-bfe6-f7cb16a61687 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:04.376630 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-28e60d25-0be3-4584-b3a7-5981bbb71f5a tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.720s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:04.376630 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.916s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:04.382538 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:55:04.382773 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Claim successful on node np0000001583
May 28 01:55:04.452606 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-28e60d25-0be3-4584-b3a7-5981bbb71f5a tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Deleted allocations for instance adfbfdf0-7c0f-4834-92ff-3b8d8c39e333
May 28 01:55:04.462964 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:04.583275 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-4a1856a2-e351-40ce-bfe6-f7cb16a61687 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Updating instance_info_cache with network_info: [{"id": "ae1eb56b-d3c2-441b-9339-b2d96192924c", "address": "fa:16:3e:ca:36:a6", "network": {"id": "a6357868-368f-400d-b8c9-8e8843bdfdda", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1753538248-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "02ba6b7c1fd84a7c8ed4e9f086f83fa0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae1eb56b-d3", "ovs_interfaceid": "ae1eb56b-d3c2-441b-9339-b2d96192924c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:55:04.623109 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Releasing lock "refresh_cache-d3135bb7-29cf-4819-9e83-1c45211901eb" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:55:04.623423 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Instance network_info: |[{"id": "2ab83417-6d0d-4eb5-a96a-398a30c193d2", "address": "fa:16:3e:76:82:b0", "network": {"id": "9fe2c990-23ca-4988-b674-c9825c3616af", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-419738907-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c32da4f768f48179b4be0509a25a704", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab83417-6d", "ovs_interfaceid": "2ab83417-6d0d-4eb5-a96a-398a30c193d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:55:04.625051 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Start _get_guest_xml network_info=[{"id": "2ab83417-6d0d-4eb5-a96a-398a30c193d2", "address": "fa:16:3e:76:82:b0", "network": {"id": "9fe2c990-23ca-4988-b674-c9825c3616af", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-419738907-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c32da4f768f48179b4be0509a25a704", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab83417-6d", "ovs_interfaceid": "2ab83417-6d0d-4eb5-a96a-398a30c193d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:55:04.634684 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:55:04.635649 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-ServersNegativeTestJSON-server-1895181752', uuid='d3135bb7-29cf-4819-9e83-1c45211901eb'), owner=OwnerMeta(userid='c9dd13ea0f744864b4c48f99b39b6436', username='tempest-ServersNegativeTestJSON-1232315525-project-member', projectid='6c32da4f768f48179b4be0509a25a704', projectname='tempest-ServersNegativeTestJSON-1232315525'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2ab83417-6d0d-4eb5-a96a-398a30c193d2", "address": "fa:16:3e:76:82:b0", "network": {"id": "9fe2c990-23ca-4988-b674-c9825c3616af", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-419738907-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c32da4f768f48179b4be0509a25a704", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab83417-6d", "ovs_interfaceid": "2ab83417-6d0d-4eb5-a96a-398a30c193d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933304.6353183) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:55:04.638375 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:55:04.639205 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:55:04.640009 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:55:04.640230 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:55:04.641368 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:55:04.641832 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:55:04.641941 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:55:04.642048 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:55:04.642253 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:55:04.642401 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:55:04.642675 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:55:04.642744 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:55:04.642882 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:55:04.643094 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:55:04.643207 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:55:04.643338 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:55:04.656848 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:54:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1895181752',display_name='tempest-ServersNegativeTestJSON-server-1895181752',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-serversnegativetestjson-server-1895181752',id=17,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c32da4f768f48179b4be0509a25a704',ramdisk_id='',reservation_id='r-j43mctex',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1232315525',owner_user_name='tempest-ServersNegativeTestJSON-1232315525-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:55:01Z,user_data=None,user_id='c9dd13ea0f744864b4c48f99b39b6436',uuid=d3135bb7-29cf-4819-9e83-1c45211901eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ab83417-6d0d-4eb5-a96a-398a30c193d2", "address": "fa:16:3e:76:82:b0", "network": {"id": "9fe2c990-23ca-4988-b674-c9825c3616af", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-419738907-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c32da4f768f48179b4be0509a25a704", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab83417-6d", "ovs_interfaceid": "2ab83417-6d0d-4eb5-a96a-398a30c193d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:55:04.657260 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Converting VIF {"id": "2ab83417-6d0d-4eb5-a96a-398a30c193d2", "address": "fa:16:3e:76:82:b0", "network": {"id": "9fe2c990-23ca-4988-b674-c9825c3616af", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-419738907-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c32da4f768f48179b4be0509a25a704", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab83417-6d", "ovs_interfaceid": "2ab83417-6d0d-4eb5-a96a-398a30c193d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:55:04.657641 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:82:b0,bridge_name='br-int',has_traffic_filtering=True,id=2ab83417-6d0d-4eb5-a96a-398a30c193d2,network=Network(9fe2c990-23ca-4988-b674-c9825c3616af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ab83417-6d') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:55:04.658303 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Lazy-loading 'pci_devices' on Instance uuid d3135bb7-29cf-4819-9e83-1c45211901eb {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:55:04.680530 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Booting with blank volume at /dev/vda
May 28 01:55:04.813143 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "refresh_cache-533f5dcc-2e48-4280-84b3-facb02dea136" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:55:04.813343 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquired lock "refresh_cache-533f5dcc-2e48-4280-84b3-facb02dea136" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:55:04.813411 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:55:04.863956 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:05.043036 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Updating instance_info_cache with network_info: [{"id": "dfa132bb-afe8-4b97-909b-816f3e916bfd", "address": "fa:16:3e:e3:af:b5", "network": {"id": "3fed2ebb-cfdf-471c-963f-f350742f2200", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1888324923-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa132bb-af", "ovs_interfaceid": "dfa132bb-afe8-4b97-909b-816f3e916bfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "939862e4-4e68-484c-bbcd-95faf922a641", "address": "fa:16:3e:2d:d8:ee", "network": {"id": "07811dc4-ff38-4d15-a899-007fdeea12e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-974977857", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap939862e4-4e", "ovs_interfaceid": "939862e4-4e68-484c-bbcd-95faf922a641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7896c8d5-ea83-4141-8344-6b557e45d6d1", "address": "fa:16:3e:e4:05:23", "network": {"id": "07811dc4-ff38-4d15-a899-007fdeea12e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-974977857", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7896c8d5-ea", "ovs_interfaceid": "7896c8d5-ea83-4141-8344-6b557e45d6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "78c3c570-3a3b-484e-bc76-7d91862ff0d4", "address": "fa:16:3e:20:fa:56", "network": {"id": "07811dc4-ff38-4d15-a899-007fdeea12e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-974977857", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap78c3c570-3a", "ovs_interfaceid": "78c3c570-3a3b-484e-bc76-7d91862ff0d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "766c9d77-3578-4071-b0eb-f2a929ee0445", "address": "fa:16:3e:0a:6e:61", "network": {"id": "07811dc4-ff38-4d15-a899-007fdeea12e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-974977857", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap766c9d77-35", "ovs_interfaceid": "766c9d77-3578-4071-b0eb-f2a929ee0445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d868b893-10e8-42d1-872f-bf4b9e8d3659", "address": "fa:16:3e:59:94:6e", "network": {"id": "7de6eee4-0d64-4194-b730-0b1e9ac928b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-2098291513", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd868b893-10", "ovs_interfaceid": "d868b893-10e8-42d1-872f-bf4b9e8d3659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9ca5546d-4b44-4470-92d7-08800876e89b", "address": "fa:16:3e:25:2d:87", "network": {"id": "7de6eee4-0d64-4194-b730-0b1e9ac928b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-2098291513", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca5546d-4b", "ovs_interfaceid": "9ca5546d-4b44-4470-92d7-08800876e89b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:55:05.085396 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4a1856a2-e351-40ce-bfe6-f7cb16a61687 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Releasing lock "refresh_cache-e73ac672-0911-4e4d-8a85-9b635a9e836f" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:55:05.161263 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] End _get_guest_xml xml=<domain type="qemu">
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:   <uuid>d3135bb7-29cf-4819-9e83-1c45211901eb</uuid>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:   <name>instance-00000011</name>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:       <nova:name>tempest-ServersNegativeTestJSON-server-1895181752</nova:name>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:55:04</nova:creationTime>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:         <nova:user uuid="c9dd13ea0f744864b4c48f99b39b6436">tempest-ServersNegativeTestJSON-1232315525-project-member</nova:user>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:         <nova:project uuid="6c32da4f768f48179b4be0509a25a704">tempest-ServersNegativeTestJSON-1232315525</nova:project>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:         <nova:port uuid="2ab83417-6d0d-4eb5-a96a-398a30c193d2">
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:     <system>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:       <entry name="serial">d3135bb7-29cf-4819-9e83-1c45211901eb</entry>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:       <entry name="uuid">d3135bb7-29cf-4819-9e83-1c45211901eb</entry>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:     </system>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:   <os>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:   </os>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:   <features>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:   </features>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:   <devices>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/d3135bb7-29cf-4819-9e83-1c45211901eb/disk"/>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:     </disk>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/d3135bb7-29cf-4819-9e83-1c45211901eb/disk.config"/>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:     </disk>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:76:82:b0"/>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:       <target dev="tap2ab83417-6d"/>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:     </interface>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/d3135bb7-29cf-4819-9e83-1c45211901eb/console.log" append="off"/>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:     </serial>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:     <video>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:     </video>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:     </rng>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:   </devices>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]: </domain>
May 28 01:55:05.161263 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:55:05.166316 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Preparing to wait for external event network-vif-plugged-2ab83417-6d0d-4eb5-a96a-398a30c193d2 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:55:05.166316 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Acquiring lock "d3135bb7-29cf-4819-9e83-1c45211901eb-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:05.166316 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Lock "d3135bb7-29cf-4819-9e83-1c45211901eb-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:05.166316 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Lock "d3135bb7-29cf-4819-9e83-1c45211901eb-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:05.166316 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:54:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1895181752',display_name='tempest-ServersNegativeTestJSON-server-1895181752',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-serversnegativetestjson-server-1895181752',id=17,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c32da4f768f48179b4be0509a25a704',ramdisk_id='',reservation_id='r-j43mctex',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1232315525',owner_user_name='tempest-ServersNegativeTestJSON-1232315525-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:55:01Z,user_data=None,user_id='c9dd13ea0f744864b4c48f99b39b6436',uuid=d3135bb7-29cf-4819-9e83-1c45211901eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ab83417-6d0d-4eb5-a96a-398a30c193d2", "address": "fa:16:3e:76:82:b0", "network": {"id": "9fe2c990-23ca-4988-b674-c9825c3616af", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-419738907-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c32da4f768f48179b4be0509a25a704", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab83417-6d", "ovs_interfaceid": "2ab83417-6d0d-4eb5-a96a-398a30c193d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:55:05.166316 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Converting VIF {"id": "2ab83417-6d0d-4eb5-a96a-398a30c193d2", "address": "fa:16:3e:76:82:b0", "network": {"id": "9fe2c990-23ca-4988-b674-c9825c3616af", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-419738907-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c32da4f768f48179b4be0509a25a704", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab83417-6d", "ovs_interfaceid": "2ab83417-6d0d-4eb5-a96a-398a30c193d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:55:05.166316 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:82:b0,bridge_name='br-int',has_traffic_filtering=True,id=2ab83417-6d0d-4eb5-a96a-398a30c193d2,network=Network(9fe2c990-23ca-4988-b674-c9825c3616af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ab83417-6d') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:55:05.166316 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:82:b0,bridge_name='br-int',has_traffic_filtering=True,id=2ab83417-6d0d-4eb5-a96a-398a30c193d2,network=Network(9fe2c990-23ca-4988-b674-c9825c3616af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ab83417-6d') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:55:05.166316 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:05.166316 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:05.166316 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:55:05.166316 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:05.166316 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a43344c0-53c3-5904-8372-680d04ec66a7', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:05.168943 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:55:05.168943 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:05.169705 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:05.169845 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ab83417-6d, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:05.170130 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2ab83417-6d, col_values=(('qos', UUID('affbbef0-51cc-47ab-be23-bcb8c94f2d0b')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:05.170304 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2ab83417-6d, col_values=(('external_ids', {'iface-id': '2ab83417-6d0d-4eb5-a96a-398a30c193d2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:82:b0', 'vm-uuid': 'd3135bb7-29cf-4819-9e83-1c45211901eb'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:05.171560 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:05.172446 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:55:05.177418 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:05.178217 np0000001583 nova-compute[98241]: INFO os_vif [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:82:b0,bridge_name='br-int',has_traffic_filtering=True,id=2ab83417-6d0d-4eb5-a96a-398a30c193d2,network=Network(9fe2c990-23ca-4988-b674-c9825c3616af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ab83417-6d')
May 28 01:55:05.346111 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ed5b09bc-74f8-4ded-885f-dc654d2ce7d1 req-6f20ce64-6944-4c9d-99df-7ec443c57d95 service nova] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Received event network-changed-b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:05.346687 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ed5b09bc-74f8-4ded-885f-dc654d2ce7d1 req-6f20ce64-6944-4c9d-99df-7ec443c57d95 service nova] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Refreshing instance network info cache due to event network-changed-b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:55:05.346886 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ed5b09bc-74f8-4ded-885f-dc654d2ce7d1 req-6f20ce64-6944-4c9d-99df-7ec443c57d95 service nova] Acquiring lock "refresh_cache-533f5dcc-2e48-4280-84b3-facb02dea136" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:55:05.406432 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:55:05.477734 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-28e60d25-0be3-4584-b3a7-5981bbb71f5a tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "adfbfdf0-7c0f-4834-92ff-3b8d8c39e333" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.988s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:05.545113 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Releasing lock "refresh_cache-0cca8054-2a26-436f-93b8-ef28e452bd65" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:55:05.545617 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Instance network_info: |[{"id": "dfa132bb-afe8-4b97-909b-816f3e916bfd", "address": "fa:16:3e:e3:af:b5", "network": {"id": "3fed2ebb-cfdf-471c-963f-f350742f2200", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1888324923-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa132bb-af", "ovs_interfaceid": "dfa132bb-afe8-4b97-909b-816f3e916bfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "939862e4-4e68-484c-bbcd-95faf922a641", "address": "fa:16:3e:2d:d8:ee", "network": {"id": "07811dc4-ff38-4d15-a899-007fdeea12e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-974977857", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap939862e4-4e", "ovs_interfaceid": "939862e4-4e68-484c-bbcd-95faf922a641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7896c8d5-ea83-4141-8344-6b557e45d6d1", "address": "fa:16:3e:e4:05:23", "network": {"id": "07811dc4-ff38-4d15-a899-007fdeea12e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-974977857", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7896c8d5-ea", "ovs_interfaceid": "7896c8d5-ea83-4141-8344-6b557e45d6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "78c3c570-3a3b-484e-bc76-7d91862ff0d4", "address": "fa:16:3e:20:fa:56", "network": {"id": "07811dc4-ff38-4d15-a899-007fdeea12e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-974977857", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap78c3c570-3a", "ovs_interfaceid": "78c3c570-3a3b-484e-bc76-7d91862ff0d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "766c9d77-3578-4071-b0eb-f2a929ee0445", "address": "fa:16:3e:0a:6e:61", "network": {"id": "07811dc4-ff38-4d15-a899-007fdeea12e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-974977857", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap766c9d77-35", "ovs_interfaceid": "766c9d77-3578-4071-b0eb-f2a929ee0445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d868b893-10e8-42d1-872f-bf4b9e8d3659", "address": "fa:16:3e:59:94:6e", "network": {"id": "7de6eee4-0d64-4194-b730-0b1e9ac928b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-2098291513", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd868b893-10", "ovs_interfaceid": "d868b893-10e8-42d1-872f-bf4b9e8d3659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9ca5546d-4b44-4470-92d7-08800876e89b", "address": "fa:16:3e:25:2d:87", "network": {"id": "7de6eee4-0d64-4194-b730-0b1e9ac928b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-2098291513", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca5546d-4b", "ovs_interfaceid": "9ca5546d-4b44-4470-92d7-08800876e89b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:55:05.546981 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Start _get_guest_xml network_info=[{"id": "dfa132bb-afe8-4b97-909b-816f3e916bfd", "address": "fa:16:3e:e3:af:b5", "network": {"id": "3fed2ebb-cfdf-471c-963f-f350742f2200", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1888324923-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa132bb-af", "ovs_interfaceid": "dfa132bb-afe8-4b97-909b-816f3e916bfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "939862e4-4e68-484c-bbcd-95faf922a641", "address": "fa:16:3e:2d:d8:ee", "network": {"id": "07811dc4-ff38-4d15-a899-007fdeea12e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-974977857", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap939862e4-4e", "ovs_interfaceid": "939862e4-4e68-484c-bbcd-95faf922a641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7896c8d5-ea83-4141-8344-6b557e45d6d1", "address": "fa:16:3e:e4:05:23", "network": {"id": "07811dc4-ff38-4d15-a899-007fdeea12e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-974977857", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7896c8d5-ea", "ovs_interfaceid": "7896c8d5-ea83-4141-8344-6b557e45d6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "78c3c570-3a3b-484e-bc76-7d91862ff0d4", "address": "fa:16:3e:20:fa:56", "network": {"id": "07811dc4-ff38-4d15-a899-007fdeea12e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-974977857", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap78c3c570-3a", "ovs_interfaceid": "78c3c570-3a3b-484e-bc76-7d91862ff0d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "766c9d77-3578-4071-b0eb-f2a929ee0445", "address": "fa:16:3e:0a:6e:61", "network": {"id": "07811dc4-ff38-4d15-a899-007fdeea12e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-974977857", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap766c9d77-35", "ovs_interfaceid": "766c9d77-3578-4071-b0eb-f2a929ee0445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d868b893-10e8-42d1-872f-bf4b9e8d3659", "address": "fa:16:3e:59:94:6e", "network": {"id": "7de6eee4-0d64-4194-b730-0b1e9ac928b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-2098291513", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd868b893-10", "ovs_interfaceid": "d868b893-10e8-42d1-872f-bf4b9e8d3659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9ca5546d-4b44-4470-92d7-08800876e89b", "address": "fa:16:3e:25:2d:87", "network": {"id": "7de6eee4-0d64-4194-b730-0b1e9ac928b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-2098291513", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca5546d-4b", "ovs_interfaceid": "9ca5546d-4b44-4470-92d7-08800876e89b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9', 'iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cb9e2524-4a7c-470b-9095-1bc5e1a51eb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '0cca8054-2a26-436f-93b8-ef28e452bd65', 'attached_at': '', 'detached_at': '', 'volume_id': 'cb9e2524-4a7c-470b-9095-1bc5e1a51eb9', 'serial': 'cb9e2524-4a7c-470b-9095-1bc5e1a51eb9'}, 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '1987c72c-c619-45e7-a733-6665194b55dd', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b', 'iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7d62e380-a6af-45e6-aefa-214f97c0760b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '0cca8054-2a26-436f-93b8-ef28e452bd65', 'attached_at': '', 'detached_at': '', 'volume_id': '7d62e380-a6af-45e6-aefa-214f97c0760b', 'serial': '7d62e380-a6af-45e6-aefa-214f97c0760b'}, 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'boot_index': 1, 'attachment_id': '29d3d63b-a3d1-4623-b493-db8560f9c3fd', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e', 'iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1319d85a-02ed-497c-a138-d2b9a5b28c6e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '0cca8054-2a26-436f-93b8-ef28e452bd65', 'attached_at': '', 'detached_at': '', 'volume_id': '1319d85a-02ed-497c-a138-d2b9a5b28c6e', 'serial': '1319d85a-02ed-497c-a138-d2b9a5b28c6e'}, 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'boot_index': 2, 'attachment_id': '5ac71183-0519-4f77-a7d4-d98fe5c32b76', 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:55:05.548772 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f7f1cd54-d7fd-4687-a46b-5f0dfcbf3369 req-94aac93c-c719-42ff-83e4-d1ceea48c63e service nova] Acquired lock "refresh_cache-0cca8054-2a26-436f-93b8-ef28e452bd65" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:55:05.548772 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-f7f1cd54-d7fd-4687-a46b-5f0dfcbf3369 req-94aac93c-c719-42ff-83e4-d1ceea48c63e service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Refreshing network info cache for port 9ca5546d-4b44-4470-92d7-08800876e89b {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:55:05.552267 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:55:05.553622 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-816699505', uuid='0cca8054-2a26-436f-93b8-ef28e452bd65'), owner=OwnerMeta(userid='3628360fdd1044689e5e94535d1b7fcd', username='tempest-TaggedBootDevicesTest_v242-2114446049-project-member', projectid='aeed1ca793154290b3390c9300844303', projectname='tempest-TaggedBootDevicesTest_v242-2114446049'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "dfa132bb-afe8-4b97-909b-816f3e916bfd", "address": "fa:16:3e:e3:af:b5", "network": {"id": "3fed2ebb-cfdf-471c-963f-f350742f2200", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1888324923-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa132bb-af", "ovs_interfaceid": "dfa132bb-afe8-4b97-909b-816f3e916bfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "939862e4-4e68-484c-bbcd-95faf922a641", "address": "fa:16:3e:2d:d8:ee", "network": {"id": "07811dc4-ff38-4d15-a899-007fdeea12e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-974977857", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap939862e4-4e", "ovs_interfaceid": "939862e4-4e68-484c-bbcd-95faf922a641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7896c8d5-ea83-4141-8344-6b557e45d6d1", "address": "fa:16:3e:e4:05:23", "network": {"id": "07811dc4-ff38-4d15-a899-007fdeea12e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-974977857", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7896c8d5-ea", "ovs_interfaceid": "7896c8d5-ea83-4141-8344-6b557e45d6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "78c3c570-3a3b-484e-bc76-7d91862ff0d4", "address": "fa:16:3e:20:fa:56", "network": {"id": "07811dc4-ff38-4d15-a899-007fdeea12e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-974977857", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap78c3c570-3a", "ovs_interfaceid": "78c3c570-3a3b-484e-bc76-7d91862ff0d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "766c9d77-3578-4071-b0eb-f2a929ee0445", "address": "fa:16:3e:0a:6e:61", "network": {"id": "07811dc4-ff38-4d15-a899-007fdeea12e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-974977857", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap766c9d77-35", "ovs_interfaceid": "766c9d77-3578-4071-b0eb-f2a929ee0445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d868b893-10e8-42d1-872f-bf4b9e8d3659", "address": "fa:16:3e:59:94:6e", "network": {"id": "7de6eee4-0d64-4194-b730-0b1e9ac928b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-2098291513", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd868b893-10", "ovs_interfaceid": "d868b893-10e8-42d1-872f-bf4b9e8d3659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9ca5546d-4b44-4470-92d7-08800876e89b", "address": "fa:16:3e:25:2d:87", "network": {"id": "7de6eee4-0d64-4194-b730-0b1e9ac928b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-2098291513", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca5546d-4b", "ovs_interfaceid": "9ca5546d-4b44-4470-92d7-08800876e89b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933305.553004) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:55:05.558206 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:55:05.559480 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:55:05.560514 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:55:05.560771 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:55:05.562048 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:55:05.562520 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:55:05.562720 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:55:05.562863 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:55:05.563049 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:55:05.564057 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:55:05.564236 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:55:05.564478 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:55:05.564624 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:55:05.564763 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:55:05.564888 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:55:05.565003 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:55:05.577096 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:55:05.577527 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9', 'iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cb9e2524-4a7c-470b-9095-1bc5e1a51eb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:55:05.577712 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:55:05.578144 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:55:05.578374 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9', 'iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cb9e2524-4a7c-470b-9095-1bc5e1a51eb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:55:05.589836 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4a1856a2-e351-40ce-bfe6-f7cb16a61687 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Lock "interface-e73ac672-0911-4e4d-8a85-9b635a9e836f-0af5589b-ed4a-40e6-b1f9-1e52f80285b9" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 6.409s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:05.595542 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:55:05.596044 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:55:05.596570 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:55:05.596768 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:55:05.597212 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:55:05.597463 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:55:05.610442 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:05.616101 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:55:05.616101 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:05.617174 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:55:05.617174 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:05.631561 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9] added
May 28 01:55:05.631561 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:55:05.631561 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:55:05.631561 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:55:05.631561 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:55:05.631561 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:55:05.631561 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:05.631801 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:55:05.631939 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0345(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:55:05.632105 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:55:05.634530 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9] added
May 28 01:55:05.634530 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:55:05.634530 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:55:05.634530 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:55:05.634530 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:55:05.634530 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:55:05.634530 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:05.634698 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:55:05.634829 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.038(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:55:05.634983 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:55:05.808070 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Updating instance_info_cache with network_info: [{"id": "b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e", "address": "fa:16:3e:e1:01:d3", "network": {"id": "2ee43c4e-569f-4726-9700-add40d768203", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ba381dad8364a488a98b80c04cce8fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bf1e5b-d3", "ovs_interfaceid": "b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:55:06.006753 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:55:06.006972 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:55:06.050607 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-f7f1cd54-d7fd-4687-a46b-5f0dfcbf3369 req-94aac93c-c719-42ff-83e4-d1ceea48c63e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:06.310333 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Releasing lock "refresh_cache-533f5dcc-2e48-4280-84b3-facb02dea136" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:55:06.310790 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Instance network_info: |[{"id": "b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e", "address": "fa:16:3e:e1:01:d3", "network": {"id": "2ee43c4e-569f-4726-9700-add40d768203", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ba381dad8364a488a98b80c04cce8fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bf1e5b-d3", "ovs_interfaceid": "b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:55:06.311041 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ed5b09bc-74f8-4ded-885f-dc654d2ce7d1 req-6f20ce64-6944-4c9d-99df-7ec443c57d95 service nova] Acquired lock "refresh_cache-533f5dcc-2e48-4280-84b3-facb02dea136" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:55:06.311283 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-ed5b09bc-74f8-4ded-885f-dc654d2ce7d1 req-6f20ce64-6944-4c9d-99df-7ec443c57d95 service nova] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Refreshing network info cache for port b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:55:06.403878 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-f7f1cd54-d7fd-4687-a46b-5f0dfcbf3369 req-94aac93c-c719-42ff-83e4-d1ceea48c63e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:06.509621 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:55:06.601320 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-f7f1cd54-d7fd-4687-a46b-5f0dfcbf3369 req-94aac93c-c719-42ff-83e4-d1ceea48c63e service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Updated VIF entry in instance network info cache for port 9ca5546d-4b44-4470-92d7-08800876e89b. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:55:06.601815 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-f7f1cd54-d7fd-4687-a46b-5f0dfcbf3369 req-94aac93c-c719-42ff-83e4-d1ceea48c63e service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Updating instance_info_cache with network_info: [{"id": "dfa132bb-afe8-4b97-909b-816f3e916bfd", "address": "fa:16:3e:e3:af:b5", "network": {"id": "3fed2ebb-cfdf-471c-963f-f350742f2200", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1888324923-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa132bb-af", "ovs_interfaceid": "dfa132bb-afe8-4b97-909b-816f3e916bfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "939862e4-4e68-484c-bbcd-95faf922a641", "address": "fa:16:3e:2d:d8:ee", "network": {"id": "07811dc4-ff38-4d15-a899-007fdeea12e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-974977857", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap939862e4-4e", "ovs_interfaceid": "939862e4-4e68-484c-bbcd-95faf922a641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7896c8d5-ea83-4141-8344-6b557e45d6d1", "address": "fa:16:3e:e4:05:23", "network": {"id": "07811dc4-ff38-4d15-a899-007fdeea12e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-974977857", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7896c8d5-ea", "ovs_interfaceid": "7896c8d5-ea83-4141-8344-6b557e45d6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "78c3c570-3a3b-484e-bc76-7d91862ff0d4", "address": "fa:16:3e:20:fa:56", "network": {"id": "07811dc4-ff38-4d15-a899-007fdeea12e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-974977857", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap78c3c570-3a", "ovs_interfaceid": "78c3c570-3a3b-484e-bc76-7d91862ff0d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "766c9d77-3578-4071-b0eb-f2a929ee0445", "address": "fa:16:3e:0a:6e:61", "network": {"id": "07811dc4-ff38-4d15-a899-007fdeea12e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-974977857", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap766c9d77-35", "ovs_interfaceid": "766c9d77-3578-4071-b0eb-f2a929ee0445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d868b893-10e8-42d1-872f-bf4b9e8d3659", "address": "fa:16:3e:59:94:6e", "network": {"id": "7de6eee4-0d64-4194-b730-0b1e9ac928b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-2098291513", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd868b893-10", "ovs_interfaceid": "d868b893-10e8-42d1-872f-bf4b9e8d3659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9ca5546d-4b44-4470-92d7-08800876e89b", "address": "fa:16:3e:25:2d:87", "network": {"id": "7de6eee4-0d64-4194-b730-0b1e9ac928b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-2098291513", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca5546d-4b", "ovs_interfaceid": "9ca5546d-4b44-4470-92d7-08800876e89b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:55:06.632516 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:55:06.635525 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:55:06.646171 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:55:06.646171 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:55:06.656264 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:55:06.656264 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:06.662567 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:06.669004 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:06.677174 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:06.677174 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:06.677174 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:55:06.677174 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsi session list stdout=tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:06.677174 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:06.677174 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:55:06.687259 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:06.687259 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:06.687259 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:55:06.687508 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsi session list stdout=tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:06.687508 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:06.687508 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:55:06.691829 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:55:06.691957 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:55:06.692127 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] No VIF found with MAC fa:16:3e:76:82:b0, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:55:06.692613 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Using config drive
May 28 01:55:06.707551 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9, portal: 192.168.40.100,3260]
May 28 01:55:06.707551 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9, portal: 192.168.40.100,3260] successful.
May 28 01:55:06.707551 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:06.721092 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:06.729507 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9, portal: 192.168.50.100,3260]
May 28 01:55:06.729507 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9, portal: 192.168.50.100,3260] successful.
May 28 01:55:06.729507 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:06.742233 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:06.742233 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:06.742233 np0000001583 nova-compute[98241]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:06.742233 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:06.742233 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:55:06.742233 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsi session list stdout=tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:06.742233 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:06.742233 np0000001583 nova-compute[98241]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:06.742233 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:06.742233 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:55:06.742233 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.142s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:55:06.742233 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:55:06.742233 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] HCTL ('7', '-', '-', 0) found on session 34 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:55:06.742233 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:55:06.747747 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:06.770031 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:06.770031 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:06.770031 np0000001583 nova-compute[98241]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:06.770031 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:06.770031 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:55:06.770031 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsi session list stdout=tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:06.770031 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:06.770031 np0000001583 nova-compute[98241]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:06.770031 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:06.770031 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:55:06.770031 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.173s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:55:06.770906 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:55:06.770906 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] HCTL ('8', '-', '-', 0) found on session 35 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:55:06.770906 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:55:06.771826 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Searching for a device in session 34 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:55:06.772010 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cb9e2524-4a7c-470b-9095-1bc5e1a51eb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:55:06.786646 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Searching for a device in session 35 and hctl ['8', '*', '*', 0] yield: None {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:55:06.813801 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-ed5b09bc-74f8-4ded-885f-dc654d2ce7d1 req-6f20ce64-6944-4c9d-99df-7ec443c57d95 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:07.023155 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.649s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:07.023631 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:55:07.105194 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f7f1cd54-d7fd-4687-a46b-5f0dfcbf3369 req-94aac93c-c719-42ff-83e4-d1ceea48c63e service nova] Releasing lock "refresh_cache-0cca8054-2a26-436f-93b8-ef28e452bd65" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:55:07.197765 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:07.217802 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-ed5b09bc-74f8-4ded-885f-dc654d2ce7d1 req-6f20ce64-6944-4c9d-99df-7ec443c57d95 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:07.239703 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e17219b6-8a34-42db-a5b2-759db3a53737 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Acquiring lock "e73ac672-0911-4e4d-8a85-9b635a9e836f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:07.239799 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e17219b6-8a34-42db-a5b2-759db3a53737 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Lock "e73ac672-0911-4e4d-8a85-9b635a9e836f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:07.239963 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e17219b6-8a34-42db-a5b2-759db3a53737 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Acquiring lock "e73ac672-0911-4e4d-8a85-9b635a9e836f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:07.240117 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e17219b6-8a34-42db-a5b2-759db3a53737 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Lock "e73ac672-0911-4e4d-8a85-9b635a9e836f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:07.240233 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e17219b6-8a34-42db-a5b2-759db3a53737 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Lock "e73ac672-0911-4e4d-8a85-9b635a9e836f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:07.249224 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-e17219b6-8a34-42db-a5b2-759db3a53737 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Terminating instance
May 28 01:55:07.351676 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Creating config drive at /opt/stack/data/nova/instances/d3135bb7-29cf-4819-9e83-1c45211901eb/disk.config
May 28 01:55:07.357518 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d3135bb7-29cf-4819-9e83-1c45211901eb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphqxopgs_ {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:07.414780 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-ed5b09bc-74f8-4ded-885f-dc654d2ce7d1 req-6f20ce64-6944-4c9d-99df-7ec443c57d95 service nova] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Updated VIF entry in instance network info cache for port b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:55:07.414780 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-ed5b09bc-74f8-4ded-885f-dc654d2ce7d1 req-6f20ce64-6944-4c9d-99df-7ec443c57d95 service nova] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Updating instance_info_cache with network_info: [{"id": "b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e", "address": "fa:16:3e:e1:01:d3", "network": {"id": "2ee43c4e-569f-4726-9700-add40d768203", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ba381dad8364a488a98b80c04cce8fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bf1e5b-d3", "ovs_interfaceid": "b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:55:07.420201 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d3135bb7-29cf-4819-9e83-1c45211901eb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphqxopgs_" returned: 0 in 0.063s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:07.532605 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:55:07.532839 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:55:07.533307 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:07.535072 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:07.610867 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b95b9664bbd944d3a55a061e1ec231ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261e17e4ed4445c887b71a705d46ad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:55:07.755203 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-e17219b6-8a34-42db-a5b2-759db3a53737 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:55:07.779679 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:07.785238 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:07.790243 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Searching for a device in session 35 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:55:07.790243 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'cb9e2524-4a7c-470b-9095-1bc5e1a51eb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:55:07.811663 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:07.817941 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:07.842845 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:07.852524 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:07.886046 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:07.919610 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ed5b09bc-74f8-4ded-885f-dc654d2ce7d1 req-6f20ce64-6944-4c9d-99df-7ec443c57d95 service nova] Releasing lock "refresh_cache-533f5dcc-2e48-4280-84b3-facb02dea136" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:55:07.934902 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:07.967633 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:07.969683 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:08.042090 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-22b8ca24-7eb6-48e0-ab8b-3defbfc6629b req-50170c8b-395b-43a0-878e-6dfe65e05695 service nova] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Received event network-vif-unplugged-ae1eb56b-d3c2-441b-9339-b2d96192924c {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:08.042090 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-22b8ca24-7eb6-48e0-ab8b-3defbfc6629b req-50170c8b-395b-43a0-878e-6dfe65e05695 service nova] Acquiring lock "e73ac672-0911-4e4d-8a85-9b635a9e836f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:08.042090 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-22b8ca24-7eb6-48e0-ab8b-3defbfc6629b req-50170c8b-395b-43a0-878e-6dfe65e05695 service nova] Lock "e73ac672-0911-4e4d-8a85-9b635a9e836f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:08.042090 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-22b8ca24-7eb6-48e0-ab8b-3defbfc6629b req-50170c8b-395b-43a0-878e-6dfe65e05695 service nova] Lock "e73ac672-0911-4e4d-8a85-9b635a9e836f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:08.042090 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-22b8ca24-7eb6-48e0-ab8b-3defbfc6629b req-50170c8b-395b-43a0-878e-6dfe65e05695 service nova] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] No waiting events found dispatching network-vif-unplugged-ae1eb56b-d3c2-441b-9339-b2d96192924c {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:55:08.042090 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-22b8ca24-7eb6-48e0-ab8b-3defbfc6629b req-50170c8b-395b-43a0-878e-6dfe65e05695 service nova] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Received event network-vif-unplugged-ae1eb56b-d3c2-441b-9339-b2d96192924c for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:55:08.042842 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:55:08.090533 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:08.177903 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:08.185345 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:08.199323 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:55:08.215450 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:55:08.246386 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:08.275291 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.998774806000029 future=<Future at 0x7724ec2d2ed0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:55:08.279060 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Instance destroyed successfully.
May 28 01:55:08.280102 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-e17219b6-8a34-42db-a5b2-759db3a53737 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Lazy-loading 'resources' on Instance uuid e73ac672-0911-4e4d-8a85-9b635a9e836f {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:55:08.292031 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:55:08.292656 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:55:08.303329 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:55:08.306117 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe63:2bb1', 'fe80::e43a:d5ff:fecc:27fe', 'fe80::fc16:3eff:fe94:7597', 'fe80::fc16:3eff:fe28:958e', 'fe80::3cc0:d1ff:fe7f:6a8', 'fe80::fc16:3eff:fe27:be54', 'fe80::a0e4:60ff:fe3f:73d6', 'fe80::fc16:3eff:fecc:f6fa', 'fe80::d4f7:45ff:fed0:14ad', 'fe80::fc16:3eff:fe76:82b0'] 
May 28 01:55:08.306117 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:55:08.306117 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:55:08.306117 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] <== get_connector_properties: return (105ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:55:08.306117 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Updating existing volume attachment record: 832c9521-5dd1-4ab5-9f86-a9f7864cec93 {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:55:08.385153 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Successfully created port: f242e691-1d28-43e0-b83a-2414c00958b8 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:55:08.542303 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-c444f805-33a4-47e7-b111-468e560331e2 req-9b7c7af3-0b36-4c75-bb8f-a5d9806fae38 service nova] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Received event network-vif-plugged-2ab83417-6d0d-4eb5-a96a-398a30c193d2 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:08.542551 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c444f805-33a4-47e7-b111-468e560331e2 req-9b7c7af3-0b36-4c75-bb8f-a5d9806fae38 service nova] Acquiring lock "d3135bb7-29cf-4819-9e83-1c45211901eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:08.542832 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c444f805-33a4-47e7-b111-468e560331e2 req-9b7c7af3-0b36-4c75-bb8f-a5d9806fae38 service nova] Lock "d3135bb7-29cf-4819-9e83-1c45211901eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:08.543008 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c444f805-33a4-47e7-b111-468e560331e2 req-9b7c7af3-0b36-4c75-bb8f-a5d9806fae38 service nova] Lock "d3135bb7-29cf-4819-9e83-1c45211901eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:08.545131 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-c444f805-33a4-47e7-b111-468e560331e2 req-9b7c7af3-0b36-4c75-bb8f-a5d9806fae38 service nova] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Processing event network-vif-plugged-2ab83417-6d0d-4eb5-a96a-398a30c193d2 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:55:08.547225 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:55:08.622452 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Found WWN 3300000003db33141 for multipath device dm-0 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:55:08.622906 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.045s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:55:08.623158 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] <== connect_volume: return (3045ms) {'type': 'block', 'scsi_wwn': '3300000003db33141', 'path': '/dev/dm-0', 'multipath_id': '3300000003db33141'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:55:08.623365 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000003db33141', 'path': '/dev/dm-0', 'multipath_id': '3300000003db33141'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:55:08.784153 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-e17219b6-8a34-42db-a5b2-759db3a53737 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:53:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2127810450',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-device-tagging-server-2127810450',id=11,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOgLraTEi6SiWvo5jslayVOBAKtkEEjh1jVuNw35Hn8cUQoGuB8wzuMiOMlFTlRtSvwVvTOnGa8VK88dE01Yrnrej50o+Hw4uQhAmKYoDt2ubT7eWDD6mkiN/JuIg389w==',key_name='tempest-keypair-1856182923',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:53:54Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='02ba6b7c1fd84a7c8ed4e9f086f83fa0',ramdisk_id='',reservation_id='r-htc032mq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1060566416',owner_user_name='tempest-TaggedAttachmentsTest-1060566416-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:53:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8df1e628989946dbafa89116b196c65b',uuid=e73ac672-0911-4e4d-8a85-9b635a9e836f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae1eb56b-d3c2-441b-9339-b2d96192924c", "address": "fa:16:3e:ca:36:a6", "network": {"id": "a6357868-368f-400d-b8c9-8e8843bdfdda", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1753538248-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "02ba6b7c1fd84a7c8ed4e9f086f83fa0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae1eb56b-d3", "ovs_interfaceid": "ae1eb56b-d3c2-441b-9339-b2d96192924c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:55:08.784402 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-e17219b6-8a34-42db-a5b2-759db3a53737 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Converting VIF {"id": "ae1eb56b-d3c2-441b-9339-b2d96192924c", "address": "fa:16:3e:ca:36:a6", "network": {"id": "a6357868-368f-400d-b8c9-8e8843bdfdda", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1753538248-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "02ba6b7c1fd84a7c8ed4e9f086f83fa0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae1eb56b-d3", "ovs_interfaceid": "ae1eb56b-d3c2-441b-9339-b2d96192924c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:55:08.785520 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-e17219b6-8a34-42db-a5b2-759db3a53737 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:36:a6,bridge_name='br-int',has_traffic_filtering=True,id=ae1eb56b-d3c2-441b-9339-b2d96192924c,network=Network(a6357868-368f-400d-b8c9-8e8843bdfdda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae1eb56b-d3') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:55:08.786709 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-e17219b6-8a34-42db-a5b2-759db3a53737 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:36:a6,bridge_name='br-int',has_traffic_filtering=True,id=ae1eb56b-d3c2-441b-9339-b2d96192924c,network=Network(a6357868-368f-400d-b8c9-8e8843bdfdda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae1eb56b-d3') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:55:08.788177 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:08.788493 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae1eb56b-d3, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:08.790661 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:08.791714 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:55:08.792343 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:08.793172 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:08.793341 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=45f760f8-a222-45d4-9eba-7efaf402c1ed) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:08.794455 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:55:08.797216 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:08.802897 np0000001583 nova-compute[98241]: INFO os_vif [None req-e17219b6-8a34-42db-a5b2-759db3a53737 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:36:a6,bridge_name='br-int',has_traffic_filtering=True,id=ae1eb56b-d3c2-441b-9339-b2d96192924c,network=Network(a6357868-368f-400d-b8c9-8e8843bdfdda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae1eb56b-d3')
May 28 01:55:08.802897 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-e17219b6-8a34-42db-a5b2-759db3a53737 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Deleting instance files /opt/stack/data/nova/instances/e73ac672-0911-4e4d-8a85-9b635a9e836f_del
May 28 01:55:08.803275 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-e17219b6-8a34-42db-a5b2-759db3a53737 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Deletion of /opt/stack/data/nova/instances/e73ac672-0911-4e4d-8a85-9b635a9e836f_del complete
May 28 01:55:09.015827 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933309.0153244, d3135bb7-29cf-4819-9e83-1c45211901eb => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:55:09.016333 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:55:09.016627 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] VM Started (Lifecycle Event)
May 28 01:55:09.019069 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:55:09.021399 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Instance spawned successfully.
May 28 01:55:09.021618 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:55:09.062398 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Successfully updated port: f242e691-1d28-43e0-b83a-2414c00958b8 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:55:09.130151 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:55:09.130549 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b', 'iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7d62e380-a6af-45e6-aefa-214f97c0760b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:55:09.130703 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:55:09.131089 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:55:09.131287 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b', 'iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7d62e380-a6af-45e6-aefa-214f97c0760b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:55:09.141455 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:55:09.141994 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:55:09.142438 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:55:09.142666 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:55:09.143308 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:55:09.143308 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:55:09.156743 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:55:09.156743 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:09.165303 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:55:09.165303 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:09.175394 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b] added
May 28 01:55:09.175394 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:55:09.175394 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:55:09.175394 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:55:09.175394 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:55:09.175394 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:55:09.175394 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:09.175814 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:55:09.175814 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0331(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:55:09.175912 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:55:09.177909 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b] added
May 28 01:55:09.177909 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:55:09.177909 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:55:09.177909 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:55:09.177909 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:55:09.177909 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:55:09.177909 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:09.178223 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:55:09.178260 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0351(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:55:09.178403 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:55:09.271841 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Acquiring lock "ea9459ae-6246-4d11-b46b-733449884b1b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:09.272281 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "ea9459ae-6246-4d11-b46b-733449884b1b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:09.309612 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-e17219b6-8a34-42db-a5b2-759db3a53737 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Took 1.55 seconds to destroy the instance on the hypervisor.
May 28 01:55:09.310216 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-e17219b6-8a34-42db-a5b2-759db3a53737 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:55:09.310570 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:55:09.310690 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:55:09.310982 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:09.401359 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:09.522311 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:55:09.526364 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:55:09.535134 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:55:09.535134 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:55:09.535134 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:55:09.535134 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:55:09.535134 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:55:09.535134 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:55:09.564833 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:55:09.567058 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Acquiring lock "refresh_cache-8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:55:09.567628 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:55:09.567934 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Creating image(s)
May 28 01:55:09.569622 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Acquired lock "refresh_cache-8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:55:09.569622 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Acquiring lock "/opt/stack/data/nova/instances/8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:09.569622 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:55:09.570491 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lock "/opt/stack/data/nova/instances/8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:09.571452 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lock "/opt/stack/data/nova/instances/8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:09.572762 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:55:09.579384 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:55:09.579615 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:09.687774 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.108s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:09.688387 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:09.689101 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:09.689791 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:55:09.694807 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:55:09.695336 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:09.777872 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:55:09.799295 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.101s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:09.799295 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:09.842436 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4/disk 1073741824" returned: 0 in 0.046s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:09.843120 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.154s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:09.843469 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:09.924012 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.080s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:09.924411 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:55:09.924722 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:10.023719 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:10.026064 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Cannot resize image /opt/stack/data/nova/instances/8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:55:10.026584 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:55:10.028840 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Ensure instance console log exists: /opt/stack/data/nova/instances/8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:55:10.028840 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:10.028840 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:10.028840 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:10.032445 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:55:10.032933 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933310.0326903, d3135bb7-29cf-4819-9e83-1c45211901eb => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:55:10.033152 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] VM Paused (Lifecycle Event)
May 28 01:55:10.045157 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Took 7.78 seconds to spawn the instance on the hypervisor.
May 28 01:55:10.045393 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:55:10.117872 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-966ce95c-d689-4965-98c1-814287252113 req-d23afd0a-3a9c-4e8a-b5a6-69df8eee7510 service nova] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Received event network-vif-deleted-ae1eb56b-d3c2-441b-9339-b2d96192924c {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:10.122401 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-966ce95c-d689-4965-98c1-814287252113 req-d23afd0a-3a9c-4e8a-b5a6-69df8eee7510 service nova] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Neutron deleted interface ae1eb56b-d3c2-441b-9339-b2d96192924c; detaching it from the instance and deleting it from the info cache
May 28 01:55:10.123766 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-966ce95c-d689-4965-98c1-814287252113 req-d23afd0a-3a9c-4e8a-b5a6-69df8eee7510 service nova] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Detach interface failed, port_id=ae1eb56b-d3c2-441b-9339-b2d96192924c, reason: Instance e73ac672-0911-4e4d-8a85-9b635a9e836f could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:55:10.144371 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-3b57a499-a032-42e3-994f-221b8f154500 req-87b46ed1-0ee9-4e46-bae8-3af756aa8a2a service nova] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Received event network-vif-unplugged-ae1eb56b-d3c2-441b-9339-b2d96192924c {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:10.148493 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-3b57a499-a032-42e3-994f-221b8f154500 req-87b46ed1-0ee9-4e46-bae8-3af756aa8a2a service nova] Acquiring lock "e73ac672-0911-4e4d-8a85-9b635a9e836f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:10.148707 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-3b57a499-a032-42e3-994f-221b8f154500 req-87b46ed1-0ee9-4e46-bae8-3af756aa8a2a service nova] Lock "e73ac672-0911-4e4d-8a85-9b635a9e836f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:10.148850 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-3b57a499-a032-42e3-994f-221b8f154500 req-87b46ed1-0ee9-4e46-bae8-3af756aa8a2a service nova] Lock "e73ac672-0911-4e4d-8a85-9b635a9e836f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:10.149012 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-3b57a499-a032-42e3-994f-221b8f154500 req-87b46ed1-0ee9-4e46-bae8-3af756aa8a2a service nova] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] No waiting events found dispatching network-vif-unplugged-ae1eb56b-d3c2-441b-9339-b2d96192924c {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:55:10.149641 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-3b57a499-a032-42e3-994f-221b8f154500 req-87b46ed1-0ee9-4e46-bae8-3af756aa8a2a service nova] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Received event network-vif-unplugged-ae1eb56b-d3c2-441b-9339-b2d96192924c for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:55:10.169970 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:55:10.176370 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:55:10.179436 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:55:10.190101 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:55:10.190101 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:55:10.198980 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:55:10.198980 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:10.211163 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:10.219265 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:10.228919 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:10.228919 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:10.228919 np0000001583 nova-compute[98241]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:10.228919 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:10.228919 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:55:10.229213 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsi session list stdout=tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:10.229213 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:10.229213 np0000001583 nova-compute[98241]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:10.229213 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:10.229213 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:55:10.242116 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:10.242116 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:10.242116 np0000001583 nova-compute[98241]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:10.242116 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:10.242116 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:55:10.243156 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsi session list stdout=tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:10.243156 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:10.243156 np0000001583 nova-compute[98241]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:10.243156 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:10.243156 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:55:10.274366 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b, portal: 192.168.40.100,3260]
May 28 01:55:10.274366 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b, portal: 192.168.40.100,3260] successful.
May 28 01:55:10.274366 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:10.283112 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b, portal: 192.168.50.100,3260]
May 28 01:55:10.283112 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b, portal: 192.168.50.100,3260] successful.
May 28 01:55:10.283112 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:10.288669 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:10.295166 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:10.315814 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:10.315814 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:10.315814 np0000001583 nova-compute[98241]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:10.315814 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:10.315814 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:10.315814 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:10.315814 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:55:10.316131 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsi session list stdout=tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:10.316131 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:10.316131 np0000001583 nova-compute[98241]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:10.316131 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:10.316131 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:10.316131 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:10.316131 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:55:10.317182 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.174s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:55:10.318415 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:10.318415 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:10.318415 np0000001583 nova-compute[98241]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:10.318415 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:10.318415 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:10.318415 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:10.318415 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:55:10.318774 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:55:10.319042 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsi session list stdout=tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:10.319042 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:10.319042 np0000001583 nova-compute[98241]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:10.319042 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:10.319042 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:10.319042 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:10.319042 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:55:10.319437 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.176s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:55:10.319538 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:55:10.321722 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] HCTL ('11', '-', '-', 0) found on session 36 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:55:10.321921 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:55:10.322490 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] HCTL ('12', '-', '-', 0) found on session 37 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:55:10.323428 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:55:10.343306 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Searching for a device in session 36 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:55:10.343423 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7d62e380-a6af-45e6-aefa-214f97c0760b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:55:10.358231 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Searching for a device in session 37 and hctl ['12', '*', '*', 0] yield: None {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:55:10.363552 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:10.363776 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:10.366945 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:55:10.367119 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Claim successful on node np0000001583
May 28 01:55:10.401167 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:10.447239 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:55:10.448811 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:55:10.448811 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Creating image(s)
May 28 01:55:10.449251 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Did not create local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 01:55:10.449422 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Ensure instance console log exists: /opt/stack/data/nova/instances/533f5dcc-2e48-4280-84b3-facb02dea136/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:55:10.449693 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:10.449904 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:10.450099 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:10.451245 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Start _get_guest_xml network_info=[{"id": "b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e", "address": "fa:16:3e:e1:01:d3", "network": {"id": "2ee43c4e-569f-4726-9700-add40d768203", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ba381dad8364a488a98b80c04cce8fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bf1e5b-d3", "ovs_interfaceid": "b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797', 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fab00939-514d-46f8-a4d7-5a7c78e44797', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '533f5dcc-2e48-4280-84b3-facb02dea136', 'attached_at': '', 'detached_at': '', 'volume_id': 'fab00939-514d-46f8-a4d7-5a7c78e44797', 'serial': 'fab00939-514d-46f8-a4d7-5a7c78e44797'}, 'delete_on_termination': True, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '832c9521-5dd1-4ab5-9f86-a9f7864cec93', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:55:10.456264 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:55:10.457512 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-516014259', uuid='533f5dcc-2e48-4280-84b3-facb02dea136'), owner=OwnerMeta(userid='c3a7b14e31ee40cf9e4f4bba084ccaa5', username='tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member', projectid='2ba381dad8364a488a98b80c04cce8fb', projectname='tempest-ServerBootFromVolumeStableRescueTest-1211567633'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e", "address": "fa:16:3e:e1:01:d3", "network": {"id": "2ee43c4e-569f-4726-9700-add40d768203", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ba381dad8364a488a98b80c04cce8fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bf1e5b-d3", "ovs_interfaceid": "b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933310.4569554) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:55:10.460367 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:55:10.461525 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:55:10.462367 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:55:10.462745 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:55:10.464218 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:55:10.465114 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:55:10.465114 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:55:10.465114 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:55:10.466692 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:55:10.466692 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:55:10.466692 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:55:10.466692 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:55:10.466692 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:55:10.466692 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:55:10.466692 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:55:10.466692 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:55:10.480327 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:55:10.481303 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797', 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fab00939-514d-46f8-a4d7-5a7c78e44797', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:55:10.481303 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:55:10.499873 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:55:10.536454 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:55:10.538487 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933310.5382123, d3135bb7-29cf-4819-9e83-1c45211901eb => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:55:10.538713 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] VM Resumed (Lifecycle Event)
May 28 01:55:10.562809 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Took 13.64 seconds to build instance.
May 28 01:55:10.595166 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Updating instance_info_cache with network_info: [{"id": "f242e691-1d28-43e0-b83a-2414c00958b8", "address": "fa:16:3e:5c:c2:5f", "network": {"id": "b31b6f30-3b80-465d-8203-e6f4c16c758c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1195490498-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "261e17e4ed4445c887b71a705d46ad7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf242e691-1d", "ovs_interfaceid": "f242e691-1d28-43e0-b83a-2414c00958b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:55:10.644324 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-419d687f-2f1a-4631-8723-58523c6c66a4 req-60f54a2c-e3e3-46ee-a1b7-451f0c71ffe4 service nova] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Received event network-vif-plugged-2ab83417-6d0d-4eb5-a96a-398a30c193d2 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:10.644495 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-419d687f-2f1a-4631-8723-58523c6c66a4 req-60f54a2c-e3e3-46ee-a1b7-451f0c71ffe4 service nova] Acquiring lock "d3135bb7-29cf-4819-9e83-1c45211901eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:10.644733 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-419d687f-2f1a-4631-8723-58523c6c66a4 req-60f54a2c-e3e3-46ee-a1b7-451f0c71ffe4 service nova] Lock "d3135bb7-29cf-4819-9e83-1c45211901eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:10.644901 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-419d687f-2f1a-4631-8723-58523c6c66a4 req-60f54a2c-e3e3-46ee-a1b7-451f0c71ffe4 service nova] Lock "d3135bb7-29cf-4819-9e83-1c45211901eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:10.645060 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-419d687f-2f1a-4631-8723-58523c6c66a4 req-60f54a2c-e3e3-46ee-a1b7-451f0c71ffe4 service nova] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] No waiting events found dispatching network-vif-plugged-2ab83417-6d0d-4eb5-a96a-398a30c193d2 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:55:10.645427 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-419d687f-2f1a-4631-8723-58523c6c66a4 req-60f54a2c-e3e3-46ee-a1b7-451f0c71ffe4 service nova] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Received unexpected event network-vif-plugged-2ab83417-6d0d-4eb5-a96a-398a30c193d2 for instance with vm_state active and task_state None.
May 28 01:55:10.645427 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-419d687f-2f1a-4631-8723-58523c6c66a4 req-60f54a2c-e3e3-46ee-a1b7-451f0c71ffe4 service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Received event network-changed-f242e691-1d28-43e0-b83a-2414c00958b8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:10.645512 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-419d687f-2f1a-4631-8723-58523c6c66a4 req-60f54a2c-e3e3-46ee-a1b7-451f0c71ffe4 service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Refreshing instance network info cache due to event network-changed-f242e691-1d28-43e0-b83a-2414c00958b8. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:55:10.648171 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-419d687f-2f1a-4631-8723-58523c6c66a4 req-60f54a2c-e3e3-46ee-a1b7-451f0c71ffe4 service nova] Acquiring lock "refresh_cache-8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:55:11.002781 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Took 1.69 seconds to deallocate network for instance.
May 28 01:55:11.041887 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:55:11.043213 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:55:11.062092 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Lock "d3135bb7-29cf-4819-9e83-1c45211901eb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.164s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:11.098116 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Releasing lock "refresh_cache-8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:55:11.098600 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Instance network_info: |[{"id": "f242e691-1d28-43e0-b83a-2414c00958b8", "address": "fa:16:3e:5c:c2:5f", "network": {"id": "b31b6f30-3b80-465d-8203-e6f4c16c758c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1195490498-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "261e17e4ed4445c887b71a705d46ad7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf242e691-1d", "ovs_interfaceid": "f242e691-1d28-43e0-b83a-2414c00958b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:55:11.099027 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-419d687f-2f1a-4631-8723-58523c6c66a4 req-60f54a2c-e3e3-46ee-a1b7-451f0c71ffe4 service nova] Acquired lock "refresh_cache-8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:55:11.101093 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Start _get_guest_xml network_info=[{"id": "f242e691-1d28-43e0-b83a-2414c00958b8", "address": "fa:16:3e:5c:c2:5f", "network": {"id": "b31b6f30-3b80-465d-8203-e6f4c16c758c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1195490498-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "261e17e4ed4445c887b71a705d46ad7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf242e691-1d", "ovs_interfaceid": "f242e691-1d28-43e0-b83a-2414c00958b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:55:11.101882 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-419d687f-2f1a-4631-8723-58523c6c66a4 req-60f54a2c-e3e3-46ee-a1b7-451f0c71ffe4 service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Refreshing network info cache for port f242e691-1d28-43e0-b83a-2414c00958b8 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:55:11.104612 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:55:11.105676 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-2789214', uuid='8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4'), owner=OwnerMeta(userid='b95b9664bbd944d3a55a061e1ec231ec', username='tempest-ServerStableDeviceRescueTest-1096447838-project-member', projectid='261e17e4ed4445c887b71a705d46ad7d', projectname='tempest-ServerStableDeviceRescueTest-1096447838'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f242e691-1d28-43e0-b83a-2414c00958b8", "address": "fa:16:3e:5c:c2:5f", "network": {"id": "b31b6f30-3b80-465d-8203-e6f4c16c758c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1195490498-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "261e17e4ed4445c887b71a705d46ad7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf242e691-1d", "ovs_interfaceid": "f242e691-1d28-43e0-b83a-2414c00958b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933311.105386) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:55:11.106537 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:55:11.106909 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:55:11.107684 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:55:11.107879 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:55:11.109941 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:55:11.110289 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:55:11.110459 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:55:11.110500 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:55:11.110607 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:55:11.110698 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:55:11.110796 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:55:11.110975 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:55:11.111069 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:55:11.111254 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:55:11.111364 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:55:11.111503 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:55:11.123836 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:54:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2789214',display_name='tempest-ServerStableDeviceRescueTest-server-2789214',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-serverstabledevicerescuetest-server-2789214',id=19,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN0i9Cbg/YfGFJTMA6Mjy+1949HN9zlsGRESiP6RbbKnMnzjD65aO38IDSCgwyQVXHEZs/nSr/IWCD0NrFHvkF+28T0YYBxOg7wkJVfd52pVGPBaDLMkFt5gcpkneL3l6g==',key_name='tempest-keypair-109338498',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='261e17e4ed4445c887b71a705d46ad7d',ramdisk_id='',reservation_id='r-6j08k7e9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1096447838',owner_user_name='tempest-ServerStableDeviceRescueTest-1096447838-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:55:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b95b9664bbd944d3a55a061e1ec231ec',uuid=8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f242e691-1d28-43e0-b83a-2414c00958b8", "address": "fa:16:3e:5c:c2:5f", "network": {"id": "b31b6f30-3b80-465d-8203-e6f4c16c758c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1195490498-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "261e17e4ed4445c887b71a705d46ad7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf242e691-1d", "ovs_interfaceid": "f242e691-1d28-43e0-b83a-2414c00958b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:55:11.124065 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Converting VIF {"id": "f242e691-1d28-43e0-b83a-2414c00958b8", "address": "fa:16:3e:5c:c2:5f", "network": {"id": "b31b6f30-3b80-465d-8203-e6f4c16c758c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1195490498-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "261e17e4ed4445c887b71a705d46ad7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf242e691-1d", "ovs_interfaceid": "f242e691-1d28-43e0-b83a-2414c00958b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:55:11.124658 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:c2:5f,bridge_name='br-int',has_traffic_filtering=True,id=f242e691-1d28-43e0-b83a-2414c00958b8,network=Network(b31b6f30-3b80-465d-8203-e6f4c16c758c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf242e691-1d') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:55:11.125299 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:55:11.354923 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Searching for a device in session 37 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:55:11.355096 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7d62e380-a6af-45e6-aefa-214f97c0760b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:55:11.508669 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e17219b6-8a34-42db-a5b2-759db3a53737 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:11.603861 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-419d687f-2f1a-4631-8723-58523c6c66a4 req-60f54a2c-e3e3-46ee-a1b7-451f0c71ffe4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:11.627802 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] End _get_guest_xml xml=<domain type="qemu">
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:   <uuid>8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4</uuid>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:   <name>instance-00000013</name>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-2789214</nova:name>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:55:11</nova:creationTime>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:         <nova:user uuid="b95b9664bbd944d3a55a061e1ec231ec">tempest-ServerStableDeviceRescueTest-1096447838-project-member</nova:user>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:         <nova:project uuid="261e17e4ed4445c887b71a705d46ad7d">tempest-ServerStableDeviceRescueTest-1096447838</nova:project>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:         <nova:port uuid="f242e691-1d28-43e0-b83a-2414c00958b8">
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:     <system>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:       <entry name="serial">8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4</entry>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:       <entry name="uuid">8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4</entry>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:     </system>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:   <os>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:   </os>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:   <features>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:   </features>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:   <devices>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4/disk"/>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:     </disk>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4/disk.config"/>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:     </disk>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:5c:c2:5f"/>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:       <target dev="tapf242e691-1d"/>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:     </interface>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4/console.log" append="off"/>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:     </serial>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:     <video>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:     </video>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:     </rng>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:   </devices>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]: </domain>
May 28 01:55:11.627802 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:55:11.629479 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Preparing to wait for external event network-vif-plugged-f242e691-1d28-43e0-b83a-2414c00958b8 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:55:11.629479 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Acquiring lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:11.629479 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:11.629479 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:11.629479 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:54:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2789214',display_name='tempest-ServerStableDeviceRescueTest-server-2789214',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-serverstabledevicerescuetest-server-2789214',id=19,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN0i9Cbg/YfGFJTMA6Mjy+1949HN9zlsGRESiP6RbbKnMnzjD65aO38IDSCgwyQVXHEZs/nSr/IWCD0NrFHvkF+28T0YYBxOg7wkJVfd52pVGPBaDLMkFt5gcpkneL3l6g==',key_name='tempest-keypair-109338498',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='261e17e4ed4445c887b71a705d46ad7d',ramdisk_id='',reservation_id='r-6j08k7e9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1096447838',owner_user_name='tempest-ServerStableDeviceRescueTest-1096447838-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:55:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b95b9664bbd944d3a55a061e1ec231ec',uuid=8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f242e691-1d28-43e0-b83a-2414c00958b8", "address": "fa:16:3e:5c:c2:5f", "network": {"id": "b31b6f30-3b80-465d-8203-e6f4c16c758c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1195490498-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "261e17e4ed4445c887b71a705d46ad7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf242e691-1d", "ovs_interfaceid": "f242e691-1d28-43e0-b83a-2414c00958b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:55:11.629479 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Converting VIF {"id": "f242e691-1d28-43e0-b83a-2414c00958b8", "address": "fa:16:3e:5c:c2:5f", "network": {"id": "b31b6f30-3b80-465d-8203-e6f4c16c758c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1195490498-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "261e17e4ed4445c887b71a705d46ad7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf242e691-1d", "ovs_interfaceid": "f242e691-1d28-43e0-b83a-2414c00958b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:55:11.630494 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:c2:5f,bridge_name='br-int',has_traffic_filtering=True,id=f242e691-1d28-43e0-b83a-2414c00958b8,network=Network(b31b6f30-3b80-465d-8203-e6f4c16c758c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf242e691-1d') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:55:11.630902 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:c2:5f,bridge_name='br-int',has_traffic_filtering=True,id=f242e691-1d28-43e0-b83a-2414c00958b8,network=Network(b31b6f30-3b80-465d-8203-e6f4c16c758c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf242e691-1d') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:55:11.631404 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:11.631710 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:11.631956 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:55:11.632757 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:11.632940 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '64eb6968-493b-545a-9b5a-395aed5f5244', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:11.634432 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:11.636639 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:55:11.636639 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:11.639480 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:11.639535 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf242e691-1d, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:11.639847 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf242e691-1d, col_values=(('qos', UUID('22b2c1ed-be91-4835-a9cb-60c436e1070a')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:11.639990 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf242e691-1d, col_values=(('external_ids', {'iface-id': 'f242e691-1d28-43e0-b83a-2414c00958b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:c2:5f', 'vm-uuid': '8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:11.641833 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:11.642929 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:55:11.649132 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:11.650283 np0000001583 nova-compute[98241]: INFO os_vif [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:c2:5f,bridge_name='br-int',has_traffic_filtering=True,id=f242e691-1d28-43e0-b83a-2414c00958b8,network=Network(b31b6f30-3b80-465d-8203-e6f4c16c758c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf242e691-1d')
May 28 01:55:11.891677 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-53dfcf35-617f-42b9-9840-b509c317cf14 tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Acquiring lock "d3135bb7-29cf-4819-9e83-1c45211901eb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:11.892152 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-53dfcf35-617f-42b9-9840-b509c317cf14 tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Lock "d3135bb7-29cf-4819-9e83-1c45211901eb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:11.894408 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-53dfcf35-617f-42b9-9840-b509c317cf14 tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Acquiring lock "d3135bb7-29cf-4819-9e83-1c45211901eb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:11.894408 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-53dfcf35-617f-42b9-9840-b509c317cf14 tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Lock "d3135bb7-29cf-4819-9e83-1c45211901eb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:11.894408 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-53dfcf35-617f-42b9-9840-b509c317cf14 tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Lock "d3135bb7-29cf-4819-9e83-1c45211901eb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:11.896049 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-53dfcf35-617f-42b9-9840-b509c317cf14 tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Terminating instance
May 28 01:55:11.968358 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-419d687f-2f1a-4631-8723-58523c6c66a4 req-60f54a2c-e3e3-46ee-a1b7-451f0c71ffe4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:12.053661 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:55:12.053981 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:55:12.157020 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-419d687f-2f1a-4631-8723-58523c6c66a4 req-60f54a2c-e3e3-46ee-a1b7-451f0c71ffe4 service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Updated VIF entry in instance network info cache for port f242e691-1d28-43e0-b83a-2414c00958b8. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:55:12.157342 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-419d687f-2f1a-4631-8723-58523c6c66a4 req-60f54a2c-e3e3-46ee-a1b7-451f0c71ffe4 service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Updating instance_info_cache with network_info: [{"id": "f242e691-1d28-43e0-b83a-2414c00958b8", "address": "fa:16:3e:5c:c2:5f", "network": {"id": "b31b6f30-3b80-465d-8203-e6f4c16c758c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1195490498-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "261e17e4ed4445c887b71a705d46ad7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf242e691-1d", "ovs_interfaceid": "f242e691-1d28-43e0-b83a-2414c00958b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:55:12.163397 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Found WWN 3300000002612402b for multipath device dm-6 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:55:12.163773 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:55:12.164024 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] <== connect_volume: return (3033ms) {'type': 'block', 'scsi_wwn': '3300000002612402b', 'path': '/dev/dm-6', 'multipath_id': '3300000002612402b'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:55:12.164241 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002612402b', 'path': '/dev/dm-6', 'multipath_id': '3300000002612402b'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:55:12.165366 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.684s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:55:12.165747 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797', 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fab00939-514d-46f8-a4d7-5a7c78e44797', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:55:12.179099 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:55:12.179998 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:55:12.180832 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:55:12.181089 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:55:12.181674 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:55:12.181950 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:55:12.204598 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:55:12.204598 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:12.205571 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:55:12.205571 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:12.222701 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797] added
May 28 01:55:12.222701 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:55:12.222701 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:55:12.222701 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:55:12.222701 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:55:12.222701 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:55:12.222701 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:12.222995 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:55:12.223265 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0411(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:55:12.223265 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:55:12.223581 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797] added
May 28 01:55:12.223581 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:55:12.223581 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:55:12.223581 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:55:12.223581 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:55:12.223581 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:55:12.223581 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:12.223814 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:55:12.223854 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0428(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:55:12.224001 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:55:12.402030 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-53dfcf35-617f-42b9-9840-b509c317cf14 tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:55:12.426368 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:12.430968 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:12.459306 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:12.558699 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:55:12.611521 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:12.620826 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:12.661335 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-419d687f-2f1a-4631-8723-58523c6c66a4 req-60f54a2c-e3e3-46ee-a1b7-451f0c71ffe4 service nova] Releasing lock "refresh_cache-8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:55:12.673940 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:55:12.673940 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e', 'iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1319d85a-02ed-497c-a138-d2b9a5b28c6e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:55:12.673940 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:55:12.740855 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999684660999947 future=<Future at 0x7724ec2edb80 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:55:12.743922 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Instance destroyed successfully.
May 28 01:55:12.744589 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-53dfcf35-617f-42b9-9840-b509c317cf14 tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Lazy-loading 'resources' on Instance uuid d3135bb7-29cf-4819-9e83-1c45211901eb {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:55:12.757156 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "587a002a-2b9c-4865-8ce2-088ad567c81b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:12.757156 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "587a002a-2b9c-4865-8ce2-088ad567c81b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:12.816613 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b8f1a5bd-1584-4441-adc6-61810059b238 req-f8d762d8-3277-4200-b5ac-28a1ea4ea944 service nova] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Received event network-vif-unplugged-2ab83417-6d0d-4eb5-a96a-398a30c193d2 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:12.817154 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b8f1a5bd-1584-4441-adc6-61810059b238 req-f8d762d8-3277-4200-b5ac-28a1ea4ea944 service nova] Acquiring lock "d3135bb7-29cf-4819-9e83-1c45211901eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:12.817304 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b8f1a5bd-1584-4441-adc6-61810059b238 req-f8d762d8-3277-4200-b5ac-28a1ea4ea944 service nova] Lock "d3135bb7-29cf-4819-9e83-1c45211901eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:12.817471 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b8f1a5bd-1584-4441-adc6-61810059b238 req-f8d762d8-3277-4200-b5ac-28a1ea4ea944 service nova] Lock "d3135bb7-29cf-4819-9e83-1c45211901eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:12.817635 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b8f1a5bd-1584-4441-adc6-61810059b238 req-f8d762d8-3277-4200-b5ac-28a1ea4ea944 service nova] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] No waiting events found dispatching network-vif-unplugged-2ab83417-6d0d-4eb5-a96a-398a30c193d2 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:55:12.817820 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b8f1a5bd-1584-4441-adc6-61810059b238 req-f8d762d8-3277-4200-b5ac-28a1ea4ea944 service nova] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Received event network-vif-unplugged-2ab83417-6d0d-4eb5-a96a-398a30c193d2 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:55:12.912443 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:13.068060 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.704s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:13.068465 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:55:13.070724 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e17219b6-8a34-42db-a5b2-759db3a53737 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.562s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:13.171683 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:55:13.171822 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:55:13.171945 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] No VIF found with MAC fa:16:3e:5c:c2:5f, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:55:13.172385 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Using config drive
May 28 01:55:13.223635 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:55:13.224390 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:55:13.236484 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:55:13.236484 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:55:13.245300 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:55:13.245300 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:13.247937 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-53dfcf35-617f-42b9-9840-b509c317cf14 tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:54:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1895181752',display_name='tempest-ServersNegativeTestJSON-server-1895181752',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-serversnegativetestjson-server-1895181752',id=17,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:55:10Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6c32da4f768f48179b4be0509a25a704',ramdisk_id='',reservation_id='r-j43mctex',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1232315525',owner_user_name='tempest-ServersNegativeTestJSON-1232315525-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:55:10Z,user_data=None,user_id='c9dd13ea0f744864b4c48f99b39b6436',uuid=d3135bb7-29cf-4819-9e83-1c45211901eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ab83417-6d0d-4eb5-a96a-398a30c193d2", "address": "fa:16:3e:76:82:b0", "network": {"id": "9fe2c990-23ca-4988-b674-c9825c3616af", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-419738907-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c32da4f768f48179b4be0509a25a704", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab83417-6d", "ovs_interfaceid": "2ab83417-6d0d-4eb5-a96a-398a30c193d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:55:13.248125 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-53dfcf35-617f-42b9-9840-b509c317cf14 tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Converting VIF {"id": "2ab83417-6d0d-4eb5-a96a-398a30c193d2", "address": "fa:16:3e:76:82:b0", "network": {"id": "9fe2c990-23ca-4988-b674-c9825c3616af", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-419738907-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c32da4f768f48179b4be0509a25a704", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab83417-6d", "ovs_interfaceid": "2ab83417-6d0d-4eb5-a96a-398a30c193d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:55:13.249093 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-53dfcf35-617f-42b9-9840-b509c317cf14 tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:82:b0,bridge_name='br-int',has_traffic_filtering=True,id=2ab83417-6d0d-4eb5-a96a-398a30c193d2,network=Network(9fe2c990-23ca-4988-b674-c9825c3616af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ab83417-6d') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:55:13.249423 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-53dfcf35-617f-42b9-9840-b509c317cf14 tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:82:b0,bridge_name='br-int',has_traffic_filtering=True,id=2ab83417-6d0d-4eb5-a96a-398a30c193d2,network=Network(9fe2c990-23ca-4988-b674-c9825c3616af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ab83417-6d') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:55:13.251593 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:13.251593 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ab83417-6d, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:13.252018 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:13.252420 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:13.253253 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:55:13.260267 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lazy-loading 'flavor' on Instance uuid 587a002a-2b9c-4865-8ce2-088ad567c81b {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:55:13.261802 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:13.262197 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:13.265190 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:13.265472 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=affbbef0-51cc-47ab-be23-bcb8c94f2d0b) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:13.266122 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:13.266702 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:55:13.272212 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:13.275608 np0000001583 nova-compute[98241]: INFO os_vif [None req-53dfcf35-617f-42b9-9840-b509c317cf14 tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:82:b0,bridge_name='br-int',has_traffic_filtering=True,id=2ab83417-6d0d-4eb5-a96a-398a30c193d2,network=Network(9fe2c990-23ca-4988-b674-c9825c3616af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ab83417-6d')
May 28 01:55:13.276047 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:13.276047 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:13.276047 np0000001583 nova-compute[98241]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:13.276047 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:13.276047 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:13.276047 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:13.276047 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:55:13.276228 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsi session list stdout=tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:13.276228 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:13.276228 np0000001583 nova-compute[98241]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:13.276228 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:13.276228 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:13.276228 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:13.276228 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:55:13.277298 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-53dfcf35-617f-42b9-9840-b509c317cf14 tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Deleting instance files /opt/stack/data/nova/instances/d3135bb7-29cf-4819-9e83-1c45211901eb_del
May 28 01:55:13.277547 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-53dfcf35-617f-42b9-9840-b509c317cf14 tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Deletion of /opt/stack/data/nova/instances/d3135bb7-29cf-4819-9e83-1c45211901eb_del complete
May 28 01:55:13.281639 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:13.281639 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:13.281639 np0000001583 nova-compute[98241]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:13.281639 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:13.281639 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:13.281639 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:13.281639 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:55:13.281862 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsi session list stdout=tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:13.281862 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:13.281862 np0000001583 nova-compute[98241]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:13.281862 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:13.281862 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:13.281862 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:13.281862 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:55:13.325232 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797, portal: 192.168.50.100,3260]
May 28 01:55:13.325232 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797, portal: 192.168.50.100,3260] successful.
May 28 01:55:13.325232 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:13.330862 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797, portal: 192.168.40.100,3260]
May 28 01:55:13.330862 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797, portal: 192.168.40.100,3260] successful.
May 28 01:55:13.330862 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:13.336697 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:13.341441 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0015282540000498557 future=<Future at 0x7724f816f740 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:55:13.341783 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:55:13.342139 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=9.931765548000158 future=<Future at 0x7724ec2d2ed0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:55:13.342409 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=9.931462103000058 future=<Future at 0x7724ec2d2ed0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:55:13.342875 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Emitting event <LifecycleEvent: 1779933298.339789, adfbfdf0-7c0f-4834-92ff-3b8d8c39e333 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:55:13.343054 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] VM Stopped (Lifecycle Event)
May 28 01:55:13.344395 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:13.357776 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:13.357776 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:13.357776 np0000001583 nova-compute[98241]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:13.357776 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:13.357776 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:13.357776 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:13.357776 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:13.357776 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:13.357776 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:55:13.358188 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsi session list stdout=tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:13.358188 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:13.358188 np0000001583 nova-compute[98241]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:13.358188 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:13.358188 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:13.358188 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:13.358188 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:13.358188 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:13.358188 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:55:13.358188 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.177s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:55:13.358530 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:55:13.359174 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] HCTL ('13', '-', '-', 0) found on session 38 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:55:13.359272 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:55:13.367462 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:13.367462 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:13.367462 np0000001583 nova-compute[98241]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:13.367462 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:13.367462 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:13.367462 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:13.367462 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:13.367462 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:13.367462 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:55:13.367790 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsi session list stdout=tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:13.367790 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:13.367790 np0000001583 nova-compute[98241]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:13.367790 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:13.367790 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:13.367790 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:13.367790 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:13.367790 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:13.367790 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:55:13.368017 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.187s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:55:13.368103 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:55:13.369010 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] HCTL ('14', '-', '-', 0) found on session 39 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:55:13.369151 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:55:13.375890 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Searching for a device in session 38 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:55:13.376184 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'fab00939-514d-46f8-a4d7-5a7c78e44797', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:55:13.384653 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Searching for a device in session 39 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:55:13.384653 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fab00939-514d-46f8-a4d7-5a7c78e44797', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:55:13.576158 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:55:13.576567 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:55:13.576790 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:13.577068 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:13.658619 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '312a198f7d3d4ce9b586d8f36cf58f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d31342458ec4ed2890a766f62facbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:55:13.680661 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:13.736642 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e17219b6-8a34-42db-a5b2-759db3a53737 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:55:13.737039 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-e17219b6-8a34-42db-a5b2-759db3a53737 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:55:13.788142 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-53dfcf35-617f-42b9-9840-b509c317cf14 tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Took 1.39 seconds to destroy the instance on the hypervisor.
May 28 01:55:13.789426 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-53dfcf35-617f-42b9-9840-b509c317cf14 tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:55:13.789426 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:55:13.789426 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:55:13.789426 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:13.845798 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-29f55208-5424-48fb-8c45-c6142b88c5ef tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: adfbfdf0-7c0f-4834-92ff-3b8d8c39e333] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:55:13.866366 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Creating config drive at /opt/stack/data/nova/instances/8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4/disk.config
May 28 01:55:13.869118 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:13.874818 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpb8vm5r76 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:13.917966 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpb8vm5r76" returned: 0 in 0.043s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:14.080898 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:55:14.137924 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Successfully created port: 2bb36d37-52de-4dcf-abb4-35b15f363457 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:55:14.182691 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:55:14.239785 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-e17219b6-8a34-42db-a5b2-759db3a53737 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:55:14.267948 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "587a002a-2b9c-4865-8ce2-088ad567c81b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:14.350109 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:14.376832 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:14.377604 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:14.478435 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:14.587107 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:55:14.629856 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:55:14.663967 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ba95e90f-1ad9-4df4-8a6f-bfe1fc2fa0b6 req-add83ac7-afe3-40b6-ba8a-7e381ee1e588 service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Received event network-vif-plugged-f242e691-1d28-43e0-b83a-2414c00958b8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:14.664300 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ba95e90f-1ad9-4df4-8a6f-bfe1fc2fa0b6 req-add83ac7-afe3-40b6-ba8a-7e381ee1e588 service nova] Acquiring lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:14.664565 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ba95e90f-1ad9-4df4-8a6f-bfe1fc2fa0b6 req-add83ac7-afe3-40b6-ba8a-7e381ee1e588 service nova] Lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:14.664779 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ba95e90f-1ad9-4df4-8a6f-bfe1fc2fa0b6 req-add83ac7-afe3-40b6-ba8a-7e381ee1e588 service nova] Lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:14.664973 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ba95e90f-1ad9-4df4-8a6f-bfe1fc2fa0b6 req-add83ac7-afe3-40b6-ba8a-7e381ee1e588 service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Processing event network-vif-plugged-f242e691-1d28-43e0-b83a-2414c00958b8 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:55:14.700700 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Successfully updated port: 2bb36d37-52de-4dcf-abb4-35b15f363457 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:55:14.701909 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:14.704212 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:14.708168 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:14.732015 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:14.747501 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e17219b6-8a34-42db-a5b2-759db3a53737 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.677s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:14.820153 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-e17219b6-8a34-42db-a5b2-759db3a53737 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Deleted allocations for instance e73ac672-0911-4e4d-8a85-9b635a9e836f
May 28 01:55:14.890113 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-3e977e72-abed-40e6-9ed7-455647784d68 req-94f01ea3-c51f-49e5-8e4c-4ef071a09f5b service nova] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Received event network-vif-unplugged-2ab83417-6d0d-4eb5-a96a-398a30c193d2 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:14.890113 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-3e977e72-abed-40e6-9ed7-455647784d68 req-94f01ea3-c51f-49e5-8e4c-4ef071a09f5b service nova] Acquiring lock "d3135bb7-29cf-4819-9e83-1c45211901eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:14.890113 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-3e977e72-abed-40e6-9ed7-455647784d68 req-94f01ea3-c51f-49e5-8e4c-4ef071a09f5b service nova] Lock "d3135bb7-29cf-4819-9e83-1c45211901eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:14.890113 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-3e977e72-abed-40e6-9ed7-455647784d68 req-94f01ea3-c51f-49e5-8e4c-4ef071a09f5b service nova] Lock "d3135bb7-29cf-4819-9e83-1c45211901eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:14.890113 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-3e977e72-abed-40e6-9ed7-455647784d68 req-94f01ea3-c51f-49e5-8e4c-4ef071a09f5b service nova] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] No waiting events found dispatching network-vif-unplugged-2ab83417-6d0d-4eb5-a96a-398a30c193d2 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:55:14.890113 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-3e977e72-abed-40e6-9ed7-455647784d68 req-94f01ea3-c51f-49e5-8e4c-4ef071a09f5b service nova] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Received event network-vif-unplugged-2ab83417-6d0d-4eb5-a96a-398a30c193d2 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:55:14.890113 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-3e977e72-abed-40e6-9ed7-455647784d68 req-94f01ea3-c51f-49e5-8e4c-4ef071a09f5b service nova] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Received event network-vif-deleted-2ab83417-6d0d-4eb5-a96a-398a30c193d2 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:14.890113 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-3e977e72-abed-40e6-9ed7-455647784d68 req-94f01ea3-c51f-49e5-8e4c-4ef071a09f5b service nova] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Received event network-changed-2bb36d37-52de-4dcf-abb4-35b15f363457 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:14.890113 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-3e977e72-abed-40e6-9ed7-455647784d68 req-94f01ea3-c51f-49e5-8e4c-4ef071a09f5b service nova] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Refreshing instance network info cache due to event network-changed-2bb36d37-52de-4dcf-abb4-35b15f363457. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:55:14.890113 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-3e977e72-abed-40e6-9ed7-455647784d68 req-94f01ea3-c51f-49e5-8e4c-4ef071a09f5b service nova] Acquiring lock "refresh_cache-ea9459ae-6246-4d11-b46b-733449884b1b" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:55:14.890601 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-3e977e72-abed-40e6-9ed7-455647784d68 req-94f01ea3-c51f-49e5-8e4c-4ef071a09f5b service nova] Acquired lock "refresh_cache-ea9459ae-6246-4d11-b46b-733449884b1b" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:55:14.890601 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-3e977e72-abed-40e6-9ed7-455647784d68 req-94f01ea3-c51f-49e5-8e4c-4ef071a09f5b service nova] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Refreshing network info cache for port 2bb36d37-52de-4dcf-abb4-35b15f363457 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:55:15.133026 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Took 1.34 seconds to deallocate network for instance.
May 28 01:55:15.199933 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Found WWN 330000000386efa88 for multipath device dm-7 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:55:15.200441 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:55:15.200629 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] <== connect_volume: return (4719ms) {'type': 'block', 'scsi_wwn': '330000000386efa88', 'path': '/dev/dm-7', 'multipath_id': '330000000386efa88'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:55:15.200792 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000386efa88', 'path': '/dev/dm-7', 'multipath_id': '330000000386efa88'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:55:15.202875 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.529s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:55:15.202875 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e', 'iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1319d85a-02ed-497c-a138-d2b9a5b28c6e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:55:15.206017 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Acquiring lock "refresh_cache-ea9459ae-6246-4d11-b46b-733449884b1b" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:55:15.215531 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:55:15.216072 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:55:15.216344 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:55:15.218937 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:55:15.219510 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:55:15.219764 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:55:15.224103 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:55:15.225315 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933315.2248042, 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:55:15.225553 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] VM Started (Lifecycle Event)
May 28 01:55:15.231608 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:55:15.233743 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Instance spawned successfully.
May 28 01:55:15.234177 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:55:15.236412 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:55:15.236412 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:15.240106 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:55:15.240106 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:15.249836 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e] added
May 28 01:55:15.249836 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:55:15.249836 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:55:15.249836 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:55:15.249836 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:55:15.249836 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:55:15.249836 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:15.250920 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:55:15.250920 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0342(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:55:15.250920 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:55:15.255324 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e] added
May 28 01:55:15.255324 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:55:15.255324 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:55:15.255324 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:55:15.255324 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:55:15.255324 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:55:15.255324 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:15.255632 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:55:15.255632 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0359(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:55:15.256033 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:55:15.372185 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "587a002a-2b9c-4865-8ce2-088ad567c81b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:15.372355 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "587a002a-2b9c-4865-8ce2-088ad567c81b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:15.372562 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Attaching volume eeb7082f-9899-40c8-ab6f-3d746680d463 to /dev/vdb
May 28 01:55:15.392579 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-3e977e72-abed-40e6-9ed7-455647784d68 req-94f01ea3-c51f-49e5-8e4c-4ef071a09f5b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:15.413192 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:55:15.424478 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:55:15.449949 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:15.478056 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-3e977e72-abed-40e6-9ed7-455647784d68 req-94f01ea3-c51f-49e5-8e4c-4ef071a09f5b service nova] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:55:15.497533 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:55:15.499072 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:55:15.511507 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:55:15.513091 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe63:2bb1', 'fe80::e43a:d5ff:fecc:27fe', 'fe80::fc16:3eff:fe94:7597', 'fe80::fc16:3eff:fe28:958e', 'fe80::3cc0:d1ff:fe7f:6a8', 'fe80::fc16:3eff:fe27:be54', 'fe80::a0e4:60ff:fe3f:73d6', 'fe80::fc16:3eff:fecc:f6fa', 'fe80::d4f7:45ff:fed0:14ad', 'fe80::fc16:3eff:fe5c:c25f', 'fe80::819:abff:fece:7871'] 
May 28 01:55:15.513252 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:55:15.513422 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:55:15.513770 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] <== get_connector_properties: return (99ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:55:15.514045 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Updating existing volume attachment record: 5445fe52-2c53-4912-a8ed-7442c80715b6 {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:55:15.602760 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:55:15.606603 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:55:15.607050 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Creating image(s)
May 28 01:55:15.608727 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Acquiring lock "/opt/stack/data/nova/instances/ea9459ae-6246-4d11-b46b-733449884b1b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:15.610491 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "/opt/stack/data/nova/instances/ea9459ae-6246-4d11-b46b-733449884b1b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:15.611166 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "/opt/stack/data/nova/instances/ea9459ae-6246-4d11-b46b-733449884b1b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:15.611941 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:55:15.619387 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:55:15.621191 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:15.651961 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-53dfcf35-617f-42b9-9840-b509c317cf14 tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:15.652690 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-53dfcf35-617f-42b9-9840-b509c317cf14 tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:15.708461 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:54:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-516014259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-serverbootfromvolumestablerescuetest-server-516014259',id=18,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ba381dad8364a488a98b80c04cce8fb',ramdisk_id='',reservation_id='r-uj4jvzn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1211567633',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:55:04Z,user_data=None,user_id='c3a7b14e31ee40cf9e4f4bba084ccaa5',uuid=533f5dcc-2e48-4280-84b3-facb02dea136,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e", "address": "fa:16:3e:e1:01:d3", "network": {"id": "2ee43c4e-569f-4726-9700-add40d768203", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ba381dad8364a488a98b80c04cce8fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bf1e5b-d3", "ovs_interfaceid": "b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:55:15.708683 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Converting VIF {"id": "b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e", "address": "fa:16:3e:e1:01:d3", "network": {"id": "2ee43c4e-569f-4726-9700-add40d768203", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ba381dad8364a488a98b80c04cce8fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bf1e5b-d3", "ovs_interfaceid": "b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:55:15.709631 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:01:d3,bridge_name='br-int',has_traffic_filtering=True,id=b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e,network=Network(2ee43c4e-569f-4726-9700-add40d768203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3bf1e5b-d3') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:55:15.711103 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lazy-loading 'pci_devices' on Instance uuid 533f5dcc-2e48-4280-84b3-facb02dea136 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:55:15.715660 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-3e977e72-abed-40e6-9ed7-455647784d68 req-94f01ea3-c51f-49e5-8e4c-4ef071a09f5b service nova] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:55:15.728375 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:55:15.730027 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:55:15.736190 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.115s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:15.736928 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:15.738257 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:15.738683 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:55:15.747076 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:55:15.749760 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:15.786613 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:55:15.789565 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:55:15.793097 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:55:15.793097 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:55:15.793097 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:55:15.793097 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:55:15.828448 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e17219b6-8a34-42db-a5b2-759db3a53737 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Lock "e73ac672-0911-4e4d-8a85-9b635a9e836f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.589s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:15.856548 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.107s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:15.857150 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/ea9459ae-6246-4d11-b46b-733449884b1b/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:15.912183 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/ea9459ae-6246-4d11-b46b-733449884b1b/disk 1073741824" returned: 0 in 0.055s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:15.912669 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.175s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:15.914017 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:16.001971 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.088s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:16.002519 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ea9459ae-6246-4d11-b46b-733449884b1b/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:55:16.002855 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea9459ae-6246-4d11-b46b-733449884b1b/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:16.079158 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:55:16.079540 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463', 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'eeb7082f-9899-40c8-ab6f-3d746680d463', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:55:16.080773 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:55:16.092887 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea9459ae-6246-4d11-b46b-733449884b1b/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:16.093353 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Cannot resize image /opt/stack/data/nova/instances/ea9459ae-6246-4d11-b46b-733449884b1b/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:55:16.093699 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:55:16.093975 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Ensure instance console log exists: /opt/stack/data/nova/instances/ea9459ae-6246-4d11-b46b-733449884b1b/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:55:16.094905 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:16.095166 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:16.095350 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:16.220047 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-3e977e72-abed-40e6-9ed7-455647784d68 req-94f01ea3-c51f-49e5-8e4c-4ef071a09f5b service nova] Releasing lock "refresh_cache-ea9459ae-6246-4d11-b46b-733449884b1b" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:55:16.220520 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] End _get_guest_xml xml=<domain type="qemu">
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:   <uuid>533f5dcc-2e48-4280-84b3-facb02dea136</uuid>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:   <name>instance-00000012</name>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-516014259</nova:name>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:55:10</nova:creationTime>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:         <nova:user uuid="c3a7b14e31ee40cf9e4f4bba084ccaa5">tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member</nova:user>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:         <nova:project uuid="2ba381dad8364a488a98b80c04cce8fb">tempest-ServerBootFromVolumeStableRescueTest-1211567633</nova:project>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:         <nova:port uuid="b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e">
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:     <system>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:       <entry name="serial">533f5dcc-2e48-4280-84b3-facb02dea136</entry>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:       <entry name="uuid">533f5dcc-2e48-4280-84b3-facb02dea136</entry>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:     </system>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:   <os>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:   </os>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:   <features>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:   </features>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:   <devices>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/533f5dcc-2e48-4280-84b3-facb02dea136/disk.config"/>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:     </disk>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:     <disk type="block" device="disk">
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:       <alias name="ua-fab00939-514d-46f8-a4d7-5a7c78e44797"/>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:       <source dev="/dev/dm-7"/>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:       <serial>fab00939-514d-46f8-a4d7-5a7c78e44797</serial>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:     </disk>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:e1:01:d3"/>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:       <target dev="tapb3bf1e5b-d3"/>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:     </interface>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/533f5dcc-2e48-4280-84b3-facb02dea136/console.log" append="off"/>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:     </serial>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:     <video>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:     </video>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:     </rng>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:   </devices>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]: </domain>
May 28 01:55:16.220520 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:55:16.225558 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Acquired lock "refresh_cache-ea9459ae-6246-4d11-b46b-733449884b1b" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:55:16.225558 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Preparing to wait for external event network-vif-plugged-b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:55:16.225558 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "533f5dcc-2e48-4280-84b3-facb02dea136-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:16.225558 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "533f5dcc-2e48-4280-84b3-facb02dea136-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:16.225558 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "533f5dcc-2e48-4280-84b3-facb02dea136-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:16.225558 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:55:16.225558 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:54:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-516014259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-serverbootfromvolumestablerescuetest-server-516014259',id=18,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ba381dad8364a488a98b80c04cce8fb',ramdisk_id='',reservation_id='r-uj4jvzn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1211567633',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:55:04Z,user_data=None,user_id='c3a7b14e31ee40cf9e4f4bba084ccaa5',uuid=533f5dcc-2e48-4280-84b3-facb02dea136,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e", "address": "fa:16:3e:e1:01:d3", "network": {"id": "2ee43c4e-569f-4726-9700-add40d768203", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ba381dad8364a488a98b80c04cce8fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bf1e5b-d3", "ovs_interfaceid": "b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:55:16.225558 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Converting VIF {"id": "b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e", "address": "fa:16:3e:e1:01:d3", "network": {"id": "2ee43c4e-569f-4726-9700-add40d768203", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ba381dad8364a488a98b80c04cce8fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bf1e5b-d3", "ovs_interfaceid": "b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:55:16.225558 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:01:d3,bridge_name='br-int',has_traffic_filtering=True,id=b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e,network=Network(2ee43c4e-569f-4726-9700-add40d768203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3bf1e5b-d3') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:55:16.225558 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:01:d3,bridge_name='br-int',has_traffic_filtering=True,id=b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e,network=Network(2ee43c4e-569f-4726-9700-add40d768203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3bf1e5b-d3') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:55:16.225558 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:16.226188 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:16.226188 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:55:16.227128 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:16.227437 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4766cac8-d4dc-5fa6-948d-e76efc277748', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:16.233106 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:55:16.234155 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:55:16.234588 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933316.2343879, 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:55:16.234768 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] VM Paused (Lifecycle Event)
May 28 01:55:16.242184 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:16.242647 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3bf1e5b-d3, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:16.243172 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb3bf1e5b-d3, col_values=(('qos', UUID('356db3e4-b569-46c1-b77b-e1aa672f0f01')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:16.243491 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb3bf1e5b-d3, col_values=(('external_ids', {'iface-id': 'b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:01:d3', 'vm-uuid': '533f5dcc-2e48-4280-84b3-facb02dea136'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:16.247403 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:55:16.250771 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:16.252384 np0000001583 nova-compute[98241]: INFO os_vif [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:01:d3,bridge_name='br-int',has_traffic_filtering=True,id=b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e,network=Network(2ee43c4e-569f-4726-9700-add40d768203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3bf1e5b-d3')
May 28 01:55:16.253124 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:55:16.261106 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:55:16.264753 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:55:16.264753 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:55:16.272024 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:55:16.272024 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:16.283072 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:16.295489 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:16.303505 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Took 6.74 seconds to spawn the instance on the hypervisor.
May 28 01:55:16.303658 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:55:16.306518 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:16.306518 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:16.306518 np0000001583 nova-compute[98241]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:16.306518 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:16.306518 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:16.306518 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:16.306518 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:16.306518 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:16.306518 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:55:16.306848 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsi session list stdout=tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:16.306848 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:16.306848 np0000001583 nova-compute[98241]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:16.306848 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:16.306848 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:16.306848 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:16.306848 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:16.306848 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:16.306848 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:55:16.319995 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:16.319995 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:16.319995 np0000001583 nova-compute[98241]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:16.319995 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:16.319995 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:16.319995 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:16.319995 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:16.319995 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:16.319995 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:55:16.319995 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsi session list stdout=tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:16.319995 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:16.319995 np0000001583 nova-compute[98241]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:16.319995 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:16.319995 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:16.319995 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:16.319995 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:16.319995 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:16.319995 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:55:16.357671 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e, portal: 192.168.40.100,3260]
May 28 01:55:16.357671 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e, portal: 192.168.40.100,3260] successful.
May 28 01:55:16.357671 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:16.364141 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-53dfcf35-617f-42b9-9840-b509c317cf14 tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:55:16.364443 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-53dfcf35-617f-42b9-9840-b509c317cf14 tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:55:16.366616 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e, portal: 192.168.50.100,3260]
May 28 01:55:16.366616 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e, portal: 192.168.50.100,3260] successful.
May 28 01:55:16.366616 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:16.373164 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:16.380800 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:16.400115 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:16.400115 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:16.400115 np0000001583 nova-compute[98241]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:16.400115 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:16.400115 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:16.400115 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:16.400115 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:16.400115 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:16.400115 np0000001583 nova-compute[98241]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:16.400115 np0000001583 nova-compute[98241]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:16.400115 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:55:16.400115 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsi session list stdout=tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:16.400115 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:16.400115 np0000001583 nova-compute[98241]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:16.400115 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:16.400115 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:16.400115 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:16.400115 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:16.400115 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:16.400115 np0000001583 nova-compute[98241]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:16.400115 np0000001583 nova-compute[98241]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:16.400115 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:55:16.400686 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.184s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:55:16.400686 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:55:16.403251 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] HCTL ('15', '-', '-', 0) found on session 40 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:55:16.403251 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:55:16.409103 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:16.409103 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:16.409103 np0000001583 nova-compute[98241]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:16.409103 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:16.409103 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:16.409103 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:16.409103 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:16.409103 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:16.409103 np0000001583 nova-compute[98241]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:16.409103 np0000001583 nova-compute[98241]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:16.409103 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:55:16.409103 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsi session list stdout=tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:16.409103 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:16.409103 np0000001583 nova-compute[98241]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:16.409103 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:16.409103 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:16.409103 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:16.409103 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:16.409103 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:16.409103 np0000001583 nova-compute[98241]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:16.409103 np0000001583 nova-compute[98241]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:16.409103 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:55:16.409103 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.186s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:55:16.409103 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:55:16.409103 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] HCTL ('16', '-', '-', 0) found on session 41 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:55:16.409103 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:55:16.436298 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Searching for a device in session 40 and hctl ['15', '*', '*', 0] yield: None {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:55:16.436298 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Searching for a device in session 41 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:55:16.436298 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '1319d85a-02ed-497c-a138-d2b9a5b28c6e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:55:16.748282 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:55:16.750864 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0fda6154-fbac-4d65-905b-39b523709e8e req-c9adf22d-487f-42e0-9d97-0682486912ca service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Received event network-vif-plugged-f242e691-1d28-43e0-b83a-2414c00958b8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:16.751101 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0fda6154-fbac-4d65-905b-39b523709e8e req-c9adf22d-487f-42e0-9d97-0682486912ca service nova] Acquiring lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:16.751306 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0fda6154-fbac-4d65-905b-39b523709e8e req-c9adf22d-487f-42e0-9d97-0682486912ca service nova] Lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:16.751472 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0fda6154-fbac-4d65-905b-39b523709e8e req-c9adf22d-487f-42e0-9d97-0682486912ca service nova] Lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:16.754020 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0fda6154-fbac-4d65-905b-39b523709e8e req-c9adf22d-487f-42e0-9d97-0682486912ca service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] No waiting events found dispatching network-vif-plugged-f242e691-1d28-43e0-b83a-2414c00958b8 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:55:16.754020 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-0fda6154-fbac-4d65-905b-39b523709e8e req-c9adf22d-487f-42e0-9d97-0682486912ca service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Received unexpected event network-vif-plugged-f242e691-1d28-43e0-b83a-2414c00958b8 for instance with vm_state active and task_state None.
May 28 01:55:16.754243 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933316.7539775, 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:55:16.754369 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] VM Resumed (Lifecycle Event)
May 28 01:55:16.812222 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:55:16.820485 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Took 15.46 seconds to build instance.
May 28 01:55:16.867820 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-53dfcf35-617f-42b9-9840-b509c317cf14 tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:55:16.992253 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:17.166071 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Updating instance_info_cache with network_info: [{"id": "2bb36d37-52de-4dcf-abb4-35b15f363457", "address": "fa:16:3e:86:7e:a1", "network": {"id": "34ab0ff0-75dd-45e7-97f6-22f8e62a8149", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1222751470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d31342458ec4ed2890a766f62facbcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb36d37-52", "ovs_interfaceid": "2bb36d37-52de-4dcf-abb4-35b15f363457", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:55:17.227072 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Acquiring lock "df5768dc-874f-4725-b2a2-e007aebc11a9" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:17.227230 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Lock "df5768dc-874f-4725-b2a2-e007aebc11a9" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:17.227339 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Shelve offloading
May 28 01:55:17.257180 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:55:17.260381 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:55:17.321921 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.976s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:17.383402 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-53dfcf35-617f-42b9-9840-b509c317cf14 tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.731s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:17.421135 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Searching for a device in session 40 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:55:17.421337 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1319d85a-02ed-497c-a138-d2b9a5b28c6e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:55:17.443101 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-53dfcf35-617f-42b9-9840-b509c317cf14 tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Deleted allocations for instance d3135bb7-29cf-4819-9e83-1c45211901eb
May 28 01:55:17.524537 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:17.668457 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Releasing lock "refresh_cache-ea9459ae-6246-4d11-b46b-733449884b1b" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:55:17.668747 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Instance network_info: |[{"id": "2bb36d37-52de-4dcf-abb4-35b15f363457", "address": "fa:16:3e:86:7e:a1", "network": {"id": "34ab0ff0-75dd-45e7-97f6-22f8e62a8149", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1222751470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d31342458ec4ed2890a766f62facbcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb36d37-52", "ovs_interfaceid": "2bb36d37-52de-4dcf-abb4-35b15f363457", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:55:17.670928 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Start _get_guest_xml network_info=[{"id": "2bb36d37-52de-4dcf-abb4-35b15f363457", "address": "fa:16:3e:86:7e:a1", "network": {"id": "34ab0ff0-75dd-45e7-97f6-22f8e62a8149", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1222751470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d31342458ec4ed2890a766f62facbcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb36d37-52", "ovs_interfaceid": "2bb36d37-52de-4dcf-abb4-35b15f363457", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:55:17.672330 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:55:17.673554 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-350641025', uuid='ea9459ae-6246-4d11-b46b-733449884b1b'), owner=OwnerMeta(userid='312a198f7d3d4ce9b586d8f36cf58f76', username='tempest-AttachVolumeShelveTestJSON-1906404591-project-member', projectid='0d31342458ec4ed2890a766f62facbcf', projectname='tempest-AttachVolumeShelveTestJSON-1906404591'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2bb36d37-52de-4dcf-abb4-35b15f363457", "address": "fa:16:3e:86:7e:a1", "network": {"id": "34ab0ff0-75dd-45e7-97f6-22f8e62a8149", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1222751470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d31342458ec4ed2890a766f62facbcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb36d37-52", "ovs_interfaceid": "2bb36d37-52de-4dcf-abb4-35b15f363457", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933317.6732264) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:55:17.677441 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:55:17.677890 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:55:17.680595 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:55:17.680595 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:55:17.681598 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:55:17.681942 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:55:17.682152 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:55:17.683579 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:55:17.683729 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:55:17.683847 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:55:17.683974 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:55:17.684137 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:55:17.684262 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:55:17.684377 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:55:17.684490 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:55:17.684618 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:55:17.697784 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:55:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-350641025',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-attachvolumeshelvetestjson-server-350641025',id=20,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyywg/GU3kMhR5XnRO3S4+qKLGn1IVmNweRmYbKjC4mG7Y3B4b1iJuav/MjMhmEg1Ch1VSJDXtwStt6yHLEcJuMrGjLfMiMuk2bmjq4ldTwnSZW8eUZkuwRr6oFssFUKg==',key_name='tempest-keypair-950315920',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d31342458ec4ed2890a766f62facbcf',ramdisk_id='',reservation_id='r-lmutfe3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1906404591',owner_user_name='tempest-AttachVolumeShelveTestJSON-1906404591-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:55:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='312a198f7d3d4ce9b586d8f36cf58f76',uuid=ea9459ae-6246-4d11-b46b-733449884b1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2bb36d37-52de-4dcf-abb4-35b15f363457", "address": "fa:16:3e:86:7e:a1", "network": {"id": "34ab0ff0-75dd-45e7-97f6-22f8e62a8149", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1222751470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d31342458ec4ed2890a766f62facbcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb36d37-52", "ovs_interfaceid": "2bb36d37-52de-4dcf-abb4-35b15f363457", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:55:17.698006 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Converting VIF {"id": "2bb36d37-52de-4dcf-abb4-35b15f363457", "address": "fa:16:3e:86:7e:a1", "network": {"id": "34ab0ff0-75dd-45e7-97f6-22f8e62a8149", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1222751470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d31342458ec4ed2890a766f62facbcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb36d37-52", "ovs_interfaceid": "2bb36d37-52de-4dcf-abb4-35b15f363457", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:55:17.698518 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:7e:a1,bridge_name='br-int',has_traffic_filtering=True,id=2bb36d37-52de-4dcf-abb4-35b15f363457,network=Network(34ab0ff0-75dd-45e7-97f6-22f8e62a8149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bb36d37-52') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:55:17.699098 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lazy-loading 'pci_devices' on Instance uuid ea9459ae-6246-4d11-b46b-733449884b1b {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:55:17.784044 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:55:17.784472 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:55:17.784472 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] No VIF found with MAC fa:16:3e:e1:01:d3, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:55:17.784664 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Using config drive
May 28 01:55:17.912808 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:18.204171 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] End _get_guest_xml xml=<domain type="qemu">
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:   <uuid>ea9459ae-6246-4d11-b46b-733449884b1b</uuid>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:   <name>instance-00000014</name>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-350641025</nova:name>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:55:17</nova:creationTime>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:         <nova:user uuid="312a198f7d3d4ce9b586d8f36cf58f76">tempest-AttachVolumeShelveTestJSON-1906404591-project-member</nova:user>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:         <nova:project uuid="0d31342458ec4ed2890a766f62facbcf">tempest-AttachVolumeShelveTestJSON-1906404591</nova:project>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:         <nova:port uuid="2bb36d37-52de-4dcf-abb4-35b15f363457">
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:     <system>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:       <entry name="serial">ea9459ae-6246-4d11-b46b-733449884b1b</entry>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:       <entry name="uuid">ea9459ae-6246-4d11-b46b-733449884b1b</entry>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:     </system>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:   <os>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:   </os>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:   <features>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:   </features>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:   <devices>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/ea9459ae-6246-4d11-b46b-733449884b1b/disk"/>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:     </disk>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/ea9459ae-6246-4d11-b46b-733449884b1b/disk.config"/>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:     </disk>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:86:7e:a1"/>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:       <target dev="tap2bb36d37-52"/>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:     </interface>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/ea9459ae-6246-4d11-b46b-733449884b1b/console.log" append="off"/>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:     </serial>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:     <video>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:     </video>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:     </rng>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:   </devices>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]: </domain>
May 28 01:55:18.204171 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:55:18.204171 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Preparing to wait for external event network-vif-plugged-2bb36d37-52de-4dcf-abb4-35b15f363457 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:55:18.204171 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Acquiring lock "ea9459ae-6246-4d11-b46b-733449884b1b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:18.204171 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "ea9459ae-6246-4d11-b46b-733449884b1b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:18.204171 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "ea9459ae-6246-4d11-b46b-733449884b1b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:18.206301 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:55:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-350641025',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-attachvolumeshelvetestjson-server-350641025',id=20,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyywg/GU3kMhR5XnRO3S4+qKLGn1IVmNweRmYbKjC4mG7Y3B4b1iJuav/MjMhmEg1Ch1VSJDXtwStt6yHLEcJuMrGjLfMiMuk2bmjq4ldTwnSZW8eUZkuwRr6oFssFUKg==',key_name='tempest-keypair-950315920',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d31342458ec4ed2890a766f62facbcf',ramdisk_id='',reservation_id='r-lmutfe3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1906404591',owner_user_name='tempest-AttachVolumeShelveTestJSON-1906404591-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:55:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='312a198f7d3d4ce9b586d8f36cf58f76',uuid=ea9459ae-6246-4d11-b46b-733449884b1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2bb36d37-52de-4dcf-abb4-35b15f363457", "address": "fa:16:3e:86:7e:a1", "network": {"id": "34ab0ff0-75dd-45e7-97f6-22f8e62a8149", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1222751470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d31342458ec4ed2890a766f62facbcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb36d37-52", "ovs_interfaceid": "2bb36d37-52de-4dcf-abb4-35b15f363457", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:55:18.206301 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Converting VIF {"id": "2bb36d37-52de-4dcf-abb4-35b15f363457", "address": "fa:16:3e:86:7e:a1", "network": {"id": "34ab0ff0-75dd-45e7-97f6-22f8e62a8149", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1222751470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d31342458ec4ed2890a766f62facbcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb36d37-52", "ovs_interfaceid": "2bb36d37-52de-4dcf-abb4-35b15f363457", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:55:18.206301 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:7e:a1,bridge_name='br-int',has_traffic_filtering=True,id=2bb36d37-52de-4dcf-abb4-35b15f363457,network=Network(34ab0ff0-75dd-45e7-97f6-22f8e62a8149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bb36d37-52') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:55:18.206301 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:7e:a1,bridge_name='br-int',has_traffic_filtering=True,id=2bb36d37-52de-4dcf-abb4-35b15f363457,network=Network(34ab0ff0-75dd-45e7-97f6-22f8e62a8149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bb36d37-52') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:55:18.213020 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:18.213020 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:18.213020 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:55:18.213020 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:18.213020 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aa1c3fe1-5102-5d9e-be32-98a2ff4da48d', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:18.213020 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:18.213342 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:55:18.219797 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:18.226990 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:18.226990 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2bb36d37-52, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:18.226990 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2bb36d37-52, col_values=(('qos', UUID('7cdfda98-67bf-4baa-aeaa-ef584ad2b49c')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:18.226990 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2bb36d37-52, col_values=(('external_ids', {'iface-id': '2bb36d37-52de-4dcf-abb4-35b15f363457', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:7e:a1', 'vm-uuid': 'ea9459ae-6246-4d11-b46b-733449884b1b'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:18.227332 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:18.228118 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:55:18.238222 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:18.239490 np0000001583 nova-compute[98241]: INFO os_vif [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:7e:a1,bridge_name='br-int',has_traffic_filtering=True,id=2bb36d37-52de-4dcf-abb4-35b15f363457,network=Network(34ab0ff0-75dd-45e7-97f6-22f8e62a8149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bb36d37-52')
May 28 01:55:18.244873 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Found WWN 3300000002baa3533 for multipath device dm-8 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:55:18.245507 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.043s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:55:18.245858 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] <== connect_volume: return (5572ms) {'type': 'block', 'scsi_wwn': '3300000002baa3533', 'path': '/dev/dm-8', 'multipath_id': '3300000002baa3533'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:55:18.246047 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002baa3533', 'path': '/dev/dm-8', 'multipath_id': '3300000002baa3533'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:55:18.247768 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.167s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:55:18.247768 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463', 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'eeb7082f-9899-40c8-ab6f-3d746680d463', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:55:18.261804 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:55:18.262994 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:55:18.262994 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:55:18.263868 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:55:18.264566 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:55:18.266761 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:55:18.276414 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:18.278699 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:18.279507 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:55:18.279507 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:18.285366 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:55:18.285366 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:18.293424 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:18.299626 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463] added
May 28 01:55:18.299626 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:55:18.299626 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:55:18.299626 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:55:18.299626 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:55:18.299626 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:55:18.299626 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:18.300058 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:55:18.302967 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:18.303264 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463] added
May 28 01:55:18.303264 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:55:18.303264 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:55:18.303264 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:55:18.303264 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:55:18.303264 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:55:18.303264 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:18.303464 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:55:18.303664 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0389(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:55:18.303826 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:55:18.305057 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0395(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:55:18.305375 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:55:18.307203 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:18.354038 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:18.384719 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e0acbacb-3031-4a55-b287-7eb97555ba4b req-312aadff-1d12-4d36-bbbf-9a5f31b12063 service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Received event network-changed-f242e691-1d28-43e0-b83a-2414c00958b8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:18.386110 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e0acbacb-3031-4a55-b287-7eb97555ba4b req-312aadff-1d12-4d36-bbbf-9a5f31b12063 service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Refreshing instance network info cache due to event network-changed-f242e691-1d28-43e0-b83a-2414c00958b8. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:55:18.386282 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e0acbacb-3031-4a55-b287-7eb97555ba4b req-312aadff-1d12-4d36-bbbf-9a5f31b12063 service nova] Acquiring lock "refresh_cache-8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:55:18.386438 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e0acbacb-3031-4a55-b287-7eb97555ba4b req-312aadff-1d12-4d36-bbbf-9a5f31b12063 service nova] Acquired lock "refresh_cache-8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:55:18.386818 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-e0acbacb-3031-4a55-b287-7eb97555ba4b req-312aadff-1d12-4d36-bbbf-9a5f31b12063 service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Refreshing network info cache for port f242e691-1d28-43e0-b83a-2414c00958b8 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:55:18.453261 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-53dfcf35-617f-42b9-9840-b509c317cf14 tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Lock "d3135bb7-29cf-4819-9e83-1c45211901eb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.561s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:18.467370 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Creating config drive at /opt/stack/data/nova/instances/533f5dcc-2e48-4280-84b3-facb02dea136/disk.config
May 28 01:55:18.472951 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/533f5dcc-2e48-4280-84b3-facb02dea136/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpql9f6t76 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:18.527902 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/533f5dcc-2e48-4280-84b3-facb02dea136/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpql9f6t76" returned: 0 in 0.055s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:18.583356 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:18.699182 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999595451999994 future=<Future at 0x7724f8281ca0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:55:18.700248 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Instance destroyed successfully.
May 28 01:55:18.700965 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Lazy-loading 'numa_topology' on Instance uuid df5768dc-874f-4725-b2a2-e007aebc11a9 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:55:18.764682 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:54:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-816699505',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-device-tagging-server-816699505',id=16,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFb4MdstYi3e4BcoWgJNrYYwrxogOgR+UEefY4K3bu6XOWdCVixfd8Z/tWUILEsfZHSabCTBL9tSi6xeabSVtuRQZOykOsXjawc/YsQNmtV8z7BBd+TQapDkhwnvY4ycw==',key_name='tempest-keypair-280238980',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aeed1ca793154290b3390c9300844303',ramdisk_id='',reservation_id='r-ujpreusk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2114446049',owner_user_name='tempest-TaggedBootDevicesTest_v242-2114446049-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:54:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3628360fdd1044689e5e94535d1b7fcd',uuid=0cca8054-2a26-436f-93b8-ef28e452bd65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfa132bb-afe8-4b97-909b-816f3e916bfd", "address": "fa:16:3e:e3:af:b5", "network": {"id": "3fed2ebb-cfdf-471c-963f-f350742f2200", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1888324923-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa132bb-af", "ovs_interfaceid": "dfa132bb-afe8-4b97-909b-816f3e916bfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:55:18.764997 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Converting VIF {"id": "dfa132bb-afe8-4b97-909b-816f3e916bfd", "address": "fa:16:3e:e3:af:b5", "network": {"id": "3fed2ebb-cfdf-471c-963f-f350742f2200", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1888324923-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa132bb-af", "ovs_interfaceid": "dfa132bb-afe8-4b97-909b-816f3e916bfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:55:18.769761 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:af:b5,bridge_name='br-int',has_traffic_filtering=True,id=dfa132bb-afe8-4b97-909b-816f3e916bfd,network=Network(3fed2ebb-cfdf-471c-963f-f350742f2200),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfa132bb-af') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:55:18.771386 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:54:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-816699505',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-device-tagging-server-816699505',id=16,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFb4MdstYi3e4BcoWgJNrYYwrxogOgR+UEefY4K3bu6XOWdCVixfd8Z/tWUILEsfZHSabCTBL9tSi6xeabSVtuRQZOykOsXjawc/YsQNmtV8z7BBd+TQapDkhwnvY4ycw==',key_name='tempest-keypair-280238980',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aeed1ca793154290b3390c9300844303',ramdisk_id='',reservation_id='r-ujpreusk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2114446049',owner_user_name='tempest-TaggedBootDevicesTest_v242-2114446049-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:54:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3628360fdd1044689e5e94535d1b7fcd',uuid=0cca8054-2a26-436f-93b8-ef28e452bd65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "939862e4-4e68-484c-bbcd-95faf922a641", "address": "fa:16:3e:2d:d8:ee", "network": {"id": "07811dc4-ff38-4d15-a899-007fdeea12e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-974977857", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap939862e4-4e", "ovs_interfaceid": "939862e4-4e68-484c-bbcd-95faf922a641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:55:18.771574 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Converting VIF {"id": "939862e4-4e68-484c-bbcd-95faf922a641", "address": "fa:16:3e:2d:d8:ee", "network": {"id": "07811dc4-ff38-4d15-a899-007fdeea12e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-974977857", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap939862e4-4e", "ovs_interfaceid": "939862e4-4e68-484c-bbcd-95faf922a641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:55:18.772611 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:d8:ee,bridge_name='br-int',has_traffic_filtering=True,id=939862e4-4e68-484c-bbcd-95faf922a641,network=Network(07811dc4-ff38-4d15-a899-007fdeea12e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap939862e4-4e') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:55:18.774166 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:54:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-816699505',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-device-tagging-server-816699505',id=16,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFb4MdstYi3e4BcoWgJNrYYwrxogOgR+UEefY4K3bu6XOWdCVixfd8Z/tWUILEsfZHSabCTBL9tSi6xeabSVtuRQZOykOsXjawc/YsQNmtV8z7BBd+TQapDkhwnvY4ycw==',key_name='tempest-keypair-280238980',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aeed1ca793154290b3390c9300844303',ramdisk_id='',reservation_id='r-ujpreusk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2114446049',owner_user_name='tempest-TaggedBootDevicesTest_v242-2114446049-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:54:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3628360fdd1044689e5e94535d1b7fcd',uuid=0cca8054-2a26-436f-93b8-ef28e452bd65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7896c8d5-ea83-4141-8344-6b557e45d6d1", "address": "fa:16:3e:e4:05:23", "network": {"id": "07811dc4-ff38-4d15-a899-007fdeea12e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-974977857", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7896c8d5-ea", "ovs_interfaceid": "7896c8d5-ea83-4141-8344-6b557e45d6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:55:18.774350 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Converting VIF {"id": "7896c8d5-ea83-4141-8344-6b557e45d6d1", "address": "fa:16:3e:e4:05:23", "network": {"id": "07811dc4-ff38-4d15-a899-007fdeea12e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-974977857", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7896c8d5-ea", "ovs_interfaceid": "7896c8d5-ea83-4141-8344-6b557e45d6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:55:18.774704 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:05:23,bridge_name='br-int',has_traffic_filtering=True,id=7896c8d5-ea83-4141-8344-6b557e45d6d1,network=Network(07811dc4-ff38-4d15-a899-007fdeea12e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7896c8d5-ea') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:55:18.777768 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:54:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-816699505',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-device-tagging-server-816699505',id=16,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFb4MdstYi3e4BcoWgJNrYYwrxogOgR+UEefY4K3bu6XOWdCVixfd8Z/tWUILEsfZHSabCTBL9tSi6xeabSVtuRQZOykOsXjawc/YsQNmtV8z7BBd+TQapDkhwnvY4ycw==',key_name='tempest-keypair-280238980',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aeed1ca793154290b3390c9300844303',ramdisk_id='',reservation_id='r-ujpreusk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2114446049',owner_user_name='tempest-TaggedBootDevicesTest_v242-2114446049-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:54:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3628360fdd1044689e5e94535d1b7fcd',uuid=0cca8054-2a26-436f-93b8-ef28e452bd65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78c3c570-3a3b-484e-bc76-7d91862ff0d4", "address": "fa:16:3e:20:fa:56", "network": {"id": "07811dc4-ff38-4d15-a899-007fdeea12e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-974977857", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap78c3c570-3a", "ovs_interfaceid": "78c3c570-3a3b-484e-bc76-7d91862ff0d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:55:18.777963 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Converting VIF {"id": "78c3c570-3a3b-484e-bc76-7d91862ff0d4", "address": "fa:16:3e:20:fa:56", "network": {"id": "07811dc4-ff38-4d15-a899-007fdeea12e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-974977857", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap78c3c570-3a", "ovs_interfaceid": "78c3c570-3a3b-484e-bc76-7d91862ff0d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:55:18.778366 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:fa:56,bridge_name='br-int',has_traffic_filtering=True,id=78c3c570-3a3b-484e-bc76-7d91862ff0d4,network=Network(07811dc4-ff38-4d15-a899-007fdeea12e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78c3c570-3a') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:55:18.779014 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:54:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-816699505',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-device-tagging-server-816699505',id=16,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFb4MdstYi3e4BcoWgJNrYYwrxogOgR+UEefY4K3bu6XOWdCVixfd8Z/tWUILEsfZHSabCTBL9tSi6xeabSVtuRQZOykOsXjawc/YsQNmtV8z7BBd+TQapDkhwnvY4ycw==',key_name='tempest-keypair-280238980',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aeed1ca793154290b3390c9300844303',ramdisk_id='',reservation_id='r-ujpreusk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2114446049',owner_user_name='tempest-TaggedBootDevicesTest_v242-2114446049-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:54:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3628360fdd1044689e5e94535d1b7fcd',uuid=0cca8054-2a26-436f-93b8-ef28e452bd65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "766c9d77-3578-4071-b0eb-f2a929ee0445", "address": "fa:16:3e:0a:6e:61", "network": {"id": "07811dc4-ff38-4d15-a899-007fdeea12e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-974977857", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap766c9d77-35", "ovs_interfaceid": "766c9d77-3578-4071-b0eb-f2a929ee0445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:55:18.779174 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Converting VIF {"id": "766c9d77-3578-4071-b0eb-f2a929ee0445", "address": "fa:16:3e:0a:6e:61", "network": {"id": "07811dc4-ff38-4d15-a899-007fdeea12e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-974977857", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap766c9d77-35", "ovs_interfaceid": "766c9d77-3578-4071-b0eb-f2a929ee0445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:55:18.780791 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:6e:61,bridge_name='br-int',has_traffic_filtering=True,id=766c9d77-3578-4071-b0eb-f2a929ee0445,network=Network(07811dc4-ff38-4d15-a899-007fdeea12e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap766c9d77-35') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:55:18.781811 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:54:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-816699505',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-device-tagging-server-816699505',id=16,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFb4MdstYi3e4BcoWgJNrYYwrxogOgR+UEefY4K3bu6XOWdCVixfd8Z/tWUILEsfZHSabCTBL9tSi6xeabSVtuRQZOykOsXjawc/YsQNmtV8z7BBd+TQapDkhwnvY4ycw==',key_name='tempest-keypair-280238980',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aeed1ca793154290b3390c9300844303',ramdisk_id='',reservation_id='r-ujpreusk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2114446049',owner_user_name='tempest-TaggedBootDevicesTest_v242-2114446049-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:54:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3628360fdd1044689e5e94535d1b7fcd',uuid=0cca8054-2a26-436f-93b8-ef28e452bd65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d868b893-10e8-42d1-872f-bf4b9e8d3659", "address": "fa:16:3e:59:94:6e", "network": {"id": "7de6eee4-0d64-4194-b730-0b1e9ac928b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-2098291513", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd868b893-10", "ovs_interfaceid": "d868b893-10e8-42d1-872f-bf4b9e8d3659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:55:18.782673 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Converting VIF {"id": "d868b893-10e8-42d1-872f-bf4b9e8d3659", "address": "fa:16:3e:59:94:6e", "network": {"id": "7de6eee4-0d64-4194-b730-0b1e9ac928b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-2098291513", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd868b893-10", "ovs_interfaceid": "d868b893-10e8-42d1-872f-bf4b9e8d3659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:55:18.783368 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:94:6e,bridge_name='br-int',has_traffic_filtering=True,id=d868b893-10e8-42d1-872f-bf4b9e8d3659,network=Network(7de6eee4-0d64-4194-b730-0b1e9ac928b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd868b893-10') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:55:18.784539 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:54:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-816699505',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-device-tagging-server-816699505',id=16,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFb4MdstYi3e4BcoWgJNrYYwrxogOgR+UEefY4K3bu6XOWdCVixfd8Z/tWUILEsfZHSabCTBL9tSi6xeabSVtuRQZOykOsXjawc/YsQNmtV8z7BBd+TQapDkhwnvY4ycw==',key_name='tempest-keypair-280238980',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aeed1ca793154290b3390c9300844303',ramdisk_id='',reservation_id='r-ujpreusk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2114446049',owner_user_name='tempest-TaggedBootDevicesTest_v242-2114446049-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:54:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3628360fdd1044689e5e94535d1b7fcd',uuid=0cca8054-2a26-436f-93b8-ef28e452bd65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ca5546d-4b44-4470-92d7-08800876e89b", "address": "fa:16:3e:25:2d:87", "network": {"id": "7de6eee4-0d64-4194-b730-0b1e9ac928b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-2098291513", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca5546d-4b", "ovs_interfaceid": "9ca5546d-4b44-4470-92d7-08800876e89b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:55:18.784913 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Converting VIF {"id": "9ca5546d-4b44-4470-92d7-08800876e89b", "address": "fa:16:3e:25:2d:87", "network": {"id": "7de6eee4-0d64-4194-b730-0b1e9ac928b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-2098291513", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca5546d-4b", "ovs_interfaceid": "9ca5546d-4b44-4470-92d7-08800876e89b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:55:18.785277 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:2d:87,bridge_name='br-int',has_traffic_filtering=True,id=9ca5546d-4b44-4470-92d7-08800876e89b,network=Network(7de6eee4-0d64-4194-b730-0b1e9ac928b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ca5546d-4b') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:55:18.786353 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Lazy-loading 'pci_devices' on Instance uuid 0cca8054-2a26-436f-93b8-ef28e452bd65 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:55:18.893559 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-e0acbacb-3031-4a55-b287-7eb97555ba4b req-312aadff-1d12-4d36-bbbf-9a5f31b12063 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:18.957322 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:55:18.957583 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:55:18.957910 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:55:18.958106 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:55:18.958405 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:55:18.958672 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:55:18.959546 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:55:18.959546 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:55:18.960012 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 01:55:18.960296 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:55:19.052439 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:19.089435 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:19.196294 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:19.204482 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:55:19.209202 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Acquiring lock "refresh_cache-df5768dc-874f-4725-b2a2-e007aebc11a9" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:55:19.209338 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Acquired lock "refresh_cache-df5768dc-874f-4725-b2a2-e007aebc11a9" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:55:19.209502 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:55:19.255993 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:19.268528 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:19.292440 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] End _get_guest_xml xml=<domain type="qemu">
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:   <uuid>0cca8054-2a26-436f-93b8-ef28e452bd65</uuid>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:   <name>instance-00000010</name>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <nova:name>tempest-device-tagging-server-816699505</nova:name>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:55:05</nova:creationTime>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:         <nova:user uuid="3628360fdd1044689e5e94535d1b7fcd">tempest-TaggedBootDevicesTest_v242-2114446049-project-member</nova:user>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:         <nova:project uuid="aeed1ca793154290b3390c9300844303">tempest-TaggedBootDevicesTest_v242-2114446049</nova:project>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:         <nova:port uuid="dfa132bb-afe8-4b97-909b-816f3e916bfd">
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:         <nova:port uuid="939862e4-4e68-484c-bbcd-95faf922a641">
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.1.7" ipVersion="4"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:         <nova:port uuid="7896c8d5-ea83-4141-8344-6b557e45d6d1">
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.1.8" ipVersion="4"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:         <nova:port uuid="78c3c570-3a3b-484e-bc76-7d91862ff0d4">
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.1.153" ipVersion="4"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:         <nova:port uuid="766c9d77-3578-4071-b0eb-f2a929ee0445">
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.1.111" ipVersion="4"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:         <nova:port uuid="d868b893-10e8-42d1-872f-bf4b9e8d3659">
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:         <nova:port uuid="9ca5546d-4b44-4470-92d7-08800876e89b">
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:     <system>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <entry name="serial">0cca8054-2a26-436f-93b8-ef28e452bd65</entry>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <entry name="uuid">0cca8054-2a26-436f-93b8-ef28e452bd65</entry>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:     </system>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:   <os>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:   </os>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:   <features>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:   </features>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:   <devices>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/0cca8054-2a26-436f-93b8-ef28e452bd65/disk.config"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:     </disk>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:     <disk type="block" device="disk">
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <alias name="ua-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <source dev="/dev/dm-0"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <serial>cb9e2524-4a7c-470b-9095-1bc5e1a51eb9</serial>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:     </disk>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:     <disk type="block" device="disk">
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <alias name="ua-7d62e380-a6af-45e6-aefa-214f97c0760b"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <source dev="/dev/dm-6"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <target dev="vdb" bus="virtio"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <serial>7d62e380-a6af-45e6-aefa-214f97c0760b</serial>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:     </disk>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:     <disk type="block" device="disk">
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <alias name="ua-1319d85a-02ed-497c-a138-d2b9a5b28c6e"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <source dev="/dev/dm-8"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <target dev="vdc" bus="virtio"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <serial>1319d85a-02ed-497c-a138-d2b9a5b28c6e</serial>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:     </disk>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:e3:af:b5"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <target dev="tapdfa132bb-af"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:     </interface>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:2d:d8:ee"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <target dev="tap939862e4-4e"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:     </interface>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:e4:05:23"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <target dev="tap7896c8d5-ea"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:     </interface>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:20:fa:56"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <target dev="tap78c3c570-3a"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:     </interface>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:0a:6e:61"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <target dev="tap766c9d77-35"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:     </interface>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:59:94:6e"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <target dev="tapd868b893-10"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:     </interface>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:25:2d:87"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <target dev="tap9ca5546d-4b"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:     </interface>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/0cca8054-2a26-436f-93b8-ef28e452bd65/console.log" append="off"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:     </serial>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:     <video>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:     </video>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:     </rng>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:   </devices>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]: </domain>
May 28 01:55:19.292440 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:55:19.301355 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Preparing to wait for external event network-vif-plugged-dfa132bb-afe8-4b97-909b-816f3e916bfd {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:55:19.301355 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Acquiring lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:19.301355 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:19.301355 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:19.301355 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Preparing to wait for external event network-vif-plugged-939862e4-4e68-484c-bbcd-95faf922a641 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:55:19.301355 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Acquiring lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:19.301355 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:19.301355 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:19.301355 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Preparing to wait for external event network-vif-plugged-7896c8d5-ea83-4141-8344-6b557e45d6d1 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:55:19.301355 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Acquiring lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:19.301355 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:19.301355 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:19.301355 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Preparing to wait for external event network-vif-plugged-78c3c570-3a3b-484e-bc76-7d91862ff0d4 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:55:19.301355 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Acquiring lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:19.301355 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:19.301355 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:19.301355 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Preparing to wait for external event network-vif-plugged-766c9d77-3578-4071-b0eb-f2a929ee0445 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:55:19.301355 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Acquiring lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:19.301355 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:19.301355 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:19.301355 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Preparing to wait for external event network-vif-plugged-d868b893-10e8-42d1-872f-bf4b9e8d3659 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:55:19.301355 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Acquiring lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:19.301355 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:19.301355 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:19.301355 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Preparing to wait for external event network-vif-plugged-9ca5546d-4b44-4470-92d7-08800876e89b {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:55:19.301355 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Acquiring lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:19.301355 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:19.301355 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:19.306642 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:54:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-816699505',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-device-tagging-server-816699505',id=16,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFb4MdstYi3e4BcoWgJNrYYwrxogOgR+UEefY4K3bu6XOWdCVixfd8Z/tWUILEsfZHSabCTBL9tSi6xeabSVtuRQZOykOsXjawc/YsQNmtV8z7BBd+TQapDkhwnvY4ycw==',key_name='tempest-keypair-280238980',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aeed1ca793154290b3390c9300844303',ramdisk_id='',reservation_id='r-ujpreusk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2114446049',owner_user_name='tempest-TaggedBootDevicesTest_v242-2114446049-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:54:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3628360fdd1044689e5e94535d1b7fcd',uuid=0cca8054-2a26-436f-93b8-ef28e452bd65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfa132bb-afe8-4b97-909b-816f3e916bfd", "address": "fa:16:3e:e3:af:b5", "network": {"id": "3fed2ebb-cfdf-471c-963f-f350742f2200", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1888324923-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa132bb-af", "ovs_interfaceid": "dfa132bb-afe8-4b97-909b-816f3e916bfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:55:19.306642 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Converting VIF {"id": "dfa132bb-afe8-4b97-909b-816f3e916bfd", "address": "fa:16:3e:e3:af:b5", "network": {"id": "3fed2ebb-cfdf-471c-963f-f350742f2200", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1888324923-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa132bb-af", "ovs_interfaceid": "dfa132bb-afe8-4b97-909b-816f3e916bfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:55:19.306642 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:af:b5,bridge_name='br-int',has_traffic_filtering=True,id=dfa132bb-afe8-4b97-909b-816f3e916bfd,network=Network(3fed2ebb-cfdf-471c-963f-f350742f2200),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfa132bb-af') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:55:19.306642 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:af:b5,bridge_name='br-int',has_traffic_filtering=True,id=dfa132bb-afe8-4b97-909b-816f3e916bfd,network=Network(3fed2ebb-cfdf-471c-963f-f350742f2200),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfa132bb-af') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:55:19.306642 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:19.306642 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:19.306642 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:55:19.306642 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:19.306642 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dea9607a-7adb-53fa-aa7e-fad916401941', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:19.306642 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:19.308312 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:55:19.308312 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:55:19.308665 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:55:19.318055 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:19.324527 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:19.324527 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdfa132bb-af, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:19.324919 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdfa132bb-af, col_values=(('qos', UUID('e60d45eb-8632-4ff6-90c1-815b49177094')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:19.325462 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdfa132bb-af, col_values=(('external_ids', {'iface-id': 'dfa132bb-afe8-4b97-909b-816f3e916bfd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:af:b5', 'vm-uuid': '0cca8054-2a26-436f-93b8-ef28e452bd65'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:19.328851 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:19.332556 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:55:19.334382 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:55:19.334382 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:55:19.337777 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:55:19.337777 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:19.359774 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:19.360268 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:19.362376 np0000001583 nova-compute[98241]: INFO os_vif [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:af:b5,bridge_name='br-int',has_traffic_filtering=True,id=dfa132bb-afe8-4b97-909b-816f3e916bfd,network=Network(3fed2ebb-cfdf-471c-963f-f350742f2200),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfa132bb-af')
May 28 01:55:19.364716 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:54:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-816699505',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-device-tagging-server-816699505',id=16,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFb4MdstYi3e4BcoWgJNrYYwrxogOgR+UEefY4K3bu6XOWdCVixfd8Z/tWUILEsfZHSabCTBL9tSi6xeabSVtuRQZOykOsXjawc/YsQNmtV8z7BBd+TQapDkhwnvY4ycw==',key_name='tempest-keypair-280238980',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aeed1ca793154290b3390c9300844303',ramdisk_id='',reservation_id='r-ujpreusk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2114446049',owner_user_name='tempest-TaggedBootDevicesTest_v242-2114446049-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:54:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3628360fdd1044689e5e94535d1b7fcd',uuid=0cca8054-2a26-436f-93b8-ef28e452bd65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "939862e4-4e68-484c-bbcd-95faf922a641", "address": "fa:16:3e:2d:d8:ee", "network": {"id": "07811dc4-ff38-4d15-a899-007fdeea12e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-974977857", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap939862e4-4e", "ovs_interfaceid": "939862e4-4e68-484c-bbcd-95faf922a641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:55:19.364716 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Converting VIF {"id": "939862e4-4e68-484c-bbcd-95faf922a641", "address": "fa:16:3e:2d:d8:ee", "network": {"id": "07811dc4-ff38-4d15-a899-007fdeea12e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-974977857", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap939862e4-4e", "ovs_interfaceid": "939862e4-4e68-484c-bbcd-95faf922a641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:55:19.364716 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:d8:ee,bridge_name='br-int',has_traffic_filtering=True,id=939862e4-4e68-484c-bbcd-95faf922a641,network=Network(07811dc4-ff38-4d15-a899-007fdeea12e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap939862e4-4e') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:55:19.365809 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:d8:ee,bridge_name='br-int',has_traffic_filtering=True,id=939862e4-4e68-484c-bbcd-95faf922a641,network=Network(07811dc4-ff38-4d15-a899-007fdeea12e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap939862e4-4e') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:55:19.366173 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:19.366430 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:19.366602 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:55:19.370016 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:19.370608 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:19.371072 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd6894998-8ce9-5181-818c-6476c570c59d', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:19.373686 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:19.374700 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:55:19.382723 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:19.382723 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:19.382723 np0000001583 nova-compute[98241]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:19.382723 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:19.382723 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:19.382723 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:19.382723 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:19.382723 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:19.382723 np0000001583 nova-compute[98241]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:19.382723 np0000001583 nova-compute[98241]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:19.382723 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:55:19.382723 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsi session list stdout=tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:19.382723 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:19.382723 np0000001583 nova-compute[98241]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:19.382723 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:19.382723 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:19.382723 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:19.382723 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:19.382723 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:19.382723 np0000001583 nova-compute[98241]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:19.382723 np0000001583 nova-compute[98241]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:19.382723 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:55:19.396720 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:19.396720 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:19.396720 np0000001583 nova-compute[98241]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:19.396720 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:19.396720 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:19.396720 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:19.396720 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:19.396720 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:19.396720 np0000001583 nova-compute[98241]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:19.396720 np0000001583 nova-compute[98241]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:19.396720 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:55:19.396720 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsi session list stdout=tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:19.396720 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:19.396720 np0000001583 nova-compute[98241]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:19.396720 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:19.396720 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:19.396720 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:19.396720 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:19.396720 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:19.396720 np0000001583 nova-compute[98241]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:19.396720 np0000001583 nova-compute[98241]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:19.396720 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:55:19.398411 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:19.405106 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:19.405106 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap939862e4-4e, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:19.405106 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap939862e4-4e, col_values=(('qos', UUID('09353074-6638-4df6-bae9-241e7b66515e')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:19.405281 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap939862e4-4e, col_values=(('external_ids', {'iface-id': '939862e4-4e68-484c-bbcd-95faf922a641', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:d8:ee', 'vm-uuid': '0cca8054-2a26-436f-93b8-ef28e452bd65'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:19.406357 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:19.407688 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:55:19.439599 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-e0acbacb-3031-4a55-b287-7eb97555ba4b req-312aadff-1d12-4d36-bbbf-9a5f31b12063 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:19.443185 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:19.451513 np0000001583 nova-compute[98241]: INFO os_vif [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:d8:ee,bridge_name='br-int',has_traffic_filtering=True,id=939862e4-4e68-484c-bbcd-95faf922a641,network=Network(07811dc4-ff38-4d15-a899-007fdeea12e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap939862e4-4e')
May 28 01:55:19.451513 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:54:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-816699505',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-device-tagging-server-816699505',id=16,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFb4MdstYi3e4BcoWgJNrYYwrxogOgR+UEefY4K3bu6XOWdCVixfd8Z/tWUILEsfZHSabCTBL9tSi6xeabSVtuRQZOykOsXjawc/YsQNmtV8z7BBd+TQapDkhwnvY4ycw==',key_name='tempest-keypair-280238980',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aeed1ca793154290b3390c9300844303',ramdisk_id='',reservation_id='r-ujpreusk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2114446049',owner_user_name='tempest-TaggedBootDevicesTest_v242-2114446049-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:54:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3628360fdd1044689e5e94535d1b7fcd',uuid=0cca8054-2a26-436f-93b8-ef28e452bd65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7896c8d5-ea83-4141-8344-6b557e45d6d1", "address": "fa:16:3e:e4:05:23", "network": {"id": "07811dc4-ff38-4d15-a899-007fdeea12e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-974977857", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7896c8d5-ea", "ovs_interfaceid": "7896c8d5-ea83-4141-8344-6b557e45d6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:55:19.451513 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Converting VIF {"id": "7896c8d5-ea83-4141-8344-6b557e45d6d1", "address": "fa:16:3e:e4:05:23", "network": {"id": "07811dc4-ff38-4d15-a899-007fdeea12e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-974977857", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7896c8d5-ea", "ovs_interfaceid": "7896c8d5-ea83-4141-8344-6b557e45d6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:55:19.451513 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:05:23,bridge_name='br-int',has_traffic_filtering=True,id=7896c8d5-ea83-4141-8344-6b557e45d6d1,network=Network(07811dc4-ff38-4d15-a899-007fdeea12e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7896c8d5-ea') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:55:19.451513 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:05:23,bridge_name='br-int',has_traffic_filtering=True,id=7896c8d5-ea83-4141-8344-6b557e45d6d1,network=Network(07811dc4-ff38-4d15-a899-007fdeea12e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7896c8d5-ea') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:55:19.451513 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:19.451513 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:19.451513 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:55:19.453800 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:19.453800 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '005a7953-ec41-592c-b999-1d62149bfdea', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:19.455941 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:19.455941 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:55:19.467918 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463, portal: 192.168.40.100,3260]
May 28 01:55:19.467918 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463, portal: 192.168.40.100,3260] successful.
May 28 01:55:19.467918 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:19.471152 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:19.471152 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:19.471338 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:19.472135 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Auditing locally available compute resources for np0000001583 (node: np0000001583) {{(pid=98241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 01:55:19.477385 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463, portal: 192.168.50.100,3260]
May 28 01:55:19.477385 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463, portal: 192.168.50.100,3260] successful.
May 28 01:55:19.477385 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:19.481029 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:19.488962 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:19.489470 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7896c8d5-ea, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:19.489602 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7896c8d5-ea, col_values=(('qos', UUID('9b161099-9298-48b7-b6e1-d2b320cbc798')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:19.489775 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7896c8d5-ea, col_values=(('external_ids', {'iface-id': '7896c8d5-ea83-4141-8344-6b557e45d6d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:05:23', 'vm-uuid': '0cca8054-2a26-436f-93b8-ef28e452bd65'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:19.492321 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:19.493785 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:55:19.494275 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:19.496578 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:19.521673 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:19.521673 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:19.521673 np0000001583 nova-compute[98241]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:19.521673 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:19.521673 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:19.521673 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:19.521673 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:19.521673 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:19.521673 np0000001583 nova-compute[98241]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:19.521673 np0000001583 nova-compute[98241]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:19.521673 np0000001583 nova-compute[98241]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:55:19.521673 np0000001583 nova-compute[98241]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:55:19.521673 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:55:19.523205 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsi session list stdout=tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:19.523205 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:19.523205 np0000001583 nova-compute[98241]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:19.523205 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:19.523205 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:19.523205 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:19.523205 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:19.523205 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:19.523205 np0000001583 nova-compute[98241]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:19.523205 np0000001583 nova-compute[98241]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:19.523205 np0000001583 nova-compute[98241]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:55:19.523205 np0000001583 nova-compute[98241]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:55:19.523205 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:55:19.523205 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.260s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:55:19.523205 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:55:19.527347 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] HCTL ('17', '-', '-', 0) found on session 42 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:55:19.527347 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:55:19.529860 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:19.531698 np0000001583 nova-compute[98241]: INFO os_vif [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:05:23,bridge_name='br-int',has_traffic_filtering=True,id=7896c8d5-ea83-4141-8344-6b557e45d6d1,network=Network(07811dc4-ff38-4d15-a899-007fdeea12e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7896c8d5-ea')
May 28 01:55:19.534043 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:54:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-816699505',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-device-tagging-server-816699505',id=16,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFb4MdstYi3e4BcoWgJNrYYwrxogOgR+UEefY4K3bu6XOWdCVixfd8Z/tWUILEsfZHSabCTBL9tSi6xeabSVtuRQZOykOsXjawc/YsQNmtV8z7BBd+TQapDkhwnvY4ycw==',key_name='tempest-keypair-280238980',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aeed1ca793154290b3390c9300844303',ramdisk_id='',reservation_id='r-ujpreusk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2114446049',owner_user_name='tempest-TaggedBootDevicesTest_v242-2114446049-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:54:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3628360fdd1044689e5e94535d1b7fcd',uuid=0cca8054-2a26-436f-93b8-ef28e452bd65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78c3c570-3a3b-484e-bc76-7d91862ff0d4", "address": "fa:16:3e:20:fa:56", "network": {"id": "07811dc4-ff38-4d15-a899-007fdeea12e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-974977857", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap78c3c570-3a", "ovs_interfaceid": "78c3c570-3a3b-484e-bc76-7d91862ff0d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:55:19.534043 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Converting VIF {"id": "78c3c570-3a3b-484e-bc76-7d91862ff0d4", "address": "fa:16:3e:20:fa:56", "network": {"id": "07811dc4-ff38-4d15-a899-007fdeea12e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-974977857", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap78c3c570-3a", "ovs_interfaceid": "78c3c570-3a3b-484e-bc76-7d91862ff0d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:55:19.534043 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:fa:56,bridge_name='br-int',has_traffic_filtering=True,id=78c3c570-3a3b-484e-bc76-7d91862ff0d4,network=Network(07811dc4-ff38-4d15-a899-007fdeea12e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78c3c570-3a') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:55:19.534043 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:fa:56,bridge_name='br-int',has_traffic_filtering=True,id=78c3c570-3a3b-484e-bc76-7d91862ff0d4,network=Network(07811dc4-ff38-4d15-a899-007fdeea12e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78c3c570-3a') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:55:19.536357 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:19.536357 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:19.536357 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:55:19.536534 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:19.536534 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:19.536534 np0000001583 nova-compute[98241]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:19.536534 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:19.536534 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:19.536534 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:19.536534 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:19.536534 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:19.536534 np0000001583 nova-compute[98241]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:19.536534 np0000001583 nova-compute[98241]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:19.536534 np0000001583 nova-compute[98241]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:55:19.536534 np0000001583 nova-compute[98241]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:55:19.536534 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:55:19.536896 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsi session list stdout=tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:19.536896 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:19.536896 np0000001583 nova-compute[98241]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:19.536896 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:19.536896 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:19.536896 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:19.536896 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:19.536896 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:19.536896 np0000001583 nova-compute[98241]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:19.536896 np0000001583 nova-compute[98241]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:19.536896 np0000001583 nova-compute[98241]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:55:19.536896 np0000001583 nova-compute[98241]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:55:19.536896 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:55:19.537227 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.272s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:55:19.537227 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:55:19.541438 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:19.541758 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '57d6f065-a68d-5c94-bf2b-16d713c7656e', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:19.542754 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] HCTL ('18', '-', '-', 0) found on session 43 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:55:19.542986 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:55:19.543690 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:19.544671 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:55:19.558052 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Searching for a device in session 42 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:55:19.558542 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'eeb7082f-9899-40c8-ab6f-3d746680d463', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:55:19.580996 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Searching for a device in session 43 and hctl ['18', '*', '*', 0] yield: None {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:55:19.580996 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:19.590210 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:19.590493 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap78c3c570-3a, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:19.591036 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap78c3c570-3a, col_values=(('qos', UUID('e66b9ee2-65ca-439a-9540-6cb3eeedd691')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:19.591036 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap78c3c570-3a, col_values=(('external_ids', {'iface-id': '78c3c570-3a3b-484e-bc76-7d91862ff0d4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:fa:56', 'vm-uuid': '0cca8054-2a26-436f-93b8-ef28e452bd65'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:19.597034 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:55:19.631281 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:19.632275 np0000001583 nova-compute[98241]: INFO os_vif [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:fa:56,bridge_name='br-int',has_traffic_filtering=True,id=78c3c570-3a3b-484e-bc76-7d91862ff0d4,network=Network(07811dc4-ff38-4d15-a899-007fdeea12e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78c3c570-3a')
May 28 01:55:19.633104 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:54:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-816699505',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-device-tagging-server-816699505',id=16,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFb4MdstYi3e4BcoWgJNrYYwrxogOgR+UEefY4K3bu6XOWdCVixfd8Z/tWUILEsfZHSabCTBL9tSi6xeabSVtuRQZOykOsXjawc/YsQNmtV8z7BBd+TQapDkhwnvY4ycw==',key_name='tempest-keypair-280238980',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aeed1ca793154290b3390c9300844303',ramdisk_id='',reservation_id='r-ujpreusk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2114446049',owner_user_name='tempest-TaggedBootDevicesTest_v242-2114446049-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:54:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3628360fdd1044689e5e94535d1b7fcd',uuid=0cca8054-2a26-436f-93b8-ef28e452bd65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "766c9d77-3578-4071-b0eb-f2a929ee0445", "address": "fa:16:3e:0a:6e:61", "network": {"id": "07811dc4-ff38-4d15-a899-007fdeea12e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-974977857", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap766c9d77-35", "ovs_interfaceid": "766c9d77-3578-4071-b0eb-f2a929ee0445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:55:19.633291 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Converting VIF {"id": "766c9d77-3578-4071-b0eb-f2a929ee0445", "address": "fa:16:3e:0a:6e:61", "network": {"id": "07811dc4-ff38-4d15-a899-007fdeea12e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-974977857", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap766c9d77-35", "ovs_interfaceid": "766c9d77-3578-4071-b0eb-f2a929ee0445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:55:19.634056 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:6e:61,bridge_name='br-int',has_traffic_filtering=True,id=766c9d77-3578-4071-b0eb-f2a929ee0445,network=Network(07811dc4-ff38-4d15-a899-007fdeea12e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap766c9d77-35') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:55:19.634249 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:6e:61,bridge_name='br-int',has_traffic_filtering=True,id=766c9d77-3578-4071-b0eb-f2a929ee0445,network=Network(07811dc4-ff38-4d15-a899-007fdeea12e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap766c9d77-35') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:55:19.635126 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:19.635126 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:19.635126 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:55:19.636622 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:19.637205 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7a50befe-52bc-5373-8df8-d151388c19ca', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:19.638902 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:19.639720 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:55:19.672972 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:19.677666 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:19.677666 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap766c9d77-35, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:19.677666 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap766c9d77-35, col_values=(('qos', UUID('f1003cae-7a36-4783-b4e3-9eadb178debd')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:19.677666 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap766c9d77-35, col_values=(('external_ids', {'iface-id': '766c9d77-3578-4071-b0eb-f2a929ee0445', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:6e:61', 'vm-uuid': '0cca8054-2a26-436f-93b8-ef28e452bd65'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:19.678328 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:19.681735 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:55:19.714112 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:19.728136 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:19.729986 np0000001583 nova-compute[98241]: INFO os_vif [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:6e:61,bridge_name='br-int',has_traffic_filtering=True,id=766c9d77-3578-4071-b0eb-f2a929ee0445,network=Network(07811dc4-ff38-4d15-a899-007fdeea12e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap766c9d77-35')
May 28 01:55:19.731384 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:54:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-816699505',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-device-tagging-server-816699505',id=16,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFb4MdstYi3e4BcoWgJNrYYwrxogOgR+UEefY4K3bu6XOWdCVixfd8Z/tWUILEsfZHSabCTBL9tSi6xeabSVtuRQZOykOsXjawc/YsQNmtV8z7BBd+TQapDkhwnvY4ycw==',key_name='tempest-keypair-280238980',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aeed1ca793154290b3390c9300844303',ramdisk_id='',reservation_id='r-ujpreusk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2114446049',owner_user_name='tempest-TaggedBootDevicesTest_v242-2114446049-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:54:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3628360fdd1044689e5e94535d1b7fcd',uuid=0cca8054-2a26-436f-93b8-ef28e452bd65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d868b893-10e8-42d1-872f-bf4b9e8d3659", "address": "fa:16:3e:59:94:6e", "network": {"id": "7de6eee4-0d64-4194-b730-0b1e9ac928b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-2098291513", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd868b893-10", "ovs_interfaceid": "d868b893-10e8-42d1-872f-bf4b9e8d3659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:55:19.734188 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Converting VIF {"id": "d868b893-10e8-42d1-872f-bf4b9e8d3659", "address": "fa:16:3e:59:94:6e", "network": {"id": "7de6eee4-0d64-4194-b730-0b1e9ac928b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-2098291513", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd868b893-10", "ovs_interfaceid": "d868b893-10e8-42d1-872f-bf4b9e8d3659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:55:19.735658 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-e0acbacb-3031-4a55-b287-7eb97555ba4b req-312aadff-1d12-4d36-bbbf-9a5f31b12063 service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Updated VIF entry in instance network info cache for port f242e691-1d28-43e0-b83a-2414c00958b8. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:55:19.736380 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:94:6e,bridge_name='br-int',has_traffic_filtering=True,id=d868b893-10e8-42d1-872f-bf4b9e8d3659,network=Network(7de6eee4-0d64-4194-b730-0b1e9ac928b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd868b893-10') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:55:19.737553 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-e0acbacb-3031-4a55-b287-7eb97555ba4b req-312aadff-1d12-4d36-bbbf-9a5f31b12063 service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Updating instance_info_cache with network_info: [{"id": "f242e691-1d28-43e0-b83a-2414c00958b8", "address": "fa:16:3e:5c:c2:5f", "network": {"id": "b31b6f30-3b80-465d-8203-e6f4c16c758c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1195490498-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "261e17e4ed4445c887b71a705d46ad7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf242e691-1d", "ovs_interfaceid": "f242e691-1d28-43e0-b83a-2414c00958b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:55:19.738993 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:94:6e,bridge_name='br-int',has_traffic_filtering=True,id=d868b893-10e8-42d1-872f-bf4b9e8d3659,network=Network(7de6eee4-0d64-4194-b730-0b1e9ac928b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd868b893-10') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:55:19.739877 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:19.740965 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:19.740965 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:55:19.744397 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:19.744397 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '85406c2b-e5eb-59d6-9fa3-5c60c510f22e', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:19.747685 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:19.749281 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:55:19.771433 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:55:19.771433 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:55:19.771433 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] No VIF found with MAC fa:16:3e:86:7e:a1, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:55:19.771433 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Using config drive
May 28 01:55:19.798158 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:19.804468 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:19.804731 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd868b893-10, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:19.805947 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd868b893-10, col_values=(('qos', UUID('dfe63a4e-9671-4919-9977-73cb39222d91')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:19.806249 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd868b893-10, col_values=(('external_ids', {'iface-id': 'd868b893-10e8-42d1-872f-bf4b9e8d3659', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:94:6e', 'vm-uuid': '0cca8054-2a26-436f-93b8-ef28e452bd65'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:19.807693 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:19.812875 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:55:19.864112 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:19.866746 np0000001583 nova-compute[98241]: INFO os_vif [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:94:6e,bridge_name='br-int',has_traffic_filtering=True,id=d868b893-10e8-42d1-872f-bf4b9e8d3659,network=Network(7de6eee4-0d64-4194-b730-0b1e9ac928b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd868b893-10')
May 28 01:55:19.866991 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:54:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-816699505',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-device-tagging-server-816699505',id=16,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFb4MdstYi3e4BcoWgJNrYYwrxogOgR+UEefY4K3bu6XOWdCVixfd8Z/tWUILEsfZHSabCTBL9tSi6xeabSVtuRQZOykOsXjawc/YsQNmtV8z7BBd+TQapDkhwnvY4ycw==',key_name='tempest-keypair-280238980',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aeed1ca793154290b3390c9300844303',ramdisk_id='',reservation_id='r-ujpreusk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2114446049',owner_user_name='tempest-TaggedBootDevicesTest_v242-2114446049-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:54:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3628360fdd1044689e5e94535d1b7fcd',uuid=0cca8054-2a26-436f-93b8-ef28e452bd65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ca5546d-4b44-4470-92d7-08800876e89b", "address": "fa:16:3e:25:2d:87", "network": {"id": "7de6eee4-0d64-4194-b730-0b1e9ac928b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-2098291513", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca5546d-4b", "ovs_interfaceid": "9ca5546d-4b44-4470-92d7-08800876e89b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:55:19.867166 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Converting VIF {"id": "9ca5546d-4b44-4470-92d7-08800876e89b", "address": "fa:16:3e:25:2d:87", "network": {"id": "7de6eee4-0d64-4194-b730-0b1e9ac928b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-2098291513", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca5546d-4b", "ovs_interfaceid": "9ca5546d-4b44-4470-92d7-08800876e89b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:55:19.868058 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:2d:87,bridge_name='br-int',has_traffic_filtering=True,id=9ca5546d-4b44-4470-92d7-08800876e89b,network=Network(7de6eee4-0d64-4194-b730-0b1e9ac928b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ca5546d-4b') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:55:19.868392 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:2d:87,bridge_name='br-int',has_traffic_filtering=True,id=9ca5546d-4b44-4470-92d7-08800876e89b,network=Network(7de6eee4-0d64-4194-b730-0b1e9ac928b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ca5546d-4b') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:55:19.868882 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:19.869940 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:19.869940 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:55:19.871228 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:19.871228 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '34c2b16e-af76-5ae6-b0e1-92035c13577b', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:19.871575 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:19.872497 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:55:19.921359 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:19.926831 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:19.927616 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9ca5546d-4b, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:19.928243 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9ca5546d-4b, col_values=(('qos', UUID('3255497a-49ed-4088-b435-801001349bda')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:19.928338 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9ca5546d-4b, col_values=(('external_ids', {'iface-id': '9ca5546d-4b44-4470-92d7-08800876e89b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:2d:87', 'vm-uuid': '0cca8054-2a26-436f-93b8-ef28e452bd65'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:19.930319 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:19.931431 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:55:19.985618 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:19.987044 np0000001583 nova-compute[98241]: INFO os_vif [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:2d:87,bridge_name='br-int',has_traffic_filtering=True,id=9ca5546d-4b44-4470-92d7-08800876e89b,network=Network(7de6eee4-0d64-4194-b730-0b1e9ac928b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ca5546d-4b')
May 28 01:55:20.177752 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:20.240264 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e0acbacb-3031-4a55-b287-7eb97555ba4b req-312aadff-1d12-4d36-bbbf-9a5f31b12063 service nova] Releasing lock "refresh_cache-8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:55:20.280235 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:20.288266 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933320.2878537, 533f5dcc-2e48-4280-84b3-facb02dea136 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:55:20.288446 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] VM Started (Lifecycle Event)
May 28 01:55:20.370158 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Updating instance_info_cache with network_info: [{"id": "d6c3c5f3-e20b-4b3e-abac-62f21007a7ad", "address": "fa:16:3e:28:95:8e", "network": {"id": "5e77962e-bcd9-4ce2-89c8-2a3c2cbd75a0", "bridge": "br-int", "label": "tempest-TestShelveInstance-351174513-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fa147b7a97664129bc2922ee1e8debc6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c3c5f3-e2", "ovs_interfaceid": "d6c3c5f3-e20b-4b3e-abac-62f21007a7ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:55:20.462788 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Creating config drive at /opt/stack/data/nova/instances/ea9459ae-6246-4d11-b46b-733449884b1b/disk.config
May 28 01:55:20.468194 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5065ddb8-5f3c-4b41-a712-5e6b3a5b7c4e req-57e0d6d8-6d66-424b-b3ad-50e938a9f9d2 service nova] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Received event network-vif-unplugged-d6c3c5f3-e20b-4b3e-abac-62f21007a7ad {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:20.468572 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5065ddb8-5f3c-4b41-a712-5e6b3a5b7c4e req-57e0d6d8-6d66-424b-b3ad-50e938a9f9d2 service nova] Acquiring lock "df5768dc-874f-4725-b2a2-e007aebc11a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:20.471564 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5065ddb8-5f3c-4b41-a712-5e6b3a5b7c4e req-57e0d6d8-6d66-424b-b3ad-50e938a9f9d2 service nova] Lock "df5768dc-874f-4725-b2a2-e007aebc11a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:20.471564 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5065ddb8-5f3c-4b41-a712-5e6b3a5b7c4e req-57e0d6d8-6d66-424b-b3ad-50e938a9f9d2 service nova] Lock "df5768dc-874f-4725-b2a2-e007aebc11a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:20.471564 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5065ddb8-5f3c-4b41-a712-5e6b3a5b7c4e req-57e0d6d8-6d66-424b-b3ad-50e938a9f9d2 service nova] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] No waiting events found dispatching network-vif-unplugged-d6c3c5f3-e20b-4b3e-abac-62f21007a7ad {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:55:20.471564 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-5065ddb8-5f3c-4b41-a712-5e6b3a5b7c4e req-57e0d6d8-6d66-424b-b3ad-50e938a9f9d2 service nova] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Received unexpected event network-vif-unplugged-d6c3c5f3-e20b-4b3e-abac-62f21007a7ad for instance with vm_state active and task_state shelving.
May 28 01:55:20.472442 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5065ddb8-5f3c-4b41-a712-5e6b3a5b7c4e req-57e0d6d8-6d66-424b-b3ad-50e938a9f9d2 service nova] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Received event network-vif-unplugged-d6c3c5f3-e20b-4b3e-abac-62f21007a7ad {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:20.473429 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ea9459ae-6246-4d11-b46b-733449884b1b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpsw0xyu1h {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:20.488423 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5065ddb8-5f3c-4b41-a712-5e6b3a5b7c4e req-57e0d6d8-6d66-424b-b3ad-50e938a9f9d2 service nova] Acquiring lock "df5768dc-874f-4725-b2a2-e007aebc11a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:20.489721 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5065ddb8-5f3c-4b41-a712-5e6b3a5b7c4e req-57e0d6d8-6d66-424b-b3ad-50e938a9f9d2 service nova] Lock "df5768dc-874f-4725-b2a2-e007aebc11a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.017s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:20.490934 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5065ddb8-5f3c-4b41-a712-5e6b3a5b7c4e req-57e0d6d8-6d66-424b-b3ad-50e938a9f9d2 service nova] Lock "df5768dc-874f-4725-b2a2-e007aebc11a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:20.490934 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5065ddb8-5f3c-4b41-a712-5e6b3a5b7c4e req-57e0d6d8-6d66-424b-b3ad-50e938a9f9d2 service nova] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] No waiting events found dispatching network-vif-unplugged-d6c3c5f3-e20b-4b3e-abac-62f21007a7ad {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:55:20.493101 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-5065ddb8-5f3c-4b41-a712-5e6b3a5b7c4e req-57e0d6d8-6d66-424b-b3ad-50e938a9f9d2 service nova] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Received unexpected event network-vif-unplugged-d6c3c5f3-e20b-4b3e-abac-62f21007a7ad for instance with vm_state active and task_state shelving.
May 28 01:55:20.493101 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5065ddb8-5f3c-4b41-a712-5e6b3a5b7c4e req-57e0d6d8-6d66-424b-b3ad-50e938a9f9d2 service nova] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Received event network-vif-plugged-b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:20.493101 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5065ddb8-5f3c-4b41-a712-5e6b3a5b7c4e req-57e0d6d8-6d66-424b-b3ad-50e938a9f9d2 service nova] Acquiring lock "533f5dcc-2e48-4280-84b3-facb02dea136-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:20.493101 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5065ddb8-5f3c-4b41-a712-5e6b3a5b7c4e req-57e0d6d8-6d66-424b-b3ad-50e938a9f9d2 service nova] Lock "533f5dcc-2e48-4280-84b3-facb02dea136-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:20.493101 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5065ddb8-5f3c-4b41-a712-5e6b3a5b7c4e req-57e0d6d8-6d66-424b-b3ad-50e938a9f9d2 service nova] Lock "533f5dcc-2e48-4280-84b3-facb02dea136-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:20.493656 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5065ddb8-5f3c-4b41-a712-5e6b3a5b7c4e req-57e0d6d8-6d66-424b-b3ad-50e938a9f9d2 service nova] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Processing event network-vif-plugged-b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:55:20.494279 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5065ddb8-5f3c-4b41-a712-5e6b3a5b7c4e req-57e0d6d8-6d66-424b-b3ad-50e938a9f9d2 service nova] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Received event network-vif-plugged-b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:20.494880 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5065ddb8-5f3c-4b41-a712-5e6b3a5b7c4e req-57e0d6d8-6d66-424b-b3ad-50e938a9f9d2 service nova] Acquiring lock "533f5dcc-2e48-4280-84b3-facb02dea136-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:20.495791 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:55:20.498443 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5065ddb8-5f3c-4b41-a712-5e6b3a5b7c4e req-57e0d6d8-6d66-424b-b3ad-50e938a9f9d2 service nova] Lock "533f5dcc-2e48-4280-84b3-facb02dea136-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:20.498443 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5065ddb8-5f3c-4b41-a712-5e6b3a5b7c4e req-57e0d6d8-6d66-424b-b3ad-50e938a9f9d2 service nova] Lock "533f5dcc-2e48-4280-84b3-facb02dea136-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:20.498443 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5065ddb8-5f3c-4b41-a712-5e6b3a5b7c4e req-57e0d6d8-6d66-424b-b3ad-50e938a9f9d2 service nova] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] No waiting events found dispatching network-vif-plugged-b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:55:20.498443 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-5065ddb8-5f3c-4b41-a712-5e6b3a5b7c4e req-57e0d6d8-6d66-424b-b3ad-50e938a9f9d2 service nova] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Received unexpected event network-vif-plugged-b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e for instance with vm_state building and task_state spawning.
May 28 01:55:20.508447 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:55:20.514648 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Instance spawned successfully.
May 28 01:55:20.514648 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:55:20.530370 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ea9459ae-6246-4d11-b46b-733449884b1b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpsw0xyu1h" returned: 0 in 0.058s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:20.575273 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Searching for a device in session 43 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:55:20.576218 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'eeb7082f-9899-40c8-ab6f-3d746680d463', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:55:20.580448 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/587a002a-2b9c-4865-8ce2-088ad567c81b/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:20.664170 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/587a002a-2b9c-4865-8ce2-088ad567c81b/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:20.665294 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/587a002a-2b9c-4865-8ce2-088ad567c81b/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:20.776785 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/587a002a-2b9c-4865-8ce2-088ad567c81b/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:20.792388 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:55:20.795826 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:55:20.873037 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Releasing lock "refresh_cache-df5768dc-874f-4725-b2a2-e007aebc11a9" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:55:20.873727 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:20.874317 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:21.003599 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:21.033403 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:55:21.033403 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:55:21.033679 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:55:21.033858 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:55:21.034413 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:55:21.034767 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:55:21.055194 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:21.137847 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:21.208109 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:21.249644 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea9459ae-6246-4d11-b46b-733449884b1b/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:21.302571 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:55:21.306096 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Found WWN 33000000086ce169e for multipath device dm-9 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:55:21.306096 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.058s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:55:21.306096 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] <== connect_volume: return (5225ms) {'type': 'block', 'scsi_wwn': '33000000086ce169e', 'path': '/dev/dm-9', 'multipath_id': '33000000086ce169e'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:55:21.306096 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000086ce169e', 'path': '/dev/dm-9', 'multipath_id': '33000000086ce169e'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:55:21.306096 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933321.3057303, 533f5dcc-2e48-4280-84b3-facb02dea136 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:55:21.306613 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] VM Paused (Lifecycle Event)
May 28 01:55:21.314891 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lazy-loading 'flavor' on Instance uuid 587a002a-2b9c-4865-8ce2-088ad567c81b {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:55:21.353908 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea9459ae-6246-4d11-b46b-733449884b1b/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:21.354626 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea9459ae-6246-4d11-b46b-733449884b1b/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:21.459386 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea9459ae-6246-4d11-b46b-733449884b1b/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:21.464856 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c36895c-9d2c-49be-b545-3658f535964a/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:21.507100 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:21.520616 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:55:21.520616 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:55:21.521873 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] No VIF found with MAC fa:16:3e:e3:af:b5, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:55:21.521873 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] No VIF found with MAC fa:16:3e:0a:6e:61, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:55:21.523979 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Using config drive
May 28 01:55:21.534087 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-15dd96c4-1b43-4128-8581-9cd1fe91c456 req-c71b207e-ecb1-49f0-bfc5-0dff96130734 service nova] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Received event network-vif-plugged-2bb36d37-52de-4dcf-abb4-35b15f363457 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:21.534408 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-15dd96c4-1b43-4128-8581-9cd1fe91c456 req-c71b207e-ecb1-49f0-bfc5-0dff96130734 service nova] Acquiring lock "ea9459ae-6246-4d11-b46b-733449884b1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:21.534644 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-15dd96c4-1b43-4128-8581-9cd1fe91c456 req-c71b207e-ecb1-49f0-bfc5-0dff96130734 service nova] Lock "ea9459ae-6246-4d11-b46b-733449884b1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:21.534810 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-15dd96c4-1b43-4128-8581-9cd1fe91c456 req-c71b207e-ecb1-49f0-bfc5-0dff96130734 service nova] Lock "ea9459ae-6246-4d11-b46b-733449884b1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:21.534975 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-15dd96c4-1b43-4128-8581-9cd1fe91c456 req-c71b207e-ecb1-49f0-bfc5-0dff96130734 service nova] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Processing event network-vif-plugged-2bb36d37-52de-4dcf-abb4-35b15f363457 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:55:21.557335 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Took 11.11 seconds to spawn the instance on the hypervisor.
May 28 01:55:21.558290 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:55:21.594654 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c36895c-9d2c-49be-b545-3658f535964a/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:21.595665 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c36895c-9d2c-49be-b545-3658f535964a/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:21.658536 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:21.707040 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c36895c-9d2c-49be-b545-3658f535964a/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:21.711608 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a4bb3b-0482-4b14-bb23-772d295b972e/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:21.753123 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:21.772626 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:21.804926 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Instance destroyed successfully.
May 28 01:55:21.806117 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Lazy-loading 'resources' on Instance uuid df5768dc-874f-4725-b2a2-e007aebc11a9 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:55:21.811596 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:55:21.815414 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933321.8146868, 533f5dcc-2e48-4280-84b3-facb02dea136 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:55:21.815414 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] VM Resumed (Lifecycle Event)
May 28 01:55:21.820388 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Attempting to attach volume eeb7082f-9899-40c8-ab6f-3d746680d463 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98241) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 01:55:21.822425 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a4bb3b-0482-4b14-bb23-772d295b972e/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:21.824175 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] attach device xml: <disk type="block" device="disk">
May 28 01:55:21.824175 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:55:21.824175 np0000001583 nova-compute[98241]:   <alias name="ua-eeb7082f-9899-40c8-ab6f-3d746680d463"/>
May 28 01:55:21.824175 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-9"/>
May 28 01:55:21.824175 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 01:55:21.824175 np0000001583 nova-compute[98241]:   <serial>eeb7082f-9899-40c8-ab6f-3d746680d463</serial>
May 28 01:55:21.824175 np0000001583 nova-compute[98241]: </disk>
May 28 01:55:21.824175 np0000001583 nova-compute[98241]:  {{(pid=98241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 01:55:21.824175 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a4bb3b-0482-4b14-bb23-772d295b972e/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:21.875924 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a4018bb5-c28a-44e8-b9d4-74ddd57fcceb req-8b6cff04-2f35-4756-a027-13f348111501 service nova] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Received event network-changed-d6c3c5f3-e20b-4b3e-abac-62f21007a7ad {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:21.878788 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a4018bb5-c28a-44e8-b9d4-74ddd57fcceb req-8b6cff04-2f35-4756-a027-13f348111501 service nova] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Refreshing instance network info cache due to event network-changed-d6c3c5f3-e20b-4b3e-abac-62f21007a7ad. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:55:21.878788 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a4018bb5-c28a-44e8-b9d4-74ddd57fcceb req-8b6cff04-2f35-4756-a027-13f348111501 service nova] Acquiring lock "refresh_cache-df5768dc-874f-4725-b2a2-e007aebc11a9" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:55:21.878788 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a4018bb5-c28a-44e8-b9d4-74ddd57fcceb req-8b6cff04-2f35-4756-a027-13f348111501 service nova] Acquired lock "refresh_cache-df5768dc-874f-4725-b2a2-e007aebc11a9" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:55:21.878788 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-a4018bb5-c28a-44e8-b9d4-74ddd57fcceb req-8b6cff04-2f35-4756-a027-13f348111501 service nova] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Refreshing network info cache for port d6c3c5f3-e20b-4b3e-abac-62f21007a7ad {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:55:21.923795 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a4bb3b-0482-4b14-bb23-772d295b972e/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:21.927018 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:55:21.931100 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/dm-7 (vda) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:55:21.933027 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:22.033726 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:22.036498 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:22.037470 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:22.080847 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Took 23.21 seconds to build instance.
May 28 01:55:22.152796 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:22.155589 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c911c7-ae44-4902-989f-3f0655243f3f/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:22.193601 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:55:22.202250 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:55:22.204763 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Instance spawned successfully.
May 28 01:55:22.208109 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:55:22.247134 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c911c7-ae44-4902-989f-3f0655243f3f/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:22.247832 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c911c7-ae44-4902-989f-3f0655243f3f/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:22.279422 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Creating config drive at /opt/stack/data/nova/instances/0cca8054-2a26-436f-93b8-ef28e452bd65/disk.config
May 28 01:55:22.290186 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0cca8054-2a26-436f-93b8-ef28e452bd65/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpktoph2gu {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:22.313490 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Object Instance<df5768dc-874f-4725-b2a2-e007aebc11a9> lazy-loaded attributes: numa_topology,resources {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:55:22.313490 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:54:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2097870267',display_name='tempest-TestShelveInstance-server-2097870267',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testshelveinstance-server-2097870267',id=12,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL46Secb60DFBeK7FYqoi8EyIkwOHDasdwHPDEkahIVyxNd9me+C0BL02CY5OdHq98hox5RGNtNExMA3lQLKOE6SZ9TSLqEp13Ql4Ayf4q9cLQMDfsak90PHfcn9GypAaA==',key_name='tempest-TestShelveInstance-1311460250',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:54:36Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fa147b7a97664129bc2922ee1e8debc6',ramdisk_id='',reservation_id='r-yyloknk0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',owner_project_name='tempest-TestShelveInstance-1732527786',owner_user_name='tempest-TestShelveInstance-1732527786-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:54:36Z,user_data=None,user_id='21c5bf800ee04e06a7ce6dfd95173502',uuid=df5768dc-874f-4725-b2a2-e007aebc11a9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6c3c5f3-e20b-4b3e-abac-62f21007a7ad", "address": "fa:16:3e:28:95:8e", "network": {"id": "5e77962e-bcd9-4ce2-89c8-2a3c2cbd75a0", "bridge": "br-int", "label": "tempest-TestShelveInstance-351174513-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fa147b7a97664129bc2922ee1e8debc6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c3c5f3-e2", "ovs_interfaceid": "d6c3c5f3-e20b-4b3e-abac-62f21007a7ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:55:22.315240 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Converting VIF {"id": "d6c3c5f3-e20b-4b3e-abac-62f21007a7ad", "address": "fa:16:3e:28:95:8e", "network": {"id": "5e77962e-bcd9-4ce2-89c8-2a3c2cbd75a0", "bridge": "br-int", "label": "tempest-TestShelveInstance-351174513-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fa147b7a97664129bc2922ee1e8debc6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c3c5f3-e2", "ovs_interfaceid": "d6c3c5f3-e20b-4b3e-abac-62f21007a7ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:55:22.316576 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:95:8e,bridge_name='br-int',has_traffic_filtering=True,id=d6c3c5f3-e20b-4b3e-abac-62f21007a7ad,network=Network(5e77962e-bcd9-4ce2-89c8-2a3c2cbd75a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6c3c5f3-e2') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:55:22.317441 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:95:8e,bridge_name='br-int',has_traffic_filtering=True,id=d6c3c5f3-e20b-4b3e-abac-62f21007a7ad,network=Network(5e77962e-bcd9-4ce2-89c8-2a3c2cbd75a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6c3c5f3-e2') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:55:22.320732 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:22.321535 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6c3c5f3-e2, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:22.323590 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:22.325096 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:55:22.326472 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:55:22.334498 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:55:22.349121 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c911c7-ae44-4902-989f-3f0655243f3f/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:22.355357 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:55:22.356400 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:22.357640 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0cca8054-2a26-436f-93b8-ef28e452bd65/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpktoph2gu" returned: 0 in 0.068s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:22.371388 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:22.382243 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-a4018bb5-c28a-44e8-b9d4-74ddd57fcceb req-8b6cff04-2f35-4756-a027-13f348111501 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:22.391254 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:22.391802 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9e94340f-4d4c-4e43-9269-86dae813fb57) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:22.399706 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:22.399819 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:55:22.402865 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.046s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:22.405322 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Hypervisor/Node resource view: name=np0000001583 free_ram=12570MB free_disk=74.35859680175781GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 01:55:22.405322 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:22.405600 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:22.437049 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:22.440050 np0000001583 nova-compute[98241]: INFO os_vif [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:95:8e,bridge_name='br-int',has_traffic_filtering=True,id=d6c3c5f3-e20b-4b3e-abac-62f21007a7ad,network=Network(5e77962e-bcd9-4ce2-89c8-2a3c2cbd75a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6c3c5f3-e2')
May 28 01:55:22.443624 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:55:22.443624 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d', 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9b421209-954a-413c-bf2c-892d99f40d2d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:55:22.443624 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:55:22.444142 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:55:22.444583 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d', 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9b421209-954a-413c-bf2c-892d99f40d2d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:55:22.444780 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:55:22.484470 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:22.484470 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:22.484470 np0000001583 nova-compute[98241]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:22.484470 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:22.484470 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:22.484470 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:22.484470 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:22.484470 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:22.484470 np0000001583 nova-compute[98241]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:22.484470 np0000001583 nova-compute[98241]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:22.484470 np0000001583 nova-compute[98241]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:55:22.484470 np0000001583 nova-compute[98241]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:55:22.484470 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:55:22.485568 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsi session list stdout=tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:22.485568 np0000001583 nova-compute[98241]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:22.485568 np0000001583 nova-compute[98241]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:22.485568 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:22.485568 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:22.485568 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:22.485568 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:22.485568 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:22.485568 np0000001583 nova-compute[98241]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:22.485568 np0000001583 nova-compute[98241]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:22.485568 np0000001583 nova-compute[98241]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:55:22.485568 np0000001583 nova-compute[98241]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:55:22.485568 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:55:22.485568 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9', '35'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b', '36'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b', '37'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797', '39'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e', '40'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e', '41'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463', '42'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463', '43')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:55:22.486545 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d', '30')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:55:22.488203 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d', '31')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:55:22.489584 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f8154d60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d'): ({'sde'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:55:22.490207 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Removing multipathed devices sdd, sde {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:55:22.492307 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Flush multipath device 3300000001305f420 {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:55:22.545777 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:55:22.582367 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "533f5dcc-2e48-4280-84b3-facb02dea136" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.736s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:22.610291 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:55:22.664934 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:55:22.664934 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:55:22.665299 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:55:22.682471 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:55:22.682721 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:55:22.699690 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:22.719220 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:55:22.722531 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:55:22.722531 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:55:22.722531 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:55:22.722531 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:55:22.722531 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:55:22.746171 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d, portal: 192.168.40.100,3260]
May 28 01:55:22.746171 np0000001583 nova-compute[98241]: Logout of [sid: 30, target: iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d, portal: 192.168.40.100,3260] successful.
May 28 01:55:22.746171 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:22.771289 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:22.789142 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:22.830972 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d, portal: 192.168.50.100,3260]
May 28 01:55:22.830972 np0000001583 nova-compute[98241]: Logout of [sid: 31, target: iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d, portal: 192.168.50.100,3260] successful.
May 28 01:55:22.830972 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:22.840937 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933322.840536, ea9459ae-6246-4d11-b46b-733449884b1b => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:55:22.841196 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] VM Started (Lifecycle Event)
May 28 01:55:22.869461 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:22.870424 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.426s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:55:22.871423 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] <== disconnect_volume: return (426ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:55:22.871788 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:55:22.872905 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Deleting instance files /opt/stack/data/nova/instances/df5768dc-874f-4725-b2a2-e007aebc11a9_del
May 28 01:55:22.874196 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Deletion of /opt/stack/data/nova/instances/df5768dc-874f-4725-b2a2-e007aebc11a9_del complete
May 28 01:55:22.932355 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:22.946443 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-a4018bb5-c28a-44e8-b9d4-74ddd57fcceb req-8b6cff04-2f35-4756-a027-13f348111501 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:23.003440 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:23.087632 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:23.184046 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-a4018bb5-c28a-44e8-b9d4-74ddd57fcceb req-8b6cff04-2f35-4756-a027-13f348111501 service nova] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Updated VIF entry in instance network info cache for port d6c3c5f3-e20b-4b3e-abac-62f21007a7ad. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:55:23.184425 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-a4018bb5-c28a-44e8-b9d4-74ddd57fcceb req-8b6cff04-2f35-4756-a027-13f348111501 service nova] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Updating instance_info_cache with network_info: [{"id": "d6c3c5f3-e20b-4b3e-abac-62f21007a7ad", "address": "fa:16:3e:28:95:8e", "network": {"id": "5e77962e-bcd9-4ce2-89c8-2a3c2cbd75a0", "bridge": null, "label": "tempest-TestShelveInstance-351174513-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fa147b7a97664129bc2922ee1e8debc6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapd6c3c5f3-e2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:55:23.216280 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:23.220482 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:23.230430 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Took 7.63 seconds to spawn the instance on the hypervisor.
May 28 01:55:23.230982 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:55:23.243558 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:23.276155 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0019265920000179904 future=<Future at 0x7724ec2d2ed0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:55:23.276155 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:55:23.276474 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=4.464306614999941 future=<Future at 0x7724ec2edb80 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:55:23.276474 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=4.464164113999914 future=<Future at 0x7724ec2edb80 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:55:23.276820 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Emitting event <LifecycleEvent: 1779933308.2737246, e73ac672-0911-4e4d-8a85-9b635a9e836f => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:55:23.277034 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] VM Stopped (Lifecycle Event)
May 28 01:55:23.306438 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:23.348090 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:55:23.354732 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:55:23.384715 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:23.437566 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:23.463486 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:23.466195 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:23.508943 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:23.527756 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:23.530749 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:23.557906 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:55:23.557906 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:55:23.557906 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:55:23.557906 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] No VIF found with MAC fa:16:3e:94:75:97, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:55:23.573658 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:23.578418 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:23.605620 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 5c36895c-9d2c-49be-b545-3658f535964a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:55:23.605684 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance df5768dc-874f-4725-b2a2-e007aebc11a9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:55:23.605808 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 587a002a-2b9c-4865-8ce2-088ad567c81b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:55:23.605950 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 75c911c7-ae44-4902-989f-3f0655243f3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:55:23.606100 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 96a4bb3b-0482-4b14-bb23-772d295b972e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:55:23.613529 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 0cca8054-2a26-436f-93b8-ef28e452bd65 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:55:23.613630 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 533f5dcc-2e48-4280-84b3-facb02dea136 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:55:23.613699 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:55:23.613775 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance ea9459ae-6246-4d11-b46b-733449884b1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:55:23.613972 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 01:55:23.614144 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Final resource view: name=np0000001583 phys_ram=24030MB used_ram=2240MB phys_disk=95GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 01:55:22 up 31 min,  2 users,  load average: 9.23, 5.56, 2.67\n', 'num_instances': '9', 'num_vm_active': '7', 'num_task_None': '6', 'num_os_type_None': '9', 'num_proj_60fbdf5ed38b4dc485a81c49b3303ed2': '2', 'io_workload': '2', 'num_task_shelving': '1', 'num_proj_fa147b7a97664129bc2922ee1e8debc6': '1', 'num_proj_2ba381dad8364a488a98b80c04cce8fb': '2', 'num_proj_6c32da4f768f48179b4be0509a25a704': '1', 'num_vm_building': '2', 'num_task_spawning': '2', 'num_proj_aeed1ca793154290b3390c9300844303': '1', 'num_proj_261e17e4ed4445c887b71a705d46ad7d': '1', 'num_proj_0d31342458ec4ed2890a766f62facbcf': '1'} {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 01:55:23.623780 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-4a43b64a-b208-44d5-b869-959c0e9d2ba4 req-44de4196-393c-47f8-979b-2ed7f4c985a7 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-vif-plugged-dfa132bb-afe8-4b97-909b-816f3e916bfd {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:23.624063 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-4a43b64a-b208-44d5-b869-959c0e9d2ba4 req-44de4196-393c-47f8-979b-2ed7f4c985a7 service nova] Acquiring lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:23.624313 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-4a43b64a-b208-44d5-b869-959c0e9d2ba4 req-44de4196-393c-47f8-979b-2ed7f4c985a7 service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:23.627067 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-4a43b64a-b208-44d5-b869-959c0e9d2ba4 req-44de4196-393c-47f8-979b-2ed7f4c985a7 service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:23.627272 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-4a43b64a-b208-44d5-b869-959c0e9d2ba4 req-44de4196-393c-47f8-979b-2ed7f4c985a7 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Processing event network-vif-plugged-dfa132bb-afe8-4b97-909b-816f3e916bfd {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:55:23.651006 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-66c2c743-d45e-4cca-9ea2-08ec3d00c69e req-38c71d92-b00e-4d12-b3c0-3599eef68347 service nova] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Received event network-vif-plugged-2bb36d37-52de-4dcf-abb4-35b15f363457 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:23.651006 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-66c2c743-d45e-4cca-9ea2-08ec3d00c69e req-38c71d92-b00e-4d12-b3c0-3599eef68347 service nova] Acquiring lock "ea9459ae-6246-4d11-b46b-733449884b1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:23.651006 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-66c2c743-d45e-4cca-9ea2-08ec3d00c69e req-38c71d92-b00e-4d12-b3c0-3599eef68347 service nova] Lock "ea9459ae-6246-4d11-b46b-733449884b1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:23.651006 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-66c2c743-d45e-4cca-9ea2-08ec3d00c69e req-38c71d92-b00e-4d12-b3c0-3599eef68347 service nova] Lock "ea9459ae-6246-4d11-b46b-733449884b1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:23.651006 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-66c2c743-d45e-4cca-9ea2-08ec3d00c69e req-38c71d92-b00e-4d12-b3c0-3599eef68347 service nova] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] No waiting events found dispatching network-vif-plugged-2bb36d37-52de-4dcf-abb4-35b15f363457 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:55:23.651006 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-66c2c743-d45e-4cca-9ea2-08ec3d00c69e req-38c71d92-b00e-4d12-b3c0-3599eef68347 service nova] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Received unexpected event network-vif-plugged-2bb36d37-52de-4dcf-abb4-35b15f363457 for instance with vm_state active and task_state None.
May 28 01:55:23.651551 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-66c2c743-d45e-4cca-9ea2-08ec3d00c69e req-38c71d92-b00e-4d12-b3c0-3599eef68347 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-vif-plugged-7896c8d5-ea83-4141-8344-6b557e45d6d1 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:23.651990 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-66c2c743-d45e-4cca-9ea2-08ec3d00c69e req-38c71d92-b00e-4d12-b3c0-3599eef68347 service nova] Acquiring lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:23.653404 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-66c2c743-d45e-4cca-9ea2-08ec3d00c69e req-38c71d92-b00e-4d12-b3c0-3599eef68347 service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:23.653635 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-66c2c743-d45e-4cca-9ea2-08ec3d00c69e req-38c71d92-b00e-4d12-b3c0-3599eef68347 service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:23.653813 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-66c2c743-d45e-4cca-9ea2-08ec3d00c69e req-38c71d92-b00e-4d12-b3c0-3599eef68347 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Processing event network-vif-plugged-7896c8d5-ea83-4141-8344-6b557e45d6d1 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:55:23.687168 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a4018bb5-c28a-44e8-b9d4-74ddd57fcceb req-8b6cff04-2f35-4756-a027-13f348111501 service nova] Releasing lock "refresh_cache-df5768dc-874f-4725-b2a2-e007aebc11a9" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:55:23.697644 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:23.758108 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Took 13.47 seconds to build instance.
May 28 01:55:23.783450 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:23.796248 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e73ac672-0911-4e4d-8a85-9b635a9e836f] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:55:23.862754 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933323.862466, ea9459ae-6246-4d11-b46b-733449884b1b => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:55:23.862936 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] VM Paused (Lifecycle Event)
May 28 01:55:23.890774 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:23.918873 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:24.046886 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:24.205551 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:24.208323 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:24.231523 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:24.269418 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b54ed154-49a9-45e3-ab45-749d62287fe7 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "ea9459ae-6246-4d11-b46b-733449884b1b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.997s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:24.359511 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Rescuing
May 28 01:55:24.359732 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "refresh_cache-533f5dcc-2e48-4280-84b3-facb02dea136" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:55:24.359887 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquired lock "refresh_cache-533f5dcc-2e48-4280-84b3-facb02dea136" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:55:24.360106 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:55:24.372914 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:55:24.378834 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933324.3783743, ea9459ae-6246-4d11-b46b-733449884b1b => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:55:24.378834 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] VM Resumed (Lifecycle Event)
May 28 01:55:24.416816 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:55:24.416816 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:55:24.537475 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:24.538771 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:24.711696 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Deleted allocations for instance df5768dc-874f-4725-b2a2-e007aebc11a9
May 28 01:55:24.745210 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:24.749747 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:24.866370 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:24.881393 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:55:24.888612 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:55:24.923357 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:55:24.960938 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:24.961919 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:25.154914 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-67f09b02-64da-4beb-a517-49351615a78a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "587a002a-2b9c-4865-8ce2-088ad567c81b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.782s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:25.201165 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:25.220172 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:25.396985 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933325.3966887, 0cca8054-2a26-436f-93b8-ef28e452bd65 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:55:25.397782 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] VM Started (Lifecycle Event)
May 28 01:55:25.434120 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:25.439795 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Compute_service record updated for np0000001583:np0000001583 {{(pid=98241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 01:55:25.440328 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:25.442021 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.035s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:25.442529 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.221s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:25.443249 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 60.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:55:25.443712 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:25.462823 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:25.474681 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:25.750547 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-3fea5c65-cf9e-4907-9889-3da5c91c2156 req-d9496c03-56d7-4a3e-a2f3-c06149f46741 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-vif-plugged-dfa132bb-afe8-4b97-909b-816f3e916bfd {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:25.750756 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-3fea5c65-cf9e-4907-9889-3da5c91c2156 req-d9496c03-56d7-4a3e-a2f3-c06149f46741 service nova] Acquiring lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:25.751414 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-3fea5c65-cf9e-4907-9889-3da5c91c2156 req-d9496c03-56d7-4a3e-a2f3-c06149f46741 service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:25.751540 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-3fea5c65-cf9e-4907-9889-3da5c91c2156 req-d9496c03-56d7-4a3e-a2f3-c06149f46741 service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:25.751718 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-3fea5c65-cf9e-4907-9889-3da5c91c2156 req-d9496c03-56d7-4a3e-a2f3-c06149f46741 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] No event matching network-vif-plugged-dfa132bb-afe8-4b97-909b-816f3e916bfd in dict_keys([('network-vif-plugged', '939862e4-4e68-484c-bbcd-95faf922a641'), ('network-vif-plugged', '78c3c570-3a3b-484e-bc76-7d91862ff0d4'), ('network-vif-plugged', '766c9d77-3578-4071-b0eb-f2a929ee0445'), ('network-vif-plugged', 'd868b893-10e8-42d1-872f-bf4b9e8d3659'), ('network-vif-plugged', '9ca5546d-4b44-4470-92d7-08800876e89b')]) {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 01:55:25.751848 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-3fea5c65-cf9e-4907-9889-3da5c91c2156 req-d9496c03-56d7-4a3e-a2f3-c06149f46741 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received unexpected event network-vif-plugged-dfa132bb-afe8-4b97-909b-816f3e916bfd for instance with vm_state building and task_state spawning.
May 28 01:55:25.752880 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-3fea5c65-cf9e-4907-9889-3da5c91c2156 req-d9496c03-56d7-4a3e-a2f3-c06149f46741 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-vif-plugged-939862e4-4e68-484c-bbcd-95faf922a641 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:25.752880 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-3fea5c65-cf9e-4907-9889-3da5c91c2156 req-d9496c03-56d7-4a3e-a2f3-c06149f46741 service nova] Acquiring lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:25.752971 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-3fea5c65-cf9e-4907-9889-3da5c91c2156 req-d9496c03-56d7-4a3e-a2f3-c06149f46741 service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:25.753116 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-3fea5c65-cf9e-4907-9889-3da5c91c2156 req-d9496c03-56d7-4a3e-a2f3-c06149f46741 service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:25.753295 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-3fea5c65-cf9e-4907-9889-3da5c91c2156 req-d9496c03-56d7-4a3e-a2f3-c06149f46741 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Processing event network-vif-plugged-939862e4-4e68-484c-bbcd-95faf922a641 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:55:25.753453 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-3fea5c65-cf9e-4907-9889-3da5c91c2156 req-d9496c03-56d7-4a3e-a2f3-c06149f46741 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-vif-plugged-939862e4-4e68-484c-bbcd-95faf922a641 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:25.753604 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-3fea5c65-cf9e-4907-9889-3da5c91c2156 req-d9496c03-56d7-4a3e-a2f3-c06149f46741 service nova] Acquiring lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:25.754892 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-3fea5c65-cf9e-4907-9889-3da5c91c2156 req-d9496c03-56d7-4a3e-a2f3-c06149f46741 service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:25.754892 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-3fea5c65-cf9e-4907-9889-3da5c91c2156 req-d9496c03-56d7-4a3e-a2f3-c06149f46741 service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:25.758473 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-3fea5c65-cf9e-4907-9889-3da5c91c2156 req-d9496c03-56d7-4a3e-a2f3-c06149f46741 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] No event matching network-vif-plugged-939862e4-4e68-484c-bbcd-95faf922a641 in dict_keys([('network-vif-plugged', '78c3c570-3a3b-484e-bc76-7d91862ff0d4'), ('network-vif-plugged', '766c9d77-3578-4071-b0eb-f2a929ee0445'), ('network-vif-plugged', 'd868b893-10e8-42d1-872f-bf4b9e8d3659'), ('network-vif-plugged', '9ca5546d-4b44-4470-92d7-08800876e89b')]) {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 01:55:25.758473 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-3fea5c65-cf9e-4907-9889-3da5c91c2156 req-d9496c03-56d7-4a3e-a2f3-c06149f46741 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received unexpected event network-vif-plugged-939862e4-4e68-484c-bbcd-95faf922a641 for instance with vm_state building and task_state spawning.
May 28 01:55:25.758473 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-3fea5c65-cf9e-4907-9889-3da5c91c2156 req-d9496c03-56d7-4a3e-a2f3-c06149f46741 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-vif-plugged-78c3c570-3a3b-484e-bc76-7d91862ff0d4 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:25.758473 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-3fea5c65-cf9e-4907-9889-3da5c91c2156 req-d9496c03-56d7-4a3e-a2f3-c06149f46741 service nova] Acquiring lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:25.758473 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-3fea5c65-cf9e-4907-9889-3da5c91c2156 req-d9496c03-56d7-4a3e-a2f3-c06149f46741 service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:25.758473 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-3fea5c65-cf9e-4907-9889-3da5c91c2156 req-d9496c03-56d7-4a3e-a2f3-c06149f46741 service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:25.758473 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-3fea5c65-cf9e-4907-9889-3da5c91c2156 req-d9496c03-56d7-4a3e-a2f3-c06149f46741 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Processing event network-vif-plugged-78c3c570-3a3b-484e-bc76-7d91862ff0d4 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:55:25.758473 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-3fea5c65-cf9e-4907-9889-3da5c91c2156 req-d9496c03-56d7-4a3e-a2f3-c06149f46741 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-vif-plugged-78c3c570-3a3b-484e-bc76-7d91862ff0d4 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:25.758473 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-3fea5c65-cf9e-4907-9889-3da5c91c2156 req-d9496c03-56d7-4a3e-a2f3-c06149f46741 service nova] Acquiring lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:25.758473 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-3fea5c65-cf9e-4907-9889-3da5c91c2156 req-d9496c03-56d7-4a3e-a2f3-c06149f46741 service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:25.758698 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-3fea5c65-cf9e-4907-9889-3da5c91c2156 req-d9496c03-56d7-4a3e-a2f3-c06149f46741 service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:25.758698 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-3fea5c65-cf9e-4907-9889-3da5c91c2156 req-d9496c03-56d7-4a3e-a2f3-c06149f46741 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] No event matching network-vif-plugged-78c3c570-3a3b-484e-bc76-7d91862ff0d4 in dict_keys([('network-vif-plugged', '766c9d77-3578-4071-b0eb-f2a929ee0445'), ('network-vif-plugged', 'd868b893-10e8-42d1-872f-bf4b9e8d3659'), ('network-vif-plugged', '9ca5546d-4b44-4470-92d7-08800876e89b')]) {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 01:55:25.762121 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-3fea5c65-cf9e-4907-9889-3da5c91c2156 req-d9496c03-56d7-4a3e-a2f3-c06149f46741 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received unexpected event network-vif-plugged-78c3c570-3a3b-484e-bc76-7d91862ff0d4 for instance with vm_state building and task_state spawning.
May 28 01:55:25.762121 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-3fea5c65-cf9e-4907-9889-3da5c91c2156 req-d9496c03-56d7-4a3e-a2f3-c06149f46741 service nova] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Received event network-changed-2bb36d37-52de-4dcf-abb4-35b15f363457 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:25.762121 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-3fea5c65-cf9e-4907-9889-3da5c91c2156 req-d9496c03-56d7-4a3e-a2f3-c06149f46741 service nova] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Refreshing instance network info cache due to event network-changed-2bb36d37-52de-4dcf-abb4-35b15f363457. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:55:25.762121 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-3fea5c65-cf9e-4907-9889-3da5c91c2156 req-d9496c03-56d7-4a3e-a2f3-c06149f46741 service nova] Acquiring lock "refresh_cache-ea9459ae-6246-4d11-b46b-733449884b1b" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:55:25.762284 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-3fea5c65-cf9e-4907-9889-3da5c91c2156 req-d9496c03-56d7-4a3e-a2f3-c06149f46741 service nova] Acquired lock "refresh_cache-ea9459ae-6246-4d11-b46b-733449884b1b" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:55:25.762351 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-3fea5c65-cf9e-4907-9889-3da5c91c2156 req-d9496c03-56d7-4a3e-a2f3-c06149f46741 service nova] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Refreshing network info cache for port 2bb36d37-52de-4dcf-abb4-35b15f363457 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:55:25.783477 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:25.788869 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b840bfab-3f67-42b3-917a-565da7e2b5d5 req-e5bb623d-c158-4beb-a96a-d6fa2c991dc9 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-vif-plugged-7896c8d5-ea83-4141-8344-6b557e45d6d1 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:25.789281 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b840bfab-3f67-42b3-917a-565da7e2b5d5 req-e5bb623d-c158-4beb-a96a-d6fa2c991dc9 service nova] Acquiring lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:25.789765 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b840bfab-3f67-42b3-917a-565da7e2b5d5 req-e5bb623d-c158-4beb-a96a-d6fa2c991dc9 service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:25.789765 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b840bfab-3f67-42b3-917a-565da7e2b5d5 req-e5bb623d-c158-4beb-a96a-d6fa2c991dc9 service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:25.789995 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b840bfab-3f67-42b3-917a-565da7e2b5d5 req-e5bb623d-c158-4beb-a96a-d6fa2c991dc9 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] No event matching network-vif-plugged-7896c8d5-ea83-4141-8344-6b557e45d6d1 in dict_keys([('network-vif-plugged', '766c9d77-3578-4071-b0eb-f2a929ee0445'), ('network-vif-plugged', 'd868b893-10e8-42d1-872f-bf4b9e8d3659'), ('network-vif-plugged', '9ca5546d-4b44-4470-92d7-08800876e89b')]) {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 01:55:25.790302 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-b840bfab-3f67-42b3-917a-565da7e2b5d5 req-e5bb623d-c158-4beb-a96a-d6fa2c991dc9 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received unexpected event network-vif-plugged-7896c8d5-ea83-4141-8344-6b557e45d6d1 for instance with vm_state building and task_state spawning.
May 28 01:55:25.790684 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b840bfab-3f67-42b3-917a-565da7e2b5d5 req-e5bb623d-c158-4beb-a96a-d6fa2c991dc9 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-vif-plugged-d868b893-10e8-42d1-872f-bf4b9e8d3659 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:25.790877 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b840bfab-3f67-42b3-917a-565da7e2b5d5 req-e5bb623d-c158-4beb-a96a-d6fa2c991dc9 service nova] Acquiring lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:25.791048 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b840bfab-3f67-42b3-917a-565da7e2b5d5 req-e5bb623d-c158-4beb-a96a-d6fa2c991dc9 service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:25.791256 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b840bfab-3f67-42b3-917a-565da7e2b5d5 req-e5bb623d-c158-4beb-a96a-d6fa2c991dc9 service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:25.791409 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b840bfab-3f67-42b3-917a-565da7e2b5d5 req-e5bb623d-c158-4beb-a96a-d6fa2c991dc9 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Processing event network-vif-plugged-d868b893-10e8-42d1-872f-bf4b9e8d3659 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:55:25.791555 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b840bfab-3f67-42b3-917a-565da7e2b5d5 req-e5bb623d-c158-4beb-a96a-d6fa2c991dc9 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-vif-plugged-d868b893-10e8-42d1-872f-bf4b9e8d3659 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:25.791715 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b840bfab-3f67-42b3-917a-565da7e2b5d5 req-e5bb623d-c158-4beb-a96a-d6fa2c991dc9 service nova] Acquiring lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:25.791861 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b840bfab-3f67-42b3-917a-565da7e2b5d5 req-e5bb623d-c158-4beb-a96a-d6fa2c991dc9 service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:25.792001 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b840bfab-3f67-42b3-917a-565da7e2b5d5 req-e5bb623d-c158-4beb-a96a-d6fa2c991dc9 service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:25.792194 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b840bfab-3f67-42b3-917a-565da7e2b5d5 req-e5bb623d-c158-4beb-a96a-d6fa2c991dc9 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] No event matching network-vif-plugged-d868b893-10e8-42d1-872f-bf4b9e8d3659 in dict_keys([('network-vif-plugged', '766c9d77-3578-4071-b0eb-f2a929ee0445'), ('network-vif-plugged', '9ca5546d-4b44-4470-92d7-08800876e89b')]) {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 01:55:25.792343 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-b840bfab-3f67-42b3-917a-565da7e2b5d5 req-e5bb623d-c158-4beb-a96a-d6fa2c991dc9 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received unexpected event network-vif-plugged-d868b893-10e8-42d1-872f-bf4b9e8d3659 for instance with vm_state building and task_state spawning.
May 28 01:55:25.809007 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7cd6b5c9-e409-416e-adf1-27b64da2e200 tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Acquiring lock "96a4bb3b-0482-4b14-bb23-772d295b972e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:25.809399 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7cd6b5c9-e409-416e-adf1-27b64da2e200 tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Lock "96a4bb3b-0482-4b14-bb23-772d295b972e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:25.809568 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7cd6b5c9-e409-416e-adf1-27b64da2e200 tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Acquiring lock "96a4bb3b-0482-4b14-bb23-772d295b972e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:25.809819 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7cd6b5c9-e409-416e-adf1-27b64da2e200 tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Lock "96a4bb3b-0482-4b14-bb23-772d295b972e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:25.809936 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7cd6b5c9-e409-416e-adf1-27b64da2e200 tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Lock "96a4bb3b-0482-4b14-bb23-772d295b972e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:25.815978 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-7cd6b5c9-e409-416e-adf1-27b64da2e200 tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Terminating instance
May 28 01:55:25.833046 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Updating instance_info_cache with network_info: [{"id": "b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e", "address": "fa:16:3e:e1:01:d3", "network": {"id": "2ee43c4e-569f-4726-9700-add40d768203", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ba381dad8364a488a98b80c04cce8fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bf1e5b-d3", "ovs_interfaceid": "b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:55:25.902289 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:55:25.911579 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933325.9112506, 0cca8054-2a26-436f-93b8-ef28e452bd65 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:55:25.912000 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] VM Paused (Lifecycle Event)
May 28 01:55:26.137230 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:55:26.137462 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:55:26.264523 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-3fea5c65-cf9e-4907-9889-3da5c91c2156 req-d9496c03-56d7-4a3e-a2f3-c06149f46741 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:26.334973 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-7cd6b5c9-e409-416e-adf1-27b64da2e200 tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:55:26.339072 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Releasing lock "refresh_cache-533f5dcc-2e48-4280-84b3-facb02dea136" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:55:26.373657 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:26.400307 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:26.401924 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:26.417339 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:55:26.422714 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:55:26.433829 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:26.644120 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:55:26.699206 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Instance destroyed successfully.
May 28 01:55:26.701449 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-7cd6b5c9-e409-416e-adf1-27b64da2e200 tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Lazy-loading 'resources' on Instance uuid 96a4bb3b-0482-4b14-bb23-772d295b972e {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:55:26.811286 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-3fea5c65-cf9e-4907-9889-3da5c91c2156 req-d9496c03-56d7-4a3e-a2f3-c06149f46741 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:26.924538 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:55:26.924896 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999817442999984 future=<Future at 0x7724ec1f2390 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:55:26.978005 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-3fea5c65-cf9e-4907-9889-3da5c91c2156 req-d9496c03-56d7-4a3e-a2f3-c06149f46741 service nova] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Updated VIF entry in instance network info cache for port 2bb36d37-52de-4dcf-abb4-35b15f363457. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:55:26.978129 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-3fea5c65-cf9e-4907-9889-3da5c91c2156 req-d9496c03-56d7-4a3e-a2f3-c06149f46741 service nova] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Updating instance_info_cache with network_info: [{"id": "2bb36d37-52de-4dcf-abb4-35b15f363457", "address": "fa:16:3e:86:7e:a1", "network": {"id": "34ab0ff0-75dd-45e7-97f6-22f8e62a8149", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1222751470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d31342458ec4ed2890a766f62facbcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb36d37-52", "ovs_interfaceid": "2bb36d37-52de-4dcf-abb4-35b15f363457", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:55:27.003023 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Rebuilding instance
May 28 01:55:27.144307 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:55:27.165729 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.725s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:27.207608 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-7cd6b5c9-e409-416e-adf1-27b64da2e200 tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:54:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-600450366',display_name='tempest-ServersNegativeTestJSON-server-600450366',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-serversnegativetestjson-server-600450366',id=15,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:54:53Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6c32da4f768f48179b4be0509a25a704',ramdisk_id='',reservation_id='r-tt0bwxky',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1232315525',owner_user_name='tempest-ServersNegativeTestJSON-1232315525-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:54:53Z,user_data=None,user_id='c9dd13ea0f744864b4c48f99b39b6436',uuid=96a4bb3b-0482-4b14-bb23-772d295b972e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6de78290-8f64-4484-a954-276fe211b28a", "address": "fa:16:3e:cc:f6:fa", "network": {"id": "9fe2c990-23ca-4988-b674-c9825c3616af", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-419738907-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c32da4f768f48179b4be0509a25a704", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6de78290-8f", "ovs_interfaceid": "6de78290-8f64-4484-a954-276fe211b28a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:55:27.207608 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-7cd6b5c9-e409-416e-adf1-27b64da2e200 tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Converting VIF {"id": "6de78290-8f64-4484-a954-276fe211b28a", "address": "fa:16:3e:cc:f6:fa", "network": {"id": "9fe2c990-23ca-4988-b674-c9825c3616af", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-419738907-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c32da4f768f48179b4be0509a25a704", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6de78290-8f", "ovs_interfaceid": "6de78290-8f64-4484-a954-276fe211b28a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:55:27.207958 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-7cd6b5c9-e409-416e-adf1-27b64da2e200 tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f6:fa,bridge_name='br-int',has_traffic_filtering=True,id=6de78290-8f64-4484-a954-276fe211b28a,network=Network(9fe2c990-23ca-4988-b674-c9825c3616af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6de78290-8f') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:55:27.208282 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-7cd6b5c9-e409-416e-adf1-27b64da2e200 tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f6:fa,bridge_name='br-int',has_traffic_filtering=True,id=6de78290-8f64-4484-a954-276fe211b28a,network=Network(9fe2c990-23ca-4988-b674-c9825c3616af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6de78290-8f') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:55:27.213867 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:27.213867 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6de78290-8f, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:27.215253 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:27.217260 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:55:27.218422 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:27.218661 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c0af93fe-320b-4aba-8523-ab45b1fb3b90) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:27.219479 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:27.220476 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:55:27.222549 np0000001583 nova-compute[98241]: INFO os_vif [None req-7cd6b5c9-e409-416e-adf1-27b64da2e200 tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f6:fa,bridge_name='br-int',has_traffic_filtering=True,id=6de78290-8f64-4484-a954-276fe211b28a,network=Network(9fe2c990-23ca-4988-b674-c9825c3616af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6de78290-8f')
May 28 01:55:27.223462 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-7cd6b5c9-e409-416e-adf1-27b64da2e200 tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Deleting instance files /opt/stack/data/nova/instances/96a4bb3b-0482-4b14-bb23-772d295b972e_del
May 28 01:55:27.223860 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-7cd6b5c9-e409-416e-adf1-27b64da2e200 tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Deletion of /opt/stack/data/nova/instances/96a4bb3b-0482-4b14-bb23-772d295b972e_del complete
May 28 01:55:27.480866 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-3fea5c65-cf9e-4907-9889-3da5c91c2156 req-d9496c03-56d7-4a3e-a2f3-c06149f46741 service nova] Releasing lock "refresh_cache-ea9459ae-6246-4d11-b46b-733449884b1b" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:55:27.672574 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-cc307870-7c52-4ef8-8dba-53309f8da29d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Lock "df5768dc-874f-4725-b2a2-e007aebc11a9" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 10.445s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:27.735396 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-7cd6b5c9-e409-416e-adf1-27b64da2e200 tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Took 1.40 seconds to destroy the instance on the hypervisor.
May 28 01:55:27.737876 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-7cd6b5c9-e409-416e-adf1-27b64da2e200 tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:55:27.739425 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:55:27.739518 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:55:27.739766 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:27.740968 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.00043495400018400687 future=<Future at 0x7724ec2edb80 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:55:27.741040 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:55:27.741203 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=5.955893964000097 future=<Future at 0x7724f8281ca0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:55:27.741297 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=5.955773886000088 future=<Future at 0x7724f8281ca0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:55:27.742430 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Emitting event <LifecycleEvent: 1779933312.7404351, d3135bb7-29cf-4819-9e83-1c45211901eb => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:55:27.742714 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] VM Stopped (Lifecycle Event)
May 28 01:55:27.838599 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:27.871898 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-03246d2e-7956-4062-bddb-0d19139fb852 req-f0916b5a-5d5a-48cb-b114-ff214c6a516e service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-vif-plugged-766c9d77-3578-4071-b0eb-f2a929ee0445 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:27.872039 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-03246d2e-7956-4062-bddb-0d19139fb852 req-f0916b5a-5d5a-48cb-b114-ff214c6a516e service nova] Acquiring lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:27.873445 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-03246d2e-7956-4062-bddb-0d19139fb852 req-f0916b5a-5d5a-48cb-b114-ff214c6a516e service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:27.873712 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-03246d2e-7956-4062-bddb-0d19139fb852 req-f0916b5a-5d5a-48cb-b114-ff214c6a516e service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:27.874516 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-03246d2e-7956-4062-bddb-0d19139fb852 req-f0916b5a-5d5a-48cb-b114-ff214c6a516e service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Processing event network-vif-plugged-766c9d77-3578-4071-b0eb-f2a929ee0445 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:55:27.874618 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-03246d2e-7956-4062-bddb-0d19139fb852 req-f0916b5a-5d5a-48cb-b114-ff214c6a516e service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-vif-plugged-766c9d77-3578-4071-b0eb-f2a929ee0445 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:27.874722 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-03246d2e-7956-4062-bddb-0d19139fb852 req-f0916b5a-5d5a-48cb-b114-ff214c6a516e service nova] Acquiring lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:27.874854 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-03246d2e-7956-4062-bddb-0d19139fb852 req-f0916b5a-5d5a-48cb-b114-ff214c6a516e service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:27.874967 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-03246d2e-7956-4062-bddb-0d19139fb852 req-f0916b5a-5d5a-48cb-b114-ff214c6a516e service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:27.875299 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-03246d2e-7956-4062-bddb-0d19139fb852 req-f0916b5a-5d5a-48cb-b114-ff214c6a516e service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] No event matching network-vif-plugged-766c9d77-3578-4071-b0eb-f2a929ee0445 in dict_keys([('network-vif-plugged', '9ca5546d-4b44-4470-92d7-08800876e89b')]) {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 01:55:27.875441 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-03246d2e-7956-4062-bddb-0d19139fb852 req-f0916b5a-5d5a-48cb-b114-ff214c6a516e service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received unexpected event network-vif-plugged-766c9d77-3578-4071-b0eb-f2a929ee0445 for instance with vm_state building and task_state spawning.
May 28 01:55:27.875560 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-03246d2e-7956-4062-bddb-0d19139fb852 req-f0916b5a-5d5a-48cb-b114-ff214c6a516e service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-vif-plugged-9ca5546d-4b44-4470-92d7-08800876e89b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:27.875697 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-03246d2e-7956-4062-bddb-0d19139fb852 req-f0916b5a-5d5a-48cb-b114-ff214c6a516e service nova] Acquiring lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:27.875867 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-03246d2e-7956-4062-bddb-0d19139fb852 req-f0916b5a-5d5a-48cb-b114-ff214c6a516e service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:27.875971 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-03246d2e-7956-4062-bddb-0d19139fb852 req-f0916b5a-5d5a-48cb-b114-ff214c6a516e service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:27.876086 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-03246d2e-7956-4062-bddb-0d19139fb852 req-f0916b5a-5d5a-48cb-b114-ff214c6a516e service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Processing event network-vif-plugged-9ca5546d-4b44-4470-92d7-08800876e89b {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:55:27.876235 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-03246d2e-7956-4062-bddb-0d19139fb852 req-f0916b5a-5d5a-48cb-b114-ff214c6a516e service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-vif-plugged-9ca5546d-4b44-4470-92d7-08800876e89b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:27.876350 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-03246d2e-7956-4062-bddb-0d19139fb852 req-f0916b5a-5d5a-48cb-b114-ff214c6a516e service nova] Acquiring lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:27.876471 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-03246d2e-7956-4062-bddb-0d19139fb852 req-f0916b5a-5d5a-48cb-b114-ff214c6a516e service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:27.876618 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-03246d2e-7956-4062-bddb-0d19139fb852 req-f0916b5a-5d5a-48cb-b114-ff214c6a516e service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:27.876745 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-03246d2e-7956-4062-bddb-0d19139fb852 req-f0916b5a-5d5a-48cb-b114-ff214c6a516e service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] No waiting events found dispatching network-vif-plugged-9ca5546d-4b44-4470-92d7-08800876e89b {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:55:27.879810 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Instance event wait completed in 2 seconds for network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:55:27.880094 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-03246d2e-7956-4062-bddb-0d19139fb852 req-f0916b5a-5d5a-48cb-b114-ff214c6a516e service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received unexpected event network-vif-plugged-9ca5546d-4b44-4470-92d7-08800876e89b for instance with vm_state building and task_state spawning.
May 28 01:55:27.883531 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933327.8830624, 0cca8054-2a26-436f-93b8-ef28e452bd65 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:55:27.884351 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:55:27.886000 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] VM Resumed (Lifecycle Event)
May 28 01:55:27.888986 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Instance spawned successfully.
May 28 01:55:27.889960 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:55:27.894591 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Acquiring lock "df5768dc-874f-4725-b2a2-e007aebc11a9" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:27.894591 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Lock "df5768dc-874f-4725-b2a2-e007aebc11a9" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:27.894591 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Unshelving
May 28 01:55:27.906823 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-784feb0e-285a-4ddd-b9c7-9275dc32ba90 req-e8176ea9-491f-4974-a56a-20ad0cfb371b service nova] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Received event network-vif-unplugged-6de78290-8f64-4484-a954-276fe211b28a {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:27.907959 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-784feb0e-285a-4ddd-b9c7-9275dc32ba90 req-e8176ea9-491f-4974-a56a-20ad0cfb371b service nova] Acquiring lock "96a4bb3b-0482-4b14-bb23-772d295b972e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:27.908230 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-784feb0e-285a-4ddd-b9c7-9275dc32ba90 req-e8176ea9-491f-4974-a56a-20ad0cfb371b service nova] Lock "96a4bb3b-0482-4b14-bb23-772d295b972e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:27.908421 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-784feb0e-285a-4ddd-b9c7-9275dc32ba90 req-e8176ea9-491f-4974-a56a-20ad0cfb371b service nova] Lock "96a4bb3b-0482-4b14-bb23-772d295b972e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:27.908700 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-784feb0e-285a-4ddd-b9c7-9275dc32ba90 req-e8176ea9-491f-4974-a56a-20ad0cfb371b service nova] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] No waiting events found dispatching network-vif-unplugged-6de78290-8f64-4484-a954-276fe211b28a {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:55:27.908812 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-784feb0e-285a-4ddd-b9c7-9275dc32ba90 req-e8176ea9-491f-4974-a56a-20ad0cfb371b service nova] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Received event network-vif-unplugged-6de78290-8f64-4484-a954-276fe211b28a for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:55:27.908957 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-784feb0e-285a-4ddd-b9c7-9275dc32ba90 req-e8176ea9-491f-4974-a56a-20ad0cfb371b service nova] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Received event network-vif-unplugged-6de78290-8f64-4484-a954-276fe211b28a {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:27.909159 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-784feb0e-285a-4ddd-b9c7-9275dc32ba90 req-e8176ea9-491f-4974-a56a-20ad0cfb371b service nova] Acquiring lock "96a4bb3b-0482-4b14-bb23-772d295b972e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:27.909346 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-784feb0e-285a-4ddd-b9c7-9275dc32ba90 req-e8176ea9-491f-4974-a56a-20ad0cfb371b service nova] Lock "96a4bb3b-0482-4b14-bb23-772d295b972e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:27.909498 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-784feb0e-285a-4ddd-b9c7-9275dc32ba90 req-e8176ea9-491f-4974-a56a-20ad0cfb371b service nova] Lock "96a4bb3b-0482-4b14-bb23-772d295b972e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:27.909644 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-784feb0e-285a-4ddd-b9c7-9275dc32ba90 req-e8176ea9-491f-4974-a56a-20ad0cfb371b service nova] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] No waiting events found dispatching network-vif-unplugged-6de78290-8f64-4484-a954-276fe211b28a {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:55:27.909990 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-784feb0e-285a-4ddd-b9c7-9275dc32ba90 req-e8176ea9-491f-4974-a56a-20ad0cfb371b service nova] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Received event network-vif-unplugged-6de78290-8f64-4484-a954-276fe211b28a for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:55:27.996372 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:28.016831 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:28.021095 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:28.045497 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:28.186769 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:28.192365 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:28.217159 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:28.246538 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-239c76d4-a3fa-44c8-a7e1-0f62b7880b6d tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: d3135bb7-29cf-4819-9e83-1c45211901eb] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:55:28.250254 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:28.263979 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:28.348100 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Instance destroyed successfully.
May 28 01:55:28.348464 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lazy-loading 'numa_topology' on Instance uuid 533f5dcc-2e48-4280-84b3-facb02dea136 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:55:28.388751 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:55:28.395271 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:55:28.403561 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:55:28.405739 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:55:28.405739 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:55:28.405739 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:55:28.405739 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:55:28.407240 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:55:28.514795 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:28.548549 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:28.559255 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Instance destroyed successfully.
May 28 01:55:28.673151 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Detaching volume eeb7082f-9899-40c8-ab6f-3d746680d463
May 28 01:55:28.678323 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:55:28.724719 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Attempting to driver detach volume eeb7082f-9899-40c8-ab6f-3d746680d463 from mountpoint /dev/vdb
May 28 01:55:28.728592 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Found disk vdb by alias ua-eeb7082f-9899-40c8-ab6f-3d746680d463 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:55:28.728711 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Attempting to detach device vdb from instance 587a002a-2b9c-4865-8ce2-088ad567c81b from the persistent domain config. {{(pid=98241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 01:55:28.728950 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:55:28.728950 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:55:28.728950 np0000001583 nova-compute[98241]:   <alias name="ua-eeb7082f-9899-40c8-ab6f-3d746680d463"/>
May 28 01:55:28.728950 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-9"/>
May 28 01:55:28.728950 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 01:55:28.728950 np0000001583 nova-compute[98241]:   <serial>eeb7082f-9899-40c8-ab6f-3d746680d463</serial>
May 28 01:55:28.728950 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:55:28.728950 np0000001583 nova-compute[98241]: </disk>
May 28 01:55:28.728950 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:55:28.735766 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Successfully detached device vdb from instance 587a002a-2b9c-4865-8ce2-088ad567c81b from the persistent domain config.
May 28 01:55:28.736636 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:55:28.736964 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463', 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'eeb7082f-9899-40c8-ab6f-3d746680d463', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': False}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:55:28.737156 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:55:28.737588 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:55:28.737901 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463', 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'eeb7082f-9899-40c8-ab6f-3d746680d463', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:55:28.738029 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:55:28.775623 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:28.775623 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:28.775623 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:28.775623 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:28.775623 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:28.775623 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:28.775623 np0000001583 nova-compute[98241]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:28.775623 np0000001583 nova-compute[98241]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:28.775623 np0000001583 nova-compute[98241]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:55:28.775623 np0000001583 nova-compute[98241]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:55:28.775623 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:55:28.776142 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsi session list stdout=tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:28.776142 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:28.776142 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:28.776142 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:28.776142 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:28.776142 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:28.776142 np0000001583 nova-compute[98241]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:28.776142 np0000001583 nova-compute[98241]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:28.776142 np0000001583 nova-compute[98241]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:55:28.776142 np0000001583 nova-compute[98241]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:55:28.776142 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:55:28.776142 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9', '35'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b', '36'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b', '37'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797', '39'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e', '40'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e', '41'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463', '42'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463', '43')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:55:28.776142 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463', '42')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:55:28.777247 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463', '43')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:55:28.778040 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f85a2de0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463'): ({'sdm'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:55:28.778270 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Removing multipathed devices sdl, sdm {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:55:28.778511 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Flush multipath device 33000000086ce169e {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:55:28.817045 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:55:28.859233 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Attempting a stable device rescue
May 28 01:55:28.865195 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:55:28.904710 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Checking to see if SCSI volumes sdl, sdm have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:55:28.904909 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] SCSI volumes sdl, sdm have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:55:28.906217 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Checking to see if device paths {'sdl', 'sdm'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:55:28.915588 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:55:28.915937 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999837230999901 future=<Future at 0x7724ec203470 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:55:28.916195 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999840346000155 future=<Future at 0x7724ec18dd90 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:55:28.921203 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Device paths {'sdl', 'sdm'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:55:28.924808 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Booting with volume 9b421209-954a-413c-bf2c-892d99f40d2d at /dev/vda
May 28 01:55:28.926523 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:55:28.927028 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Took 32.31 seconds to spawn the instance on the hypervisor.
May 28 01:55:28.930100 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:55:28.943391 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:28.979302 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=98241) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 28 01:55:28.982950 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463, portal: 192.168.40.100,3260]
May 28 01:55:28.982950 np0000001583 nova-compute[98241]: Logout of [sid: 42, target: iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463, portal: 192.168.40.100,3260] successful.
May 28 01:55:28.982950 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:28.984193 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Instance directory exists: not creating {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 01:55:28.984403 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Creating image(s)
May 28 01:55:28.985246 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "/opt/stack/data/nova/instances/533f5dcc-2e48-4280-84b3-facb02dea136/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:28.985508 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "/opt/stack/data/nova/instances/533f5dcc-2e48-4280-84b3-facb02dea136/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:28.986099 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "/opt/stack/data/nova/instances/533f5dcc-2e48-4280-84b3-facb02dea136/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:28.986381 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lazy-loading 'trusted_certs' on Instance uuid 533f5dcc-2e48-4280-84b3-facb02dea136 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:55:28.989303 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:55:29.004862 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:55:29.011644 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:29.026739 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:29.035036 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:29.067607 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463, portal: 192.168.50.100,3260]
May 28 01:55:29.067607 np0000001583 nova-compute[98241]: Logout of [sid: 43, target: iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463, portal: 192.168.50.100,3260] successful.
May 28 01:55:29.067607 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:29.075562 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:55:29.075899 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:55:29.091467 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:55:29.093528 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe63:2bb1', 'fe80::e43a:d5ff:fecc:27fe', 'fe80::fc16:3eff:fe27:be54', 'fe80::a0e4:60ff:fe3f:73d6', 'fe80::fc16:3eff:fe5c:c25f', 'fe80::819:abff:fece:7871', 'fe80::fc16:3eff:fe86:7ea1', 'fe80::c4dd:b4ff:fe11:7c8', 'fe80::fc16:3eff:fee3:afb5', 'fe80::fc16:3eff:fe2d:d8ee', 'fe80::3880:a4ff:fe4d:a74b', 'fe80::fc16:3eff:fee4:523', 'fe80::fc16:3eff:fe20:fa56', 'fe80::fc16:3eff:fe0a:6e61', 'fe80::fc16:3eff:fe59:946e', 'fe80::6823:8cff:fe94:ad71', 'fe80::fc16:3eff:fe25:2d87', 'fe80::f404:a1ff:fe1b:755c'] 
May 28 01:55:29.093836 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:55:29.094010 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:55:29.094355 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] <== get_connector_properties: return (104ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:55:29.094650 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Updating existing volume attachment record: 23c669af-8270-4691-929b-b1e528cfd2fa {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:55:29.098603 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:29.099005 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:55:29.099232 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] <== disconnect_volume: return (362ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:55:29.099405 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:55:29.179896 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Took 1.44 seconds to deallocate network for instance.
May 28 01:55:29.444422 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Took 45.97 seconds to build instance.
May 28 01:55:29.492814 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Object Instance<533f5dcc-2e48-4280-84b3-facb02dea136> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:55:29.493433 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "5fae241bec13d6964e7b7236331e2a2426e51f84" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:29.493903 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "5fae241bec13d6964e7b7236331e2a2426e51f84" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:29.691360 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7cd6b5c9-e409-416e-adf1-27b64da2e200 tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:29.691892 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7cd6b5c9-e409-416e-adf1-27b64da2e200 tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:29.947940 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ded4f88-d2ee-4b0e-b3f4-187d6aabbfd6 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 47.479s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:29.995520 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-1f7f582c-5e7d-499b-9bff-35d09365e8b8 req-66a8b622-5b4a-4ca8-a544-ae297cebeeb8 service nova] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Received event network-vif-unplugged-b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:29.995808 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-1f7f582c-5e7d-499b-9bff-35d09365e8b8 req-66a8b622-5b4a-4ca8-a544-ae297cebeeb8 service nova] Acquiring lock "533f5dcc-2e48-4280-84b3-facb02dea136-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:29.996037 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-1f7f582c-5e7d-499b-9bff-35d09365e8b8 req-66a8b622-5b4a-4ca8-a544-ae297cebeeb8 service nova] Lock "533f5dcc-2e48-4280-84b3-facb02dea136-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:29.996176 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-1f7f582c-5e7d-499b-9bff-35d09365e8b8 req-66a8b622-5b4a-4ca8-a544-ae297cebeeb8 service nova] Lock "533f5dcc-2e48-4280-84b3-facb02dea136-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:29.996380 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-1f7f582c-5e7d-499b-9bff-35d09365e8b8 req-66a8b622-5b4a-4ca8-a544-ae297cebeeb8 service nova] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] No waiting events found dispatching network-vif-unplugged-b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:55:29.996524 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-1f7f582c-5e7d-499b-9bff-35d09365e8b8 req-66a8b622-5b4a-4ca8-a544-ae297cebeeb8 service nova] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Received unexpected event network-vif-unplugged-b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e for instance with vm_state active and task_state rescuing.
May 28 01:55:29.998643 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-1f7f582c-5e7d-499b-9bff-35d09365e8b8 req-66a8b622-5b4a-4ca8-a544-ae297cebeeb8 service nova] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Received event network-vif-unplugged-b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:30.002036 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-1f7f582c-5e7d-499b-9bff-35d09365e8b8 req-66a8b622-5b4a-4ca8-a544-ae297cebeeb8 service nova] Acquiring lock "533f5dcc-2e48-4280-84b3-facb02dea136-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:30.002036 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-1f7f582c-5e7d-499b-9bff-35d09365e8b8 req-66a8b622-5b4a-4ca8-a544-ae297cebeeb8 service nova] Lock "533f5dcc-2e48-4280-84b3-facb02dea136-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:30.002036 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-1f7f582c-5e7d-499b-9bff-35d09365e8b8 req-66a8b622-5b4a-4ca8-a544-ae297cebeeb8 service nova] Lock "533f5dcc-2e48-4280-84b3-facb02dea136-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:30.002036 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-1f7f582c-5e7d-499b-9bff-35d09365e8b8 req-66a8b622-5b4a-4ca8-a544-ae297cebeeb8 service nova] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] No waiting events found dispatching network-vif-unplugged-b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:55:30.002036 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-1f7f582c-5e7d-499b-9bff-35d09365e8b8 req-66a8b622-5b4a-4ca8-a544-ae297cebeeb8 service nova] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Received unexpected event network-vif-unplugged-b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e for instance with vm_state active and task_state rescuing.
May 28 01:55:30.013328 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-287bb7e6-1a37-4513-8543-509183b6a197 req-3c1de169-3129-465e-886c-954e75c1c148 service nova] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Received event network-vif-deleted-6de78290-8f64-4484-a954-276fe211b28a {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:30.013328 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-287bb7e6-1a37-4513-8543-509183b6a197 req-3c1de169-3129-465e-886c-954e75c1c148 service nova] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Received event network-vif-unplugged-6ddf64a7-099d-4ef6-8dfc-7377446b66f7 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:30.013871 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-287bb7e6-1a37-4513-8543-509183b6a197 req-3c1de169-3129-465e-886c-954e75c1c148 service nova] Acquiring lock "587a002a-2b9c-4865-8ce2-088ad567c81b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:30.013871 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-287bb7e6-1a37-4513-8543-509183b6a197 req-3c1de169-3129-465e-886c-954e75c1c148 service nova] Lock "587a002a-2b9c-4865-8ce2-088ad567c81b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:30.013871 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-287bb7e6-1a37-4513-8543-509183b6a197 req-3c1de169-3129-465e-886c-954e75c1c148 service nova] Lock "587a002a-2b9c-4865-8ce2-088ad567c81b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:30.013981 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-287bb7e6-1a37-4513-8543-509183b6a197 req-3c1de169-3129-465e-886c-954e75c1c148 service nova] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] No waiting events found dispatching network-vif-unplugged-6ddf64a7-099d-4ef6-8dfc-7377446b66f7 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:55:30.014181 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-287bb7e6-1a37-4513-8543-509183b6a197 req-3c1de169-3129-465e-886c-954e75c1c148 service nova] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Received unexpected event network-vif-unplugged-6ddf64a7-099d-4ef6-8dfc-7377446b66f7 for instance with vm_state active and task_state rebuilding.
May 28 01:55:30.014181 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-287bb7e6-1a37-4513-8543-509183b6a197 req-3c1de169-3129-465e-886c-954e75c1c148 service nova] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Received event network-vif-unplugged-6ddf64a7-099d-4ef6-8dfc-7377446b66f7 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:30.014355 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-287bb7e6-1a37-4513-8543-509183b6a197 req-3c1de169-3129-465e-886c-954e75c1c148 service nova] Acquiring lock "587a002a-2b9c-4865-8ce2-088ad567c81b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:30.014498 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-287bb7e6-1a37-4513-8543-509183b6a197 req-3c1de169-3129-465e-886c-954e75c1c148 service nova] Lock "587a002a-2b9c-4865-8ce2-088ad567c81b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:30.014636 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-287bb7e6-1a37-4513-8543-509183b6a197 req-3c1de169-3129-465e-886c-954e75c1c148 service nova] Lock "587a002a-2b9c-4865-8ce2-088ad567c81b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:30.014743 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-287bb7e6-1a37-4513-8543-509183b6a197 req-3c1de169-3129-465e-886c-954e75c1c148 service nova] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] No waiting events found dispatching network-vif-unplugged-6ddf64a7-099d-4ef6-8dfc-7377446b66f7 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:55:30.014881 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-287bb7e6-1a37-4513-8543-509183b6a197 req-3c1de169-3129-465e-886c-954e75c1c148 service nova] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Received unexpected event network-vif-unplugged-6ddf64a7-099d-4ef6-8dfc-7377446b66f7 for instance with vm_state active and task_state rebuilding.
May 28 01:55:30.181574 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Instance destroyed successfully.
May 28 01:55:30.182875 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:54:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-307669431',display_name='tempest-ServerActionsTestOtherA-server-1171245773',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-tempest-common-compute-instance-307669431',id=13,image_ref='160eac6b-3e35-4339-bdf4-c5b84e5687ff',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+uj6sYtPnyFWQs1nCcEuZB/a15TtoxueiMzmbIyATZcok2qJukDOEiuQPENacqvJA6yFSDD4IVNTN5EdbtPeAegQv2a08BDT/l0Bf9OlKlI25U/AVBDkLghlYu/vY6eg==',key_name='tempest-keypair-374991287',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:54:33Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='60fbdf5ed38b4dc485a81c49b3303ed2',ramdisk_id='',reservation_id='r-m7y4i9cj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='160eac6b-3e35-4339-bdf4-c5b84e5687ff',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1714646345',owner_user_name='tempest-ServerActionsTestOtherA-1714646345-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:55:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27c90c0a8eb148fda8ae718f07ff1ed4',uuid=587a002a-2b9c-4865-8ce2-088ad567c81b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ddf64a7-099d-4ef6-8dfc-7377446b66f7", "address": "fa:16:3e:94:75:97", "network": {"id": "b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-280876007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60fbdf5ed38b4dc485a81c49b3303ed2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddf64a7-09", "ovs_interfaceid": "6ddf64a7-099d-4ef6-8dfc-7377446b66f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:55:30.184171 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Converting VIF {"id": "6ddf64a7-099d-4ef6-8dfc-7377446b66f7", "address": "fa:16:3e:94:75:97", "network": {"id": "b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-280876007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60fbdf5ed38b4dc485a81c49b3303ed2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddf64a7-09", "ovs_interfaceid": "6ddf64a7-099d-4ef6-8dfc-7377446b66f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:55:30.184171 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:75:97,bridge_name='br-int',has_traffic_filtering=True,id=6ddf64a7-099d-4ef6-8dfc-7377446b66f7,network=Network(b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ddf64a7-09') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:55:30.184645 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:75:97,bridge_name='br-int',has_traffic_filtering=True,id=6ddf64a7-099d-4ef6-8dfc-7377446b66f7,network=Network(b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ddf64a7-09') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:55:30.186276 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:30.186276 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6ddf64a7-09, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:30.190476 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:30.190476 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:55:30.196958 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:30.198422 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:30.198422 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=df6738ab-f6cd-4ca0-af5b-9e8b86ab16ef) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:30.200124 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:30.201195 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:55:30.209947 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:30.215715 np0000001583 nova-compute[98241]: INFO os_vif [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:75:97,bridge_name='br-int',has_traffic_filtering=True,id=6ddf64a7-099d-4ef6-8dfc-7377446b66f7,network=Network(b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ddf64a7-09')
May 28 01:55:30.219065 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:55:30.222228 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463', 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'eeb7082f-9899-40c8-ab6f-3d746680d463', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:55:30.222463 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:55:30.232120 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.009s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:55:30.232120 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463', 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'eeb7082f-9899-40c8-ab6f-3d746680d463', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:55:30.232120 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:55:30.272769 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:55:30.277334 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:55:30.279649 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5fae241bec13d6964e7b7236331e2a2426e51f84.part --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:30.280799 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:30.280799 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:30.280799 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:30.280799 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:30.280799 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:30.280799 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:30.280799 np0000001583 nova-compute[98241]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:30.280799 np0000001583 nova-compute[98241]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:30.280799 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:55:30.281069 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsi session list stdout=tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:30.281069 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:30.281069 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:30.281069 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:30.281069 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:30.281069 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:30.281069 np0000001583 nova-compute[98241]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:30.281069 np0000001583 nova-compute[98241]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:30.281069 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:55:30.281394 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9', '35'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b', '36'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b', '37'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797', '39'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e', '40'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e', '41')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:55:30.281966 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463, 0): [] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:55:30.281966 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463') {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 28 01:55:30.281966 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463, 0): [] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:55:30.282165 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463') {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 28 01:55:30.284199 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f8398a40>, {}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:55:30.284475 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Disconnecting from: [] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:55:30.285144 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.054s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:55:30.289306 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] <== disconnect_volume: return (66ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:55:30.307737 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:55:30.312401 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Deleting instance files /opt/stack/data/nova/instances/587a002a-2b9c-4865-8ce2-088ad567c81b_del
May 28 01:55:30.314680 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Deletion of /opt/stack/data/nova/instances/587a002a-2b9c-4865-8ce2-088ad567c81b_del complete
May 28 01:55:30.380303 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5fae241bec13d6964e7b7236331e2a2426e51f84.part --force-share --output=json" returned: 0 in 0.101s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:30.380733 np0000001583 nova-compute[98241]: DEBUG nova.virt.images [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] 6c24143d-68c1-4812-89f1-6891a6236a06 was qcow2, converting to raw {{(pid=98241) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 01:55:30.382154 np0000001583 nova-compute[98241]: DEBUG nova.privsep.utils [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98241) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 01:55:30.382154 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5fae241bec13d6964e7b7236331e2a2426e51f84.part /opt/stack/data/nova/instances/_base/5fae241bec13d6964e7b7236331e2a2426e51f84.converted {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:30.463874 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-7cd6b5c9-e409-416e-adf1-27b64da2e200 tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:55:30.463874 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-7cd6b5c9-e409-416e-adf1-27b64da2e200 tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:55:30.486921 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5fae241bec13d6964e7b7236331e2a2426e51f84.part /opt/stack/data/nova/instances/_base/5fae241bec13d6964e7b7236331e2a2426e51f84.converted" returned: 0 in 0.105s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:30.492678 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5fae241bec13d6964e7b7236331e2a2426e51f84.converted --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:30.597230 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5fae241bec13d6964e7b7236331e2a2426e51f84.converted --force-share --output=json" returned: 0 in 0.104s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:30.598023 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "5fae241bec13d6964e7b7236331e2a2426e51f84" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.104s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:30.598683 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:55:30.603748 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:55:30.605803 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "5fae241bec13d6964e7b7236331e2a2426e51f84" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:30.606613 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "5fae241bec13d6964e7b7236331e2a2426e51f84" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:30.607458 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:55:30.612526 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:55:30.613428 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5fae241bec13d6964e7b7236331e2a2426e51f84 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:30.718206 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5fae241bec13d6964e7b7236331e2a2426e51f84 --force-share --output=json" returned: 0 in 0.105s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:30.718852 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5fae241bec13d6964e7b7236331e2a2426e51f84,backing_fmt=raw /opt/stack/data/nova/instances/533f5dcc-2e48-4280-84b3-facb02dea136/disk.rescue {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:30.773380 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5fae241bec13d6964e7b7236331e2a2426e51f84,backing_fmt=raw /opt/stack/data/nova/instances/533f5dcc-2e48-4280-84b3-facb02dea136/disk.rescue" returned: 0 in 0.054s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:30.773822 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "5fae241bec13d6964e7b7236331e2a2426e51f84" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.167s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:30.774403 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lazy-loading 'migration_context' on Instance uuid 533f5dcc-2e48-4280-84b3-facb02dea136 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:55:30.836175 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:30.967783 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-7cd6b5c9-e409-416e-adf1-27b64da2e200 tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:55:31.204519 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:31.277030 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Object Instance<533f5dcc-2e48-4280-84b3-facb02dea136> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:55:31.277403 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:55:31.278207 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Start _get_guest_xml network_info=[{"id": "b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e", "address": "fa:16:3e:e1:01:d3", "network": {"id": "2ee43c4e-569f-4726-9700-add40d768203", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "vif_mac": "fa:16:3e:e1:01:d3"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ba381dad8364a488a98b80c04cce8fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bf1e5b-d3", "ovs_interfaceid": "b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6c24143d-68c1-4812-89f1-6891a6236a06', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797', 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fab00939-514d-46f8-a4d7-5a7c78e44797', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, 'status': 'reserved', 'instance': '533f5dcc-2e48-4280-84b3-facb02dea136', 'attached_at': '', 'detached_at': '', 'volume_id': 'fab00939-514d-46f8-a4d7-5a7c78e44797', 'serial': 'fab00939-514d-46f8-a4d7-5a7c78e44797'}, 'delete_on_termination': True, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '832c9521-5dd1-4ab5-9f86-a9f7864cec93', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:55:31.278463 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lazy-loading 'resources' on Instance uuid 533f5dcc-2e48-4280-84b3-facb02dea136 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:55:31.334179 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Booting with volume eeb7082f-9899-40c8-ab6f-3d746680d463 at /dev/vdb
May 28 01:55:31.393950 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:55:31.412761 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:55:31.443491 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:31.479174 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7cd6b5c9-e409-416e-adf1-27b64da2e200 tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.787s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:31.484455 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.648s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:31.491862 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Lazy-loading 'pci_requests' on Instance uuid df5768dc-874f-4725-b2a2-e007aebc11a9 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:55:31.504200 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:55:31.504573 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:55:31.520128 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:55:31.522915 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe63:2bb1', 'fe80::e43a:d5ff:fecc:27fe', 'fe80::fc16:3eff:fe27:be54', 'fe80::a0e4:60ff:fe3f:73d6', 'fe80::fc16:3eff:fe5c:c25f', 'fe80::819:abff:fece:7871', 'fe80::fc16:3eff:fe86:7ea1', 'fe80::c4dd:b4ff:fe11:7c8', 'fe80::fc16:3eff:fee3:afb5', 'fe80::fc16:3eff:fe2d:d8ee', 'fe80::3880:a4ff:fe4d:a74b', 'fe80::fc16:3eff:fee4:523', 'fe80::fc16:3eff:fe20:fa56', 'fe80::fc16:3eff:fe0a:6e61', 'fe80::fc16:3eff:fe59:946e', 'fe80::6823:8cff:fe94:ad71', 'fe80::fc16:3eff:fe25:2d87', 'fe80::f404:a1ff:fe1b:755c'] 
May 28 01:55:31.523136 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:55:31.523316 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:55:31.523655 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:55:31.526568 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Updating existing volume attachment record: 783f7f7e-81e1-4d2c-927c-e9572666b08e {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:55:31.569118 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-7cd6b5c9-e409-416e-adf1-27b64da2e200 tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Deleted allocations for instance 96a4bb3b-0482-4b14-bb23-772d295b972e
May 28 01:55:31.785006 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Object Instance<533f5dcc-2e48-4280-84b3-facb02dea136> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:55:31.791191 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:55:31.792740 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-516014259', uuid='533f5dcc-2e48-4280-84b3-facb02dea136'), owner=OwnerMeta(userid='c3a7b14e31ee40cf9e4f4bba084ccaa5', username='tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member', projectid='2ba381dad8364a488a98b80c04cce8fb', projectname='tempest-ServerBootFromVolumeStableRescueTest-1211567633'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e", "address": "fa:16:3e:e1:01:d3", "network": {"id": "2ee43c4e-569f-4726-9700-add40d768203", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "vif_mac": "fa:16:3e:e1:01:d3"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ba381dad8364a488a98b80c04cce8fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bf1e5b-d3", "ovs_interfaceid": "b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933331.792232) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:55:31.796013 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:55:31.797032 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:55:31.800135 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:55:31.800400 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:55:31.801491 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:55:31.801784 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:55:31.801932 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:55:31.802024 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:55:31.802796 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:55:31.803124 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:55:31.803463 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:55:31.803650 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:55:31.803707 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:55:31.803940 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:55:31.804169 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:55:31.804252 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:55:31.805012 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lazy-loading 'vcpu_model' on Instance uuid 533f5dcc-2e48-4280-84b3-facb02dea136 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:55:32.003398 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Lazy-loading 'numa_topology' on Instance uuid df5768dc-874f-4725-b2a2-e007aebc11a9 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:55:32.278576 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-1f4ca6c1-5dc4-4af7-9bb0-4785f559779c req-f2117bee-50ba-43e0-864c-cceee8c1db36 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-changed-dfa132bb-afe8-4b97-909b-816f3e916bfd {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:32.278699 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-1f4ca6c1-5dc4-4af7-9bb0-4785f559779c req-f2117bee-50ba-43e0-864c-cceee8c1db36 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Refreshing instance network info cache due to event network-changed-dfa132bb-afe8-4b97-909b-816f3e916bfd. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:55:32.278940 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-1f4ca6c1-5dc4-4af7-9bb0-4785f559779c req-f2117bee-50ba-43e0-864c-cceee8c1db36 service nova] Acquiring lock "refresh_cache-0cca8054-2a26-436f-93b8-ef28e452bd65" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:55:32.278983 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-1f4ca6c1-5dc4-4af7-9bb0-4785f559779c req-f2117bee-50ba-43e0-864c-cceee8c1db36 service nova] Acquired lock "refresh_cache-0cca8054-2a26-436f-93b8-ef28e452bd65" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:55:32.279266 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-1f4ca6c1-5dc4-4af7-9bb0-4785f559779c req-f2117bee-50ba-43e0-864c-cceee8c1db36 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Refreshing network info cache for port dfa132bb-afe8-4b97-909b-816f3e916bfd {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:55:32.307160 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Object Instance<533f5dcc-2e48-4280-84b3-facb02dea136> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:55:32.319024 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/533f5dcc-2e48-4280-84b3-facb02dea136/disk.config --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:32.420469 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/533f5dcc-2e48-4280-84b3-facb02dea136/disk.config --force-share --output=json" returned: 0 in 0.101s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:32.420970 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "/opt/stack/data/nova/instances/533f5dcc-2e48-4280-84b3-facb02dea136/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:32.421253 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "/opt/stack/data/nova/instances/533f5dcc-2e48-4280-84b3-facb02dea136/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:32.421920 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "/opt/stack/data/nova/instances/533f5dcc-2e48-4280-84b3-facb02dea136/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:32.422380 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:55:32.422768 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797', 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fab00939-514d-46f8-a4d7-5a7c78e44797', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:55:32.422935 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:55:32.423532 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:55:32.423795 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797', 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fab00939-514d-46f8-a4d7-5a7c78e44797', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:55:32.438179 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:55:32.438828 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:55:32.439404 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:55:32.439666 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:55:32.440039 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:55:32.440270 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: node.startup = automatic
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: node.session.scan = manual
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:55:32.454865 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:55:32.454865 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: node.startup = automatic
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: node.session.scan = manual
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:55:32.462998 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:55:32.462998 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:32.474010 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:32.486548 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:32.495399 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:32.495399 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:32.495399 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:32.495399 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:32.495399 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:32.495399 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:32.495399 np0000001583 nova-compute[98241]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:32.495399 np0000001583 nova-compute[98241]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:32.495399 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:55:32.495744 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsi session list stdout=tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:32.495744 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:32.495744 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:32.495744 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:32.495744 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:32.495744 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:32.495744 np0000001583 nova-compute[98241]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:32.495744 np0000001583 nova-compute[98241]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:32.495744 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:55:32.495991 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.057s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:55:32.496068 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:55:32.496886 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] HCTL ('14', '0', '0', 0) found on session 39 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:55:32.496886 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Scanning host 14 c: 0, t: 0, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:55:32.506021 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:55:32.506203 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Claim successful on node np0000001583
May 28 01:55:32.511846 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:32.511846 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:32.511846 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:32.511846 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:32.511846 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:32.511846 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:32.511846 np0000001583 nova-compute[98241]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:32.511846 np0000001583 nova-compute[98241]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:32.511846 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:55:32.512117 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsi session list stdout=tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:32.512117 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:32.512117 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:32.512117 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:32.512117 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:32.512117 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:32.512117 np0000001583 nova-compute[98241]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:32.512117 np0000001583 nova-compute[98241]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:32.512117 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:55:32.512691 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.073s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:55:32.512862 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:55:32.514213 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] HCTL ('13', '0', '0', 0) found on session 38 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:55:32.514399 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Scanning host 13 c: 0, t: 0, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:55:32.514947 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Searching for a device in session 39 and hctl ('14', '0', '0', 0) yield: sdi {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:55:32.515170 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fab00939-514d-46f8-a4d7-5a7c78e44797', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:55:32.524321 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Searching for a device in session 38 and hctl ('13', '0', '0', 0) yield: sdh {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:55:32.524812 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'fab00939-514d-46f8-a4d7-5a7c78e44797', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:55:32.584448 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7cd6b5c9-e409-416e-adf1-27b64da2e200 tempest-ServersNegativeTestJSON-1232315525 tempest-ServersNegativeTestJSON-1232315525-project-member] Lock "96a4bb3b-0482-4b14-bb23-772d295b972e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.774s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:32.782741 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-1f4ca6c1-5dc4-4af7-9bb0-4785f559779c req-f2117bee-50ba-43e0-864c-cceee8c1db36 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:32.999260 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:33.308726 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-1f4ca6c1-5dc4-4af7-9bb0-4785f559779c req-f2117bee-50ba-43e0-864c-cceee8c1db36 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:33.439941 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:55:33.484557 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-1f4ca6c1-5dc4-4af7-9bb0-4785f559779c req-f2117bee-50ba-43e0-864c-cceee8c1db36 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Updated VIF entry in instance network info cache for port dfa132bb-afe8-4b97-909b-816f3e916bfd. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:55:33.485206 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-1f4ca6c1-5dc4-4af7-9bb0-4785f559779c req-f2117bee-50ba-43e0-864c-cceee8c1db36 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Updating instance_info_cache with network_info: [{"id": "dfa132bb-afe8-4b97-909b-816f3e916bfd", "address": "fa:16:3e:e3:af:b5", "network": {"id": "3fed2ebb-cfdf-471c-963f-f350742f2200", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1888324923-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa132bb-af", "ovs_interfaceid": "dfa132bb-afe8-4b97-909b-816f3e916bfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "939862e4-4e68-484c-bbcd-95faf922a641", "address": "fa:16:3e:2d:d8:ee", "network": {"id": "07811dc4-ff38-4d15-a899-007fdeea12e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-974977857", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap939862e4-4e", "ovs_interfaceid": "939862e4-4e68-484c-bbcd-95faf922a641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7896c8d5-ea83-4141-8344-6b557e45d6d1", "address": "fa:16:3e:e4:05:23", "network": {"id": "07811dc4-ff38-4d15-a899-007fdeea12e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-974977857", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7896c8d5-ea", "ovs_interfaceid": "7896c8d5-ea83-4141-8344-6b557e45d6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "78c3c570-3a3b-484e-bc76-7d91862ff0d4", "address": "fa:16:3e:20:fa:56", "network": {"id": "07811dc4-ff38-4d15-a899-007fdeea12e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-974977857", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap78c3c570-3a", "ovs_interfaceid": "78c3c570-3a3b-484e-bc76-7d91862ff0d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "766c9d77-3578-4071-b0eb-f2a929ee0445", "address": "fa:16:3e:0a:6e:61", "network": {"id": "07811dc4-ff38-4d15-a899-007fdeea12e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-974977857", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap766c9d77-35", "ovs_interfaceid": "766c9d77-3578-4071-b0eb-f2a929ee0445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d868b893-10e8-42d1-872f-bf4b9e8d3659", "address": "fa:16:3e:59:94:6e", "network": {"id": "7de6eee4-0d64-4194-b730-0b1e9ac928b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-2098291513", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd868b893-10", "ovs_interfaceid": "d868b893-10e8-42d1-872f-bf4b9e8d3659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9ca5546d-4b44-4470-92d7-08800876e89b", "address": "fa:16:3e:25:2d:87", "network": {"id": "7de6eee4-0d64-4194-b730-0b1e9ac928b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-2098291513", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca5546d-4b", "ovs_interfaceid": "9ca5546d-4b44-4470-92d7-08800876e89b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:55:33.680018 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:55:33.680018 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Creating image(s)
May 28 01:55:33.680018 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "/opt/stack/data/nova/instances/587a002a-2b9c-4865-8ce2-088ad567c81b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:33.680018 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "/opt/stack/data/nova/instances/587a002a-2b9c-4865-8ce2-088ad567c81b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:33.680569 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "/opt/stack/data/nova/instances/587a002a-2b9c-4865-8ce2-088ad567c81b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:33.680919 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "53568087b7f6756103af21d4fcdbe387ad32abe4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:33.681299 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "53568087b7f6756103af21d4fcdbe387ad32abe4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:33.697590 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0004213879999497294 future=<Future at 0x7724f8281ca0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:55:33.697716 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:55:33.697768 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=8.22693705200004 future=<Future at 0x7724ec1f2390 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:55:33.697875 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=8.226842643000055 future=<Future at 0x7724ec1f2390 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:55:33.699278 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-a48597d6-d1e4-4992-8756-342c7ee11329 None None] Emitting event <LifecycleEvent: 1779933318.6969728, df5768dc-874f-4725-b2a2-e007aebc11a9 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:55:33.700502 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-a48597d6-d1e4-4992-8756-342c7ee11329 None None] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] VM Stopped (Lifecycle Event)
May 28 01:55:33.988706 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-1f4ca6c1-5dc4-4af7-9bb0-4785f559779c req-f2117bee-50ba-43e0-864c-cceee8c1db36 service nova] Releasing lock "refresh_cache-0cca8054-2a26-436f-93b8-ef28e452bd65" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:55:34.055655 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:55:34.056178 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:55:34.071494 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:55:34.074406 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:55:34.074608 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/53568087b7f6756103af21d4fcdbe387ad32abe4.part --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:34.176948 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/53568087b7f6756103af21d4fcdbe387ad32abe4.part --force-share --output=json" returned: 0 in 0.102s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:34.177460 np0000001583 nova-compute[98241]: DEBUG nova.virt.images [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] 160eac6b-3e35-4339-bdf4-c5b84e5687ff was qcow2, converting to raw {{(pid=98241) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 01:55:34.178087 np0000001583 nova-compute[98241]: DEBUG nova.privsep.utils [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98241) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 01:55:34.178699 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/53568087b7f6756103af21d4fcdbe387ad32abe4.part /opt/stack/data/nova/instances/_base/53568087b7f6756103af21d4fcdbe387ad32abe4.converted {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:34.206985 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a48597d6-d1e4-4992-8756-342c7ee11329 None None] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:55:34.307787 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:55:34.333607 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/53568087b7f6756103af21d4fcdbe387ad32abe4.part /opt/stack/data/nova/instances/_base/53568087b7f6756103af21d4fcdbe387ad32abe4.converted" returned: 0 in 0.155s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:34.341105 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/53568087b7f6756103af21d4fcdbe387ad32abe4.converted --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:34.452679 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/53568087b7f6756103af21d4fcdbe387ad32abe4.converted --force-share --output=json" returned: 0 in 0.112s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:34.456113 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "53568087b7f6756103af21d4fcdbe387ad32abe4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.773s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:34.456113 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:55:34.460009 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Found WWN 330000000386efa88 for multipath device dm-7 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:55:34.460685 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.037s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:55:34.460889 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] <== connect_volume: return (2038ms) {'type': 'block', 'scsi_wwn': '330000000386efa88', 'path': '/dev/dm-7', 'multipath_id': '330000000386efa88'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:55:34.461054 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000386efa88', 'path': '/dev/dm-7', 'multipath_id': '330000000386efa88'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:55:34.462182 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:55:34.463592 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/53568087b7f6756103af21d4fcdbe387ad32abe4 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:34.559446 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:55:34.569042 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/53568087b7f6756103af21d4fcdbe387ad32abe4 --force-share --output=json" returned: 0 in 0.105s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:34.569754 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "53568087b7f6756103af21d4fcdbe387ad32abe4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:34.571713 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "53568087b7f6756103af21d4fcdbe387ad32abe4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:34.571713 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:55:34.575425 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:55:34.575859 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/53568087b7f6756103af21d4fcdbe387ad32abe4 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:34.687188 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/53568087b7f6756103af21d4fcdbe387ad32abe4 --force-share --output=json" returned: 0 in 0.111s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:34.689233 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/53568087b7f6756103af21d4fcdbe387ad32abe4,backing_fmt=raw /opt/stack/data/nova/instances/587a002a-2b9c-4865-8ce2-088ad567c81b/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:34.757293 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/53568087b7f6756103af21d4fcdbe387ad32abe4,backing_fmt=raw /opt/stack/data/nova/instances/587a002a-2b9c-4865-8ce2-088ad567c81b/disk 1073741824" returned: 0 in 0.069s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:34.757909 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "53568087b7f6756103af21d4fcdbe387ad32abe4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.188s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:34.758246 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/53568087b7f6756103af21d4fcdbe387ad32abe4 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:34.776725 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:34.867257 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/53568087b7f6756103af21d4fcdbe387ad32abe4 --force-share --output=json" returned: 0 in 0.109s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:34.868305 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Checking if we can resize image /opt/stack/data/nova/instances/587a002a-2b9c-4865-8ce2-088ad567c81b/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:55:34.868742 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/587a002a-2b9c-4865-8ce2-088ad567c81b/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:34.965534 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/587a002a-2b9c-4865-8ce2-088ad567c81b/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:34.966005 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Cannot resize image /opt/stack/data/nova/instances/587a002a-2b9c-4865-8ce2-088ad567c81b/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:55:34.966582 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:55:34.966787 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Ensure instance console log exists: /opt/stack/data/nova/instances/587a002a-2b9c-4865-8ce2-088ad567c81b/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:55:34.967271 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:34.967578 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:34.967705 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:34.970095 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Start _get_guest_xml network_info=[{"id": "6ddf64a7-099d-4ef6-8dfc-7377446b66f7", "address": "fa:16:3e:94:75:97", "network": {"id": "b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-280876007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60fbdf5ed38b4dc485a81c49b3303ed2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddf64a7-09", "ovs_interfaceid": "6ddf64a7-099d-4ef6-8dfc-7377446b66f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-28T01:49:31Z,direct_url=<?>,disk_format='qcow2',id=160eac6b-3e35-4339-bdf4-c5b84e5687ff,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-28T01:49:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463', 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'eeb7082f-9899-40c8-ab6f-3d746680d463', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '587a002a-2b9c-4865-8ce2-088ad567c81b', 'attached_at': '', 'detached_at': '', 'volume_id': 'eeb7082f-9899-40c8-ab6f-3d746680d463', 'serial': 'eeb7082f-9899-40c8-ab6f-3d746680d463'}, 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'attachment_id': '783f7f7e-81e1-4d2c-927c-e9572666b08e', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:55:34.973979 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
May 28 01:55:34.976918 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='160eac6b-3e35-4339-bdf4-c5b84e5687ff', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-1171245773', uuid='587a002a-2b9c-4865-8ce2-088ad567c81b'), owner=OwnerMeta(userid='27c90c0a8eb148fda8ae718f07ff1ed4', username='tempest-ServerActionsTestOtherA-1714646345-project-member', projectid='60fbdf5ed38b4dc485a81c49b3303ed2', projectname='tempest-ServerActionsTestOtherA-1714646345'), image=ImageMeta(id='160eac6b-3e35-4339-bdf4-c5b84e5687ff', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6ddf64a7-099d-4ef6-8dfc-7377446b66f7", "address": "fa:16:3e:94:75:97", "network": {"id": "b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-280876007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60fbdf5ed38b4dc485a81c49b3303ed2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddf64a7-09", "ovs_interfaceid": "6ddf64a7-099d-4ef6-8dfc-7377446b66f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933334.975196) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:55:34.978292 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:55:34.982139 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:55:34.983635 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:55:34.983941 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:55:34.985210 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:55:34.985574 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-28T01:49:31Z,direct_url=<?>,disk_format='qcow2',id=160eac6b-3e35-4339-bdf4-c5b84e5687ff,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-28T01:49:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:55:34.985719 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:55:34.985803 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:55:34.985970 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:55:34.986032 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:55:34.986149 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:55:34.986389 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:55:34.986535 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:55:34.986655 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:55:34.986756 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:55:34.986918 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:55:34.987045 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lazy-loading 'vcpu_model' on Instance uuid 587a002a-2b9c-4865-8ce2-088ad567c81b {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:55:34.998234 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:54:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-516014259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-serverbootfromvolumestablerescuetest-server-516014259',id=18,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:55:21Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ba381dad8364a488a98b80c04cce8fb',ramdisk_id='',reservation_id='r-uj4jvzn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1211567633',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:55:22Z,user_data=None,user_id='c3a7b14e31ee40cf9e4f4bba084ccaa5',uuid=533f5dcc-2e48-4280-84b3-facb02dea136,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e", "address": "fa:16:3e:e1:01:d3", "network": {"id": "2ee43c4e-569f-4726-9700-add40d768203", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "vif_mac": "fa:16:3e:e1:01:d3"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ba381dad8364a488a98b80c04cce8fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bf1e5b-d3", "ovs_interfaceid": "b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:55:34.998505 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Converting VIF {"id": "b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e", "address": "fa:16:3e:e1:01:d3", "network": {"id": "2ee43c4e-569f-4726-9700-add40d768203", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "vif_mac": "fa:16:3e:e1:01:d3"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ba381dad8364a488a98b80c04cce8fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bf1e5b-d3", "ovs_interfaceid": "b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:55:34.999374 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:01:d3,bridge_name='br-int',has_traffic_filtering=True,id=b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e,network=Network(2ee43c4e-569f-4726-9700-add40d768203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3bf1e5b-d3') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:55:35.000008 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lazy-loading 'pci_devices' on Instance uuid 533f5dcc-2e48-4280-84b3-facb02dea136 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:55:35.073182 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.589s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:35.073758 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:35.177723 np0000001583 nova-compute[98241]: INFO nova.network.neutron [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Updating port d6c3c5f3-e20b-4b3e-abac-62f21007a7ad with attributes {'binding:host_id': 'np0000001583', 'device_owner': 'compute:nova'}
May 28 01:55:35.201047 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:35.509155 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Object Instance<533f5dcc-2e48-4280-84b3-facb02dea136> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:55:35.511115 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] End _get_guest_xml xml=<domain type="qemu">
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:   <uuid>533f5dcc-2e48-4280-84b3-facb02dea136</uuid>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:   <name>instance-00000012</name>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-516014259</nova:name>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:55:31</nova:creationTime>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:         <nova:user uuid="c3a7b14e31ee40cf9e4f4bba084ccaa5">tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member</nova:user>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:         <nova:project uuid="2ba381dad8364a488a98b80c04cce8fb">tempest-ServerBootFromVolumeStableRescueTest-1211567633</nova:project>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:         <nova:port uuid="b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e">
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:     <system>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:       <entry name="serial">533f5dcc-2e48-4280-84b3-facb02dea136</entry>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:       <entry name="uuid">533f5dcc-2e48-4280-84b3-facb02dea136</entry>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:     </system>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:   <os>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:   </os>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:   <features>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:   </features>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:   <devices>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/533f5dcc-2e48-4280-84b3-facb02dea136/disk.config"/>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:     </disk>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:     <disk type="block" device="disk">
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:       <alias name="ua-fab00939-514d-46f8-a4d7-5a7c78e44797"/>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:       <source dev="/dev/dm-7"/>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:       <serial>fab00939-514d-46f8-a4d7-5a7c78e44797</serial>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:     </disk>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/533f5dcc-2e48-4280-84b3-facb02dea136/disk.rescue"/>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:       <target dev="vdb" bus="virtio"/>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:       <boot order="1"/>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:     </disk>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:e1:01:d3"/>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:       <target dev="tapb3bf1e5b-d3"/>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:     </interface>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/533f5dcc-2e48-4280-84b3-facb02dea136/console.log" append="off"/>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:     </serial>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:     <video>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:     </video>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:     </rng>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:   </devices>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]: </domain>
May 28 01:55:35.511115 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:55:35.515719 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:55:35.517110 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463', 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'eeb7082f-9899-40c8-ab6f-3d746680d463', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:55:35.517110 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:55:35.517110 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:55:35.517110 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463', 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'eeb7082f-9899-40c8-ab6f-3d746680d463', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:55:35.521909 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Instance destroyed successfully.
May 28 01:55:35.531602 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:55:35.532296 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:55:35.534123 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:55:35.534925 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:55:35.535018 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:55:35.535234 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:55:35.551053 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:55:35.551053 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:35.562175 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:55:35.562175 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:35.571357 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463] added
May 28 01:55:35.571357 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:55:35.571357 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:55:35.571357 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:55:35.571357 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:55:35.571357 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:55:35.571357 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:35.571723 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:55:35.571892 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0372(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:55:35.571892 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:55:35.576290 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463] added
May 28 01:55:35.576290 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:55:35.576290 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:55:35.576290 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:55:35.576290 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:55:35.576290 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:55:35.576290 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:35.577782 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:55:35.577782 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0415(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:55:35.577782 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:55:35.789131 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:35.865228 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Acquiring lock "refresh_cache-df5768dc-874f-4725-b2a2-e007aebc11a9" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:55:35.865345 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Acquired lock "refresh_cache-df5768dc-874f-4725-b2a2-e007aebc11a9" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:55:35.865522 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:55:35.929313 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e24b4fe7-7c8d-4cce-ba0f-097e62def1b6 req-b09f286e-fd18-46e5-bd0b-0b5e782fb826 service nova] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Received event network-changed-d6c3c5f3-e20b-4b3e-abac-62f21007a7ad {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:35.929498 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e24b4fe7-7c8d-4cce-ba0f-097e62def1b6 req-b09f286e-fd18-46e5-bd0b-0b5e782fb826 service nova] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Refreshing instance network info cache due to event network-changed-d6c3c5f3-e20b-4b3e-abac-62f21007a7ad. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:55:35.929718 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e24b4fe7-7c8d-4cce-ba0f-097e62def1b6 req-b09f286e-fd18-46e5-bd0b-0b5e782fb826 service nova] Acquiring lock "refresh_cache-df5768dc-874f-4725-b2a2-e007aebc11a9" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:55:36.368047 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:36.572406 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:55:36.577425 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:55:36.590595 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:55:36.590595 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:55:36.599693 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:55:36.599693 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:36.610000 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:36.616448 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:36.628727 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:36.628727 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:36.628727 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:36.628727 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:36.628727 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:36.628727 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:36.628727 np0000001583 nova-compute[98241]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:36.628727 np0000001583 nova-compute[98241]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:36.628727 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:55:36.629112 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsi session list stdout=tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:36.629112 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:36.629112 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:36.629112 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:36.629112 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:36.629112 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:36.629112 np0000001583 nova-compute[98241]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:36.629112 np0000001583 nova-compute[98241]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:36.629112 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:55:36.641528 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:36.641528 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:36.641528 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:36.641528 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:36.641528 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:36.641528 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:36.641528 np0000001583 nova-compute[98241]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:36.641528 np0000001583 nova-compute[98241]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:36.641528 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:55:36.641990 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsi session list stdout=tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:36.641990 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:36.641990 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:36.641990 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:36.641990 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:36.641990 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:36.641990 np0000001583 nova-compute[98241]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:36.641990 np0000001583 nova-compute[98241]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:36.641990 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:55:36.690690 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463, portal: 192.168.40.100,3260]
May 28 01:55:36.690690 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463, portal: 192.168.40.100,3260] successful.
May 28 01:55:36.690690 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:36.697069 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463, portal: 192.168.50.100,3260]
May 28 01:55:36.697069 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463, portal: 192.168.50.100,3260] successful.
May 28 01:55:36.697069 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:36.708605 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:36.716789 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:36.728765 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:36.728765 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:36.728765 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:36.728765 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:36.728765 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:36.728765 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:36.728765 np0000001583 nova-compute[98241]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:36.728765 np0000001583 nova-compute[98241]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:36.728765 np0000001583 nova-compute[98241]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:55:36.728765 np0000001583 nova-compute[98241]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:55:36.728765 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:55:36.729307 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsi session list stdout=tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:36.729307 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:36.729307 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:36.729307 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:36.729307 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:36.729307 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:36.729307 np0000001583 nova-compute[98241]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:36.729307 np0000001583 nova-compute[98241]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:36.729307 np0000001583 nova-compute[98241]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:55:36.729307 np0000001583 nova-compute[98241]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:55:36.729307 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:55:36.729627 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.195s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:55:36.729627 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:55:36.731232 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] HCTL ('10', '-', '-', 0) found on session 45 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:55:36.731367 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:55:36.739633 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:36.739633 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:36.739633 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:36.739633 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:36.739633 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:36.739633 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:36.739633 np0000001583 nova-compute[98241]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:36.739633 np0000001583 nova-compute[98241]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:36.739633 np0000001583 nova-compute[98241]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:55:36.739633 np0000001583 nova-compute[98241]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:55:36.739633 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:55:36.739983 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsi session list stdout=tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:36.739983 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:36.739983 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:36.739983 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:36.739983 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:36.739983 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:36.739983 np0000001583 nova-compute[98241]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:36.739983 np0000001583 nova-compute[98241]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:36.739983 np0000001583 nova-compute[98241]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:55:36.739983 np0000001583 nova-compute[98241]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:55:36.739983 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:55:36.740288 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.206s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:55:36.740288 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:55:36.742537 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] HCTL ('9', '-', '-', 0) found on session 44 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:55:36.742537 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:55:36.766217 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Searching for a device in session 45 and hctl ['10', '*', '*', 0] yield: sdd {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:55:36.766217 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'eeb7082f-9899-40c8-ab6f-3d746680d463', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:55:36.766217 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Searching for a device in session 44 and hctl ['9', '*', '*', 0] yield: sde {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:55:36.766217 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'eeb7082f-9899-40c8-ab6f-3d746680d463', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:55:36.792865 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:36.986957 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Updating instance_info_cache with network_info: [{"id": "d6c3c5f3-e20b-4b3e-abac-62f21007a7ad", "address": "fa:16:3e:28:95:8e", "network": {"id": "5e77962e-bcd9-4ce2-89c8-2a3c2cbd75a0", "bridge": "br-int", "label": "tempest-TestShelveInstance-351174513-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fa147b7a97664129bc2922ee1e8debc6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c3c5f3-e2", "ovs_interfaceid": "d6c3c5f3-e20b-4b3e-abac-62f21007a7ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:55:37.044023 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:55:37.044227 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:55:37.044344 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:55:37.044436 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] No VIF found with MAC fa:16:3e:e1:01:d3, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:55:37.045609 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Using config drive
May 28 01:55:37.489573 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Releasing lock "refresh_cache-df5768dc-874f-4725-b2a2-e007aebc11a9" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:55:37.491487 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:55:37.491487 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Creating image(s)
May 28 01:55:37.491593 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Did not create local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 01:55:37.491731 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Ensure instance console log exists: /opt/stack/data/nova/instances/df5768dc-874f-4725-b2a2-e007aebc11a9/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:55:37.492007 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e24b4fe7-7c8d-4cce-ba0f-097e62def1b6 req-b09f286e-fd18-46e5-bd0b-0b5e782fb826 service nova] Acquired lock "refresh_cache-df5768dc-874f-4725-b2a2-e007aebc11a9" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:55:37.492234 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-e24b4fe7-7c8d-4cce-ba0f-097e62def1b6 req-b09f286e-fd18-46e5-bd0b-0b5e782fb826 service nova] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Refreshing network info cache for port d6c3c5f3-e20b-4b3e-abac-62f21007a7ad {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:55:37.493397 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:37.495644 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:37.496728 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:37.496728 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Start _get_guest_xml network_info=[{"id": "d6c3c5f3-e20b-4b3e-abac-62f21007a7ad", "address": "fa:16:3e:28:95:8e", "network": {"id": "5e77962e-bcd9-4ce2-89c8-2a3c2cbd75a0", "bridge": "br-int", "label": "tempest-TestShelveInstance-351174513-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fa147b7a97664129bc2922ee1e8debc6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c3c5f3-e2", "ovs_interfaceid": "d6c3c5f3-e20b-4b3e-abac-62f21007a7ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d', 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9b421209-954a-413c-bf2c-892d99f40d2d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'df5768dc-874f-4725-b2a2-e007aebc11a9', 'attached_at': '', 'detached_at': '', 'volume_id': '9b421209-954a-413c-bf2c-892d99f40d2d', 'serial': '9b421209-954a-413c-bf2c-892d99f40d2d'}, 'delete_on_termination': True, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '23c669af-8270-4691-929b-b1e528cfd2fa', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:55:37.501173 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:55:37.503669 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestShelveInstance-server-2097870267', uuid='df5768dc-874f-4725-b2a2-e007aebc11a9'), owner=OwnerMeta(userid='21c5bf800ee04e06a7ce6dfd95173502', username='tempest-TestShelveInstance-1732527786-project-member', projectid='fa147b7a97664129bc2922ee1e8debc6', projectname='tempest-TestShelveInstance-1732527786'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d6c3c5f3-e20b-4b3e-abac-62f21007a7ad", "address": "fa:16:3e:28:95:8e", "network": {"id": "5e77962e-bcd9-4ce2-89c8-2a3c2cbd75a0", "bridge": "br-int", "label": "tempest-TestShelveInstance-351174513-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fa147b7a97664129bc2922ee1e8debc6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c3c5f3-e2", "ovs_interfaceid": "d6c3c5f3-e20b-4b3e-abac-62f21007a7ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933337.5032618) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:55:37.507438 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:55:37.507438 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:55:37.508923 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:55:37.509768 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:55:37.511221 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:55:37.511583 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:55:37.511751 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:55:37.512248 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:55:37.512248 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:55:37.512248 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:55:37.512248 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:55:37.512378 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:55:37.512582 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:55:37.512669 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:55:37.513661 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:55:37.513890 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:55:37.514170 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Lazy-loading 'vcpu_model' on Instance uuid df5768dc-874f-4725-b2a2-e007aebc11a9 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:55:37.535736 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:55:37.547511 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lazy-loading 'ec2_ids' on Instance uuid 533f5dcc-2e48-4280-84b3-facb02dea136 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:55:37.997532 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-e24b4fe7-7c8d-4cce-ba0f-097e62def1b6 req-b09f286e-fd18-46e5-bd0b-0b5e782fb826 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:38.001219 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:38.017129 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Object Instance<df5768dc-874f-4725-b2a2-e007aebc11a9> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:55:38.032040 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:55:38.032581 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d', 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9b421209-954a-413c-bf2c-892d99f40d2d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:55:38.032816 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:55:38.051228 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Object Instance<533f5dcc-2e48-4280-84b3-facb02dea136> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:55:38.051390 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lazy-loading 'keypairs' on Instance uuid 533f5dcc-2e48-4280-84b3-facb02dea136 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:55:38.396647 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-e24b4fe7-7c8d-4cce-ba0f-097e62def1b6 req-b09f286e-fd18-46e5-bd0b-0b5e782fb826 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:38.556096 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Object Instance<533f5dcc-2e48-4280-84b3-facb02dea136> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:55:38.559976 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:38.563637 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Found WWN 33000000086ce169e for multipath device dm-3 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:55:38.564104 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.047s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:55:38.564168 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] <== connect_volume: return (3047ms) {'type': 'block', 'scsi_wwn': '33000000086ce169e', 'path': '/dev/dm-3', 'multipath_id': '33000000086ce169e'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:55:38.565457 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000086ce169e', 'path': '/dev/dm-3', 'multipath_id': '33000000086ce169e'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:55:38.566679 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.533s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:55:38.566679 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d', 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9b421209-954a-413c-bf2c-892d99f40d2d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:55:38.585965 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:55:38.587390 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:55:38.587628 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:55:38.588642 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:55:38.592628 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:55:38.593977 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:55:38.599968 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-e24b4fe7-7c8d-4cce-ba0f-097e62def1b6 req-b09f286e-fd18-46e5-bd0b-0b5e782fb826 service nova] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Updated VIF entry in instance network info cache for port d6c3c5f3-e20b-4b3e-abac-62f21007a7ad. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:55:38.602359 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-e24b4fe7-7c8d-4cce-ba0f-097e62def1b6 req-b09f286e-fd18-46e5-bd0b-0b5e782fb826 service nova] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Updating instance_info_cache with network_info: [{"id": "d6c3c5f3-e20b-4b3e-abac-62f21007a7ad", "address": "fa:16:3e:28:95:8e", "network": {"id": "5e77962e-bcd9-4ce2-89c8-2a3c2cbd75a0", "bridge": "br-int", "label": "tempest-TestShelveInstance-351174513-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fa147b7a97664129bc2922ee1e8debc6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c3c5f3-e2", "ovs_interfaceid": "d6c3c5f3-e20b-4b3e-abac-62f21007a7ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:55:38.611112 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:55:38.611112 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:38.621790 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:55:38.621790 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:38.635453 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d] added
May 28 01:55:38.635453 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:55:38.635453 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:55:38.635453 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:55:38.635453 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:55:38.635453 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:55:38.635453 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:38.635992 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:55:38.636289 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0486(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:55:38.637210 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:55:38.645990 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d] added
May 28 01:55:38.645990 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:55:38.645990 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:55:38.645990 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:55:38.645990 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:55:38.645990 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:55:38.645990 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:38.645990 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:55:38.646409 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0524(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:55:38.647689 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:55:38.724929 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Creating config drive at /opt/stack/data/nova/instances/533f5dcc-2e48-4280-84b3-facb02dea136/disk.config.rescue
May 28 01:55:38.727253 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/533f5dcc-2e48-4280-84b3-facb02dea136/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmppi2c67au {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:38.778720 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/533f5dcc-2e48-4280-84b3-facb02dea136/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmppi2c67au" returned: 0 in 0.051s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:39.072831 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T01:54:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-307669431',display_name='tempest-ServerActionsTestOtherA-server-1171245773',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-tempest-common-compute-instance-307669431',id=13,image_ref='160eac6b-3e35-4339-bdf4-c5b84e5687ff',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+uj6sYtPnyFWQs1nCcEuZB/a15TtoxueiMzmbIyATZcok2qJukDOEiuQPENacqvJA6yFSDD4IVNTN5EdbtPeAegQv2a08BDT/l0Bf9OlKlI25U/AVBDkLghlYu/vY6eg==',key_name='tempest-keypair-374991287',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:54:33Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='60fbdf5ed38b4dc485a81c49b3303ed2',ramdisk_id='',reservation_id='r-m7y4i9cj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='160eac6b-3e35-4339-bdf4-c5b84e5687ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1714646345',owner_user_name='tempest-ServerActionsTestOtherA-1714646345-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:55:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27c90c0a8eb148fda8ae718f07ff1ed4',uuid=587a002a-2b9c-4865-8ce2-088ad567c81b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ddf64a7-099d-4ef6-8dfc-7377446b66f7", "address": "fa:16:3e:94:75:97", "network": {"id": "b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-280876007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60fbdf5ed38b4dc485a81c49b3303ed2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddf64a7-09", "ovs_interfaceid": "6ddf64a7-099d-4ef6-8dfc-7377446b66f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:55:39.073064 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Converting VIF {"id": "6ddf64a7-099d-4ef6-8dfc-7377446b66f7", "address": "fa:16:3e:94:75:97", "network": {"id": "b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-280876007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60fbdf5ed38b4dc485a81c49b3303ed2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddf64a7-09", "ovs_interfaceid": "6ddf64a7-099d-4ef6-8dfc-7377446b66f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:55:39.074195 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:75:97,bridge_name='br-int',has_traffic_filtering=True,id=6ddf64a7-099d-4ef6-8dfc-7377446b66f7,network=Network(b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ddf64a7-09') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:55:39.076883 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] End _get_guest_xml xml=<domain type="qemu">
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:   <uuid>587a002a-2b9c-4865-8ce2-088ad567c81b</uuid>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:   <name>instance-0000000d</name>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:       <nova:name>tempest-ServerActionsTestOtherA-server-1171245773</nova:name>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:55:34</nova:creationTime>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:       <nova:image uuid="160eac6b-3e35-4339-bdf4-c5b84e5687ff">
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:         <nova:user uuid="27c90c0a8eb148fda8ae718f07ff1ed4">tempest-ServerActionsTestOtherA-1714646345-project-member</nova:user>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:         <nova:project uuid="60fbdf5ed38b4dc485a81c49b3303ed2">tempest-ServerActionsTestOtherA-1714646345</nova:project>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="160eac6b-3e35-4339-bdf4-c5b84e5687ff"/>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:         <nova:port uuid="6ddf64a7-099d-4ef6-8dfc-7377446b66f7">
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:     <system>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:       <entry name="serial">587a002a-2b9c-4865-8ce2-088ad567c81b</entry>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:       <entry name="uuid">587a002a-2b9c-4865-8ce2-088ad567c81b</entry>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:     </system>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:   <os>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:   </os>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:   <features>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:   </features>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:   <devices>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/587a002a-2b9c-4865-8ce2-088ad567c81b/disk"/>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:     </disk>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/587a002a-2b9c-4865-8ce2-088ad567c81b/disk.config"/>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:     </disk>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:     <disk type="block" device="disk">
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:       <alias name="ua-eeb7082f-9899-40c8-ab6f-3d746680d463"/>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:       <source dev="/dev/dm-3"/>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:       <target dev="vdb" bus="virtio"/>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:       <serial>eeb7082f-9899-40c8-ab6f-3d746680d463</serial>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:     </disk>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:94:75:97"/>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:       <target dev="tap6ddf64a7-09"/>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:     </interface>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/587a002a-2b9c-4865-8ce2-088ad567c81b/console.log" append="off"/>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:     </serial>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:     <video>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:     </video>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:     </rng>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:   </devices>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]: </domain>
May 28 01:55:39.076883 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:55:39.079655 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T01:54:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-307669431',display_name='tempest-ServerActionsTestOtherA-server-1171245773',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-tempest-common-compute-instance-307669431',id=13,image_ref='160eac6b-3e35-4339-bdf4-c5b84e5687ff',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+uj6sYtPnyFWQs1nCcEuZB/a15TtoxueiMzmbIyATZcok2qJukDOEiuQPENacqvJA6yFSDD4IVNTN5EdbtPeAegQv2a08BDT/l0Bf9OlKlI25U/AVBDkLghlYu/vY6eg==',key_name='tempest-keypair-374991287',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:54:33Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='60fbdf5ed38b4dc485a81c49b3303ed2',ramdisk_id='',reservation_id='r-m7y4i9cj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='160eac6b-3e35-4339-bdf4-c5b84e5687ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1714646345',owner_user_name='tempest-ServerActionsTestOtherA-1714646345-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:55:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27c90c0a8eb148fda8ae718f07ff1ed4',uuid=587a002a-2b9c-4865-8ce2-088ad567c81b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ddf64a7-099d-4ef6-8dfc-7377446b66f7", "address": "fa:16:3e:94:75:97", "network": {"id": "b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-280876007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60fbdf5ed38b4dc485a81c49b3303ed2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddf64a7-09", "ovs_interfaceid": "6ddf64a7-099d-4ef6-8dfc-7377446b66f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:55:39.079655 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Converting VIF {"id": "6ddf64a7-099d-4ef6-8dfc-7377446b66f7", "address": "fa:16:3e:94:75:97", "network": {"id": "b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-280876007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60fbdf5ed38b4dc485a81c49b3303ed2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddf64a7-09", "ovs_interfaceid": "6ddf64a7-099d-4ef6-8dfc-7377446b66f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:55:39.079655 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:75:97,bridge_name='br-int',has_traffic_filtering=True,id=6ddf64a7-099d-4ef6-8dfc-7377446b66f7,network=Network(b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ddf64a7-09') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:55:39.079655 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:75:97,bridge_name='br-int',has_traffic_filtering=True,id=6ddf64a7-099d-4ef6-8dfc-7377446b66f7,network=Network(b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ddf64a7-09') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:55:39.079935 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:39.080153 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:39.080479 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:55:39.081973 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:39.082286 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4d7078cd-b62c-567e-8e1d-12562936b86c', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:39.099025 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:39.100187 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:55:39.104300 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:39.106206 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e24b4fe7-7c8d-4cce-ba0f-097e62def1b6 req-b09f286e-fd18-46e5-bd0b-0b5e782fb826 service nova] Releasing lock "refresh_cache-df5768dc-874f-4725-b2a2-e007aebc11a9" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:55:39.107241 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:39.107539 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6ddf64a7-09, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:39.108015 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6ddf64a7-09, col_values=(('qos', UUID('239b45e8-2532-49bb-a264-0b85c3c494d6')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:39.108257 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6ddf64a7-09, col_values=(('external_ids', {'iface-id': '6ddf64a7-099d-4ef6-8dfc-7377446b66f7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:75:97', 'vm-uuid': '587a002a-2b9c-4865-8ce2-088ad567c81b'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:39.111416 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:55:39.121601 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:39.122354 np0000001583 nova-compute[98241]: INFO os_vif [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:75:97,bridge_name='br-int',has_traffic_filtering=True,id=6ddf64a7-099d-4ef6-8dfc-7377446b66f7,network=Network(b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ddf64a7-09')
May 28 01:55:39.251703 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:39.289759 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:39.294775 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:39.372911 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Acquiring lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:39.373183 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:39.386760 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:39.422953 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:39.429053 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:39.640759 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:55:39.647100 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:55:39.657373 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:55:39.657373 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:55:39.662972 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:55:39.662972 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:39.673975 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:39.679682 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:39.691869 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:39.691869 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:39.691869 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:39.691869 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:39.691869 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:39.691869 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:39.691869 np0000001583 nova-compute[98241]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:39.691869 np0000001583 nova-compute[98241]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:39.691869 np0000001583 nova-compute[98241]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:55:39.691869 np0000001583 nova-compute[98241]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:55:39.691869 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:55:39.692331 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsi session list stdout=tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:39.692331 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:39.692331 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:39.692331 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:39.692331 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:39.692331 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:39.692331 np0000001583 nova-compute[98241]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:39.692331 np0000001583 nova-compute[98241]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:39.692331 np0000001583 nova-compute[98241]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:55:39.692331 np0000001583 nova-compute[98241]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:55:39.692331 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:55:39.700697 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:39.700697 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:39.700697 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:39.700697 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:39.700697 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:39.700697 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:39.700697 np0000001583 nova-compute[98241]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:39.700697 np0000001583 nova-compute[98241]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:39.700697 np0000001583 nova-compute[98241]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:55:39.700697 np0000001583 nova-compute[98241]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:55:39.700697 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:55:39.701154 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsi session list stdout=tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:39.701154 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:39.701154 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:39.701154 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:39.701154 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:39.701154 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:39.701154 np0000001583 nova-compute[98241]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:39.701154 np0000001583 nova-compute[98241]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:39.701154 np0000001583 nova-compute[98241]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:55:39.701154 np0000001583 nova-compute[98241]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:55:39.701154 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:55:39.747536 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d, portal: 192.168.40.100,3260]
May 28 01:55:39.747536 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d, portal: 192.168.40.100,3260] successful.
May 28 01:55:39.747536 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:39.756453 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d, portal: 192.168.50.100,3260]
May 28 01:55:39.756453 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d, portal: 192.168.50.100,3260] successful.
May 28 01:55:39.756453 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:39.763467 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:39.772971 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:55:39.792488 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:39.792488 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:39.792488 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:39.792488 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:39.792488 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:39.792488 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:39.792488 np0000001583 nova-compute[98241]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:39.792488 np0000001583 nova-compute[98241]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:39.792488 np0000001583 nova-compute[98241]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:55:39.792488 np0000001583 nova-compute[98241]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:55:39.792488 np0000001583 nova-compute[98241]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:39.792488 np0000001583 nova-compute[98241]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:39.792488 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:55:39.792823 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsi session list stdout=tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:39.792823 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:39.792823 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:39.792823 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:39.792823 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:39.792823 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:39.792823 np0000001583 nova-compute[98241]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:39.792823 np0000001583 nova-compute[98241]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:39.792823 np0000001583 nova-compute[98241]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:55:39.792823 np0000001583 nova-compute[98241]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:55:39.792823 np0000001583 nova-compute[98241]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:39.792823 np0000001583 nova-compute[98241]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:39.792823 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:55:39.793111 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.206s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:55:39.793174 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:55:39.794513 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] HCTL ('17', '-', '-', 0) found on session 46 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:55:39.794657 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:55:39.799698 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:39.799698 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:39.799698 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:39.799698 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:39.799698 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:39.799698 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:39.799698 np0000001583 nova-compute[98241]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:39.799698 np0000001583 nova-compute[98241]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:39.799698 np0000001583 nova-compute[98241]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:55:39.799698 np0000001583 nova-compute[98241]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:55:39.799698 np0000001583 nova-compute[98241]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:39.799698 np0000001583 nova-compute[98241]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:39.799698 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:55:39.800017 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsi session list stdout=tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:39.800017 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:55:39.800017 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:39.800017 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:55:39.800017 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:39.800017 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:55:39.800017 np0000001583 nova-compute[98241]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:39.800017 np0000001583 nova-compute[98241]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:55:39.800017 np0000001583 nova-compute[98241]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:55:39.800017 np0000001583 nova-compute[98241]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:55:39.800017 np0000001583 nova-compute[98241]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:39.800017 np0000001583 nova-compute[98241]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:55:39.800017 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:55:39.800689 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.208s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:55:39.800689 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:55:39.801370 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] HCTL ('18', '-', '-', 0) found on session 47 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:55:39.801473 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:55:39.815528 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Searching for a device in session 46 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:55:39.815818 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9b421209-954a-413c-bf2c-892d99f40d2d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:55:39.822378 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Searching for a device in session 47 and hctl ['18', '*', '*', 0] yield: None {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:55:39.875365 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:55:40.241540 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Removed pending STOPPED event for 533f5dcc-2e48-4280-84b3-facb02dea136 due to new event <LifecycleEvent: 1779933340.2410278, 533f5dcc-2e48-4280-84b3-facb02dea136 => Resumed> {{(pid=98241) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 01:55:40.242850 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933340.2410278, 533f5dcc-2e48-4280-84b3-facb02dea136 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:55:40.243035 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] VM Resumed (Lifecycle Event)
May 28 01:55:40.244783 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-44369498-249a-4bba-8915-53c70eb0bb64 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:55:40.432039 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:40.432213 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:40.436610 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:55:40.436818 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Claim successful on node np0000001583
May 28 01:55:40.651534 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:55:40.652040 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:55:40.652040 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:55:40.652040 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] No VIF found with MAC fa:16:3e:94:75:97, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:55:40.652501 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Using config drive
May 28 01:55:40.747710 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:55:40.749327 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:55:40.822732 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Searching for a device in session 47 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:55:40.822900 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9b421209-954a-413c-bf2c-892d99f40d2d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:55:41.158136 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lazy-loading 'ec2_ids' on Instance uuid 587a002a-2b9c-4865-8ce2-088ad567c81b {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:55:41.253285 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933341.25224, 533f5dcc-2e48-4280-84b3-facb02dea136 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:55:41.253285 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] VM Started (Lifecycle Event)
May 28 01:55:41.595853 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-368136c6-42e2-43c1-80c6-ae9c0d772a55 req-8012ad99-93fe-4a96-84bc-4a38fd0f8a30 service nova] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Received event network-vif-plugged-b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:41.596189 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-368136c6-42e2-43c1-80c6-ae9c0d772a55 req-8012ad99-93fe-4a96-84bc-4a38fd0f8a30 service nova] Acquiring lock "533f5dcc-2e48-4280-84b3-facb02dea136-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:41.597311 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-368136c6-42e2-43c1-80c6-ae9c0d772a55 req-8012ad99-93fe-4a96-84bc-4a38fd0f8a30 service nova] Lock "533f5dcc-2e48-4280-84b3-facb02dea136-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:41.597461 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-368136c6-42e2-43c1-80c6-ae9c0d772a55 req-8012ad99-93fe-4a96-84bc-4a38fd0f8a30 service nova] Lock "533f5dcc-2e48-4280-84b3-facb02dea136-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:41.597616 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-368136c6-42e2-43c1-80c6-ae9c0d772a55 req-8012ad99-93fe-4a96-84bc-4a38fd0f8a30 service nova] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] No waiting events found dispatching network-vif-plugged-b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:55:41.597791 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-368136c6-42e2-43c1-80c6-ae9c0d772a55 req-8012ad99-93fe-4a96-84bc-4a38fd0f8a30 service nova] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Received unexpected event network-vif-plugged-b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e for instance with vm_state rescued and task_state unrescuing.
May 28 01:55:41.615397 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Found WWN 3300000001305f420 for multipath device dm-4 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:55:41.615824 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.050s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:55:41.616298 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] <== connect_volume: return (3583ms) {'type': 'block', 'scsi_wwn': '3300000001305f420', 'path': '/dev/dm-4', 'multipath_id': '3300000001305f420'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:55:41.616618 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000001305f420', 'path': '/dev/dm-4', 'multipath_id': '3300000001305f420'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:55:41.666557 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Object Instance<587a002a-2b9c-4865-8ce2-088ad567c81b> lazy-loaded attributes: vcpu_model,ec2_ids {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:55:41.666950 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lazy-loading 'keypairs' on Instance uuid 587a002a-2b9c-4865-8ce2-088ad567c81b {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:55:41.743922 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-54ef8ccc-e54a-419d-b456-0f1744e02803 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Unrescuing
May 28 01:55:41.744211 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-54ef8ccc-e54a-419d-b456-0f1744e02803 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "refresh_cache-533f5dcc-2e48-4280-84b3-facb02dea136" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:55:41.744367 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-54ef8ccc-e54a-419d-b456-0f1744e02803 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquired lock "refresh_cache-533f5dcc-2e48-4280-84b3-facb02dea136" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:55:41.744563 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-54ef8ccc-e54a-419d-b456-0f1744e02803 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:55:41.760029 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:55:41.762035 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:55:41.925213 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.00046813499989184493 future=<Future at 0x7724ec1f2390 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:55:41.925870 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Emitting event <LifecycleEvent: 1779933326.9246268, 96a4bb3b-0482-4b14-bb23-772d295b972e => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:55:41.926059 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:55:41.926237 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=1.9895367369999803 future=<Future at 0x7724ec203470 state=cancelled>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:55:41.926345 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=1.9894160280000506 future=<Future at 0x7724ec203470 state=cancelled>) was cancelled while queued, skipping {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:55:41.926442 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:55:41.926878 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] VM Stopped (Lifecycle Event)
May 28 01:55:41.928328 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=1.9877165180000702 future=<Future at 0x7724ec18dd90 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:55:41.928457 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=1.9875542800000403 future=<Future at 0x7724ec18dd90 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:55:41.996109 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:55:41.996462 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:55:42.122797 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T01:54:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2097870267',display_name='tempest-TestShelveInstance-server-2097870267',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testshelveinstance-server-2097870267',id=12,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1311460250',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:54:36Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='fa147b7a97664129bc2922ee1e8debc6',ramdisk_id='',reservation_id='r-yyloknk0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',owner_project_name='tempest-TestShelveInstance-1732527786',owner_user_name='tempest-TestShelveInstance-1732527786-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:55:28Z,user_data=None,user_id='21c5bf800ee04e06a7ce6dfd95173502',uuid=df5768dc-874f-4725-b2a2-e007aebc11a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d6c3c5f3-e20b-4b3e-abac-62f21007a7ad", "address": "fa:16:3e:28:95:8e", "network": {"id": "5e77962e-bcd9-4ce2-89c8-2a3c2cbd75a0", "bridge": "br-int", "label": "tempest-TestShelveInstance-351174513-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fa147b7a97664129bc2922ee1e8debc6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c3c5f3-e2", "ovs_interfaceid": "d6c3c5f3-e20b-4b3e-abac-62f21007a7ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:55:42.122797 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Converting VIF {"id": "d6c3c5f3-e20b-4b3e-abac-62f21007a7ad", "address": "fa:16:3e:28:95:8e", "network": {"id": "5e77962e-bcd9-4ce2-89c8-2a3c2cbd75a0", "bridge": "br-int", "label": "tempest-TestShelveInstance-351174513-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fa147b7a97664129bc2922ee1e8debc6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c3c5f3-e2", "ovs_interfaceid": "d6c3c5f3-e20b-4b3e-abac-62f21007a7ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:55:42.123313 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:95:8e,bridge_name='br-int',has_traffic_filtering=True,id=d6c3c5f3-e20b-4b3e-abac-62f21007a7ad,network=Network(5e77962e-bcd9-4ce2-89c8-2a3c2cbd75a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6c3c5f3-e2') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:55:42.123999 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Lazy-loading 'pci_devices' on Instance uuid df5768dc-874f-4725-b2a2-e007aebc11a9 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:55:42.170102 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Object Instance<587a002a-2b9c-4865-8ce2-088ad567c81b> lazy-loaded attributes: vcpu_model,ec2_ids,keypairs {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:55:42.173648 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.: NotImplementedError
May 28 01:55:42.248445 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-54ef8ccc-e54a-419d-b456-0f1744e02803 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:42.265870 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 28 01:55:42.330520 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Creating config drive at /opt/stack/data/nova/instances/587a002a-2b9c-4865-8ce2-088ad567c81b/disk.config
May 28 01:55:42.336949 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/587a002a-2b9c-4865-8ce2-088ad567c81b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqextks3k {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:42.386738 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/587a002a-2b9c-4865-8ce2-088ad567c81b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqextks3k" returned: 0 in 0.050s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:42.430686 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-50b6e0f9-62c5-4113-bbb5-7312bac91480 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: 96a4bb3b-0482-4b14-bb23-772d295b972e] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:55:42.504756 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:55:42.626406 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Object Instance<df5768dc-874f-4725-b2a2-e007aebc11a9> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:55:42.629905 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] End _get_guest_xml xml=<domain type="qemu">
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:   <uuid>df5768dc-874f-4725-b2a2-e007aebc11a9</uuid>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:   <name>instance-0000000c</name>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:       <nova:name>tempest-TestShelveInstance-server-2097870267</nova:name>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:55:37</nova:creationTime>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:       <nova:image uuid="">
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:         <nova:user uuid="21c5bf800ee04e06a7ce6dfd95173502">tempest-TestShelveInstance-1732527786-project-member</nova:user>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:         <nova:project uuid="fa147b7a97664129bc2922ee1e8debc6">tempest-TestShelveInstance-1732527786</nova:project>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:       <nova:root type="volume" uuid=""/>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:         <nova:port uuid="d6c3c5f3-e20b-4b3e-abac-62f21007a7ad">
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:     <system>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:       <entry name="serial">df5768dc-874f-4725-b2a2-e007aebc11a9</entry>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:       <entry name="uuid">df5768dc-874f-4725-b2a2-e007aebc11a9</entry>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:     </system>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:   <os>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:   </os>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:   <features>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:   </features>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:   <devices>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/df5768dc-874f-4725-b2a2-e007aebc11a9/disk.config"/>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:     </disk>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:     <disk type="block" device="disk">
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:       <alias name="ua-9b421209-954a-413c-bf2c-892d99f40d2d"/>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:       <source dev="/dev/dm-4"/>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:       <serial>9b421209-954a-413c-bf2c-892d99f40d2d</serial>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:     </disk>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:28:95:8e"/>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:       <target dev="tapd6c3c5f3-e2"/>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:     </interface>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/df5768dc-874f-4725-b2a2-e007aebc11a9/console.log" append="off"/>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:     </serial>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:     <video>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:     </video>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:     </rng>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:   </devices>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]: </domain>
May 28 01:55:42.629905 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:55:42.634230 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Preparing to wait for external event network-vif-plugged-d6c3c5f3-e20b-4b3e-abac-62f21007a7ad {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:55:42.634230 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Acquiring lock "df5768dc-874f-4725-b2a2-e007aebc11a9-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:42.634230 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Lock "df5768dc-874f-4725-b2a2-e007aebc11a9-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:42.634230 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Lock "df5768dc-874f-4725-b2a2-e007aebc11a9-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:42.634230 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T01:54:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2097870267',display_name='tempest-TestShelveInstance-server-2097870267',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testshelveinstance-server-2097870267',id=12,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1311460250',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:54:36Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='fa147b7a97664129bc2922ee1e8debc6',ramdisk_id='',reservation_id='r-yyloknk0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',owner_project_name='tempest-TestShelveInstance-1732527786',owner_user_name='tempest-TestShelveInstance-1732527786-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:55:28Z,user_data=None,user_id='21c5bf800ee04e06a7ce6dfd95173502',uuid=df5768dc-874f-4725-b2a2-e007aebc11a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d6c3c5f3-e20b-4b3e-abac-62f21007a7ad", "address": "fa:16:3e:28:95:8e", "network": {"id": "5e77962e-bcd9-4ce2-89c8-2a3c2cbd75a0", "bridge": "br-int", "label": "tempest-TestShelveInstance-351174513-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fa147b7a97664129bc2922ee1e8debc6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c3c5f3-e2", "ovs_interfaceid": "d6c3c5f3-e20b-4b3e-abac-62f21007a7ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:55:42.634230 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Converting VIF {"id": "d6c3c5f3-e20b-4b3e-abac-62f21007a7ad", "address": "fa:16:3e:28:95:8e", "network": {"id": "5e77962e-bcd9-4ce2-89c8-2a3c2cbd75a0", "bridge": "br-int", "label": "tempest-TestShelveInstance-351174513-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fa147b7a97664129bc2922ee1e8debc6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c3c5f3-e2", "ovs_interfaceid": "d6c3c5f3-e20b-4b3e-abac-62f21007a7ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:55:42.634230 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:95:8e,bridge_name='br-int',has_traffic_filtering=True,id=d6c3c5f3-e20b-4b3e-abac-62f21007a7ad,network=Network(5e77962e-bcd9-4ce2-89c8-2a3c2cbd75a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6c3c5f3-e2') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:55:42.634230 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:95:8e,bridge_name='br-int',has_traffic_filtering=True,id=d6c3c5f3-e20b-4b3e-abac-62f21007a7ad,network=Network(5e77962e-bcd9-4ce2-89c8-2a3c2cbd75a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6c3c5f3-e2') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:55:42.634230 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:42.634638 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:42.635029 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:55:42.638241 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:42.638241 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cf685a94-2be5-510f-b153-aecbbc731b8e', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:42.642745 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:42.642745 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:55:42.650633 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:42.655357 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:42.655357 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6c3c5f3-e2, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:42.655357 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd6c3c5f3-e2, col_values=(('qos', UUID('90565f86-c348-4339-95f5-673ec8be0bec')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:42.655357 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd6c3c5f3-e2, col_values=(('external_ids', {'iface-id': 'd6c3c5f3-e20b-4b3e-abac-62f21007a7ad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:95:8e', 'vm-uuid': 'df5768dc-874f-4725-b2a2-e007aebc11a9'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:42.655817 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:42.658048 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:55:42.671875 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:42.673742 np0000001583 nova-compute[98241]: INFO os_vif [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:95:8e,bridge_name='br-int',has_traffic_filtering=True,id=d6c3c5f3-e20b-4b3e-abac-62f21007a7ad,network=Network(5e77962e-bcd9-4ce2-89c8-2a3c2cbd75a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6c3c5f3-e2')
May 28 01:55:42.682554 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-54ef8ccc-e54a-419d-b456-0f1744e02803 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:42.844685 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-54ef8ccc-e54a-419d-b456-0f1744e02803 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Updating instance_info_cache with network_info: [{"id": "b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e", "address": "fa:16:3e:e1:01:d3", "network": {"id": "2ee43c4e-569f-4726-9700-add40d768203", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ba381dad8364a488a98b80c04cce8fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bf1e5b-d3", "ovs_interfaceid": "b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:55:42.945875 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:42.990117 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:43.003216 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:43.016525 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.584s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:43.017043 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:55:43.073706 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:43.153521 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:43.161214 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:43.207717 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-c74c73f8-fee2-4b4d-b459-8a4821cf2ced req-8bf71fe1-6e21-4d5c-be67-67680bee1a2d service nova] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Received event network-vif-plugged-6ddf64a7-099d-4ef6-8dfc-7377446b66f7 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:43.208017 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c74c73f8-fee2-4b4d-b459-8a4821cf2ced req-8bf71fe1-6e21-4d5c-be67-67680bee1a2d service nova] Acquiring lock "587a002a-2b9c-4865-8ce2-088ad567c81b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:43.208675 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c74c73f8-fee2-4b4d-b459-8a4821cf2ced req-8bf71fe1-6e21-4d5c-be67-67680bee1a2d service nova] Lock "587a002a-2b9c-4865-8ce2-088ad567c81b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:43.208889 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c74c73f8-fee2-4b4d-b459-8a4821cf2ced req-8bf71fe1-6e21-4d5c-be67-67680bee1a2d service nova] Lock "587a002a-2b9c-4865-8ce2-088ad567c81b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:43.209479 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-c74c73f8-fee2-4b4d-b459-8a4821cf2ced req-8bf71fe1-6e21-4d5c-be67-67680bee1a2d service nova] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] No waiting events found dispatching network-vif-plugged-6ddf64a7-099d-4ef6-8dfc-7377446b66f7 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:55:43.209479 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-c74c73f8-fee2-4b4d-b459-8a4821cf2ced req-8bf71fe1-6e21-4d5c-be67-67680bee1a2d service nova] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Received unexpected event network-vif-plugged-6ddf64a7-099d-4ef6-8dfc-7377446b66f7 for instance with vm_state active and task_state rebuild_spawning.
May 28 01:55:43.349904 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-54ef8ccc-e54a-419d-b456-0f1744e02803 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Releasing lock "refresh_cache-533f5dcc-2e48-4280-84b3-facb02dea136" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:55:43.350070 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-54ef8ccc-e54a-419d-b456-0f1744e02803 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lazy-loading 'flavor' on Instance uuid 533f5dcc-2e48-4280-84b3-facb02dea136 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:55:43.524971 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:55:43.525252 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:55:43.525632 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:43.526030 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:43.652694 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8f68ae604d0442439a927020cec740c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db0b9fa3fcc47408dad261c2004e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:55:43.698480 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9301503f-a9df-4a7c-84b3-eb9d4edf2dd3 req-344f6007-b893-4e09-b5f7-5cd3a6c3ad67 service nova] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Received event network-vif-plugged-b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:43.700046 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9301503f-a9df-4a7c-84b3-eb9d4edf2dd3 req-344f6007-b893-4e09-b5f7-5cd3a6c3ad67 service nova] Acquiring lock "533f5dcc-2e48-4280-84b3-facb02dea136-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:43.701292 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9301503f-a9df-4a7c-84b3-eb9d4edf2dd3 req-344f6007-b893-4e09-b5f7-5cd3a6c3ad67 service nova] Lock "533f5dcc-2e48-4280-84b3-facb02dea136-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:43.701292 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9301503f-a9df-4a7c-84b3-eb9d4edf2dd3 req-344f6007-b893-4e09-b5f7-5cd3a6c3ad67 service nova] Lock "533f5dcc-2e48-4280-84b3-facb02dea136-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:43.701292 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9301503f-a9df-4a7c-84b3-eb9d4edf2dd3 req-344f6007-b893-4e09-b5f7-5cd3a6c3ad67 service nova] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] No waiting events found dispatching network-vif-plugged-b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:55:43.701292 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-9301503f-a9df-4a7c-84b3-eb9d4edf2dd3 req-344f6007-b893-4e09-b5f7-5cd3a6c3ad67 service nova] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Received unexpected event network-vif-plugged-b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e for instance with vm_state rescued and task_state unrescuing.
May 28 01:55:43.896844 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:43.902631 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:43.917490 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0014097639998453815 future=<Future at 0x7724ec18dd90 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:55:43.917690 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:55:43.922005 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Emitting event <LifecycleEvent: 1779933328.91598, 587a002a-2b9c-4865-8ce2-088ad567c81b => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:55:43.922371 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] VM Stopped (Lifecycle Event)
May 28 01:55:43.935688 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:44.016162 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Instance event wait completed in 0 seconds for  {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:55:44.016406 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:55:44.018131 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Removed pending STOPPED event for 587a002a-2b9c-4865-8ce2-088ad567c81b due to new event <LifecycleEvent: 1779933344.017702, 587a002a-2b9c-4865-8ce2-088ad567c81b => Resumed> {{(pid=98241) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 01:55:44.018311 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933344.017702, 587a002a-2b9c-4865-8ce2-088ad567c81b => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:55:44.018451 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] VM Resumed (Lifecycle Event)
May 28 01:55:44.021626 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Instance spawned successfully.
May 28 01:55:44.024748 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:55:44.033570 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:55:44.101105 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:44.115673 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:44.182058 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:44.200517 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:44.210797 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:55:44.211019 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:55:44.211219 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] No VIF found with MAC fa:16:3e:28:95:8e, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:55:44.212053 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Using config drive
May 28 01:55:44.221245 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Instance destroyed successfully.
May 28 01:55:44.221617 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-54ef8ccc-e54a-419d-b456-0f1744e02803 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lazy-loading 'numa_topology' on Instance uuid 533f5dcc-2e48-4280-84b3-facb02dea136 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:55:44.432405 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:55:44.523992 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:55:44.524910 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:55:44.531153 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:55:44.531406 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:55:44.531724 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:55:44.532045 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:55:44.533094 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:55:44.533094 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:55:44.543251 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:55:44.638007 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Successfully created port: 7567636b-7225-4025-b9f0-d4c8eb5abe43 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:55:44.715834 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Lazy-loading 'ec2_ids' on Instance uuid df5768dc-874f-4725-b2a2-e007aebc11a9 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:55:44.723476 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-54ef8ccc-e54a-419d-b456-0f1744e02803 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Object Instance<533f5dcc-2e48-4280-84b3-facb02dea136> lazy-loaded attributes: flavor,numa_topology {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:55:45.033274 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
May 28 01:55:45.033551 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933345.0333464, 587a002a-2b9c-4865-8ce2-088ad567c81b => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:55:45.033708 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] VM Started (Lifecycle Event)
May 28 01:55:45.040234 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:55:45.208119 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:45.221745 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Object Instance<df5768dc-874f-4725-b2a2-e007aebc11a9> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices,ec2_ids {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:55:45.222631 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Lazy-loading 'keypairs' on Instance uuid df5768dc-874f-4725-b2a2-e007aebc11a9 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:55:45.246463 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:45.248974 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Successfully updated port: 7567636b-7225-4025-b9f0-d4c8eb5abe43 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:55:45.314581 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-4756e7ad-40fa-41ef-9f58-887931b19b5e req-6cba01ad-426c-4b3f-953e-cf245c35ff43 service nova] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Received event network-vif-plugged-6ddf64a7-099d-4ef6-8dfc-7377446b66f7 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:45.315264 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-4756e7ad-40fa-41ef-9f58-887931b19b5e req-6cba01ad-426c-4b3f-953e-cf245c35ff43 service nova] Acquiring lock "587a002a-2b9c-4865-8ce2-088ad567c81b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:45.315264 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-4756e7ad-40fa-41ef-9f58-887931b19b5e req-6cba01ad-426c-4b3f-953e-cf245c35ff43 service nova] Lock "587a002a-2b9c-4865-8ce2-088ad567c81b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:45.315407 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-4756e7ad-40fa-41ef-9f58-887931b19b5e req-6cba01ad-426c-4b3f-953e-cf245c35ff43 service nova] Lock "587a002a-2b9c-4865-8ce2-088ad567c81b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:45.315570 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-4756e7ad-40fa-41ef-9f58-887931b19b5e req-6cba01ad-426c-4b3f-953e-cf245c35ff43 service nova] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] No waiting events found dispatching network-vif-plugged-6ddf64a7-099d-4ef6-8dfc-7377446b66f7 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:55:45.315967 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-4756e7ad-40fa-41ef-9f58-887931b19b5e req-6cba01ad-426c-4b3f-953e-cf245c35ff43 service nova] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Received unexpected event network-vif-plugged-6ddf64a7-099d-4ef6-8dfc-7377446b66f7 for instance with vm_state active and task_state None.
May 28 01:55:45.329106 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5204310f-e2a1-45f8-b6a7-0f78fbbb6b9c req-e536a5f9-af45-4ee9-aff9-0d711ae45d6a service nova] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Received event network-changed-7567636b-7225-4025-b9f0-d4c8eb5abe43 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:45.329106 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5204310f-e2a1-45f8-b6a7-0f78fbbb6b9c req-e536a5f9-af45-4ee9-aff9-0d711ae45d6a service nova] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Refreshing instance network info cache due to event network-changed-7567636b-7225-4025-b9f0-d4c8eb5abe43. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:55:45.329106 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5204310f-e2a1-45f8-b6a7-0f78fbbb6b9c req-e536a5f9-af45-4ee9-aff9-0d711ae45d6a service nova] Acquiring lock "refresh_cache-7078fbb1-fa4a-4589-9f95-9d95dee381e0" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:55:45.329106 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5204310f-e2a1-45f8-b6a7-0f78fbbb6b9c req-e536a5f9-af45-4ee9-aff9-0d711ae45d6a service nova] Acquired lock "refresh_cache-7078fbb1-fa4a-4589-9f95-9d95dee381e0" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:55:45.329106 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-5204310f-e2a1-45f8-b6a7-0f78fbbb6b9c req-e536a5f9-af45-4ee9-aff9-0d711ae45d6a service nova] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Refreshing network info cache for port 7567636b-7225-4025-b9f0-d4c8eb5abe43 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:55:45.342335 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:45.412106 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:45.415565 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:45.538494 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:55:45.540674 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:55:45.550117 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:45.550117 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:45.550457 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Trying to apply a migration context that does not seem to be set for this instance {{(pid=98241) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1074}}
May 28 01:55:45.558104 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:55:45.558276 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:55:45.558518 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Creating image(s)
May 28 01:55:45.559744 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Acquiring lock "/opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:45.559973 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "/opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:45.560715 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "/opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:45.562142 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:55:45.565032 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:55:45.566747 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:45.673252 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.106s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:45.676287 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:45.676287 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:45.676287 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:55:45.680579 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:55:45.681024 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:45.731509 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Object Instance<df5768dc-874f-4725-b2a2-e007aebc11a9> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:55:45.742303 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:45.753091 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Acquiring lock "refresh_cache-7078fbb1-fa4a-4589-9f95-9d95dee381e0" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:55:45.796381 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2f68f8cc-37ed-4652-a19c-d9f8519cffcf req-49cb3ca7-9cd6-484c-a593-4af75ffbf67c service nova] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Received event network-vif-unplugged-b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:45.796602 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2f68f8cc-37ed-4652-a19c-d9f8519cffcf req-49cb3ca7-9cd6-484c-a593-4af75ffbf67c service nova] Acquiring lock "533f5dcc-2e48-4280-84b3-facb02dea136-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:45.796772 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2f68f8cc-37ed-4652-a19c-d9f8519cffcf req-49cb3ca7-9cd6-484c-a593-4af75ffbf67c service nova] Lock "533f5dcc-2e48-4280-84b3-facb02dea136-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:45.796908 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2f68f8cc-37ed-4652-a19c-d9f8519cffcf req-49cb3ca7-9cd6-484c-a593-4af75ffbf67c service nova] Lock "533f5dcc-2e48-4280-84b3-facb02dea136-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:45.797018 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2f68f8cc-37ed-4652-a19c-d9f8519cffcf req-49cb3ca7-9cd6-484c-a593-4af75ffbf67c service nova] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] No waiting events found dispatching network-vif-unplugged-b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:55:45.797161 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-2f68f8cc-37ed-4652-a19c-d9f8519cffcf req-49cb3ca7-9cd6-484c-a593-4af75ffbf67c service nova] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Received unexpected event network-vif-unplugged-b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e for instance with vm_state rescued and task_state unrescuing.
May 28 01:55:45.797256 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2f68f8cc-37ed-4652-a19c-d9f8519cffcf req-49cb3ca7-9cd6-484c-a593-4af75ffbf67c service nova] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Received event network-vif-unplugged-b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:45.797367 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2f68f8cc-37ed-4652-a19c-d9f8519cffcf req-49cb3ca7-9cd6-484c-a593-4af75ffbf67c service nova] Acquiring lock "533f5dcc-2e48-4280-84b3-facb02dea136-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:45.797486 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2f68f8cc-37ed-4652-a19c-d9f8519cffcf req-49cb3ca7-9cd6-484c-a593-4af75ffbf67c service nova] Lock "533f5dcc-2e48-4280-84b3-facb02dea136-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:45.797612 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2f68f8cc-37ed-4652-a19c-d9f8519cffcf req-49cb3ca7-9cd6-484c-a593-4af75ffbf67c service nova] Lock "533f5dcc-2e48-4280-84b3-facb02dea136-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:45.797718 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2f68f8cc-37ed-4652-a19c-d9f8519cffcf req-49cb3ca7-9cd6-484c-a593-4af75ffbf67c service nova] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] No waiting events found dispatching network-vif-unplugged-b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:55:45.797825 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-2f68f8cc-37ed-4652-a19c-d9f8519cffcf req-49cb3ca7-9cd6-484c-a593-4af75ffbf67c service nova] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Received unexpected event network-vif-unplugged-b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e for instance with vm_state rescued and task_state unrescuing.
May 28 01:55:45.797937 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2f68f8cc-37ed-4652-a19c-d9f8519cffcf req-49cb3ca7-9cd6-484c-a593-4af75ffbf67c service nova] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Received event network-vif-plugged-b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:45.798050 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2f68f8cc-37ed-4652-a19c-d9f8519cffcf req-49cb3ca7-9cd6-484c-a593-4af75ffbf67c service nova] Acquiring lock "533f5dcc-2e48-4280-84b3-facb02dea136-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:45.799129 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2f68f8cc-37ed-4652-a19c-d9f8519cffcf req-49cb3ca7-9cd6-484c-a593-4af75ffbf67c service nova] Lock "533f5dcc-2e48-4280-84b3-facb02dea136-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:45.800126 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2f68f8cc-37ed-4652-a19c-d9f8519cffcf req-49cb3ca7-9cd6-484c-a593-4af75ffbf67c service nova] Lock "533f5dcc-2e48-4280-84b3-facb02dea136-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:45.800265 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2f68f8cc-37ed-4652-a19c-d9f8519cffcf req-49cb3ca7-9cd6-484c-a593-4af75ffbf67c service nova] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] No waiting events found dispatching network-vif-plugged-b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:55:45.801291 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-2f68f8cc-37ed-4652-a19c-d9f8519cffcf req-49cb3ca7-9cd6-484c-a593-4af75ffbf67c service nova] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Received unexpected event network-vif-plugged-b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e for instance with vm_state rescued and task_state unrescuing.
May 28 01:55:45.801400 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2f68f8cc-37ed-4652-a19c-d9f8519cffcf req-49cb3ca7-9cd6-484c-a593-4af75ffbf67c service nova] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Received event network-vif-plugged-b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:45.801598 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2f68f8cc-37ed-4652-a19c-d9f8519cffcf req-49cb3ca7-9cd6-484c-a593-4af75ffbf67c service nova] Acquiring lock "533f5dcc-2e48-4280-84b3-facb02dea136-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:45.802647 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2f68f8cc-37ed-4652-a19c-d9f8519cffcf req-49cb3ca7-9cd6-484c-a593-4af75ffbf67c service nova] Lock "533f5dcc-2e48-4280-84b3-facb02dea136-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:45.802817 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2f68f8cc-37ed-4652-a19c-d9f8519cffcf req-49cb3ca7-9cd6-484c-a593-4af75ffbf67c service nova] Lock "533f5dcc-2e48-4280-84b3-facb02dea136-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:45.803822 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2f68f8cc-37ed-4652-a19c-d9f8519cffcf req-49cb3ca7-9cd6-484c-a593-4af75ffbf67c service nova] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] No waiting events found dispatching network-vif-plugged-b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:55:45.804121 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-2f68f8cc-37ed-4652-a19c-d9f8519cffcf req-49cb3ca7-9cd6-484c-a593-4af75ffbf67c service nova] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Received unexpected event network-vif-plugged-b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e for instance with vm_state rescued and task_state unrescuing.
May 28 01:55:45.805136 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.124s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:45.806238 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:45.833144 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-5204310f-e2a1-45f8-b6a7-0f78fbbb6b9c req-e536a5f9-af45-4ee9-aff9-0d711ae45d6a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:45.871673 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0/disk 1073741824" returned: 0 in 0.065s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:45.874407 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:45.874407 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:45.944812 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Creating config drive at /opt/stack/data/nova/instances/df5768dc-874f-4725-b2a2-e007aebc11a9/disk.config
May 28 01:55:45.948789 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/df5768dc-874f-4725-b2a2-e007aebc11a9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpo9ollhoh {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:45.969337 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-5204310f-e2a1-45f8-b6a7-0f78fbbb6b9c req-e536a5f9-af45-4ee9-aff9-0d711ae45d6a service nova] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:55:45.987998 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.115s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:45.989651 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:55:45.991127 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:46.011877 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/df5768dc-874f-4725-b2a2-e007aebc11a9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpo9ollhoh" returned: 0 in 0.061s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:46.047231 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999143081000057 future=<Future at 0x7724ec17d0a0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:55:46.047563 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.996444340000153 future=<Future at 0x7724ec17d0a0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:55:46.047663 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.99632957200015 future=<Future at 0x7724ec17d0a0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:55:46.082543 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:46.082912 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Cannot resize image /opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:55:46.083237 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:55:46.083416 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Ensure instance console log exists: /opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:55:46.092099 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:46.092099 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:46.092099 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:46.159702 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-5204310f-e2a1-45f8-b6a7-0f78fbbb6b9c req-e536a5f9-af45-4ee9-aff9-0d711ae45d6a service nova] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:55:46.176493 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Removed pending STOPPED event for 533f5dcc-2e48-4280-84b3-facb02dea136 due to new event <LifecycleEvent: 1779933346.1761568, 533f5dcc-2e48-4280-84b3-facb02dea136 => Resumed> {{(pid=98241) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 01:55:46.176628 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933346.1761568, 533f5dcc-2e48-4280-84b3-facb02dea136 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:55:46.176753 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] VM Resumed (Lifecycle Event)
May 28 01:55:46.179475 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-54ef8ccc-e54a-419d-b456-0f1744e02803 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:55:46.468101 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:46.504133 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:46.507384 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:46.563442 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-aee879cb-5518-4221-83a1-0a6a214303ad tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 1.012s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:46.597143 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:46.661057 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5204310f-e2a1-45f8-b6a7-0f78fbbb6b9c req-e536a5f9-af45-4ee9-aff9-0d711ae45d6a service nova] Releasing lock "refresh_cache-7078fbb1-fa4a-4589-9f95-9d95dee381e0" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:55:46.661762 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Acquired lock "refresh_cache-7078fbb1-fa4a-4589-9f95-9d95dee381e0" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:55:46.662538 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:55:46.679704 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:55:46.685260 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:55:46.892491 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:46.896067 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:46.904791 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:46.904791 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:46.942920 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:47.190458 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933347.190133, 533f5dcc-2e48-4280-84b3-facb02dea136 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:55:47.190702 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] VM Started (Lifecycle Event)
May 28 01:55:47.252220 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:55:47.493095 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:47.657278 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:47.682433 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Updating instance_info_cache with network_info: [{"id": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "address": "fa:16:3e:30:bd:e8", "network": {"id": "11b2c699-14f1-4eba-bbe6-b7655c6f17cc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1044342879-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2db0b9fa3fcc47408dad261c2004e4a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7567636b-72", "ovs_interfaceid": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:55:47.694021 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:55:47.697063 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:55:47.879703 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b1d5360a-4879-4327-ae8e-68a5b4d5c376 req-8cac3088-a70c-4c1f-ab8d-13aa0b9016ab service nova] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Received event network-vif-plugged-d6c3c5f3-e20b-4b3e-abac-62f21007a7ad {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:47.880391 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b1d5360a-4879-4327-ae8e-68a5b4d5c376 req-8cac3088-a70c-4c1f-ab8d-13aa0b9016ab service nova] Acquiring lock "df5768dc-874f-4725-b2a2-e007aebc11a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:47.880628 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b1d5360a-4879-4327-ae8e-68a5b4d5c376 req-8cac3088-a70c-4c1f-ab8d-13aa0b9016ab service nova] Lock "df5768dc-874f-4725-b2a2-e007aebc11a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:47.880872 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b1d5360a-4879-4327-ae8e-68a5b4d5c376 req-8cac3088-a70c-4c1f-ab8d-13aa0b9016ab service nova] Lock "df5768dc-874f-4725-b2a2-e007aebc11a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:47.881235 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b1d5360a-4879-4327-ae8e-68a5b4d5c376 req-8cac3088-a70c-4c1f-ab8d-13aa0b9016ab service nova] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Processing event network-vif-plugged-d6c3c5f3-e20b-4b3e-abac-62f21007a7ad {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:55:47.881235 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b1d5360a-4879-4327-ae8e-68a5b4d5c376 req-8cac3088-a70c-4c1f-ab8d-13aa0b9016ab service nova] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Received event network-vif-plugged-d6c3c5f3-e20b-4b3e-abac-62f21007a7ad {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:47.881399 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b1d5360a-4879-4327-ae8e-68a5b4d5c376 req-8cac3088-a70c-4c1f-ab8d-13aa0b9016ab service nova] Acquiring lock "df5768dc-874f-4725-b2a2-e007aebc11a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:47.881627 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b1d5360a-4879-4327-ae8e-68a5b4d5c376 req-8cac3088-a70c-4c1f-ab8d-13aa0b9016ab service nova] Lock "df5768dc-874f-4725-b2a2-e007aebc11a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:47.881627 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b1d5360a-4879-4327-ae8e-68a5b4d5c376 req-8cac3088-a70c-4c1f-ab8d-13aa0b9016ab service nova] Lock "df5768dc-874f-4725-b2a2-e007aebc11a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:47.882653 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b1d5360a-4879-4327-ae8e-68a5b4d5c376 req-8cac3088-a70c-4c1f-ab8d-13aa0b9016ab service nova] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] No waiting events found dispatching network-vif-plugged-d6c3c5f3-e20b-4b3e-abac-62f21007a7ad {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:55:47.882653 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-b1d5360a-4879-4327-ae8e-68a5b4d5c376 req-8cac3088-a70c-4c1f-ab8d-13aa0b9016ab service nova] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Received unexpected event network-vif-plugged-d6c3c5f3-e20b-4b3e-abac-62f21007a7ad for instance with vm_state shelved_offloaded and task_state spawning.
May 28 01:55:47.882653 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:55:47.884942 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:55:47.888324 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Instance spawned successfully.
May 28 01:55:47.888938 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:55:48.005553 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:48.126472 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "45a73c95-ff10-4b74-9ab8-4014a244a7d3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:48.126472 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "45a73c95-ff10-4b74-9ab8-4014a244a7d3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:48.184687 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Releasing lock "refresh_cache-7078fbb1-fa4a-4589-9f95-9d95dee381e0" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:55:48.185226 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Instance network_info: |[{"id": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "address": "fa:16:3e:30:bd:e8", "network": {"id": "11b2c699-14f1-4eba-bbe6-b7655c6f17cc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1044342879-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2db0b9fa3fcc47408dad261c2004e4a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7567636b-72", "ovs_interfaceid": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:55:48.187697 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Start _get_guest_xml network_info=[{"id": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "address": "fa:16:3e:30:bd:e8", "network": {"id": "11b2c699-14f1-4eba-bbe6-b7655c6f17cc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1044342879-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2db0b9fa3fcc47408dad261c2004e4a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7567636b-72", "ovs_interfaceid": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:55:48.190705 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:55:48.191845 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-1792038090', uuid='7078fbb1-fa4a-4589-9f95-9d95dee381e0'), owner=OwnerMeta(userid='8f68ae604d0442439a927020cec740c0', username='tempest-ServerActionsTestOtherB-640844130-project-member', projectid='2db0b9fa3fcc47408dad261c2004e4a5', projectname='tempest-ServerActionsTestOtherB-640844130'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "address": "fa:16:3e:30:bd:e8", "network": {"id": "11b2c699-14f1-4eba-bbe6-b7655c6f17cc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1044342879-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2db0b9fa3fcc47408dad261c2004e4a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7567636b-72", "ovs_interfaceid": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933348.1913776) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:55:48.192999 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:55:48.193478 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:55:48.194563 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:55:48.194767 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:55:48.195949 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:55:48.197782 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:55:48.197782 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:55:48.197782 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:55:48.197782 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:55:48.197782 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:55:48.197782 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:55:48.197782 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:55:48.197782 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:55:48.197782 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:55:48.197782 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:55:48.198261 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:55:48.208714 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933348.2081592, df5768dc-874f-4725-b2a2-e007aebc11a9 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:55:48.208714 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] VM Started (Lifecycle Event)
May 28 01:55:48.215216 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:55:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1792038090',display_name='tempest-ServerActionsTestOtherB-server-1792038090',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-serveractionstestotherb-server-1792038090',id=21,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNeqI2aR1ssi4HNJOeFKCNjp+Pt+IJYlcdzP/eafAClJj6eROY4EAGFoc44ZS4UJO1qzGM7qaA7m9ha8h0zhGTrn53zFMwGuQ42KOAfa++4mKlE3DbzUB8ddEdTJR9n/hA==',key_name='tempest-keypair-738336147',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2db0b9fa3fcc47408dad261c2004e4a5',ramdisk_id='',reservation_id='r-aqj2v230',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-640844130',owner_user_name='tempest-ServerActionsTestOtherB-640844130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:55:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f68ae604d0442439a927020cec740c0',uuid=7078fbb1-fa4a-4589-9f95-9d95dee381e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "address": "fa:16:3e:30:bd:e8", "network": {"id": "11b2c699-14f1-4eba-bbe6-b7655c6f17cc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1044342879-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2db0b9fa3fcc47408dad261c2004e4a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7567636b-72", "ovs_interfaceid": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:55:48.215426 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Converting VIF {"id": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "address": "fa:16:3e:30:bd:e8", "network": {"id": "11b2c699-14f1-4eba-bbe6-b7655c6f17cc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1044342879-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2db0b9fa3fcc47408dad261c2004e4a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7567636b-72", "ovs_interfaceid": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:55:48.216157 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:bd:e8,bridge_name='br-int',has_traffic_filtering=True,id=7567636b-7225-4025-b9f0-d4c8eb5abe43,network=Network(11b2c699-14f1-4eba-bbe6-b7655c6f17cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7567636b-72') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:55:48.217670 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lazy-loading 'pci_devices' on Instance uuid 7078fbb1-fa4a-4589-9f95-9d95dee381e0 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:55:48.400712 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6ee279a0-c0bc-44e7-aabb-84fd09bd61a4 tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Lock "df5768dc-874f-4725-b2a2-e007aebc11a9" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 20.508s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:48.628738 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:55:48.712074 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:55:48.716776 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:55:48.720337 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] End _get_guest_xml xml=<domain type="qemu">
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:   <uuid>7078fbb1-fa4a-4589-9f95-9d95dee381e0</uuid>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:   <name>instance-00000015</name>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:       <nova:name>tempest-ServerActionsTestOtherB-server-1792038090</nova:name>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:55:48</nova:creationTime>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:         <nova:user uuid="8f68ae604d0442439a927020cec740c0">tempest-ServerActionsTestOtherB-640844130-project-member</nova:user>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:         <nova:project uuid="2db0b9fa3fcc47408dad261c2004e4a5">tempest-ServerActionsTestOtherB-640844130</nova:project>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:         <nova:port uuid="7567636b-7225-4025-b9f0-d4c8eb5abe43">
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:     <system>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:       <entry name="serial">7078fbb1-fa4a-4589-9f95-9d95dee381e0</entry>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:       <entry name="uuid">7078fbb1-fa4a-4589-9f95-9d95dee381e0</entry>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:     </system>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:   <os>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:   </os>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:   <features>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:   </features>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:   <devices>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0/disk"/>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:     </disk>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0/disk.config"/>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:     </disk>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:30:bd:e8"/>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:       <target dev="tap7567636b-72"/>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:     </interface>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0/console.log" append="off"/>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:     </serial>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:     <video>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:     </video>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:     </rng>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:   </devices>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]: </domain>
May 28 01:55:48.720337 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:55:48.723167 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Preparing to wait for external event network-vif-plugged-7567636b-7225-4025-b9f0-d4c8eb5abe43 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:55:48.723167 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Acquiring lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:48.723167 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:48.723167 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:48.725588 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:55:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1792038090',display_name='tempest-ServerActionsTestOtherB-server-1792038090',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-serveractionstestotherb-server-1792038090',id=21,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNeqI2aR1ssi4HNJOeFKCNjp+Pt+IJYlcdzP/eafAClJj6eROY4EAGFoc44ZS4UJO1qzGM7qaA7m9ha8h0zhGTrn53zFMwGuQ42KOAfa++4mKlE3DbzUB8ddEdTJR9n/hA==',key_name='tempest-keypair-738336147',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2db0b9fa3fcc47408dad261c2004e4a5',ramdisk_id='',reservation_id='r-aqj2v230',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-640844130',owner_user_name='tempest-ServerActionsTestOtherB-640844130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:55:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f68ae604d0442439a927020cec740c0',uuid=7078fbb1-fa4a-4589-9f95-9d95dee381e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "address": "fa:16:3e:30:bd:e8", "network": {"id": "11b2c699-14f1-4eba-bbe6-b7655c6f17cc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1044342879-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2db0b9fa3fcc47408dad261c2004e4a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7567636b-72", "ovs_interfaceid": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:55:48.725805 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Converting VIF {"id": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "address": "fa:16:3e:30:bd:e8", "network": {"id": "11b2c699-14f1-4eba-bbe6-b7655c6f17cc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1044342879-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2db0b9fa3fcc47408dad261c2004e4a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7567636b-72", "ovs_interfaceid": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:55:48.726623 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:bd:e8,bridge_name='br-int',has_traffic_filtering=True,id=7567636b-7225-4025-b9f0-d4c8eb5abe43,network=Network(11b2c699-14f1-4eba-bbe6-b7655c6f17cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7567636b-72') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:55:48.727518 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:bd:e8,bridge_name='br-int',has_traffic_filtering=True,id=7567636b-7225-4025-b9f0-d4c8eb5abe43,network=Network(11b2c699-14f1-4eba-bbe6-b7655c6f17cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7567636b-72') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:55:48.727518 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:48.727874 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:48.728420 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:55:48.730539 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:48.730780 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '15af2633-77b4-5bbb-af75-e68dce2f4585', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:48.731668 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:48.732498 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:55:48.737104 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:48.740926 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:48.741382 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7567636b-72, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:48.741760 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7567636b-72, col_values=(('qos', UUID('746878da-74c9-482f-9afb-e8561bf6e119')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:48.741967 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7567636b-72, col_values=(('external_ids', {'iface-id': '7567636b-7225-4025-b9f0-d4c8eb5abe43', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:bd:e8', 'vm-uuid': '7078fbb1-fa4a-4589-9f95-9d95dee381e0'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:48.744098 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:48.746424 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:55:48.753462 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:48.755309 np0000001583 nova-compute[98241]: INFO os_vif [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:bd:e8,bridge_name='br-int',has_traffic_filtering=True,id=7567636b-7225-4025-b9f0-d4c8eb5abe43,network=Network(11b2c699-14f1-4eba-bbe6-b7655c6f17cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7567636b-72')
May 28 01:55:49.190939 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:49.191437 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:49.195056 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:55:49.195345 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Claim successful on node np0000001583
May 28 01:55:49.216304 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933349.21599, df5768dc-874f-4725-b2a2-e007aebc11a9 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:55:49.216476 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] VM Paused (Lifecycle Event)
May 28 01:55:49.719093 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:55:49.720634 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933349.7204053, df5768dc-874f-4725-b2a2-e007aebc11a9 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:55:49.720818 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] VM Resumed (Lifecycle Event)
May 28 01:55:50.222968 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:55:50.226673 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:55:50.276263 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:55:50.276418 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:55:50.276582 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] No VIF found with MAC fa:16:3e:30:bd:e8, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:55:50.276958 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Using config drive
May 28 01:55:50.783843 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:50.898739 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:55:50.898739 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:55:50.970105 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Creating config drive at /opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0/disk.config
May 28 01:55:50.975977 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1_4hzu5m {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:51.035013 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1_4hzu5m" returned: 0 in 0.059s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:51.404129 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:55:51.585716 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:51.617232 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:51.620868 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:51.733201 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:51.894195 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b7bb419c-2076-4d9a-aa29-11c2240c5b22 req-8c83bebf-5456-4c00-b4fb-89cc9419faff service nova] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Received event network-vif-plugged-7567636b-7225-4025-b9f0-d4c8eb5abe43 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:51.894332 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b7bb419c-2076-4d9a-aa29-11c2240c5b22 req-8c83bebf-5456-4c00-b4fb-89cc9419faff service nova] Acquiring lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:51.894636 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b7bb419c-2076-4d9a-aa29-11c2240c5b22 req-8c83bebf-5456-4c00-b4fb-89cc9419faff service nova] Lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:51.895161 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b7bb419c-2076-4d9a-aa29-11c2240c5b22 req-8c83bebf-5456-4c00-b4fb-89cc9419faff service nova] Lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:51.895345 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b7bb419c-2076-4d9a-aa29-11c2240c5b22 req-8c83bebf-5456-4c00-b4fb-89cc9419faff service nova] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Processing event network-vif-plugged-7567636b-7225-4025-b9f0-d4c8eb5abe43 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:55:51.921003 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.730s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:51.921652 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:55:52.051039 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:52.059270 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:52.066796 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:52.094629 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:52.433572 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:55:52.434177 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:55:52.434177 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:52.434511 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:52.560785 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c3a7b14e31ee40cf9e4f4bba084ccaa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba381dad8364a488a98b80c04cce8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:55:52.767350 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933352.7668824, 7078fbb1-fa4a-4589-9f95-9d95dee381e0 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:55:52.767764 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:55:52.767904 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] VM Started (Lifecycle Event)
May 28 01:55:52.772951 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:55:52.776362 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Instance spawned successfully.
May 28 01:55:52.776772 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:55:52.938543 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:55:53.009681 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:53.118727 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Successfully created port: 463c33b4-3468-4b31-b611-3ab977c91c1c {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:55:53.272881 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:55:53.280187 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:55:53.289368 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:55:53.289481 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:55:53.290303 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:55:53.290303 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:55:53.290303 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:55:53.290537 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:55:53.441952 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:55:53.755229 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:53.784858 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:55:53.785236 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933353.784948, 7078fbb1-fa4a-4589-9f95-9d95dee381e0 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:55:53.785408 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] VM Paused (Lifecycle Event)
May 28 01:55:53.800450 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Took 8.24 seconds to spawn the instance on the hypervisor.
May 28 01:55:53.800710 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:55:53.832104 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Successfully updated port: 463c33b4-3468-4b31-b611-3ab977c91c1c {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:55:53.986771 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0ddb1186-a756-431e-b571-56553bfa02b6 req-b569c595-c692-4b55-88d9-fc02a26782d7 service nova] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Received event network-vif-plugged-7567636b-7225-4025-b9f0-d4c8eb5abe43 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:53.986998 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0ddb1186-a756-431e-b571-56553bfa02b6 req-b569c595-c692-4b55-88d9-fc02a26782d7 service nova] Acquiring lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:53.987240 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0ddb1186-a756-431e-b571-56553bfa02b6 req-b569c595-c692-4b55-88d9-fc02a26782d7 service nova] Lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:53.987447 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0ddb1186-a756-431e-b571-56553bfa02b6 req-b569c595-c692-4b55-88d9-fc02a26782d7 service nova] Lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:53.987623 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0ddb1186-a756-431e-b571-56553bfa02b6 req-b569c595-c692-4b55-88d9-fc02a26782d7 service nova] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] No waiting events found dispatching network-vif-plugged-7567636b-7225-4025-b9f0-d4c8eb5abe43 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:55:53.994173 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-0ddb1186-a756-431e-b571-56553bfa02b6 req-b569c595-c692-4b55-88d9-fc02a26782d7 service nova] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Received unexpected event network-vif-plugged-7567636b-7225-4025-b9f0-d4c8eb5abe43 for instance with vm_state active and task_state None.
May 28 01:55:53.994173 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0ddb1186-a756-431e-b571-56553bfa02b6 req-b569c595-c692-4b55-88d9-fc02a26782d7 service nova] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Received event network-changed-463c33b4-3468-4b31-b611-3ab977c91c1c {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:53.994173 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0ddb1186-a756-431e-b571-56553bfa02b6 req-b569c595-c692-4b55-88d9-fc02a26782d7 service nova] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Refreshing instance network info cache due to event network-changed-463c33b4-3468-4b31-b611-3ab977c91c1c. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:55:53.994173 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0ddb1186-a756-431e-b571-56553bfa02b6 req-b569c595-c692-4b55-88d9-fc02a26782d7 service nova] Acquiring lock "refresh_cache-45a73c95-ff10-4b74-9ab8-4014a244a7d3" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:55:53.994173 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0ddb1186-a756-431e-b571-56553bfa02b6 req-b569c595-c692-4b55-88d9-fc02a26782d7 service nova] Acquired lock "refresh_cache-45a73c95-ff10-4b74-9ab8-4014a244a7d3" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:55:53.994173 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-0ddb1186-a756-431e-b571-56553bfa02b6 req-b569c595-c692-4b55-88d9-fc02a26782d7 service nova] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Refreshing network info cache for port 463c33b4-3468-4b31-b611-3ab977c91c1c {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:55:54.293428 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:55:54.294964 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933354.294674, 7078fbb1-fa4a-4589-9f95-9d95dee381e0 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:55:54.295215 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] VM Resumed (Lifecycle Event)
May 28 01:55:54.316458 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Took 13.93 seconds to build instance.
May 28 01:55:54.334456 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "refresh_cache-45a73c95-ff10-4b74-9ab8-4014a244a7d3" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:55:54.456802 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:55:54.457977 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:55:54.458598 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Creating image(s)
May 28 01:55:54.459271 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "/opt/stack/data/nova/instances/45a73c95-ff10-4b74-9ab8-4014a244a7d3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:54.459530 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "/opt/stack/data/nova/instances/45a73c95-ff10-4b74-9ab8-4014a244a7d3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:54.460184 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "/opt/stack/data/nova/instances/45a73c95-ff10-4b74-9ab8-4014a244a7d3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:54.460971 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:55:54.465579 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:55:54.470214 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:54.500041 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-0ddb1186-a756-431e-b571-56553bfa02b6 req-b569c595-c692-4b55-88d9-fc02a26782d7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:54.566338 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.096s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:54.567475 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:54.567995 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:54.569616 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:55:54.573248 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:55:54.573985 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:54.595975 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-0ddb1186-a756-431e-b571-56553bfa02b6 req-b569c595-c692-4b55-88d9-fc02a26782d7 service nova] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:55:54.686783 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.113s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:54.687447 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/45a73c95-ff10-4b74-9ab8-4014a244a7d3/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:54.752032 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/45a73c95-ff10-4b74-9ab8-4014a244a7d3/disk 1073741824" returned: 0 in 0.064s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:54.752729 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.185s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:54.753202 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:54.795148 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-0ddb1186-a756-431e-b571-56553bfa02b6 req-b569c595-c692-4b55-88d9-fc02a26782d7 service nova] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:55:54.798536 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:55:54.806641 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:55:54.819431 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.446s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:54.852829 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.099s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:54.856106 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Checking if we can resize image /opt/stack/data/nova/instances/45a73c95-ff10-4b74-9ab8-4014a244a7d3/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:55:54.856106 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a73c95-ff10-4b74-9ab8-4014a244a7d3/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:54.947955 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a73c95-ff10-4b74-9ab8-4014a244a7d3/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:54.948609 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Cannot resize image /opt/stack/data/nova/instances/45a73c95-ff10-4b74-9ab8-4014a244a7d3/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:55:54.949198 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:55:54.949443 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Ensure instance console log exists: /opt/stack/data/nova/instances/45a73c95-ff10-4b74-9ab8-4014a244a7d3/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:55:54.949834 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:54.950148 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:54.950357 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:55.297901 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0ddb1186-a756-431e-b571-56553bfa02b6 req-b569c595-c692-4b55-88d9-fc02a26782d7 service nova] Releasing lock "refresh_cache-45a73c95-ff10-4b74-9ab8-4014a244a7d3" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:55:55.299480 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquired lock "refresh_cache-45a73c95-ff10-4b74-9ab8-4014a244a7d3" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:55:55.299480 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:55:55.887049 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:55:55.921314 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-dcb484ee-420d-49a1-bca7-3c813c96cbdb req-6bcb03d6-39c1-4893-9932-eb16bde6598a service nova] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Received event network-changed-7567636b-7225-4025-b9f0-d4c8eb5abe43 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:55:55.921909 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-dcb484ee-420d-49a1-bca7-3c813c96cbdb req-6bcb03d6-39c1-4893-9932-eb16bde6598a service nova] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Refreshing instance network info cache due to event network-changed-7567636b-7225-4025-b9f0-d4c8eb5abe43. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:55:55.921909 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-dcb484ee-420d-49a1-bca7-3c813c96cbdb req-6bcb03d6-39c1-4893-9932-eb16bde6598a service nova] Acquiring lock "refresh_cache-7078fbb1-fa4a-4589-9f95-9d95dee381e0" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:55:55.922025 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-dcb484ee-420d-49a1-bca7-3c813c96cbdb req-6bcb03d6-39c1-4893-9932-eb16bde6598a service nova] Acquired lock "refresh_cache-7078fbb1-fa4a-4589-9f95-9d95dee381e0" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:55:55.922429 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-dcb484ee-420d-49a1-bca7-3c813c96cbdb req-6bcb03d6-39c1-4893-9932-eb16bde6598a service nova] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Refreshing network info cache for port 7567636b-7225-4025-b9f0-d4c8eb5abe43 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:55:56.083423 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:56.154911 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-7dced259-ef34-43f0-96e6-ab1f7097328e tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:55:56.274442 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Updating instance_info_cache with network_info: [{"id": "463c33b4-3468-4b31-b611-3ab977c91c1c", "address": "fa:16:3e:20:92:ee", "network": {"id": "2ee43c4e-569f-4726-9700-add40d768203", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ba381dad8364a488a98b80c04cce8fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap463c33b4-34", "ovs_interfaceid": "463c33b4-3468-4b31-b611-3ab977c91c1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:55:56.427991 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-dcb484ee-420d-49a1-bca7-3c813c96cbdb req-6bcb03d6-39c1-4893-9932-eb16bde6598a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:56.665611 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-7dced259-ef34-43f0-96e6-ab1f7097328e tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] instance snapshotting
May 28 01:55:56.776589 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Releasing lock "refresh_cache-45a73c95-ff10-4b74-9ab8-4014a244a7d3" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:55:56.778365 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Instance network_info: |[{"id": "463c33b4-3468-4b31-b611-3ab977c91c1c", "address": "fa:16:3e:20:92:ee", "network": {"id": "2ee43c4e-569f-4726-9700-add40d768203", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ba381dad8364a488a98b80c04cce8fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap463c33b4-34", "ovs_interfaceid": "463c33b4-3468-4b31-b611-3ab977c91c1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:55:56.780038 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Start _get_guest_xml network_info=[{"id": "463c33b4-3468-4b31-b611-3ab977c91c1c", "address": "fa:16:3e:20:92:ee", "network": {"id": "2ee43c4e-569f-4726-9700-add40d768203", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ba381dad8364a488a98b80c04cce8fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap463c33b4-34", "ovs_interfaceid": "463c33b4-3468-4b31-b611-3ab977c91c1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:55:56.782307 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:55:56.784436 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-876652948', uuid='45a73c95-ff10-4b74-9ab8-4014a244a7d3'), owner=OwnerMeta(userid='c3a7b14e31ee40cf9e4f4bba084ccaa5', username='tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member', projectid='2ba381dad8364a488a98b80c04cce8fb', projectname='tempest-ServerBootFromVolumeStableRescueTest-1211567633'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "463c33b4-3468-4b31-b611-3ab977c91c1c", "address": "fa:16:3e:20:92:ee", "network": {"id": "2ee43c4e-569f-4726-9700-add40d768203", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ba381dad8364a488a98b80c04cce8fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap463c33b4-34", "ovs_interfaceid": "463c33b4-3468-4b31-b611-3ab977c91c1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933356.7835507) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:55:56.785512 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:55:56.785705 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:55:56.794203 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:55:56.794520 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:55:56.796050 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:55:56.796718 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:55:56.796928 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:55:56.797057 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:55:56.797292 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:55:56.797427 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:55:56.797574 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:55:56.797817 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:55:56.797982 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:55:56.798172 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:55:56.798347 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:55:56.798564 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:55:56.815117 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:55:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-876652948',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-serverbootfromvolumestablerescuetest-server-876652948',id=22,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ba381dad8364a488a98b80c04cce8fb',ramdisk_id='',reservation_id='r-oqy0fx76',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1211567633',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:55:53Z,user_data=None,user_id='c3a7b14e31ee40cf9e4f4bba084ccaa5',uuid=45a73c95-ff10-4b74-9ab8-4014a244a7d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "463c33b4-3468-4b31-b611-3ab977c91c1c", "address": "fa:16:3e:20:92:ee", "network": {"id": "2ee43c4e-569f-4726-9700-add40d768203", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ba381dad8364a488a98b80c04cce8fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap463c33b4-34", "ovs_interfaceid": "463c33b4-3468-4b31-b611-3ab977c91c1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:55:56.815638 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Converting VIF {"id": "463c33b4-3468-4b31-b611-3ab977c91c1c", "address": "fa:16:3e:20:92:ee", "network": {"id": "2ee43c4e-569f-4726-9700-add40d768203", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ba381dad8364a488a98b80c04cce8fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap463c33b4-34", "ovs_interfaceid": "463c33b4-3468-4b31-b611-3ab977c91c1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:55:56.816169 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:92:ee,bridge_name='br-int',has_traffic_filtering=True,id=463c33b4-3468-4b31-b611-3ab977c91c1c,network=Network(2ee43c4e-569f-4726-9700-add40d768203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap463c33b4-34') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:55:56.816939 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lazy-loading 'pci_devices' on Instance uuid 45a73c95-ff10-4b74-9ab8-4014a244a7d3 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:55:56.854564 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-7dced259-ef34-43f0-96e6-ab1f7097328e tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Beginning live snapshot process
May 28 01:55:56.878071 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-dcb484ee-420d-49a1-bca7-3c813c96cbdb req-6bcb03d6-39c1-4893-9932-eb16bde6598a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:57.069334 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-dcb484ee-420d-49a1-bca7-3c813c96cbdb req-6bcb03d6-39c1-4893-9932-eb16bde6598a service nova] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Updated VIF entry in instance network info cache for port 7567636b-7225-4025-b9f0-d4c8eb5abe43. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:55:57.069772 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-dcb484ee-420d-49a1-bca7-3c813c96cbdb req-6bcb03d6-39c1-4893-9932-eb16bde6598a service nova] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Updating instance_info_cache with network_info: [{"id": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "address": "fa:16:3e:30:bd:e8", "network": {"id": "11b2c699-14f1-4eba-bbe6-b7655c6f17cc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1044342879-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2db0b9fa3fcc47408dad261c2004e4a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7567636b-72", "ovs_interfaceid": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:55:57.321781 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] End _get_guest_xml xml=<domain type="qemu">
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:   <uuid>45a73c95-ff10-4b74-9ab8-4014a244a7d3</uuid>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:   <name>instance-00000016</name>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-876652948</nova:name>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:55:56</nova:creationTime>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:         <nova:user uuid="c3a7b14e31ee40cf9e4f4bba084ccaa5">tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member</nova:user>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:         <nova:project uuid="2ba381dad8364a488a98b80c04cce8fb">tempest-ServerBootFromVolumeStableRescueTest-1211567633</nova:project>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:         <nova:port uuid="463c33b4-3468-4b31-b611-3ab977c91c1c">
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:     <system>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:       <entry name="serial">45a73c95-ff10-4b74-9ab8-4014a244a7d3</entry>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:       <entry name="uuid">45a73c95-ff10-4b74-9ab8-4014a244a7d3</entry>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:     </system>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:   <os>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:   </os>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:   <features>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:   </features>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:   <devices>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/45a73c95-ff10-4b74-9ab8-4014a244a7d3/disk"/>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:     </disk>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/45a73c95-ff10-4b74-9ab8-4014a244a7d3/disk.config"/>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:     </disk>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:20:92:ee"/>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:       <target dev="tap463c33b4-34"/>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:     </interface>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/45a73c95-ff10-4b74-9ab8-4014a244a7d3/console.log" append="off"/>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:     </serial>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:     <video>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:     </video>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:     </rng>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:   </devices>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]: </domain>
May 28 01:55:57.321781 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:55:57.321781 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Preparing to wait for external event network-vif-plugged-463c33b4-3468-4b31-b611-3ab977c91c1c {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:55:57.321781 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "45a73c95-ff10-4b74-9ab8-4014a244a7d3-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:55:57.321781 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "45a73c95-ff10-4b74-9ab8-4014a244a7d3-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:55:57.321781 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "45a73c95-ff10-4b74-9ab8-4014a244a7d3-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:55:57.324926 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:55:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-876652948',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-serverbootfromvolumestablerescuetest-server-876652948',id=22,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ba381dad8364a488a98b80c04cce8fb',ramdisk_id='',reservation_id='r-oqy0fx76',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1211567633',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:55:53Z,user_data=None,user_id='c3a7b14e31ee40cf9e4f4bba084ccaa5',uuid=45a73c95-ff10-4b74-9ab8-4014a244a7d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "463c33b4-3468-4b31-b611-3ab977c91c1c", "address": "fa:16:3e:20:92:ee", "network": {"id": "2ee43c4e-569f-4726-9700-add40d768203", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ba381dad8364a488a98b80c04cce8fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap463c33b4-34", "ovs_interfaceid": "463c33b4-3468-4b31-b611-3ab977c91c1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:55:57.324926 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Converting VIF {"id": "463c33b4-3468-4b31-b611-3ab977c91c1c", "address": "fa:16:3e:20:92:ee", "network": {"id": "2ee43c4e-569f-4726-9700-add40d768203", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ba381dad8364a488a98b80c04cce8fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap463c33b4-34", "ovs_interfaceid": "463c33b4-3468-4b31-b611-3ab977c91c1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:55:57.324926 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:92:ee,bridge_name='br-int',has_traffic_filtering=True,id=463c33b4-3468-4b31-b611-3ab977c91c1c,network=Network(2ee43c4e-569f-4726-9700-add40d768203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap463c33b4-34') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:55:57.324926 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:92:ee,bridge_name='br-int',has_traffic_filtering=True,id=463c33b4-3468-4b31-b611-3ab977c91c1c,network=Network(2ee43c4e-569f-4726-9700-add40d768203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap463c33b4-34') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:55:57.324926 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:57.324926 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:57.324926 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:55:57.327767 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:57.327767 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b6cce7a8-7f56-50c2-9268-43510e8335d0', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:57.327767 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:57.329567 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:55:57.329567 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:57.336105 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:57.336487 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap463c33b4-34, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:57.337113 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap463c33b4-34, col_values=(('qos', UUID('e94ade6c-75ce-46ee-99a8-87ee157e27cd')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:57.337469 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap463c33b4-34, col_values=(('external_ids', {'iface-id': '463c33b4-3468-4b31-b611-3ab977c91c1c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:92:ee', 'vm-uuid': '45a73c95-ff10-4b74-9ab8-4014a244a7d3'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:55:57.339265 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:57.342469 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:55:57.347709 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:57.349496 np0000001583 nova-compute[98241]: INFO os_vif [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:92:ee,bridge_name='br-int',has_traffic_filtering=True,id=463c33b4-3468-4b31-b611-3ab977c91c1c,network=Network(2ee43c4e-569f-4726-9700-add40d768203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap463c33b4-34')
May 28 01:55:57.572536 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-dcb484ee-420d-49a1-bca7-3c813c96cbdb req-6bcb03d6-39c1-4893-9932-eb16bde6598a service nova] Releasing lock "refresh_cache-7078fbb1-fa4a-4589-9f95-9d95dee381e0" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:55:58.011054 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:55:58.375407 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-7dced259-ef34-43f0-96e6-ab1f7097328e tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4/disk --force-share --output=json -f qcow2 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:58.485187 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-7dced259-ef34-43f0-96e6-ab1f7097328e tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4/disk --force-share --output=json -f qcow2" returned: 0 in 0.109s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:58.485907 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-7dced259-ef34-43f0-96e6-ab1f7097328e tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4/disk --force-share --output=json -f qcow2 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:58.591155 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-7dced259-ef34-43f0-96e6-ab1f7097328e tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4/disk --force-share --output=json -f qcow2" returned: 0 in 0.103s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:58.591155 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-7dced259-ef34-43f0-96e6-ab1f7097328e tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:55:58.594857 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-7dced259-ef34-43f0-96e6-ab1f7097328e tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:55:58.595291 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-7dced259-ef34-43f0-96e6-ab1f7097328e tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:58.713887 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-7dced259-ef34-43f0-96e6-ab1f7097328e tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.118s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:58.715488 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-7dced259-ef34-43f0-96e6-ab1f7097328e tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpk8aedc1f/e6e1bdea291541ef905a946cde98e7e9.delta 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:58.788125 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-7dced259-ef34-43f0-96e6-ab1f7097328e tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpk8aedc1f/e6e1bdea291541ef905a946cde98e7e9.delta 1073741824" returned: 0 in 0.072s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:58.788804 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-7dced259-ef34-43f0-96e6-ab1f7097328e tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Quiescing instance not available: QEMU guest agent is not enabled.
May 28 01:55:58.880816 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:55:58.881000 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:55:58.881189 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] No VIF found with MAC fa:16:3e:20:92:ee, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:55:58.881852 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Using config drive
May 28 01:55:59.082360 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-7dced259-ef34-43f0-96e6-ab1f7097328e tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] COPY block job progress, current cursor: 0 final cursor: 76677120 {{(pid=98241) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 28 01:55:59.390105 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:55:59.529771 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Creating config drive at /opt/stack/data/nova/instances/45a73c95-ff10-4b74-9ab8-4014a244a7d3/disk.config
May 28 01:55:59.536318 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/45a73c95-ff10-4b74-9ab8-4014a244a7d3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpsepzrm7s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:59.582316 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/45a73c95-ff10-4b74-9ab8-4014a244a7d3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpsepzrm7s" returned: 0 in 0.046s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:59.585996 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-7dced259-ef34-43f0-96e6-ab1f7097328e tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] COPY block job progress, current cursor: 76677120 final cursor: 76677120 {{(pid=98241) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 28 01:55:59.590012 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-7dced259-ef34-43f0-96e6-ab1f7097328e tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Skipping quiescing instance: QEMU guest agent is not enabled.
May 28 01:55:59.711498 np0000001583 nova-compute[98241]: DEBUG nova.privsep.utils [None req-7dced259-ef34-43f0-96e6-ab1f7097328e tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98241) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 01:55:59.711727 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-7dced259-ef34-43f0-96e6-ab1f7097328e tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpk8aedc1f/e6e1bdea291541ef905a946cde98e7e9.delta /opt/stack/data/nova/instances/snapshots/tmpk8aedc1f/e6e1bdea291541ef905a946cde98e7e9 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:55:59.935828 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-7dced259-ef34-43f0-96e6-ab1f7097328e tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpk8aedc1f/e6e1bdea291541ef905a946cde98e7e9.delta /opt/stack/data/nova/instances/snapshots/tmpk8aedc1f/e6e1bdea291541ef905a946cde98e7e9" returned: 0 in 0.224s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:55:59.941755 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-7dced259-ef34-43f0-96e6-ab1f7097328e tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Snapshot extracted, beginning image upload
May 28 01:56:00.096554 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:00.133716 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:00.135727 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:00.245952 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:00.306357 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:00.308241 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:00.343046 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-bd2a5f49-3f9e-421b-9a77-a568fdd2503f req-34ae6756-c40e-48d0-abad-6fd7d8d44cc7 service nova] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Received event network-vif-plugged-463c33b4-3468-4b31-b611-3ab977c91c1c {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:00.344868 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bd2a5f49-3f9e-421b-9a77-a568fdd2503f req-34ae6756-c40e-48d0-abad-6fd7d8d44cc7 service nova] Acquiring lock "45a73c95-ff10-4b74-9ab8-4014a244a7d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:00.345318 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bd2a5f49-3f9e-421b-9a77-a568fdd2503f req-34ae6756-c40e-48d0-abad-6fd7d8d44cc7 service nova] Lock "45a73c95-ff10-4b74-9ab8-4014a244a7d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:00.345656 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bd2a5f49-3f9e-421b-9a77-a568fdd2503f req-34ae6756-c40e-48d0-abad-6fd7d8d44cc7 service nova] Lock "45a73c95-ff10-4b74-9ab8-4014a244a7d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:00.346587 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-bd2a5f49-3f9e-421b-9a77-a568fdd2503f req-34ae6756-c40e-48d0-abad-6fd7d8d44cc7 service nova] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Processing event network-vif-plugged-463c33b4-3468-4b31-b611-3ab977c91c1c {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:56:01.044611 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0005313479998676485 future=<Future at 0x7724ec17d0a0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:56:01.045896 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:56:01.139407 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933361.1388938, 45a73c95-ff10-4b74-9ab8-4014a244a7d3 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:56:01.139578 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] VM Started (Lifecycle Event)
May 28 01:56:01.141020 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:56:01.146157 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:56:01.152372 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Instance spawned successfully.
May 28 01:56:01.154614 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:56:01.643918 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:56:01.648680 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:56:01.667061 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:56:01.667813 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:56:01.668606 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:56:01.668889 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:56:01.669238 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:56:01.670210 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:56:02.159109 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:56:02.160444 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933362.1589391, 45a73c95-ff10-4b74-9ab8-4014a244a7d3 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:56:02.160444 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] VM Paused (Lifecycle Event)
May 28 01:56:02.178068 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Took 7.72 seconds to spawn the instance on the hypervisor.
May 28 01:56:02.178751 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:56:02.339171 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:02.433572 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-dfa79507-10bb-43df-bfba-7b02ed191642 req-078f64d7-81a3-4931-8f17-0d9016a9947d service nova] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Received event network-vif-plugged-463c33b4-3468-4b31-b611-3ab977c91c1c {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:02.433937 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-dfa79507-10bb-43df-bfba-7b02ed191642 req-078f64d7-81a3-4931-8f17-0d9016a9947d service nova] Acquiring lock "45a73c95-ff10-4b74-9ab8-4014a244a7d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:02.434777 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-dfa79507-10bb-43df-bfba-7b02ed191642 req-078f64d7-81a3-4931-8f17-0d9016a9947d service nova] Lock "45a73c95-ff10-4b74-9ab8-4014a244a7d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:02.435567 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-dfa79507-10bb-43df-bfba-7b02ed191642 req-078f64d7-81a3-4931-8f17-0d9016a9947d service nova] Lock "45a73c95-ff10-4b74-9ab8-4014a244a7d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:02.436277 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-dfa79507-10bb-43df-bfba-7b02ed191642 req-078f64d7-81a3-4931-8f17-0d9016a9947d service nova] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] No waiting events found dispatching network-vif-plugged-463c33b4-3468-4b31-b611-3ab977c91c1c {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:56:02.436683 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-dfa79507-10bb-43df-bfba-7b02ed191642 req-078f64d7-81a3-4931-8f17-0d9016a9947d service nova] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Received unexpected event network-vif-plugged-463c33b4-3468-4b31-b611-3ab977c91c1c for instance with vm_state active and task_state None.
May 28 01:56:02.667057 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:56:02.668391 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933362.668106, 45a73c95-ff10-4b74-9ab8-4014a244a7d3 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:56:02.668611 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] VM Resumed (Lifecycle Event)
May 28 01:56:02.907636 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Took 13.77 seconds to build instance.
May 28 01:56:03.016922 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:03.176164 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:56:03.176963 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:56:03.248855 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-7dced259-ef34-43f0-96e6-ab1f7097328e tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Snapshot image upload complete
May 28 01:56:03.249317 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-7dced259-ef34-43f0-96e6-ab1f7097328e tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Took 6.58 seconds to snapshot the instance on the hypervisor.
May 28 01:56:03.410283 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-38508e89-4c70-43a9-94d4-9ada07fd3baa tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "45a73c95-ff10-4b74-9ab8-4014a244a7d3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.285s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:04.384770 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Acquiring lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:04.385217 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:04.502838 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-66a9216f-6696-4f02-a25b-ea29ec1bc56b tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:56:04.890749 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lazy-loading 'flavor' on Instance uuid 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:56:04.961889 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5dfeb303-5ca3-4732-84c0-d060dde92417 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Acquiring lock "ea9459ae-6246-4d11-b46b-733449884b1b" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:04.962099 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5dfeb303-5ca3-4732-84c0-d060dde92417 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "ea9459ae-6246-4d11-b46b-733449884b1b" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:04.962685 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-5dfeb303-5ca3-4732-84c0-d060dde92417 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Shelving
May 28 01:56:05.012035 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-66a9216f-6696-4f02-a25b-ea29ec1bc56b tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] instance snapshotting
May 28 01:56:05.106019 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-66a9216f-6696-4f02-a25b-ea29ec1bc56b tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Beginning live snapshot process
May 28 01:56:05.896284 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:06.002294 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:06.010046 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:06.026238 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:06.034170 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:06.055289 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:06.058790 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:06.215714 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0cab083f-311d-478c-a661-f96e5922c744 req-cb8770f8-f650-4d6a-9607-6828ee53cf36 service nova] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Received event network-vif-unplugged-2bb36d37-52de-4dcf-abb4-35b15f363457 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:06.215955 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0cab083f-311d-478c-a661-f96e5922c744 req-cb8770f8-f650-4d6a-9607-6828ee53cf36 service nova] Acquiring lock "ea9459ae-6246-4d11-b46b-733449884b1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:06.218432 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0cab083f-311d-478c-a661-f96e5922c744 req-cb8770f8-f650-4d6a-9607-6828ee53cf36 service nova] Lock "ea9459ae-6246-4d11-b46b-733449884b1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:06.218432 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0cab083f-311d-478c-a661-f96e5922c744 req-cb8770f8-f650-4d6a-9607-6828ee53cf36 service nova] Lock "ea9459ae-6246-4d11-b46b-733449884b1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:06.218432 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0cab083f-311d-478c-a661-f96e5922c744 req-cb8770f8-f650-4d6a-9607-6828ee53cf36 service nova] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] No waiting events found dispatching network-vif-unplugged-2bb36d37-52de-4dcf-abb4-35b15f363457 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:56:06.218432 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-0cab083f-311d-478c-a661-f96e5922c744 req-cb8770f8-f650-4d6a-9607-6828ee53cf36 service nova] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Received unexpected event network-vif-unplugged-2bb36d37-52de-4dcf-abb4-35b15f363457 for instance with vm_state active and task_state shelving.
May 28 01:56:06.339835 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999652948999938 future=<Future at 0x7724ec1b94c0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:56:06.341690 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.997842335000087 future=<Future at 0x7724ec1b94c0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:56:06.342035 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.997496746000024 future=<Future at 0x7724ec1b94c0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:56:06.346229 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Instance destroyed successfully.
May 28 01:56:06.346667 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-5dfeb303-5ca3-4732-84c0-d060dde92417 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lazy-loading 'numa_topology' on Instance uuid ea9459ae-6246-4d11-b46b-733449884b1b {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:56:06.620608 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-66a9216f-6696-4f02-a25b-ea29ec1bc56b tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a73c95-ff10-4b74-9ab8-4014a244a7d3/disk --force-share --output=json -f qcow2 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:06.713549 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-66a9216f-6696-4f02-a25b-ea29ec1bc56b tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a73c95-ff10-4b74-9ab8-4014a244a7d3/disk --force-share --output=json -f qcow2" returned: 0 in 0.093s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:56:06.714175 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-66a9216f-6696-4f02-a25b-ea29ec1bc56b tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a73c95-ff10-4b74-9ab8-4014a244a7d3/disk --force-share --output=json -f qcow2 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:06.816488 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-66a9216f-6696-4f02-a25b-ea29ec1bc56b tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a73c95-ff10-4b74-9ab8-4014a244a7d3/disk --force-share --output=json -f qcow2" returned: 0 in 0.102s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:56:06.817805 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-66a9216f-6696-4f02-a25b-ea29ec1bc56b tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:56:06.821024 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-66a9216f-6696-4f02-a25b-ea29ec1bc56b tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:56:06.821513 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-66a9216f-6696-4f02-a25b-ea29ec1bc56b tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:06.923341 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-66a9216f-6696-4f02-a25b-ea29ec1bc56b tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.102s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:56:06.924032 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-66a9216f-6696-4f02-a25b-ea29ec1bc56b tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpjkzijiue/c4491b711dd5418a94a990d73c7fcfdd.delta 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:06.976098 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-66a9216f-6696-4f02-a25b-ea29ec1bc56b tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpjkzijiue/c4491b711dd5418a94a990d73c7fcfdd.delta 1073741824" returned: 0 in 0.052s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:56:06.977679 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-66a9216f-6696-4f02-a25b-ea29ec1bc56b tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Quiescing instance not available: QEMU guest agent is not enabled.
May 28 01:56:06.986968 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Acquiring lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:06.987352 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:06.987720 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Attaching volume 3bc9896c-bcd6-402c-8ce3-e94000d21629 to /dev/vdb
May 28 01:56:07.009165 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-5dfeb303-5ca3-4732-84c0-d060dde92417 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Beginning cold snapshot process
May 28 01:56:07.060208 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:56:07.078742 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:56:07.110535 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:07.147545 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:56:07.148160 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:56:07.163337 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:56:07.166639 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe63:2bb1', 'fe80::e43a:d5ff:fecc:27fe', 'fe80::fc16:3eff:fe27:be54', 'fe80::a0e4:60ff:fe3f:73d6', 'fe80::fc16:3eff:fe5c:c25f', 'fe80::819:abff:fece:7871', 'fe80::fc16:3eff:fee3:afb5', 'fe80::fc16:3eff:fe2d:d8ee', 'fe80::3880:a4ff:fe4d:a74b', 'fe80::fc16:3eff:fee4:523', 'fe80::fc16:3eff:fe20:fa56', 'fe80::fc16:3eff:fe0a:6e61', 'fe80::fc16:3eff:fe59:946e', 'fe80::6823:8cff:fe94:ad71', 'fe80::fc16:3eff:fe25:2d87', 'fe80::f404:a1ff:fe1b:755c', 'fe80::fc16:3eff:fe94:7597', 'fe80::fc16:3eff:fee1:1d3', 'fe80::fc16:3eff:fe28:958e', 'fe80::3cc0:d1ff:fe7f:6a8', 'fe80::fc16:3eff:fe30:bde8', 'fe80::e04b:eeff:fe0a:e20d', 'fe80::fc16:3eff:fe20:92ee'] 
May 28 01:56:07.166822 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:56:07.166934 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:56:07.167207 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] <== get_connector_properties: return (106ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:56:07.167532 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Updating existing volume attachment record: c7a775b9-9127-483c-a694-064dd9034e6b {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:56:07.290641 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-66a9216f-6696-4f02-a25b-ea29ec1bc56b tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] COPY block job progress, current cursor: 1 final cursor: 1 {{(pid=98241) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 28 01:56:07.293829 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-66a9216f-6696-4f02-a25b-ea29ec1bc56b tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Skipping quiescing instance: QEMU guest agent is not enabled.
May 28 01:56:07.340884 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:07.359192 np0000001583 nova-compute[98241]: DEBUG nova.privsep.utils [None req-66a9216f-6696-4f02-a25b-ea29ec1bc56b tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98241) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 01:56:07.359192 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-66a9216f-6696-4f02-a25b-ea29ec1bc56b tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpjkzijiue/c4491b711dd5418a94a990d73c7fcfdd.delta /opt/stack/data/nova/instances/snapshots/tmpjkzijiue/c4491b711dd5418a94a990d73c7fcfdd {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:07.476774 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-66a9216f-6696-4f02-a25b-ea29ec1bc56b tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpjkzijiue/c4491b711dd5418a94a990d73c7fcfdd.delta /opt/stack/data/nova/instances/snapshots/tmpjkzijiue/c4491b711dd5418a94a990d73c7fcfdd" returned: 0 in 0.120s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:56:07.480221 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-66a9216f-6696-4f02-a25b-ea29ec1bc56b tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Snapshot extracted, beginning image upload
May 28 01:56:07.733858 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:56:07.733858 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629', 'iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3bc9896c-bcd6-402c-8ce3-e94000d21629', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:56:07.734134 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:56:07.734657 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:56:07.734984 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629', 'iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3bc9896c-bcd6-402c-8ce3-e94000d21629', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:56:07.754057 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:56:07.755541 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:56:07.756298 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:56:07.756971 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:56:07.756971 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:56:07.758127 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:56:07.774925 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:56:07.774925 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:07.781412 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:56:07.781412 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:07.792192 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629] added
May 28 01:56:07.792192 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:56:07.792192 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:56:07.792192 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:56:07.792192 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:56:07.792192 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:56:07.792192 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:07.792671 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:56:07.792879 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0357(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:56:07.793054 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:56:07.797470 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629] added
May 28 01:56:07.797470 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:56:07.797470 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:56:07.797470 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:56:07.797470 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:56:07.797470 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:56:07.797470 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:07.797470 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:56:07.797470 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0411(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:56:07.797470 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:56:08.020306 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:08.305249 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-fd1612f9-7986-44d9-a839-44620f457dbf req-d3ed435e-3474-458f-b539-68f07bfa9833 service nova] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Received event network-vif-unplugged-2bb36d37-52de-4dcf-abb4-35b15f363457 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:08.306251 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-fd1612f9-7986-44d9-a839-44620f457dbf req-d3ed435e-3474-458f-b539-68f07bfa9833 service nova] Acquiring lock "ea9459ae-6246-4d11-b46b-733449884b1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:08.306251 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-fd1612f9-7986-44d9-a839-44620f457dbf req-d3ed435e-3474-458f-b539-68f07bfa9833 service nova] Lock "ea9459ae-6246-4d11-b46b-733449884b1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:08.306251 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-fd1612f9-7986-44d9-a839-44620f457dbf req-d3ed435e-3474-458f-b539-68f07bfa9833 service nova] Lock "ea9459ae-6246-4d11-b46b-733449884b1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:08.306251 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-fd1612f9-7986-44d9-a839-44620f457dbf req-d3ed435e-3474-458f-b539-68f07bfa9833 service nova] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] No waiting events found dispatching network-vif-unplugged-2bb36d37-52de-4dcf-abb4-35b15f363457 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:56:08.306251 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-fd1612f9-7986-44d9-a839-44620f457dbf req-d3ed435e-3474-458f-b539-68f07bfa9833 service nova] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Received unexpected event network-vif-unplugged-2bb36d37-52de-4dcf-abb4-35b15f363457 for instance with vm_state active and task_state shelving_image_pending_upload.
May 28 01:56:08.534141 np0000001583 nova-compute[98241]: DEBUG nova.privsep.utils [None req-5dfeb303-5ca3-4732-84c0-d060dde92417 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98241) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 01:56:08.535954 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-5dfeb303-5ca3-4732-84c0-d060dde92417 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ea9459ae-6246-4d11-b46b-733449884b1b/disk /opt/stack/data/nova/instances/snapshots/tmp7w6bm0yp/8dc2133f1a9245579e62a29ef707c271 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:08.794193 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:56:08.798069 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:56:08.811554 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:56:08.811554 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:56:08.817685 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:56:08.817685 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:08.832686 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:08.838610 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:08.854653 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:56:08.854653 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:56:08.854653 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:56:08.854653 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:56:08.854653 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:08.854653 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:08.854653 np0000001583 nova-compute[98241]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:56:08.854653 np0000001583 nova-compute[98241]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:56:08.854653 np0000001583 nova-compute[98241]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:08.854653 np0000001583 nova-compute[98241]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:08.854653 np0000001583 nova-compute[98241]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:08.854653 np0000001583 nova-compute[98241]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:08.854653 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:56:08.855120 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] iscsi session list stdout=tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:56:08.855120 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:56:08.855120 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:56:08.855120 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:56:08.855120 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:08.855120 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:08.855120 np0000001583 nova-compute[98241]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:56:08.855120 np0000001583 nova-compute[98241]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:56:08.855120 np0000001583 nova-compute[98241]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:08.855120 np0000001583 nova-compute[98241]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:08.855120 np0000001583 nova-compute[98241]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:08.855120 np0000001583 nova-compute[98241]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:08.855120 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:56:08.862481 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-5dfeb303-5ca3-4732-84c0-d060dde92417 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ea9459ae-6246-4d11-b46b-733449884b1b/disk /opt/stack/data/nova/instances/snapshots/tmp7w6bm0yp/8dc2133f1a9245579e62a29ef707c271" returned: 0 in 0.327s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:56:08.863048 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-5dfeb303-5ca3-4732-84c0-d060dde92417 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Snapshot extracted, beginning image upload
May 28 01:56:08.867421 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:56:08.867421 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:56:08.867421 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:56:08.867421 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:56:08.867421 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:08.867421 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:08.867421 np0000001583 nova-compute[98241]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:56:08.867421 np0000001583 nova-compute[98241]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:56:08.867421 np0000001583 nova-compute[98241]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:08.867421 np0000001583 nova-compute[98241]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:08.867421 np0000001583 nova-compute[98241]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:08.867421 np0000001583 nova-compute[98241]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:08.867421 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:56:08.868233 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] iscsi session list stdout=tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:56:08.868233 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:56:08.868233 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:56:08.868233 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:56:08.868233 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:08.868233 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:08.868233 np0000001583 nova-compute[98241]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:56:08.868233 np0000001583 nova-compute[98241]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:56:08.868233 np0000001583 nova-compute[98241]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:08.868233 np0000001583 nova-compute[98241]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:08.868233 np0000001583 nova-compute[98241]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:08.868233 np0000001583 nova-compute[98241]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:08.868233 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:56:08.931873 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629, portal: 192.168.50.100,3260]
May 28 01:56:08.931873 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629, portal: 192.168.50.100,3260] successful.
May 28 01:56:08.931873 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:08.945478 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629, portal: 192.168.40.100,3260]
May 28 01:56:08.945478 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629, portal: 192.168.40.100,3260] successful.
May 28 01:56:08.945478 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:08.950190 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:08.964840 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:08.977841 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:56:08.977841 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:56:08.977841 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:56:08.977841 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:56:08.977841 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:08.977841 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:08.977841 np0000001583 nova-compute[98241]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:56:08.977841 np0000001583 nova-compute[98241]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:56:08.977841 np0000001583 nova-compute[98241]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:08.977841 np0000001583 nova-compute[98241]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:08.977841 np0000001583 nova-compute[98241]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:08.977841 np0000001583 nova-compute[98241]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:08.977841 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:08.977841 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:08.977841 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:56:08.978227 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] iscsi session list stdout=tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:56:08.978227 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:56:08.978227 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:56:08.978227 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:56:08.978227 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:08.978227 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:08.978227 np0000001583 nova-compute[98241]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:56:08.978227 np0000001583 nova-compute[98241]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:56:08.978227 np0000001583 nova-compute[98241]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:08.978227 np0000001583 nova-compute[98241]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:08.978227 np0000001583 nova-compute[98241]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:08.978227 np0000001583 nova-compute[98241]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:08.978227 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:08.978227 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:08.978227 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:56:08.980001 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.222s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:56:08.980180 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:56:08.984642 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] HCTL ('19', '-', '-', 0) found on session 48 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:56:08.984827 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:56:08.992426 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:56:08.992426 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:56:08.992426 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:56:08.992426 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:56:08.992426 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:08.992426 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:08.992426 np0000001583 nova-compute[98241]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:56:08.992426 np0000001583 nova-compute[98241]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:56:08.992426 np0000001583 nova-compute[98241]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:08.992426 np0000001583 nova-compute[98241]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:08.992426 np0000001583 nova-compute[98241]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:08.992426 np0000001583 nova-compute[98241]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:08.992426 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:08.992426 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:08.992426 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:56:08.992822 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] iscsi session list stdout=tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:56:08.992822 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:56:08.992822 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:56:08.992822 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:56:08.992822 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:08.992822 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:08.992822 np0000001583 nova-compute[98241]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:56:08.992822 np0000001583 nova-compute[98241]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:56:08.992822 np0000001583 nova-compute[98241]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:08.992822 np0000001583 nova-compute[98241]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:08.992822 np0000001583 nova-compute[98241]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:08.992822 np0000001583 nova-compute[98241]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:08.992822 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:08.992822 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:08.992822 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:56:08.993196 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.238s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:56:08.993196 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:56:08.996149 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] HCTL ('20', '-', '-', 0) found on session 49 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:56:08.996363 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:56:09.005153 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Searching for a device in session 48 and hctl ['19', '*', '*', 0] yield: None {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:56:09.020677 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Searching for a device in session 49 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:56:09.020677 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3bc9896c-bcd6-402c-8ce3-e94000d21629', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:56:10.006280 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Searching for a device in session 48 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:56:10.006280 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3bc9896c-bcd6-402c-8ce3-e94000d21629', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:56:10.447215 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-66a9216f-6696-4f02-a25b-ea29ec1bc56b tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Snapshot image upload complete
May 28 01:56:10.447746 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-66a9216f-6696-4f02-a25b-ea29ec1bc56b tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Took 5.43 seconds to snapshot the instance on the hypervisor.
May 28 01:56:10.776448 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Found WWN 33000000033e0ca3f for multipath device dm-10 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:56:10.776448 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:56:10.776448 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] <== connect_volume: return (3041ms) {'type': 'block', 'scsi_wwn': '33000000033e0ca3f', 'path': '/dev/dm-10', 'multipath_id': '33000000033e0ca3f'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:56:10.776448 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000033e0ca3f', 'path': '/dev/dm-10', 'multipath_id': '33000000033e0ca3f'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:56:10.780156 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lazy-loading 'flavor' on Instance uuid 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:56:11.284308 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Attempting to attach volume 3bc9896c-bcd6-402c-8ce3-e94000d21629 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98241) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 01:56:11.287012 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] attach device xml: <disk type="block" device="disk">
May 28 01:56:11.287012 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:56:11.287012 np0000001583 nova-compute[98241]:   <alias name="ua-3bc9896c-bcd6-402c-8ce3-e94000d21629"/>
May 28 01:56:11.287012 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-10"/>
May 28 01:56:11.287012 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 01:56:11.287012 np0000001583 nova-compute[98241]:   <serial>3bc9896c-bcd6-402c-8ce3-e94000d21629</serial>
May 28 01:56:11.287012 np0000001583 nova-compute[98241]: </disk>
May 28 01:56:11.287012 np0000001583 nova-compute[98241]:  {{(pid=98241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 01:56:11.790666 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-5dfeb303-5ca3-4732-84c0-d060dde92417 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Snapshot image upload complete
May 28 01:56:11.791146 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-5dfeb303-5ca3-4732-84c0-d060dde92417 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:56:12.299705 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-5dfeb303-5ca3-4732-84c0-d060dde92417 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Shelve offloading
May 28 01:56:12.343298 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:12.442299 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "e4fd6c94-b2c8-4d2b-b89b-c715a30c1884" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:12.442587 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "e4fd6c94-b2c8-4d2b-b89b-c715a30c1884" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:12.806989 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Instance destroyed successfully.
May 28 01:56:12.807408 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-5dfeb303-5ca3-4732-84c0-d060dde92417 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:56:12.808368 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5dfeb303-5ca3-4732-84c0-d060dde92417 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Acquiring lock "refresh_cache-ea9459ae-6246-4d11-b46b-733449884b1b" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:56:12.808483 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5dfeb303-5ca3-4732-84c0-d060dde92417 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Acquired lock "refresh_cache-ea9459ae-6246-4d11-b46b-733449884b1b" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:56:12.808629 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-5dfeb303-5ca3-4732-84c0-d060dde92417 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:56:12.944501 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:56:13.000344 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:56:13.000548 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:56:13.000706 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:56:13.000860 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] No VIF found with MAC fa:16:3e:5c:c2:5f, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:56:13.020426 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:13.310805 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-5dfeb303-5ca3-4732-84c0-d060dde92417 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:56:13.537841 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:13.538196 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:13.542827 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:56:13.543180 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Claim successful on node np0000001583
May 28 01:56:13.717832 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-5dfeb303-5ca3-4732-84c0-d060dde92417 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:56:13.862886 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-5dfeb303-5ca3-4732-84c0-d060dde92417 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Updating instance_info_cache with network_info: [{"id": "2bb36d37-52de-4dcf-abb4-35b15f363457", "address": "fa:16:3e:86:7e:a1", "network": {"id": "34ab0ff0-75dd-45e7-97f6-22f8e62a8149", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1222751470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d31342458ec4ed2890a766f62facbcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb36d37-52", "ovs_interfaceid": "2bb36d37-52de-4dcf-abb4-35b15f363457", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:56:14.364766 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5dfeb303-5ca3-4732-84c0-d060dde92417 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Releasing lock "refresh_cache-ea9459ae-6246-4d11-b46b-733449884b1b" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:56:14.365142 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-5dfeb303-5ca3-4732-84c0-d060dde92417 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:56:14.365383 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-5dfeb303-5ca3-4732-84c0-d060dde92417 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:56:14.558827 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b06cf7e7-fe37-446c-9b82-86f77c8dcf39 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.572s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:14.941904 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Instance destroyed successfully.
May 28 01:56:14.942479 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-5dfeb303-5ca3-4732-84c0-d060dde92417 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lazy-loading 'resources' on Instance uuid ea9459ae-6246-4d11-b46b-733449884b1b {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:56:15.003456 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-bd434067-0a44-431c-8a9a-9883230dd3b1 req-4f32b4d2-d5de-4ca5-8324-51816b9c87ee service nova] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Received event network-changed-2bb36d37-52de-4dcf-abb4-35b15f363457 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:15.004365 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-bd434067-0a44-431c-8a9a-9883230dd3b1 req-4f32b4d2-d5de-4ca5-8324-51816b9c87ee service nova] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Refreshing instance network info cache due to event network-changed-2bb36d37-52de-4dcf-abb4-35b15f363457. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:56:15.004541 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bd434067-0a44-431c-8a9a-9883230dd3b1 req-4f32b4d2-d5de-4ca5-8324-51816b9c87ee service nova] Acquiring lock "refresh_cache-ea9459ae-6246-4d11-b46b-733449884b1b" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:56:15.004781 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bd434067-0a44-431c-8a9a-9883230dd3b1 req-4f32b4d2-d5de-4ca5-8324-51816b9c87ee service nova] Acquired lock "refresh_cache-ea9459ae-6246-4d11-b46b-733449884b1b" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:56:15.004781 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-bd434067-0a44-431c-8a9a-9883230dd3b1 req-4f32b4d2-d5de-4ca5-8324-51816b9c87ee service nova] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Refreshing network info cache for port 2bb36d37-52de-4dcf-abb4-35b15f363457 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:56:15.144103 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Rescuing
May 28 01:56:15.144103 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Acquiring lock "refresh_cache-8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:56:15.144103 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Acquired lock "refresh_cache-8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:56:15.144103 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:56:15.288982 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:56:15.288982 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:56:15.446406 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-5dfeb303-5ca3-4732-84c0-d060dde92417 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Object Instance<ea9459ae-6246-4d11-b46b-733449884b1b> lazy-loaded attributes: numa_topology,resources {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:56:15.446406 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-5dfeb303-5ca3-4732-84c0-d060dde92417 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:55:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-350641025',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-attachvolumeshelvetestjson-server-350641025',id=20,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyywg/GU3kMhR5XnRO3S4+qKLGn1IVmNweRmYbKjC4mG7Y3B4b1iJuav/MjMhmEg1Ch1VSJDXtwStt6yHLEcJuMrGjLfMiMuk2bmjq4ldTwnSZW8eUZkuwRr6oFssFUKg==',key_name='tempest-keypair-950315920',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:55:23Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0d31342458ec4ed2890a766f62facbcf',ramdisk_id='',reservation_id='r-lmutfe3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1906404591',owner_user_name='tempest-AttachVolumeShelveTestJSON-1906404591-project-member',shelved_at='2026-05-28T01:56:11.790708',shelved_host='np0000001583',shelved_image_id='adce11b4-189e-4822-9602-663c6d77d880'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:56:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='312a198f7d3d4ce9b586d8f36cf58f76',uuid=ea9459ae-6246-4d11-b46b-733449884b1b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "2bb36d37-52de-4dcf-abb4-35b15f363457", "address": "fa:16:3e:86:7e:a1", "network": {"id": "34ab0ff0-75dd-45e7-97f6-22f8e62a8149", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1222751470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d31342458ec4ed2890a766f62facbcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb36d37-52", "ovs_interfaceid": "2bb36d37-52de-4dcf-abb4-35b15f363457", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:56:15.446406 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-5dfeb303-5ca3-4732-84c0-d060dde92417 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Converting VIF {"id": "2bb36d37-52de-4dcf-abb4-35b15f363457", "address": "fa:16:3e:86:7e:a1", "network": {"id": "34ab0ff0-75dd-45e7-97f6-22f8e62a8149", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1222751470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d31342458ec4ed2890a766f62facbcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb36d37-52", "ovs_interfaceid": "2bb36d37-52de-4dcf-abb4-35b15f363457", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:56:15.446782 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-5dfeb303-5ca3-4732-84c0-d060dde92417 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:7e:a1,bridge_name='br-int',has_traffic_filtering=True,id=2bb36d37-52de-4dcf-abb4-35b15f363457,network=Network(34ab0ff0-75dd-45e7-97f6-22f8e62a8149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bb36d37-52') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:56:15.446782 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-5dfeb303-5ca3-4732-84c0-d060dde92417 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:7e:a1,bridge_name='br-int',has_traffic_filtering=True,id=2bb36d37-52de-4dcf-abb4-35b15f363457,network=Network(34ab0ff0-75dd-45e7-97f6-22f8e62a8149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bb36d37-52') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:56:15.451185 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:15.451185 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2bb36d37-52, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:56:15.451185 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:15.451613 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:56:15.453933 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:15.453933 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:15.453933 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7cdfda98-67bf-4baa-aeaa-ef584ad2b49c) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:56:15.457735 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:15.460397 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:56:15.460397 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:15.461224 np0000001583 nova-compute[98241]: INFO os_vif [None req-5dfeb303-5ca3-4732-84c0-d060dde92417 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:7e:a1,bridge_name='br-int',has_traffic_filtering=True,id=2bb36d37-52de-4dcf-abb4-35b15f363457,network=Network(34ab0ff0-75dd-45e7-97f6-22f8e62a8149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bb36d37-52')
May 28 01:56:15.462141 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-5dfeb303-5ca3-4732-84c0-d060dde92417 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Deleting instance files /opt/stack/data/nova/instances/ea9459ae-6246-4d11-b46b-733449884b1b_del
May 28 01:56:15.468869 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-5dfeb303-5ca3-4732-84c0-d060dde92417 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Deletion of /opt/stack/data/nova/instances/ea9459ae-6246-4d11-b46b-733449884b1b_del complete
May 28 01:56:15.513957 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-bd434067-0a44-431c-8a9a-9883230dd3b1 req-4f32b4d2-d5de-4ca5-8324-51816b9c87ee service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:56:15.647556 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:56:15.791929 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:56:15.910009 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-bd434067-0a44-431c-8a9a-9883230dd3b1 req-4f32b4d2-d5de-4ca5-8324-51816b9c87ee service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:56:16.061892 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-5dfeb303-5ca3-4732-84c0-d060dde92417 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Deleted allocations for instance ea9459ae-6246-4d11-b46b-733449884b1b
May 28 01:56:16.108369 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:56:16.118575 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-bd434067-0a44-431c-8a9a-9883230dd3b1 req-4f32b4d2-d5de-4ca5-8324-51816b9c87ee service nova] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Updated VIF entry in instance network info cache for port 2bb36d37-52de-4dcf-abb4-35b15f363457. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:56:16.119120 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-bd434067-0a44-431c-8a9a-9883230dd3b1 req-4f32b4d2-d5de-4ca5-8324-51816b9c87ee service nova] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Updating instance_info_cache with network_info: [{"id": "2bb36d37-52de-4dcf-abb4-35b15f363457", "address": "fa:16:3e:86:7e:a1", "network": {"id": "34ab0ff0-75dd-45e7-97f6-22f8e62a8149", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1222751470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d31342458ec4ed2890a766f62facbcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap2bb36d37-52", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:56:16.268357 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Updating instance_info_cache with network_info: [{"id": "f242e691-1d28-43e0-b83a-2414c00958b8", "address": "fa:16:3e:5c:c2:5f", "network": {"id": "b31b6f30-3b80-465d-8203-e6f4c16c758c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1195490498-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "261e17e4ed4445c887b71a705d46ad7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf242e691-1d", "ovs_interfaceid": "f242e691-1d28-43e0-b83a-2414c00958b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:56:16.299707 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.762s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:16.300184 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:56:16.568135 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5dfeb303-5ca3-4732-84c0-d060dde92417 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:16.568362 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5dfeb303-5ca3-4732-84c0-d060dde92417 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:16.621424 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bd434067-0a44-431c-8a9a-9883230dd3b1 req-4f32b4d2-d5de-4ca5-8324-51816b9c87ee service nova] Releasing lock "refresh_cache-ea9459ae-6246-4d11-b46b-733449884b1b" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:56:16.774666 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Releasing lock "refresh_cache-8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:56:16.806962 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:56:16.807603 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:56:16.807603 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:56:16.807795 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:56:16.920910 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c3a7b14e31ee40cf9e4f4bba084ccaa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba381dad8364a488a98b80c04cce8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:56:17.316215 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:56:17.346494 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-5dfeb303-5ca3-4732-84c0-d060dde92417 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:56:17.346791 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-5dfeb303-5ca3-4732-84c0-d060dde92417 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:56:17.488259 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Successfully created port: f31bd559-b1fa-4de0-9abf-97d61aa6ffea {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:56:17.820482 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:56:17.852101 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-5dfeb303-5ca3-4732-84c0-d060dde92417 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:56:18.024453 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:18.103779 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Successfully updated port: f31bd559-b1fa-4de0-9abf-97d61aa6ffea {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:56:18.166590 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-4b956a9d-0fff-466a-b1aa-491d1225244a req-349ae112-5e92-4f3c-ae02-bc2b680f8335 service nova] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Received event network-changed-f31bd559-b1fa-4de0-9abf-97d61aa6ffea {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:18.168098 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-4b956a9d-0fff-466a-b1aa-491d1225244a req-349ae112-5e92-4f3c-ae02-bc2b680f8335 service nova] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Refreshing instance network info cache due to event network-changed-f31bd559-b1fa-4de0-9abf-97d61aa6ffea. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:56:18.168098 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-4b956a9d-0fff-466a-b1aa-491d1225244a req-349ae112-5e92-4f3c-ae02-bc2b680f8335 service nova] Acquiring lock "refresh_cache-e4fd6c94-b2c8-4d2b-b89b-c715a30c1884" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:56:18.168098 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-4b956a9d-0fff-466a-b1aa-491d1225244a req-349ae112-5e92-4f3c-ae02-bc2b680f8335 service nova] Acquired lock "refresh_cache-e4fd6c94-b2c8-4d2b-b89b-c715a30c1884" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:56:18.168098 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-4b956a9d-0fff-466a-b1aa-491d1225244a req-349ae112-5e92-4f3c-ae02-bc2b680f8335 service nova] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Refreshing network info cache for port f31bd559-b1fa-4de0-9abf-97d61aa6ffea {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:56:18.325539 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Booting with volume-backed-image 3aa57a53-c080-4a55-ba67-d70bf1ef7690 at /dev/vda
May 28 01:56:18.363389 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5dfeb303-5ca3-4732-84c0-d060dde92417 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.795s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:18.480905 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:18.486316 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:18.518838 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:18.533174 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:18.561450 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:18.566028 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:18.608508 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "refresh_cache-e4fd6c94-b2c8-4d2b-b89b-c715a30c1884" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:56:18.672745 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-4b956a9d-0fff-466a-b1aa-491d1225244a req-349ae112-5e92-4f3c-ae02-bc2b680f8335 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:56:18.764485 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b462d1f2-a411-4c03-b43c-deb0fcd7f9d4 req-575827b4-9666-43d6-8b5b-0502a46cbe24 service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Received event network-vif-unplugged-f242e691-1d28-43e0-b83a-2414c00958b8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:18.765458 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b462d1f2-a411-4c03-b43c-deb0fcd7f9d4 req-575827b4-9666-43d6-8b5b-0502a46cbe24 service nova] Acquiring lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:18.765458 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b462d1f2-a411-4c03-b43c-deb0fcd7f9d4 req-575827b4-9666-43d6-8b5b-0502a46cbe24 service nova] Lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:18.765554 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b462d1f2-a411-4c03-b43c-deb0fcd7f9d4 req-575827b4-9666-43d6-8b5b-0502a46cbe24 service nova] Lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:18.765936 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b462d1f2-a411-4c03-b43c-deb0fcd7f9d4 req-575827b4-9666-43d6-8b5b-0502a46cbe24 service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] No waiting events found dispatching network-vif-unplugged-f242e691-1d28-43e0-b83a-2414c00958b8 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:56:18.767603 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-b462d1f2-a411-4c03-b43c-deb0fcd7f9d4 req-575827b4-9666-43d6-8b5b-0502a46cbe24 service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Received unexpected event network-vif-unplugged-f242e691-1d28-43e0-b83a-2414c00958b8 for instance with vm_state active and task_state rescuing.
May 28 01:56:18.832565 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999572356000044 future=<Future at 0x7724ec16fda0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:56:18.835806 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Instance destroyed successfully.
May 28 01:56:18.836310 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lazy-loading 'numa_topology' on Instance uuid 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:56:18.858760 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-4b956a9d-0fff-466a-b1aa-491d1225244a req-349ae112-5e92-4f3c-ae02-bc2b680f8335 service nova] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:56:18.872943 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5dfeb303-5ca3-4732-84c0-d060dde92417 tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "ea9459ae-6246-4d11-b46b-733449884b1b" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 13.911s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:19.111382 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-4b956a9d-0fff-466a-b1aa-491d1225244a req-349ae112-5e92-4f3c-ae02-bc2b680f8335 service nova] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:56:19.340715 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Attempting a stable device rescue
May 28 01:56:19.466641 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=98241) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 28 01:56:19.471726 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Instance directory exists: not creating {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 01:56:19.474227 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Creating image(s)
May 28 01:56:19.474227 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Acquiring lock "/opt/stack/data/nova/instances/8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:19.474227 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lock "/opt/stack/data/nova/instances/8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:19.474227 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lock "/opt/stack/data/nova/instances/8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:19.474227 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:56:19.553134 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Acquiring lock "0cca8054-2a26-436f-93b8-ef28e452bd65" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:19.553397 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:19.553669 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Acquiring lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:19.553886 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:19.554533 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:19.557123 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Terminating instance
May 28 01:56:19.615360 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-4b956a9d-0fff-466a-b1aa-491d1225244a req-349ae112-5e92-4f3c-ae02-bc2b680f8335 service nova] Releasing lock "refresh_cache-e4fd6c94-b2c8-4d2b-b89b-c715a30c1884" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:56:19.615551 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquired lock "refresh_cache-e4fd6c94-b2c8-4d2b-b89b-c715a30c1884" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:56:19.616173 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:56:19.975799 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Object Instance<8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:56:19.976357 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Acquiring lock "86d7e6d4e86a0e87924f99c68e18f84e62b7eeb2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:19.976689 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lock "86d7e6d4e86a0e87924f99c68e18f84e62b7eeb2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:20.062443 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:56:20.097043 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:20.107268 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:20.134781 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:20.174874 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:20.199452 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:20.205610 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:20.240484 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:56:20.309105 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Acquiring lock "ea9459ae-6246-4d11-b46b-733449884b1b" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:20.309105 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "ea9459ae-6246-4d11-b46b-733449884b1b" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:20.309105 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Unshelving
May 28 01:56:20.355977 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:20.379477 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:20.460297 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:20.482290 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:20.487019 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-fa84d5ff-c4c0-47ae-82fa-b19acd7442a5 req-665d23e9-5743-4f85-8e16-e93fdd73e835 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-vif-unplugged-dfa132bb-afe8-4b97-909b-816f3e916bfd {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:20.487445 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-fa84d5ff-c4c0-47ae-82fa-b19acd7442a5 req-665d23e9-5743-4f85-8e16-e93fdd73e835 service nova] Acquiring lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:20.487693 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-fa84d5ff-c4c0-47ae-82fa-b19acd7442a5 req-665d23e9-5743-4f85-8e16-e93fdd73e835 service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:20.487908 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-fa84d5ff-c4c0-47ae-82fa-b19acd7442a5 req-665d23e9-5743-4f85-8e16-e93fdd73e835 service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:20.490197 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-fa84d5ff-c4c0-47ae-82fa-b19acd7442a5 req-665d23e9-5743-4f85-8e16-e93fdd73e835 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] No waiting events found dispatching network-vif-unplugged-dfa132bb-afe8-4b97-909b-816f3e916bfd {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:56:20.490351 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-fa84d5ff-c4c0-47ae-82fa-b19acd7442a5 req-665d23e9-5743-4f85-8e16-e93fdd73e835 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-vif-unplugged-dfa132bb-afe8-4b97-909b-816f3e916bfd for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:56:20.584345 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:56:20.593161 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:20.599397 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:20.697188 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:20.737468 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:20.813935 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:20.820385 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999626108999792 future=<Future at 0x7724ec17d1c0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:56:20.837673 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Instance destroyed successfully.
May 28 01:56:20.850742 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Lazy-loading 'resources' on Instance uuid 0cca8054-2a26-436f-93b8-ef28e452bd65 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:56:20.880047 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:20.981472 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a2a5f6f1-d0e3-47a7-80d3-27107f0abd03 req-e08c3231-73e9-4dd9-a26c-5992ea31cfe5 service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Received event network-vif-unplugged-f242e691-1d28-43e0-b83a-2414c00958b8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:20.981472 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a2a5f6f1-d0e3-47a7-80d3-27107f0abd03 req-e08c3231-73e9-4dd9-a26c-5992ea31cfe5 service nova] Acquiring lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:20.982444 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a2a5f6f1-d0e3-47a7-80d3-27107f0abd03 req-e08c3231-73e9-4dd9-a26c-5992ea31cfe5 service nova] Lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:20.982571 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a2a5f6f1-d0e3-47a7-80d3-27107f0abd03 req-e08c3231-73e9-4dd9-a26c-5992ea31cfe5 service nova] Lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:20.982744 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a2a5f6f1-d0e3-47a7-80d3-27107f0abd03 req-e08c3231-73e9-4dd9-a26c-5992ea31cfe5 service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] No waiting events found dispatching network-vif-unplugged-f242e691-1d28-43e0-b83a-2414c00958b8 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:56:20.984127 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-a2a5f6f1-d0e3-47a7-80d3-27107f0abd03 req-e08c3231-73e9-4dd9-a26c-5992ea31cfe5 service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Received unexpected event network-vif-unplugged-f242e691-1d28-43e0-b83a-2414c00958b8 for instance with vm_state active and task_state rescuing.
May 28 01:56:20.984127 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a2a5f6f1-d0e3-47a7-80d3-27107f0abd03 req-e08c3231-73e9-4dd9-a26c-5992ea31cfe5 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-vif-unplugged-7896c8d5-ea83-4141-8344-6b557e45d6d1 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:20.984127 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a2a5f6f1-d0e3-47a7-80d3-27107f0abd03 req-e08c3231-73e9-4dd9-a26c-5992ea31cfe5 service nova] Acquiring lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:20.984127 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a2a5f6f1-d0e3-47a7-80d3-27107f0abd03 req-e08c3231-73e9-4dd9-a26c-5992ea31cfe5 service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:20.984127 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a2a5f6f1-d0e3-47a7-80d3-27107f0abd03 req-e08c3231-73e9-4dd9-a26c-5992ea31cfe5 service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:20.984127 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a2a5f6f1-d0e3-47a7-80d3-27107f0abd03 req-e08c3231-73e9-4dd9-a26c-5992ea31cfe5 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] No waiting events found dispatching network-vif-unplugged-7896c8d5-ea83-4141-8344-6b557e45d6d1 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:56:20.984127 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a2a5f6f1-d0e3-47a7-80d3-27107f0abd03 req-e08c3231-73e9-4dd9-a26c-5992ea31cfe5 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-vif-unplugged-7896c8d5-ea83-4141-8344-6b557e45d6d1 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:56:21.078240 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Updating instance_info_cache with network_info: [{"id": "f31bd559-b1fa-4de0-9abf-97d61aa6ffea", "address": "fa:16:3e:ad:d2:22", "network": {"id": "2ee43c4e-569f-4726-9700-add40d768203", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ba381dad8364a488a98b80c04cce8fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf31bd559-b1", "ovs_interfaceid": "f31bd559-b1fa-4de0-9abf-97d61aa6ffea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:56:21.320537 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:21.341094 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.001584138999987772 future=<Future at 0x7724ec1b94c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:56:21.341679 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:56:21.341978 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=12.490137274000062 future=<Future at 0x7724ec16fda0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:56:21.342280 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=12.489905242000077 future=<Future at 0x7724ec16fda0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:56:21.344481 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Emitting event <LifecycleEvent: 1779933366.339362, ea9459ae-6246-4d11-b46b-733449884b1b => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:56:21.344481 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] VM Stopped (Lifecycle Event)
May 28 01:56:21.360924 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:54:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-816699505',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-device-tagging-server-816699505',id=16,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFb4MdstYi3e4BcoWgJNrYYwrxogOgR+UEefY4K3bu6XOWdCVixfd8Z/tWUILEsfZHSabCTBL9tSi6xeabSVtuRQZOykOsXjawc/YsQNmtV8z7BBd+TQapDkhwnvY4ycw==',key_name='tempest-keypair-280238980',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:55:28Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aeed1ca793154290b3390c9300844303',ramdisk_id='',reservation_id='r-ujpreusk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2114446049',owner_user_name='tempest-TaggedBootDevicesTest_v242-2114446049-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:55:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3628360fdd1044689e5e94535d1b7fcd',uuid=0cca8054-2a26-436f-93b8-ef28e452bd65,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dfa132bb-afe8-4b97-909b-816f3e916bfd", "address": "fa:16:3e:e3:af:b5", "network": {"id": "3fed2ebb-cfdf-471c-963f-f350742f2200", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1888324923-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa132bb-af", "ovs_interfaceid": "dfa132bb-afe8-4b97-909b-816f3e916bfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:56:21.361721 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Converting VIF {"id": "dfa132bb-afe8-4b97-909b-816f3e916bfd", "address": "fa:16:3e:e3:af:b5", "network": {"id": "3fed2ebb-cfdf-471c-963f-f350742f2200", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1888324923-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa132bb-af", "ovs_interfaceid": "dfa132bb-afe8-4b97-909b-816f3e916bfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:56:21.362164 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:af:b5,bridge_name='br-int',has_traffic_filtering=True,id=dfa132bb-afe8-4b97-909b-816f3e916bfd,network=Network(3fed2ebb-cfdf-471c-963f-f350742f2200),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfa132bb-af') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:56:21.365746 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:af:b5,bridge_name='br-int',has_traffic_filtering=True,id=dfa132bb-afe8-4b97-909b-816f3e916bfd,network=Network(3fed2ebb-cfdf-471c-963f-f350742f2200),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfa132bb-af') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:56:21.368063 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:21.368433 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdfa132bb-af, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:56:21.370093 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:21.371261 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:56:21.425502 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:21.430614 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:21.430614 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e60d45eb-8632-4ff6-90c1-815b49177094) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:56:21.430614 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:21.430614 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:56:21.440552 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:21.440552 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:21.441971 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lazy-loading 'pci_requests' on Instance uuid ea9459ae-6246-4d11-b46b-733449884b1b {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:56:21.473285 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:21.477774 np0000001583 nova-compute[98241]: INFO os_vif [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:af:b5,bridge_name='br-int',has_traffic_filtering=True,id=dfa132bb-afe8-4b97-909b-816f3e916bfd,network=Network(3fed2ebb-cfdf-471c-963f-f350742f2200),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfa132bb-af')
May 28 01:56:21.480691 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:54:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-816699505',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-device-tagging-server-816699505',id=16,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFb4MdstYi3e4BcoWgJNrYYwrxogOgR+UEefY4K3bu6XOWdCVixfd8Z/tWUILEsfZHSabCTBL9tSi6xeabSVtuRQZOykOsXjawc/YsQNmtV8z7BBd+TQapDkhwnvY4ycw==',key_name='tempest-keypair-280238980',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:55:28Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aeed1ca793154290b3390c9300844303',ramdisk_id='',reservation_id='r-ujpreusk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2114446049',owner_user_name='tempest-TaggedBootDevicesTest_v242-2114446049-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:55:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3628360fdd1044689e5e94535d1b7fcd',uuid=0cca8054-2a26-436f-93b8-ef28e452bd65,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "939862e4-4e68-484c-bbcd-95faf922a641", "address": "fa:16:3e:2d:d8:ee", "network": {"id": "07811dc4-ff38-4d15-a899-007fdeea12e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-974977857", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap939862e4-4e", "ovs_interfaceid": "939862e4-4e68-484c-bbcd-95faf922a641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:56:21.480935 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Converting VIF {"id": "939862e4-4e68-484c-bbcd-95faf922a641", "address": "fa:16:3e:2d:d8:ee", "network": {"id": "07811dc4-ff38-4d15-a899-007fdeea12e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-974977857", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap939862e4-4e", "ovs_interfaceid": "939862e4-4e68-484c-bbcd-95faf922a641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:56:21.481478 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:d8:ee,bridge_name='br-int',has_traffic_filtering=True,id=939862e4-4e68-484c-bbcd-95faf922a641,network=Network(07811dc4-ff38-4d15-a899-007fdeea12e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap939862e4-4e') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:56:21.481704 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:d8:ee,bridge_name='br-int',has_traffic_filtering=True,id=939862e4-4e68-484c-bbcd-95faf922a641,network=Network(07811dc4-ff38-4d15-a899-007fdeea12e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap939862e4-4e') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:56:21.483738 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:21.483979 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap939862e4-4e, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:56:21.485508 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:21.487106 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:56:21.525359 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:21.527216 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:21.527483 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=09353074-6638-4df6-bae9-241e7b66515e) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:56:21.529307 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:21.530067 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:56:21.564855 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:21.568253 np0000001583 nova-compute[98241]: INFO os_vif [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:d8:ee,bridge_name='br-int',has_traffic_filtering=True,id=939862e4-4e68-484c-bbcd-95faf922a641,network=Network(07811dc4-ff38-4d15-a899-007fdeea12e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap939862e4-4e')
May 28 01:56:21.569109 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:54:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-816699505',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-device-tagging-server-816699505',id=16,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFb4MdstYi3e4BcoWgJNrYYwrxogOgR+UEefY4K3bu6XOWdCVixfd8Z/tWUILEsfZHSabCTBL9tSi6xeabSVtuRQZOykOsXjawc/YsQNmtV8z7BBd+TQapDkhwnvY4ycw==',key_name='tempest-keypair-280238980',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:55:28Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aeed1ca793154290b3390c9300844303',ramdisk_id='',reservation_id='r-ujpreusk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2114446049',owner_user_name='tempest-TaggedBootDevicesTest_v242-2114446049-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:55:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3628360fdd1044689e5e94535d1b7fcd',uuid=0cca8054-2a26-436f-93b8-ef28e452bd65,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7896c8d5-ea83-4141-8344-6b557e45d6d1", "address": "fa:16:3e:e4:05:23", "network": {"id": "07811dc4-ff38-4d15-a899-007fdeea12e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-974977857", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7896c8d5-ea", "ovs_interfaceid": "7896c8d5-ea83-4141-8344-6b557e45d6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:56:21.569928 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Converting VIF {"id": "7896c8d5-ea83-4141-8344-6b557e45d6d1", "address": "fa:16:3e:e4:05:23", "network": {"id": "07811dc4-ff38-4d15-a899-007fdeea12e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-974977857", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7896c8d5-ea", "ovs_interfaceid": "7896c8d5-ea83-4141-8344-6b557e45d6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:56:21.570205 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:05:23,bridge_name='br-int',has_traffic_filtering=True,id=7896c8d5-ea83-4141-8344-6b557e45d6d1,network=Network(07811dc4-ff38-4d15-a899-007fdeea12e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7896c8d5-ea') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:56:21.570828 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:05:23,bridge_name='br-int',has_traffic_filtering=True,id=7896c8d5-ea83-4141-8344-6b557e45d6d1,network=Network(07811dc4-ff38-4d15-a899-007fdeea12e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7896c8d5-ea') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:56:21.573051 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:21.573051 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7896c8d5-ea, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:56:21.575056 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:56:21.581666 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Releasing lock "refresh_cache-e4fd6c94-b2c8-4d2b-b89b-c715a30c1884" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:56:21.581961 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Instance network_info: |[{"id": "f31bd559-b1fa-4de0-9abf-97d61aa6ffea", "address": "fa:16:3e:ad:d2:22", "network": {"id": "2ee43c4e-569f-4726-9700-add40d768203", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ba381dad8364a488a98b80c04cce8fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf31bd559-b1", "ovs_interfaceid": "f31bd559-b1fa-4de0-9abf-97d61aa6ffea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:56:21.582838 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:56:21.586773 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:56:21.587601 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86d7e6d4e86a0e87924f99c68e18f84e62b7eeb2.part --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:21.604417 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:21.610936 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:21.611446 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9b161099-9298-48b7-b6e1-d2b320cbc798) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:56:21.612586 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:21.613526 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:56:21.644195 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:21.649171 np0000001583 nova-compute[98241]: INFO os_vif [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:05:23,bridge_name='br-int',has_traffic_filtering=True,id=7896c8d5-ea83-4141-8344-6b557e45d6d1,network=Network(07811dc4-ff38-4d15-a899-007fdeea12e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7896c8d5-ea')
May 28 01:56:21.650677 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:54:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-816699505',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-device-tagging-server-816699505',id=16,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFb4MdstYi3e4BcoWgJNrYYwrxogOgR+UEefY4K3bu6XOWdCVixfd8Z/tWUILEsfZHSabCTBL9tSi6xeabSVtuRQZOykOsXjawc/YsQNmtV8z7BBd+TQapDkhwnvY4ycw==',key_name='tempest-keypair-280238980',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:55:28Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aeed1ca793154290b3390c9300844303',ramdisk_id='',reservation_id='r-ujpreusk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2114446049',owner_user_name='tempest-TaggedBootDevicesTest_v242-2114446049-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:55:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3628360fdd1044689e5e94535d1b7fcd',uuid=0cca8054-2a26-436f-93b8-ef28e452bd65,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78c3c570-3a3b-484e-bc76-7d91862ff0d4", "address": "fa:16:3e:20:fa:56", "network": {"id": "07811dc4-ff38-4d15-a899-007fdeea12e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-974977857", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap78c3c570-3a", "ovs_interfaceid": "78c3c570-3a3b-484e-bc76-7d91862ff0d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:56:21.652539 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Converting VIF {"id": "78c3c570-3a3b-484e-bc76-7d91862ff0d4", "address": "fa:16:3e:20:fa:56", "network": {"id": "07811dc4-ff38-4d15-a899-007fdeea12e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-974977857", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap78c3c570-3a", "ovs_interfaceid": "78c3c570-3a3b-484e-bc76-7d91862ff0d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:56:21.653837 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:fa:56,bridge_name='br-int',has_traffic_filtering=True,id=78c3c570-3a3b-484e-bc76-7d91862ff0d4,network=Network(07811dc4-ff38-4d15-a899-007fdeea12e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78c3c570-3a') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:56:21.654304 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:fa:56,bridge_name='br-int',has_traffic_filtering=True,id=78c3c570-3a3b-484e-bc76-7d91862ff0d4,network=Network(07811dc4-ff38-4d15-a899-007fdeea12e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78c3c570-3a') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:56:21.659836 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:21.659836 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap78c3c570-3a, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:56:21.660309 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:21.661998 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:56:21.687642 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:21.692216 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:21.692216 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e66b9ee2-65ca-439a-9540-6cb3eeedd691) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:56:21.692883 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:21.693709 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:56:21.712641 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86d7e6d4e86a0e87924f99c68e18f84e62b7eeb2.part --force-share --output=json" returned: 0 in 0.125s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:56:21.712996 np0000001583 nova-compute[98241]: DEBUG nova.virt.images [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] f1345ee8-7bcb-4cdf-ba2b-affa1582cc10 was qcow2, converting to raw {{(pid=98241) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 01:56:21.714181 np0000001583 nova-compute[98241]: DEBUG nova.privsep.utils [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98241) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 01:56:21.714694 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/86d7e6d4e86a0e87924f99c68e18f84e62b7eeb2.part /opt/stack/data/nova/instances/_base/86d7e6d4e86a0e87924f99c68e18f84e62b7eeb2.converted {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:21.736388 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:21.740401 np0000001583 nova-compute[98241]: INFO os_vif [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:fa:56,bridge_name='br-int',has_traffic_filtering=True,id=78c3c570-3a3b-484e-bc76-7d91862ff0d4,network=Network(07811dc4-ff38-4d15-a899-007fdeea12e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78c3c570-3a')
May 28 01:56:21.740900 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:54:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-816699505',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-device-tagging-server-816699505',id=16,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFb4MdstYi3e4BcoWgJNrYYwrxogOgR+UEefY4K3bu6XOWdCVixfd8Z/tWUILEsfZHSabCTBL9tSi6xeabSVtuRQZOykOsXjawc/YsQNmtV8z7BBd+TQapDkhwnvY4ycw==',key_name='tempest-keypair-280238980',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:55:28Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aeed1ca793154290b3390c9300844303',ramdisk_id='',reservation_id='r-ujpreusk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2114446049',owner_user_name='tempest-TaggedBootDevicesTest_v242-2114446049-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:55:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3628360fdd1044689e5e94535d1b7fcd',uuid=0cca8054-2a26-436f-93b8-ef28e452bd65,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "766c9d77-3578-4071-b0eb-f2a929ee0445", "address": "fa:16:3e:0a:6e:61", "network": {"id": "07811dc4-ff38-4d15-a899-007fdeea12e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-974977857", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap766c9d77-35", "ovs_interfaceid": "766c9d77-3578-4071-b0eb-f2a929ee0445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:56:21.741174 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Converting VIF {"id": "766c9d77-3578-4071-b0eb-f2a929ee0445", "address": "fa:16:3e:0a:6e:61", "network": {"id": "07811dc4-ff38-4d15-a899-007fdeea12e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-974977857", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap766c9d77-35", "ovs_interfaceid": "766c9d77-3578-4071-b0eb-f2a929ee0445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:56:21.742102 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:6e:61,bridge_name='br-int',has_traffic_filtering=True,id=766c9d77-3578-4071-b0eb-f2a929ee0445,network=Network(07811dc4-ff38-4d15-a899-007fdeea12e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap766c9d77-35') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:56:21.742474 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:6e:61,bridge_name='br-int',has_traffic_filtering=True,id=766c9d77-3578-4071-b0eb-f2a929ee0445,network=Network(07811dc4-ff38-4d15-a899-007fdeea12e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap766c9d77-35') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:56:21.746710 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:21.746710 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap766c9d77-35, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:56:21.748513 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:21.748513 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:56:21.768495 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:21.771171 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:21.771794 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f1003cae-7a36-4783-b4e3-9eadb178debd) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:56:21.772478 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:21.773214 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:56:21.793328 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:21.795030 np0000001583 nova-compute[98241]: INFO os_vif [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:6e:61,bridge_name='br-int',has_traffic_filtering=True,id=766c9d77-3578-4071-b0eb-f2a929ee0445,network=Network(07811dc4-ff38-4d15-a899-007fdeea12e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap766c9d77-35')
May 28 01:56:21.795947 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:54:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-816699505',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-device-tagging-server-816699505',id=16,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFb4MdstYi3e4BcoWgJNrYYwrxogOgR+UEefY4K3bu6XOWdCVixfd8Z/tWUILEsfZHSabCTBL9tSi6xeabSVtuRQZOykOsXjawc/YsQNmtV8z7BBd+TQapDkhwnvY4ycw==',key_name='tempest-keypair-280238980',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:55:28Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aeed1ca793154290b3390c9300844303',ramdisk_id='',reservation_id='r-ujpreusk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2114446049',owner_user_name='tempest-TaggedBootDevicesTest_v242-2114446049-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:55:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3628360fdd1044689e5e94535d1b7fcd',uuid=0cca8054-2a26-436f-93b8-ef28e452bd65,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d868b893-10e8-42d1-872f-bf4b9e8d3659", "address": "fa:16:3e:59:94:6e", "network": {"id": "7de6eee4-0d64-4194-b730-0b1e9ac928b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-2098291513", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd868b893-10", "ovs_interfaceid": "d868b893-10e8-42d1-872f-bf4b9e8d3659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:56:21.796186 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Converting VIF {"id": "d868b893-10e8-42d1-872f-bf4b9e8d3659", "address": "fa:16:3e:59:94:6e", "network": {"id": "7de6eee4-0d64-4194-b730-0b1e9ac928b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-2098291513", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd868b893-10", "ovs_interfaceid": "d868b893-10e8-42d1-872f-bf4b9e8d3659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:56:21.796861 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:94:6e,bridge_name='br-int',has_traffic_filtering=True,id=d868b893-10e8-42d1-872f-bf4b9e8d3659,network=Network(7de6eee4-0d64-4194-b730-0b1e9ac928b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd868b893-10') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:56:21.797168 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:94:6e,bridge_name='br-int',has_traffic_filtering=True,id=d868b893-10e8-42d1-872f-bf4b9e8d3659,network=Network(7de6eee4-0d64-4194-b730-0b1e9ac928b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd868b893-10') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:56:21.798948 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:21.798948 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd868b893-10, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:56:21.800392 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:21.800392 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:56:21.817791 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:21.820195 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:21.820195 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dfe63a4e-9671-4919-9977-73cb39222d91) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:56:21.822362 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:21.822362 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:56:21.837070 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:21.839270 np0000001583 nova-compute[98241]: INFO os_vif [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:94:6e,bridge_name='br-int',has_traffic_filtering=True,id=d868b893-10e8-42d1-872f-bf4b9e8d3659,network=Network(7de6eee4-0d64-4194-b730-0b1e9ac928b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd868b893-10')
May 28 01:56:21.840762 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:54:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-816699505',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-device-tagging-server-816699505',id=16,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFb4MdstYi3e4BcoWgJNrYYwrxogOgR+UEefY4K3bu6XOWdCVixfd8Z/tWUILEsfZHSabCTBL9tSi6xeabSVtuRQZOykOsXjawc/YsQNmtV8z7BBd+TQapDkhwnvY4ycw==',key_name='tempest-keypair-280238980',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:55:28Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aeed1ca793154290b3390c9300844303',ramdisk_id='',reservation_id='r-ujpreusk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2114446049',owner_user_name='tempest-TaggedBootDevicesTest_v242-2114446049-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:55:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3628360fdd1044689e5e94535d1b7fcd',uuid=0cca8054-2a26-436f-93b8-ef28e452bd65,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9ca5546d-4b44-4470-92d7-08800876e89b", "address": "fa:16:3e:25:2d:87", "network": {"id": "7de6eee4-0d64-4194-b730-0b1e9ac928b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-2098291513", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca5546d-4b", "ovs_interfaceid": "9ca5546d-4b44-4470-92d7-08800876e89b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:56:21.840762 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Converting VIF {"id": "9ca5546d-4b44-4470-92d7-08800876e89b", "address": "fa:16:3e:25:2d:87", "network": {"id": "7de6eee4-0d64-4194-b730-0b1e9ac928b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-2098291513", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aeed1ca793154290b3390c9300844303", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca5546d-4b", "ovs_interfaceid": "9ca5546d-4b44-4470-92d7-08800876e89b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:56:21.841170 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:2d:87,bridge_name='br-int',has_traffic_filtering=True,id=9ca5546d-4b44-4470-92d7-08800876e89b,network=Network(7de6eee4-0d64-4194-b730-0b1e9ac928b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ca5546d-4b') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:56:21.841369 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:2d:87,bridge_name='br-int',has_traffic_filtering=True,id=9ca5546d-4b44-4470-92d7-08800876e89b,network=Network(7de6eee4-0d64-4194-b730-0b1e9ac928b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ca5546d-4b') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:56:21.843386 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:21.843935 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9ca5546d-4b, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:56:21.845486 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:21.847612 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:56:21.851344 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:56:21.854399 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:21.856187 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:21.856187 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3255497a-49ed-4088-b435-801001349bda) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:56:21.857278 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:21.858514 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:56:21.871708 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:21.875101 np0000001583 nova-compute[98241]: INFO os_vif [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:2d:87,bridge_name='br-int',has_traffic_filtering=True,id=9ca5546d-4b44-4470-92d7-08800876e89b,network=Network(7de6eee4-0d64-4194-b730-0b1e9ac928b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ca5546d-4b')
May 28 01:56:21.878225 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:56:21.880420 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9', 'iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cb9e2524-4a7c-470b-9095-1bc5e1a51eb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:56:21.880742 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:56:21.881259 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:56:21.881750 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9', 'iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cb9e2524-4a7c-470b-9095-1bc5e1a51eb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:56:21.883622 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:56:21.934171 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:56:21.934171 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:56:21.934171 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:56:21.934171 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:56:21.934171 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:21.934171 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:21.934171 np0000001583 nova-compute[98241]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:56:21.934171 np0000001583 nova-compute[98241]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:56:21.934171 np0000001583 nova-compute[98241]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:21.934171 np0000001583 nova-compute[98241]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:21.934171 np0000001583 nova-compute[98241]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:21.934171 np0000001583 nova-compute[98241]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:21.934171 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:21.934171 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:21.934171 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:56:21.934171 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsi session list stdout=tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:56:21.934171 np0000001583 nova-compute[98241]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9 (non-flash)
May 28 01:56:21.934171 np0000001583 nova-compute[98241]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:56:21.934171 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:56:21.934171 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:21.934171 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:21.934171 np0000001583 nova-compute[98241]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:56:21.934171 np0000001583 nova-compute[98241]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:56:21.934171 np0000001583 nova-compute[98241]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:21.934171 np0000001583 nova-compute[98241]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:21.934171 np0000001583 nova-compute[98241]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:21.934171 np0000001583 nova-compute[98241]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:21.934171 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:21.934171 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:21.934171 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:56:21.935709 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9', '35'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b', '36'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b', '37'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797', '39'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e', '40'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e', '41'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463', '44'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463', '45'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d', '47'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629', '48'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629', '49')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:56:21.935709 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9', '34')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:56:21.936429 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9', '35')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:56:21.938600 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f83074c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9'): ({'sdc'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:56:21.938896 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Removing multipathed devices sdc, sdb {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:56:21.939907 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Flush multipath device 3300000003db33141 {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:56:21.950183 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lazy-loading 'numa_topology' on Instance uuid ea9459ae-6246-4d11-b46b-733449884b1b {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:56:21.996114 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:56:22.000678 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/86d7e6d4e86a0e87924f99c68e18f84e62b7eeb2.part /opt/stack/data/nova/instances/_base/86d7e6d4e86a0e87924f99c68e18f84e62b7eeb2.converted" returned: 0 in 0.286s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:56:22.020450 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86d7e6d4e86a0e87924f99c68e18f84e62b7eeb2.converted --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:22.042900 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:56:22.086960 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:56:22.087243 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:56:22.088944 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:56:22.103651 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:56:22.104051 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:56:22.117118 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86d7e6d4e86a0e87924f99c68e18f84e62b7eeb2.converted --force-share --output=json" returned: 0 in 0.095s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:56:22.118255 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lock "86d7e6d4e86a0e87924f99c68e18f84e62b7eeb2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.141s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:22.119199 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:56:22.126681 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:56:22.135147 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Acquiring lock "86d7e6d4e86a0e87924f99c68e18f84e62b7eeb2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:22.135147 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:22.135553 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lock "86d7e6d4e86a0e87924f99c68e18f84e62b7eeb2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:22.135752 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:56:22.138543 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:56:22.139035 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86d7e6d4e86a0e87924f99c68e18f84e62b7eeb2 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:22.161930 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:56:22.180478 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:56:22.181614 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9, portal: 192.168.40.100,3260]
May 28 01:56:22.181614 np0000001583 nova-compute[98241]: Logout of [sid: 34, target: iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9, portal: 192.168.40.100,3260] successful.
May 28 01:56:22.181614 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:22.214844 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:22.216830 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:22.244564 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:22.250990 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86d7e6d4e86a0e87924f99c68e18f84e62b7eeb2 --force-share --output=json" returned: 0 in 0.112s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:56:22.251892 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/86d7e6d4e86a0e87924f99c68e18f84e62b7eeb2,backing_fmt=raw /opt/stack/data/nova/instances/8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4/disk.rescue {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:22.283355 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:56:22.284111 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:56:22.285962 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9, portal: 192.168.50.100,3260]
May 28 01:56:22.285962 np0000001583 nova-compute[98241]: Logout of [sid: 35, target: iqn.2023-03.storpool.com:os--volume-cb9e2524-4a7c-470b-9095-1bc5e1a51eb9, portal: 192.168.50.100,3260] successful.
May 28 01:56:22.285962 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:22.297858 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:56:22.299573 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe63:2bb1', 'fe80::e43a:d5ff:fecc:27fe', 'fe80::fc16:3eff:fe27:be54', 'fe80::a0e4:60ff:fe3f:73d6', 'fe80::fc16:3eff:fe94:7597', 'fe80::fc16:3eff:fee1:1d3', 'fe80::fc16:3eff:fe28:958e', 'fe80::3cc0:d1ff:fe7f:6a8', 'fe80::fc16:3eff:fe30:bde8', 'fe80::e04b:eeff:fe0a:e20d', 'fe80::fc16:3eff:fe20:92ee'] 
May 28 01:56:22.299774 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:56:22.299854 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:56:22.300089 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:56:22.300615 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Updating existing volume attachment record: a5c77d2d-e62a-40ca-b3f5-78f2e58c6d2c {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:56:22.318741 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:22.318741 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.438s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:56:22.319902 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] <== disconnect_volume: return (439ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:56:22.321229 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/86d7e6d4e86a0e87924f99c68e18f84e62b7eeb2,backing_fmt=raw /opt/stack/data/nova/instances/8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4/disk.rescue" returned: 0 in 0.068s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:56:22.322144 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:56:22.322721 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lock "86d7e6d4e86a0e87924f99c68e18f84e62b7eeb2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:22.323098 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lazy-loading 'migration_context' on Instance uuid 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:56:22.326946 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:56:22.327514 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b', 'iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7d62e380-a6af-45e6-aefa-214f97c0760b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:56:22.327661 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:56:22.328358 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:56:22.328651 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b', 'iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7d62e380-a6af-45e6-aefa-214f97c0760b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:56:22.328846 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:56:22.375354 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:56:22.375354 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:56:22.375354 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:22.375354 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:22.375354 np0000001583 nova-compute[98241]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:56:22.375354 np0000001583 nova-compute[98241]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:56:22.375354 np0000001583 nova-compute[98241]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:22.375354 np0000001583 nova-compute[98241]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:22.375354 np0000001583 nova-compute[98241]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:22.375354 np0000001583 nova-compute[98241]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:22.375354 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:22.375354 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:22.375354 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:56:22.375354 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsi session list stdout=tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:56:22.375354 np0000001583 nova-compute[98241]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b (non-flash)
May 28 01:56:22.375354 np0000001583 nova-compute[98241]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:22.375354 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:22.375354 np0000001583 nova-compute[98241]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:56:22.375354 np0000001583 nova-compute[98241]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:56:22.375354 np0000001583 nova-compute[98241]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:22.375354 np0000001583 nova-compute[98241]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:22.375354 np0000001583 nova-compute[98241]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:22.375354 np0000001583 nova-compute[98241]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:22.375354 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:22.375354 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:22.375354 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:56:22.375354 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b', '36'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b', '37'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797', '39'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e', '40'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e', '41'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463', '44'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463', '45'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d', '47'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629', '48'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629', '49')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:56:22.376427 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b', '36')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:56:22.376965 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b', '37')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:56:22.378343 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724ec325800>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b'): ({'sdg'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:56:22.379633 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Removing multipathed devices sdf, sdg {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:56:22.379633 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Flush multipath device 3300000002612402b {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:56:22.411173 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:56:22.454772 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:56:22.454772 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Claim successful on node np0000001583
May 28 01:56:22.469840 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:56:22.526094 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:56:22.526340 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:56:22.529184 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:56:22.543426 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:56:22.543751 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:56:22.560013 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:22.605213 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b, portal: 192.168.40.100,3260]
May 28 01:56:22.605213 np0000001583 nova-compute[98241]: Logout of [sid: 36, target: iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b, portal: 192.168.40.100,3260] successful.
May 28 01:56:22.605213 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:22.622764 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-af1138c0-f813-4e51-8a9c-a21f8e277b47 req-7f45936c-2849-4555-8054-78e15fc56bb0 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-vif-unplugged-dfa132bb-afe8-4b97-909b-816f3e916bfd {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:22.623018 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-af1138c0-f813-4e51-8a9c-a21f8e277b47 req-7f45936c-2849-4555-8054-78e15fc56bb0 service nova] Acquiring lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:22.623315 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-af1138c0-f813-4e51-8a9c-a21f8e277b47 req-7f45936c-2849-4555-8054-78e15fc56bb0 service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:22.623567 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-af1138c0-f813-4e51-8a9c-a21f8e277b47 req-7f45936c-2849-4555-8054-78e15fc56bb0 service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:22.623863 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-af1138c0-f813-4e51-8a9c-a21f8e277b47 req-7f45936c-2849-4555-8054-78e15fc56bb0 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] No waiting events found dispatching network-vif-unplugged-dfa132bb-afe8-4b97-909b-816f3e916bfd {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:56:22.624068 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-af1138c0-f813-4e51-8a9c-a21f8e277b47 req-7f45936c-2849-4555-8054-78e15fc56bb0 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-vif-unplugged-dfa132bb-afe8-4b97-909b-816f3e916bfd for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:56:22.624290 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-af1138c0-f813-4e51-8a9c-a21f8e277b47 req-7f45936c-2849-4555-8054-78e15fc56bb0 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-vif-unplugged-939862e4-4e68-484c-bbcd-95faf922a641 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:22.624557 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-af1138c0-f813-4e51-8a9c-a21f8e277b47 req-7f45936c-2849-4555-8054-78e15fc56bb0 service nova] Acquiring lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:22.624759 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-af1138c0-f813-4e51-8a9c-a21f8e277b47 req-7f45936c-2849-4555-8054-78e15fc56bb0 service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:22.624883 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-af1138c0-f813-4e51-8a9c-a21f8e277b47 req-7f45936c-2849-4555-8054-78e15fc56bb0 service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:22.625213 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-af1138c0-f813-4e51-8a9c-a21f8e277b47 req-7f45936c-2849-4555-8054-78e15fc56bb0 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] No waiting events found dispatching network-vif-unplugged-939862e4-4e68-484c-bbcd-95faf922a641 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:56:22.625213 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-af1138c0-f813-4e51-8a9c-a21f8e277b47 req-7f45936c-2849-4555-8054-78e15fc56bb0 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-vif-unplugged-939862e4-4e68-484c-bbcd-95faf922a641 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:56:22.625421 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-af1138c0-f813-4e51-8a9c-a21f8e277b47 req-7f45936c-2849-4555-8054-78e15fc56bb0 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-vif-unplugged-939862e4-4e68-484c-bbcd-95faf922a641 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:22.625699 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-af1138c0-f813-4e51-8a9c-a21f8e277b47 req-7f45936c-2849-4555-8054-78e15fc56bb0 service nova] Acquiring lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:22.625916 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-af1138c0-f813-4e51-8a9c-a21f8e277b47 req-7f45936c-2849-4555-8054-78e15fc56bb0 service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:22.626063 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-af1138c0-f813-4e51-8a9c-a21f8e277b47 req-7f45936c-2849-4555-8054-78e15fc56bb0 service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:22.626613 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-af1138c0-f813-4e51-8a9c-a21f8e277b47 req-7f45936c-2849-4555-8054-78e15fc56bb0 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] No waiting events found dispatching network-vif-unplugged-939862e4-4e68-484c-bbcd-95faf922a641 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:56:22.626753 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-af1138c0-f813-4e51-8a9c-a21f8e277b47 req-7f45936c-2849-4555-8054-78e15fc56bb0 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-vif-unplugged-939862e4-4e68-484c-bbcd-95faf922a641 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:56:22.626890 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-af1138c0-f813-4e51-8a9c-a21f8e277b47 req-7f45936c-2849-4555-8054-78e15fc56bb0 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-vif-unplugged-9ca5546d-4b44-4470-92d7-08800876e89b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:22.627063 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-af1138c0-f813-4e51-8a9c-a21f8e277b47 req-7f45936c-2849-4555-8054-78e15fc56bb0 service nova] Acquiring lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:22.627268 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-af1138c0-f813-4e51-8a9c-a21f8e277b47 req-7f45936c-2849-4555-8054-78e15fc56bb0 service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:22.627456 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-af1138c0-f813-4e51-8a9c-a21f8e277b47 req-7f45936c-2849-4555-8054-78e15fc56bb0 service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:22.627816 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-af1138c0-f813-4e51-8a9c-a21f8e277b47 req-7f45936c-2849-4555-8054-78e15fc56bb0 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] No waiting events found dispatching network-vif-unplugged-9ca5546d-4b44-4470-92d7-08800876e89b {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:56:22.627816 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-af1138c0-f813-4e51-8a9c-a21f8e277b47 req-7f45936c-2849-4555-8054-78e15fc56bb0 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-vif-unplugged-9ca5546d-4b44-4470-92d7-08800876e89b for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:56:22.627892 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-af1138c0-f813-4e51-8a9c-a21f8e277b47 req-7f45936c-2849-4555-8054-78e15fc56bb0 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-vif-unplugged-9ca5546d-4b44-4470-92d7-08800876e89b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:22.628543 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-af1138c0-f813-4e51-8a9c-a21f8e277b47 req-7f45936c-2849-4555-8054-78e15fc56bb0 service nova] Acquiring lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:22.628543 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-af1138c0-f813-4e51-8a9c-a21f8e277b47 req-7f45936c-2849-4555-8054-78e15fc56bb0 service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:22.628543 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-af1138c0-f813-4e51-8a9c-a21f8e277b47 req-7f45936c-2849-4555-8054-78e15fc56bb0 service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:22.628543 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-af1138c0-f813-4e51-8a9c-a21f8e277b47 req-7f45936c-2849-4555-8054-78e15fc56bb0 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] No waiting events found dispatching network-vif-unplugged-9ca5546d-4b44-4470-92d7-08800876e89b {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:56:22.628681 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-af1138c0-f813-4e51-8a9c-a21f8e277b47 req-7f45936c-2849-4555-8054-78e15fc56bb0 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-vif-unplugged-9ca5546d-4b44-4470-92d7-08800876e89b for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:56:22.628964 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-af1138c0-f813-4e51-8a9c-a21f8e277b47 req-7f45936c-2849-4555-8054-78e15fc56bb0 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-vif-unplugged-766c9d77-3578-4071-b0eb-f2a929ee0445 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:22.629303 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-af1138c0-f813-4e51-8a9c-a21f8e277b47 req-7f45936c-2849-4555-8054-78e15fc56bb0 service nova] Acquiring lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:22.629393 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-af1138c0-f813-4e51-8a9c-a21f8e277b47 req-7f45936c-2849-4555-8054-78e15fc56bb0 service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:22.629516 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-af1138c0-f813-4e51-8a9c-a21f8e277b47 req-7f45936c-2849-4555-8054-78e15fc56bb0 service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:22.629672 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-af1138c0-f813-4e51-8a9c-a21f8e277b47 req-7f45936c-2849-4555-8054-78e15fc56bb0 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] No waiting events found dispatching network-vif-unplugged-766c9d77-3578-4071-b0eb-f2a929ee0445 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:56:22.629830 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-af1138c0-f813-4e51-8a9c-a21f8e277b47 req-7f45936c-2849-4555-8054-78e15fc56bb0 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-vif-unplugged-766c9d77-3578-4071-b0eb-f2a929ee0445 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:56:22.630048 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-af1138c0-f813-4e51-8a9c-a21f8e277b47 req-7f45936c-2849-4555-8054-78e15fc56bb0 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-vif-unplugged-766c9d77-3578-4071-b0eb-f2a929ee0445 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:22.630234 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-af1138c0-f813-4e51-8a9c-a21f8e277b47 req-7f45936c-2849-4555-8054-78e15fc56bb0 service nova] Acquiring lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:22.630466 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-af1138c0-f813-4e51-8a9c-a21f8e277b47 req-7f45936c-2849-4555-8054-78e15fc56bb0 service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:22.630721 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-af1138c0-f813-4e51-8a9c-a21f8e277b47 req-7f45936c-2849-4555-8054-78e15fc56bb0 service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:22.630905 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-af1138c0-f813-4e51-8a9c-a21f8e277b47 req-7f45936c-2849-4555-8054-78e15fc56bb0 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] No waiting events found dispatching network-vif-unplugged-766c9d77-3578-4071-b0eb-f2a929ee0445 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:56:22.631003 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-af1138c0-f813-4e51-8a9c-a21f8e277b47 req-7f45936c-2849-4555-8054-78e15fc56bb0 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-vif-unplugged-766c9d77-3578-4071-b0eb-f2a929ee0445 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:56:22.631146 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-af1138c0-f813-4e51-8a9c-a21f8e277b47 req-7f45936c-2849-4555-8054-78e15fc56bb0 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-vif-unplugged-78c3c570-3a3b-484e-bc76-7d91862ff0d4 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:22.631319 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-af1138c0-f813-4e51-8a9c-a21f8e277b47 req-7f45936c-2849-4555-8054-78e15fc56bb0 service nova] Acquiring lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:22.632041 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-af1138c0-f813-4e51-8a9c-a21f8e277b47 req-7f45936c-2849-4555-8054-78e15fc56bb0 service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:22.632606 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-af1138c0-f813-4e51-8a9c-a21f8e277b47 req-7f45936c-2849-4555-8054-78e15fc56bb0 service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:22.632606 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-af1138c0-f813-4e51-8a9c-a21f8e277b47 req-7f45936c-2849-4555-8054-78e15fc56bb0 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] No waiting events found dispatching network-vif-unplugged-78c3c570-3a3b-484e-bc76-7d91862ff0d4 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:56:22.632606 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-af1138c0-f813-4e51-8a9c-a21f8e277b47 req-7f45936c-2849-4555-8054-78e15fc56bb0 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-vif-unplugged-78c3c570-3a3b-484e-bc76-7d91862ff0d4 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:56:22.633194 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:22.649246 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:22.694192 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b, portal: 192.168.50.100,3260]
May 28 01:56:22.694192 np0000001583 nova-compute[98241]: Logout of [sid: 37, target: iqn.2023-03.storpool.com:os--volume-7d62e380-a6af-45e6-aefa-214f97c0760b, portal: 192.168.50.100,3260] successful.
May 28 01:56:22.694192 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:22.719224 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:22.719489 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:56:22.719621 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] <== disconnect_volume: return (391ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:56:22.719787 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:56:22.720953 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:56:22.721338 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e', 'iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1319d85a-02ed-497c-a138-d2b9a5b28c6e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:56:22.721509 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:56:22.721897 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:56:22.722305 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e', 'iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1319d85a-02ed-497c-a138-d2b9a5b28c6e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:56:22.722542 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:56:22.756368 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:22.756368 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:22.756368 np0000001583 nova-compute[98241]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:56:22.756368 np0000001583 nova-compute[98241]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:56:22.756368 np0000001583 nova-compute[98241]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:22.756368 np0000001583 nova-compute[98241]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:22.756368 np0000001583 nova-compute[98241]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:22.756368 np0000001583 nova-compute[98241]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:22.756368 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:22.756368 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:22.756368 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:56:22.756644 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsi session list stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:22.756644 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:22.756644 np0000001583 nova-compute[98241]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:56:22.756644 np0000001583 nova-compute[98241]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e (non-flash)
May 28 01:56:22.756644 np0000001583 nova-compute[98241]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:22.756644 np0000001583 nova-compute[98241]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:22.756644 np0000001583 nova-compute[98241]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:22.756644 np0000001583 nova-compute[98241]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:22.756644 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:22.756644 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:22.756644 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:56:22.756644 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797', '39'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e', '40'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e', '41'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463', '44'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463', '45'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d', '47'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629', '48'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629', '49')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:56:22.756875 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e', '40')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:56:22.757611 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e', '41')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:56:22.758896 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724ec325800>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e'): ({'sdk'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:56:22.759091 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Removing multipathed devices sdk, sdj {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:56:22.759927 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Flush multipath device 3300000002baa3533 {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:56:22.798458 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:56:22.830099 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Object Instance<8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:56:22.830099 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:56:22.830099 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Start _get_guest_xml network_info=[{"id": "f242e691-1d28-43e0-b83a-2414c00958b8", "address": "fa:16:3e:5c:c2:5f", "network": {"id": "b31b6f30-3b80-465d-8203-e6f4c16c758c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1195490498-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.61", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1195490498-network", "vif_mac": "fa:16:3e:5c:c2:5f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "261e17e4ed4445c887b71a705d46ad7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf242e691-1d", "ovs_interfaceid": "f242e691-1d28-43e0-b83a-2414c00958b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f1345ee8-7bcb-4cdf-ba2b-affa1582cc10', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629', 'iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3bc9896c-bcd6-402c-8ce3-e94000d21629', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, 'status': 'reserved', 'instance': '8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4', 'attached_at': '', 'detached_at': '', 'volume_id': '3bc9896c-bcd6-402c-8ce3-e94000d21629', 'serial': '3bc9896c-bcd6-402c-8ce3-e94000d21629'}, 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'attachment_id': 'c7a775b9-9127-483c-a694-064dd9034e6b', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:56:22.830099 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lazy-loading 'resources' on Instance uuid 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:56:22.836454 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:56:22.882484 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Checking to see if SCSI volumes sdk, sdj have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:56:22.882693 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] SCSI volumes sdk, sdj have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:56:22.884309 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Checking to see if device paths {'sdk', 'sdj'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:56:22.898664 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Device paths {'sdk', 'sdj'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:56:22.899171 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:56:22.910946 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:22.950605 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e, portal: 192.168.40.100,3260]
May 28 01:56:22.950605 np0000001583 nova-compute[98241]: Logout of [sid: 40, target: iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e, portal: 192.168.40.100,3260] successful.
May 28 01:56:22.950605 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:22.975653 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:22.988317 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:23.026290 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:23.031959 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e, portal: 192.168.50.100,3260]
May 28 01:56:23.031959 np0000001583 nova-compute[98241]: Logout of [sid: 41, target: iqn.2023-03.storpool.com:os--volume-1319d85a-02ed-497c-a138-d2b9a5b28c6e, portal: 192.168.50.100,3260] successful.
May 28 01:56:23.031959 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:23.050247 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:23.050493 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:56:23.050685 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] <== disconnect_volume: return (328ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:56:23.050736 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:56:23.051024 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Deleting instance files /opt/stack/data/nova/instances/0cca8054-2a26-436f-93b8-ef28e452bd65_del
May 28 01:56:23.051614 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Deletion of /opt/stack/data/nova/instances/0cca8054-2a26-436f-93b8-ef28e452bd65_del complete
May 28 01:56:23.062020 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-70f2bb25-2c22-46a7-8c2f-b051add74cac req-eaa64d9f-7c16-4e11-8771-ef29f1841087 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-vif-unplugged-7896c8d5-ea83-4141-8344-6b557e45d6d1 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:23.062268 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-70f2bb25-2c22-46a7-8c2f-b051add74cac req-eaa64d9f-7c16-4e11-8771-ef29f1841087 service nova] Acquiring lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:23.062489 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-70f2bb25-2c22-46a7-8c2f-b051add74cac req-eaa64d9f-7c16-4e11-8771-ef29f1841087 service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:23.062637 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-70f2bb25-2c22-46a7-8c2f-b051add74cac req-eaa64d9f-7c16-4e11-8771-ef29f1841087 service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:23.062749 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-70f2bb25-2c22-46a7-8c2f-b051add74cac req-eaa64d9f-7c16-4e11-8771-ef29f1841087 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] No waiting events found dispatching network-vif-unplugged-7896c8d5-ea83-4141-8344-6b557e45d6d1 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:56:23.062856 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-70f2bb25-2c22-46a7-8c2f-b051add74cac req-eaa64d9f-7c16-4e11-8771-ef29f1841087 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-vif-unplugged-7896c8d5-ea83-4141-8344-6b557e45d6d1 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:56:23.062957 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-70f2bb25-2c22-46a7-8c2f-b051add74cac req-eaa64d9f-7c16-4e11-8771-ef29f1841087 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-vif-unplugged-d868b893-10e8-42d1-872f-bf4b9e8d3659 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:23.063168 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-70f2bb25-2c22-46a7-8c2f-b051add74cac req-eaa64d9f-7c16-4e11-8771-ef29f1841087 service nova] Acquiring lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:23.063759 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-70f2bb25-2c22-46a7-8c2f-b051add74cac req-eaa64d9f-7c16-4e11-8771-ef29f1841087 service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:23.064012 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-70f2bb25-2c22-46a7-8c2f-b051add74cac req-eaa64d9f-7c16-4e11-8771-ef29f1841087 service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:23.064149 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-70f2bb25-2c22-46a7-8c2f-b051add74cac req-eaa64d9f-7c16-4e11-8771-ef29f1841087 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] No waiting events found dispatching network-vif-unplugged-d868b893-10e8-42d1-872f-bf4b9e8d3659 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:56:23.064287 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-70f2bb25-2c22-46a7-8c2f-b051add74cac req-eaa64d9f-7c16-4e11-8771-ef29f1841087 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-vif-unplugged-d868b893-10e8-42d1-872f-bf4b9e8d3659 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:56:23.064440 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-70f2bb25-2c22-46a7-8c2f-b051add74cac req-eaa64d9f-7c16-4e11-8771-ef29f1841087 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-vif-unplugged-d868b893-10e8-42d1-872f-bf4b9e8d3659 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:23.064571 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-70f2bb25-2c22-46a7-8c2f-b051add74cac req-eaa64d9f-7c16-4e11-8771-ef29f1841087 service nova] Acquiring lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:23.064707 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-70f2bb25-2c22-46a7-8c2f-b051add74cac req-eaa64d9f-7c16-4e11-8771-ef29f1841087 service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:23.064805 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-70f2bb25-2c22-46a7-8c2f-b051add74cac req-eaa64d9f-7c16-4e11-8771-ef29f1841087 service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:23.065001 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-70f2bb25-2c22-46a7-8c2f-b051add74cac req-eaa64d9f-7c16-4e11-8771-ef29f1841087 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] No waiting events found dispatching network-vif-unplugged-d868b893-10e8-42d1-872f-bf4b9e8d3659 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:56:23.065001 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-70f2bb25-2c22-46a7-8c2f-b051add74cac req-eaa64d9f-7c16-4e11-8771-ef29f1841087 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-vif-unplugged-d868b893-10e8-42d1-872f-bf4b9e8d3659 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:56:23.336105 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Object Instance<8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:56:23.337197 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:56:23.339198 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-2789214', uuid='8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4'), owner=OwnerMeta(userid='b95b9664bbd944d3a55a061e1ec231ec', username='tempest-ServerStableDeviceRescueTest-1096447838-project-member', projectid='261e17e4ed4445c887b71a705d46ad7d', projectname='tempest-ServerStableDeviceRescueTest-1096447838'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f242e691-1d28-43e0-b83a-2414c00958b8", "address": "fa:16:3e:5c:c2:5f", "network": {"id": "b31b6f30-3b80-465d-8203-e6f4c16c758c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1195490498-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.61", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1195490498-network", "vif_mac": "fa:16:3e:5c:c2:5f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "261e17e4ed4445c887b71a705d46ad7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf242e691-1d", "ovs_interfaceid": "f242e691-1d28-43e0-b83a-2414c00958b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933383.3386219) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:56:23.340888 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:56:23.341477 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:56:23.342606 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:56:23.342921 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:56:23.345475 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:56:23.346007 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:56:23.346401 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:56:23.346621 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:56:23.346879 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:56:23.347110 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:56:23.347931 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:56:23.348213 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:56:23.351305 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:56:23.351484 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:56:23.351617 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:56:23.351939 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:56:23.351939 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:56:23.559420 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Took 3.50 seconds to destroy the instance on the hypervisor.
May 28 01:56:23.560237 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:56:23.560591 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:56:23.560743 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:56:23.561149 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:56:23.666540 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:56:23.854721 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Object Instance<8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:56:23.874953 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4/disk.config --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:23.966868 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-583130f7-1acf-4362-b72c-e9b6dc4e7667 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "587a002a-2b9c-4865-8ce2-088ad567c81b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:23.967285 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-583130f7-1acf-4362-b72c-e9b6dc4e7667 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "587a002a-2b9c-4865-8ce2-088ad567c81b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:23.985232 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4/disk.config --force-share --output=json" returned: 0 in 0.110s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:56:23.985456 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Acquiring lock "/opt/stack/data/nova/instances/8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:23.985675 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lock "/opt/stack/data/nova/instances/8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:23.986742 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lock "/opt/stack/data/nova/instances/8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:23.987255 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:56:23.987596 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629', 'iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3bc9896c-bcd6-402c-8ce3-e94000d21629', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:56:23.987765 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:56:23.988922 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:56:23.988922 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629', 'iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3bc9896c-bcd6-402c-8ce3-e94000d21629', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:56:24.005477 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:56:24.005907 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:56:24.006859 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:56:24.007501 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:56:24.008420 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:56:24.008805 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: node.startup = automatic
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: node.session.scan = manual
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:56:24.022365 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:56:24.022365 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: node.startup = automatic
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: node.session.scan = manual
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:56:24.034993 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:56:24.034993 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:24.046853 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:24.062343 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:24.072372 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:24.072372 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:24.072372 np0000001583 nova-compute[98241]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:24.072372 np0000001583 nova-compute[98241]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:24.072372 np0000001583 nova-compute[98241]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:24.072372 np0000001583 nova-compute[98241]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:24.072372 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:24.072372 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:24.072372 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:56:24.072652 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] iscsi session list stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:24.072652 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:24.072652 np0000001583 nova-compute[98241]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:24.072652 np0000001583 nova-compute[98241]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:24.072652 np0000001583 nova-compute[98241]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:24.072652 np0000001583 nova-compute[98241]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:24.072652 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:24.072652 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:24.072652 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:56:24.073020 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.066s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:56:24.073211 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:56:24.073942 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] HCTL ('19', '0', '0', 0) found on session 48 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:56:24.074054 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Scanning host 19 c: 0, t: 0, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:56:24.089914 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:24.089914 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:24.089914 np0000001583 nova-compute[98241]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:24.089914 np0000001583 nova-compute[98241]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:24.089914 np0000001583 nova-compute[98241]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:24.089914 np0000001583 nova-compute[98241]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:24.089914 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:24.089914 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:24.089914 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:56:24.090264 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] iscsi session list stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:24.090264 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:24.090264 np0000001583 nova-compute[98241]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:24.090264 np0000001583 nova-compute[98241]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:24.090264 np0000001583 nova-compute[98241]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:24.090264 np0000001583 nova-compute[98241]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:24.090264 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:24.090264 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:24.090264 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:56:24.093100 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.083s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:56:24.093100 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:56:24.093642 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] HCTL ('20', '0', '0', 0) found on session 49 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:56:24.093816 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Scanning host 20 c: 0, t: 0, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:56:24.095819 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Searching for a device in session 48 and hctl ('19', '0', '0', 0) yield: sdn {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:56:24.095987 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3bc9896c-bcd6-402c-8ce3-e94000d21629', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:56:24.105855 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Searching for a device in session 49 and hctl ('20', '0', '0', 0) yield: sdo {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:56:24.106268 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3bc9896c-bcd6-402c-8ce3-e94000d21629', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:56:24.190561 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:56:24.190810 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:56:24.443547 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:56:24.445030 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:56:24.445356 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Creating image(s)
May 28 01:56:24.445730 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Did not create local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 01:56:24.445937 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Ensure instance console log exists: /opt/stack/data/nova/instances/e4fd6c94-b2c8-4d2b-b89b-c715a30c1884/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:56:24.446291 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:24.446499 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:24.446655 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:24.447847 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Start _get_guest_xml network_info=[{"id": "f31bd559-b1fa-4de0-9abf-97d61aa6ffea", "address": "fa:16:3e:ad:d2:22", "network": {"id": "2ee43c4e-569f-4726-9700-add40d768203", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ba381dad8364a488a98b80c04cce8fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf31bd559-b1", "ovs_interfaceid": "f31bd559-b1fa-4de0-9abf-97d61aa6ffea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c', 'iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '161f7cd8-cf0d-4077-99da-a7d8bba6321c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'e4fd6c94-b2c8-4d2b-b89b-c715a30c1884', 'attached_at': '', 'detached_at': '', 'volume_id': '161f7cd8-cf0d-4077-99da-a7d8bba6321c', 'serial': '161f7cd8-cf0d-4077-99da-a7d8bba6321c'}, 'delete_on_termination': True, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'a5c77d2d-e62a-40ca-b3f5-78f2e58c6d2c', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:56:24.449718 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:56:24.451506 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-938986098', uuid='e4fd6c94-b2c8-4d2b-b89b-c715a30c1884'), owner=OwnerMeta(userid='c3a7b14e31ee40cf9e4f4bba084ccaa5', username='tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member', projectid='2ba381dad8364a488a98b80c04cce8fb', projectname='tempest-ServerBootFromVolumeStableRescueTest-1211567633'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f31bd559-b1fa-4de0-9abf-97d61aa6ffea", "address": "fa:16:3e:ad:d2:22", "network": {"id": "2ee43c4e-569f-4726-9700-add40d768203", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ba381dad8364a488a98b80c04cce8fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf31bd559-b1", "ovs_interfaceid": "f31bd559-b1fa-4de0-9abf-97d61aa6ffea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933384.4510722) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:56:24.452833 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:56:24.453313 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:56:24.454495 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:56:24.454790 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:56:24.455831 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:56:24.456355 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:56:24.456622 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:56:24.456812 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:56:24.457057 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:56:24.457262 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:56:24.457468 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:56:24.457724 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:56:24.457936 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:56:24.458591 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:56:24.458831 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:56:24.459146 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:56:24.475762 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:56:24.477031 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-583130f7-1acf-4362-b72c-e9b6dc4e7667 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Detaching volume eeb7082f-9899-40c8-ab6f-3d746680d463
May 28 01:56:24.481390 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c', 'iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '161f7cd8-cf0d-4077-99da-a7d8bba6321c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:56:24.481691 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:56:24.554029 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-583130f7-1acf-4362-b72c-e9b6dc4e7667 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Attempting to driver detach volume eeb7082f-9899-40c8-ab6f-3d746680d463 from mountpoint /dev/vdb
May 28 01:56:24.558213 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-583130f7-1acf-4362-b72c-e9b6dc4e7667 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Found disk vdb by alias ua-eeb7082f-9899-40c8-ab6f-3d746680d463 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:56:24.559564 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-583130f7-1acf-4362-b72c-e9b6dc4e7667 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Found disk vdb by alias ua-eeb7082f-9899-40c8-ab6f-3d746680d463 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:56:24.559967 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-583130f7-1acf-4362-b72c-e9b6dc4e7667 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Attempting to detach device vdb from instance 587a002a-2b9c-4865-8ce2-088ad567c81b from the persistent domain config. {{(pid=98241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 01:56:24.559967 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-583130f7-1acf-4362-b72c-e9b6dc4e7667 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:56:24.559967 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:56:24.559967 np0000001583 nova-compute[98241]:   <alias name="ua-eeb7082f-9899-40c8-ab6f-3d746680d463"/>
May 28 01:56:24.559967 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-3"/>
May 28 01:56:24.559967 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 01:56:24.559967 np0000001583 nova-compute[98241]:   <serial>eeb7082f-9899-40c8-ab6f-3d746680d463</serial>
May 28 01:56:24.559967 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 01:56:24.559967 np0000001583 nova-compute[98241]: </disk>
May 28 01:56:24.559967 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:56:24.567585 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-583130f7-1acf-4362-b72c-e9b6dc4e7667 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Successfully detached device vdb from instance 587a002a-2b9c-4865-8ce2-088ad567c81b from the persistent domain config.
May 28 01:56:24.567729 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-583130f7-1acf-4362-b72c-e9b6dc4e7667 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] (1/8): Attempting to detach device vdb with device alias ua-eeb7082f-9899-40c8-ab6f-3d746680d463 from instance 587a002a-2b9c-4865-8ce2-088ad567c81b from the live domain config. {{(pid=98241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 01:56:24.567992 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-583130f7-1acf-4362-b72c-e9b6dc4e7667 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:56:24.567992 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:56:24.567992 np0000001583 nova-compute[98241]:   <alias name="ua-eeb7082f-9899-40c8-ab6f-3d746680d463"/>
May 28 01:56:24.567992 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-3"/>
May 28 01:56:24.567992 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 01:56:24.567992 np0000001583 nova-compute[98241]:   <serial>eeb7082f-9899-40c8-ab6f-3d746680d463</serial>
May 28 01:56:24.567992 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 01:56:24.567992 np0000001583 nova-compute[98241]: </disk>
May 28 01:56:24.567992 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:56:24.694239 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:56:24.718861 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-1ae8573c-8ba4-48e4-afe2-0a4903a4a5b6 req-d0a6c034-bea0-4a90-8081-aaaa56b5ed58 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-vif-unplugged-78c3c570-3a3b-484e-bc76-7d91862ff0d4 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:24.719704 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-1ae8573c-8ba4-48e4-afe2-0a4903a4a5b6 req-d0a6c034-bea0-4a90-8081-aaaa56b5ed58 service nova] Acquiring lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:24.719977 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-1ae8573c-8ba4-48e4-afe2-0a4903a4a5b6 req-d0a6c034-bea0-4a90-8081-aaaa56b5ed58 service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:24.720026 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-1ae8573c-8ba4-48e4-afe2-0a4903a4a5b6 req-d0a6c034-bea0-4a90-8081-aaaa56b5ed58 service nova] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:24.720227 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-1ae8573c-8ba4-48e4-afe2-0a4903a4a5b6 req-d0a6c034-bea0-4a90-8081-aaaa56b5ed58 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] No waiting events found dispatching network-vif-unplugged-78c3c570-3a3b-484e-bc76-7d91862ff0d4 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:56:24.720368 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-1ae8573c-8ba4-48e4-afe2-0a4903a4a5b6 req-d0a6c034-bea0-4a90-8081-aaaa56b5ed58 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-vif-unplugged-78c3c570-3a3b-484e-bc76-7d91862ff0d4 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:56:25.007988 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:56:25.062470 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-071f5411-029c-4a4c-9139-d647edb31959 req-94d2cb24-74cd-4edc-9f83-e0f005ea58d1 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-vif-deleted-9ca5546d-4b44-4470-92d7-08800876e89b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:25.062680 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-071f5411-029c-4a4c-9139-d647edb31959 req-94d2cb24-74cd-4edc-9f83-e0f005ea58d1 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Neutron deleted interface 9ca5546d-4b44-4470-92d7-08800876e89b; detaching it from the instance and deleting it from the info cache
May 28 01:56:25.065497 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-071f5411-029c-4a4c-9139-d647edb31959 req-94d2cb24-74cd-4edc-9f83-e0f005ea58d1 service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Detach interface failed, port_id=9ca5546d-4b44-4470-92d7-08800876e89b, reason: Instance 0cca8054-2a26-436f-93b8-ef28e452bd65 could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:56:25.200480 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Received event <DeviceRemovedEvent: 1779933385.199284, 587a002a-2b9c-4865-8ce2-088ad567c81b => ua-eeb7082f-9899-40c8-ab6f-3d746680d463> from libvirt while the driver is waiting for it; dispatched. {{(pid=98241) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 01:56:25.200923 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-583130f7-1acf-4362-b72c-e9b6dc4e7667 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-eeb7082f-9899-40c8-ab6f-3d746680d463 for instance 587a002a-2b9c-4865-8ce2-088ad567c81b {{(pid=98241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 01:56:25.203878 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-583130f7-1acf-4362-b72c-e9b6dc4e7667 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Successfully detached device vdb from instance 587a002a-2b9c-4865-8ce2-088ad567c81b from the live domain config.
May 28 01:56:25.205727 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.766s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:25.206330 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:56:25.209874 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-583130f7-1acf-4362-b72c-e9b6dc4e7667 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:56:25.209874 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-583130f7-1acf-4362-b72c-e9b6dc4e7667 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463', 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'eeb7082f-9899-40c8-ab6f-3d746680d463', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:56:25.209874 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-583130f7-1acf-4362-b72c-e9b6dc4e7667 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:56:25.351240 np0000001583 nova-compute[98241]: INFO nova.network.neutron [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Updating port 2bb36d37-52de-4dcf-abb4-35b15f363457 with attributes {'binding:host_id': 'np0000001583', 'device_owner': 'compute:nova'}
May 28 01:56:25.445027 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:56:25.445388 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:56:25.445748 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:56:25.445833 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:56:25.446011 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:56:25.446189 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:56:25.446566 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:56:25.446566 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 01:56:25.446683 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:56:25.951999 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:25.952424 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:25.952592 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:25.952792 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Auditing locally available compute resources for np0000001583 (node: np0000001583) {{(pid=98241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 01:56:26.032466 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Found WWN 33000000033e0ca3f for multipath device dm-10 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:56:26.032466 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.044s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:56:26.032466 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] <== connect_volume: return (2044ms) {'type': 'block', 'scsi_wwn': '33000000033e0ca3f', 'path': '/dev/dm-10', 'multipath_id': '33000000033e0ca3f'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:56:26.032466 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000033e0ca3f', 'path': '/dev/dm-10', 'multipath_id': '33000000033e0ca3f'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:56:26.034869 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.553s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:56:26.034971 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c', 'iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '161f7cd8-cf0d-4077-99da-a7d8bba6321c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:56:26.049679 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:56:26.050538 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:56:26.051092 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:56:26.051339 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:56:26.051805 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:56:26.052521 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:56:26.065038 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:56:26.065038 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:26.071502 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:56:26.071502 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:26.077683 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c] added
May 28 01:56:26.077683 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:56:26.077683 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:56:26.077683 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:56:26.077683 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:56:26.077683 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:56:26.077683 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:26.078019 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:56:26.079183 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0267(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:56:26.079183 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:56:26.084332 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c] added
May 28 01:56:26.084332 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:56:26.084332 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:56:26.084332 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:56:26.084332 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:56:26.084332 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:56:26.084332 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:26.084332 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:56:26.084332 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0321(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:56:26.084332 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:56:26.095957 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Acquiring lock "refresh_cache-ea9459ae-6246-4d11-b46b-733449884b1b" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:56:26.096069 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Acquired lock "refresh_cache-ea9459ae-6246-4d11-b46b-733449884b1b" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:56:26.096195 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:56:26.157239 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-db2459ae-2f3c-4cd8-a875-b89f92bade43 req-17793c88-f3a0-40fb-87d1-964bbb632e5e service nova] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Received event network-changed-2bb36d37-52de-4dcf-abb4-35b15f363457 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:26.157714 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-db2459ae-2f3c-4cd8-a875-b89f92bade43 req-17793c88-f3a0-40fb-87d1-964bbb632e5e service nova] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Refreshing instance network info cache due to event network-changed-2bb36d37-52de-4dcf-abb4-35b15f363457. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:56:26.157923 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-db2459ae-2f3c-4cd8-a875-b89f92bade43 req-17793c88-f3a0-40fb-87d1-964bbb632e5e service nova] Acquiring lock "refresh_cache-ea9459ae-6246-4d11-b46b-733449884b1b" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:56:26.486824 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Acquiring lock "df5768dc-874f-4725-b2a2-e007aebc11a9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:26.486824 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Lock "df5768dc-874f-4725-b2a2-e007aebc11a9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:26.486824 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Acquiring lock "df5768dc-874f-4725-b2a2-e007aebc11a9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:26.486824 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Lock "df5768dc-874f-4725-b2a2-e007aebc11a9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:26.486824 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Lock "df5768dc-874f-4725-b2a2-e007aebc11a9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:26.489966 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Terminating instance
May 28 01:56:26.540709 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:54:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2789214',display_name='tempest-ServerStableDeviceRescueTest-server-2789214',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-serverstabledevicerescuetest-server-2789214',id=19,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN0i9Cbg/YfGFJTMA6Mjy+1949HN9zlsGRESiP6RbbKnMnzjD65aO38IDSCgwyQVXHEZs/nSr/IWCD0NrFHvkF+28T0YYBxOg7wkJVfd52pVGPBaDLMkFt5gcpkneL3l6g==',key_name='tempest-keypair-109338498',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:55:16Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='261e17e4ed4445c887b71a705d46ad7d',ramdisk_id='',reservation_id='r-6j08k7e9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1096447838',owner_user_name='tempest-ServerStableDeviceRescueTest-1096447838-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:56:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b95b9664bbd944d3a55a061e1ec231ec',uuid=8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f242e691-1d28-43e0-b83a-2414c00958b8", "address": "fa:16:3e:5c:c2:5f", "network": {"id": "b31b6f30-3b80-465d-8203-e6f4c16c758c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1195490498-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.61", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1195490498-network", "vif_mac": "fa:16:3e:5c:c2:5f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "261e17e4ed4445c887b71a705d46ad7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf242e691-1d", "ovs_interfaceid": "f242e691-1d28-43e0-b83a-2414c00958b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:56:26.540932 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Converting VIF {"id": "f242e691-1d28-43e0-b83a-2414c00958b8", "address": "fa:16:3e:5c:c2:5f", "network": {"id": "b31b6f30-3b80-465d-8203-e6f4c16c758c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1195490498-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.61", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1195490498-network", "vif_mac": "fa:16:3e:5c:c2:5f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "261e17e4ed4445c887b71a705d46ad7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf242e691-1d", "ovs_interfaceid": "f242e691-1d28-43e0-b83a-2414c00958b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:56:26.541565 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:c2:5f,bridge_name='br-int',has_traffic_filtering=True,id=f242e691-1d28-43e0-b83a-2414c00958b8,network=Network(b31b6f30-3b80-465d-8203-e6f4c16c758c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf242e691-1d') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:56:26.542312 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:56:26.598100 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:56:26.711107 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:56:26.816372 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0fcafc10-f289-4e12-8e8f-92f7794c9644 req-8e3f243a-4269-45ef-987c-7d3257f0985a service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-vif-deleted-d868b893-10e8-42d1-872f-bf4b9e8d3659 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:26.816372 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0fcafc10-f289-4e12-8e8f-92f7794c9644 req-8e3f243a-4269-45ef-987c-7d3257f0985a service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-vif-deleted-78c3c570-3a3b-484e-bc76-7d91862ff0d4 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:26.816372 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0fcafc10-f289-4e12-8e8f-92f7794c9644 req-8e3f243a-4269-45ef-987c-7d3257f0985a service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-vif-deleted-dfa132bb-afe8-4b97-909b-816f3e916bfd {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:26.858033 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:26.954614 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:56:26.993880 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:56:27.008644 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/587a002a-2b9c-4865-8ce2-088ad567c81b/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:27.028046 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:27.040697 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:27.045273 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Object Instance<8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:56:27.047424 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] End _get_guest_xml xml=<domain type="qemu">
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:   <uuid>8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4</uuid>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:   <name>instance-00000013</name>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-2789214</nova:name>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:56:23</nova:creationTime>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:         <nova:user uuid="b95b9664bbd944d3a55a061e1ec231ec">tempest-ServerStableDeviceRescueTest-1096447838-project-member</nova:user>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:         <nova:project uuid="261e17e4ed4445c887b71a705d46ad7d">tempest-ServerStableDeviceRescueTest-1096447838</nova:project>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:         <nova:port uuid="f242e691-1d28-43e0-b83a-2414c00958b8">
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:     <system>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:       <entry name="serial">8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4</entry>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:       <entry name="uuid">8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4</entry>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:     </system>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:   <os>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:   </os>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:   <features>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:   </features>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:   <devices>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4/disk"/>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:     </disk>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4/disk.config"/>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:     </disk>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:     <disk type="block" device="disk">
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:       <alias name="ua-3bc9896c-bcd6-402c-8ce3-e94000d21629"/>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:       <source dev="/dev/dm-10"/>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:       <target dev="vdb" bus="virtio"/>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:       <serial>3bc9896c-bcd6-402c-8ce3-e94000d21629</serial>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:     </disk>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4/disk.rescue"/>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:       <target dev="vdc" bus="virtio"/>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:       <boot order="1"/>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:     </disk>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:5c:c2:5f"/>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:       <target dev="tapf242e691-1d"/>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:     </interface>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4/console.log" append="off"/>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:     </serial>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:     <video>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:     </video>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:     </rng>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:   </devices>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]: </domain>
May 28 01:56:27.047424 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:56:27.053550 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:27.067642 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Instance destroyed successfully.
May 28 01:56:27.080586 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:56:27.085719 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:27.085719 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:56:27.104227 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:56:27.104227 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:56:27.109122 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:56:27.109122 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:27.121821 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:27.124720 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:27.125167 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/587a002a-2b9c-4865-8ce2-088ad567c81b/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:56:27.127844 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/587a002a-2b9c-4865-8ce2-088ad567c81b/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:27.151734 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-c33af352-b20f-40ae-95a4-ec9af135dde9 req-d4ec7469-fc66-49da-9188-95f5b2a9862d service nova] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Received event network-changed-d6c3c5f3-e20b-4b3e-abac-62f21007a7ad {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:27.152912 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:27.152912 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:27.152912 np0000001583 nova-compute[98241]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:27.152912 np0000001583 nova-compute[98241]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:27.152912 np0000001583 nova-compute[98241]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:27.152912 np0000001583 nova-compute[98241]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:27.152912 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:27.152912 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:27.152912 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:56:27.154019 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-c33af352-b20f-40ae-95a4-ec9af135dde9 req-d4ec7469-fc66-49da-9188-95f5b2a9862d service nova] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Refreshing instance network info cache due to event network-changed-d6c3c5f3-e20b-4b3e-abac-62f21007a7ad. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:56:27.154802 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:27.154802 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:27.154802 np0000001583 nova-compute[98241]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:27.154802 np0000001583 nova-compute[98241]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:27.154802 np0000001583 nova-compute[98241]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:27.154802 np0000001583 nova-compute[98241]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:27.154802 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:27.154802 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:27.154802 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:56:27.155097 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsi session list stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:27.155097 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:27.155097 np0000001583 nova-compute[98241]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:27.155097 np0000001583 nova-compute[98241]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:27.155097 np0000001583 nova-compute[98241]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:27.155097 np0000001583 nova-compute[98241]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:27.155097 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:27.155097 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:27.155097 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:56:27.155632 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c33af352-b20f-40ae-95a4-ec9af135dde9 req-d4ec7469-fc66-49da-9188-95f5b2a9862d service nova] Acquiring lock "refresh_cache-df5768dc-874f-4725-b2a2-e007aebc11a9" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:56:27.156720 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsi session list stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:27.156720 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:27.156720 np0000001583 nova-compute[98241]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:27.156720 np0000001583 nova-compute[98241]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:27.156720 np0000001583 nova-compute[98241]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:27.156720 np0000001583 nova-compute[98241]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:27.156720 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:27.156720 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:27.156720 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:56:27.157086 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c33af352-b20f-40ae-95a4-ec9af135dde9 req-d4ec7469-fc66-49da-9188-95f5b2a9862d service nova] Acquired lock "refresh_cache-df5768dc-874f-4725-b2a2-e007aebc11a9" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:56:27.157424 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-c33af352-b20f-40ae-95a4-ec9af135dde9 req-d4ec7469-fc66-49da-9188-95f5b2a9862d service nova] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Refreshing network info cache for port d6c3c5f3-e20b-4b3e-abac-62f21007a7ad {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:56:27.195294 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Updating instance_info_cache with network_info: [{"id": "2bb36d37-52de-4dcf-abb4-35b15f363457", "address": "fa:16:3e:86:7e:a1", "network": {"id": "34ab0ff0-75dd-45e7-97f6-22f8e62a8149", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1222751470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d31342458ec4ed2890a766f62facbcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb36d37-52", "ovs_interfaceid": "2bb36d37-52de-4dcf-abb4-35b15f363457", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:56:27.213108 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c, portal: 192.168.50.100,3260]
May 28 01:56:27.213108 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c, portal: 192.168.50.100,3260] successful.
May 28 01:56:27.213108 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:27.213416 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Took 3.65 seconds to deallocate network for instance.
May 28 01:56:27.220953 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c, portal: 192.168.40.100,3260]
May 28 01:56:27.220953 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c, portal: 192.168.40.100,3260] successful.
May 28 01:56:27.220953 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:27.230804 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/587a002a-2b9c-4865-8ce2-088ad567c81b/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:56:27.231095 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:27.234958 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c36895c-9d2c-49be-b545-3658f535964a/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:27.253914 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:27.257157 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:27.257157 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:27.257157 np0000001583 nova-compute[98241]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:27.257157 np0000001583 nova-compute[98241]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:27.257157 np0000001583 nova-compute[98241]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:27.257157 np0000001583 nova-compute[98241]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:27.257157 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:27.257157 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:27.257157 np0000001583 nova-compute[98241]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:27.257157 np0000001583 nova-compute[98241]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:27.257157 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:56:27.257624 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsi session list stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:27.257624 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:27.257624 np0000001583 nova-compute[98241]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:27.257624 np0000001583 nova-compute[98241]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:27.257624 np0000001583 nova-compute[98241]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:27.257624 np0000001583 nova-compute[98241]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:27.257624 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:27.257624 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:27.257624 np0000001583 nova-compute[98241]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:27.257624 np0000001583 nova-compute[98241]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:27.257624 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:56:27.258549 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.207s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:56:27.258763 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:56:27.260670 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] HCTL ('7', '-', '-', 0) found on session 50 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:56:27.260833 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:56:27.281634 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:27.281634 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:27.281634 np0000001583 nova-compute[98241]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:27.281634 np0000001583 nova-compute[98241]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:27.281634 np0000001583 nova-compute[98241]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:27.281634 np0000001583 nova-compute[98241]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:27.281634 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:27.281634 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:27.281634 np0000001583 nova-compute[98241]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:27.281634 np0000001583 nova-compute[98241]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:27.281634 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:56:27.281634 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsi session list stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:27.281634 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:27.281634 np0000001583 nova-compute[98241]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:27.281634 np0000001583 nova-compute[98241]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:27.281634 np0000001583 nova-compute[98241]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:27.281634 np0000001583 nova-compute[98241]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:27.281634 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:27.281634 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:27.281634 np0000001583 nova-compute[98241]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:27.281634 np0000001583 nova-compute[98241]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:27.281634 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:56:27.281634 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.227s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:56:27.281634 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:56:27.281634 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Searching for a device in session 50 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:56:27.281634 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '161f7cd8-cf0d-4077-99da-a7d8bba6321c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:56:27.283586 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] HCTL ('8', '-', '-', 0) found on session 51 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:56:27.283777 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:56:27.313361 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Searching for a device in session 51 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:56:27.313361 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '161f7cd8-cf0d-4077-99da-a7d8bba6321c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:56:27.333847 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:27.340857 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c36895c-9d2c-49be-b545-3658f535964a/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:56:27.341992 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c36895c-9d2c-49be-b545-3658f535964a/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:27.361881 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:27.370809 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.998950921999949 future=<Future at 0x7724ec37ec60 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:56:27.376887 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Instance destroyed successfully.
May 28 01:56:27.377879 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Lazy-loading 'resources' on Instance uuid df5768dc-874f-4725-b2a2-e007aebc11a9 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:56:27.464132 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c36895c-9d2c-49be-b545-3658f535964a/disk --force-share --output=json" returned: 0 in 0.122s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:56:27.467496 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:27.562112 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:56:27.563784 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:27.661293 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-c33af352-b20f-40ae-95a4-ec9af135dde9 req-d4ec7469-fc66-49da-9188-95f5b2a9862d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:56:27.664756 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:56:27.668349 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a73c95-ff10-4b74-9ab8-4014a244a7d3/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:27.700300 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Releasing lock "refresh_cache-ea9459ae-6246-4d11-b46b-733449884b1b" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:56:27.703398 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:56:27.703759 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-db2459ae-2f3c-4cd8-a875-b89f92bade43 req-17793c88-f3a0-40fb-87d1-964bbb632e5e service nova] Acquired lock "refresh_cache-ea9459ae-6246-4d11-b46b-733449884b1b" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:56:27.704014 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-db2459ae-2f3c-4cd8-a875-b89f92bade43 req-17793c88-f3a0-40fb-87d1-964bbb632e5e service nova] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Refreshing network info cache for port 2bb36d37-52de-4dcf-abb4-35b15f363457 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:56:27.706670 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Creating image(s)
May 28 01:56:27.707641 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Acquiring lock "/opt/stack/data/nova/instances/ea9459ae-6246-4d11-b46b-733449884b1b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:27.707967 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "/opt/stack/data/nova/instances/ea9459ae-6246-4d11-b46b-733449884b1b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:27.708957 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "/opt/stack/data/nova/instances/ea9459ae-6246-4d11-b46b-733449884b1b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:27.709197 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lazy-loading 'trusted_certs' on Instance uuid ea9459ae-6246-4d11-b46b-733449884b1b {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:56:27.766156 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a73c95-ff10-4b74-9ab8-4014a244a7d3/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:56:27.766658 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a73c95-ff10-4b74-9ab8-4014a244a7d3/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:27.868946 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a73c95-ff10-4b74-9ab8-4014a244a7d3/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:56:27.873640 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/dm-4 (vda) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:56:27.875057 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/dm-7 (vda) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:56:27.877060 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:27.899063 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T01:54:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2097870267',display_name='tempest-TestShelveInstance-server-2097870267',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testshelveinstance-server-2097870267',id=12,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL46Secb60DFBeK7FYqoi8EyIkwOHDasdwHPDEkahIVyxNd9me+C0BL02CY5OdHq98hox5RGNtNExMA3lQLKOE6SZ9TSLqEp13Ql4Ayf4q9cLQMDfsak90PHfcn9GypAaA==',key_name='tempest-TestShelveInstance-1311460250',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:55:47Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fa147b7a97664129bc2922ee1e8debc6',ramdisk_id='',reservation_id='r-yyloknk0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',owner_project_name='tempest-TestShelveInstance-1732527786',owner_user_name='tempest-TestShelveInstance-1732527786-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:55:48Z,user_data=None,user_id='21c5bf800ee04e06a7ce6dfd95173502',uuid=df5768dc-874f-4725-b2a2-e007aebc11a9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6c3c5f3-e20b-4b3e-abac-62f21007a7ad", "address": "fa:16:3e:28:95:8e", "network": {"id": "5e77962e-bcd9-4ce2-89c8-2a3c2cbd75a0", "bridge": "br-int", "label": "tempest-TestShelveInstance-351174513-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fa147b7a97664129bc2922ee1e8debc6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c3c5f3-e2", "ovs_interfaceid": "d6c3c5f3-e20b-4b3e-abac-62f21007a7ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:56:27.899958 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Converting VIF {"id": "d6c3c5f3-e20b-4b3e-abac-62f21007a7ad", "address": "fa:16:3e:28:95:8e", "network": {"id": "5e77962e-bcd9-4ce2-89c8-2a3c2cbd75a0", "bridge": "br-int", "label": "tempest-TestShelveInstance-351174513-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fa147b7a97664129bc2922ee1e8debc6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c3c5f3-e2", "ovs_interfaceid": "d6c3c5f3-e20b-4b3e-abac-62f21007a7ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:56:27.902182 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:95:8e,bridge_name='br-int',has_traffic_filtering=True,id=d6c3c5f3-e20b-4b3e-abac-62f21007a7ad,network=Network(5e77962e-bcd9-4ce2-89c8-2a3c2cbd75a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6c3c5f3-e2') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:56:27.902679 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:95:8e,bridge_name='br-int',has_traffic_filtering=True,id=d6c3c5f3-e20b-4b3e-abac-62f21007a7ad,network=Network(5e77962e-bcd9-4ce2-89c8-2a3c2cbd75a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6c3c5f3-e2') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:56:27.906147 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:27.906742 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6c3c5f3-e2, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:56:27.909667 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:27.910894 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:56:27.916063 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:27.917767 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:27.917984 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=90565f86-c348-4339-95f5-673ec8be0bec) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:56:27.919243 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:56:27.925407 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:27.929673 np0000001583 nova-compute[98241]: INFO os_vif [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:95:8e,bridge_name='br-int',has_traffic_filtering=True,id=d6c3c5f3-e20b-4b3e-abac-62f21007a7ad,network=Network(5e77962e-bcd9-4ce2-89c8-2a3c2cbd75a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6c3c5f3-e2')
May 28 01:56:27.935961 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:56:27.936372 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d', 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9b421209-954a-413c-bf2c-892d99f40d2d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:56:27.936533 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:56:27.987294 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:56:27.991102 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:28.028772 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:28.048859 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-c33af352-b20f-40ae-95a4-ec9af135dde9 req-d4ec7469-fc66-49da-9188-95f5b2a9862d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:56:28.055106 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:56:28.073696 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:56:28.077116 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/dm-10 (vdb) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:56:28.077116 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4/disk.rescue --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:28.183320 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4/disk.rescue --force-share --output=json" returned: 0 in 0.108s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:56:28.187308 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4/disk.rescue --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:28.212141 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-c33af352-b20f-40ae-95a4-ec9af135dde9 req-d4ec7469-fc66-49da-9188-95f5b2a9862d service nova] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Updated VIF entry in instance network info cache for port d6c3c5f3-e20b-4b3e-abac-62f21007a7ad. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:56:28.212652 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-c33af352-b20f-40ae-95a4-ec9af135dde9 req-d4ec7469-fc66-49da-9188-95f5b2a9862d service nova] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Updating instance_info_cache with network_info: [{"id": "d6c3c5f3-e20b-4b3e-abac-62f21007a7ad", "address": "fa:16:3e:28:95:8e", "network": {"id": "5e77962e-bcd9-4ce2-89c8-2a3c2cbd75a0", "bridge": "br-int", "label": "tempest-TestShelveInstance-351174513-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fa147b7a97664129bc2922ee1e8debc6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c3c5f3-e2", "ovs_interfaceid": "d6c3c5f3-e20b-4b3e-abac-62f21007a7ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:56:28.216305 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-db2459ae-2f3c-4cd8-a875-b89f92bade43 req-17793c88-f3a0-40fb-87d1-964bbb632e5e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:56:28.220995 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Object Instance<ea9459ae-6246-4d11-b46b-733449884b1b> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:56:28.221828 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Acquiring lock "68eb2642ce949fc71df161507beab4c8318cb427" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:28.222766 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "68eb2642ce949fc71df161507beab4c8318cb427" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:28.269803 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4/disk.rescue --force-share --output=json" returned: 0 in 0.086s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:56:28.275103 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c911c7-ae44-4902-989f-3f0655243f3f/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:28.375970 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c911c7-ae44-4902-989f-3f0655243f3f/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:56:28.376759 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c911c7-ae44-4902-989f-3f0655243f3f/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:28.501207 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c911c7-ae44-4902-989f-3f0655243f3f/disk --force-share --output=json" returned: 0 in 0.123s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:56:28.506410 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:56:28.506410 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:28.556902 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.050s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:56:28.559691 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Hypervisor/Node resource view: name=np0000001583 free_ram=12014MB free_disk=73.97340774536133GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 01:56:28.559691 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:28.559691 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:28.605844 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:56:28.606005 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:56:28.606165 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:56:28.606292 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:56:28.606454 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] No VIF found with MAC fa:16:3e:5c:c2:5f, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:56:28.607325 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Using config drive
May 28 01:56:28.718515 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-db2459ae-2f3c-4cd8-a875-b89f92bade43 req-17793c88-f3a0-40fb-87d1-964bbb632e5e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:56:28.723182 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c33af352-b20f-40ae-95a4-ec9af135dde9 req-d4ec7469-fc66-49da-9188-95f5b2a9862d service nova] Releasing lock "refresh_cache-df5768dc-874f-4725-b2a2-e007aebc11a9" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:56:28.723539 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-c33af352-b20f-40ae-95a4-ec9af135dde9 req-d4ec7469-fc66-49da-9188-95f5b2a9862d service nova] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Received event network-vif-deleted-766c9d77-3578-4071-b0eb-f2a929ee0445 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:28.925940 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ef6bc752-2392-450c-9e52-83629a0ce97c req-8c00f167-146e-42c2-a7d9-a827d0c802d3 service nova] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Received event network-vif-unplugged-d6c3c5f3-e20b-4b3e-abac-62f21007a7ad {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:28.925940 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ef6bc752-2392-450c-9e52-83629a0ce97c req-8c00f167-146e-42c2-a7d9-a827d0c802d3 service nova] Acquiring lock "df5768dc-874f-4725-b2a2-e007aebc11a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:28.925940 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ef6bc752-2392-450c-9e52-83629a0ce97c req-8c00f167-146e-42c2-a7d9-a827d0c802d3 service nova] Lock "df5768dc-874f-4725-b2a2-e007aebc11a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:28.925940 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ef6bc752-2392-450c-9e52-83629a0ce97c req-8c00f167-146e-42c2-a7d9-a827d0c802d3 service nova] Lock "df5768dc-874f-4725-b2a2-e007aebc11a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:28.927537 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ef6bc752-2392-450c-9e52-83629a0ce97c req-8c00f167-146e-42c2-a7d9-a827d0c802d3 service nova] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] No waiting events found dispatching network-vif-unplugged-d6c3c5f3-e20b-4b3e-abac-62f21007a7ad {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:56:28.927937 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ef6bc752-2392-450c-9e52-83629a0ce97c req-8c00f167-146e-42c2-a7d9-a827d0c802d3 service nova] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Received event network-vif-unplugged-d6c3c5f3-e20b-4b3e-abac-62f21007a7ad for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:56:28.930534 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ef6bc752-2392-450c-9e52-83629a0ce97c req-8c00f167-146e-42c2-a7d9-a827d0c802d3 service nova] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Received event network-vif-unplugged-d6c3c5f3-e20b-4b3e-abac-62f21007a7ad {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:28.931181 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ef6bc752-2392-450c-9e52-83629a0ce97c req-8c00f167-146e-42c2-a7d9-a827d0c802d3 service nova] Acquiring lock "df5768dc-874f-4725-b2a2-e007aebc11a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:28.931794 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ef6bc752-2392-450c-9e52-83629a0ce97c req-8c00f167-146e-42c2-a7d9-a827d0c802d3 service nova] Lock "df5768dc-874f-4725-b2a2-e007aebc11a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:28.932163 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ef6bc752-2392-450c-9e52-83629a0ce97c req-8c00f167-146e-42c2-a7d9-a827d0c802d3 service nova] Lock "df5768dc-874f-4725-b2a2-e007aebc11a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:28.932321 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ef6bc752-2392-450c-9e52-83629a0ce97c req-8c00f167-146e-42c2-a7d9-a827d0c802d3 service nova] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] No waiting events found dispatching network-vif-unplugged-d6c3c5f3-e20b-4b3e-abac-62f21007a7ad {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:56:28.932446 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ef6bc752-2392-450c-9e52-83629a0ce97c req-8c00f167-146e-42c2-a7d9-a827d0c802d3 service nova] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Received event network-vif-unplugged-d6c3c5f3-e20b-4b3e-abac-62f21007a7ad for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:56:28.946035 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Took 1.73 seconds to detach 3 volumes for instance.
May 28 01:56:28.951934 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-db2459ae-2f3c-4cd8-a875-b89f92bade43 req-17793c88-f3a0-40fb-87d1-964bbb632e5e service nova] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Updated VIF entry in instance network info cache for port 2bb36d37-52de-4dcf-abb4-35b15f363457. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:56:28.951934 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-db2459ae-2f3c-4cd8-a875-b89f92bade43 req-17793c88-f3a0-40fb-87d1-964bbb632e5e service nova] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Updating instance_info_cache with network_info: [{"id": "2bb36d37-52de-4dcf-abb4-35b15f363457", "address": "fa:16:3e:86:7e:a1", "network": {"id": "34ab0ff0-75dd-45e7-97f6-22f8e62a8149", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1222751470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d31342458ec4ed2890a766f62facbcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb36d37-52", "ovs_interfaceid": "2bb36d37-52de-4dcf-abb4-35b15f363457", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:56:29.074995 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Found WWN 33000000093bcf41a for multipath device dm-0 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:56:29.075632 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:56:29.075632 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] <== connect_volume: return (4593ms) {'type': 'block', 'scsi_wwn': '33000000093bcf41a', 'path': '/dev/dm-0', 'multipath_id': '33000000093bcf41a'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:56:29.075872 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000093bcf41a', 'path': '/dev/dm-0', 'multipath_id': '33000000093bcf41a'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:56:29.077779 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-583130f7-1acf-4362-b72c-e9b6dc4e7667 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 3.868s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:56:29.080058 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-583130f7-1acf-4362-b72c-e9b6dc4e7667 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463', 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'eeb7082f-9899-40c8-ab6f-3d746680d463', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:56:29.081360 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-583130f7-1acf-4362-b72c-e9b6dc4e7667 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:56:29.111750 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lazy-loading 'ec2_ids' on Instance uuid 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:56:29.119198 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-583130f7-1acf-4362-b72c-e9b6dc4e7667 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:29.119198 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:29.119198 np0000001583 nova-compute[98241]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:29.119198 np0000001583 nova-compute[98241]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:29.119198 np0000001583 nova-compute[98241]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:29.119198 np0000001583 nova-compute[98241]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:29.119198 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:29.119198 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:29.119198 np0000001583 nova-compute[98241]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:29.119198 np0000001583 nova-compute[98241]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:29.119198 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:56:29.119698 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-583130f7-1acf-4362-b72c-e9b6dc4e7667 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsi session list stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:29.119698 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:29.119698 np0000001583 nova-compute[98241]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:29.119698 np0000001583 nova-compute[98241]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463 (non-flash)
May 28 01:56:29.119698 np0000001583 nova-compute[98241]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:29.119698 np0000001583 nova-compute[98241]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:29.119698 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:29.119698 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:29.119698 np0000001583 nova-compute[98241]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:29.119698 np0000001583 nova-compute[98241]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:29.119698 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:56:29.119698 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-583130f7-1acf-4362-b72c-e9b6dc4e7667 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463', '44'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463', '45'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d', '47'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629', '48'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629', '49'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c', '50'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c', '51')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:56:29.119698 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-583130f7-1acf-4362-b72c-e9b6dc4e7667 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463', '45')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:56:29.122289 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-583130f7-1acf-4362-b72c-e9b6dc4e7667 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463', '44')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:56:29.125534 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-583130f7-1acf-4362-b72c-e9b6dc4e7667 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724ec1eb880>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463'): ({'sde'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:56:29.125870 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-583130f7-1acf-4362-b72c-e9b6dc4e7667 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Removing multipathed devices sdd, sde {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:56:29.126811 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-583130f7-1acf-4362-b72c-e9b6dc4e7667 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Flush multipath device 33000000086ce169e {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:56:29.163180 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-583130f7-1acf-4362-b72c-e9b6dc4e7667 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:56:29.219218 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-583130f7-1acf-4362-b72c-e9b6dc4e7667 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:56:29.267691 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-583130f7-1acf-4362-b72c-e9b6dc4e7667 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:56:29.268069 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-583130f7-1acf-4362-b72c-e9b6dc4e7667 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:56:29.270400 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-583130f7-1acf-4362-b72c-e9b6dc4e7667 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:56:29.281306 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:56:29.284469 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:56:29.285153 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68eb2642ce949fc71df161507beab4c8318cb427.part --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:29.285501 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-583130f7-1acf-4362-b72c-e9b6dc4e7667 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:56:29.285779 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-583130f7-1acf-4362-b72c-e9b6dc4e7667 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:56:29.298496 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-583130f7-1acf-4362-b72c-e9b6dc4e7667 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:29.334395 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-583130f7-1acf-4362-b72c-e9b6dc4e7667 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463, portal: 192.168.40.100,3260]
May 28 01:56:29.334395 np0000001583 nova-compute[98241]: Logout of [sid: 45, target: iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463, portal: 192.168.40.100,3260] successful.
May 28 01:56:29.334395 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:29.356500 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-583130f7-1acf-4362-b72c-e9b6dc4e7667 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:29.368457 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-583130f7-1acf-4362-b72c-e9b6dc4e7667 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:29.373609 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68eb2642ce949fc71df161507beab4c8318cb427.part --force-share --output=json" returned: 0 in 0.088s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:56:29.374039 np0000001583 nova-compute[98241]: DEBUG nova.virt.images [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] adce11b4-189e-4822-9602-663c6d77d880 was qcow2, converting to raw {{(pid=98241) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 01:56:29.374739 np0000001583 nova-compute[98241]: DEBUG nova.privsep.utils [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98241) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 01:56:29.375000 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/68eb2642ce949fc71df161507beab4c8318cb427.part /opt/stack/data/nova/instances/_base/68eb2642ce949fc71df161507beab4c8318cb427.converted {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:29.404205 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-583130f7-1acf-4362-b72c-e9b6dc4e7667 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463, portal: 192.168.50.100,3260]
May 28 01:56:29.404205 np0000001583 nova-compute[98241]: Logout of [sid: 44, target: iqn.2023-03.storpool.com:os--volume-eeb7082f-9899-40c8-ab6f-3d746680d463, portal: 192.168.50.100,3260] successful.
May 28 01:56:29.404205 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:29.421370 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-583130f7-1acf-4362-b72c-e9b6dc4e7667 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:29.421910 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-583130f7-1acf-4362-b72c-e9b6dc4e7667 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:56:29.422126 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-583130f7-1acf-4362-b72c-e9b6dc4e7667 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] <== disconnect_volume: return (4213ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:56:29.422353 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-583130f7-1acf-4362-b72c-e9b6dc4e7667 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:56:29.424923 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.488s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:56:29.425344 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d', 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9b421209-954a-413c-bf2c-892d99f40d2d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:56:29.425499 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:56:29.456777 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:29.456777 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:29.456777 np0000001583 nova-compute[98241]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:29.456777 np0000001583 nova-compute[98241]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:29.456777 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:29.456777 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:29.456777 np0000001583 nova-compute[98241]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:29.456777 np0000001583 nova-compute[98241]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:29.456777 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:56:29.456777 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsi session list stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:29.456777 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:29.456777 np0000001583 nova-compute[98241]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:29.456777 np0000001583 nova-compute[98241]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d (non-flash)
May 28 01:56:29.456777 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:29.456777 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:29.456777 np0000001583 nova-compute[98241]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:29.456777 np0000001583 nova-compute[98241]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:29.456777 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:56:29.457232 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797', '39'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d', '47'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629', '48'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629', '49'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c', '50'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c', '51')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:56:29.457232 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d', '46')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:56:29.458031 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-db2459ae-2f3c-4cd8-a875-b89f92bade43 req-17793c88-f3a0-40fb-87d1-964bbb632e5e service nova] Releasing lock "refresh_cache-ea9459ae-6246-4d11-b46b-733449884b1b" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:56:29.461295 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:29.462921 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d', '47')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:56:29.464523 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724ec327f60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d'): ({'sdm'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:56:29.464523 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Removing multipathed devices sdl, sdm {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:56:29.464779 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Flush multipath device 3300000001305f420 {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:56:29.524848 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:56:29.545225 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/68eb2642ce949fc71df161507beab4c8318cb427.part /opt/stack/data/nova/instances/_base/68eb2642ce949fc71df161507beab4c8318cb427.converted" returned: 0 in 0.170s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:56:29.563762 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:56:29.563762 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68eb2642ce949fc71df161507beab4c8318cb427.converted --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:29.589129 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:56:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-938986098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-serverbootfromvolumestablerescuetest-server-938986098',id=23,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ba381dad8364a488a98b80c04cce8fb',ramdisk_id='',reservation_id='r-nlyn62br',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1211567633',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:56:18Z,user_data=None,user_id='c3a7b14e31ee40cf9e4f4bba084ccaa5',uuid=e4fd6c94-b2c8-4d2b-b89b-c715a30c1884,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f31bd559-b1fa-4de0-9abf-97d61aa6ffea", "address": "fa:16:3e:ad:d2:22", "network": {"id": "2ee43c4e-569f-4726-9700-add40d768203", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ba381dad8364a488a98b80c04cce8fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf31bd559-b1", "ovs_interfaceid": "f31bd559-b1fa-4de0-9abf-97d61aa6ffea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:56:29.589129 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Converting VIF {"id": "f31bd559-b1fa-4de0-9abf-97d61aa6ffea", "address": "fa:16:3e:ad:d2:22", "network": {"id": "2ee43c4e-569f-4726-9700-add40d768203", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ba381dad8364a488a98b80c04cce8fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf31bd559-b1", "ovs_interfaceid": "f31bd559-b1fa-4de0-9abf-97d61aa6ffea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:56:29.590804 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:d2:22,bridge_name='br-int',has_traffic_filtering=True,id=f31bd559-b1fa-4de0-9abf-97d61aa6ffea,network=Network(2ee43c4e-569f-4726-9700-add40d768203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf31bd559-b1') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:56:29.592028 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lazy-loading 'pci_devices' on Instance uuid e4fd6c94-b2c8-4d2b-b89b-c715a30c1884 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:56:29.616675 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Object Instance<8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:56:29.616915 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lazy-loading 'keypairs' on Instance uuid 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:56:29.629571 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Checking to see if SCSI volumes sdl, sdm have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:56:29.629781 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] SCSI volumes sdl, sdm have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:56:29.630988 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Checking to see if device paths {'sdl', 'sdm'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:56:29.642794 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Device paths {'sdl', 'sdm'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:56:29.643168 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:56:29.654532 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:29.656586 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 5c36895c-9d2c-49be-b545-3658f535964a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:56:29.656728 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 587a002a-2b9c-4865-8ce2-088ad567c81b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:56:29.656862 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 75c911c7-ae44-4902-989f-3f0655243f3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:56:29.656951 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 0cca8054-2a26-436f-93b8-ef28e452bd65 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:56:29.657032 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 533f5dcc-2e48-4280-84b3-facb02dea136 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:56:29.657134 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:56:29.657225 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance df5768dc-874f-4725-b2a2-e007aebc11a9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:56:29.657297 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 7078fbb1-fa4a-4589-9f95-9d95dee381e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:56:29.657373 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 45a73c95-ff10-4b74-9ab8-4014a244a7d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:56:29.657461 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance e4fd6c94-b2c8-4d2b-b89b-c715a30c1884 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:56:29.657536 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance ea9459ae-6246-4d11-b46b-733449884b1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:56:29.657767 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 01:56:29.657906 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Final resource view: name=np0000001583 phys_ram=24030MB used_ram=2624MB phys_disk=95GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 01:56:28 up 32 min,  2 users,  load average: 9.27, 6.39, 3.16\n', 'num_instances': '11', 'num_vm_active': '9', 'num_task_None': '6', 'num_os_type_None': '11', 'num_proj_60fbdf5ed38b4dc485a81c49b3303ed2': '2', 'io_workload': '2', 'num_proj_2ba381dad8364a488a98b80c04cce8fb': '4', 'num_task_rescuing': '1', 'num_proj_261e17e4ed4445c887b71a705d46ad7d': '1', 'num_proj_2db0b9fa3fcc47408dad261c2004e4a5': '1', 'num_vm_building': '1', 'num_task_spawning': '2', 'num_task_deleting': '2', 'num_proj_fa147b7a97664129bc2922ee1e8debc6': '1', 'num_proj_aeed1ca793154290b3390c9300844303': '1', 'num_vm_shelved_offloaded': '1', 'num_proj_0d31342458ec4ed2890a766f62facbcf': '1'} {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 01:56:29.662148 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68eb2642ce949fc71df161507beab4c8318cb427.converted --force-share --output=json" returned: 0 in 0.099s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:56:29.662966 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "68eb2642ce949fc71df161507beab4c8318cb427" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.440s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:29.663772 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:56:29.666767 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:56:29.668173 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68eb2642ce949fc71df161507beab4c8318cb427 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:29.690381 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d, portal: 192.168.40.100,3260]
May 28 01:56:29.690381 np0000001583 nova-compute[98241]: Logout of [sid: 46, target: iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d, portal: 192.168.40.100,3260] successful.
May 28 01:56:29.690381 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:29.709838 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:29.727419 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:29.752105 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68eb2642ce949fc71df161507beab4c8318cb427 --force-share --output=json" returned: 0 in 0.084s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:56:29.752918 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Acquiring lock "68eb2642ce949fc71df161507beab4c8318cb427" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:29.753464 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "68eb2642ce949fc71df161507beab4c8318cb427" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:29.754025 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:56:29.757963 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:56:29.758358 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68eb2642ce949fc71df161507beab4c8318cb427 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:29.798716 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d, portal: 192.168.50.100,3260]
May 28 01:56:29.798716 np0000001583 nova-compute[98241]: Logout of [sid: 47, target: iqn.2023-03.storpool.com:os--volume-9b421209-954a-413c-bf2c-892d99f40d2d, portal: 192.168.50.100,3260] successful.
May 28 01:56:29.798716 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:29.823188 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:29.828985 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.404s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:56:29.829853 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] <== disconnect_volume: return (1892ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:56:29.829853 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:56:29.829853 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Deleting instance files /opt/stack/data/nova/instances/df5768dc-874f-4725-b2a2-e007aebc11a9_del
May 28 01:56:29.830803 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Deletion of /opt/stack/data/nova/instances/df5768dc-874f-4725-b2a2-e007aebc11a9_del complete
May 28 01:56:29.872387 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68eb2642ce949fc71df161507beab4c8318cb427 --force-share --output=json" returned: 0 in 0.114s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:56:29.872899 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68eb2642ce949fc71df161507beab4c8318cb427,backing_fmt=raw /opt/stack/data/nova/instances/ea9459ae-6246-4d11-b46b-733449884b1b/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:29.933277 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68eb2642ce949fc71df161507beab4c8318cb427,backing_fmt=raw /opt/stack/data/nova/instances/ea9459ae-6246-4d11-b46b-733449884b1b/disk 1073741824" returned: 0 in 0.060s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:56:29.933788 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "68eb2642ce949fc71df161507beab4c8318cb427" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.180s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:29.934200 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68eb2642ce949fc71df161507beab4c8318cb427 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:30.011713 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-583130f7-1acf-4362-b72c-e9b6dc4e7667 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lazy-loading 'flavor' on Instance uuid 587a002a-2b9c-4865-8ce2-088ad567c81b {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:56:30.034100 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68eb2642ce949fc71df161507beab4c8318cb427 --force-share --output=json" returned: 0 in 0.097s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:56:30.034100 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lazy-loading 'migration_context' on Instance uuid ea9459ae-6246-4d11-b46b-733449884b1b {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:56:30.097238 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] End _get_guest_xml xml=<domain type="qemu">
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:   <uuid>e4fd6c94-b2c8-4d2b-b89b-c715a30c1884</uuid>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:   <name>instance-00000017</name>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-938986098</nova:name>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:56:24</nova:creationTime>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:         <nova:user uuid="c3a7b14e31ee40cf9e4f4bba084ccaa5">tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member</nova:user>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:         <nova:project uuid="2ba381dad8364a488a98b80c04cce8fb">tempest-ServerBootFromVolumeStableRescueTest-1211567633</nova:project>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:         <nova:port uuid="f31bd559-b1fa-4de0-9abf-97d61aa6ffea">
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:     <system>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:       <entry name="serial">e4fd6c94-b2c8-4d2b-b89b-c715a30c1884</entry>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:       <entry name="uuid">e4fd6c94-b2c8-4d2b-b89b-c715a30c1884</entry>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:     </system>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:   <os>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:   </os>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:   <features>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:   </features>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:   <devices>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/e4fd6c94-b2c8-4d2b-b89b-c715a30c1884/disk.config"/>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:     </disk>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:     <disk type="block" device="disk">
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:       <alias name="ua-161f7cd8-cf0d-4077-99da-a7d8bba6321c"/>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:       <source dev="/dev/dm-0"/>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:       <serial>161f7cd8-cf0d-4077-99da-a7d8bba6321c</serial>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:     </disk>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:ad:d2:22"/>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:       <target dev="tapf31bd559-b1"/>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:     </interface>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/e4fd6c94-b2c8-4d2b-b89b-c715a30c1884/console.log" append="off"/>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:     </serial>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:     <video>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:     </video>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:     </rng>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:   </devices>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]: </domain>
May 28 01:56:30.097238 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:56:30.099406 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Preparing to wait for external event network-vif-plugged-f31bd559-b1fa-4de0-9abf-97d61aa6ffea {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:56:30.099406 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "e4fd6c94-b2c8-4d2b-b89b-c715a30c1884-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:30.099406 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "e4fd6c94-b2c8-4d2b-b89b-c715a30c1884-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:30.099406 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "e4fd6c94-b2c8-4d2b-b89b-c715a30c1884-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:30.099406 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:56:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-938986098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-serverbootfromvolumestablerescuetest-server-938986098',id=23,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ba381dad8364a488a98b80c04cce8fb',ramdisk_id='',reservation_id='r-nlyn62br',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1211567633',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:56:18Z,user_data=None,user_id='c3a7b14e31ee40cf9e4f4bba084ccaa5',uuid=e4fd6c94-b2c8-4d2b-b89b-c715a30c1884,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f31bd559-b1fa-4de0-9abf-97d61aa6ffea", "address": "fa:16:3e:ad:d2:22", "network": {"id": "2ee43c4e-569f-4726-9700-add40d768203", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ba381dad8364a488a98b80c04cce8fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf31bd559-b1", "ovs_interfaceid": "f31bd559-b1fa-4de0-9abf-97d61aa6ffea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:56:30.099698 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Converting VIF {"id": "f31bd559-b1fa-4de0-9abf-97d61aa6ffea", "address": "fa:16:3e:ad:d2:22", "network": {"id": "2ee43c4e-569f-4726-9700-add40d768203", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ba381dad8364a488a98b80c04cce8fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf31bd559-b1", "ovs_interfaceid": "f31bd559-b1fa-4de0-9abf-97d61aa6ffea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:56:30.100325 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:d2:22,bridge_name='br-int',has_traffic_filtering=True,id=f31bd559-b1fa-4de0-9abf-97d61aa6ffea,network=Network(2ee43c4e-569f-4726-9700-add40d768203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf31bd559-b1') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:56:30.100623 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:d2:22,bridge_name='br-int',has_traffic_filtering=True,id=f31bd559-b1fa-4de0-9abf-97d61aa6ffea,network=Network(2ee43c4e-569f-4726-9700-add40d768203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf31bd559-b1') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:56:30.101233 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:30.101694 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:56:30.102032 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:56:30.103893 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:30.103893 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ee9782da-ba28-58cf-a2fa-16d635d5bd5f', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:56:30.108487 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:56:30.110835 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:30.115052 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:30.115980 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf31bd559-b1, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:56:30.117369 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf31bd559-b1, col_values=(('qos', UUID('eaab5d89-522c-4c3c-8d6b-1a57e68519fd')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:56:30.117577 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf31bd559-b1, col_values=(('external_ids', {'iface-id': 'f31bd559-b1fa-4de0-9abf-97d61aa6ffea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:d2:22', 'vm-uuid': 'e4fd6c94-b2c8-4d2b-b89b-c715a30c1884'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:56:30.121807 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:56:30.124166 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Object Instance<8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:56:30.129691 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:56:30.135246 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:30.137239 np0000001583 nova-compute[98241]: INFO os_vif [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:d2:22,bridge_name='br-int',has_traffic_filtering=True,id=f31bd559-b1fa-4de0-9abf-97d61aa6ffea,network=Network(2ee43c4e-569f-4726-9700-add40d768203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf31bd559-b1')
May 28 01:56:30.316515 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Creating config drive at /opt/stack/data/nova/instances/8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4/disk.config.rescue
May 28 01:56:30.328718 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmprr3j0stn {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:30.366823 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Took 3.37 seconds to destroy the instance on the hypervisor.
May 28 01:56:30.370920 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:56:30.371590 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:56:30.371789 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:56:30.372841 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:56:30.394927 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmprr3j0stn" returned: 0 in 0.066s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:56:30.473588 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:56:30.534601 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Object Instance<ea9459ae-6246-4d11-b46b-733449884b1b> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:56:30.534986 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Rebasing disk image.
May 28 01:56:30.535253 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:30.555968 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:56:30.556456 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:56:30.631222 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.096s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:56:30.631989 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 -F raw /opt/stack/data/nova/instances/ea9459ae-6246-4d11-b46b-733449884b1b/disk {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:30.881678 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ef85c7d2-93d3-4230-ae35-01f636cafa14 req-997b0167-19e2-4e58-a539-b270a3cbf4ec service nova] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Received event network-vif-deleted-d6c3c5f3-e20b-4b3e-abac-62f21007a7ad {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:30.881916 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-ef85c7d2-93d3-4230-ae35-01f636cafa14 req-997b0167-19e2-4e58-a539-b270a3cbf4ec service nova] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Neutron deleted interface d6c3c5f3-e20b-4b3e-abac-62f21007a7ad; detaching it from the instance and deleting it from the info cache
May 28 01:56:30.886965 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ef85c7d2-93d3-4230-ae35-01f636cafa14 req-997b0167-19e2-4e58-a539-b270a3cbf4ec service nova] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Detach interface failed, port_id=d6c3c5f3-e20b-4b3e-abac-62f21007a7ad, reason: Instance df5768dc-874f-4725-b2a2-e007aebc11a9 could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:56:30.922229 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:30.968814 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:31.031217 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-583130f7-1acf-4362-b72c-e9b6dc4e7667 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "587a002a-2b9c-4865-8ce2-088ad567c81b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 7.064s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:31.062039 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:56:31.075836 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:31.316473 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:56:31.360174 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:31.375477 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:31.403135 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:31.408115 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:31.579446 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Compute_service record updated for np0000001583:np0000001583 {{(pid=98241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 01:56:31.579705 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.022s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:31.580108 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.119s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:31.580414 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 52.74 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:56:31.667608 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:56:31.667608 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:56:31.667828 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] No VIF found with MAC fa:16:3e:ad:d2:22, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:56:31.668597 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Using config drive
May 28 01:56:31.670456 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b9830c73-3416-4989-b103-04d6cb197d6a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "587a002a-2b9c-4865-8ce2-088ad567c81b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:31.670658 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b9830c73-3416-4989-b103-04d6cb197d6a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "587a002a-2b9c-4865-8ce2-088ad567c81b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:31.671148 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b9830c73-3416-4989-b103-04d6cb197d6a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "587a002a-2b9c-4865-8ce2-088ad567c81b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:31.671148 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b9830c73-3416-4989-b103-04d6cb197d6a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "587a002a-2b9c-4865-8ce2-088ad567c81b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:31.671148 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b9830c73-3416-4989-b103-04d6cb197d6a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "587a002a-2b9c-4865-8ce2-088ad567c81b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:31.673561 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-b9830c73-3416-4989-b103-04d6cb197d6a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Terminating instance
May 28 01:56:31.730686 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 -F raw /opt/stack/data/nova/instances/ea9459ae-6246-4d11-b46b-733449884b1b/disk" returned: 0 in 1.099s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:56:31.731091 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:56:31.731269 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Ensure instance console log exists: /opt/stack/data/nova/instances/ea9459ae-6246-4d11-b46b-733449884b1b/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:56:31.731537 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:31.731697 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:31.731898 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:31.733350 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Start _get_guest_xml network_info=[{"id": "2bb36d37-52de-4dcf-abb4-35b15f363457", "address": "fa:16:3e:86:7e:a1", "network": {"id": "34ab0ff0-75dd-45e7-97f6-22f8e62a8149", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1222751470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d31342458ec4ed2890a766f62facbcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb36d37-52", "ovs_interfaceid": "2bb36d37-52de-4dcf-abb4-35b15f363457", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='a832ab60dda3bfbae14f4ed372e54e7c',container_format='bare',created_at=2026-05-28T01:56:04Z,direct_url=<?>,disk_format='qcow2',id=adce11b4-189e-4822-9602-663c6d77d880,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-350641025-shelved',owner='0d31342458ec4ed2890a766f62facbcf',properties=ImageMetaProps,protected=<?>,size=53608448,status='active',tags=<?>,updated_at=2026-05-28T01:56:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:56:31.736919 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:56:31.741455 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-350641025', uuid='ea9459ae-6246-4d11-b46b-733449884b1b'), owner=OwnerMeta(userid='312a198f7d3d4ce9b586d8f36cf58f76', username='tempest-AttachVolumeShelveTestJSON-1906404591-project-member', projectid='0d31342458ec4ed2890a766f62facbcf', projectname='tempest-AttachVolumeShelveTestJSON-1906404591'), image=ImageMeta(id='adce11b4-189e-4822-9602-663c6d77d880', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2bb36d37-52de-4dcf-abb4-35b15f363457", "address": "fa:16:3e:86:7e:a1", "network": {"id": "34ab0ff0-75dd-45e7-97f6-22f8e62a8149", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1222751470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d31342458ec4ed2890a766f62facbcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb36d37-52", "ovs_interfaceid": "2bb36d37-52de-4dcf-abb4-35b15f363457", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933391.7410522) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:56:31.743575 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:56:31.743915 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:56:31.744714 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:56:31.744911 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:56:31.745775 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:56:31.746142 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='a832ab60dda3bfbae14f4ed372e54e7c',container_format='bare',created_at=2026-05-28T01:56:04Z,direct_url=<?>,disk_format='qcow2',id=adce11b4-189e-4822-9602-663c6d77d880,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-350641025-shelved',owner='0d31342458ec4ed2890a766f62facbcf',properties=ImageMetaProps,protected=<?>,size=53608448,status='active',tags=<?>,updated_at=2026-05-28T01:56:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:56:31.746278 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:56:31.746375 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:56:31.746525 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:56:31.746608 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:56:31.746703 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:56:31.746905 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:56:31.747067 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:56:31.747228 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:56:31.747335 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:56:31.747447 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:56:31.747583 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lazy-loading 'vcpu_model' on Instance uuid ea9459ae-6246-4d11-b46b-733449884b1b {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:56:31.820449 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Took 1.45 seconds to deallocate network for instance.
May 28 01:56:31.989315 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Removed pending STOPPED event for 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4 due to new event <LifecycleEvent: 1779933391.9889488, 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4 => Resumed> {{(pid=98241) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 01:56:31.991133 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933391.9889488, 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:56:31.992410 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] VM Resumed (Lifecycle Event)
May 28 01:56:31.993532 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a311ace8-986d-4ecd-880b-78b9f127a021 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:56:32.176004 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:56:32.180462 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-b9830c73-3416-4989-b103-04d6cb197d6a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:56:32.206562 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:32.210326 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:32.231333 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:32.253760 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Object Instance<ea9459ae-6246-4d11-b46b-733449884b1b> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:56:32.275056 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T01:55:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-350641025',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-attachvolumeshelvetestjson-server-350641025',id=20,image_ref='adce11b4-189e-4822-9602-663c6d77d880',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-950315920',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:55:23Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0d31342458ec4ed2890a766f62facbcf',ramdisk_id='',reservation_id='r-lmutfe3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1906404591',owner_user_name='tempest-AttachVolumeShelveTestJSON-1906404591-project-member',shelved_at='2026-05-28T01:56:11.790708',shelved_host='np0000001583',shelved_image_id='adce11b4-189e-4822-9602-663c6d77d880'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:56:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='312a198f7d3d4ce9b586d8f36cf58f76',uuid=ea9459ae-6246-4d11-b46b-733449884b1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "2bb36d37-52de-4dcf-abb4-35b15f363457", "address": "fa:16:3e:86:7e:a1", "network": {"id": "34ab0ff0-75dd-45e7-97f6-22f8e62a8149", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1222751470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d31342458ec4ed2890a766f62facbcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb36d37-52", "ovs_interfaceid": "2bb36d37-52de-4dcf-abb4-35b15f363457", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:56:32.275225 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Converting VIF {"id": "2bb36d37-52de-4dcf-abb4-35b15f363457", "address": "fa:16:3e:86:7e:a1", "network": {"id": "34ab0ff0-75dd-45e7-97f6-22f8e62a8149", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1222751470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d31342458ec4ed2890a766f62facbcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb36d37-52", "ovs_interfaceid": "2bb36d37-52de-4dcf-abb4-35b15f363457", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:56:32.275925 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:7e:a1,bridge_name='br-int',has_traffic_filtering=True,id=2bb36d37-52de-4dcf-abb4-35b15f363457,network=Network(34ab0ff0-75dd-45e7-97f6-22f8e62a8149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bb36d37-52') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:56:32.276590 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lazy-loading 'pci_devices' on Instance uuid ea9459ae-6246-4d11-b46b-733449884b1b {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:56:32.324801 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:56:32.325288 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:56:32.392359 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Creating config drive at /opt/stack/data/nova/instances/e4fd6c94-b2c8-4d2b-b89b-c715a30c1884/disk.config
May 28 01:56:32.397864 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e4fd6c94-b2c8-4d2b-b89b-c715a30c1884/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpkhapowcr {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:32.424916 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Took 0.60 seconds to detach 1 volumes for instance.
May 28 01:56:32.430391 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Deleting volume: 9b421209-954a-413c-bf2c-892d99f40d2d {{(pid=98241) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 28 01:56:32.461783 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:32.472065 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e4fd6c94-b2c8-4d2b-b89b-c715a30c1884/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpkhapowcr" returned: 0 in 0.072s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:56:32.475006 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:32.496035 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:56:32.511972 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:56:32.694663 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Instance destroyed successfully.
May 28 01:56:32.695278 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-b9830c73-3416-4989-b103-04d6cb197d6a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lazy-loading 'resources' on Instance uuid 587a002a-2b9c-4865-8ce2-088ad567c81b {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:56:32.779843 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Object Instance<ea9459ae-6246-4d11-b46b-733449884b1b> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:56:32.781578 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] End _get_guest_xml xml=<domain type="qemu">
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:   <uuid>ea9459ae-6246-4d11-b46b-733449884b1b</uuid>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:   <name>instance-00000014</name>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-350641025</nova:name>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:56:31</nova:creationTime>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:         <nova:user uuid="312a198f7d3d4ce9b586d8f36cf58f76">tempest-AttachVolumeShelveTestJSON-1906404591-project-member</nova:user>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:         <nova:project uuid="0d31342458ec4ed2890a766f62facbcf">tempest-AttachVolumeShelveTestJSON-1906404591</nova:project>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:         <nova:port uuid="2bb36d37-52de-4dcf-abb4-35b15f363457">
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:     <system>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:       <entry name="serial">ea9459ae-6246-4d11-b46b-733449884b1b</entry>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:       <entry name="uuid">ea9459ae-6246-4d11-b46b-733449884b1b</entry>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:     </system>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:   <os>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:   </os>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:   <features>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:   </features>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:   <devices>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/ea9459ae-6246-4d11-b46b-733449884b1b/disk"/>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:     </disk>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/ea9459ae-6246-4d11-b46b-733449884b1b/disk.config"/>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:     </disk>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:86:7e:a1"/>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:       <target dev="tap2bb36d37-52"/>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:     </interface>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/ea9459ae-6246-4d11-b46b-733449884b1b/console.log" append="off"/>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:     </serial>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:     <video>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:     </video>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:     </rng>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:   </devices>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]: </domain>
May 28 01:56:32.781578 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:56:32.783384 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Preparing to wait for external event network-vif-plugged-2bb36d37-52de-4dcf-abb4-35b15f363457 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:56:32.783384 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Acquiring lock "ea9459ae-6246-4d11-b46b-733449884b1b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:32.783384 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "ea9459ae-6246-4d11-b46b-733449884b1b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:32.783384 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "ea9459ae-6246-4d11-b46b-733449884b1b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:32.783384 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T01:55:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-350641025',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-attachvolumeshelvetestjson-server-350641025',id=20,image_ref='adce11b4-189e-4822-9602-663c6d77d880',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-950315920',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:55:23Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0d31342458ec4ed2890a766f62facbcf',ramdisk_id='',reservation_id='r-lmutfe3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1906404591',owner_user_name='tempest-AttachVolumeShelveTestJSON-1906404591-project-member',shelved_at='2026-05-28T01:56:11.790708',shelved_host='np0000001583',shelved_image_id='adce11b4-189e-4822-9602-663c6d77d880'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:56:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='312a198f7d3d4ce9b586d8f36cf58f76',uuid=ea9459ae-6246-4d11-b46b-733449884b1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "2bb36d37-52de-4dcf-abb4-35b15f363457", "address": "fa:16:3e:86:7e:a1", "network": {"id": "34ab0ff0-75dd-45e7-97f6-22f8e62a8149", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1222751470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d31342458ec4ed2890a766f62facbcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb36d37-52", "ovs_interfaceid": "2bb36d37-52de-4dcf-abb4-35b15f363457", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:56:32.783600 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Converting VIF {"id": "2bb36d37-52de-4dcf-abb4-35b15f363457", "address": "fa:16:3e:86:7e:a1", "network": {"id": "34ab0ff0-75dd-45e7-97f6-22f8e62a8149", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1222751470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d31342458ec4ed2890a766f62facbcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb36d37-52", "ovs_interfaceid": "2bb36d37-52de-4dcf-abb4-35b15f363457", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:56:32.784391 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:7e:a1,bridge_name='br-int',has_traffic_filtering=True,id=2bb36d37-52de-4dcf-abb4-35b15f363457,network=Network(34ab0ff0-75dd-45e7-97f6-22f8e62a8149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bb36d37-52') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:56:32.784602 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:7e:a1,bridge_name='br-int',has_traffic_filtering=True,id=2bb36d37-52de-4dcf-abb4-35b15f363457,network=Network(34ab0ff0-75dd-45e7-97f6-22f8e62a8149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bb36d37-52') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:56:32.784957 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:32.785219 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:56:32.785506 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:56:32.786475 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:32.786637 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aa1c3fe1-5102-5d9e-be32-98a2ff4da48d', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:56:32.787520 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:32.788311 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:56:32.803170 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:32.806501 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:32.806501 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2bb36d37-52, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:56:32.806886 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2bb36d37-52, col_values=(('qos', UUID('e922b9e7-2491-45bb-a0b6-b72c09973134')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:56:32.806886 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2bb36d37-52, col_values=(('external_ids', {'iface-id': '2bb36d37-52de-4dcf-abb4-35b15f363457', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:7e:a1', 'vm-uuid': 'ea9459ae-6246-4d11-b46b-733449884b1b'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:56:32.807798 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:32.809708 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:56:32.826753 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:32.827683 np0000001583 nova-compute[98241]: INFO os_vif [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:7e:a1,bridge_name='br-int',has_traffic_filtering=True,id=2bb36d37-52de-4dcf-abb4-35b15f363457,network=Network(34ab0ff0-75dd-45e7-97f6-22f8e62a8149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bb36d37-52')
May 28 01:56:32.830853 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:56:32.972822 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-178229f0-9b6b-456d-90ca-6ed2944dc842 req-54ddfe19-edc2-4c80-a10a-924952b265a4 service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Received event network-vif-plugged-f242e691-1d28-43e0-b83a-2414c00958b8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:32.973033 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-178229f0-9b6b-456d-90ca-6ed2944dc842 req-54ddfe19-edc2-4c80-a10a-924952b265a4 service nova] Acquiring lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:32.973256 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-178229f0-9b6b-456d-90ca-6ed2944dc842 req-54ddfe19-edc2-4c80-a10a-924952b265a4 service nova] Lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:32.973379 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-178229f0-9b6b-456d-90ca-6ed2944dc842 req-54ddfe19-edc2-4c80-a10a-924952b265a4 service nova] Lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:32.973532 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-178229f0-9b6b-456d-90ca-6ed2944dc842 req-54ddfe19-edc2-4c80-a10a-924952b265a4 service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] No waiting events found dispatching network-vif-plugged-f242e691-1d28-43e0-b83a-2414c00958b8 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:56:32.973821 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-178229f0-9b6b-456d-90ca-6ed2944dc842 req-54ddfe19-edc2-4c80-a10a-924952b265a4 service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Received unexpected event network-vif-plugged-f242e691-1d28-43e0-b83a-2414c00958b8 for instance with vm_state rescued and task_state unrescuing.
May 28 01:56:32.973869 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-178229f0-9b6b-456d-90ca-6ed2944dc842 req-54ddfe19-edc2-4c80-a10a-924952b265a4 service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Received event network-vif-plugged-f242e691-1d28-43e0-b83a-2414c00958b8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:32.974040 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-178229f0-9b6b-456d-90ca-6ed2944dc842 req-54ddfe19-edc2-4c80-a10a-924952b265a4 service nova] Acquiring lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:32.976269 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-178229f0-9b6b-456d-90ca-6ed2944dc842 req-54ddfe19-edc2-4c80-a10a-924952b265a4 service nova] Lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:32.976427 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-178229f0-9b6b-456d-90ca-6ed2944dc842 req-54ddfe19-edc2-4c80-a10a-924952b265a4 service nova] Lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:32.976930 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-178229f0-9b6b-456d-90ca-6ed2944dc842 req-54ddfe19-edc2-4c80-a10a-924952b265a4 service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] No waiting events found dispatching network-vif-plugged-f242e691-1d28-43e0-b83a-2414c00958b8 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:56:32.977112 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-178229f0-9b6b-456d-90ca-6ed2944dc842 req-54ddfe19-edc2-4c80-a10a-924952b265a4 service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Received unexpected event network-vif-plugged-f242e691-1d28-43e0-b83a-2414c00958b8 for instance with vm_state rescued and task_state unrescuing.
May 28 01:56:32.977263 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-178229f0-9b6b-456d-90ca-6ed2944dc842 req-54ddfe19-edc2-4c80-a10a-924952b265a4 service nova] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Received event network-vif-unplugged-6ddf64a7-099d-4ef6-8dfc-7377446b66f7 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:32.977440 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-178229f0-9b6b-456d-90ca-6ed2944dc842 req-54ddfe19-edc2-4c80-a10a-924952b265a4 service nova] Acquiring lock "587a002a-2b9c-4865-8ce2-088ad567c81b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:32.977626 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-178229f0-9b6b-456d-90ca-6ed2944dc842 req-54ddfe19-edc2-4c80-a10a-924952b265a4 service nova] Lock "587a002a-2b9c-4865-8ce2-088ad567c81b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:32.978012 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-178229f0-9b6b-456d-90ca-6ed2944dc842 req-54ddfe19-edc2-4c80-a10a-924952b265a4 service nova] Lock "587a002a-2b9c-4865-8ce2-088ad567c81b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:32.978012 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-178229f0-9b6b-456d-90ca-6ed2944dc842 req-54ddfe19-edc2-4c80-a10a-924952b265a4 service nova] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] No waiting events found dispatching network-vif-unplugged-6ddf64a7-099d-4ef6-8dfc-7377446b66f7 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:56:32.978012 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-178229f0-9b6b-456d-90ca-6ed2944dc842 req-54ddfe19-edc2-4c80-a10a-924952b265a4 service nova] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Received event network-vif-unplugged-6ddf64a7-099d-4ef6-8dfc-7377446b66f7 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:56:32.978205 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-178229f0-9b6b-456d-90ca-6ed2944dc842 req-54ddfe19-edc2-4c80-a10a-924952b265a4 service nova] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Received event network-vif-unplugged-6ddf64a7-099d-4ef6-8dfc-7377446b66f7 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:32.978469 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-178229f0-9b6b-456d-90ca-6ed2944dc842 req-54ddfe19-edc2-4c80-a10a-924952b265a4 service nova] Acquiring lock "587a002a-2b9c-4865-8ce2-088ad567c81b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:32.978761 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-178229f0-9b6b-456d-90ca-6ed2944dc842 req-54ddfe19-edc2-4c80-a10a-924952b265a4 service nova] Lock "587a002a-2b9c-4865-8ce2-088ad567c81b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:32.978761 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-178229f0-9b6b-456d-90ca-6ed2944dc842 req-54ddfe19-edc2-4c80-a10a-924952b265a4 service nova] Lock "587a002a-2b9c-4865-8ce2-088ad567c81b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:32.978761 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-178229f0-9b6b-456d-90ca-6ed2944dc842 req-54ddfe19-edc2-4c80-a10a-924952b265a4 service nova] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] No waiting events found dispatching network-vif-unplugged-6ddf64a7-099d-4ef6-8dfc-7377446b66f7 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:56:32.978934 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-178229f0-9b6b-456d-90ca-6ed2944dc842 req-54ddfe19-edc2-4c80-a10a-924952b265a4 service nova] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Received event network-vif-unplugged-6ddf64a7-099d-4ef6-8dfc-7377446b66f7 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:56:33.013826 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:33.015681 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933393.015418, 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:56:33.015794 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] VM Started (Lifecycle Event)
May 28 01:56:33.030696 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:33.082441 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:33.123708 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:33.129437 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:33.198387 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-b9830c73-3416-4989-b103-04d6cb197d6a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T01:54:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-307669431',display_name='tempest-ServerActionsTestOtherA-server-1171245773',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-tempest-common-compute-instance-307669431',id=13,image_ref='160eac6b-3e35-4339-bdf4-c5b84e5687ff',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+uj6sYtPnyFWQs1nCcEuZB/a15TtoxueiMzmbIyATZcok2qJukDOEiuQPENacqvJA6yFSDD4IVNTN5EdbtPeAegQv2a08BDT/l0Bf9OlKlI25U/AVBDkLghlYu/vY6eg==',key_name='tempest-keypair-374991287',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:55:45Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60fbdf5ed38b4dc485a81c49b3303ed2',ramdisk_id='',reservation_id='r-m7y4i9cj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='160eac6b-3e35-4339-bdf4-c5b84e5687ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1714646345',owner_user_name='tempest-ServerActionsTestOtherA-1714646345-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:55:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27c90c0a8eb148fda8ae718f07ff1ed4',uuid=587a002a-2b9c-4865-8ce2-088ad567c81b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ddf64a7-099d-4ef6-8dfc-7377446b66f7", "address": "fa:16:3e:94:75:97", "network": {"id": "b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-280876007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60fbdf5ed38b4dc485a81c49b3303ed2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddf64a7-09", "ovs_interfaceid": "6ddf64a7-099d-4ef6-8dfc-7377446b66f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:56:33.199039 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-b9830c73-3416-4989-b103-04d6cb197d6a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Converting VIF {"id": "6ddf64a7-099d-4ef6-8dfc-7377446b66f7", "address": "fa:16:3e:94:75:97", "network": {"id": "b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-280876007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60fbdf5ed38b4dc485a81c49b3303ed2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddf64a7-09", "ovs_interfaceid": "6ddf64a7-099d-4ef6-8dfc-7377446b66f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:56:33.201303 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-b9830c73-3416-4989-b103-04d6cb197d6a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:75:97,bridge_name='br-int',has_traffic_filtering=True,id=6ddf64a7-099d-4ef6-8dfc-7377446b66f7,network=Network(b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ddf64a7-09') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:56:33.201880 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-b9830c73-3416-4989-b103-04d6cb197d6a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:75:97,bridge_name='br-int',has_traffic_filtering=True,id=6ddf64a7-099d-4ef6-8dfc-7377446b66f7,network=Network(b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ddf64a7-09') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:56:33.205008 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:33.205268 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6ddf64a7-09, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:56:33.207542 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:33.208750 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:56:33.215097 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:33.216469 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:33.216691 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=239b45e8-2532-49bb-a264-0b85c3c494d6) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:56:33.218634 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:33.219600 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:56:33.236833 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:33.241724 np0000001583 nova-compute[98241]: INFO os_vif [None req-b9830c73-3416-4989-b103-04d6cb197d6a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:75:97,bridge_name='br-int',has_traffic_filtering=True,id=6ddf64a7-099d-4ef6-8dfc-7377446b66f7,network=Network(b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ddf64a7-09')
May 28 01:56:33.242207 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-b9830c73-3416-4989-b103-04d6cb197d6a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Deleting instance files /opt/stack/data/nova/instances/587a002a-2b9c-4865-8ce2-088ad567c81b_del
May 28 01:56:33.243158 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-b9830c73-3416-4989-b103-04d6cb197d6a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Deletion of /opt/stack/data/nova/instances/587a002a-2b9c-4865-8ce2-088ad567c81b_del complete
May 28 01:56:33.283912 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:33.293642 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:33.341668 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.761s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:33.347096 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.330s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:33.415261 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-699105e8-bf33-46ea-8f20-8b18d6c13708 req-0c1615ed-4f09-473c-b4b0-9fa7c83b5780 service nova] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Received event network-vif-plugged-f31bd559-b1fa-4de0-9abf-97d61aa6ffea {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:33.416568 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-699105e8-bf33-46ea-8f20-8b18d6c13708 req-0c1615ed-4f09-473c-b4b0-9fa7c83b5780 service nova] Acquiring lock "e4fd6c94-b2c8-4d2b-b89b-c715a30c1884-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:33.420281 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-699105e8-bf33-46ea-8f20-8b18d6c13708 req-0c1615ed-4f09-473c-b4b0-9fa7c83b5780 service nova] Lock "e4fd6c94-b2c8-4d2b-b89b-c715a30c1884-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:33.420281 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-699105e8-bf33-46ea-8f20-8b18d6c13708 req-0c1615ed-4f09-473c-b4b0-9fa7c83b5780 service nova] Lock "e4fd6c94-b2c8-4d2b-b89b-c715a30c1884-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:33.420281 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-699105e8-bf33-46ea-8f20-8b18d6c13708 req-0c1615ed-4f09-473c-b4b0-9fa7c83b5780 service nova] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Processing event network-vif-plugged-f31bd559-b1fa-4de0-9abf-97d61aa6ffea {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:56:33.432565 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Deleted allocations for instance 0cca8054-2a26-436f-93b8-ef28e452bd65
May 28 01:56:33.437941 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-561e1484-43f8-4040-a8ad-6ccbffc465d2 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Unrescuing
May 28 01:56:33.438836 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-561e1484-43f8-4040-a8ad-6ccbffc465d2 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Acquiring lock "refresh_cache-8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:56:33.438836 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-561e1484-43f8-4040-a8ad-6ccbffc465d2 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Acquired lock "refresh_cache-8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:56:33.438836 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-561e1484-43f8-4040-a8ad-6ccbffc465d2 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:56:33.518262 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:56:33.522047 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:56:33.757156 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-b9830c73-3416-4989-b103-04d6cb197d6a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Took 1.58 seconds to destroy the instance on the hypervisor.
May 28 01:56:33.759301 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-b9830c73-3416-4989-b103-04d6cb197d6a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:56:33.759824 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:56:33.759974 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:56:33.760332 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:56:33.832888 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0003427159999773721 future=<Future at 0x7724ec16fda0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:56:33.832888 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:56:33.832888 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=1.9865436219999992 future=<Future at 0x7724ec17d1c0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:56:33.832888 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=1.9864233119999426 future=<Future at 0x7724ec17d1c0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:56:33.950742 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-561e1484-43f8-4040-a8ad-6ccbffc465d2 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:56:33.965071 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:56:34.023713 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 28 01:56:34.023971 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999790931000007 future=<Future at 0x7724ec17c710 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:56:34.119506 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:56:34.119890 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:56:34.195003 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933394.1945286, e4fd6c94-b2c8-4d2b-b89b-c715a30c1884 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:56:34.195592 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:56:34.195805 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] VM Started (Lifecycle Event)
May 28 01:56:34.198414 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:56:34.204106 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Instance spawned successfully.
May 28 01:56:34.205562 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:56:34.361672 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:56:34.362225 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:56:34.362225 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] No VIF found with MAC fa:16:3e:86:7e:a1, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:56:34.362653 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Using config drive
May 28 01:56:34.446100 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8f6e748f-1258-4f15-b545-2a642de541f0 tempest-TaggedBootDevicesTest_v242-2114446049 tempest-TaggedBootDevicesTest_v242-2114446049-project-member] Lock "0cca8054-2a26-436f-93b8-ef28e452bd65" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.893s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:34.500461 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Acquiring lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:34.500654 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:34.520906 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-561e1484-43f8-4040-a8ad-6ccbffc465d2 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:56:34.579252 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-4bcf1a58-3e49-4c0f-954e-56e735778c3a req-6ba72b9f-ee28-4806-82cc-62bb9aaa98dc service nova] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Received event network-vif-deleted-6ddf64a7-099d-4ef6-8dfc-7377446b66f7 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:34.579462 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-4bcf1a58-3e49-4c0f-954e-56e735778c3a req-6ba72b9f-ee28-4806-82cc-62bb9aaa98dc service nova] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Neutron deleted interface 6ddf64a7-099d-4ef6-8dfc-7377446b66f7; detaching it from the instance and deleting it from the info cache
May 28 01:56:34.580922 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-4bcf1a58-3e49-4c0f-954e-56e735778c3a req-6ba72b9f-ee28-4806-82cc-62bb9aaa98dc service nova] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Detach interface failed, port_id=6ddf64a7-099d-4ef6-8dfc-7377446b66f7, reason: Instance 587a002a-2b9c-4865-8ce2-088ad567c81b could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:56:34.624807 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:56:34.700144 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:56:34.702484 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:56:34.715384 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:56:34.715640 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:56:34.716495 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:56:34.716495 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:56:34.716991 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:56:34.717416 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:56:34.724593 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-561e1484-43f8-4040-a8ad-6ccbffc465d2 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Updating instance_info_cache with network_info: [{"id": "f242e691-1d28-43e0-b83a-2414c00958b8", "address": "fa:16:3e:5c:c2:5f", "network": {"id": "b31b6f30-3b80-465d-8203-e6f4c16c758c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1195490498-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "261e17e4ed4445c887b71a705d46ad7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf242e691-1d", "ovs_interfaceid": "f242e691-1d28-43e0-b83a-2414c00958b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:56:34.870167 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lazy-loading 'ec2_ids' on Instance uuid ea9459ae-6246-4d11-b46b-733449884b1b {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:56:35.005199 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lazy-loading 'flavor' on Instance uuid 7078fbb1-fa4a-4589-9f95-9d95dee381e0 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:56:35.022022 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:56:35.073235 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f5f771a3-cea1-483c-9c65-6478e9644432 req-30e5759a-b5ee-4fad-b7ef-fddaf36f6e62 service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Received event network-changed-f242e691-1d28-43e0-b83a-2414c00958b8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:35.073398 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f5f771a3-cea1-483c-9c65-6478e9644432 req-30e5759a-b5ee-4fad-b7ef-fddaf36f6e62 service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Refreshing instance network info cache due to event network-changed-f242e691-1d28-43e0-b83a-2414c00958b8. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:56:35.073476 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f5f771a3-cea1-483c-9c65-6478e9644432 req-30e5759a-b5ee-4fad-b7ef-fddaf36f6e62 service nova] Acquiring lock "refresh_cache-8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:56:35.137646 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.794s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:35.205252 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:56:35.206718 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933395.206011, e4fd6c94-b2c8-4d2b-b89b-c715a30c1884 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:56:35.206718 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] VM Paused (Lifecycle Event)
May 28 01:56:35.209540 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Deleted allocations for instance df5768dc-874f-4725-b2a2-e007aebc11a9
May 28 01:56:35.229338 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Took 10.79 seconds to spawn the instance on the hypervisor.
May 28 01:56:35.229501 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:56:35.230285 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-561e1484-43f8-4040-a8ad-6ccbffc465d2 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Releasing lock "refresh_cache-8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:56:35.230677 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-561e1484-43f8-4040-a8ad-6ccbffc465d2 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lazy-loading 'flavor' on Instance uuid 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:56:35.234774 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f5f771a3-cea1-483c-9c65-6478e9644432 req-30e5759a-b5ee-4fad-b7ef-fddaf36f6e62 service nova] Acquired lock "refresh_cache-8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:56:35.235585 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-f5f771a3-cea1-483c-9c65-6478e9644432 req-30e5759a-b5ee-4fad-b7ef-fddaf36f6e62 service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Refreshing network info cache for port f242e691-1d28-43e0-b83a-2414c00958b8 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:56:35.378190 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Object Instance<ea9459ae-6246-4d11-b46b-733449884b1b> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:56:35.378622 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lazy-loading 'keypairs' on Instance uuid ea9459ae-6246-4d11-b46b-733449884b1b {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:56:35.502203 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-29219845-4279-403d-91e5-e9023463bac2 req-e1bcbb59-1b60-4e46-9ca8-98f6e1a5a07c service nova] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Received event network-vif-plugged-f31bd559-b1fa-4de0-9abf-97d61aa6ffea {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:35.502405 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-29219845-4279-403d-91e5-e9023463bac2 req-e1bcbb59-1b60-4e46-9ca8-98f6e1a5a07c service nova] Acquiring lock "e4fd6c94-b2c8-4d2b-b89b-c715a30c1884-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:35.502597 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-29219845-4279-403d-91e5-e9023463bac2 req-e1bcbb59-1b60-4e46-9ca8-98f6e1a5a07c service nova] Lock "e4fd6c94-b2c8-4d2b-b89b-c715a30c1884-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:35.502758 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-29219845-4279-403d-91e5-e9023463bac2 req-e1bcbb59-1b60-4e46-9ca8-98f6e1a5a07c service nova] Lock "e4fd6c94-b2c8-4d2b-b89b-c715a30c1884-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:35.502932 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-29219845-4279-403d-91e5-e9023463bac2 req-e1bcbb59-1b60-4e46-9ca8-98f6e1a5a07c service nova] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] No waiting events found dispatching network-vif-plugged-f31bd559-b1fa-4de0-9abf-97d61aa6ffea {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:56:35.503114 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-29219845-4279-403d-91e5-e9023463bac2 req-e1bcbb59-1b60-4e46-9ca8-98f6e1a5a07c service nova] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Received unexpected event network-vif-plugged-f31bd559-b1fa-4de0-9abf-97d61aa6ffea for instance with vm_state active and task_state None.
May 28 01:56:35.524252 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Took 1.76 seconds to deallocate network for instance.
May 28 01:56:35.712236 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:56:35.717531 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933395.716651, e4fd6c94-b2c8-4d2b-b89b-c715a30c1884 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:56:35.717531 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] VM Resumed (Lifecycle Event)
May 28 01:56:35.741735 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-f5f771a3-cea1-483c-9c65-6478e9644432 req-30e5759a-b5ee-4fad-b7ef-fddaf36f6e62 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:56:35.755726 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Took 22.30 seconds to build instance.
May 28 01:56:35.775244 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:35.781204 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:35.808281 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:35.819823 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0004279770000721328 future=<Future at 0x7724ec17d1c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:56:35.819979 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:56:35.820354 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=6.549473971999987 future=<Future at 0x7724ec37ec60 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:56:35.820354 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=6.549328994999996 future=<Future at 0x7724ec37ec60 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:56:35.821561 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Emitting event <LifecycleEvent: 1779933380.819241, 0cca8054-2a26-436f-93b8-ef28e452bd65 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:56:35.821734 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] VM Stopped (Lifecycle Event)
May 28 01:56:35.846375 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:35.883155 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Object Instance<ea9459ae-6246-4d11-b46b-733449884b1b> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:56:35.886820 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:56:36.019587 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.519s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:36.030532 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b9830c73-3416-4989-b103-04d6cb197d6a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:36.030734 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b9830c73-3416-4989-b103-04d6cb197d6a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:36.084257 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:36.100133 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:36.146682 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Instance destroyed successfully.
May 28 01:56:36.148568 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-561e1484-43f8-4040-a8ad-6ccbffc465d2 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lazy-loading 'numa_topology' on Instance uuid 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:56:36.227921 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:56:36.229698 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9de14200-7d25-4dba-9748-d8e5a05ece6d tempest-TestShelveInstance-1732527786 tempest-TestShelveInstance-1732527786-project-member] Lock "df5768dc-874f-4725-b2a2-e007aebc11a9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.744s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:36.235123 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:56:36.244503 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Creating config drive at /opt/stack/data/nova/instances/ea9459ae-6246-4d11-b46b-733449884b1b/disk.config
May 28 01:56:36.251335 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ea9459ae-6246-4d11-b46b-733449884b1b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4xghda56 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:36.274807 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "e4fd6c94-b2c8-4d2b-b89b-c715a30c1884" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.830s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:36.330691 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-7e11118a-ecbd-4222-880d-6dc52900df43 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 0cca8054-2a26-436f-93b8-ef28e452bd65] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:56:36.338545 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ea9459ae-6246-4d11-b46b-733449884b1b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4xghda56" returned: 0 in 0.086s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:56:36.372978 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-f5f771a3-cea1-483c-9c65-6478e9644432 req-30e5759a-b5ee-4fad-b7ef-fddaf36f6e62 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:56:36.651525 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-561e1484-43f8-4040-a8ad-6ccbffc465d2 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Object Instance<8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4> lazy-loaded attributes: flavor,numa_topology {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:56:36.694437 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-f5f771a3-cea1-483c-9c65-6478e9644432 req-30e5759a-b5ee-4fad-b7ef-fddaf36f6e62 service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Updated VIF entry in instance network info cache for port f242e691-1d28-43e0-b83a-2414c00958b8. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:56:36.700116 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-f5f771a3-cea1-483c-9c65-6478e9644432 req-30e5759a-b5ee-4fad-b7ef-fddaf36f6e62 service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Updating instance_info_cache with network_info: [{"id": "f242e691-1d28-43e0-b83a-2414c00958b8", "address": "fa:16:3e:5c:c2:5f", "network": {"id": "b31b6f30-3b80-465d-8203-e6f4c16c758c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1195490498-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "261e17e4ed4445c887b71a705d46ad7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf242e691-1d", "ovs_interfaceid": "f242e691-1d28-43e0-b83a-2414c00958b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:56:36.741027 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999519034000059 future=<Future at 0x7724ec4e3c20 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:56:36.842597 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b9830c73-3416-4989-b103-04d6cb197d6a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:56:36.842793 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-b9830c73-3416-4989-b103-04d6cb197d6a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:56:37.008278 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:37.042140 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:37.043412 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:37.147013 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Acquiring lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:37.147013 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:37.147013 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Attaching volume ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 to /dev/vdb
May 28 01:56:37.188969 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-717734bf-bcc4-4ce0-911a-990dc96e9731 req-f779de6c-f750-49ed-9624-d065ae423f8f service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Received event network-vif-unplugged-f242e691-1d28-43e0-b83a-2414c00958b8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:37.189248 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-717734bf-bcc4-4ce0-911a-990dc96e9731 req-f779de6c-f750-49ed-9624-d065ae423f8f service nova] Acquiring lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:37.191028 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-717734bf-bcc4-4ce0-911a-990dc96e9731 req-f779de6c-f750-49ed-9624-d065ae423f8f service nova] Lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:37.191336 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-717734bf-bcc4-4ce0-911a-990dc96e9731 req-f779de6c-f750-49ed-9624-d065ae423f8f service nova] Lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:37.191336 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-717734bf-bcc4-4ce0-911a-990dc96e9731 req-f779de6c-f750-49ed-9624-d065ae423f8f service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] No waiting events found dispatching network-vif-unplugged-f242e691-1d28-43e0-b83a-2414c00958b8 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:56:37.191463 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-717734bf-bcc4-4ce0-911a-990dc96e9731 req-f779de6c-f750-49ed-9624-d065ae423f8f service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Received unexpected event network-vif-unplugged-f242e691-1d28-43e0-b83a-2414c00958b8 for instance with vm_state rescued and task_state unrescuing.
May 28 01:56:37.191563 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-717734bf-bcc4-4ce0-911a-990dc96e9731 req-f779de6c-f750-49ed-9624-d065ae423f8f service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Received event network-vif-unplugged-f242e691-1d28-43e0-b83a-2414c00958b8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:37.191731 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-717734bf-bcc4-4ce0-911a-990dc96e9731 req-f779de6c-f750-49ed-9624-d065ae423f8f service nova] Acquiring lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:37.192714 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-717734bf-bcc4-4ce0-911a-990dc96e9731 req-f779de6c-f750-49ed-9624-d065ae423f8f service nova] Lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:37.192714 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-717734bf-bcc4-4ce0-911a-990dc96e9731 req-f779de6c-f750-49ed-9624-d065ae423f8f service nova] Lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:37.192714 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-717734bf-bcc4-4ce0-911a-990dc96e9731 req-f779de6c-f750-49ed-9624-d065ae423f8f service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] No waiting events found dispatching network-vif-unplugged-f242e691-1d28-43e0-b83a-2414c00958b8 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:56:37.192714 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-717734bf-bcc4-4ce0-911a-990dc96e9731 req-f779de6c-f750-49ed-9624-d065ae423f8f service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Received unexpected event network-vif-unplugged-f242e691-1d28-43e0-b83a-2414c00958b8 for instance with vm_state rescued and task_state unrescuing.
May 28 01:56:37.203782 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f5f771a3-cea1-483c-9c65-6478e9644432 req-30e5759a-b5ee-4fad-b7ef-fddaf36f6e62 service nova] Releasing lock "refresh_cache-8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:56:37.204450 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f5f771a3-cea1-483c-9c65-6478e9644432 req-30e5759a-b5ee-4fad-b7ef-fddaf36f6e62 service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Received event network-changed-f242e691-1d28-43e0-b83a-2414c00958b8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:37.204450 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f5f771a3-cea1-483c-9c65-6478e9644432 req-30e5759a-b5ee-4fad-b7ef-fddaf36f6e62 service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Refreshing instance network info cache due to event network-changed-f242e691-1d28-43e0-b83a-2414c00958b8. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:56:37.204450 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f5f771a3-cea1-483c-9c65-6478e9644432 req-30e5759a-b5ee-4fad-b7ef-fddaf36f6e62 service nova] Acquiring lock "refresh_cache-8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:56:37.204450 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f5f771a3-cea1-483c-9c65-6478e9644432 req-30e5759a-b5ee-4fad-b7ef-fddaf36f6e62 service nova] Acquired lock "refresh_cache-8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:56:37.204599 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-f5f771a3-cea1-483c-9c65-6478e9644432 req-30e5759a-b5ee-4fad-b7ef-fddaf36f6e62 service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Refreshing network info cache for port f242e691-1d28-43e0-b83a-2414c00958b8 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:56:37.236151 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:56:37.252682 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:56:37.279691 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:37.321145 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:37.333089 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:56:37.334912 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:56:37.346062 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:56:37.348585 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe63:2bb1', 'fe80::e43a:d5ff:fecc:27fe', 'fe80::fc16:3eff:fe27:be54', 'fe80::a0e4:60ff:fe3f:73d6', 'fe80::fc16:3eff:fee1:1d3', 'fe80::fc16:3eff:fe30:bde8', 'fe80::e04b:eeff:fe0a:e20d', 'fe80::fc16:3eff:fe20:92ee', 'fe80::fc16:3eff:fead:d222', 'fe80::fc16:3eff:fe86:7ea1', 'fe80::c4dd:b4ff:fe11:7c8'] 
May 28 01:56:37.348850 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:56:37.349131 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:56:37.350051 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:56:37.350051 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Updating existing volume attachment record: 54e83274-3b5f-4dce-a4d3-7b9466df6dff {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:56:37.355313 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-b9830c73-3416-4989-b103-04d6cb197d6a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:56:37.453468 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:37.456654 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:37.485323 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:37.493842 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:37.503186 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:37.503646 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:37.528801 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:37.584489 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:37.709253 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-f5f771a3-cea1-483c-9c65-6478e9644432 req-30e5759a-b5ee-4fad-b7ef-fddaf36f6e62 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:56:37.737301 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:37.866985 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b9830c73-3416-4989-b103-04d6cb197d6a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.836s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:37.959098 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:56:37.962246 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-b9830c73-3416-4989-b103-04d6cb197d6a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Deleted allocations for instance 587a002a-2b9c-4865-8ce2-088ad567c81b
May 28 01:56:37.968953 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:56:37.970185 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:56:37.970627 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:56:37.970935 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:56:37.986090 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:56:37.987469 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:56:37.987837 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:56:37.988231 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:56:37.992361 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.006s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:56:37.992681 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:56:38.011360 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:56:38.011360 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:38.021894 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:56:38.021894 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:38.036605 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2] added
May 28 01:56:38.036605 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:56:38.036605 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:56:38.036605 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:56:38.036605 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:56:38.036605 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:56:38.036605 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:38.037657 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:56:38.038025 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0498(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:56:38.039298 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:56:38.039928 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2] added
May 28 01:56:38.039928 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:56:38.039928 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:56:38.039928 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:56:38.039928 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:56:38.039928 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:56:38.039928 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:38.040217 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:56:38.042754 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0478(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:56:38.043473 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:56:38.043473 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:38.085387 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:38.090644 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:38.118243 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:38.231128 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Rescuing
May 28 01:56:38.231367 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "refresh_cache-e4fd6c94-b2c8-4d2b-b89b-c715a30c1884" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:56:38.231512 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquired lock "refresh_cache-e4fd6c94-b2c8-4d2b-b89b-c715a30c1884" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:56:38.231701 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:56:38.232556 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:38.396262 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-f5f771a3-cea1-483c-9c65-6478e9644432 req-30e5759a-b5ee-4fad-b7ef-fddaf36f6e62 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:56:38.469356 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:38.602924 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-f5f771a3-cea1-483c-9c65-6478e9644432 req-30e5759a-b5ee-4fad-b7ef-fddaf36f6e62 service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Updated VIF entry in instance network info cache for port f242e691-1d28-43e0-b83a-2414c00958b8. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:56:38.603507 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-f5f771a3-cea1-483c-9c65-6478e9644432 req-30e5759a-b5ee-4fad-b7ef-fddaf36f6e62 service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Updating instance_info_cache with network_info: [{"id": "f242e691-1d28-43e0-b83a-2414c00958b8", "address": "fa:16:3e:5c:c2:5f", "network": {"id": "b31b6f30-3b80-465d-8203-e6f4c16c758c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1195490498-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "261e17e4ed4445c887b71a705d46ad7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf242e691-1d", "ovs_interfaceid": "f242e691-1d28-43e0-b83a-2414c00958b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:56:38.657961 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933398.6574864, ea9459ae-6246-4d11-b46b-733449884b1b => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:56:38.658592 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] VM Started (Lifecycle Event)
May 28 01:56:38.707800 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-561e1484-43f8-4040-a8ad-6ccbffc465d2 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:56:38.734914 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:56:38.979779 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b9830c73-3416-4989-b103-04d6cb197d6a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "587a002a-2b9c-4865-8ce2-088ad567c81b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.309s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:39.039864 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:56:39.043490 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:56:39.056118 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:56:39.056118 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:56:39.062463 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:56:39.062463 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:39.073890 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:39.086621 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:39.095389 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:39.095389 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:39.095389 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:39.095389 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:39.095389 np0000001583 nova-compute[98241]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:39.095389 np0000001583 nova-compute[98241]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:39.095389 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:56:39.095743 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsi session list stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:39.095743 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:39.095743 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:39.095743 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:39.095743 np0000001583 nova-compute[98241]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:39.095743 np0000001583 nova-compute[98241]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:39.095743 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:56:39.106316 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f5f771a3-cea1-483c-9c65-6478e9644432 req-30e5759a-b5ee-4fad-b7ef-fddaf36f6e62 service nova] Releasing lock "refresh_cache-8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:56:39.112468 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:56:39.114828 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:39.114828 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:39.114828 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:39.114828 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:39.114828 np0000001583 nova-compute[98241]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:39.114828 np0000001583 nova-compute[98241]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:39.114828 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:56:39.115150 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsi session list stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:39.115150 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:39.115150 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:39.115150 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:39.115150 np0000001583 nova-compute[98241]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:39.115150 np0000001583 nova-compute[98241]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:39.115150 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:56:39.138051 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2, portal: 192.168.50.100,3260]
May 28 01:56:39.138051 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2, portal: 192.168.50.100,3260] successful.
May 28 01:56:39.138051 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:39.155433 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:39.162642 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:56:39.168414 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933399.1678977, ea9459ae-6246-4d11-b46b-733449884b1b => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:56:39.168625 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] VM Paused (Lifecycle Event)
May 28 01:56:39.190176 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2, portal: 192.168.40.100,3260]
May 28 01:56:39.190176 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2, portal: 192.168.40.100,3260] successful.
May 28 01:56:39.190176 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:39.197191 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:39.197191 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:39.197191 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:39.197191 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:39.197191 np0000001583 nova-compute[98241]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:39.197191 np0000001583 nova-compute[98241]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:39.197191 np0000001583 nova-compute[98241]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:56:39.197191 np0000001583 nova-compute[98241]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:56:39.197191 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:56:39.197574 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsi session list stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:39.197574 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:39.197574 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:39.197574 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:39.197574 np0000001583 nova-compute[98241]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:39.197574 np0000001583 nova-compute[98241]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:39.197574 np0000001583 nova-compute[98241]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:56:39.197574 np0000001583 nova-compute[98241]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:56:39.197574 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:56:39.197972 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.210s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:56:39.198323 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:56:39.200120 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] HCTL ('9', '-', '-', 0) found on session 52 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:56:39.200120 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:56:39.210715 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:39.229454 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Searching for a device in session 52 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:56:39.229454 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:56:39.234159 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:39.234159 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:39.234159 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:39.234159 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:39.234159 np0000001583 nova-compute[98241]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:39.234159 np0000001583 nova-compute[98241]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:39.234159 np0000001583 nova-compute[98241]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:56:39.234159 np0000001583 nova-compute[98241]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:56:39.234159 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:56:39.234159 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsi session list stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:39.234159 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:39.234159 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:39.234159 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:39.234159 np0000001583 nova-compute[98241]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:39.234159 np0000001583 nova-compute[98241]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:39.234159 np0000001583 nova-compute[98241]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:56:39.234159 np0000001583 nova-compute[98241]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:56:39.234159 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:56:39.234159 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.241s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:56:39.234159 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:56:39.234885 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] HCTL ('10', '-', '-', 0) found on session 53 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:56:39.234885 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:56:39.256184 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Searching for a device in session 53 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:56:39.256184 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:56:39.312560 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d77d8b55-c4b8-4a73-ba3f-04e3a8c646cb req-6a397a8d-98fe-4896-9188-13fdb0161a11 service nova] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Received event network-vif-plugged-2bb36d37-52de-4dcf-abb4-35b15f363457 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:39.312560 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d77d8b55-c4b8-4a73-ba3f-04e3a8c646cb req-6a397a8d-98fe-4896-9188-13fdb0161a11 service nova] Acquiring lock "ea9459ae-6246-4d11-b46b-733449884b1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:39.312560 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d77d8b55-c4b8-4a73-ba3f-04e3a8c646cb req-6a397a8d-98fe-4896-9188-13fdb0161a11 service nova] Lock "ea9459ae-6246-4d11-b46b-733449884b1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:39.312560 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d77d8b55-c4b8-4a73-ba3f-04e3a8c646cb req-6a397a8d-98fe-4896-9188-13fdb0161a11 service nova] Lock "ea9459ae-6246-4d11-b46b-733449884b1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:39.312560 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d77d8b55-c4b8-4a73-ba3f-04e3a8c646cb req-6a397a8d-98fe-4896-9188-13fdb0161a11 service nova] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Processing event network-vif-plugged-2bb36d37-52de-4dcf-abb4-35b15f363457 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:56:39.312560 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d77d8b55-c4b8-4a73-ba3f-04e3a8c646cb req-6a397a8d-98fe-4896-9188-13fdb0161a11 service nova] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Received event network-vif-plugged-2bb36d37-52de-4dcf-abb4-35b15f363457 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:39.312560 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d77d8b55-c4b8-4a73-ba3f-04e3a8c646cb req-6a397a8d-98fe-4896-9188-13fdb0161a11 service nova] Acquiring lock "ea9459ae-6246-4d11-b46b-733449884b1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:39.312560 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d77d8b55-c4b8-4a73-ba3f-04e3a8c646cb req-6a397a8d-98fe-4896-9188-13fdb0161a11 service nova] Lock "ea9459ae-6246-4d11-b46b-733449884b1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:39.312560 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d77d8b55-c4b8-4a73-ba3f-04e3a8c646cb req-6a397a8d-98fe-4896-9188-13fdb0161a11 service nova] Lock "ea9459ae-6246-4d11-b46b-733449884b1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:39.312560 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d77d8b55-c4b8-4a73-ba3f-04e3a8c646cb req-6a397a8d-98fe-4896-9188-13fdb0161a11 service nova] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] No waiting events found dispatching network-vif-plugged-2bb36d37-52de-4dcf-abb4-35b15f363457 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:56:39.312560 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-d77d8b55-c4b8-4a73-ba3f-04e3a8c646cb req-6a397a8d-98fe-4896-9188-13fdb0161a11 service nova] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Received unexpected event network-vif-plugged-2bb36d37-52de-4dcf-abb4-35b15f363457 for instance with vm_state shelved_offloaded and task_state spawning.
May 28 01:56:39.312560 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d77d8b55-c4b8-4a73-ba3f-04e3a8c646cb req-6a397a8d-98fe-4896-9188-13fdb0161a11 service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Received event network-vif-plugged-f242e691-1d28-43e0-b83a-2414c00958b8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:39.312560 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:56:39.315006 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d77d8b55-c4b8-4a73-ba3f-04e3a8c646cb req-6a397a8d-98fe-4896-9188-13fdb0161a11 service nova] Acquiring lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:39.315006 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d77d8b55-c4b8-4a73-ba3f-04e3a8c646cb req-6a397a8d-98fe-4896-9188-13fdb0161a11 service nova] Lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:39.315006 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d77d8b55-c4b8-4a73-ba3f-04e3a8c646cb req-6a397a8d-98fe-4896-9188-13fdb0161a11 service nova] Lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:39.315006 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d77d8b55-c4b8-4a73-ba3f-04e3a8c646cb req-6a397a8d-98fe-4896-9188-13fdb0161a11 service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] No waiting events found dispatching network-vif-plugged-f242e691-1d28-43e0-b83a-2414c00958b8 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:56:39.316029 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-d77d8b55-c4b8-4a73-ba3f-04e3a8c646cb req-6a397a8d-98fe-4896-9188-13fdb0161a11 service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Received unexpected event network-vif-plugged-f242e691-1d28-43e0-b83a-2414c00958b8 for instance with vm_state active and task_state None.
May 28 01:56:39.316029 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d77d8b55-c4b8-4a73-ba3f-04e3a8c646cb req-6a397a8d-98fe-4896-9188-13fdb0161a11 service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Received event network-vif-plugged-f242e691-1d28-43e0-b83a-2414c00958b8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:39.317798 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d77d8b55-c4b8-4a73-ba3f-04e3a8c646cb req-6a397a8d-98fe-4896-9188-13fdb0161a11 service nova] Acquiring lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:39.318020 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d77d8b55-c4b8-4a73-ba3f-04e3a8c646cb req-6a397a8d-98fe-4896-9188-13fdb0161a11 service nova] Lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:39.318235 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d77d8b55-c4b8-4a73-ba3f-04e3a8c646cb req-6a397a8d-98fe-4896-9188-13fdb0161a11 service nova] Lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:39.318351 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d77d8b55-c4b8-4a73-ba3f-04e3a8c646cb req-6a397a8d-98fe-4896-9188-13fdb0161a11 service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] No waiting events found dispatching network-vif-plugged-f242e691-1d28-43e0-b83a-2414c00958b8 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:56:39.318515 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-d77d8b55-c4b8-4a73-ba3f-04e3a8c646cb req-6a397a8d-98fe-4896-9188-13fdb0161a11 service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Received unexpected event network-vif-plugged-f242e691-1d28-43e0-b83a-2414c00958b8 for instance with vm_state active and task_state None.
May 28 01:56:39.319772 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:56:39.327666 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Instance spawned successfully.
May 28 01:56:39.432201 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Updating instance_info_cache with network_info: [{"id": "f31bd559-b1fa-4de0-9abf-97d61aa6ffea", "address": "fa:16:3e:ad:d2:22", "network": {"id": "2ee43c4e-569f-4726-9700-add40d768203", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ba381dad8364a488a98b80c04cce8fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf31bd559-b1", "ovs_interfaceid": "f31bd559-b1fa-4de0-9abf-97d61aa6ffea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:56:39.674937 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:56:39.677219 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Removed pending STOPPED event for 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4 due to new event <LifecycleEvent: 1779933399.6769552, 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4 => Resumed> {{(pid=98241) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 01:56:39.677367 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933399.6769552, 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:56:39.677436 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] VM Resumed (Lifecycle Event)
May 28 01:56:39.867593 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:56:39.940770 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Releasing lock "refresh_cache-e4fd6c94-b2c8-4d2b-b89b-c715a30c1884" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:56:39.988621 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:56:40.179922 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:56:40.184599 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:56:40.381395 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b86a2028-d64d-4b20-a808-1d4edec2ffbe tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "ea9459ae-6246-4d11-b46b-733449884b1b" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 20.074s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:40.691954 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933400.6916666, 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:56:40.692160 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] VM Started (Lifecycle Event)
May 28 01:56:41.007423 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Found WWN 3300000002607d8cf for multipath device dm-3 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:56:41.007778 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:56:41.007826 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] <== connect_volume: return (3038ms) {'type': 'block', 'scsi_wwn': '3300000002607d8cf', 'path': '/dev/dm-3', 'multipath_id': '3300000002607d8cf'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:56:41.007989 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002607d8cf', 'path': '/dev/dm-3', 'multipath_id': '3300000002607d8cf'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:56:41.013708 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lazy-loading 'flavor' on Instance uuid 7078fbb1-fa4a-4589-9f95-9d95dee381e0 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:56:41.049967 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:41.194684 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:56:41.197725 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:56:41.520744 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Attempting to attach volume ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98241) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 01:56:41.521830 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] attach device xml: <disk type="block" device="disk">
May 28 01:56:41.521830 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:56:41.521830 np0000001583 nova-compute[98241]:   <alias name="ua-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2"/>
May 28 01:56:41.521830 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-3"/>
May 28 01:56:41.521830 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 01:56:41.521830 np0000001583 nova-compute[98241]:   <serial>ba26e203-0d5a-4c3d-b50d-9d38c042d9d2</serial>
May 28 01:56:41.521830 np0000001583 nova-compute[98241]: </disk>
May 28 01:56:41.521830 np0000001583 nova-compute[98241]:  {{(pid=98241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 01:56:41.592865 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:41.596219 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:41.622032 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:41.700031 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933401.699637, ea9459ae-6246-4d11-b46b-733449884b1b => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:56:41.700241 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] VM Resumed (Lifecycle Event)
May 28 01:56:41.765377 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:41.774176 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:41.887810 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-94208f4f-1657-4485-b4b8-3c2a5b625ef4 req-7488664e-20c1-4f40-8f1a-58dc5cc3900b service nova] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Received event network-vif-unplugged-f31bd559-b1fa-4de0-9abf-97d61aa6ffea {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:41.889019 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-94208f4f-1657-4485-b4b8-3c2a5b625ef4 req-7488664e-20c1-4f40-8f1a-58dc5cc3900b service nova] Acquiring lock "e4fd6c94-b2c8-4d2b-b89b-c715a30c1884-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:41.889323 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-94208f4f-1657-4485-b4b8-3c2a5b625ef4 req-7488664e-20c1-4f40-8f1a-58dc5cc3900b service nova] Lock "e4fd6c94-b2c8-4d2b-b89b-c715a30c1884-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:41.889530 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-94208f4f-1657-4485-b4b8-3c2a5b625ef4 req-7488664e-20c1-4f40-8f1a-58dc5cc3900b service nova] Lock "e4fd6c94-b2c8-4d2b-b89b-c715a30c1884-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:41.889725 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-94208f4f-1657-4485-b4b8-3c2a5b625ef4 req-7488664e-20c1-4f40-8f1a-58dc5cc3900b service nova] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] No waiting events found dispatching network-vif-unplugged-f31bd559-b1fa-4de0-9abf-97d61aa6ffea {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:56:41.889924 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-94208f4f-1657-4485-b4b8-3c2a5b625ef4 req-7488664e-20c1-4f40-8f1a-58dc5cc3900b service nova] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Received unexpected event network-vif-unplugged-f31bd559-b1fa-4de0-9abf-97d61aa6ffea for instance with vm_state active and task_state rescuing.
May 28 01:56:41.929740 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Instance destroyed successfully.
May 28 01:56:41.930611 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lazy-loading 'numa_topology' on Instance uuid e4fd6c94-b2c8-4d2b-b89b-c715a30c1884 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:56:42.204471 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:56:42.207878 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:56:42.372549 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0028531729999485833 future=<Future at 0x7724ec37ec60 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:56:42.372942 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Emitting event <LifecycleEvent: 1779933387.3695083, df5768dc-874f-4725-b2a2-e007aebc11a9 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:56:42.373096 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:56:42.374213 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] VM Stopped (Lifecycle Event)
May 28 01:56:42.375558 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=6.648210420000169 future=<Future at 0x7724ec17c710 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:56:42.375682 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=6.648055665000129 future=<Future at 0x7724ec17c710 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:56:42.443757 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Attempting a stable device rescue
May 28 01:56:42.548649 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=98241) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 28 01:56:42.555377 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Instance directory exists: not creating {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 01:56:42.555949 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Creating image(s)
May 28 01:56:42.557298 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "/opt/stack/data/nova/instances/e4fd6c94-b2c8-4d2b-b89b-c715a30c1884/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:42.557298 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "/opt/stack/data/nova/instances/e4fd6c94-b2c8-4d2b-b89b-c715a30c1884/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:42.557575 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "/opt/stack/data/nova/instances/e4fd6c94-b2c8-4d2b-b89b-c715a30c1884/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:42.557788 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lazy-loading 'trusted_certs' on Instance uuid e4fd6c94-b2c8-4d2b-b89b-c715a30c1884 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:56:42.712171 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999691712999947 future=<Future at 0x7724ec203350 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:56:42.881453 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: df5768dc-874f-4725-b2a2-e007aebc11a9] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:56:43.035050 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:43.060167 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Object Instance<e4fd6c94-b2c8-4d2b-b89b-c715a30c1884> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:56:43.060567 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "0d77f92dafdba4f1aba5f55dc4fe581b87a56861" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:43.060767 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "0d77f92dafdba4f1aba5f55dc4fe581b87a56861" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:43.233954 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:56:43.234409 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:56:43.234409 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:56:43.234409 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] No VIF found with MAC fa:16:3e:30:bd:e8, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:56:43.238697 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:43.571796 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:43.572419 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:43.761700 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:56:43.764824 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:56:43.764960 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d77f92dafdba4f1aba5f55dc4fe581b87a56861.part --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:43.795192 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:43.865609 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d77f92dafdba4f1aba5f55dc4fe581b87a56861.part --force-share --output=json" returned: 0 in 0.100s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:56:43.866062 np0000001583 nova-compute[98241]: DEBUG nova.virt.images [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] e0ecf659-336f-469c-9dc6-56e8b5433507 was qcow2, converting to raw {{(pid=98241) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 01:56:43.870106 np0000001583 nova-compute[98241]: DEBUG nova.privsep.utils [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98241) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 01:56:43.870106 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0d77f92dafdba4f1aba5f55dc4fe581b87a56861.part /opt/stack/data/nova/instances/_base/0d77f92dafdba4f1aba5f55dc4fe581b87a56861.converted {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:43.959703 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0d77f92dafdba4f1aba5f55dc4fe581b87a56861.part /opt/stack/data/nova/instances/_base/0d77f92dafdba4f1aba5f55dc4fe581b87a56861.converted" returned: 0 in 0.091s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:56:43.968986 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d77f92dafdba4f1aba5f55dc4fe581b87a56861.converted --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:43.998228 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-c65bbbbb-a67e-4fb9-a6ec-3a75f2a2a1bb req-48d1bd7f-e158-458a-8d66-c5791c4f684f service nova] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Received event network-vif-unplugged-f31bd559-b1fa-4de0-9abf-97d61aa6ffea {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:44.004178 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c65bbbbb-a67e-4fb9-a6ec-3a75f2a2a1bb req-48d1bd7f-e158-458a-8d66-c5791c4f684f service nova] Acquiring lock "e4fd6c94-b2c8-4d2b-b89b-c715a30c1884-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:44.004675 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c65bbbbb-a67e-4fb9-a6ec-3a75f2a2a1bb req-48d1bd7f-e158-458a-8d66-c5791c4f684f service nova] Lock "e4fd6c94-b2c8-4d2b-b89b-c715a30c1884-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:44.004995 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c65bbbbb-a67e-4fb9-a6ec-3a75f2a2a1bb req-48d1bd7f-e158-458a-8d66-c5791c4f684f service nova] Lock "e4fd6c94-b2c8-4d2b-b89b-c715a30c1884-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:44.005114 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-c65bbbbb-a67e-4fb9-a6ec-3a75f2a2a1bb req-48d1bd7f-e158-458a-8d66-c5791c4f684f service nova] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] No waiting events found dispatching network-vif-unplugged-f31bd559-b1fa-4de0-9abf-97d61aa6ffea {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:56:44.005316 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-c65bbbbb-a67e-4fb9-a6ec-3a75f2a2a1bb req-48d1bd7f-e158-458a-8d66-c5791c4f684f service nova] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Received unexpected event network-vif-unplugged-f31bd559-b1fa-4de0-9abf-97d61aa6ffea for instance with vm_state active and task_state rescuing.
May 28 01:56:44.076785 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:56:44.088872 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d77f92dafdba4f1aba5f55dc4fe581b87a56861.converted --force-share --output=json" returned: 0 in 0.120s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:56:44.091006 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "0d77f92dafdba4f1aba5f55dc4fe581b87a56861" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.029s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:44.091006 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:56:44.094971 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:56:44.097102 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "0d77f92dafdba4f1aba5f55dc4fe581b87a56861" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:44.097102 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "0d77f92dafdba4f1aba5f55dc4fe581b87a56861" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:44.097729 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:56:44.101820 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:56:44.102450 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d77f92dafdba4f1aba5f55dc4fe581b87a56861 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:44.215848 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d77f92dafdba4f1aba5f55dc4fe581b87a56861 --force-share --output=json" returned: 0 in 0.113s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:56:44.215988 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d77f92dafdba4f1aba5f55dc4fe581b87a56861,backing_fmt=raw /opt/stack/data/nova/instances/e4fd6c94-b2c8-4d2b-b89b-c715a30c1884/disk.rescue {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:44.270167 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d77f92dafdba4f1aba5f55dc4fe581b87a56861,backing_fmt=raw /opt/stack/data/nova/instances/e4fd6c94-b2c8-4d2b-b89b-c715a30c1884/disk.rescue" returned: 0 in 0.054s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:56:44.270782 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "0d77f92dafdba4f1aba5f55dc4fe581b87a56861" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.174s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:44.270852 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lazy-loading 'migration_context' on Instance uuid e4fd6c94-b2c8-4d2b-b89b-c715a30c1884 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:56:44.664318 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:44.664318 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:44.669179 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:56:44.670222 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Claim successful on node np0000001583
May 28 01:56:44.774286 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Object Instance<e4fd6c94-b2c8-4d2b-b89b-c715a30c1884> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:56:44.774626 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:56:44.775268 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Start _get_guest_xml network_info=[{"id": "f31bd559-b1fa-4de0-9abf-97d61aa6ffea", "address": "fa:16:3e:ad:d2:22", "network": {"id": "2ee43c4e-569f-4726-9700-add40d768203", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "vif_mac": "fa:16:3e:ad:d2:22"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ba381dad8364a488a98b80c04cce8fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf31bd559-b1", "ovs_interfaceid": "f31bd559-b1fa-4de0-9abf-97d61aa6ffea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e0ecf659-336f-469c-9dc6-56e8b5433507', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c', 'iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '161f7cd8-cf0d-4077-99da-a7d8bba6321c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, 'status': 'reserved', 'instance': 'e4fd6c94-b2c8-4d2b-b89b-c715a30c1884', 'attached_at': '', 'detached_at': '', 'volume_id': '161f7cd8-cf0d-4077-99da-a7d8bba6321c', 'serial': '161f7cd8-cf0d-4077-99da-a7d8bba6321c'}, 'delete_on_termination': True, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'a5c77d2d-e62a-40ca-b3f5-78f2e58c6d2c', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:56:44.775491 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lazy-loading 'resources' on Instance uuid e4fd6c94-b2c8-4d2b-b89b-c715a30c1884 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:56:44.807342 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ce58e315-4246-42bc-8416-173be23b2567 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.661s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:45.282105 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Object Instance<e4fd6c94-b2c8-4d2b-b89b-c715a30c1884> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:56:45.282633 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:56:45.283995 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-938986098', uuid='e4fd6c94-b2c8-4d2b-b89b-c715a30c1884'), owner=OwnerMeta(userid='c3a7b14e31ee40cf9e4f4bba084ccaa5', username='tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member', projectid='2ba381dad8364a488a98b80c04cce8fb', projectname='tempest-ServerBootFromVolumeStableRescueTest-1211567633'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f31bd559-b1fa-4de0-9abf-97d61aa6ffea", "address": "fa:16:3e:ad:d2:22", "network": {"id": "2ee43c4e-569f-4726-9700-add40d768203", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "vif_mac": "fa:16:3e:ad:d2:22"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ba381dad8364a488a98b80c04cce8fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf31bd559-b1", "ovs_interfaceid": "f31bd559-b1fa-4de0-9abf-97d61aa6ffea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933405.2835479) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:56:45.285355 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:56:45.285861 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:56:45.289414 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:56:45.289414 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:56:45.291141 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:56:45.291842 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:56:45.292102 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:56:45.292287 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:56:45.292497 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:56:45.292634 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:56:45.292784 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:56:45.293157 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:56:45.293336 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:56:45.293518 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:56:45.294223 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:56:45.297278 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:56:45.297278 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lazy-loading 'vcpu_model' on Instance uuid e4fd6c94-b2c8-4d2b-b89b-c715a30c1884 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:56:45.798048 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Object Instance<e4fd6c94-b2c8-4d2b-b89b-c715a30c1884> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:56:45.815920 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4fd6c94-b2c8-4d2b-b89b-c715a30c1884/disk.config --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:45.902102 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4fd6c94-b2c8-4d2b-b89b-c715a30c1884/disk.config --force-share --output=json" returned: 0 in 0.085s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:56:45.902102 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "/opt/stack/data/nova/instances/e4fd6c94-b2c8-4d2b-b89b-c715a30c1884/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:45.902359 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "/opt/stack/data/nova/instances/e4fd6c94-b2c8-4d2b-b89b-c715a30c1884/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:45.903054 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "/opt/stack/data/nova/instances/e4fd6c94-b2c8-4d2b-b89b-c715a30c1884/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:45.903686 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:56:45.904820 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c', 'iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '161f7cd8-cf0d-4077-99da-a7d8bba6321c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:56:45.905169 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:56:45.905750 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:56:45.906201 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c', 'iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '161f7cd8-cf0d-4077-99da-a7d8bba6321c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:56:45.918928 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:56:45.919549 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:56:45.919751 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:56:45.920751 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:56:45.924641 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:56:45.924864 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: node.startup = automatic
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: node.session.scan = manual
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:56:45.937362 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:56:45.937362 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: node.startup = automatic
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: node.session.scan = manual
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:56:45.942637 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:56:45.942637 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:45.955472 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:45.967022 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:45.983704 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:45.983704 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:45.983704 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:45.983704 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:45.983704 np0000001583 nova-compute[98241]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:45.983704 np0000001583 nova-compute[98241]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:45.983704 np0000001583 nova-compute[98241]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:56:45.983704 np0000001583 nova-compute[98241]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:56:45.983704 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:56:45.984099 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsi session list stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:45.984099 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:45.984099 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:45.984099 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:45.984099 np0000001583 nova-compute[98241]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:45.984099 np0000001583 nova-compute[98241]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:45.984099 np0000001583 nova-compute[98241]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:56:45.984099 np0000001583 nova-compute[98241]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:56:45.984099 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:56:45.984266 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.060s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:56:45.984371 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:56:45.984957 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] HCTL ('7', '0', '0', 0) found on session 50 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:56:45.985064 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Scanning host 7 c: 0, t: 0, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:56:45.998369 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:45.998369 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:45.998369 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:45.998369 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:45.998369 np0000001583 nova-compute[98241]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:45.998369 np0000001583 nova-compute[98241]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:45.998369 np0000001583 nova-compute[98241]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:56:45.998369 np0000001583 nova-compute[98241]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:56:45.998369 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:56:45.998369 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsi session list stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:45.998369 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:45.998369 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:45.998369 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:45.998369 np0000001583 nova-compute[98241]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:45.998369 np0000001583 nova-compute[98241]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:45.998369 np0000001583 nova-compute[98241]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:56:45.998369 np0000001583 nova-compute[98241]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:56:45.998369 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:56:45.998944 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Searching for a device in session 50 and hctl ('7', '0', '0', 0) yield: sdb {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:56:45.999257 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '161f7cd8-cf0d-4077-99da-a7d8bba6321c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:56:46.001452 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.080s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:56:46.001452 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:56:46.002272 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] HCTL ('8', '0', '0', 0) found on session 51 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:56:46.002529 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Scanning host 8 c: 0, t: 0, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:56:46.024511 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Searching for a device in session 51 and hctl ('8', '0', '0', 0) yield: sdc {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:56:46.024704 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '161f7cd8-cf0d-4077-99da-a7d8bba6321c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:56:46.119974 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:46.245055 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Stashing vm_state: active {{(pid=98241) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 28 01:56:46.366796 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:46.407658 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:56:46.408734 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:56:46.801927 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:46.912315 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:56:46.924033 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:56:47.423436 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.761s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:47.423933 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:56:47.429043 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.628s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:47.941245 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:56:47.941245 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:56:47.941245 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:56:47.941245 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:56:47.944481 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:56:47.944617 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Claim successful on node np0000001583
May 28 01:56:47.949908 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Found WWN 33000000093bcf41a for multipath device dm-0 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:56:47.950163 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.044s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:56:47.950415 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] <== connect_volume: return (2045ms) {'type': 'block', 'scsi_wwn': '33000000093bcf41a', 'path': '/dev/dm-0', 'multipath_id': '33000000093bcf41a'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:56:47.950697 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000093bcf41a', 'path': '/dev/dm-0', 'multipath_id': '33000000093bcf41a'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:56:48.036825 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:48.180110 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '27c90c0a8eb148fda8ae718f07ff1ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fbdf5ed38b4dc485a81c49b3303ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:56:48.240331 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:48.454027 np0000001583 nova-compute[98241]: INFO nova.compute.resource_tracker [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Updating resource usage from migration 58ebb15c-8f8a-42f0-b0e7-e0a6f68f17e9
May 28 01:56:48.457981 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:48.459958 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:56:48.469270 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:56:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-938986098',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-serverbootfromvolumestablerescuetest-server-938986098',id=23,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:56:35Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ba381dad8364a488a98b80c04cce8fb',ramdisk_id='',reservation_id='r-nlyn62br',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1211567633',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:56:35Z,user_data=None,user_id='c3a7b14e31ee40cf9e4f4bba084ccaa5',uuid=e4fd6c94-b2c8-4d2b-b89b-c715a30c1884,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f31bd559-b1fa-4de0-9abf-97d61aa6ffea", "address": "fa:16:3e:ad:d2:22", "network": {"id": "2ee43c4e-569f-4726-9700-add40d768203", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "vif_mac": "fa:16:3e:ad:d2:22"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ba381dad8364a488a98b80c04cce8fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf31bd559-b1", "ovs_interfaceid": "f31bd559-b1fa-4de0-9abf-97d61aa6ffea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:56:48.469270 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Converting VIF {"id": "f31bd559-b1fa-4de0-9abf-97d61aa6ffea", "address": "fa:16:3e:ad:d2:22", "network": {"id": "2ee43c4e-569f-4726-9700-add40d768203", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "vif_mac": "fa:16:3e:ad:d2:22"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ba381dad8364a488a98b80c04cce8fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf31bd559-b1", "ovs_interfaceid": "f31bd559-b1fa-4de0-9abf-97d61aa6ffea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:56:48.469616 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:d2:22,bridge_name='br-int',has_traffic_filtering=True,id=f31bd559-b1fa-4de0-9abf-97d61aa6ffea,network=Network(2ee43c4e-569f-4726-9700-add40d768203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf31bd559-b1') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:56:48.470591 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lazy-loading 'pci_devices' on Instance uuid e4fd6c94-b2c8-4d2b-b89b-c715a30c1884 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:56:48.881559 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Successfully created port: bce4c127-622b-4001-a5df-94a04616b08e {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:56:48.969573 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:56:48.974751 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Object Instance<e4fd6c94-b2c8-4d2b-b89b-c715a30c1884> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:56:48.976724 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] End _get_guest_xml xml=<domain type="qemu">
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:   <uuid>e4fd6c94-b2c8-4d2b-b89b-c715a30c1884</uuid>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:   <name>instance-00000017</name>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-938986098</nova:name>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:56:45</nova:creationTime>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:         <nova:user uuid="c3a7b14e31ee40cf9e4f4bba084ccaa5">tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member</nova:user>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:         <nova:project uuid="2ba381dad8364a488a98b80c04cce8fb">tempest-ServerBootFromVolumeStableRescueTest-1211567633</nova:project>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:         <nova:port uuid="f31bd559-b1fa-4de0-9abf-97d61aa6ffea">
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:     <system>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:       <entry name="serial">e4fd6c94-b2c8-4d2b-b89b-c715a30c1884</entry>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:       <entry name="uuid">e4fd6c94-b2c8-4d2b-b89b-c715a30c1884</entry>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:     </system>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:   <os>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:   </os>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:   <features>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:   </features>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:   <devices>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/e4fd6c94-b2c8-4d2b-b89b-c715a30c1884/disk.config"/>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:     </disk>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:     <disk type="block" device="disk">
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:       <alias name="ua-161f7cd8-cf0d-4077-99da-a7d8bba6321c"/>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:       <source dev="/dev/dm-0"/>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:       <serial>161f7cd8-cf0d-4077-99da-a7d8bba6321c</serial>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:     </disk>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/e4fd6c94-b2c8-4d2b-b89b-c715a30c1884/disk.rescue"/>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:       <target dev="vdb" bus="virtio"/>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:       <boot order="1"/>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:     </disk>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:ad:d2:22"/>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:       <target dev="tapf31bd559-b1"/>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:     </interface>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/e4fd6c94-b2c8-4d2b-b89b-c715a30c1884/console.log" append="off"/>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:     </serial>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:     <video>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:     </video>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:     </rng>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:   </devices>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]: </domain>
May 28 01:56:48.976724 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:56:48.984208 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Instance destroyed successfully.
May 28 01:56:49.024353 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0004561409998586896 future=<Future at 0x7724ec17c710 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:56:49.024656 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:56:49.024799 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=2.715737494999985 future=<Future at 0x7724ec4e3c20 state=cancelled>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:56:49.024881 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=2.715635870999904 future=<Future at 0x7724ec4e3c20 state=cancelled>) was cancelled while queued, skipping {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:56:49.024972 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:56:49.025138 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=8.686731159999908 future=<Future at 0x7724ec203350 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:56:49.025203 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=8.686607473999857 future=<Future at 0x7724ec203350 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:56:49.025688 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Emitting event <LifecycleEvent: 1779933394.0236783, 587a002a-2b9c-4865-8ce2-088ad567c81b => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:56:49.025848 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] VM Stopped (Lifecycle Event)
May 28 01:56:49.215962 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:56:49.215962 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:56:49.478104 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Booting with volume 78c187c7-3cb4-4c4d-a525-9e431e3d0d1a at /dev/vda
May 28 01:56:49.529843 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cfbc2199-3831-41fe-8187-0f2379140a0c tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 587a002a-2b9c-4865-8ce2-088ad567c81b] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:56:49.549395 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:56:49.570782 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:56:49.603103 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:49.645484 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:56:49.645975 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:56:49.661620 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:56:49.663626 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe63:2bb1', 'fe80::e43a:d5ff:fecc:27fe', 'fe80::fc16:3eff:fe27:be54', 'fe80::a0e4:60ff:fe3f:73d6', 'fe80::fc16:3eff:fee1:1d3', 'fe80::fc16:3eff:fe30:bde8', 'fe80::e04b:eeff:fe0a:e20d', 'fe80::fc16:3eff:fe20:92ee', 'fe80::fc16:3eff:fe86:7ea1', 'fe80::c4dd:b4ff:fe11:7c8', 'fe80::fc16:3eff:fe5c:c25f', 'fe80::819:abff:fece:7871'] 
May 28 01:56:49.663892 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:56:49.664177 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:56:49.664587 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:56:49.664920 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Updating existing volume attachment record: e6741f72-c29c-4b7e-bb09-99589949bad9 {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:56:49.718701 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:56:50.228388 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.799s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:50.228656 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Migrating
May 28 01:56:50.228880 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:56:50.229026 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Acquired lock "compute-rpcapi-router" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:56:50.511173 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:56:50.511173 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:56:50.511173 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:56:50.511173 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] No VIF found with MAC fa:16:3e:ad:d2:22, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:56:50.511173 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Using config drive
May 28 01:56:50.731241 np0000001583 nova-compute[98241]: INFO nova.compute.rpcapi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Automatically selected compute RPC version 6.5 from minimum service version 72
May 28 01:56:50.732065 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Releasing lock "compute-rpcapi-router" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:56:50.732364 np0000001583 nova-compute[98241]: DEBUG nova.compute.rpcapi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98241) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 01:56:50.786691 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Successfully updated port: bce4c127-622b-4001-a5df-94a04616b08e {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:56:50.871288 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2c21d41b-7109-4b84-b130-a49b5fb15d70 req-392a11c2-af3a-42fb-ac35-2059d0522b23 service nova] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Received event network-changed-bce4c127-622b-4001-a5df-94a04616b08e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:50.871420 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2c21d41b-7109-4b84-b130-a49b5fb15d70 req-392a11c2-af3a-42fb-ac35-2059d0522b23 service nova] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Refreshing instance network info cache due to event network-changed-bce4c127-622b-4001-a5df-94a04616b08e. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:56:50.871591 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2c21d41b-7109-4b84-b130-a49b5fb15d70 req-392a11c2-af3a-42fb-ac35-2059d0522b23 service nova] Acquiring lock "refresh_cache-12f40ca4-b4b3-43f4-8c0b-cb208f59935c" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:56:50.871756 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2c21d41b-7109-4b84-b130-a49b5fb15d70 req-392a11c2-af3a-42fb-ac35-2059d0522b23 service nova] Acquired lock "refresh_cache-12f40ca4-b4b3-43f4-8c0b-cb208f59935c" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:56:50.871816 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-2c21d41b-7109-4b84-b130-a49b5fb15d70 req-392a11c2-af3a-42fb-ac35-2059d0522b23 service nova] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Refreshing network info cache for port bce4c127-622b-4001-a5df-94a04616b08e {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:56:51.016589 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lazy-loading 'ec2_ids' on Instance uuid e4fd6c94-b2c8-4d2b-b89b-c715a30c1884 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:56:51.261374 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Acquiring lock "refresh_cache-7078fbb1-fa4a-4589-9f95-9d95dee381e0" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:56:51.261575 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Acquired lock "refresh_cache-7078fbb1-fa4a-4589-9f95-9d95dee381e0" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:56:51.261634 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:56:51.289630 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "refresh_cache-12f40ca4-b4b3-43f4-8c0b-cb208f59935c" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:56:51.374642 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-2c21d41b-7109-4b84-b130-a49b5fb15d70 req-392a11c2-af3a-42fb-ac35-2059d0522b23 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:56:51.521787 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Object Instance<e4fd6c94-b2c8-4d2b-b89b-c715a30c1884> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:56:51.523898 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lazy-loading 'keypairs' on Instance uuid e4fd6c94-b2c8-4d2b-b89b-c715a30c1884 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:56:51.629652 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-2c21d41b-7109-4b84-b130-a49b5fb15d70 req-392a11c2-af3a-42fb-ac35-2059d0522b23 service nova] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:56:51.764787 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:56:51.812378 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:56:51.813489 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:56:51.813910 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Creating image(s)
May 28 01:56:51.815643 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Did not create local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 01:56:51.815643 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Ensure instance console log exists: /opt/stack/data/nova/instances/12f40ca4-b4b3-43f4-8c0b-cb208f59935c/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:56:51.815643 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:51.815643 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:51.815643 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:51.880949 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-2c21d41b-7109-4b84-b130-a49b5fb15d70 req-392a11c2-af3a-42fb-ac35-2059d0522b23 service nova] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:56:52.025849 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Object Instance<e4fd6c94-b2c8-4d2b-b89b-c715a30c1884> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:56:52.029030 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:56:52.032587 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:52.241700 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Creating config drive at /opt/stack/data/nova/instances/e4fd6c94-b2c8-4d2b-b89b-c715a30c1884/disk.config.rescue
May 28 01:56:52.247174 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e4fd6c94-b2c8-4d2b-b89b-c715a30c1884/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpjdaixyci {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:52.270387 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:56:52.310951 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e4fd6c94-b2c8-4d2b-b89b-c715a30c1884/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpjdaixyci" returned: 0 in 0.064s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:56:52.383924 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2c21d41b-7109-4b84-b130-a49b5fb15d70 req-392a11c2-af3a-42fb-ac35-2059d0522b23 service nova] Releasing lock "refresh_cache-12f40ca4-b4b3-43f4-8c0b-cb208f59935c" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:56:52.384591 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquired lock "refresh_cache-12f40ca4-b4b3-43f4-8c0b-cb208f59935c" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:56:52.384946 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:56:52.442037 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Updating instance_info_cache with network_info: [{"id": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "address": "fa:16:3e:30:bd:e8", "network": {"id": "11b2c699-14f1-4eba-bbe6-b7655c6f17cc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1044342879-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2db0b9fa3fcc47408dad261c2004e4a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7567636b-72", "ovs_interfaceid": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:56:52.655917 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:52.855046 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:52.877750 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:52.878839 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:52.946983 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Releasing lock "refresh_cache-7078fbb1-fa4a-4589-9f95-9d95dee381e0" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:56:52.994608 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:53.038876 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:56:53.041545 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:53.069958 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:53.070645 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:53.241578 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:53.410016 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:56:53.688437 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Updating instance_info_cache with network_info: [{"id": "bce4c127-622b-4001-a5df-94a04616b08e", "address": "fa:16:3e:b1:89:97", "network": {"id": "b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-280876007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60fbdf5ed38b4dc485a81c49b3303ed2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbce4c127-62", "ovs_interfaceid": "bce4c127-622b-4001-a5df-94a04616b08e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:56:53.900588 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Removed pending STOPPED event for e4fd6c94-b2c8-4d2b-b89b-c715a30c1884 due to new event <LifecycleEvent: 1779933413.9000964, e4fd6c94-b2c8-4d2b-b89b-c715a30c1884 => Resumed> {{(pid=98241) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 01:56:53.901117 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933413.9000964, e4fd6c94-b2c8-4d2b-b89b-c715a30c1884 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:56:53.901117 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] VM Resumed (Lifecycle Event)
May 28 01:56:53.907871 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-33d7f1fe-397b-42bc-ba4a-781d67090154 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:56:54.101313 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:54.192461 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Releasing lock "refresh_cache-12f40ca4-b4b3-43f4-8c0b-cb208f59935c" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:56:54.192804 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Instance network_info: |[{"id": "bce4c127-622b-4001-a5df-94a04616b08e", "address": "fa:16:3e:b1:89:97", "network": {"id": "b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-280876007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60fbdf5ed38b4dc485a81c49b3303ed2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbce4c127-62", "ovs_interfaceid": "bce4c127-622b-4001-a5df-94a04616b08e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:56:54.194244 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Start _get_guest_xml network_info=[{"id": "bce4c127-622b-4001-a5df-94a04616b08e", "address": "fa:16:3e:b1:89:97", "network": {"id": "b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-280876007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60fbdf5ed38b4dc485a81c49b3303ed2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbce4c127-62", "ovs_interfaceid": "bce4c127-622b-4001-a5df-94a04616b08e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', 'iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '12f40ca4-b4b3-43f4-8c0b-cb208f59935c', 'attached_at': '', 'detached_at': '', 'volume_id': '78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', 'serial': '78c187c7-3cb4-4c4d-a525-9e431e3d0d1a'}, 'delete_on_termination': True, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'e6741f72-c29c-4b7e-bb09-99589949bad9', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:56:54.198317 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:56:54.199838 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-1837652712', uuid='12f40ca4-b4b3-43f4-8c0b-cb208f59935c'), owner=OwnerMeta(userid='27c90c0a8eb148fda8ae718f07ff1ed4', username='tempest-ServerActionsTestOtherA-1714646345-project-member', projectid='60fbdf5ed38b4dc485a81c49b3303ed2', projectname='tempest-ServerActionsTestOtherA-1714646345'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "bce4c127-622b-4001-a5df-94a04616b08e", "address": "fa:16:3e:b1:89:97", "network": {"id": "b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-280876007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60fbdf5ed38b4dc485a81c49b3303ed2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbce4c127-62", "ovs_interfaceid": "bce4c127-622b-4001-a5df-94a04616b08e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933414.1993976) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:56:54.203110 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:56:54.203110 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:56:54.205554 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:56:54.209107 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:56:54.209107 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:56:54.209107 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:56:54.209107 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:56:54.209107 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:56:54.209107 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:56:54.209107 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:56:54.209107 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:56:54.210048 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:56:54.210349 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:56:54.210787 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:56:54.211133 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:56:54.211409 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:56:54.226037 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:56:54.227113 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', 'iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:56:54.227113 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:56:54.227668 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:56:54.228124 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', 'iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:56:54.244355 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:56:54.244994 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:56:54.245755 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:56:54.249942 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:56:54.250397 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:56:54.250774 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:56:54.267751 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:56:54.267751 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:54.278985 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:56:54.278985 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:54.292570 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a] added
May 28 01:56:54.292570 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:56:54.292570 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:56:54.292570 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:56:54.292570 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:56:54.292570 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:56:54.292570 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:54.292570 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:56:54.292570 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0425(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:56:54.292570 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:56:54.297318 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a] added
May 28 01:56:54.297318 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:56:54.297318 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:56:54.297318 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:56:54.297318 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:56:54.297318 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:56:54.297318 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:54.297629 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:56:54.297629 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0474(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:56:54.297759 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:56:54.412656 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:56:54.414826 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:56:54.464951 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Starting migrate_disk_and_power_off {{(pid=98241) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 28 01:56:54.495368 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:54.502216 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:54.524974 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:54.552610 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:54.559142 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:54.848613 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Instance destroyed successfully.
May 28 01:56:54.851680 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:55:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1792038090',display_name='tempest-ServerActionsTestOtherB-server-1792038090',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-serveractionstestotherb-server-1792038090',id=21,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNeqI2aR1ssi4HNJOeFKCNjp+Pt+IJYlcdzP/eafAClJj6eROY4EAGFoc44ZS4UJO1qzGM7qaA7m9ha8h0zhGTrn53zFMwGuQ42KOAfa++4mKlE3DbzUB8ddEdTJR9n/hA==',key_name='tempest-keypair-738336147',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:55:53Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2db0b9fa3fcc47408dad261c2004e4a5',ramdisk_id='',reservation_id='r-aqj2v230',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-640844130',owner_user_name='tempest-ServerActionsTestOtherB-640844130-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:56:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f68ae604d0442439a927020cec740c0',uuid=7078fbb1-fa4a-4589-9f95-9d95dee381e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "address": "fa:16:3e:30:bd:e8", "network": {"id": "11b2c699-14f1-4eba-bbe6-b7655c6f17cc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1044342879-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.99", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1044342879-network", "vif_mac": "fa:16:3e:30:bd:e8"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2db0b9fa3fcc47408dad261c2004e4a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7567636b-72", "ovs_interfaceid": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:56:54.851979 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Converting VIF {"id": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "address": "fa:16:3e:30:bd:e8", "network": {"id": "11b2c699-14f1-4eba-bbe6-b7655c6f17cc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1044342879-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.99", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1044342879-network", "vif_mac": "fa:16:3e:30:bd:e8"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2db0b9fa3fcc47408dad261c2004e4a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7567636b-72", "ovs_interfaceid": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:56:54.852947 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:bd:e8,bridge_name='br-int',has_traffic_filtering=True,id=7567636b-7225-4025-b9f0-d4c8eb5abe43,network=Network(11b2c699-14f1-4eba-bbe6-b7655c6f17cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7567636b-72') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:56:54.854970 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:bd:e8,bridge_name='br-int',has_traffic_filtering=True,id=7567636b-7225-4025-b9f0-d4c8eb5abe43,network=Network(11b2c699-14f1-4eba-bbe6-b7655c6f17cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7567636b-72') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:56:54.860792 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:54.861188 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7567636b-72, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:56:54.862815 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:54.864053 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:56:54.865400 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:54.867249 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:54.867449 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=746878da-74c9-482f-9afb-e8561bf6e119) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:56:54.868136 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:54.869123 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:56:54.869658 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:54.872258 np0000001583 nova-compute[98241]: INFO os_vif [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:bd:e8,bridge_name='br-int',has_traffic_filtering=True,id=7567636b-7225-4025-b9f0-d4c8eb5abe43,network=Network(11b2c699-14f1-4eba-bbe6-b7655c6f17cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7567636b-72')
May 28 01:56:54.877972 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:56:54.878666 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:56:54.878929 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:56:54.924292 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933414.923968, e4fd6c94-b2c8-4d2b-b89b-c715a30c1884 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:56:54.925440 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] VM Started (Lifecycle Event)
May 28 01:56:55.091860 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e2ed6929-8dda-4353-b75e-8d748fcfe5c6 req-278790f9-6ad5-4ede-93e2-19d0e7ec4ef6 service nova] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Received event network-vif-plugged-f31bd559-b1fa-4de0-9abf-97d61aa6ffea {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:55.093168 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e2ed6929-8dda-4353-b75e-8d748fcfe5c6 req-278790f9-6ad5-4ede-93e2-19d0e7ec4ef6 service nova] Acquiring lock "e4fd6c94-b2c8-4d2b-b89b-c715a30c1884-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:55.093168 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e2ed6929-8dda-4353-b75e-8d748fcfe5c6 req-278790f9-6ad5-4ede-93e2-19d0e7ec4ef6 service nova] Lock "e4fd6c94-b2c8-4d2b-b89b-c715a30c1884-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:55.093600 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e2ed6929-8dda-4353-b75e-8d748fcfe5c6 req-278790f9-6ad5-4ede-93e2-19d0e7ec4ef6 service nova] Lock "e4fd6c94-b2c8-4d2b-b89b-c715a30c1884-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:55.093600 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e2ed6929-8dda-4353-b75e-8d748fcfe5c6 req-278790f9-6ad5-4ede-93e2-19d0e7ec4ef6 service nova] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] No waiting events found dispatching network-vif-plugged-f31bd559-b1fa-4de0-9abf-97d61aa6ffea {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:56:55.093600 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-e2ed6929-8dda-4353-b75e-8d748fcfe5c6 req-278790f9-6ad5-4ede-93e2-19d0e7ec4ef6 service nova] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Received unexpected event network-vif-plugged-f31bd559-b1fa-4de0-9abf-97d61aa6ffea for instance with vm_state rescued and task_state None.
May 28 01:56:55.247324 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:55.294913 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:56:55.298224 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:56:55.315118 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:56:55.315118 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:56:55.317603 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:56:55.317603 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:55.339390 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:55.353173 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:55.368586 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:55.368586 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:55.368586 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:55.368586 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:55.368586 np0000001583 nova-compute[98241]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:55.368586 np0000001583 nova-compute[98241]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:55.368586 np0000001583 nova-compute[98241]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:56:55.368586 np0000001583 nova-compute[98241]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:56:55.368586 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:56:55.368915 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsi session list stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:55.368915 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:55.368915 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:55.368915 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:55.368915 np0000001583 nova-compute[98241]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:55.368915 np0000001583 nova-compute[98241]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:55.368915 np0000001583 nova-compute[98241]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:56:55.368915 np0000001583 nova-compute[98241]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:56:55.368915 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:56:55.373561 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:55.373561 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:55.373561 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:55.373561 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:55.373561 np0000001583 nova-compute[98241]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:55.373561 np0000001583 nova-compute[98241]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:55.373561 np0000001583 nova-compute[98241]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:56:55.373561 np0000001583 nova-compute[98241]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:56:55.373561 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:56:55.374035 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsi session list stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:55.374035 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:55.374035 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:55.374035 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:55.374035 np0000001583 nova-compute[98241]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:55.374035 np0000001583 nova-compute[98241]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:55.374035 np0000001583 nova-compute[98241]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:56:55.374035 np0000001583 nova-compute[98241]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:56:55.374035 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:56:55.419284 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a, portal: 192.168.40.100,3260]
May 28 01:56:55.419284 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a, portal: 192.168.40.100,3260] successful.
May 28 01:56:55.419284 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:55.428818 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a, portal: 192.168.50.100,3260]
May 28 01:56:55.428818 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a, portal: 192.168.50.100,3260] successful.
May 28 01:56:55.428818 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:55.430182 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:56:55.436872 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:56:55.442195 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:55.449194 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:55.471898 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:55.471898 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:55.471898 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:55.471898 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:55.471898 np0000001583 nova-compute[98241]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:55.471898 np0000001583 nova-compute[98241]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:55.471898 np0000001583 nova-compute[98241]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:56:55.471898 np0000001583 nova-compute[98241]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:56:55.471898 np0000001583 nova-compute[98241]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:56:55.471898 np0000001583 nova-compute[98241]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:56:55.471898 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:56:55.472500 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsi session list stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:55.472500 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:55.472500 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:55.472500 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:55.472500 np0000001583 nova-compute[98241]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:55.472500 np0000001583 nova-compute[98241]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:55.472500 np0000001583 nova-compute[98241]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:56:55.472500 np0000001583 nova-compute[98241]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:56:55.472500 np0000001583 nova-compute[98241]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:56:55.472500 np0000001583 nova-compute[98241]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:56:55.472500 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:56:55.472500 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.226s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:56:55.473116 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:56:55.474357 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] HCTL ('11', '-', '-', 0) found on session 54 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:56:55.474357 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:56:55.476935 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:55.476935 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:55.476935 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:55.476935 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:55.476935 np0000001583 nova-compute[98241]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:55.476935 np0000001583 nova-compute[98241]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:55.476935 np0000001583 nova-compute[98241]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:56:55.476935 np0000001583 nova-compute[98241]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:56:55.476935 np0000001583 nova-compute[98241]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:56:55.476935 np0000001583 nova-compute[98241]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:56:55.476935 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:56:55.477270 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsi session list stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:55.477270 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:55.477270 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:55.477270 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:55.477270 np0000001583 nova-compute[98241]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:55.477270 np0000001583 nova-compute[98241]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:55.477270 np0000001583 nova-compute[98241]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:56:55.477270 np0000001583 nova-compute[98241]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:56:55.477270 np0000001583 nova-compute[98241]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:56:55.477270 np0000001583 nova-compute[98241]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:56:55.477270 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:56:55.477549 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.232s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:56:55.477549 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:56:55.478683 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] HCTL ('12', '-', '-', 0) found on session 55 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:56:55.482206 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:56:55.503191 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Searching for a device in session 54 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:56:55.503191 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:56:55.521206 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Searching for a device in session 55 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:56:55.521206 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:56:55.942287 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999674989999903 future=<Future at 0x7724ec317b90 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:56:56.095485 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-73114472-13b4-4671-a428-2de392fe953d req-e8df0f40-b2f1-43bd-80cb-8b753275423b service nova] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Received event network-vif-unplugged-bce4c127-622b-4001-a5df-94a04616b08e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:56.099015 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-73114472-13b4-4671-a428-2de392fe953d req-e8df0f40-b2f1-43bd-80cb-8b753275423b service nova] Acquiring lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:56.099015 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-73114472-13b4-4671-a428-2de392fe953d req-e8df0f40-b2f1-43bd-80cb-8b753275423b service nova] Lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:56.099015 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-73114472-13b4-4671-a428-2de392fe953d req-e8df0f40-b2f1-43bd-80cb-8b753275423b service nova] Lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:56.099015 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-73114472-13b4-4671-a428-2de392fe953d req-e8df0f40-b2f1-43bd-80cb-8b753275423b service nova] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] No waiting events found dispatching network-vif-unplugged-bce4c127-622b-4001-a5df-94a04616b08e {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:56:56.099015 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-73114472-13b4-4671-a428-2de392fe953d req-e8df0f40-b2f1-43bd-80cb-8b753275423b service nova] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Received unexpected event network-vif-unplugged-bce4c127-622b-4001-a5df-94a04616b08e for instance with vm_state building and task_state spawning.
May 28 01:56:56.247318 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:56:56.327396 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-52183f2c-7317-4de1-a1a6-da8df69b261b tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Unrescuing
May 28 01:56:56.327592 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-52183f2c-7317-4de1-a1a6-da8df69b261b tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "refresh_cache-e4fd6c94-b2c8-4d2b-b89b-c715a30c1884" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:56:56.327716 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-52183f2c-7317-4de1-a1a6-da8df69b261b tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquired lock "refresh_cache-e4fd6c94-b2c8-4d2b-b89b-c715a30c1884" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:56:56.327810 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-52183f2c-7317-4de1-a1a6-da8df69b261b tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:56:56.830417 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-52183f2c-7317-4de1-a1a6-da8df69b261b tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:56:57.275909 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Found WWN 330000000acc6074f for multipath device dm-4 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:56:57.276335 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.049s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:56:57.276435 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] <== connect_volume: return (3049ms) {'type': 'block', 'scsi_wwn': '330000000acc6074f', 'path': '/dev/dm-4', 'multipath_id': '330000000acc6074f'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:56:57.278714 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.398s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:56:57.279165 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000acc6074f', 'path': '/dev/dm-4', 'multipath_id': '330000000acc6074f'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:56:57.279336 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:56:57.279763 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:56:57.321497 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:57.321497 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:57.321497 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:57.321497 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:57.321497 np0000001583 nova-compute[98241]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:57.321497 np0000001583 nova-compute[98241]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:57.321497 np0000001583 nova-compute[98241]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:56:57.321497 np0000001583 nova-compute[98241]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:56:57.321497 np0000001583 nova-compute[98241]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:56:57.321497 np0000001583 nova-compute[98241]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:56:57.321497 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:56:57.321765 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsi session list stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:57.321765 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:56:57.321765 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:57.321765 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:56:57.321765 np0000001583 nova-compute[98241]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:57.321765 np0000001583 nova-compute[98241]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:56:57.321765 np0000001583 nova-compute[98241]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:56:57.321765 np0000001583 nova-compute[98241]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:56:57.321765 np0000001583 nova-compute[98241]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:56:57.321765 np0000001583 nova-compute[98241]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:56:57.321765 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:56:57.321765 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629', '48'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629', '49'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c', '50'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c', '51'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', '52'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', '53'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', '54'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', '55')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:56:57.322050 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', '53')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:56:57.323026 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', '52')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:56:57.323830 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f829c0e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2'): ({'sdd'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:56:57.324122 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Removing multipathed devices sdd, sde {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:56:57.326355 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Flush multipath device 3300000002607d8cf {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:56:57.326665 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-52183f2c-7317-4de1-a1a6-da8df69b261b tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:56:57.365834 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:56:57.374273 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2daa7d55-c037-4c9b-b456-d10daa0738e4 req-a34d28ef-dd27-48a1-9573-b7f1dbba3649 service nova] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Received event network-vif-plugged-f31bd559-b1fa-4de0-9abf-97d61aa6ffea {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:57.374611 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2daa7d55-c037-4c9b-b456-d10daa0738e4 req-a34d28ef-dd27-48a1-9573-b7f1dbba3649 service nova] Acquiring lock "e4fd6c94-b2c8-4d2b-b89b-c715a30c1884-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:57.375341 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2daa7d55-c037-4c9b-b456-d10daa0738e4 req-a34d28ef-dd27-48a1-9573-b7f1dbba3649 service nova] Lock "e4fd6c94-b2c8-4d2b-b89b-c715a30c1884-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:57.375478 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2daa7d55-c037-4c9b-b456-d10daa0738e4 req-a34d28ef-dd27-48a1-9573-b7f1dbba3649 service nova] Lock "e4fd6c94-b2c8-4d2b-b89b-c715a30c1884-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:57.376247 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2daa7d55-c037-4c9b-b456-d10daa0738e4 req-a34d28ef-dd27-48a1-9573-b7f1dbba3649 service nova] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] No waiting events found dispatching network-vif-plugged-f31bd559-b1fa-4de0-9abf-97d61aa6ffea {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:56:57.376732 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-2daa7d55-c037-4c9b-b456-d10daa0738e4 req-a34d28ef-dd27-48a1-9573-b7f1dbba3649 service nova] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Received unexpected event network-vif-plugged-f31bd559-b1fa-4de0-9abf-97d61aa6ffea for instance with vm_state rescued and task_state unrescuing.
May 28 01:56:57.376732 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2daa7d55-c037-4c9b-b456-d10daa0738e4 req-a34d28ef-dd27-48a1-9573-b7f1dbba3649 service nova] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Received event network-vif-unplugged-7567636b-7225-4025-b9f0-d4c8eb5abe43 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:57.378319 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2daa7d55-c037-4c9b-b456-d10daa0738e4 req-a34d28ef-dd27-48a1-9573-b7f1dbba3649 service nova] Acquiring lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:57.378412 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2daa7d55-c037-4c9b-b456-d10daa0738e4 req-a34d28ef-dd27-48a1-9573-b7f1dbba3649 service nova] Lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:57.378691 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2daa7d55-c037-4c9b-b456-d10daa0738e4 req-a34d28ef-dd27-48a1-9573-b7f1dbba3649 service nova] Lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:57.378691 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2daa7d55-c037-4c9b-b456-d10daa0738e4 req-a34d28ef-dd27-48a1-9573-b7f1dbba3649 service nova] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] No waiting events found dispatching network-vif-unplugged-7567636b-7225-4025-b9f0-d4c8eb5abe43 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:56:57.378779 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-2daa7d55-c037-4c9b-b456-d10daa0738e4 req-a34d28ef-dd27-48a1-9573-b7f1dbba3649 service nova] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Received unexpected event network-vif-unplugged-7567636b-7225-4025-b9f0-d4c8eb5abe43 for instance with vm_state active and task_state resize_migrating.
May 28 01:56:57.378937 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2daa7d55-c037-4c9b-b456-d10daa0738e4 req-a34d28ef-dd27-48a1-9573-b7f1dbba3649 service nova] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Received event network-vif-unplugged-7567636b-7225-4025-b9f0-d4c8eb5abe43 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:56:57.379966 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2daa7d55-c037-4c9b-b456-d10daa0738e4 req-a34d28ef-dd27-48a1-9573-b7f1dbba3649 service nova] Acquiring lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:57.379966 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2daa7d55-c037-4c9b-b456-d10daa0738e4 req-a34d28ef-dd27-48a1-9573-b7f1dbba3649 service nova] Lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:57.380667 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2daa7d55-c037-4c9b-b456-d10daa0738e4 req-a34d28ef-dd27-48a1-9573-b7f1dbba3649 service nova] Lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:57.380928 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2daa7d55-c037-4c9b-b456-d10daa0738e4 req-a34d28ef-dd27-48a1-9573-b7f1dbba3649 service nova] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] No waiting events found dispatching network-vif-unplugged-7567636b-7225-4025-b9f0-d4c8eb5abe43 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:56:57.382455 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-2daa7d55-c037-4c9b-b456-d10daa0738e4 req-a34d28ef-dd27-48a1-9573-b7f1dbba3649 service nova] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Received unexpected event network-vif-unplugged-7567636b-7225-4025-b9f0-d4c8eb5abe43 for instance with vm_state active and task_state resize_migrating.
May 28 01:56:57.402628 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:56:57.448459 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:56:57.448685 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:56:57.449823 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:56:57.469584 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:56:57.469584 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:56:57.491091 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:57.518349 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-52183f2c-7317-4de1-a1a6-da8df69b261b tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Updating instance_info_cache with network_info: [{"id": "f31bd559-b1fa-4de0-9abf-97d61aa6ffea", "address": "fa:16:3e:ad:d2:22", "network": {"id": "2ee43c4e-569f-4726-9700-add40d768203", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ba381dad8364a488a98b80c04cce8fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf31bd559-b1", "ovs_interfaceid": "f31bd559-b1fa-4de0-9abf-97d61aa6ffea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:56:57.530287 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2, portal: 192.168.40.100,3260]
May 28 01:56:57.530287 np0000001583 nova-compute[98241]: Logout of [sid: 53, target: iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2, portal: 192.168.40.100,3260] successful.
May 28 01:56:57.530287 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:57.557148 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:57.569688 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:57.611310 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2, portal: 192.168.50.100,3260]
May 28 01:56:57.611310 np0000001583 nova-compute[98241]: Logout of [sid: 52, target: iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2, portal: 192.168.50.100,3260] successful.
May 28 01:56:57.611310 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:57.637133 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:56:57.637378 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:56:57.637509 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] <== disconnect_volume: return (2758ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:56:57.637653 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:56:57.653004 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:57.713148 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0012177080000128626 future=<Future at 0x7724ec203350 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:56:57.713248 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:56:57.713375 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=13.228302860999975 future=<Future at 0x7724ec317b90 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:56:57.713454 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=13.228209872999969 future=<Future at 0x7724ec317b90 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:56:57.752591 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:56:57.756138 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:57.790106 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:56:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1837652712',display_name='tempest-ServerActionsTestOtherA-server-1837652712',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-serveractionstestothera-server-1837652712',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIePG0IU7S1SlFjpc/VmXFCBBKIijsN+gHQMlnhYfGPcl665nwX9JP0OwVOuueebU/mRc6FRuLr9ai0zvPAu2rDRN1UE1FBgnGgOOoImTJFqPL9BfFXoi8JNvWclsGpwzg==',key_name='tempest-keypair-1911990843',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60fbdf5ed38b4dc485a81c49b3303ed2',ramdisk_id='',reservation_id='r-t6bk0usf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1714646345',owner_user_name='tempest-ServerActionsTestOtherA-1714646345-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:56:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27c90c0a8eb148fda8ae718f07ff1ed4',uuid=12f40ca4-b4b3-43f4-8c0b-cb208f59935c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bce4c127-622b-4001-a5df-94a04616b08e", "address": "fa:16:3e:b1:89:97", "network": {"id": "b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-280876007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60fbdf5ed38b4dc485a81c49b3303ed2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbce4c127-62", "ovs_interfaceid": "bce4c127-622b-4001-a5df-94a04616b08e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:56:57.790106 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Converting VIF {"id": "bce4c127-622b-4001-a5df-94a04616b08e", "address": "fa:16:3e:b1:89:97", "network": {"id": "b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-280876007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60fbdf5ed38b4dc485a81c49b3303ed2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbce4c127-62", "ovs_interfaceid": "bce4c127-622b-4001-a5df-94a04616b08e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:56:57.790106 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:89:97,bridge_name='br-int',has_traffic_filtering=True,id=bce4c127-622b-4001-a5df-94a04616b08e,network=Network(b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbce4c127-62') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:56:57.790801 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lazy-loading 'pci_devices' on Instance uuid 12f40ca4-b4b3-43f4-8c0b-cb208f59935c {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:56:57.842721 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:56:57.843069 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] skipping disk /dev/dm-3 (vdb) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:56:57.843833 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0_resize/disk /opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0/disk {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:57.939453 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] CMD "cp -r /opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0_resize/disk /opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0/disk" returned: 0 in 0.095s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:56:57.940069 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0_resize/disk.config /opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0/disk.config {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:57.983578 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] CMD "cp -r /opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0_resize/disk.config /opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0/disk.config" returned: 0 in 0.043s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:56:57.984191 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0_resize/disk.info /opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0/disk.info {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:56:58.022515 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-52183f2c-7317-4de1-a1a6-da8df69b261b tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Releasing lock "refresh_cache-e4fd6c94-b2c8-4d2b-b89b-c715a30c1884" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:56:58.025008 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-52183f2c-7317-4de1-a1a6-da8df69b261b tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lazy-loading 'flavor' on Instance uuid e4fd6c94-b2c8-4d2b-b89b-c715a30c1884 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:56:58.034280 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] CMD "cp -r /opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0_resize/disk.info /opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0/disk.info" returned: 0 in 0.050s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:56:58.040899 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:58.216725 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "fbe845bb-c11e-4c97-85b8-4f3759e1bd22" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:58.217034 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "fbe845bb-c11e-4c97-85b8-4f3759e1bd22" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:58.295346 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] End _get_guest_xml xml=<domain type="qemu">
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:   <uuid>12f40ca4-b4b3-43f4-8c0b-cb208f59935c</uuid>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:   <name>instance-00000018</name>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:       <nova:name>tempest-ServerActionsTestOtherA-server-1837652712</nova:name>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:56:54</nova:creationTime>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:       <nova:image uuid="">
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:         <nova:user uuid="27c90c0a8eb148fda8ae718f07ff1ed4">tempest-ServerActionsTestOtherA-1714646345-project-member</nova:user>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:         <nova:project uuid="60fbdf5ed38b4dc485a81c49b3303ed2">tempest-ServerActionsTestOtherA-1714646345</nova:project>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:       <nova:root type="volume" uuid=""/>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:         <nova:port uuid="bce4c127-622b-4001-a5df-94a04616b08e">
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:     <system>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:       <entry name="serial">12f40ca4-b4b3-43f4-8c0b-cb208f59935c</entry>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:       <entry name="uuid">12f40ca4-b4b3-43f4-8c0b-cb208f59935c</entry>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:     </system>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:   <os>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:   </os>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:   <features>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:   </features>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:   <devices>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/12f40ca4-b4b3-43f4-8c0b-cb208f59935c/disk.config"/>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:     </disk>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:     <disk type="block" device="disk">
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:       <alias name="ua-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a"/>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:       <source dev="/dev/dm-4"/>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:       <serial>78c187c7-3cb4-4c4d-a525-9e431e3d0d1a</serial>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:     </disk>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:b1:89:97"/>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:       <target dev="tapbce4c127-62"/>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:     </interface>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/12f40ca4-b4b3-43f4-8c0b-cb208f59935c/console.log" append="off"/>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:     </serial>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:     <video>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:     </video>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:     </rng>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:   </devices>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]: </domain>
May 28 01:56:58.295346 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:56:58.298067 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Preparing to wait for external event network-vif-plugged-bce4c127-622b-4001-a5df-94a04616b08e {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:56:58.298067 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:58.298067 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:58.298067 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:56:58.299628 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:56:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1837652712',display_name='tempest-ServerActionsTestOtherA-server-1837652712',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-serveractionstestothera-server-1837652712',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIePG0IU7S1SlFjpc/VmXFCBBKIijsN+gHQMlnhYfGPcl665nwX9JP0OwVOuueebU/mRc6FRuLr9ai0zvPAu2rDRN1UE1FBgnGgOOoImTJFqPL9BfFXoi8JNvWclsGpwzg==',key_name='tempest-keypair-1911990843',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60fbdf5ed38b4dc485a81c49b3303ed2',ramdisk_id='',reservation_id='r-t6bk0usf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1714646345',owner_user_name='tempest-ServerActionsTestOtherA-1714646345-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:56:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27c90c0a8eb148fda8ae718f07ff1ed4',uuid=12f40ca4-b4b3-43f4-8c0b-cb208f59935c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bce4c127-622b-4001-a5df-94a04616b08e", "address": "fa:16:3e:b1:89:97", "network": {"id": "b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-280876007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60fbdf5ed38b4dc485a81c49b3303ed2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbce4c127-62", "ovs_interfaceid": "bce4c127-622b-4001-a5df-94a04616b08e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:56:58.299628 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Converting VIF {"id": "bce4c127-622b-4001-a5df-94a04616b08e", "address": "fa:16:3e:b1:89:97", "network": {"id": "b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-280876007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60fbdf5ed38b4dc485a81c49b3303ed2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbce4c127-62", "ovs_interfaceid": "bce4c127-622b-4001-a5df-94a04616b08e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:56:58.300272 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:89:97,bridge_name='br-int',has_traffic_filtering=True,id=bce4c127-622b-4001-a5df-94a04616b08e,network=Network(b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbce4c127-62') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:56:58.301290 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:89:97,bridge_name='br-int',has_traffic_filtering=True,id=bce4c127-622b-4001-a5df-94a04616b08e,network=Network(b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbce4c127-62') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:56:58.302868 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:58.303250 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:56:58.303499 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:56:58.305091 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:58.305327 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c6a7b9d9-c297-5b42-92df-565144da91cd', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:56:58.316503 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:58.317442 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:56:58.320129 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:58.320262 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbce4c127-62, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:56:58.320600 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbce4c127-62, col_values=(('qos', UUID('8b0914bd-51f5-4ed4-b5dc-b00359760388')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:56:58.320776 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbce4c127-62, col_values=(('external_ids', {'iface-id': 'bce4c127-622b-4001-a5df-94a04616b08e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:89:97', 'vm-uuid': '12f40ca4-b4b3-43f4-8c0b-cb208f59935c'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:56:58.321563 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:58.322667 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:56:58.327595 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:58.328548 np0000001583 nova-compute[98241]: INFO os_vif [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:89:97,bridge_name='br-int',has_traffic_filtering=True,id=bce4c127-622b-4001-a5df-94a04616b08e,network=Network(b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbce4c127-62')
May 28 01:56:58.558631 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:58.561978 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:58.588946 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:58.721285 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:56:58.755638 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:58.765470 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:58.875144 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.99963674699984 future=<Future at 0x7724ec1cf620 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:56:58.876996 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Instance destroyed successfully.
May 28 01:56:58.878766 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-52183f2c-7317-4de1-a1a6-da8df69b261b tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lazy-loading 'numa_topology' on Instance uuid e4fd6c94-b2c8-4d2b-b89b-c715a30c1884 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:56:59.188582 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:56:59.188935 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:56:59.272040 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:59.272253 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:59.275104 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:56:59.275262 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Claim successful on node np0000001583
May 28 01:56:59.280090 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Port 7567636b-7225-4025-b9f0-d4c8eb5abe43 binding to destination host np0000001583 is already ACTIVE {{(pid=98241) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 28 01:56:59.381127 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-52183f2c-7317-4de1-a1a6-da8df69b261b tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Object Instance<e4fd6c94-b2c8-4d2b-b89b-c715a30c1884> lazy-loaded attributes: flavor,numa_topology {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:56:59.469002 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "1100d127-f3d6-416e-a646-b072660980bc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:56:59.469187 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "1100d127-f3d6-416e-a646-b072660980bc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:56:59.805164 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:59.833279 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:59.836370 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:59.846039 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:56:59.846267 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:56:59.846390 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] No VIF found with MAC fa:16:3e:b1:89:97, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:56:59.847275 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Using config drive
May 28 01:56:59.916250 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:59.961895 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:59.967658 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:56:59.970502 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:57:00.290587 np0000001583 nova-compute[98241]: DEBUG nova.compute.rpcapi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98241) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 01:57:00.301482 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Acquiring lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:00.301676 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:00.301787 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:00.352447 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:00.490553 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Creating config drive at /opt/stack/data/nova/instances/12f40ca4-b4b3-43f4-8c0b-cb208f59935c/disk.config
May 28 01:57:00.494942 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/12f40ca4-b4b3-43f4-8c0b-cb208f59935c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwy_segzu {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:57:00.509370 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Removed pending STOPPED event for e4fd6c94-b2c8-4d2b-b89b-c715a30c1884 due to new event <LifecycleEvent: 1779933420.5055315, e4fd6c94-b2c8-4d2b-b89b-c715a30c1884 => Resumed> {{(pid=98241) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 01:57:00.510035 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933420.5055315, e4fd6c94-b2c8-4d2b-b89b-c715a30c1884 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:57:00.510455 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] VM Resumed (Lifecycle Event)
May 28 01:57:00.524333 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-52183f2c-7317-4de1-a1a6-da8df69b261b tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:57:00.550923 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:00.557673 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/12f40ca4-b4b3-43f4-8c0b-cb208f59935c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwy_segzu" returned: 0 in 0.063s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:57:00.921752 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:57:00.922029 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:57:00.988644 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:01.022533 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:01.026356 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:57:01.030597 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:57:01.122528 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:01.156783 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:01.158731 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:01.252398 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d9a26d41-ba36-4820-ace8-e6f01ebbde54 req-f9bc8681-6c84-49e1-a328-f32a834a3f1f service nova] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Received event network-vif-plugged-bce4c127-622b-4001-a5df-94a04616b08e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:57:01.252398 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d9a26d41-ba36-4820-ace8-e6f01ebbde54 req-f9bc8681-6c84-49e1-a328-f32a834a3f1f service nova] Acquiring lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:01.252398 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d9a26d41-ba36-4820-ace8-e6f01ebbde54 req-f9bc8681-6c84-49e1-a328-f32a834a3f1f service nova] Lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:01.252398 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d9a26d41-ba36-4820-ace8-e6f01ebbde54 req-f9bc8681-6c84-49e1-a328-f32a834a3f1f service nova] Lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:01.252398 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d9a26d41-ba36-4820-ace8-e6f01ebbde54 req-f9bc8681-6c84-49e1-a328-f32a834a3f1f service nova] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Processing event network-vif-plugged-bce4c127-622b-4001-a5df-94a04616b08e {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:57:01.315945 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:01.415554 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Acquiring lock "refresh_cache-7078fbb1-fa4a-4589-9f95-9d95dee381e0" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:57:01.415841 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Acquired lock "refresh_cache-7078fbb1-fa4a-4589-9f95-9d95dee381e0" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:57:01.415897 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:57:01.426027 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:57:01.540336 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933421.539974, e4fd6c94-b2c8-4d2b-b89b-c715a30c1884 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:57:01.540764 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] VM Started (Lifecycle Event)
May 28 01:57:01.843655 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "e4fd6c94-b2c8-4d2b-b89b-c715a30c1884" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:01.843845 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "e4fd6c94-b2c8-4d2b-b89b-c715a30c1884" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:01.844153 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "e4fd6c94-b2c8-4d2b-b89b-c715a30c1884-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:01.844245 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "e4fd6c94-b2c8-4d2b-b89b-c715a30c1884-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:01.844353 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "e4fd6c94-b2c8-4d2b-b89b-c715a30c1884-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:01.846555 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Terminating instance
May 28 01:57:01.888467 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:57:01.890751 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:57:01.892691 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Instance spawned successfully.
May 28 01:57:01.893045 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:57:01.920410 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:01.935255 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.663s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:01.936845 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.385s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:01.937250 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:57:01.940973 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:57:01.941143 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Claim successful on node np0000001583
May 28 01:57:02.043148 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:57:02.044624 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: deleting, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:57:02.343143 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:02.349853 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:57:02.371664 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:02.372325 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:02.398263 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:02.401827 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:57:02.402014 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:57:02.402440 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:57:02.402796 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:57:02.403188 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:57:02.404233 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:57:02.453676 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:57:02.464313 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:57:02.464313 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:02.464313 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:02.478313 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e1f4e248-76ec-42c6-92a0-117e09febd28 req-08052139-5bb0-4b98-ab27-4514a0a019da service nova] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Received event network-vif-unplugged-f31bd559-b1fa-4de0-9abf-97d61aa6ffea {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:57:02.478501 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e1f4e248-76ec-42c6-92a0-117e09febd28 req-08052139-5bb0-4b98-ab27-4514a0a019da service nova] Acquiring lock "e4fd6c94-b2c8-4d2b-b89b-c715a30c1884-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:02.481198 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e1f4e248-76ec-42c6-92a0-117e09febd28 req-08052139-5bb0-4b98-ab27-4514a0a019da service nova] Lock "e4fd6c94-b2c8-4d2b-b89b-c715a30c1884-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:02.481367 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e1f4e248-76ec-42c6-92a0-117e09febd28 req-08052139-5bb0-4b98-ab27-4514a0a019da service nova] Lock "e4fd6c94-b2c8-4d2b-b89b-c715a30c1884-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:02.481574 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e1f4e248-76ec-42c6-92a0-117e09febd28 req-08052139-5bb0-4b98-ab27-4514a0a019da service nova] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] No waiting events found dispatching network-vif-unplugged-f31bd559-b1fa-4de0-9abf-97d61aa6ffea {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:57:02.481663 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e1f4e248-76ec-42c6-92a0-117e09febd28 req-08052139-5bb0-4b98-ab27-4514a0a019da service nova] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Received event network-vif-unplugged-f31bd559-b1fa-4de0-9abf-97d61aa6ffea for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:57:02.547016 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] During sync_power_state the instance has a pending task (deleting). Skip.
May 28 01:57:02.547439 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933422.547168, 12f40ca4-b4b3-43f4-8c0b-cb208f59935c => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:57:02.547491 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] VM Started (Lifecycle Event)
May 28 01:57:02.567387 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Updating instance_info_cache with network_info: [{"id": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "address": "fa:16:3e:30:bd:e8", "network": {"id": "11b2c699-14f1-4eba-bbe6-b7655c6f17cc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1044342879-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2db0b9fa3fcc47408dad261c2004e4a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7567636b-72", "ovs_interfaceid": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:57:02.578906 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:02.588037 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:02.598427 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6be314b4eed642c3b2c72fe115860220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432aa1094ced436494def17a875aa8e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:57:02.702379 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Instance destroyed successfully.
May 28 01:57:02.703266 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lazy-loading 'resources' on Instance uuid e4fd6c94-b2c8-4d2b-b89b-c715a30c1884 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:57:02.909991 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Took 11.10 seconds to spawn the instance on the hypervisor.
May 28 01:57:02.910140 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:57:02.960879 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:57:03.046399 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:03.051846 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:57:03.056708 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:57:03.070308 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Releasing lock "refresh_cache-7078fbb1-fa4a-4589-9f95-9d95dee381e0" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:57:03.119600 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Successfully created port: 51d1e24b-97cd-4966-b67c-17e8092be898 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:57:03.208160 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:56:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-938986098',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-serverbootfromvolumestablerescuetest-server-938986098',id=23,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:56:53Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ba381dad8364a488a98b80c04cce8fb',ramdisk_id='',reservation_id='r-nlyn62br',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1211567633',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:57:01Z,user_data=None,user_id='c3a7b14e31ee40cf9e4f4bba084ccaa5',uuid=e4fd6c94-b2c8-4d2b-b89b-c715a30c1884,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f31bd559-b1fa-4de0-9abf-97d61aa6ffea", "address": "fa:16:3e:ad:d2:22", "network": {"id": "2ee43c4e-569f-4726-9700-add40d768203", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ba381dad8364a488a98b80c04cce8fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf31bd559-b1", "ovs_interfaceid": "f31bd559-b1fa-4de0-9abf-97d61aa6ffea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:57:03.208337 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Converting VIF {"id": "f31bd559-b1fa-4de0-9abf-97d61aa6ffea", "address": "fa:16:3e:ad:d2:22", "network": {"id": "2ee43c4e-569f-4726-9700-add40d768203", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ba381dad8364a488a98b80c04cce8fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf31bd559-b1", "ovs_interfaceid": "f31bd559-b1fa-4de0-9abf-97d61aa6ffea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:57:03.208908 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:d2:22,bridge_name='br-int',has_traffic_filtering=True,id=f31bd559-b1fa-4de0-9abf-97d61aa6ffea,network=Network(2ee43c4e-569f-4726-9700-add40d768203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf31bd559-b1') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:57:03.209145 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:d2:22,bridge_name='br-int',has_traffic_filtering=True,id=f31bd559-b1fa-4de0-9abf-97d61aa6ffea,network=Network(2ee43c4e-569f-4726-9700-add40d768203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf31bd559-b1') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:57:03.211223 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:03.211543 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf31bd559-b1, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:03.213887 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:57:03.214097 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:03.217168 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:03.217168 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eaab5d89-522c-4c3c-8d6b-1a57e68519fd) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:03.217701 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:03.218247 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:57:03.218733 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:03.221478 np0000001583 nova-compute[98241]: INFO os_vif [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:d2:22,bridge_name='br-int',has_traffic_filtering=True,id=f31bd559-b1fa-4de0-9abf-97d61aa6ffea,network=Network(2ee43c4e-569f-4726-9700-add40d768203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf31bd559-b1')
May 28 01:57:03.223574 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:57:03.223861 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c', 'iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '161f7cd8-cf0d-4077-99da-a7d8bba6321c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:57:03.223987 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:57:03.224357 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:57:03.224645 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c', 'iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '161f7cd8-cf0d-4077-99da-a7d8bba6321c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:57:03.224777 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:57:03.258634 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:57:03.258634 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:57:03.258634 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:57:03.258634 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:57:03.258634 np0000001583 nova-compute[98241]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:57:03.258634 np0000001583 nova-compute[98241]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:57:03.258634 np0000001583 nova-compute[98241]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:03.258634 np0000001583 nova-compute[98241]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:03.258634 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:57:03.258883 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsi session list stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:57:03.258883 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:57:03.258883 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:57:03.258883 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:57:03.258883 np0000001583 nova-compute[98241]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:57:03.258883 np0000001583 nova-compute[98241]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c (non-flash)
May 28 01:57:03.258883 np0000001583 nova-compute[98241]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:03.258883 np0000001583 nova-compute[98241]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:03.258883 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:57:03.259200 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629', '48'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629', '49'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c', '50'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c', '51'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', '54'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', '55')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:57:03.259200 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c', '51')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:57:03.260316 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c', '50')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:57:03.264446 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724ec2c63e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c'): ({'sdb'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:57:03.266918 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Removing multipathed devices sdc, sdb {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:57:03.266918 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Flush multipath device 33000000093bcf41a {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:57:03.316556 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b651a13d-878b-4dc6-afdf-90843ee87248 req-d0bd9b5e-8ac0-40e8-98cd-ccf25fc84a99 service nova] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Received event network-vif-plugged-bce4c127-622b-4001-a5df-94a04616b08e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:57:03.316778 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b651a13d-878b-4dc6-afdf-90843ee87248 req-d0bd9b5e-8ac0-40e8-98cd-ccf25fc84a99 service nova] Acquiring lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:03.316968 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b651a13d-878b-4dc6-afdf-90843ee87248 req-d0bd9b5e-8ac0-40e8-98cd-ccf25fc84a99 service nova] Lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:03.317194 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b651a13d-878b-4dc6-afdf-90843ee87248 req-d0bd9b5e-8ac0-40e8-98cd-ccf25fc84a99 service nova] Lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:03.317550 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b651a13d-878b-4dc6-afdf-90843ee87248 req-d0bd9b5e-8ac0-40e8-98cd-ccf25fc84a99 service nova] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] No waiting events found dispatching network-vif-plugged-bce4c127-622b-4001-a5df-94a04616b08e {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:57:03.317844 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-b651a13d-878b-4dc6-afdf-90843ee87248 req-d0bd9b5e-8ac0-40e8-98cd-ccf25fc84a99 service nova] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Received unexpected event network-vif-plugged-bce4c127-622b-4001-a5df-94a04616b08e for instance with vm_state active and task_state None.
May 28 01:57:03.326564 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:57:03.378423 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:57:03.420239 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Took 18.84 seconds to build instance.
May 28 01:57:03.432308 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:57:03.432308 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:57:03.432861 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:57:03.449212 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:57:03.449355 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:57:03.467115 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:03.469004 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:57:03.512200 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c, portal: 192.168.40.100,3260]
May 28 01:57:03.512200 np0000001583 nova-compute[98241]: Logout of [sid: 51, target: iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c, portal: 192.168.40.100,3260] successful.
May 28 01:57:03.512200 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:03.529713 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:03.540107 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:03.559866 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933423.5595953, 12f40ca4-b4b3-43f4-8c0b-cb208f59935c => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:57:03.560268 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] VM Paused (Lifecycle Event)
May 28 01:57:03.571398 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c, portal: 192.168.50.100,3260]
May 28 01:57:03.571398 np0000001583 nova-compute[98241]: Logout of [sid: 50, target: iqn.2023-03.storpool.com:os--volume-161f7cd8-cf0d-4077-99da-a7d8bba6321c, portal: 192.168.50.100,3260] successful.
May 28 01:57:03.571398 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:03.581629 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:57:03.592502 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:03.592923 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:57:03.593229 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] <== disconnect_volume: return (369ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:57:03.593421 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:57:03.595504 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Deleting instance files /opt/stack/data/nova/instances/e4fd6c94-b2c8-4d2b-b89b-c715a30c1884_del
May 28 01:57:03.598177 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:57:03.599353 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Deletion of /opt/stack/data/nova/instances/e4fd6c94-b2c8-4d2b-b89b-c715a30c1884_del complete
May 28 01:57:03.629833 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:57:03.666400 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:57:03.666788 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:57:03.677142 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:57:03.678276 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe63:2bb1', 'fe80::e43a:d5ff:fecc:27fe', 'fe80::fc16:3eff:fe27:be54', 'fe80::a0e4:60ff:fe3f:73d6', 'fe80::fc16:3eff:fee1:1d3', 'fe80::fc16:3eff:fe20:92ee', 'fe80::fc16:3eff:fe86:7ea1', 'fe80::c4dd:b4ff:fe11:7c8', 'fe80::fc16:3eff:fe5c:c25f', 'fe80::819:abff:fece:7871', 'fe80::fc16:3eff:feb1:8997'] 
May 28 01:57:03.678466 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:57:03.678554 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:57:03.678821 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] <== get_connector_properties: return (97ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:57:03.735693 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:57:03.735940 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:57:03.924197 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.352s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:03.949756 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ddda0d48-d085-469b-a8dc-ff2cc5aa6fef req-7c823736-12a6-4983-8358-c7a646cc315d service nova] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Received event network-vif-unplugged-51d1e24b-97cd-4966-b67c-17e8092be898 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:57:03.949874 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ddda0d48-d085-469b-a8dc-ff2cc5aa6fef req-7c823736-12a6-4983-8358-c7a646cc315d service nova] Acquiring lock "fbe845bb-c11e-4c97-85b8-4f3759e1bd22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:03.950173 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ddda0d48-d085-469b-a8dc-ff2cc5aa6fef req-7c823736-12a6-4983-8358-c7a646cc315d service nova] Lock "fbe845bb-c11e-4c97-85b8-4f3759e1bd22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:03.950297 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ddda0d48-d085-469b-a8dc-ff2cc5aa6fef req-7c823736-12a6-4983-8358-c7a646cc315d service nova] Lock "fbe845bb-c11e-4c97-85b8-4f3759e1bd22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:03.950375 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ddda0d48-d085-469b-a8dc-ff2cc5aa6fef req-7c823736-12a6-4983-8358-c7a646cc315d service nova] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] No waiting events found dispatching network-vif-unplugged-51d1e24b-97cd-4966-b67c-17e8092be898 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:57:03.950492 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-ddda0d48-d085-469b-a8dc-ff2cc5aa6fef req-7c823736-12a6-4983-8358-c7a646cc315d service nova] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Received unexpected event network-vif-unplugged-51d1e24b-97cd-4966-b67c-17e8092be898 for instance with vm_state building and task_state block_device_mapping.
May 28 01:57:03.974479 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Booting with volume 4eea4106-b0fc-4a86-9288-5bf9167cb805 at /dev/vda
May 28 01:57:04.017483 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Successfully updated port: 51d1e24b-97cd-4966-b67c-17e8092be898 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:57:04.022774 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:57:04.034829 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:57:04.055647 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:57:04.069339 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:57:04.076068 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933424.0756733, 12f40ca4-b4b3-43f4-8c0b-cb208f59935c => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:57:04.076254 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] VM Resumed (Lifecycle Event)
May 28 01:57:04.094334 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:57:04.094639 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:57:04.106295 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Took 1.76 seconds to destroy the instance on the hypervisor.
May 28 01:57:04.107123 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:57:04.107687 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:57:04.107844 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:57:04.108266 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:04.111470 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:57:04.112658 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe63:2bb1', 'fe80::e43a:d5ff:fecc:27fe', 'fe80::fc16:3eff:fe27:be54', 'fe80::a0e4:60ff:fe3f:73d6', 'fe80::fc16:3eff:fee1:1d3', 'fe80::fc16:3eff:fe20:92ee', 'fe80::fc16:3eff:fe86:7ea1', 'fe80::c4dd:b4ff:fe11:7c8', 'fe80::fc16:3eff:fe5c:c25f', 'fe80::819:abff:fece:7871', 'fe80::fc16:3eff:feb1:8997'] 
May 28 01:57:04.112824 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:57:04.112992 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:57:04.113304 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] <== get_connector_properties: return (90ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:57:04.115367 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Updating existing volume attachment record: 46ed5eed-f108-490f-8cfa-c5af31b9e49d {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:57:04.190391 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:04.242288 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:57:04.520773 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "refresh_cache-fbe845bb-c11e-4c97-85b8-4f3759e1bd22" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:57:04.520895 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquired lock "refresh_cache-fbe845bb-c11e-4c97-85b8-4f3759e1bd22" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:57:04.521105 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:57:04.581134 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:57:04.582788 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:57:04.630406 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-6c2284b2-92ae-4d67-9572-9c1bb6f1c361 req-c4e38571-1a5d-4140-9632-f3fa4f96bb67 service nova] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Received event network-vif-unplugged-f31bd559-b1fa-4de0-9abf-97d61aa6ffea {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:57:04.630406 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-6c2284b2-92ae-4d67-9572-9c1bb6f1c361 req-c4e38571-1a5d-4140-9632-f3fa4f96bb67 service nova] Acquiring lock "e4fd6c94-b2c8-4d2b-b89b-c715a30c1884-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:04.630406 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-6c2284b2-92ae-4d67-9572-9c1bb6f1c361 req-c4e38571-1a5d-4140-9632-f3fa4f96bb67 service nova] Lock "e4fd6c94-b2c8-4d2b-b89b-c715a30c1884-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:04.630406 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-6c2284b2-92ae-4d67-9572-9c1bb6f1c361 req-c4e38571-1a5d-4140-9632-f3fa4f96bb67 service nova] Lock "e4fd6c94-b2c8-4d2b-b89b-c715a30c1884-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:04.630406 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-6c2284b2-92ae-4d67-9572-9c1bb6f1c361 req-c4e38571-1a5d-4140-9632-f3fa4f96bb67 service nova] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] No waiting events found dispatching network-vif-unplugged-f31bd559-b1fa-4de0-9abf-97d61aa6ffea {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:57:04.630406 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-6c2284b2-92ae-4d67-9572-9c1bb6f1c361 req-c4e38571-1a5d-4140-9632-f3fa4f96bb67 service nova] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Received event network-vif-unplugged-f31bd559-b1fa-4de0-9abf-97d61aa6ffea for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:57:04.630406 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-6c2284b2-92ae-4d67-9572-9c1bb6f1c361 req-c4e38571-1a5d-4140-9632-f3fa4f96bb67 service nova] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Received event network-vif-plugged-f31bd559-b1fa-4de0-9abf-97d61aa6ffea {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:57:04.631113 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-6c2284b2-92ae-4d67-9572-9c1bb6f1c361 req-c4e38571-1a5d-4140-9632-f3fa4f96bb67 service nova] Acquiring lock "e4fd6c94-b2c8-4d2b-b89b-c715a30c1884-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:04.632584 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-6c2284b2-92ae-4d67-9572-9c1bb6f1c361 req-c4e38571-1a5d-4140-9632-f3fa4f96bb67 service nova] Lock "e4fd6c94-b2c8-4d2b-b89b-c715a30c1884-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:04.636103 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-6c2284b2-92ae-4d67-9572-9c1bb6f1c361 req-c4e38571-1a5d-4140-9632-f3fa4f96bb67 service nova] Lock "e4fd6c94-b2c8-4d2b-b89b-c715a30c1884-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:04.636103 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-6c2284b2-92ae-4d67-9572-9c1bb6f1c361 req-c4e38571-1a5d-4140-9632-f3fa4f96bb67 service nova] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] No waiting events found dispatching network-vif-plugged-f31bd559-b1fa-4de0-9abf-97d61aa6ffea {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:57:04.636103 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-6c2284b2-92ae-4d67-9572-9c1bb6f1c361 req-c4e38571-1a5d-4140-9632-f3fa4f96bb67 service nova] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Received unexpected event network-vif-plugged-f31bd559-b1fa-4de0-9abf-97d61aa6ffea for instance with vm_state active and task_state deleting.
May 28 01:57:04.636103 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-6c2284b2-92ae-4d67-9572-9c1bb6f1c361 req-c4e38571-1a5d-4140-9632-f3fa4f96bb67 service nova] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Received event network-vif-plugged-f31bd559-b1fa-4de0-9abf-97d61aa6ffea {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:57:04.636103 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-6c2284b2-92ae-4d67-9572-9c1bb6f1c361 req-c4e38571-1a5d-4140-9632-f3fa4f96bb67 service nova] Acquiring lock "e4fd6c94-b2c8-4d2b-b89b-c715a30c1884-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:04.636103 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-6c2284b2-92ae-4d67-9572-9c1bb6f1c361 req-c4e38571-1a5d-4140-9632-f3fa4f96bb67 service nova] Lock "e4fd6c94-b2c8-4d2b-b89b-c715a30c1884-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:04.636103 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-6c2284b2-92ae-4d67-9572-9c1bb6f1c361 req-c4e38571-1a5d-4140-9632-f3fa4f96bb67 service nova] Lock "e4fd6c94-b2c8-4d2b-b89b-c715a30c1884-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:04.636103 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-6c2284b2-92ae-4d67-9572-9c1bb6f1c361 req-c4e38571-1a5d-4140-9632-f3fa4f96bb67 service nova] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] No waiting events found dispatching network-vif-plugged-f31bd559-b1fa-4de0-9abf-97d61aa6ffea {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:57:04.636103 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-6c2284b2-92ae-4d67-9572-9c1bb6f1c361 req-c4e38571-1a5d-4140-9632-f3fa4f96bb67 service nova] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Received unexpected event network-vif-plugged-f31bd559-b1fa-4de0-9abf-97d61aa6ffea for instance with vm_state active and task_state deleting.
May 28 01:57:04.636103 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-6c2284b2-92ae-4d67-9572-9c1bb6f1c361 req-c4e38571-1a5d-4140-9632-f3fa4f96bb67 service nova] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Received event network-vif-unplugged-f31bd559-b1fa-4de0-9abf-97d61aa6ffea {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:57:04.636103 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-6c2284b2-92ae-4d67-9572-9c1bb6f1c361 req-c4e38571-1a5d-4140-9632-f3fa4f96bb67 service nova] Acquiring lock "e4fd6c94-b2c8-4d2b-b89b-c715a30c1884-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:04.636103 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-6c2284b2-92ae-4d67-9572-9c1bb6f1c361 req-c4e38571-1a5d-4140-9632-f3fa4f96bb67 service nova] Lock "e4fd6c94-b2c8-4d2b-b89b-c715a30c1884-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:04.636103 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-6c2284b2-92ae-4d67-9572-9c1bb6f1c361 req-c4e38571-1a5d-4140-9632-f3fa4f96bb67 service nova] Lock "e4fd6c94-b2c8-4d2b-b89b-c715a30c1884-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:04.636103 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-6c2284b2-92ae-4d67-9572-9c1bb6f1c361 req-c4e38571-1a5d-4140-9632-f3fa4f96bb67 service nova] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] No waiting events found dispatching network-vif-unplugged-f31bd559-b1fa-4de0-9abf-97d61aa6ffea {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:57:04.636103 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-6c2284b2-92ae-4d67-9572-9c1bb6f1c361 req-c4e38571-1a5d-4140-9632-f3fa4f96bb67 service nova] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Received event network-vif-unplugged-f31bd559-b1fa-4de0-9abf-97d61aa6ffea for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:57:04.636103 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-6c2284b2-92ae-4d67-9572-9c1bb6f1c361 req-c4e38571-1a5d-4140-9632-f3fa4f96bb67 service nova] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Received event network-vif-unplugged-f31bd559-b1fa-4de0-9abf-97d61aa6ffea {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:57:04.636103 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-6c2284b2-92ae-4d67-9572-9c1bb6f1c361 req-c4e38571-1a5d-4140-9632-f3fa4f96bb67 service nova] Acquiring lock "e4fd6c94-b2c8-4d2b-b89b-c715a30c1884-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:04.636976 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-6c2284b2-92ae-4d67-9572-9c1bb6f1c361 req-c4e38571-1a5d-4140-9632-f3fa4f96bb67 service nova] Lock "e4fd6c94-b2c8-4d2b-b89b-c715a30c1884-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:04.637717 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-6c2284b2-92ae-4d67-9572-9c1bb6f1c361 req-c4e38571-1a5d-4140-9632-f3fa4f96bb67 service nova] Lock "e4fd6c94-b2c8-4d2b-b89b-c715a30c1884-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:04.638126 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-6c2284b2-92ae-4d67-9572-9c1bb6f1c361 req-c4e38571-1a5d-4140-9632-f3fa4f96bb67 service nova] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] No waiting events found dispatching network-vif-unplugged-f31bd559-b1fa-4de0-9abf-97d61aa6ffea {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:57:04.639450 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-6c2284b2-92ae-4d67-9572-9c1bb6f1c361 req-c4e38571-1a5d-4140-9632-f3fa4f96bb67 service nova] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Received event network-vif-unplugged-f31bd559-b1fa-4de0-9abf-97d61aa6ffea for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:57:04.639450 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-6c2284b2-92ae-4d67-9572-9c1bb6f1c361 req-c4e38571-1a5d-4140-9632-f3fa4f96bb67 service nova] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Received event network-vif-deleted-f31bd559-b1fa-4de0-9abf-97d61aa6ffea {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:57:04.639450 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-6c2284b2-92ae-4d67-9572-9c1bb6f1c361 req-c4e38571-1a5d-4140-9632-f3fa4f96bb67 service nova] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Neutron deleted interface f31bd559-b1fa-4de0-9abf-97d61aa6ffea; detaching it from the instance and deleting it from the info cache
May 28 01:57:04.641992 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-6c2284b2-92ae-4d67-9572-9c1bb6f1c361 req-c4e38571-1a5d-4140-9632-f3fa4f96bb67 service nova] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Detach interface failed, port_id=f31bd559-b1fa-4de0-9abf-97d61aa6ffea, reason: Instance e4fd6c94-b2c8-4d2b-b89b-c715a30c1884 could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:57:04.747581 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.812s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:04.748148 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:57:04.846196 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Starting finish_migration {{(pid=98241) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 28 01:57:04.849333 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Instance directory exists: not creating {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 01:57:04.849617 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Creating image(s)
May 28 01:57:04.850402 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:57:04.962907 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.112s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:57:04.963413 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:57:04.963646 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:57:04.984592 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:57:05.076798 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:57:05.077276 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Cannot resize image /opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:57:05.086481 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999679428999798 future=<Future at 0x7724ec1f1ee0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:05.090142 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:57:05.262778 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:57:05.262950 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 1100d127-f3d6-416e-a646-b072660980bc] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:57:05.263281 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:05.263631 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:05.278890 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:05.367702 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '00cb6190618b45eb994dd16d3c657f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837663bcfa40402aaf583729dfbb26cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:57:05.446054 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Updating instance_info_cache with network_info: [{"id": "51d1e24b-97cd-4966-b67c-17e8092be898", "address": "fa:16:3e:35:0c:91", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51d1e24b-97", "ovs_interfaceid": "51d1e24b-97cd-4966-b67c-17e8092be898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:57:05.488925 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Took 1.38 seconds to deallocate network for instance.
May 28 01:57:05.579833 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Did not create local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 01:57:05.579986 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Ensure instance console log exists: /opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:57:05.580373 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:05.580556 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:05.580981 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:05.582997 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Start _get_guest_xml network_info=[{"id": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "address": "fa:16:3e:30:bd:e8", "network": {"id": "11b2c699-14f1-4eba-bbe6-b7655c6f17cc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1044342879-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.99", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1044342879-network", "vif_mac": "fa:16:3e:30:bd:e8"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2db0b9fa3fcc47408dad261c2004e4a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7567636b-72", "ovs_interfaceid": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '7078fbb1-fa4a-4589-9f95-9d95dee381e0', 'attached_at': '2026-05-28T01:57:04.000000', 'detached_at': '', 'volume_id': 'ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'serial': 'ba26e203-0d5a-4c3d-b50d-9d38c042d9d2'}, 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'attachment_id': '43e96007-33b4-4cbf-9daf-92bb472fd85c', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:57:05.585349 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:57:05.586583 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-1792038090', uuid='7078fbb1-fa4a-4589-9f95-9d95dee381e0'), owner=OwnerMeta(userid='8f68ae604d0442439a927020cec740c0', username='tempest-ServerActionsTestOtherB-640844130-project-member', projectid='2db0b9fa3fcc47408dad261c2004e4a5', projectname='tempest-ServerActionsTestOtherB-640844130'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "address": "fa:16:3e:30:bd:e8", "network": {"id": "11b2c699-14f1-4eba-bbe6-b7655c6f17cc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1044342879-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.99", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1044342879-network", "vif_mac": "fa:16:3e:30:bd:e8"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2db0b9fa3fcc47408dad261c2004e4a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7567636b-72", "ovs_interfaceid": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933425.586142) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:57:05.587699 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:57:05.588058 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:57:05.589313 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:57:05.589555 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:57:05.590620 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:57:05.590995 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:57:05.591202 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:57:05.591352 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:57:05.591522 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:57:05.591653 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:57:05.591801 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:57:05.592050 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:57:05.592179 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:57:05.592341 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:57:05.592472 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:57:05.592584 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:57:05.605094 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0/disk.config --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:57:05.710007 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0/disk.config --force-share --output=json" returned: 0 in 0.105s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:57:05.710630 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Acquiring lock "/opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:05.711091 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "/opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:05.711613 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "/opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:05.712181 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:57:05.712662 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:57:05.712855 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:57:05.713915 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:57:05.714284 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:57:05.735909 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:57:05.736543 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:57:05.739529 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:57:05.739798 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:57:05.740512 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:57:05.740831 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:57:05.759926 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:57:05.759926 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:05.762536 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:57:05.766929 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:57:05.766929 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:05.774460 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2] added
May 28 01:57:05.774460 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:57:05.774460 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:57:05.774460 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:57:05.774460 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:57:05.774460 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:57:05.774460 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:05.774682 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:57:05.775769 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.035(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:57:05.775769 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:57:05.783510 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2] added
May 28 01:57:05.783510 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:57:05.783510 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:57:05.783510 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:57:05.783510 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:57:05.783510 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:57:05.783510 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:05.783759 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:57:05.784592 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0432(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:57:05.784723 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:57:05.948567 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Releasing lock "refresh_cache-fbe845bb-c11e-4c97-85b8-4f3759e1bd22" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:57:05.948936 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Instance network_info: |[{"id": "51d1e24b-97cd-4966-b67c-17e8092be898", "address": "fa:16:3e:35:0c:91", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51d1e24b-97", "ovs_interfaceid": "51d1e24b-97cd-4966-b67c-17e8092be898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:57:05.966843 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Successfully created port: addc7428-573c-4e5e-bb8f-096648f17132 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:57:06.048859 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-097fca48-f55a-4213-95e8-d76faec74513 req-aeadf788-978e-40b7-8efe-031e1b81830d service nova] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Received event network-changed-51d1e24b-97cd-4966-b67c-17e8092be898 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:57:06.052396 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-097fca48-f55a-4213-95e8-d76faec74513 req-aeadf788-978e-40b7-8efe-031e1b81830d service nova] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Refreshing instance network info cache due to event network-changed-51d1e24b-97cd-4966-b67c-17e8092be898. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:57:06.052594 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-097fca48-f55a-4213-95e8-d76faec74513 req-aeadf788-978e-40b7-8efe-031e1b81830d service nova] Acquiring lock "refresh_cache-fbe845bb-c11e-4c97-85b8-4f3759e1bd22" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:57:06.053160 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-097fca48-f55a-4213-95e8-d76faec74513 req-aeadf788-978e-40b7-8efe-031e1b81830d service nova] Acquired lock "refresh_cache-fbe845bb-c11e-4c97-85b8-4f3759e1bd22" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:57:06.053160 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-097fca48-f55a-4213-95e8-d76faec74513 req-aeadf788-978e-40b7-8efe-031e1b81830d service nova] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Refreshing network info cache for port 51d1e24b-97cd-4966-b67c-17e8092be898 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:57:06.068746 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Took 0.58 seconds to detach 1 volumes for instance.
May 28 01:57:06.072167 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Deleting volume: 161f7cd8-cf0d-4077-99da-a7d8bba6321c {{(pid=98241) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 28 01:57:06.244192 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:57:06.244192 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:57:06.244192 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Creating image(s)
May 28 01:57:06.244192 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Did not create local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 01:57:06.244192 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Ensure instance console log exists: /opt/stack/data/nova/instances/fbe845bb-c11e-4c97-85b8-4f3759e1bd22/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:57:06.245889 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:06.246034 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:06.247115 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:06.247903 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Start _get_guest_xml network_info=[{"id": "51d1e24b-97cd-4966-b67c-17e8092be898", "address": "fa:16:3e:35:0c:91", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51d1e24b-97", "ovs_interfaceid": "51d1e24b-97cd-4966-b67c-17e8092be898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805', 'iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4eea4106-b0fc-4a86-9288-5bf9167cb805', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'fbe845bb-c11e-4c97-85b8-4f3759e1bd22', 'attached_at': '', 'detached_at': '', 'volume_id': '4eea4106-b0fc-4a86-9288-5bf9167cb805', 'serial': '4eea4106-b0fc-4a86-9288-5bf9167cb805'}, 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '46ed5eed-f108-490f-8cfa-c5af31b9e49d', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:57:06.252802 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:57:06.254192 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-952825136', uuid='fbe845bb-c11e-4c97-85b8-4f3759e1bd22'), owner=OwnerMeta(userid='6be314b4eed642c3b2c72fe115860220', username='tempest-TestVolumeBootPattern-1031057169-project-member', projectid='432aa1094ced436494def17a875aa8e1', projectname='tempest-TestVolumeBootPattern-1031057169'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "51d1e24b-97cd-4966-b67c-17e8092be898", "address": "fa:16:3e:35:0c:91", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51d1e24b-97", "ovs_interfaceid": "51d1e24b-97cd-4966-b67c-17e8092be898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933426.2536364) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:57:06.255141 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:57:06.255887 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:57:06.256408 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:57:06.256629 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:57:06.257641 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:57:06.257958 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:57:06.258165 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:57:06.258324 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:57:06.258500 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:57:06.258606 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:57:06.258741 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:57:06.258946 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:57:06.259100 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:57:06.259362 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:57:06.259500 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:57:06.259730 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:57:06.270622 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:57:06.277256 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:57:06.277363 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805', 'iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4eea4106-b0fc-4a86-9288-5bf9167cb805', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:57:06.277494 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:57:06.557154 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-097fca48-f55a-4213-95e8-d76faec74513 req-aeadf788-978e-40b7-8efe-031e1b81830d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:06.596642 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Successfully updated port: addc7428-573c-4e5e-bb8f-096648f17132 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:57:06.617944 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:06.618099 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:06.713563 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-68ce04cc-59ec-4210-a611-9648a563a3dc req-49860f3f-5e99-49d7-89fd-bf2f13046db7 service nova] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Received event network-changed-addc7428-573c-4e5e-bb8f-096648f17132 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:57:06.714203 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-68ce04cc-59ec-4210-a611-9648a563a3dc req-49860f3f-5e99-49d7-89fd-bf2f13046db7 service nova] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Refreshing instance network info cache due to event network-changed-addc7428-573c-4e5e-bb8f-096648f17132. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:57:06.714203 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-68ce04cc-59ec-4210-a611-9648a563a3dc req-49860f3f-5e99-49d7-89fd-bf2f13046db7 service nova] Acquiring lock "refresh_cache-1100d127-f3d6-416e-a646-b072660980bc" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:57:06.717306 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-68ce04cc-59ec-4210-a611-9648a563a3dc req-49860f3f-5e99-49d7-89fd-bf2f13046db7 service nova] Acquired lock "refresh_cache-1100d127-f3d6-416e-a646-b072660980bc" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:57:06.718389 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-68ce04cc-59ec-4210-a611-9648a563a3dc req-49860f3f-5e99-49d7-89fd-bf2f13046db7 service nova] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Refreshing network info cache for port addc7428-573c-4e5e-bb8f-096648f17132 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:57:06.775349 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:57:06.788050 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:57:06.791728 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:57:06.791728 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:57:06.804101 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:57:06.804101 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:06.815139 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:06.816670 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:06.833750 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:57:06.833750 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:57:06.833750 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:57:06.833750 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:57:06.833750 np0000001583 nova-compute[98241]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:06.833750 np0000001583 nova-compute[98241]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:06.833750 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:57:06.834070 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsi session list stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:57:06.834070 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:57:06.834070 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:57:06.834070 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:57:06.834070 np0000001583 nova-compute[98241]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:06.834070 np0000001583 nova-compute[98241]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:06.834070 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:57:06.839398 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:57:06.839398 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:57:06.839398 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:57:06.839398 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:57:06.839398 np0000001583 nova-compute[98241]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:06.839398 np0000001583 nova-compute[98241]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:06.839398 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:57:06.839671 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsi session list stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:57:06.839671 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:57:06.839671 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:57:06.839671 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:57:06.839671 np0000001583 nova-compute[98241]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:06.839671 np0000001583 nova-compute[98241]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:06.839671 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:57:06.876551 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2, portal: 192.168.50.100,3260]
May 28 01:57:06.876551 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2, portal: 192.168.50.100,3260] successful.
May 28 01:57:06.876551 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:06.877563 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Stashing vm_state: active {{(pid=98241) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 28 01:57:06.888197 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2, portal: 192.168.40.100,3260]
May 28 01:57:06.888197 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2, portal: 192.168.40.100,3260] successful.
May 28 01:57:06.888197 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:06.896757 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:06.905510 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:06.918628 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:57:06.918628 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:57:06.918628 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:57:06.918628 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:57:06.918628 np0000001583 nova-compute[98241]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:06.918628 np0000001583 nova-compute[98241]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:06.918628 np0000001583 nova-compute[98241]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:57:06.918628 np0000001583 nova-compute[98241]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:57:06.918628 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:57:06.918832 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsi session list stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:57:06.918832 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:57:06.918832 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:57:06.918832 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:57:06.918832 np0000001583 nova-compute[98241]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:06.918832 np0000001583 nova-compute[98241]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:06.918832 np0000001583 nova-compute[98241]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:57:06.918832 np0000001583 nova-compute[98241]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:57:06.918832 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:57:06.919560 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.180s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:57:06.919560 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:57:06.920440 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] HCTL ('7', '-', '-', 0) found on session 56 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:57:06.920601 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:57:06.928357 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:57:06.928357 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:57:06.928357 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:57:06.928357 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:57:06.928357 np0000001583 nova-compute[98241]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:06.928357 np0000001583 nova-compute[98241]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:06.928357 np0000001583 nova-compute[98241]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:57:06.928357 np0000001583 nova-compute[98241]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:57:06.928357 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:57:06.928357 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsi session list stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:57:06.928357 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:57:06.928357 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:57:06.928357 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:57:06.928357 np0000001583 nova-compute[98241]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:06.928357 np0000001583 nova-compute[98241]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:06.928357 np0000001583 nova-compute[98241]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:57:06.928357 np0000001583 nova-compute[98241]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:57:06.928357 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:57:06.928767 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.188s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:57:06.928872 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:57:06.930044 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] HCTL ('8', '-', '-', 0) found on session 57 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:57:06.930242 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:57:06.940185 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Searching for a device in session 56 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:57:06.940900 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:57:06.956009 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Searching for a device in session 57 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:57:06.956205 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:57:06.968012 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-097fca48-f55a-4213-95e8-d76faec74513 req-aeadf788-978e-40b7-8efe-031e1b81830d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:07.099005 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "refresh_cache-1100d127-f3d6-416e-a646-b072660980bc" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:57:07.170069 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-097fca48-f55a-4213-95e8-d76faec74513 req-aeadf788-978e-40b7-8efe-031e1b81830d service nova] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Updated VIF entry in instance network info cache for port 51d1e24b-97cd-4966-b67c-17e8092be898. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:57:07.170472 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-097fca48-f55a-4213-95e8-d76faec74513 req-aeadf788-978e-40b7-8efe-031e1b81830d service nova] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Updating instance_info_cache with network_info: [{"id": "51d1e24b-97cd-4966-b67c-17e8092be898", "address": "fa:16:3e:35:0c:91", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51d1e24b-97", "ovs_interfaceid": "51d1e24b-97cd-4966-b67c-17e8092be898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:57:07.222753 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-68ce04cc-59ec-4210-a611-9648a563a3dc req-49860f3f-5e99-49d7-89fd-bf2f13046db7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:07.281662 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:57:07.286992 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:57:07.287402 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Creating image(s)
May 28 01:57:07.288034 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "/opt/stack/data/nova/instances/1100d127-f3d6-416e-a646-b072660980bc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:07.288207 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "/opt/stack/data/nova/instances/1100d127-f3d6-416e-a646-b072660980bc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:07.288676 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "/opt/stack/data/nova/instances/1100d127-f3d6-416e-a646-b072660980bc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:07.289306 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:57:07.293347 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:57:07.294605 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:57:07.324723 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-68ce04cc-59ec-4210-a611-9648a563a3dc req-49860f3f-5e99-49d7-89fd-bf2f13046db7 service nova] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:57:07.389924 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.095s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:57:07.390540 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:07.391907 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:07.391907 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:57:07.396309 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:57:07.396892 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:57:07.476797 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:07.497983 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.101s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:57:07.498522 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/1100d127-f3d6-416e-a646-b072660980bc/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:57:07.556682 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-68ce04cc-59ec-4210-a611-9648a563a3dc req-49860f3f-5e99-49d7-89fd-bf2f13046db7 service nova] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:57:07.563755 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/1100d127-f3d6-416e-a646-b072660980bc/disk 1073741824" returned: 0 in 0.065s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:57:07.565003 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.174s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:07.565394 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:57:07.629237 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:57:07.629677 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:57:07.672849 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-097fca48-f55a-4213-95e8-d76faec74513 req-aeadf788-978e-40b7-8efe-031e1b81830d service nova] Releasing lock "refresh_cache-fbe845bb-c11e-4c97-85b8-4f3759e1bd22" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:57:07.673050 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-097fca48-f55a-4213-95e8-d76faec74513 req-aeadf788-978e-40b7-8efe-031e1b81830d service nova] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Received event network-changed-fcf662e6-60ad-4e4c-b3da-ce3edf11d15b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:57:07.673275 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-097fca48-f55a-4213-95e8-d76faec74513 req-aeadf788-978e-40b7-8efe-031e1b81830d service nova] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Refreshing instance network info cache due to event network-changed-fcf662e6-60ad-4e4c-b3da-ce3edf11d15b. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:57:07.673468 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-097fca48-f55a-4213-95e8-d76faec74513 req-aeadf788-978e-40b7-8efe-031e1b81830d service nova] Acquiring lock "refresh_cache-5c36895c-9d2c-49be-b545-3658f535964a" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:57:07.673579 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-097fca48-f55a-4213-95e8-d76faec74513 req-aeadf788-978e-40b7-8efe-031e1b81830d service nova] Acquired lock "refresh_cache-5c36895c-9d2c-49be-b545-3658f535964a" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:57:07.673744 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-097fca48-f55a-4213-95e8-d76faec74513 req-aeadf788-978e-40b7-8efe-031e1b81830d service nova] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Refreshing network info cache for port fcf662e6-60ad-4e4c-b3da-ce3edf11d15b {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:57:07.675977 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.111s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:57:07.679105 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1100d127-f3d6-416e-a646-b072660980bc/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:57:07.679105 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1100d127-f3d6-416e-a646-b072660980bc/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:57:07.740751 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:57:07.764002 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1100d127-f3d6-416e-a646-b072660980bc/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:57:07.764462 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Cannot resize image /opt/stack/data/nova/instances/1100d127-f3d6-416e-a646-b072660980bc/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:57:07.764846 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:57:07.765047 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Ensure instance console log exists: /opt/stack/data/nova/instances/1100d127-f3d6-416e-a646-b072660980bc/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:57:07.765374 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:07.765585 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:07.765733 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:08.046698 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:08.060070 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-68ce04cc-59ec-4210-a611-9648a563a3dc req-49860f3f-5e99-49d7-89fd-bf2f13046db7 service nova] Releasing lock "refresh_cache-1100d127-f3d6-416e-a646-b072660980bc" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:57:08.060343 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquired lock "refresh_cache-1100d127-f3d6-416e-a646-b072660980bc" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:57:08.060624 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:57:08.137555 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:57:08.175984 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-097fca48-f55a-4213-95e8-d76faec74513 req-aeadf788-978e-40b7-8efe-031e1b81830d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:08.227331 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:08.487486 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-097fca48-f55a-4213-95e8-d76faec74513 req-aeadf788-978e-40b7-8efe-031e1b81830d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:08.645920 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.028s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:08.650258 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 1.171s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:08.651119 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:57:08.655858 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-097fca48-f55a-4213-95e8-d76faec74513 req-aeadf788-978e-40b7-8efe-031e1b81830d service nova] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Updated VIF entry in instance network info cache for port fcf662e6-60ad-4e4c-b3da-ce3edf11d15b. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:57:08.656319 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-097fca48-f55a-4213-95e8-d76faec74513 req-aeadf788-978e-40b7-8efe-031e1b81830d service nova] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Updating instance_info_cache with network_info: [{"id": "fcf662e6-60ad-4e4c-b3da-ce3edf11d15b", "address": "fa:16:3e:63:2b:b1", "network": {"id": "b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-280876007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60fbdf5ed38b4dc485a81c49b3303ed2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf662e6-60", "ovs_interfaceid": "fcf662e6-60ad-4e4c-b3da-ce3edf11d15b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:57:08.733100 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Deleted allocations for instance e4fd6c94-b2c8-4d2b-b89b-c715a30c1884
May 28 01:57:08.758417 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Found WWN 3300000002607d8cf for multipath device dm-0 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:57:08.758792 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.045s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:57:08.759109 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] <== connect_volume: return (3046ms) {'type': 'block', 'scsi_wwn': '3300000002607d8cf', 'path': '/dev/dm-0', 'multipath_id': '3300000002607d8cf'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:57:08.759320 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002607d8cf', 'path': '/dev/dm-0', 'multipath_id': '3300000002607d8cf'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:57:08.759696 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.482s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:57:08.759958 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805', 'iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4eea4106-b0fc-4a86-9288-5bf9167cb805', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:57:08.770422 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:57:08.771111 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:57:08.772506 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:57:08.772506 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:57:08.772506 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:57:08.772506 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:57:08.784715 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:57:08.784715 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:08.789020 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:57:08.789020 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:08.797233 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805] added
May 28 01:57:08.797233 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:57:08.797233 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:57:08.797233 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:57:08.797233 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:57:08.797233 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:57:08.797233 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:08.801093 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805] added
May 28 01:57:08.801093 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:57:08.801093 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:57:08.801093 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:57:08.801093 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:57:08.801093 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:57:08.801093 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:08.801453 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:57:08.801713 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:57:08.802175 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0299(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:57:08.802433 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0296(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:57:08.802665 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:57:08.802799 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:57:08.854102 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:08.990570 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Updating instance_info_cache with network_info: [{"id": "addc7428-573c-4e5e-bb8f-096648f17132", "address": "fa:16:3e:92:e2:5b", "network": {"id": "62e7cc38-1758-4b09-a352-4635adc9cfea", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587967507-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "837663bcfa40402aaf583729dfbb26cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaddc7428-57", "ovs_interfaceid": "addc7428-573c-4e5e-bb8f-096648f17132", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:57:09.161815 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:57:09.166103 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Claim successful on node np0000001583
May 28 01:57:09.166103 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-097fca48-f55a-4213-95e8-d76faec74513 req-aeadf788-978e-40b7-8efe-031e1b81830d service nova] Releasing lock "refresh_cache-5c36895c-9d2c-49be-b545-3658f535964a" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:57:09.166103 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-097fca48-f55a-4213-95e8-d76faec74513 req-aeadf788-978e-40b7-8efe-031e1b81830d service nova] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Received event network-changed-bce4c127-622b-4001-a5df-94a04616b08e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:57:09.166103 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-097fca48-f55a-4213-95e8-d76faec74513 req-aeadf788-978e-40b7-8efe-031e1b81830d service nova] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Refreshing instance network info cache due to event network-changed-bce4c127-622b-4001-a5df-94a04616b08e. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:57:09.166103 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-097fca48-f55a-4213-95e8-d76faec74513 req-aeadf788-978e-40b7-8efe-031e1b81830d service nova] Acquiring lock "refresh_cache-12f40ca4-b4b3-43f4-8c0b-cb208f59935c" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:57:09.166103 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-097fca48-f55a-4213-95e8-d76faec74513 req-aeadf788-978e-40b7-8efe-031e1b81830d service nova] Acquired lock "refresh_cache-12f40ca4-b4b3-43f4-8c0b-cb208f59935c" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:57:09.166462 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-097fca48-f55a-4213-95e8-d76faec74513 req-aeadf788-978e-40b7-8efe-031e1b81830d service nova] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Refreshing network info cache for port bce4c127-622b-4001-a5df-94a04616b08e {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:57:09.264216 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:55:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1792038090',display_name='tempest-ServerActionsTestOtherB-server-1792038090',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001583',hostname='tempest-serveractionstestotherb-server-1792038090',id=21,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNeqI2aR1ssi4HNJOeFKCNjp+Pt+IJYlcdzP/eafAClJj6eROY4EAGFoc44ZS4UJO1qzGM7qaA7m9ha8h0zhGTrn53zFMwGuQ42KOAfa++4mKlE3DbzUB8ddEdTJR9n/hA==',key_name='tempest-keypair-738336147',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:55:53Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001583',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2db0b9fa3fcc47408dad261c2004e4a5',ramdisk_id='',reservation_id='r-aqj2v230',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-640844130',owner_user_name='tempest-ServerActionsTestOtherB-640844130-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:57:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f68ae604d0442439a927020cec740c0',uuid=7078fbb1-fa4a-4589-9f95-9d95dee381e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "address": "fa:16:3e:30:bd:e8", "network": {"id": "11b2c699-14f1-4eba-bbe6-b7655c6f17cc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1044342879-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.99", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1044342879-network", "vif_mac": "fa:16:3e:30:bd:e8"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2db0b9fa3fcc47408dad261c2004e4a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7567636b-72", "ovs_interfaceid": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:57:09.264216 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Converting VIF {"id": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "address": "fa:16:3e:30:bd:e8", "network": {"id": "11b2c699-14f1-4eba-bbe6-b7655c6f17cc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1044342879-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.99", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1044342879-network", "vif_mac": "fa:16:3e:30:bd:e8"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2db0b9fa3fcc47408dad261c2004e4a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7567636b-72", "ovs_interfaceid": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:57:09.264901 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:bd:e8,bridge_name='br-int',has_traffic_filtering=True,id=7567636b-7225-4025-b9f0-d4c8eb5abe43,network=Network(11b2c699-14f1-4eba-bbe6-b7655c6f17cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7567636b-72') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:57:09.266307 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] End _get_guest_xml xml=<domain type="qemu">
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:   <uuid>7078fbb1-fa4a-4589-9f95-9d95dee381e0</uuid>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:   <name>instance-00000015</name>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:   <memory>262144</memory>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:       <nova:name>tempest-ServerActionsTestOtherB-server-1792038090</nova:name>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:57:05</nova:creationTime>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.micro" id="84">
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:         <nova:memory>256</nova:memory>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:         <nova:user uuid="8f68ae604d0442439a927020cec740c0">tempest-ServerActionsTestOtherB-640844130-project-member</nova:user>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:         <nova:project uuid="2db0b9fa3fcc47408dad261c2004e4a5">tempest-ServerActionsTestOtherB-640844130</nova:project>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:         <nova:port uuid="7567636b-7225-4025-b9f0-d4c8eb5abe43">
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:     <system>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:       <entry name="serial">7078fbb1-fa4a-4589-9f95-9d95dee381e0</entry>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:       <entry name="uuid">7078fbb1-fa4a-4589-9f95-9d95dee381e0</entry>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:     </system>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:   <os>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:   </os>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:   <features>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:   </features>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:   <devices>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0/disk"/>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:     </disk>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0/disk.config"/>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:     </disk>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:     <disk type="block" device="disk">
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:       <alias name="ua-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2"/>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:       <source dev="/dev/dm-0"/>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:       <target dev="vdb" bus="virtio"/>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:       <serial>ba26e203-0d5a-4c3d-b50d-9d38c042d9d2</serial>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:     </disk>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:30:bd:e8"/>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:       <target dev="tap7567636b-72"/>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:     </interface>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0/console.log" append="off"/>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:     </serial>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:     <video>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:     </video>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:     </rng>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:   </devices>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]: </domain>
May 28 01:57:09.266307 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:57:09.268352 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:55:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1792038090',display_name='tempest-ServerActionsTestOtherB-server-1792038090',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001583',hostname='tempest-serveractionstestotherb-server-1792038090',id=21,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNeqI2aR1ssi4HNJOeFKCNjp+Pt+IJYlcdzP/eafAClJj6eROY4EAGFoc44ZS4UJO1qzGM7qaA7m9ha8h0zhGTrn53zFMwGuQ42KOAfa++4mKlE3DbzUB8ddEdTJR9n/hA==',key_name='tempest-keypair-738336147',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:55:53Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001583',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2db0b9fa3fcc47408dad261c2004e4a5',ramdisk_id='',reservation_id='r-aqj2v230',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-640844130',owner_user_name='tempest-ServerActionsTestOtherB-640844130-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:57:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f68ae604d0442439a927020cec740c0',uuid=7078fbb1-fa4a-4589-9f95-9d95dee381e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "address": "fa:16:3e:30:bd:e8", "network": {"id": "11b2c699-14f1-4eba-bbe6-b7655c6f17cc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1044342879-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.99", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1044342879-network", "vif_mac": "fa:16:3e:30:bd:e8"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2db0b9fa3fcc47408dad261c2004e4a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7567636b-72", "ovs_interfaceid": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:57:09.268352 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Converting VIF {"id": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "address": "fa:16:3e:30:bd:e8", "network": {"id": "11b2c699-14f1-4eba-bbe6-b7655c6f17cc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1044342879-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.99", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1044342879-network", "vif_mac": "fa:16:3e:30:bd:e8"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2db0b9fa3fcc47408dad261c2004e4a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7567636b-72", "ovs_interfaceid": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:57:09.268352 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:bd:e8,bridge_name='br-int',has_traffic_filtering=True,id=7567636b-7225-4025-b9f0-d4c8eb5abe43,network=Network(11b2c699-14f1-4eba-bbe6-b7655c6f17cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7567636b-72') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:57:09.270647 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:bd:e8,bridge_name='br-int',has_traffic_filtering=True,id=7567636b-7225-4025-b9f0-d4c8eb5abe43,network=Network(11b2c699-14f1-4eba-bbe6-b7655c6f17cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7567636b-72') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:57:09.270647 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:09.270647 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:09.270647 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:57:09.271860 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:09.272147 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '15af2633-77b4-5bbb-af75-e68dce2f4585', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:09.273012 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:09.275313 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:57:09.277495 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:09.277495 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7567636b-72, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:09.277776 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7567636b-72, col_values=(('qos', UUID('d881634d-4f82-4cbf-a760-2fa641398d03')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:09.278111 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7567636b-72, col_values=(('external_ids', {'iface-id': '7567636b-7225-4025-b9f0-d4c8eb5abe43', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:bd:e8', 'vm-uuid': '7078fbb1-fa4a-4589-9f95-9d95dee381e0'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:09.278783 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:09.279792 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:57:09.285183 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:09.288483 np0000001583 nova-compute[98241]: INFO os_vif [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:bd:e8,bridge_name='br-int',has_traffic_filtering=True,id=7567636b-7225-4025-b9f0-d4c8eb5abe43,network=Network(11b2c699-14f1-4eba-bbe6-b7655c6f17cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7567636b-72')
May 28 01:57:09.492300 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Releasing lock "refresh_cache-1100d127-f3d6-416e-a646-b072660980bc" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:57:09.492591 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Instance network_info: |[{"id": "addc7428-573c-4e5e-bb8f-096648f17132", "address": "fa:16:3e:92:e2:5b", "network": {"id": "62e7cc38-1758-4b09-a352-4635adc9cfea", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587967507-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "837663bcfa40402aaf583729dfbb26cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaddc7428-57", "ovs_interfaceid": "addc7428-573c-4e5e-bb8f-096648f17132", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:57:09.494033 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Start _get_guest_xml network_info=[{"id": "addc7428-573c-4e5e-bb8f-096648f17132", "address": "fa:16:3e:92:e2:5b", "network": {"id": "62e7cc38-1758-4b09-a352-4635adc9cfea", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587967507-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "837663bcfa40402aaf583729dfbb26cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaddc7428-57", "ovs_interfaceid": "addc7428-573c-4e5e-bb8f-096648f17132", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:57:09.495682 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:57:09.496700 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-62369716', uuid='1100d127-f3d6-416e-a646-b072660980bc'), owner=OwnerMeta(userid='00cb6190618b45eb994dd16d3c657f01', username='tempest-AttachVolumeNegativeTest-169599115-project-member', projectid='837663bcfa40402aaf583729dfbb26cd', projectname='tempest-AttachVolumeNegativeTest-169599115'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "addc7428-573c-4e5e-bb8f-096648f17132", "address": "fa:16:3e:92:e2:5b", "network": {"id": "62e7cc38-1758-4b09-a352-4635adc9cfea", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587967507-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "837663bcfa40402aaf583729dfbb26cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaddc7428-57", "ovs_interfaceid": "addc7428-573c-4e5e-bb8f-096648f17132", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933429.4963818) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:57:09.497735 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:57:09.498034 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:57:09.498646 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:57:09.498800 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:57:09.499624 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:57:09.499880 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:57:09.500055 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:57:09.500126 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:57:09.500242 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:57:09.500314 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:57:09.500426 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:57:09.500572 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:57:09.500663 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:57:09.500760 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:57:09.500852 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:57:09.500959 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:57:09.511477 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:56:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-62369716',display_name='tempest-AttachVolumeNegativeTest-server-62369716',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-attachvolumenegativetest-server-62369716',id=26,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBfW7IFXJjWOYq3eCq2aqExUMzvjYvgU907FlYR/n8nl7Vof3eMqYKZUQnxzR4TW0LrAMe7GgYL2dH4bjZ1gr2Pe89Z3BD2G3RVOrg7fW4OHXlv3ASmhxMYDzifFzgLWg==',key_name='tempest-keypair-1768809071',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='837663bcfa40402aaf583729dfbb26cd',ramdisk_id='',reservation_id='r-qt95u7wp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-169599115',owner_user_name='tempest-AttachVolumeNegativeTest-169599115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:57:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='00cb6190618b45eb994dd16d3c657f01',uuid=1100d127-f3d6-416e-a646-b072660980bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "addc7428-573c-4e5e-bb8f-096648f17132", "address": "fa:16:3e:92:e2:5b", "network": {"id": "62e7cc38-1758-4b09-a352-4635adc9cfea", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587967507-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "837663bcfa40402aaf583729dfbb26cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaddc7428-57", "ovs_interfaceid": "addc7428-573c-4e5e-bb8f-096648f17132", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:57:09.511730 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Converting VIF {"id": "addc7428-573c-4e5e-bb8f-096648f17132", "address": "fa:16:3e:92:e2:5b", "network": {"id": "62e7cc38-1758-4b09-a352-4635adc9cfea", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587967507-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "837663bcfa40402aaf583729dfbb26cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaddc7428-57", "ovs_interfaceid": "addc7428-573c-4e5e-bb8f-096648f17132", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:57:09.512310 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:e2:5b,bridge_name='br-int',has_traffic_filtering=True,id=addc7428-573c-4e5e-bb8f-096648f17132,network=Network(62e7cc38-1758-4b09-a352-4635adc9cfea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaddc7428-57') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:57:09.512749 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lazy-loading 'pci_devices' on Instance uuid 1100d127-f3d6-416e-a646-b072660980bc {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:57:09.668956 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-097fca48-f55a-4213-95e8-d76faec74513 req-aeadf788-978e-40b7-8efe-031e1b81830d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:09.673953 np0000001583 nova-compute[98241]: INFO nova.compute.resource_tracker [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Updating resource usage from migration fb013581-358b-4004-8e04-ae891cc5e071
May 28 01:57:09.744272 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5f84e807-944d-41f6-9431-823c69cb3bdf tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "e4fd6c94-b2c8-4d2b-b89b-c715a30c1884" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.900s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:09.803018 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:57:09.803475 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:57:09.817667 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:57:09.817667 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:57:09.819511 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:57:09.819511 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:09.837162 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:09.842639 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:09.857326 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:57:09.857326 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:57:09.857326 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:57:09.857326 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:57:09.857326 np0000001583 nova-compute[98241]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:09.857326 np0000001583 nova-compute[98241]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:09.857326 np0000001583 nova-compute[98241]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:57:09.857326 np0000001583 nova-compute[98241]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:57:09.857326 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:57:09.859132 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:57:09.859132 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:57:09.859132 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:57:09.859132 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:57:09.859132 np0000001583 nova-compute[98241]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:09.859132 np0000001583 nova-compute[98241]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:09.859132 np0000001583 nova-compute[98241]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:57:09.859132 np0000001583 nova-compute[98241]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:57:09.859132 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:57:09.869472 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:57:09.869472 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:57:09.869472 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:57:09.869472 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:57:09.869472 np0000001583 nova-compute[98241]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:09.869472 np0000001583 nova-compute[98241]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:09.869472 np0000001583 nova-compute[98241]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:57:09.869472 np0000001583 nova-compute[98241]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:57:09.869472 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:57:09.870367 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:57:09.870367 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:57:09.870367 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:57:09.870367 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:57:09.870367 np0000001583 nova-compute[98241]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:09.870367 np0000001583 nova-compute[98241]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:09.870367 np0000001583 nova-compute[98241]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:57:09.870367 np0000001583 nova-compute[98241]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:57:09.870367 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:57:09.901746 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805, portal: 192.168.40.100,3260]
May 28 01:57:09.901746 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805, portal: 192.168.40.100,3260] successful.
May 28 01:57:09.901746 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:09.917595 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:09.932649 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805, portal: 192.168.50.100,3260]
May 28 01:57:09.932649 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805, portal: 192.168.50.100,3260] successful.
May 28 01:57:09.932649 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:09.938538 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:57:09.938538 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:57:09.938538 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:57:09.938538 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:57:09.938538 np0000001583 nova-compute[98241]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:09.938538 np0000001583 nova-compute[98241]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:09.938538 np0000001583 nova-compute[98241]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:57:09.938538 np0000001583 nova-compute[98241]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:57:09.938538 np0000001583 nova-compute[98241]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805 (non-flash)
May 28 01:57:09.938538 np0000001583 nova-compute[98241]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805 (non-flash)
May 28 01:57:09.938538 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:57:09.938796 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:57:09.938796 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:57:09.938796 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:57:09.938796 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:57:09.938796 np0000001583 nova-compute[98241]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:09.938796 np0000001583 nova-compute[98241]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:09.938796 np0000001583 nova-compute[98241]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:57:09.938796 np0000001583 nova-compute[98241]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:57:09.938796 np0000001583 nova-compute[98241]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805 (non-flash)
May 28 01:57:09.938796 np0000001583 nova-compute[98241]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805 (non-flash)
May 28 01:57:09.938796 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:57:09.939096 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.168s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:57:09.939096 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:57:09.943707 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] HCTL ('9', '-', '-', 0) found on session 58 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:57:09.943707 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:57:09.945346 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:09.960911 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Searching for a device in session 58 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:57:09.960911 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4eea4106-b0fc-4a86-9288-5bf9167cb805', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:57:09.971190 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:57:09.971190 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:57:09.971190 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:57:09.971190 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:57:09.971190 np0000001583 nova-compute[98241]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:09.971190 np0000001583 nova-compute[98241]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:09.971190 np0000001583 nova-compute[98241]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:57:09.971190 np0000001583 nova-compute[98241]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:57:09.971190 np0000001583 nova-compute[98241]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805 (non-flash)
May 28 01:57:09.971190 np0000001583 nova-compute[98241]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805 (non-flash)
May 28 01:57:09.971190 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:57:09.971546 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:57:09.971546 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:57:09.971546 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:57:09.971546 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:57:09.971546 np0000001583 nova-compute[98241]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:09.971546 np0000001583 nova-compute[98241]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:09.971546 np0000001583 nova-compute[98241]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:57:09.971546 np0000001583 nova-compute[98241]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:57:09.971546 np0000001583 nova-compute[98241]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805 (non-flash)
May 28 01:57:09.971546 np0000001583 nova-compute[98241]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805 (non-flash)
May 28 01:57:09.971546 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:57:09.971809 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.200s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:57:09.971809 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:57:09.972796 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] HCTL ('10', '-', '-', 0) found on session 59 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:57:09.972897 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:57:09.995581 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Searching for a device in session 59 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:57:09.995853 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '4eea4106-b0fc-4a86-9288-5bf9167cb805', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:57:10.016845 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 1100d127-f3d6-416e-a646-b072660980bc] End _get_guest_xml xml=<domain type="qemu">
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:   <uuid>1100d127-f3d6-416e-a646-b072660980bc</uuid>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:   <name>instance-0000001a</name>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:       <nova:name>tempest-AttachVolumeNegativeTest-server-62369716</nova:name>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:57:09</nova:creationTime>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:         <nova:user uuid="00cb6190618b45eb994dd16d3c657f01">tempest-AttachVolumeNegativeTest-169599115-project-member</nova:user>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:         <nova:project uuid="837663bcfa40402aaf583729dfbb26cd">tempest-AttachVolumeNegativeTest-169599115</nova:project>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:         <nova:port uuid="addc7428-573c-4e5e-bb8f-096648f17132">
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:     <system>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:       <entry name="serial">1100d127-f3d6-416e-a646-b072660980bc</entry>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:       <entry name="uuid">1100d127-f3d6-416e-a646-b072660980bc</entry>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:     </system>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:   <os>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:   </os>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:   <features>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:   </features>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:   <devices>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/1100d127-f3d6-416e-a646-b072660980bc/disk"/>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:     </disk>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/1100d127-f3d6-416e-a646-b072660980bc/disk.config"/>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:     </disk>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:92:e2:5b"/>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:       <target dev="tapaddc7428-57"/>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:     </interface>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/1100d127-f3d6-416e-a646-b072660980bc/console.log" append="off"/>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:     </serial>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:     <video>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:     </video>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:     </rng>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:   </devices>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]: </domain>
May 28 01:57:10.016845 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:57:10.018886 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Preparing to wait for external event network-vif-plugged-addc7428-573c-4e5e-bb8f-096648f17132 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:57:10.018886 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "1100d127-f3d6-416e-a646-b072660980bc-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:10.018886 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "1100d127-f3d6-416e-a646-b072660980bc-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:10.018886 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "1100d127-f3d6-416e-a646-b072660980bc-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:10.018886 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:56:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-62369716',display_name='tempest-AttachVolumeNegativeTest-server-62369716',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-attachvolumenegativetest-server-62369716',id=26,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBfW7IFXJjWOYq3eCq2aqExUMzvjYvgU907FlYR/n8nl7Vof3eMqYKZUQnxzR4TW0LrAMe7GgYL2dH4bjZ1gr2Pe89Z3BD2G3RVOrg7fW4OHXlv3ASmhxMYDzifFzgLWg==',key_name='tempest-keypair-1768809071',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='837663bcfa40402aaf583729dfbb26cd',ramdisk_id='',reservation_id='r-qt95u7wp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-169599115',owner_user_name='tempest-AttachVolumeNegativeTest-169599115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:57:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='00cb6190618b45eb994dd16d3c657f01',uuid=1100d127-f3d6-416e-a646-b072660980bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "addc7428-573c-4e5e-bb8f-096648f17132", "address": "fa:16:3e:92:e2:5b", "network": {"id": "62e7cc38-1758-4b09-a352-4635adc9cfea", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587967507-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "837663bcfa40402aaf583729dfbb26cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaddc7428-57", "ovs_interfaceid": "addc7428-573c-4e5e-bb8f-096648f17132", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:57:10.019507 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Converting VIF {"id": "addc7428-573c-4e5e-bb8f-096648f17132", "address": "fa:16:3e:92:e2:5b", "network": {"id": "62e7cc38-1758-4b09-a352-4635adc9cfea", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587967507-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "837663bcfa40402aaf583729dfbb26cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaddc7428-57", "ovs_interfaceid": "addc7428-573c-4e5e-bb8f-096648f17132", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:57:10.019748 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:e2:5b,bridge_name='br-int',has_traffic_filtering=True,id=addc7428-573c-4e5e-bb8f-096648f17132,network=Network(62e7cc38-1758-4b09-a352-4635adc9cfea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaddc7428-57') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:57:10.019994 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:e2:5b,bridge_name='br-int',has_traffic_filtering=True,id=addc7428-573c-4e5e-bb8f-096648f17132,network=Network(62e7cc38-1758-4b09-a352-4635adc9cfea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaddc7428-57') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:57:10.020719 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:10.021007 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:10.021273 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:57:10.022276 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:10.022511 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd3f82770-6862-558c-be3e-bd1580c0cc74', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:10.024417 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:10.025044 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:57:10.032463 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:10.038030 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:10.038030 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaddc7428-57, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:10.038030 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaddc7428-57, col_values=(('qos', UUID('68697d5a-6cb9-43f7-b8d2-c11920819da9')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:10.038030 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaddc7428-57, col_values=(('external_ids', {'iface-id': 'addc7428-573c-4e5e-bb8f-096648f17132', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:e2:5b', 'vm-uuid': '1100d127-f3d6-416e-a646-b072660980bc'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:10.038353 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:10.040531 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:57:10.050526 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:10.051970 np0000001583 nova-compute[98241]: INFO os_vif [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:e2:5b,bridge_name='br-int',has_traffic_filtering=True,id=addc7428-573c-4e5e-bb8f-096648f17132,network=Network(62e7cc38-1758-4b09-a352-4635adc9cfea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaddc7428-57')
May 28 01:57:10.128141 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-097fca48-f55a-4213-95e8-d76faec74513 req-aeadf788-978e-40b7-8efe-031e1b81830d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:10.290984 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-097fca48-f55a-4213-95e8-d76faec74513 req-aeadf788-978e-40b7-8efe-031e1b81830d service nova] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Updated VIF entry in instance network info cache for port bce4c127-622b-4001-a5df-94a04616b08e. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:57:10.291310 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-097fca48-f55a-4213-95e8-d76faec74513 req-aeadf788-978e-40b7-8efe-031e1b81830d service nova] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Updating instance_info_cache with network_info: [{"id": "bce4c127-622b-4001-a5df-94a04616b08e", "address": "fa:16:3e:b1:89:97", "network": {"id": "b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-280876007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60fbdf5ed38b4dc485a81c49b3303ed2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbce4c127-62", "ovs_interfaceid": "bce4c127-622b-4001-a5df-94a04616b08e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:57:10.416995 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:57:10.417360 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:57:10.748105 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-eee8df1c-20fa-4f20-8e75-3377bb367520 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "45a73c95-ff10-4b74-9ab8-4014a244a7d3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:10.748502 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-eee8df1c-20fa-4f20-8e75-3377bb367520 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "45a73c95-ff10-4b74-9ab8-4014a244a7d3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:10.748502 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-eee8df1c-20fa-4f20-8e75-3377bb367520 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "45a73c95-ff10-4b74-9ab8-4014a244a7d3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:10.748666 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-eee8df1c-20fa-4f20-8e75-3377bb367520 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "45a73c95-ff10-4b74-9ab8-4014a244a7d3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:10.748804 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-eee8df1c-20fa-4f20-8e75-3377bb367520 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "45a73c95-ff10-4b74-9ab8-4014a244a7d3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:10.750699 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-eee8df1c-20fa-4f20-8e75-3377bb367520 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Terminating instance
May 28 01:57:10.772435 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:57:10.794010 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-097fca48-f55a-4213-95e8-d76faec74513 req-aeadf788-978e-40b7-8efe-031e1b81830d service nova] Releasing lock "refresh_cache-12f40ca4-b4b3-43f4-8c0b-cb208f59935c" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:57:10.815303 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:57:10.815527 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:57:10.815667 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:57:10.815803 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] No VIF found with MAC fa:16:3e:30:bd:e8, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:57:10.816409 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Using config drive
May 28 01:57:10.921946 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:57:10.942107 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.00037473499992302095 future=<Future at 0x7724ec317b90 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:10.942221 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:10.942326 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=2.932365305999838 future=<Future at 0x7724ec1cf620 state=cancelled>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:10.942394 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=2.9322780789998433 future=<Future at 0x7724ec1cf620 state=cancelled>) was cancelled while queued, skipping {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:10.942464 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:10.942573 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=9.143562547999863 future=<Future at 0x7724ec1f1ee0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:10.942640 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=9.143478567999864 future=<Future at 0x7724ec1f1ee0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:10.944531 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Emitting event <LifecycleEvent: 1779933415.941608, 7078fbb1-fa4a-4589-9f95-9d95dee381e0 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:57:10.944702 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] VM Stopped (Lifecycle Event)
May 28 01:57:11.196814 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-58955a65-3b11-4d65-98b3-a579daba3dc4 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Acquiring lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:11.196814 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-58955a65-3b11-4d65-98b3-a579daba3dc4 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:11.255241 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-eee8df1c-20fa-4f20-8e75-3377bb367520 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:57:11.267472 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:11.315298 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:11.322354 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:11.339043 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:11.386329 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:11.434780 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.788s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:11.434871 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Migrating
May 28 01:57:11.435141 np0000001583 nova-compute[98241]: DEBUG nova.compute.rpcapi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98241) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 01:57:11.447157 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:57:11.494701 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-fd1982f8-dcb2-4f3b-a688-12526b5e34f0 req-e3c39fe5-8cbb-4b90-8d70-ed9916000307 service nova] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Received event network-vif-unplugged-463c33b4-3468-4b31-b611-3ab977c91c1c {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:57:11.495740 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-fd1982f8-dcb2-4f3b-a688-12526b5e34f0 req-e3c39fe5-8cbb-4b90-8d70-ed9916000307 service nova] Acquiring lock "45a73c95-ff10-4b74-9ab8-4014a244a7d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:11.495740 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-fd1982f8-dcb2-4f3b-a688-12526b5e34f0 req-e3c39fe5-8cbb-4b90-8d70-ed9916000307 service nova] Lock "45a73c95-ff10-4b74-9ab8-4014a244a7d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:11.496014 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-fd1982f8-dcb2-4f3b-a688-12526b5e34f0 req-e3c39fe5-8cbb-4b90-8d70-ed9916000307 service nova] Lock "45a73c95-ff10-4b74-9ab8-4014a244a7d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:11.496177 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-fd1982f8-dcb2-4f3b-a688-12526b5e34f0 req-e3c39fe5-8cbb-4b90-8d70-ed9916000307 service nova] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] No waiting events found dispatching network-vif-unplugged-463c33b4-3468-4b31-b611-3ab977c91c1c {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:57:11.496472 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-fd1982f8-dcb2-4f3b-a688-12526b5e34f0 req-e3c39fe5-8cbb-4b90-8d70-ed9916000307 service nova] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Received event network-vif-unplugged-463c33b4-3468-4b31-b611-3ab977c91c1c for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:57:11.542261 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-fe05caff-ace7-4f8e-a938-39609b315fb9 req-9f2149d5-664c-485d-9b10-ff7707cf4577 service nova] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Received event network-vif-plugged-7567636b-7225-4025-b9f0-d4c8eb5abe43 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:57:11.542436 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-fe05caff-ace7-4f8e-a938-39609b315fb9 req-9f2149d5-664c-485d-9b10-ff7707cf4577 service nova] Acquiring lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:11.542555 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-fe05caff-ace7-4f8e-a938-39609b315fb9 req-9f2149d5-664c-485d-9b10-ff7707cf4577 service nova] Lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:11.542712 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-fe05caff-ace7-4f8e-a938-39609b315fb9 req-9f2149d5-664c-485d-9b10-ff7707cf4577 service nova] Lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:11.542781 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-fe05caff-ace7-4f8e-a938-39609b315fb9 req-9f2149d5-664c-485d-9b10-ff7707cf4577 service nova] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] No waiting events found dispatching network-vif-plugged-7567636b-7225-4025-b9f0-d4c8eb5abe43 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:57:11.542918 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-fe05caff-ace7-4f8e-a938-39609b315fb9 req-9f2149d5-664c-485d-9b10-ff7707cf4577 service nova] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Received unexpected event network-vif-plugged-7567636b-7225-4025-b9f0-d4c8eb5abe43 for instance with vm_state active and task_state resize_finish.
May 28 01:57:11.582121 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:57:11.582121 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:57:11.582121 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] No VIF found with MAC fa:16:3e:92:e2:5b, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:57:11.582369 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Using config drive
May 28 01:57:11.604372 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.9996453629999 future=<Future at 0x7724f847dc10 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:11.609165 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Instance destroyed successfully.
May 28 01:57:11.611536 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-eee8df1c-20fa-4f20-8e75-3377bb367520 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lazy-loading 'resources' on Instance uuid 45a73c95-ff10-4b74-9ab8-4014a244a7d3 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:57:11.671548 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:11.683922 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:11.688436 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:11.698740 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-58955a65-3b11-4d65-98b3-a579daba3dc4 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Detaching volume 3bc9896c-bcd6-402c-8ce3-e94000d21629
May 28 01:57:11.717816 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:11.731395 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:11.753154 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-58955a65-3b11-4d65-98b3-a579daba3dc4 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Attempting to driver detach volume 3bc9896c-bcd6-402c-8ce3-e94000d21629 from mountpoint /dev/vdb
May 28 01:57:11.757822 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-58955a65-3b11-4d65-98b3-a579daba3dc4 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Found disk vdb by alias ua-3bc9896c-bcd6-402c-8ce3-e94000d21629 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:57:11.759110 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-58955a65-3b11-4d65-98b3-a579daba3dc4 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Found disk vdb by alias ua-3bc9896c-bcd6-402c-8ce3-e94000d21629 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:57:11.759258 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-58955a65-3b11-4d65-98b3-a579daba3dc4 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Attempting to detach device vdb from instance 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4 from the persistent domain config. {{(pid=98241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 01:57:11.759516 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-58955a65-3b11-4d65-98b3-a579daba3dc4 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:57:11.759516 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:57:11.759516 np0000001583 nova-compute[98241]:   <alias name="ua-3bc9896c-bcd6-402c-8ce3-e94000d21629"/>
May 28 01:57:11.759516 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-10"/>
May 28 01:57:11.759516 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 01:57:11.759516 np0000001583 nova-compute[98241]:   <serial>3bc9896c-bcd6-402c-8ce3-e94000d21629</serial>
May 28 01:57:11.759516 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:57:11.759516 np0000001583 nova-compute[98241]: </disk>
May 28 01:57:11.759516 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:57:11.767860 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-58955a65-3b11-4d65-98b3-a579daba3dc4 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Successfully detached device vdb from instance 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4 from the persistent domain config.
May 28 01:57:11.768072 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-58955a65-3b11-4d65-98b3-a579daba3dc4 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] (1/8): Attempting to detach device vdb with device alias ua-3bc9896c-bcd6-402c-8ce3-e94000d21629 from instance 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4 from the live domain config. {{(pid=98241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 01:57:11.768359 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-58955a65-3b11-4d65-98b3-a579daba3dc4 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:57:11.768359 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:57:11.768359 np0000001583 nova-compute[98241]:   <alias name="ua-3bc9896c-bcd6-402c-8ce3-e94000d21629"/>
May 28 01:57:11.768359 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-10"/>
May 28 01:57:11.768359 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 01:57:11.768359 np0000001583 nova-compute[98241]:   <serial>3bc9896c-bcd6-402c-8ce3-e94000d21629</serial>
May 28 01:57:11.768359 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:57:11.768359 np0000001583 nova-compute[98241]: </disk>
May 28 01:57:11.768359 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:57:11.796206 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Found WWN 330000000fa18cbaf for multipath device dm-1 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:57:11.798108 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:57:11.798108 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] <== connect_volume: return (5519ms) {'type': 'block', 'scsi_wwn': '330000000fa18cbaf', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '330000000fa18cbaf'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:57:11.798108 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000fa18cbaf', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '330000000fa18cbaf'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:57:11.840859 np0000001583 nova-compute[98241]: DEBUG os_brick.encryptors [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805', 'iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4eea4106-b0fc-4a86-9288-5bf9167cb805', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, 'status': 'reserved', 'instance': 'fbe845bb-c11e-4c97-85b8-4f3759e1bd22', 'attached_at': '', 'detached_at': '', 'volume_id': '4eea4106-b0fc-4a86-9288-5bf9167cb805', 'serial': '4eea4106-b0fc-4a86-9288-5bf9167cb805'} {{(pid=98241) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 01:57:11.841494 np0000001583 nova-compute[98241]: WARNING stevedore.named [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 01:57:11.842244 np0000001583 nova-compute[98241]: WARNING castellan.key_manager [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 01:57:11.844853 np0000001583 nova-compute[98241]: WARNING nova.keymgr.conf_key_mgr [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 01:57:11.875538 np0000001583 nova-compute[98241]: WARNING os_brick.encryptors.luks [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 28 01:57:11.875935 np0000001583 nova-compute[98241]: WARNING stevedore.named [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 01:57:11.876099 np0000001583 nova-compute[98241]: WARNING castellan.key_manager [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 01:57:11.876257 np0000001583 nova-compute[98241]: WARNING nova.keymgr.conf_key_mgr [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 01:57:11.876736 np0000001583 nova-compute[98241]: DEBUG os_brick.encryptors [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x7724f90af9e0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805', 'iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4eea4106-b0fc-4a86-9288-5bf9167cb805', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, 'status': 'reserved', 'instance': 'fbe845bb-c11e-4c97-85b8-4f3759e1bd22', 'attached_at': '', 'detached_at': '', 'volume_id': '4eea4106-b0fc-4a86-9288-5bf9167cb805', 'serial': '4eea4106-b0fc-4a86-9288-5bf9167cb805'} {{(pid=98241) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 28 01:57:11.876863 np0000001583 nova-compute[98241]: DEBUG os_brick.encryptors.luks [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] formatting encrypted volume /dev/dm-1 {{(pid=98241) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 28 01:57:11.958902 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "refresh_cache-12f40ca4-b4b3-43f4-8c0b-cb208f59935c" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:57:11.959094 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquired lock "refresh_cache-12f40ca4-b4b3-43f4-8c0b-cb208f59935c" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:57:11.959358 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:57:11.988230 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:12.004527 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:12.088557 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:12.115962 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-eee8df1c-20fa-4f20-8e75-3377bb367520 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:55:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-876652948',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-serverbootfromvolumestablerescuetest-server-876652948',id=22,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:56:02Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ba381dad8364a488a98b80c04cce8fb',ramdisk_id='',reservation_id='r-oqy0fx76',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1211567633',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:56:10Z,user_data=None,user_id='c3a7b14e31ee40cf9e4f4bba084ccaa5',uuid=45a73c95-ff10-4b74-9ab8-4014a244a7d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "463c33b4-3468-4b31-b611-3ab977c91c1c", "address": "fa:16:3e:20:92:ee", "network": {"id": "2ee43c4e-569f-4726-9700-add40d768203", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ba381dad8364a488a98b80c04cce8fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap463c33b4-34", "ovs_interfaceid": "463c33b4-3468-4b31-b611-3ab977c91c1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:57:12.116198 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-eee8df1c-20fa-4f20-8e75-3377bb367520 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Converting VIF {"id": "463c33b4-3468-4b31-b611-3ab977c91c1c", "address": "fa:16:3e:20:92:ee", "network": {"id": "2ee43c4e-569f-4726-9700-add40d768203", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ba381dad8364a488a98b80c04cce8fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap463c33b4-34", "ovs_interfaceid": "463c33b4-3468-4b31-b611-3ab977c91c1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:57:12.119100 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-eee8df1c-20fa-4f20-8e75-3377bb367520 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:92:ee,bridge_name='br-int',has_traffic_filtering=True,id=463c33b4-3468-4b31-b611-3ab977c91c1c,network=Network(2ee43c4e-569f-4726-9700-add40d768203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap463c33b4-34') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:57:12.119100 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-eee8df1c-20fa-4f20-8e75-3377bb367520 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:92:ee,bridge_name='br-int',has_traffic_filtering=True,id=463c33b4-3468-4b31-b611-3ab977c91c1c,network=Network(2ee43c4e-569f-4726-9700-add40d768203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap463c33b4-34') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:57:12.121447 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:12.122942 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap463c33b4-34, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:12.124121 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:12.125394 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:57:12.136119 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:12.137309 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:12.137309 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e94ade6c-75ce-46ee-99a8-87ee157e27cd) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:12.142402 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:12.142402 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:57:12.144627 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:12.150443 np0000001583 nova-compute[98241]: INFO os_vif [None req-eee8df1c-20fa-4f20-8e75-3377bb367520 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:92:ee,bridge_name='br-int',has_traffic_filtering=True,id=463c33b4-3468-4b31-b611-3ab977c91c1c,network=Network(2ee43c4e-569f-4726-9700-add40d768203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap463c33b4-34')
May 28 01:57:12.151070 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-eee8df1c-20fa-4f20-8e75-3377bb367520 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Deleting instance files /opt/stack/data/nova/instances/45a73c95-ff10-4b74-9ab8-4014a244a7d3_del
May 28 01:57:12.153863 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-eee8df1c-20fa-4f20-8e75-3377bb367520 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Deletion of /opt/stack/data/nova/instances/45a73c95-ff10-4b74-9ab8-4014a244a7d3_del complete
May 28 01:57:12.255576 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Creating config drive at /opt/stack/data/nova/instances/1100d127-f3d6-416e-a646-b072660980bc/disk.config
May 28 01:57:12.261751 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1100d127-f3d6-416e-a646-b072660980bc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpp7wrgibz {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:57:12.278835 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933432.277611, 7078fbb1-fa4a-4589-9f95-9d95dee381e0 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:57:12.279551 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] VM Resumed (Lifecycle Event)
May 28 01:57:12.283703 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Instance event wait completed in 0 seconds for  {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:57:12.288811 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Instance running successfully.
May 28 01:57:12.290192 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Failed to set time: agent not configured {{(pid=98241) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 28 01:57:12.290425 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3157f081-88df-4322-8b0c-8c4f9dbf4421 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] finish_migration finished successfully. {{(pid=98241) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 28 01:57:12.312948 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1100d127-f3d6-416e-a646-b072660980bc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpp7wrgibz" returned: 0 in 0.051s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:57:12.313656 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-58955a65-3b11-4d65-98b3-a579daba3dc4 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-3bc9896c-bcd6-402c-8ce3-e94000d21629 for instance 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4 {{(pid=98241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 01:57:12.462470 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:12.658880 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-eee8df1c-20fa-4f20-8e75-3377bb367520 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Took 1.40 seconds to destroy the instance on the hypervisor.
May 28 01:57:12.659481 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-eee8df1c-20fa-4f20-8e75-3377bb367520 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:57:12.659866 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:57:12.660015 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:57:12.660285 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:12.774710 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:12.783119 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:12.787873 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:57:12.800673 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:57:12.804430 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:12.836052 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:12.907668 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:13.051902 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:13.123616 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Updating instance_info_cache with network_info: [{"id": "bce4c127-622b-4001-a5df-94a04616b08e", "address": "fa:16:3e:b1:89:97", "network": {"id": "b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-280876007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60fbdf5ed38b4dc485a81c49b3303ed2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbce4c127-62", "ovs_interfaceid": "bce4c127-622b-4001-a5df-94a04616b08e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:57:13.193429 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:13.194036 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:13.200747 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:13.223163 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:13.311064 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 28 01:57:13.311326 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933433.3111613, 7078fbb1-fa4a-4589-9f95-9d95dee381e0 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:57:13.314177 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] VM Started (Lifecycle Event)
May 28 01:57:13.565637 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7db40b63-a72f-47f0-a334-c3c0de4ec6b2 req-32a19d53-7ed5-4ca6-a623-4bdee4091069 service nova] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Received event network-vif-unplugged-463c33b4-3468-4b31-b611-3ab977c91c1c {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:57:13.565889 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7db40b63-a72f-47f0-a334-c3c0de4ec6b2 req-32a19d53-7ed5-4ca6-a623-4bdee4091069 service nova] Acquiring lock "45a73c95-ff10-4b74-9ab8-4014a244a7d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:13.566120 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7db40b63-a72f-47f0-a334-c3c0de4ec6b2 req-32a19d53-7ed5-4ca6-a623-4bdee4091069 service nova] Lock "45a73c95-ff10-4b74-9ab8-4014a244a7d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:13.566264 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7db40b63-a72f-47f0-a334-c3c0de4ec6b2 req-32a19d53-7ed5-4ca6-a623-4bdee4091069 service nova] Lock "45a73c95-ff10-4b74-9ab8-4014a244a7d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:13.567699 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7db40b63-a72f-47f0-a334-c3c0de4ec6b2 req-32a19d53-7ed5-4ca6-a623-4bdee4091069 service nova] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] No waiting events found dispatching network-vif-unplugged-463c33b4-3468-4b31-b611-3ab977c91c1c {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:57:13.567839 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7db40b63-a72f-47f0-a334-c3c0de4ec6b2 req-32a19d53-7ed5-4ca6-a623-4bdee4091069 service nova] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Received event network-vif-unplugged-463c33b4-3468-4b31-b611-3ab977c91c1c for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:57:13.567970 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7db40b63-a72f-47f0-a334-c3c0de4ec6b2 req-32a19d53-7ed5-4ca6-a623-4bdee4091069 service nova] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Received event network-vif-deleted-463c33b4-3468-4b31-b611-3ab977c91c1c {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:57:13.568471 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-7db40b63-a72f-47f0-a334-c3c0de4ec6b2 req-32a19d53-7ed5-4ca6-a623-4bdee4091069 service nova] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Neutron deleted interface 463c33b4-3468-4b31-b611-3ab977c91c1c; detaching it from the instance and deleting it from the info cache
May 28 01:57:13.571982 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7db40b63-a72f-47f0-a334-c3c0de4ec6b2 req-32a19d53-7ed5-4ca6-a623-4bdee4091069 service nova] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Detach interface failed, port_id=463c33b4-3468-4b31-b611-3ab977c91c1c, reason: Instance 45a73c95-ff10-4b74-9ab8-4014a244a7d3 could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:57:13.603036 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:57:13.626643 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Releasing lock "refresh_cache-12f40ca4-b4b3-43f4-8c0b-cb208f59935c" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:57:13.638599 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5cb5da08-dd69-4d0a-bcbd-82a90d845d02 req-8b952b08-8c08-41cc-b8ba-88b079d5f7bc service nova] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Received event network-vif-plugged-7567636b-7225-4025-b9f0-d4c8eb5abe43 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:57:13.639018 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5cb5da08-dd69-4d0a-bcbd-82a90d845d02 req-8b952b08-8c08-41cc-b8ba-88b079d5f7bc service nova] Acquiring lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:13.639903 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5cb5da08-dd69-4d0a-bcbd-82a90d845d02 req-8b952b08-8c08-41cc-b8ba-88b079d5f7bc service nova] Lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:13.639903 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5cb5da08-dd69-4d0a-bcbd-82a90d845d02 req-8b952b08-8c08-41cc-b8ba-88b079d5f7bc service nova] Lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:13.640049 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5cb5da08-dd69-4d0a-bcbd-82a90d845d02 req-8b952b08-8c08-41cc-b8ba-88b079d5f7bc service nova] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] No waiting events found dispatching network-vif-plugged-7567636b-7225-4025-b9f0-d4c8eb5abe43 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:57:13.640190 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-5cb5da08-dd69-4d0a-bcbd-82a90d845d02 req-8b952b08-8c08-41cc-b8ba-88b079d5f7bc service nova] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Received unexpected event network-vif-plugged-7567636b-7225-4025-b9f0-d4c8eb5abe43 for instance with vm_state resized and task_state None.
May 28 01:57:13.640366 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5cb5da08-dd69-4d0a-bcbd-82a90d845d02 req-8b952b08-8c08-41cc-b8ba-88b079d5f7bc service nova] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Received event network-vif-plugged-addc7428-573c-4e5e-bb8f-096648f17132 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:57:13.640583 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5cb5da08-dd69-4d0a-bcbd-82a90d845d02 req-8b952b08-8c08-41cc-b8ba-88b079d5f7bc service nova] Acquiring lock "1100d127-f3d6-416e-a646-b072660980bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:13.640826 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5cb5da08-dd69-4d0a-bcbd-82a90d845d02 req-8b952b08-8c08-41cc-b8ba-88b079d5f7bc service nova] Lock "1100d127-f3d6-416e-a646-b072660980bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:13.641452 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5cb5da08-dd69-4d0a-bcbd-82a90d845d02 req-8b952b08-8c08-41cc-b8ba-88b079d5f7bc service nova] Lock "1100d127-f3d6-416e-a646-b072660980bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:13.641452 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5cb5da08-dd69-4d0a-bcbd-82a90d845d02 req-8b952b08-8c08-41cc-b8ba-88b079d5f7bc service nova] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Processing event network-vif-plugged-addc7428-573c-4e5e-bb8f-096648f17132 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:57:13.641677 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5cb5da08-dd69-4d0a-bcbd-82a90d845d02 req-8b952b08-8c08-41cc-b8ba-88b079d5f7bc service nova] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Received event network-vif-plugged-addc7428-573c-4e5e-bb8f-096648f17132 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:57:13.641858 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5cb5da08-dd69-4d0a-bcbd-82a90d845d02 req-8b952b08-8c08-41cc-b8ba-88b079d5f7bc service nova] Acquiring lock "1100d127-f3d6-416e-a646-b072660980bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:13.642035 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5cb5da08-dd69-4d0a-bcbd-82a90d845d02 req-8b952b08-8c08-41cc-b8ba-88b079d5f7bc service nova] Lock "1100d127-f3d6-416e-a646-b072660980bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:13.642204 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5cb5da08-dd69-4d0a-bcbd-82a90d845d02 req-8b952b08-8c08-41cc-b8ba-88b079d5f7bc service nova] Lock "1100d127-f3d6-416e-a646-b072660980bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:13.642383 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5cb5da08-dd69-4d0a-bcbd-82a90d845d02 req-8b952b08-8c08-41cc-b8ba-88b079d5f7bc service nova] [instance: 1100d127-f3d6-416e-a646-b072660980bc] No waiting events found dispatching network-vif-plugged-addc7428-573c-4e5e-bb8f-096648f17132 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:57:13.642510 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-5cb5da08-dd69-4d0a-bcbd-82a90d845d02 req-8b952b08-8c08-41cc-b8ba-88b079d5f7bc service nova] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Received unexpected event network-vif-plugged-addc7428-573c-4e5e-bb8f-096648f17132 for instance with vm_state building and task_state spawning.
May 28 01:57:13.748318 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:57:13.751484 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:57:13.756140 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Instance spawned successfully.
May 28 01:57:13.756140 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:57:13.817230 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:57:13.819108 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:57:14.106125 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Took 1.45 seconds to deallocate network for instance.
May 28 01:57:14.216317 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:14.265310 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:57:14.265310 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:57:14.265974 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:57:14.266398 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:57:14.270148 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:57:14.270148 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:57:14.322001 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] During sync_power_state the instance has a pending task (resize_reverting). Skip.
May 28 01:57:14.322712 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Received event <DeviceRemovedEvent: 1779933434.3224404, 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4 => ua-3bc9896c-bcd6-402c-8ce3-e94000d21629> from libvirt while the driver is waiting for it; dispatched. {{(pid=98241) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 01:57:14.323470 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933434.3232048, 1100d127-f3d6-416e-a646-b072660980bc => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:57:14.323567 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 1100d127-f3d6-416e-a646-b072660980bc] VM Started (Lifecycle Event)
May 28 01:57:14.330472 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-58955a65-3b11-4d65-98b3-a579daba3dc4 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Successfully detached device vdb from instance 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4 from the live domain config.
May 28 01:57:14.332671 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58955a65-3b11-4d65-98b3-a579daba3dc4 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:57:14.332863 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58955a65-3b11-4d65-98b3-a579daba3dc4 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629', 'iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3bc9896c-bcd6-402c-8ce3-e94000d21629', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': False}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:57:14.333477 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-58955a65-3b11-4d65-98b3-a579daba3dc4 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:57:14.333911 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-58955a65-3b11-4d65-98b3-a579daba3dc4 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:57:14.334379 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58955a65-3b11-4d65-98b3-a579daba3dc4 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629', 'iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3bc9896c-bcd6-402c-8ce3-e94000d21629', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:57:14.334603 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58955a65-3b11-4d65-98b3-a579daba3dc4 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:57:14.355098 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:14.357958 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:14.357958 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:14.370539 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58955a65-3b11-4d65-98b3-a579daba3dc4 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:57:14.370539 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:57:14.370539 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:57:14.370539 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:57:14.370539 np0000001583 nova-compute[98241]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:14.370539 np0000001583 nova-compute[98241]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:14.370539 np0000001583 nova-compute[98241]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:57:14.370539 np0000001583 nova-compute[98241]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:57:14.370539 np0000001583 nova-compute[98241]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805 (non-flash)
May 28 01:57:14.370539 np0000001583 nova-compute[98241]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805 (non-flash)
May 28 01:57:14.370539 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:57:14.371500 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58955a65-3b11-4d65-98b3-a579daba3dc4 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] iscsi session list stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:57:14.371500 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:57:14.371500 np0000001583 nova-compute[98241]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:57:14.371500 np0000001583 nova-compute[98241]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629 (non-flash)
May 28 01:57:14.371500 np0000001583 nova-compute[98241]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:14.371500 np0000001583 nova-compute[98241]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:14.371500 np0000001583 nova-compute[98241]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:57:14.371500 np0000001583 nova-compute[98241]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:57:14.371500 np0000001583 nova-compute[98241]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805 (non-flash)
May 28 01:57:14.371500 np0000001583 nova-compute[98241]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805 (non-flash)
May 28 01:57:14.371500 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:57:14.371500 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58955a65-3b11-4d65-98b3-a579daba3dc4 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629', '48'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629', '49'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', '54'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', '55'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', '56'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', '57'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805', '58'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805', '59')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:57:14.371500 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58955a65-3b11-4d65-98b3-a579daba3dc4 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629', '49')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:57:14.372750 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58955a65-3b11-4d65-98b3-a579daba3dc4 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629', '48')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:57:14.375955 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58955a65-3b11-4d65-98b3-a579daba3dc4 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f829fa60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629'): ({'sdo'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629'): ({'sdn'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:57:14.376526 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-58955a65-3b11-4d65-98b3-a579daba3dc4 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Removing multipathed devices sdo, sdn {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:57:14.376875 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-58955a65-3b11-4d65-98b3-a579daba3dc4 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Flush multipath device 33000000033e0ca3f {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:57:14.414103 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-58955a65-3b11-4d65-98b3-a579daba3dc4 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:57:14.459424 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Port 7567636b-7225-4025-b9f0-d4c8eb5abe43 binding to destination host np0000001583 is already ACTIVE {{(pid=98241) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 28 01:57:14.459745 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Acquiring lock "refresh_cache-7078fbb1-fa4a-4589-9f95-9d95dee381e0" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:57:14.459745 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Acquired lock "refresh_cache-7078fbb1-fa4a-4589-9f95-9d95dee381e0" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:57:14.459943 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:57:14.465607 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-58955a65-3b11-4d65-98b3-a579daba3dc4 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:57:14.511853 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-58955a65-3b11-4d65-98b3-a579daba3dc4 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Checking to see if SCSI volumes sdo, sdn have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:57:14.511853 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-58955a65-3b11-4d65-98b3-a579daba3dc4 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] SCSI volumes sdo, sdn have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:57:14.511853 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-58955a65-3b11-4d65-98b3-a579daba3dc4 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Checking to see if device paths {'sdo', 'sdn'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:57:14.526501 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-58955a65-3b11-4d65-98b3-a579daba3dc4 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Device paths {'sdo', 'sdn'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:57:14.527573 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58955a65-3b11-4d65-98b3-a579daba3dc4 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:57:14.541987 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58955a65-3b11-4d65-98b3-a579daba3dc4 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:14.582554 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58955a65-3b11-4d65-98b3-a579daba3dc4 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629, portal: 192.168.40.100,3260]
May 28 01:57:14.582554 np0000001583 nova-compute[98241]: Logout of [sid: 49, target: iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629, portal: 192.168.40.100,3260] successful.
May 28 01:57:14.582554 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:14.605976 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58955a65-3b11-4d65-98b3-a579daba3dc4 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:14.612697 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-eee8df1c-20fa-4f20-8e75-3377bb367520 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:14.612873 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-eee8df1c-20fa-4f20-8e75-3377bb367520 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:14.622214 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58955a65-3b11-4d65-98b3-a579daba3dc4 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:14.663389 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58955a65-3b11-4d65-98b3-a579daba3dc4 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629, portal: 192.168.50.100,3260]
May 28 01:57:14.663389 np0000001583 nova-compute[98241]: Logout of [sid: 48, target: iqn.2023-03.storpool.com:os--volume-3bc9896c-bcd6-402c-8ce3-e94000d21629, portal: 192.168.50.100,3260] successful.
May 28 01:57:14.663389 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:14.688109 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58955a65-3b11-4d65-98b3-a579daba3dc4 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:14.688109 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-58955a65-3b11-4d65-98b3-a579daba3dc4 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:57:14.688109 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58955a65-3b11-4d65-98b3-a579daba3dc4 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] <== disconnect_volume: return (352ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:57:14.688109 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58955a65-3b11-4d65-98b3-a579daba3dc4 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:57:14.775534 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Took 7.49 seconds to spawn the instance on the hypervisor.
May 28 01:57:14.775804 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:57:14.827230 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:57:14.829054 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:57:14.963411 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:15.143362 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Starting migrate_disk_and_power_off {{(pid=98241) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 28 01:57:15.168245 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:15.197542 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:15.245316 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-58955a65-3b11-4d65-98b3-a579daba3dc4 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lazy-loading 'flavor' on Instance uuid 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:57:15.290611 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Took 14.82 seconds to build instance.
May 28 01:57:15.326589 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-eee8df1c-20fa-4f20-8e75-3377bb367520 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:57:15.326868 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-eee8df1c-20fa-4f20-8e75-3377bb367520 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:57:15.331455 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933435.3312438, 1100d127-f3d6-416e-a646-b072660980bc => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:57:15.331557 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 1100d127-f3d6-416e-a646-b072660980bc] VM Paused (Lifecycle Event)
May 28 01:57:15.339834 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:15.345429 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:15.421486 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:15.484074 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Instance destroyed successfully.
May 28 01:57:15.486592 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:56:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1837652712',display_name='tempest-ServerActionsTestOtherA-server-1837652712',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-serveractionstestothera-server-1837652712',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIePG0IU7S1SlFjpc/VmXFCBBKIijsN+gHQMlnhYfGPcl665nwX9JP0OwVOuueebU/mRc6FRuLr9ai0zvPAu2rDRN1UE1FBgnGgOOoImTJFqPL9BfFXoi8JNvWclsGpwzg==',key_name='tempest-keypair-1911990843',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:57:02Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='60fbdf5ed38b4dc485a81c49b3303ed2',ramdisk_id='',reservation_id='r-t6bk0usf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1714646345',owner_user_name='tempest-ServerActionsTestOtherA-1714646345-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:57:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27c90c0a8eb148fda8ae718f07ff1ed4',uuid=12f40ca4-b4b3-43f4-8c0b-cb208f59935c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bce4c127-622b-4001-a5df-94a04616b08e", "address": "fa:16:3e:b1:89:97", "network": {"id": "b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-280876007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-280876007-network", "vif_mac": "fa:16:3e:b1:89:97"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60fbdf5ed38b4dc485a81c49b3303ed2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbce4c127-62", "ovs_interfaceid": "bce4c127-622b-4001-a5df-94a04616b08e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:57:15.486917 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Converting VIF {"id": "bce4c127-622b-4001-a5df-94a04616b08e", "address": "fa:16:3e:b1:89:97", "network": {"id": "b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-280876007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-280876007-network", "vif_mac": "fa:16:3e:b1:89:97"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60fbdf5ed38b4dc485a81c49b3303ed2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbce4c127-62", "ovs_interfaceid": "bce4c127-622b-4001-a5df-94a04616b08e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:57:15.487616 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b1:89:97,bridge_name='br-int',has_traffic_filtering=True,id=bce4c127-622b-4001-a5df-94a04616b08e,network=Network(b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbce4c127-62') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:57:15.487890 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:89:97,bridge_name='br-int',has_traffic_filtering=True,id=bce4c127-622b-4001-a5df-94a04616b08e,network=Network(b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbce4c127-62') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:57:15.494312 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:15.494687 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbce4c127-62, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:15.497867 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:15.499026 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:57:15.501332 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:15.501553 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8b0914bd-51f5-4ed4-b5dc-b00359760388) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:15.502912 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:57:15.508717 np0000001583 nova-compute[98241]: INFO os_vif [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:89:97,bridge_name='br-int',has_traffic_filtering=True,id=bce4c127-622b-4001-a5df-94a04616b08e,network=Network(b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbce4c127-62')
May 28 01:57:15.510913 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:57:15.510913 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', 'iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:57:15.510913 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:57:15.510913 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:57:15.510913 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', 'iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:57:15.510913 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:57:15.552849 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:57:15.552849 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:57:15.552849 np0000001583 nova-compute[98241]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:15.552849 np0000001583 nova-compute[98241]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:15.552849 np0000001583 nova-compute[98241]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:57:15.552849 np0000001583 nova-compute[98241]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:57:15.552849 np0000001583 nova-compute[98241]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805 (non-flash)
May 28 01:57:15.552849 np0000001583 nova-compute[98241]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805 (non-flash)
May 28 01:57:15.552849 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:57:15.552849 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsi session list stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:57:15.552849 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:57:15.552849 np0000001583 nova-compute[98241]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:15.552849 np0000001583 nova-compute[98241]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:15.552849 np0000001583 nova-compute[98241]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:57:15.552849 np0000001583 nova-compute[98241]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:57:15.552849 np0000001583 nova-compute[98241]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805 (non-flash)
May 28 01:57:15.552849 np0000001583 nova-compute[98241]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805 (non-flash)
May 28 01:57:15.552849 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:57:15.552849 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797', '39'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', '54'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', '55'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', '56'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', '57'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805', '58'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805', '59')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:57:15.552849 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', '54')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:57:15.553809 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', '55')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:57:15.554329 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724ec2c7ce0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a'): ({'sdg'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:57:15.554537 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Removing multipathed devices sdf, sdg {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:57:15.554756 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Flush multipath device 330000000acc6074f {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:57:15.596372 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Updating instance_info_cache with network_info: [{"id": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "address": "fa:16:3e:30:bd:e8", "network": {"id": "11b2c699-14f1-4eba-bbe6-b7655c6f17cc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1044342879-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2db0b9fa3fcc47408dad261c2004e4a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7567636b-72", "ovs_interfaceid": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:57:15.612610 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:57:15.660730 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:57:15.709999 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0bc8932e-6909-48c3-9fc3-7cb6119a7531 req-dc5a95af-4a33-46a7-be4d-d0879896dea0 service nova] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Received event network-vif-unplugged-bce4c127-622b-4001-a5df-94a04616b08e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:57:15.710270 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0bc8932e-6909-48c3-9fc3-7cb6119a7531 req-dc5a95af-4a33-46a7-be4d-d0879896dea0 service nova] Acquiring lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:15.710722 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0bc8932e-6909-48c3-9fc3-7cb6119a7531 req-dc5a95af-4a33-46a7-be4d-d0879896dea0 service nova] Lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:15.712104 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0bc8932e-6909-48c3-9fc3-7cb6119a7531 req-dc5a95af-4a33-46a7-be4d-d0879896dea0 service nova] Lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:15.712104 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0bc8932e-6909-48c3-9fc3-7cb6119a7531 req-dc5a95af-4a33-46a7-be4d-d0879896dea0 service nova] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] No waiting events found dispatching network-vif-unplugged-bce4c127-622b-4001-a5df-94a04616b08e {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:57:15.712104 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-0bc8932e-6909-48c3-9fc3-7cb6119a7531 req-dc5a95af-4a33-46a7-be4d-d0879896dea0 service nova] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Received unexpected event network-vif-unplugged-bce4c127-622b-4001-a5df-94a04616b08e for instance with vm_state active and task_state resize_migrating.
May 28 01:57:15.712473 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0bc8932e-6909-48c3-9fc3-7cb6119a7531 req-dc5a95af-4a33-46a7-be4d-d0879896dea0 service nova] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Received event network-vif-unplugged-bce4c127-622b-4001-a5df-94a04616b08e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:57:15.712473 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0bc8932e-6909-48c3-9fc3-7cb6119a7531 req-dc5a95af-4a33-46a7-be4d-d0879896dea0 service nova] Acquiring lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:15.712545 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0bc8932e-6909-48c3-9fc3-7cb6119a7531 req-dc5a95af-4a33-46a7-be4d-d0879896dea0 service nova] Lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:15.712688 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0bc8932e-6909-48c3-9fc3-7cb6119a7531 req-dc5a95af-4a33-46a7-be4d-d0879896dea0 service nova] Lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:15.712688 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:57:15.713014 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0bc8932e-6909-48c3-9fc3-7cb6119a7531 req-dc5a95af-4a33-46a7-be4d-d0879896dea0 service nova] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] No waiting events found dispatching network-vif-unplugged-bce4c127-622b-4001-a5df-94a04616b08e {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:57:15.713188 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-0bc8932e-6909-48c3-9fc3-7cb6119a7531 req-dc5a95af-4a33-46a7-be4d-d0879896dea0 service nova] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Received unexpected event network-vif-unplugged-bce4c127-622b-4001-a5df-94a04616b08e for instance with vm_state active and task_state resize_migrating.
May 28 01:57:15.713586 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:57:15.717784 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:57:15.732378 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:57:15.732378 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:57:15.747311 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:15.791757 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a, portal: 192.168.40.100,3260]
May 28 01:57:15.791757 np0000001583 nova-compute[98241]: Logout of [sid: 54, target: iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a, portal: 192.168.40.100,3260] successful.
May 28 01:57:15.791757 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:15.798153 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "1100d127-f3d6-416e-a646-b072660980bc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.328s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:15.813802 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:15.828374 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:15.830224 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-eee8df1c-20fa-4f20-8e75-3377bb367520 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:57:15.837205 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:57:15.841072 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933435.8406062, 1100d127-f3d6-416e-a646-b072660980bc => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:57:15.841072 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 1100d127-f3d6-416e-a646-b072660980bc] VM Resumed (Lifecycle Event)
May 28 01:57:15.865256 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a, portal: 192.168.50.100,3260]
May 28 01:57:15.865256 np0000001583 nova-compute[98241]: Logout of [sid: 55, target: iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a, portal: 192.168.50.100,3260] successful.
May 28 01:57:15.865256 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:15.885988 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:15.886259 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:57:15.886363 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] <== disconnect_volume: return (376ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:57:15.886475 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:57:15.890019 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] skipping disk /dev/dm-4 (vda) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:57:15.890405 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/12f40ca4-b4b3-43f4-8c0b-cb208f59935c_resize/disk.config /opt/stack/data/nova/instances/12f40ca4-b4b3-43f4-8c0b-cb208f59935c/disk.config {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:57:15.946112 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] CMD "cp -r /opt/stack/data/nova/instances/12f40ca4-b4b3-43f4-8c0b-cb208f59935c_resize/disk.config /opt/stack/data/nova/instances/12f40ca4-b4b3-43f4-8c0b-cb208f59935c/disk.config" returned: 0 in 0.055s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:57:16.014480 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Secret XML: <secret ephemeral="no" private="no">
May 28 01:57:16.014480 np0000001583 nova-compute[98241]:   <usage type="volume">
May 28 01:57:16.014480 np0000001583 nova-compute[98241]:     <volume>4eea4106-b0fc-4a86-9288-5bf9167cb805</volume>
May 28 01:57:16.014480 np0000001583 nova-compute[98241]:   </usage>
May 28 01:57:16.014480 np0000001583 nova-compute[98241]: </secret>
May 28 01:57:16.014480 np0000001583 nova-compute[98241]:  {{(pid=98241) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 28 01:57:16.103105 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Releasing lock "refresh_cache-7078fbb1-fa4a-4589-9f95-9d95dee381e0" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:57:16.258988 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-58955a65-3b11-4d65-98b3-a579daba3dc4 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.063s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:16.344116 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-eee8df1c-20fa-4f20-8e75-3377bb367520 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.731s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:16.346842 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:57:16.349715 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:57:16.427605 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-eee8df1c-20fa-4f20-8e75-3377bb367520 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Deleted allocations for instance 45a73c95-ff10-4b74-9ab8-4014a244a7d3
May 28 01:57:16.531128 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:56:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-952825136',display_name='tempest-TestVolumeBootPattern-server-952825136',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testvolumebootpattern-server-952825136',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='432aa1094ced436494def17a875aa8e1',ramdisk_id='',reservation_id='r-4sgy7b5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1031057169',owner_user_name='tempest-TestVolumeBootPattern-1031057169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:57:04Z,user_data=None,user_id='6be314b4eed642c3b2c72fe115860220',uuid=fbe845bb-c11e-4c97-85b8-4f3759e1bd22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51d1e24b-97cd-4966-b67c-17e8092be898", "address": "fa:16:3e:35:0c:91", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51d1e24b-97", "ovs_interfaceid": "51d1e24b-97cd-4966-b67c-17e8092be898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:57:16.531407 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converting VIF {"id": "51d1e24b-97cd-4966-b67c-17e8092be898", "address": "fa:16:3e:35:0c:91", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51d1e24b-97", "ovs_interfaceid": "51d1e24b-97cd-4966-b67c-17e8092be898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:57:16.532351 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:0c:91,bridge_name='br-int',has_traffic_filtering=True,id=51d1e24b-97cd-4966-b67c-17e8092be898,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51d1e24b-97') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:57:16.533844 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lazy-loading 'pci_devices' on Instance uuid fbe845bb-c11e-4c97-85b8-4f3759e1bd22 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:57:16.609993 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Creating tmpfile /opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0/tmpsggzuknn to verify with other compute node that the instance is on the same shared storage. {{(pid=98241) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:10552}}
May 28 01:57:16.610526 np0000001583 nova-compute[98241]: DEBUG nova.compute.rpcapi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98241) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 01:57:16.854057 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999708474000045 future=<Future at 0x7724ec1a9520 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:17.040538 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] End _get_guest_xml xml=<domain type="qemu">
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:   <uuid>fbe845bb-c11e-4c97-85b8-4f3759e1bd22</uuid>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:   <name>instance-00000019</name>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:       <nova:name>tempest-TestVolumeBootPattern-server-952825136</nova:name>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:57:06</nova:creationTime>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:       <nova:image uuid="">
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:         <nova:properties/>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:         <nova:user uuid="6be314b4eed642c3b2c72fe115860220">tempest-TestVolumeBootPattern-1031057169-project-member</nova:user>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:         <nova:project uuid="432aa1094ced436494def17a875aa8e1">tempest-TestVolumeBootPattern-1031057169</nova:project>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:       <nova:root type="volume" uuid=""/>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:         <nova:port uuid="51d1e24b-97cd-4966-b67c-17e8092be898">
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:     <system>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:       <entry name="serial">fbe845bb-c11e-4c97-85b8-4f3759e1bd22</entry>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:       <entry name="uuid">fbe845bb-c11e-4c97-85b8-4f3759e1bd22</entry>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:     </system>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:   <os>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:   </os>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:   <features>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:   </features>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:   <devices>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/fbe845bb-c11e-4c97-85b8-4f3759e1bd22/disk.config"/>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:     </disk>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:     <disk type="block" device="disk">
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:       <alias name="ua-4eea4106-b0fc-4a86-9288-5bf9167cb805"/>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:       <serial>4eea4106-b0fc-4a86-9288-5bf9167cb805</serial>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:       <encryption format="luks">
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:         <secret type="passphrase" uuid="c938bedf-7149-4b05-8c1b-da67123d7955"/>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:       </encryption>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:     </disk>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:35:0c:91"/>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:       <target dev="tap51d1e24b-97"/>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:     </interface>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/fbe845bb-c11e-4c97-85b8-4f3759e1bd22/console.log" append="off"/>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:     </serial>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:     <video>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:     </video>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:     </rng>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:   </devices>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]: </domain>
May 28 01:57:17.040538 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:57:17.042868 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Preparing to wait for external event network-vif-plugged-51d1e24b-97cd-4966-b67c-17e8092be898 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:57:17.042868 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "fbe845bb-c11e-4c97-85b8-4f3759e1bd22-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:17.042868 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "fbe845bb-c11e-4c97-85b8-4f3759e1bd22-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:17.042868 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "fbe845bb-c11e-4c97-85b8-4f3759e1bd22-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:17.042868 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:56:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-952825136',display_name='tempest-TestVolumeBootPattern-server-952825136',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testvolumebootpattern-server-952825136',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='432aa1094ced436494def17a875aa8e1',ramdisk_id='',reservation_id='r-4sgy7b5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1031057169',owner_user_name='tempest-TestVolumeBootPattern-1031057169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:57:04Z,user_data=None,user_id='6be314b4eed642c3b2c72fe115860220',uuid=fbe845bb-c11e-4c97-85b8-4f3759e1bd22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51d1e24b-97cd-4966-b67c-17e8092be898", "address": "fa:16:3e:35:0c:91", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51d1e24b-97", "ovs_interfaceid": "51d1e24b-97cd-4966-b67c-17e8092be898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:57:17.042868 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converting VIF {"id": "51d1e24b-97cd-4966-b67c-17e8092be898", "address": "fa:16:3e:35:0c:91", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51d1e24b-97", "ovs_interfaceid": "51d1e24b-97cd-4966-b67c-17e8092be898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:57:17.046377 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:0c:91,bridge_name='br-int',has_traffic_filtering=True,id=51d1e24b-97cd-4966-b67c-17e8092be898,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51d1e24b-97') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:57:17.046377 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:0c:91,bridge_name='br-int',has_traffic_filtering=True,id=51d1e24b-97cd-4966-b67c-17e8092be898,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51d1e24b-97') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:57:17.046684 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:17.047166 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:17.047499 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:57:17.051220 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:17.051382 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c6f37672-46de-5d0f-bc70-555374f055b1', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:17.052513 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:17.053148 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:57:17.054516 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:17.059490 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:17.059707 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51d1e24b-97, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:17.061547 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap51d1e24b-97, col_values=(('qos', UUID('83fe72c0-ec4f-4cc7-a431-33bcdebdb3d3')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:17.061547 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap51d1e24b-97, col_values=(('external_ids', {'iface-id': '51d1e24b-97cd-4966-b67c-17e8092be898', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:0c:91', 'vm-uuid': 'fbe845bb-c11e-4c97-85b8-4f3759e1bd22'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:17.061547 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:17.062463 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:57:17.069705 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:17.072091 np0000001583 nova-compute[98241]: INFO os_vif [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:0c:91,bridge_name='br-int',has_traffic_filtering=True,id=51d1e24b-97cd-4966-b67c-17e8092be898,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51d1e24b-97')
May 28 01:57:17.111069 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:17.111466 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:17.141252 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:17.146592 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:17.172655 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:17.176120 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:17.199498 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:17.202196 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Port bce4c127-622b-4001-a5df-94a04616b08e binding to destination host np0000001583 is already ACTIVE {{(pid=98241) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 28 01:57:17.211733 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:17.278615 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0ddfbe58-2a6e-44ec-8406-3b6a8e575930 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Acquiring lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:17.278865 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0ddfbe58-2a6e-44ec-8406-3b6a8e575930 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:17.279054 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0ddfbe58-2a6e-44ec-8406-3b6a8e575930 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Acquiring lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:17.279156 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0ddfbe58-2a6e-44ec-8406-3b6a8e575930 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:17.279275 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0ddfbe58-2a6e-44ec-8406-3b6a8e575930 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:17.281765 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-0ddfbe58-2a6e-44ec-8406-3b6a8e575930 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Terminating instance
May 28 01:57:17.344315 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-1115ced3-1906-47d4-87ae-ba45fb02400f req-6955f033-53c2-49ac-a060-f7bcfba85890 service nova] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Received event network-vif-unplugged-7567636b-7225-4025-b9f0-d4c8eb5abe43 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:57:17.344315 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-1115ced3-1906-47d4-87ae-ba45fb02400f req-6955f033-53c2-49ac-a060-f7bcfba85890 service nova] Acquiring lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:17.344502 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-1115ced3-1906-47d4-87ae-ba45fb02400f req-6955f033-53c2-49ac-a060-f7bcfba85890 service nova] Lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:17.344618 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-1115ced3-1906-47d4-87ae-ba45fb02400f req-6955f033-53c2-49ac-a060-f7bcfba85890 service nova] Lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:17.344721 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-1115ced3-1906-47d4-87ae-ba45fb02400f req-6955f033-53c2-49ac-a060-f7bcfba85890 service nova] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] No waiting events found dispatching network-vif-unplugged-7567636b-7225-4025-b9f0-d4c8eb5abe43 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:57:17.344875 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-1115ced3-1906-47d4-87ae-ba45fb02400f req-6955f033-53c2-49ac-a060-f7bcfba85890 service nova] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Received unexpected event network-vif-unplugged-7567636b-7225-4025-b9f0-d4c8eb5abe43 for instance with vm_state resized and task_state resize_reverting.
May 28 01:57:17.443854 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-eee8df1c-20fa-4f20-8e75-3377bb367520 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "45a73c95-ff10-4b74-9ab8-4014a244a7d3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.695s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:17.458768 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999725256999909 future=<Future at 0x7724ec1aa7b0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:17.461569 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Instance destroyed successfully.
May 28 01:57:17.462341 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lazy-loading 'resources' on Instance uuid 7078fbb1-fa4a-4589-9f95-9d95dee381e0 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:57:17.770995 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-8adad1cf-eb97-41d9-a333-c0b109a1781b req-e875c9b3-517c-4453-971f-459cf6a1321f service nova] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Received event network-changed-addc7428-573c-4e5e-bb8f-096648f17132 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:57:17.771291 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-8adad1cf-eb97-41d9-a333-c0b109a1781b req-e875c9b3-517c-4453-971f-459cf6a1321f service nova] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Refreshing instance network info cache due to event network-changed-addc7428-573c-4e5e-bb8f-096648f17132. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:57:17.771425 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-8adad1cf-eb97-41d9-a333-c0b109a1781b req-e875c9b3-517c-4453-971f-459cf6a1321f service nova] Acquiring lock "refresh_cache-1100d127-f3d6-416e-a646-b072660980bc" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:57:17.771501 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-8adad1cf-eb97-41d9-a333-c0b109a1781b req-e875c9b3-517c-4453-971f-459cf6a1321f service nova] Acquired lock "refresh_cache-1100d127-f3d6-416e-a646-b072660980bc" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:57:17.771617 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-8adad1cf-eb97-41d9-a333-c0b109a1781b req-e875c9b3-517c-4453-971f-459cf6a1321f service nova] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Refreshing network info cache for port addc7428-573c-4e5e-bb8f-096648f17132 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:57:17.787100 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-0ddfbe58-2a6e-44ec-8406-3b6a8e575930 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:57:17.818286 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:17.820401 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:17.837489 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:17.851241 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:17.875253 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:17.893846 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:17.955699 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-67cbfd3c-bcca-468c-a0bb-b349af40cd9f tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Acquiring lock "ea9459ae-6246-4d11-b46b-733449884b1b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:17.955854 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-67cbfd3c-bcca-468c-a0bb-b349af40cd9f tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "ea9459ae-6246-4d11-b46b-733449884b1b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:17.955987 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-67cbfd3c-bcca-468c-a0bb-b349af40cd9f tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Acquiring lock "ea9459ae-6246-4d11-b46b-733449884b1b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:17.956118 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-67cbfd3c-bcca-468c-a0bb-b349af40cd9f tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "ea9459ae-6246-4d11-b46b-733449884b1b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:17.956225 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-67cbfd3c-bcca-468c-a0bb-b349af40cd9f tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "ea9459ae-6246-4d11-b46b-733449884b1b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:17.960511 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-67cbfd3c-bcca-468c-a0bb-b349af40cd9f tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Terminating instance
May 28 01:57:17.968404 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:55:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1792038090',display_name='tempest-ServerActionsTestOtherB-server-1792038090',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001583',hostname='tempest-serveractionstestotherb-server-1792038090',id=21,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNeqI2aR1ssi4HNJOeFKCNjp+Pt+IJYlcdzP/eafAClJj6eROY4EAGFoc44ZS4UJO1qzGM7qaA7m9ha8h0zhGTrn53zFMwGuQ42KOAfa++4mKlE3DbzUB8ddEdTJR9n/hA==',key_name='tempest-keypair-738336147',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:57:12Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=Flavor(12),node='np0000001583',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2db0b9fa3fcc47408dad261c2004e4a5',ramdisk_id='',reservation_id='r-aqj2v230',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-640844130',owner_user_name='tempest-ServerActionsTestOtherB-640844130-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:57:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f68ae604d0442439a927020cec740c0',uuid=7078fbb1-fa4a-4589-9f95-9d95dee381e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "address": "fa:16:3e:30:bd:e8", "network": {"id": "11b2c699-14f1-4eba-bbe6-b7655c6f17cc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1044342879-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2db0b9fa3fcc47408dad261c2004e4a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7567636b-72", "ovs_interfaceid": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:57:17.968599 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Converting VIF {"id": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "address": "fa:16:3e:30:bd:e8", "network": {"id": "11b2c699-14f1-4eba-bbe6-b7655c6f17cc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1044342879-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2db0b9fa3fcc47408dad261c2004e4a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7567636b-72", "ovs_interfaceid": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:57:17.970973 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:bd:e8,bridge_name='br-int',has_traffic_filtering=True,id=7567636b-7225-4025-b9f0-d4c8eb5abe43,network=Network(11b2c699-14f1-4eba-bbe6-b7655c6f17cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7567636b-72') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:57:17.971369 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:bd:e8,bridge_name='br-int',has_traffic_filtering=True,id=7567636b-7225-4025-b9f0-d4c8eb5abe43,network=Network(11b2c699-14f1-4eba-bbe6-b7655c6f17cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7567636b-72') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:57:17.972692 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:17.974535 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7567636b-72, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:17.982584 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:17.984211 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:57:17.995909 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:17.997067 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:17.997370 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d881634d-4f82-4cbf-a760-2fa641398d03) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:17.997951 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:18.001135 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:57:18.009191 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:18.012153 np0000001583 nova-compute[98241]: INFO os_vif [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:bd:e8,bridge_name='br-int',has_traffic_filtering=True,id=7567636b-7225-4025-b9f0-d4c8eb5abe43,network=Network(11b2c699-14f1-4eba-bbe6-b7655c6f17cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7567636b-72')
May 28 01:57:18.012830 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:57:18.013182 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:57:18.013347 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:57:18.014067 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:57:18.014067 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:57:18.014346 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:57:18.048438 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:57:18.048438 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:57:18.048438 np0000001583 nova-compute[98241]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:57:18.048438 np0000001583 nova-compute[98241]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:57:18.048438 np0000001583 nova-compute[98241]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805 (non-flash)
May 28 01:57:18.048438 np0000001583 nova-compute[98241]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805 (non-flash)
May 28 01:57:18.048438 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:57:18.048739 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsi session list stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:57:18.048739 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:57:18.048739 np0000001583 nova-compute[98241]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:57:18.048739 np0000001583 nova-compute[98241]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:57:18.048739 np0000001583 nova-compute[98241]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805 (non-flash)
May 28 01:57:18.048739 np0000001583 nova-compute[98241]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805 (non-flash)
May 28 01:57:18.048739 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:57:18.048884 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', '56'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', '57'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805', '58'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805', '59')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:57:18.048884 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', '57')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:57:18.049722 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', '56')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:57:18.050651 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f81549a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2'): ({'sdb'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:57:18.050870 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Removing multipathed devices sdc, sdb {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:57:18.051088 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Flush multipath device 3300000002607d8cf {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:57:18.055736 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:18.087997 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:57:18.137092 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999721347999866 future=<Future at 0x7724f82ef7d0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:18.140590 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Instance destroyed successfully.
May 28 01:57:18.141024 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-0ddfbe58-2a6e-44ec-8406-3b6a8e575930 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lazy-loading 'resources' on Instance uuid 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:57:18.144885 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:57:18.199302 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:57:18.199535 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:57:18.200687 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:57:18.211153 np0000001583 nova-compute[98241]: DEBUG nova.compute.rpcapi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98241) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 01:57:18.219712 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:57:18.219712 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:57:18.226459 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:18.226605 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:18.226770 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:18.236923 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:18.273317 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-8adad1cf-eb97-41d9-a333-c0b109a1781b req-e875c9b3-517c-4453-971f-459cf6a1321f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:18.279401 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2, portal: 192.168.40.100,3260]
May 28 01:57:18.279401 np0000001583 nova-compute[98241]: Logout of [sid: 57, target: iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2, portal: 192.168.40.100,3260] successful.
May 28 01:57:18.279401 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:18.296504 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:18.311436 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:18.350549 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2, portal: 192.168.50.100,3260]
May 28 01:57:18.350549 np0000001583 nova-compute[98241]: Logout of [sid: 56, target: iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2, portal: 192.168.50.100,3260] successful.
May 28 01:57:18.350549 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:18.366701 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:18.366993 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:57:18.367193 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] <== disconnect_volume: return (353ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:57:18.367363 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:57:18.454550 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "533f5dcc-2e48-4280-84b3-facb02dea136" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:18.454767 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "533f5dcc-2e48-4280-84b3-facb02dea136" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:18.455122 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "533f5dcc-2e48-4280-84b3-facb02dea136-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:18.455320 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "533f5dcc-2e48-4280-84b3-facb02dea136-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:18.455504 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "533f5dcc-2e48-4280-84b3-facb02dea136-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:18.461312 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Terminating instance
May 28 01:57:18.463826 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-67cbfd3c-bcca-468c-a0bb-b349af40cd9f tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:57:18.495825 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:18.519472 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:18.521503 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:18.542726 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:18.555939 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:18.596219 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:57:18.596414 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:57:18.596552 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] No VIF found with MAC fa:16:3e:35:0c:91, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:57:18.596940 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Using config drive
May 28 01:57:18.626175 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-8adad1cf-eb97-41d9-a333-c0b109a1781b req-e875c9b3-517c-4453-971f-459cf6a1321f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:18.645024 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-0ddfbe58-2a6e-44ec-8406-3b6a8e575930 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:54:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2789214',display_name='tempest-ServerStableDeviceRescueTest-server-2789214',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-serverstabledevicerescuetest-server-2789214',id=19,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN0i9Cbg/YfGFJTMA6Mjy+1949HN9zlsGRESiP6RbbKnMnzjD65aO38IDSCgwyQVXHEZs/nSr/IWCD0NrFHvkF+28T0YYBxOg7wkJVfd52pVGPBaDLMkFt5gcpkneL3l6g==',key_name='tempest-keypair-109338498',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:56:31Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='261e17e4ed4445c887b71a705d46ad7d',ramdisk_id='',reservation_id='r-6j08k7e9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1096447838',owner_user_name='tempest-ServerStableDeviceRescueTest-1096447838-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:56:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b95b9664bbd944d3a55a061e1ec231ec',uuid=8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f242e691-1d28-43e0-b83a-2414c00958b8", "address": "fa:16:3e:5c:c2:5f", "network": {"id": "b31b6f30-3b80-465d-8203-e6f4c16c758c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1195490498-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "261e17e4ed4445c887b71a705d46ad7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf242e691-1d", "ovs_interfaceid": "f242e691-1d28-43e0-b83a-2414c00958b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:57:18.645340 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-0ddfbe58-2a6e-44ec-8406-3b6a8e575930 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Converting VIF {"id": "f242e691-1d28-43e0-b83a-2414c00958b8", "address": "fa:16:3e:5c:c2:5f", "network": {"id": "b31b6f30-3b80-465d-8203-e6f4c16c758c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1195490498-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "261e17e4ed4445c887b71a705d46ad7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf242e691-1d", "ovs_interfaceid": "f242e691-1d28-43e0-b83a-2414c00958b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:57:18.645788 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-0ddfbe58-2a6e-44ec-8406-3b6a8e575930 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:c2:5f,bridge_name='br-int',has_traffic_filtering=True,id=f242e691-1d28-43e0-b83a-2414c00958b8,network=Network(b31b6f30-3b80-465d-8203-e6f4c16c758c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf242e691-1d') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:57:18.646032 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-0ddfbe58-2a6e-44ec-8406-3b6a8e575930 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:c2:5f,bridge_name='br-int',has_traffic_filtering=True,id=f242e691-1d28-43e0-b83a-2414c00958b8,network=Network(b31b6f30-3b80-465d-8203-e6f4c16c758c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf242e691-1d') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:57:18.647282 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:18.647524 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf242e691-1d, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:18.652261 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:18.653231 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:57:18.661738 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:18.663266 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:18.663454 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=22b2c1ed-be91-4835-a9cb-60c436e1070a) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:18.665066 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:18.665066 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:57:18.677460 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:18.680469 np0000001583 nova-compute[98241]: INFO os_vif [None req-0ddfbe58-2a6e-44ec-8406-3b6a8e575930 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:c2:5f,bridge_name='br-int',has_traffic_filtering=True,id=f242e691-1d28-43e0-b83a-2414c00958b8,network=Network(b31b6f30-3b80-465d-8203-e6f4c16c758c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf242e691-1d')
May 28 01:57:18.680469 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-0ddfbe58-2a6e-44ec-8406-3b6a8e575930 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Deleting instance files /opt/stack/data/nova/instances/8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4_del
May 28 01:57:18.681313 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-0ddfbe58-2a6e-44ec-8406-3b6a8e575930 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Deletion of /opt/stack/data/nova/instances/8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4_del complete
May 28 01:57:18.798587 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-8adad1cf-eb97-41d9-a333-c0b109a1781b req-e875c9b3-517c-4453-971f-459cf6a1321f service nova] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Updated VIF entry in instance network info cache for port addc7428-573c-4e5e-bb8f-096648f17132. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:57:18.799380 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999514754999836 future=<Future at 0x7724f82ee930 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:18.800277 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-8adad1cf-eb97-41d9-a333-c0b109a1781b req-e875c9b3-517c-4453-971f-459cf6a1321f service nova] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Updating instance_info_cache with network_info: [{"id": "addc7428-573c-4e5e-bb8f-096648f17132", "address": "fa:16:3e:92:e2:5b", "network": {"id": "62e7cc38-1758-4b09-a352-4635adc9cfea", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587967507-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "837663bcfa40402aaf583729dfbb26cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaddc7428-57", "ovs_interfaceid": "addc7428-573c-4e5e-bb8f-096648f17132", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:57:18.802585 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Instance destroyed successfully.
May 28 01:57:18.803008 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-67cbfd3c-bcca-468c-a0bb-b349af40cd9f tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lazy-loading 'resources' on Instance uuid ea9459ae-6246-4d11-b46b-733449884b1b {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:57:18.967004 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:57:18.994544 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:18.999420 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:19.029834 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:19.103186 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:19.137652 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:19.150468 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:19.188666 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-0ddfbe58-2a6e-44ec-8406-3b6a8e575930 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Took 1.40 seconds to destroy the instance on the hypervisor.
May 28 01:57:19.189462 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-0ddfbe58-2a6e-44ec-8406-3b6a8e575930 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:57:19.190254 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:57:19.190254 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:57:19.190254 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:19.241928 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:19.268827 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Creating config drive at /opt/stack/data/nova/instances/fbe845bb-c11e-4c97-85b8-4f3759e1bd22/disk.config
May 28 01:57:19.276703 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999713323000151 future=<Future at 0x7724ec34dac0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:19.277787 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/fbe845bb-c11e-4c97-85b8-4f3759e1bd22/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpo57qqad8 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:57:19.297608 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Instance destroyed successfully.
May 28 01:57:19.299743 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lazy-loading 'resources' on Instance uuid 533f5dcc-2e48-4280-84b3-facb02dea136 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:57:19.305525 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-8adad1cf-eb97-41d9-a333-c0b109a1781b req-e875c9b3-517c-4453-971f-459cf6a1321f service nova] Releasing lock "refresh_cache-1100d127-f3d6-416e-a646-b072660980bc" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:57:19.308737 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-67cbfd3c-bcca-468c-a0bb-b349af40cd9f tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T01:55:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-350641025',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-attachvolumeshelvetestjson-server-350641025',id=20,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyywg/GU3kMhR5XnRO3S4+qKLGn1IVmNweRmYbKjC4mG7Y3B4b1iJuav/MjMhmEg1Ch1VSJDXtwStt6yHLEcJuMrGjLfMiMuk2bmjq4ldTwnSZW8eUZkuwRr6oFssFUKg==',key_name='tempest-keypair-950315920',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:56:39Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d31342458ec4ed2890a766f62facbcf',ramdisk_id='',reservation_id='r-lmutfe3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1906404591',owner_user_name='tempest-AttachVolumeShelveTestJSON-1906404591-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:56:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='312a198f7d3d4ce9b586d8f36cf58f76',uuid=ea9459ae-6246-4d11-b46b-733449884b1b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2bb36d37-52de-4dcf-abb4-35b15f363457", "address": "fa:16:3e:86:7e:a1", "network": {"id": "34ab0ff0-75dd-45e7-97f6-22f8e62a8149", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1222751470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d31342458ec4ed2890a766f62facbcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb36d37-52", "ovs_interfaceid": "2bb36d37-52de-4dcf-abb4-35b15f363457", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:57:19.310461 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-67cbfd3c-bcca-468c-a0bb-b349af40cd9f tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Converting VIF {"id": "2bb36d37-52de-4dcf-abb4-35b15f363457", "address": "fa:16:3e:86:7e:a1", "network": {"id": "34ab0ff0-75dd-45e7-97f6-22f8e62a8149", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1222751470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d31342458ec4ed2890a766f62facbcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb36d37-52", "ovs_interfaceid": "2bb36d37-52de-4dcf-abb4-35b15f363457", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:57:19.311382 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-67cbfd3c-bcca-468c-a0bb-b349af40cd9f tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:7e:a1,bridge_name='br-int',has_traffic_filtering=True,id=2bb36d37-52de-4dcf-abb4-35b15f363457,network=Network(34ab0ff0-75dd-45e7-97f6-22f8e62a8149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bb36d37-52') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:57:19.311683 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-67cbfd3c-bcca-468c-a0bb-b349af40cd9f tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:7e:a1,bridge_name='br-int',has_traffic_filtering=True,id=2bb36d37-52de-4dcf-abb4-35b15f363457,network=Network(34ab0ff0-75dd-45e7-97f6-22f8e62a8149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bb36d37-52') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:57:19.313594 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:19.314429 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2bb36d37-52, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:19.316675 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:19.317570 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:57:19.326400 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:19.327503 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:19.327719 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e922b9e7-2491-45bb-a0b6-b72c09973134) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:19.328667 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:19.329225 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:57:19.339360 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:19.342562 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:19.343723 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/fbe845bb-c11e-4c97-85b8-4f3759e1bd22/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpo57qqad8" returned: 0 in 0.066s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:57:19.346793 np0000001583 nova-compute[98241]: INFO os_vif [None req-67cbfd3c-bcca-468c-a0bb-b349af40cd9f tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:7e:a1,bridge_name='br-int',has_traffic_filtering=True,id=2bb36d37-52de-4dcf-abb4-35b15f363457,network=Network(34ab0ff0-75dd-45e7-97f6-22f8e62a8149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bb36d37-52')
May 28 01:57:19.347361 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-67cbfd3c-bcca-468c-a0bb-b349af40cd9f tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Deleting instance files /opt/stack/data/nova/instances/ea9459ae-6246-4d11-b46b-733449884b1b_del
May 28 01:57:19.354415 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-67cbfd3c-bcca-468c-a0bb-b349af40cd9f tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Deletion of /opt/stack/data/nova/instances/ea9459ae-6246-4d11-b46b-733449884b1b_del complete
May 28 01:57:19.367338 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "refresh_cache-12f40ca4-b4b3-43f4-8c0b-cb208f59935c" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:57:19.367504 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquired lock "refresh_cache-12f40ca4-b4b3-43f4-8c0b-cb208f59935c" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:57:19.367718 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:57:19.506833 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:19.507233 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:19.593163 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-89c9a47b-6e4f-45b5-bc37-3acc9a906b20 req-1e3769fd-b353-4fa2-848f-402fddfadb2d service nova] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Received event network-vif-unplugged-7567636b-7225-4025-b9f0-d4c8eb5abe43 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:57:19.599432 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-89c9a47b-6e4f-45b5-bc37-3acc9a906b20 req-1e3769fd-b353-4fa2-848f-402fddfadb2d service nova] Acquiring lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:19.601138 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-89c9a47b-6e4f-45b5-bc37-3acc9a906b20 req-1e3769fd-b353-4fa2-848f-402fddfadb2d service nova] Lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:19.601138 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-89c9a47b-6e4f-45b5-bc37-3acc9a906b20 req-1e3769fd-b353-4fa2-848f-402fddfadb2d service nova] Lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:19.601138 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-89c9a47b-6e4f-45b5-bc37-3acc9a906b20 req-1e3769fd-b353-4fa2-848f-402fddfadb2d service nova] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] No waiting events found dispatching network-vif-unplugged-7567636b-7225-4025-b9f0-d4c8eb5abe43 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:57:19.601138 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-89c9a47b-6e4f-45b5-bc37-3acc9a906b20 req-1e3769fd-b353-4fa2-848f-402fddfadb2d service nova] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Received unexpected event network-vif-unplugged-7567636b-7225-4025-b9f0-d4c8eb5abe43 for instance with vm_state resized and task_state resize_reverting.
May 28 01:57:19.601138 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-89c9a47b-6e4f-45b5-bc37-3acc9a906b20 req-1e3769fd-b353-4fa2-848f-402fddfadb2d service nova] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Received event network-vif-unplugged-b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:57:19.601138 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-89c9a47b-6e4f-45b5-bc37-3acc9a906b20 req-1e3769fd-b353-4fa2-848f-402fddfadb2d service nova] Acquiring lock "533f5dcc-2e48-4280-84b3-facb02dea136-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:19.601657 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-89c9a47b-6e4f-45b5-bc37-3acc9a906b20 req-1e3769fd-b353-4fa2-848f-402fddfadb2d service nova] Lock "533f5dcc-2e48-4280-84b3-facb02dea136-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:19.601657 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-89c9a47b-6e4f-45b5-bc37-3acc9a906b20 req-1e3769fd-b353-4fa2-848f-402fddfadb2d service nova] Lock "533f5dcc-2e48-4280-84b3-facb02dea136-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:19.601657 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-89c9a47b-6e4f-45b5-bc37-3acc9a906b20 req-1e3769fd-b353-4fa2-848f-402fddfadb2d service nova] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] No waiting events found dispatching network-vif-unplugged-b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:57:19.601657 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-89c9a47b-6e4f-45b5-bc37-3acc9a906b20 req-1e3769fd-b353-4fa2-848f-402fddfadb2d service nova] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Received event network-vif-unplugged-b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:57:19.601834 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-89c9a47b-6e4f-45b5-bc37-3acc9a906b20 req-1e3769fd-b353-4fa2-848f-402fddfadb2d service nova] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Received event network-vif-unplugged-b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:57:19.601877 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-89c9a47b-6e4f-45b5-bc37-3acc9a906b20 req-1e3769fd-b353-4fa2-848f-402fddfadb2d service nova] Acquiring lock "533f5dcc-2e48-4280-84b3-facb02dea136-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:19.602023 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-89c9a47b-6e4f-45b5-bc37-3acc9a906b20 req-1e3769fd-b353-4fa2-848f-402fddfadb2d service nova] Lock "533f5dcc-2e48-4280-84b3-facb02dea136-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:19.602190 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-89c9a47b-6e4f-45b5-bc37-3acc9a906b20 req-1e3769fd-b353-4fa2-848f-402fddfadb2d service nova] Lock "533f5dcc-2e48-4280-84b3-facb02dea136-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:19.602292 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-89c9a47b-6e4f-45b5-bc37-3acc9a906b20 req-1e3769fd-b353-4fa2-848f-402fddfadb2d service nova] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] No waiting events found dispatching network-vif-unplugged-b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:57:19.602427 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-89c9a47b-6e4f-45b5-bc37-3acc9a906b20 req-1e3769fd-b353-4fa2-848f-402fddfadb2d service nova] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Received event network-vif-unplugged-b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:57:19.811108 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:54:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-516014259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-serverbootfromvolumestablerescuetest-server-516014259',id=18,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:55:40Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ba381dad8364a488a98b80c04cce8fb',ramdisk_id='',reservation_id='r-uj4jvzn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1211567633',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:55:46Z,user_data=None,user_id='c3a7b14e31ee40cf9e4f4bba084ccaa5',uuid=533f5dcc-2e48-4280-84b3-facb02dea136,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e", "address": "fa:16:3e:e1:01:d3", "network": {"id": "2ee43c4e-569f-4726-9700-add40d768203", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ba381dad8364a488a98b80c04cce8fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bf1e5b-d3", "ovs_interfaceid": "b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:57:19.811364 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Converting VIF {"id": "b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e", "address": "fa:16:3e:e1:01:d3", "network": {"id": "2ee43c4e-569f-4726-9700-add40d768203", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ba381dad8364a488a98b80c04cce8fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bf1e5b-d3", "ovs_interfaceid": "b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:57:19.812018 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:01:d3,bridge_name='br-int',has_traffic_filtering=True,id=b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e,network=Network(2ee43c4e-569f-4726-9700-add40d768203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3bf1e5b-d3') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:57:19.813052 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:01:d3,bridge_name='br-int',has_traffic_filtering=True,id=b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e,network=Network(2ee43c4e-569f-4726-9700-add40d768203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3bf1e5b-d3') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:57:19.815015 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:19.815015 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3bf1e5b-d3, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:19.816594 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:19.816594 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:57:19.823057 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:19.823987 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:19.823987 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=356db3e4-b569-46c1-b77b-e1aa672f0f01) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:19.825191 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:19.825885 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:57:19.832179 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:19.834101 np0000001583 nova-compute[98241]: INFO os_vif [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:01:d3,bridge_name='br-int',has_traffic_filtering=True,id=b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e,network=Network(2ee43c4e-569f-4726-9700-add40d768203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3bf1e5b-d3')
May 28 01:57:19.839088 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:57:19.839626 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797', 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fab00939-514d-46f8-a4d7-5a7c78e44797', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:57:19.839837 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:57:19.840370 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:57:19.840797 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797', 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fab00939-514d-46f8-a4d7-5a7c78e44797', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:57:19.841036 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:57:19.866982 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:19.870165 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:19.880102 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-67cbfd3c-bcca-468c-a0bb-b349af40cd9f tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Took 1.42 seconds to destroy the instance on the hypervisor.
May 28 01:57:19.880999 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-67cbfd3c-bcca-468c-a0bb-b349af40cd9f tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:57:19.881805 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:57:19.881805 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:57:19.882234 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:19.884797 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:57:19.884797 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:57:19.884797 np0000001583 nova-compute[98241]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805 (non-flash)
May 28 01:57:19.884797 np0000001583 nova-compute[98241]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805 (non-flash)
May 28 01:57:19.884797 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:57:19.884797 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsi session list stdout=tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:57:19.884797 np0000001583 nova-compute[98241]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797 (non-flash)
May 28 01:57:19.884797 np0000001583 nova-compute[98241]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805 (non-flash)
May 28 01:57:19.884797 np0000001583 nova-compute[98241]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805 (non-flash)
May 28 01:57:19.884797 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:57:19.884797 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797', '39'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805', '58'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805', '59')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:57:19.884797 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797', '39')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:57:19.888130 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797', '38')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:57:19.888831 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f829c4a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797'): ({'sdh'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:57:19.889148 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Removing multipathed devices sdh, sdi {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:57:19.889487 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Flush multipath device 330000000386efa88 {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:57:19.898608 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:19.914320 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ec3ac82a-91ac-4f75-9438-ad9b53717e1a req-cbe5a4bd-cf50-4888-86bf-bf830cf66d5d service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Received event network-vif-unplugged-f242e691-1d28-43e0-b83a-2414c00958b8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:57:19.914320 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ec3ac82a-91ac-4f75-9438-ad9b53717e1a req-cbe5a4bd-cf50-4888-86bf-bf830cf66d5d service nova] Acquiring lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:19.914459 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ec3ac82a-91ac-4f75-9438-ad9b53717e1a req-cbe5a4bd-cf50-4888-86bf-bf830cf66d5d service nova] Lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:19.914663 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ec3ac82a-91ac-4f75-9438-ad9b53717e1a req-cbe5a4bd-cf50-4888-86bf-bf830cf66d5d service nova] Lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:19.915020 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ec3ac82a-91ac-4f75-9438-ad9b53717e1a req-cbe5a4bd-cf50-4888-86bf-bf830cf66d5d service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] No waiting events found dispatching network-vif-unplugged-f242e691-1d28-43e0-b83a-2414c00958b8 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:57:19.915221 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ec3ac82a-91ac-4f75-9438-ad9b53717e1a req-cbe5a4bd-cf50-4888-86bf-bf830cf66d5d service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Received event network-vif-unplugged-f242e691-1d28-43e0-b83a-2414c00958b8 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:57:19.915404 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ec3ac82a-91ac-4f75-9438-ad9b53717e1a req-cbe5a4bd-cf50-4888-86bf-bf830cf66d5d service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Received event network-vif-unplugged-f242e691-1d28-43e0-b83a-2414c00958b8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:57:19.915561 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ec3ac82a-91ac-4f75-9438-ad9b53717e1a req-cbe5a4bd-cf50-4888-86bf-bf830cf66d5d service nova] Acquiring lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:19.915729 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ec3ac82a-91ac-4f75-9438-ad9b53717e1a req-cbe5a4bd-cf50-4888-86bf-bf830cf66d5d service nova] Lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:19.915847 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ec3ac82a-91ac-4f75-9438-ad9b53717e1a req-cbe5a4bd-cf50-4888-86bf-bf830cf66d5d service nova] Lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:19.915995 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ec3ac82a-91ac-4f75-9438-ad9b53717e1a req-cbe5a4bd-cf50-4888-86bf-bf830cf66d5d service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] No waiting events found dispatching network-vif-unplugged-f242e691-1d28-43e0-b83a-2414c00958b8 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:57:19.916117 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ec3ac82a-91ac-4f75-9438-ad9b53717e1a req-cbe5a4bd-cf50-4888-86bf-bf830cf66d5d service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Received event network-vif-unplugged-f242e691-1d28-43e0-b83a-2414c00958b8 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:57:19.916219 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ec3ac82a-91ac-4f75-9438-ad9b53717e1a req-cbe5a4bd-cf50-4888-86bf-bf830cf66d5d service nova] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Received event network-vif-unplugged-2bb36d37-52de-4dcf-abb4-35b15f363457 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:57:19.916330 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ec3ac82a-91ac-4f75-9438-ad9b53717e1a req-cbe5a4bd-cf50-4888-86bf-bf830cf66d5d service nova] Acquiring lock "ea9459ae-6246-4d11-b46b-733449884b1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:19.916466 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ec3ac82a-91ac-4f75-9438-ad9b53717e1a req-cbe5a4bd-cf50-4888-86bf-bf830cf66d5d service nova] Lock "ea9459ae-6246-4d11-b46b-733449884b1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:19.916604 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ec3ac82a-91ac-4f75-9438-ad9b53717e1a req-cbe5a4bd-cf50-4888-86bf-bf830cf66d5d service nova] Lock "ea9459ae-6246-4d11-b46b-733449884b1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:19.916810 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ec3ac82a-91ac-4f75-9438-ad9b53717e1a req-cbe5a4bd-cf50-4888-86bf-bf830cf66d5d service nova] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] No waiting events found dispatching network-vif-unplugged-2bb36d37-52de-4dcf-abb4-35b15f363457 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:57:19.916981 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ec3ac82a-91ac-4f75-9438-ad9b53717e1a req-cbe5a4bd-cf50-4888-86bf-bf830cf66d5d service nova] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Received event network-vif-unplugged-2bb36d37-52de-4dcf-abb4-35b15f363457 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:57:19.917190 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ec3ac82a-91ac-4f75-9438-ad9b53717e1a req-cbe5a4bd-cf50-4888-86bf-bf830cf66d5d service nova] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Received event network-vif-unplugged-2bb36d37-52de-4dcf-abb4-35b15f363457 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:57:19.917310 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ec3ac82a-91ac-4f75-9438-ad9b53717e1a req-cbe5a4bd-cf50-4888-86bf-bf830cf66d5d service nova] Acquiring lock "ea9459ae-6246-4d11-b46b-733449884b1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:19.917663 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ec3ac82a-91ac-4f75-9438-ad9b53717e1a req-cbe5a4bd-cf50-4888-86bf-bf830cf66d5d service nova] Lock "ea9459ae-6246-4d11-b46b-733449884b1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:19.917663 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ec3ac82a-91ac-4f75-9438-ad9b53717e1a req-cbe5a4bd-cf50-4888-86bf-bf830cf66d5d service nova] Lock "ea9459ae-6246-4d11-b46b-733449884b1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:19.917663 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ec3ac82a-91ac-4f75-9438-ad9b53717e1a req-cbe5a4bd-cf50-4888-86bf-bf830cf66d5d service nova] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] No waiting events found dispatching network-vif-unplugged-2bb36d37-52de-4dcf-abb4-35b15f363457 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:57:19.917763 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ec3ac82a-91ac-4f75-9438-ad9b53717e1a req-cbe5a4bd-cf50-4888-86bf-bf830cf66d5d service nova] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Received event network-vif-unplugged-2bb36d37-52de-4dcf-abb4-35b15f363457 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:57:19.927661 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:57:19.984986 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:57:20.012953 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lazy-loading 'migration_context' on Instance uuid 7078fbb1-fa4a-4589-9f95-9d95dee381e0 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:57:20.017427 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:20.066378 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:57:20.068666 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:57:20.070105 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:20.073179 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:57:20.086856 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0006262970000534551 future=<Future at 0x7724ec1f1ee0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:20.086952 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:20.087127 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=6.516888867999796 future=<Future at 0x7724f847dc10 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:20.087253 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=6.516742288999922 future=<Future at 0x7724f847dc10 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:20.093106 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Emitting event <LifecycleEvent: 1779933425.0860507, e4fd6c94-b2c8-4d2b-b89b-c715a30c1884 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:57:20.093106 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] VM Stopped (Lifecycle Event)
May 28 01:57:20.093490 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:57:20.093537 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:57:20.112091 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:20.146279 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797, portal: 192.168.40.100,3260]
May 28 01:57:20.146279 np0000001583 nova-compute[98241]: Logout of [sid: 39, target: iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797, portal: 192.168.40.100,3260] successful.
May 28 01:57:20.146279 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:20.165253 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:20.182169 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:20.199951 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f42c8a5e-29bc-4540-8e6f-f10c5799f993 req-0d0b1648-6512-4087-a3d4-cc4a481a4bb7 service nova] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Received event network-vif-plugged-51d1e24b-97cd-4966-b67c-17e8092be898 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:57:20.200123 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f42c8a5e-29bc-4540-8e6f-f10c5799f993 req-0d0b1648-6512-4087-a3d4-cc4a481a4bb7 service nova] Acquiring lock "fbe845bb-c11e-4c97-85b8-4f3759e1bd22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:20.201108 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f42c8a5e-29bc-4540-8e6f-f10c5799f993 req-0d0b1648-6512-4087-a3d4-cc4a481a4bb7 service nova] Lock "fbe845bb-c11e-4c97-85b8-4f3759e1bd22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:20.201108 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f42c8a5e-29bc-4540-8e6f-f10c5799f993 req-0d0b1648-6512-4087-a3d4-cc4a481a4bb7 service nova] Lock "fbe845bb-c11e-4c97-85b8-4f3759e1bd22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:20.201108 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f42c8a5e-29bc-4540-8e6f-f10c5799f993 req-0d0b1648-6512-4087-a3d4-cc4a481a4bb7 service nova] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Processing event network-vif-plugged-51d1e24b-97cd-4966-b67c-17e8092be898 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:57:20.223696 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797, portal: 192.168.50.100,3260]
May 28 01:57:20.223696 np0000001583 nova-compute[98241]: Logout of [sid: 38, target: iqn.2023-03.storpool.com:os--volume-fab00939-514d-46f8-a4d7-5a7c78e44797, portal: 192.168.50.100,3260] successful.
May 28 01:57:20.223696 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:20.241343 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:20.242118 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.401s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:57:20.242118 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] <== disconnect_volume: return (402ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:57:20.242118 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:57:20.242364 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Deleting instance files /opt/stack/data/nova/instances/533f5dcc-2e48-4280-84b3-facb02dea136_del
May 28 01:57:20.243198 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Deletion of /opt/stack/data/nova/instances/533f5dcc-2e48-4280-84b3-facb02dea136_del complete
May 28 01:57:20.303955 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:20.307390 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:20.313666 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:20.342608 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:20.416251 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:57:20.436959 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:20.521909 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Object Instance<7078fbb1-fa4a-4589-9f95-9d95dee381e0> lazy-loaded attributes: resources,migration_context {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:57:20.595715 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-2b9bfaee-b77c-4e06-a6d5-616b7f189a93 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: e4fd6c94-b2c8-4d2b-b89b-c715a30c1884] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:57:20.638222 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Updating instance_info_cache with network_info: [{"id": "bce4c127-622b-4001-a5df-94a04616b08e", "address": "fa:16:3e:b1:89:97", "network": {"id": "b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-280876007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60fbdf5ed38b4dc485a81c49b3303ed2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbce4c127-62", "ovs_interfaceid": "bce4c127-622b-4001-a5df-94a04616b08e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:57:20.765984 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Took 1.80 seconds to destroy the instance on the hypervisor.
May 28 01:57:20.766724 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:57:20.767161 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:57:20.767389 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:57:20.767787 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:20.875567 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:20.917833 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Took 1.73 seconds to deallocate network for instance.
May 28 01:57:21.141483 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:57:21.145985 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Releasing lock "refresh_cache-12f40ca4-b4b3-43f4-8c0b-cb208f59935c" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:57:21.196176 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:57:21.196447 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:57:21.430781 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0ddfbe58-2a6e-44ec-8406-3b6a8e575930 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:21.651505 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:57:21.653470 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Took 1.77 seconds to deallocate network for instance.
May 28 01:57:21.660001 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a721ba77-0328-4f03-89ff-5d1c6a24381d req-eda8d041-ab17-4703-b122-e0c2f2ff8e91 service nova] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Received event network-vif-deleted-2bb36d37-52de-4dcf-abb4-35b15f363457 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:57:21.660314 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a721ba77-0328-4f03-89ff-5d1c6a24381d req-eda8d041-ab17-4703-b122-e0c2f2ff8e91 service nova] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Received event network-vif-deleted-b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:57:21.663740 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-a721ba77-0328-4f03-89ff-5d1c6a24381d req-eda8d041-ab17-4703-b122-e0c2f2ff8e91 service nova] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Neutron deleted interface b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e; detaching it from the instance and deleting it from the info cache
May 28 01:57:21.667099 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a721ba77-0328-4f03-89ff-5d1c6a24381d req-eda8d041-ab17-4703-b122-e0c2f2ff8e91 service nova] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Detach interface failed, port_id=b3bf1e5b-d3e6-43f2-8048-5c5a1881fa4e, reason: Instance 533f5dcc-2e48-4280-84b3-facb02dea136 could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:57:21.678795 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:57:21.691679 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:57:21.700697 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:57:21.722371 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:57:21.759497 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:57:21.760740 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:57:21.763138 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933441.7626855, fbe845bb-c11e-4c97-85b8-4f3759e1bd22 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:57:21.763752 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:57:21.764006 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] VM Started (Lifecycle Event)
May 28 01:57:21.771103 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:57:21.771103 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe63:2bb1', 'fe80::e43a:d5ff:fecc:27fe', 'fe80::fc16:3eff:fe27:be54', 'fe80::a0e4:60ff:fe3f:73d6', 'fe80::fc16:3eff:fe92:e25b', 'fe80::ecb9:b7ff:fe00:dc63', 'fe80::fc16:3eff:fe35:c91', 'fe80::34e0:eeff:fee2:bede'] 
May 28 01:57:21.771103 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:57:21.771103 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:57:21.771103 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] <== get_connector_properties: return (90ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:57:21.774168 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:57:21.779263 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Instance spawned successfully.
May 28 01:57:21.779605 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:57:21.989199 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7baf8cea-22d4-48a8-a819-8fd22dcf618d req-165abe47-8f9e-4a3f-a01e-068d6054c742 service nova] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Received event network-vif-deleted-f242e691-1d28-43e0-b83a-2414c00958b8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:57:22.158311 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Took 1.39 seconds to deallocate network for instance.
May 28 01:57:22.172005 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-67cbfd3c-bcca-468c-a0bb-b349af40cd9f tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:22.257156 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f9ebc3e7-d948-4ff7-942a-e56c4b2aaf8c req-306bfb53-c4d2-4faf-8a49-8b1f73c8c78d service nova] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Received event network-vif-plugged-51d1e24b-97cd-4966-b67c-17e8092be898 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:57:22.257709 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f9ebc3e7-d948-4ff7-942a-e56c4b2aaf8c req-306bfb53-c4d2-4faf-8a49-8b1f73c8c78d service nova] Acquiring lock "fbe845bb-c11e-4c97-85b8-4f3759e1bd22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:22.257903 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f9ebc3e7-d948-4ff7-942a-e56c4b2aaf8c req-306bfb53-c4d2-4faf-8a49-8b1f73c8c78d service nova] Lock "fbe845bb-c11e-4c97-85b8-4f3759e1bd22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:22.258042 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f9ebc3e7-d948-4ff7-942a-e56c4b2aaf8c req-306bfb53-c4d2-4faf-8a49-8b1f73c8c78d service nova] Lock "fbe845bb-c11e-4c97-85b8-4f3759e1bd22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:22.258195 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f9ebc3e7-d948-4ff7-942a-e56c4b2aaf8c req-306bfb53-c4d2-4faf-8a49-8b1f73c8c78d service nova] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] No waiting events found dispatching network-vif-plugged-51d1e24b-97cd-4966-b67c-17e8092be898 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:57:22.258334 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-f9ebc3e7-d948-4ff7-942a-e56c4b2aaf8c req-306bfb53-c4d2-4faf-8a49-8b1f73c8c78d service nova] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Received unexpected event network-vif-plugged-51d1e24b-97cd-4966-b67c-17e8092be898 for instance with vm_state building and task_state spawning.
May 28 01:57:22.266910 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:57:22.270237 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:57:22.289714 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:57:22.290213 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:57:22.290535 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:57:22.290739 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:57:22.290964 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:57:22.291260 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:57:22.710246 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Took 0.55 seconds to detach 1 volumes for instance.
May 28 01:57:22.712452 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Deleting volume: fab00939-514d-46f8-a4d7-5a7c78e44797 {{(pid=98241) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 28 01:57:22.715340 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 3.208s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:22.715833 np0000001583 nova-compute[98241]: DEBUG nova.compute.rpcapi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98241) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 01:57:22.721715 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0ddfbe58-2a6e-44ec-8406-3b6a8e575930 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.291s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:22.772418 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:57:22.772722 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933442.7725039, fbe845bb-c11e-4c97-85b8-4f3759e1bd22 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:57:22.772762 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] VM Paused (Lifecycle Event)
May 28 01:57:22.795979 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Took 16.55 seconds to spawn the instance on the hypervisor.
May 28 01:57:22.796177 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:57:22.937105 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Starting finish_migration {{(pid=98241) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 28 01:57:22.937105 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Instance directory exists: not creating {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 01:57:22.937351 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Creating image(s)
May 28 01:57:22.937906 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Did not create local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 01:57:22.938221 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Ensure instance console log exists: /opt/stack/data/nova/instances/12f40ca4-b4b3-43f4-8c0b-cb208f59935c/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:57:22.938681 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:22.938980 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:22.939310 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:22.940272 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Start _get_guest_xml network_info=[{"id": "bce4c127-622b-4001-a5df-94a04616b08e", "address": "fa:16:3e:b1:89:97", "network": {"id": "b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-280876007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-280876007-network", "vif_mac": "fa:16:3e:b1:89:97"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60fbdf5ed38b4dc485a81c49b3303ed2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbce4c127-62", "ovs_interfaceid": "bce4c127-622b-4001-a5df-94a04616b08e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', 'iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '12f40ca4-b4b3-43f4-8c0b-cb208f59935c', 'attached_at': '2026-05-28T01:57:22.000000', 'detached_at': '', 'volume_id': '78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', 'serial': '78c187c7-3cb4-4c4d-a525-9e431e3d0d1a'}, 'delete_on_termination': True, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '0a1f57b9-b01c-4fc8-a9bd-77281344bcff', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:57:22.943175 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:57:22.944679 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-1837652712', uuid='12f40ca4-b4b3-43f4-8c0b-cb208f59935c'), owner=OwnerMeta(userid='27c90c0a8eb148fda8ae718f07ff1ed4', username='tempest-ServerActionsTestOtherA-1714646345-project-member', projectid='60fbdf5ed38b4dc485a81c49b3303ed2', projectname='tempest-ServerActionsTestOtherA-1714646345'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "bce4c127-622b-4001-a5df-94a04616b08e", "address": "fa:16:3e:b1:89:97", "network": {"id": "b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-280876007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-280876007-network", "vif_mac": "fa:16:3e:b1:89:97"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60fbdf5ed38b4dc485a81c49b3303ed2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbce4c127-62", "ovs_interfaceid": "bce4c127-622b-4001-a5df-94a04616b08e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933442.9442923) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:57:22.945924 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:57:22.946352 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:57:22.947539 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:57:22.947792 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:57:22.948982 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:57:22.949700 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:57:22.949975 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:57:22.951551 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:57:22.951551 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:57:22.951551 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:57:22.951551 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:57:22.951551 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:57:22.951551 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:57:22.953764 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:57:22.955752 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:57:22.955752 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:57:22.967986 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12f40ca4-b4b3-43f4-8c0b-cb208f59935c/disk.config --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:57:23.061611 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:23.075111 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12f40ca4-b4b3-43f4-8c0b-cb208f59935c/disk.config --force-share --output=json" returned: 0 in 0.107s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:57:23.075616 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "/opt/stack/data/nova/instances/12f40ca4-b4b3-43f4-8c0b-cb208f59935c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:23.077100 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "/opt/stack/data/nova/instances/12f40ca4-b4b3-43f4-8c0b-cb208f59935c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:23.077100 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "/opt/stack/data/nova/instances/12f40ca4-b4b3-43f4-8c0b-cb208f59935c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:23.077394 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:57:23.077923 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', 'iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:57:23.078266 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:57:23.078756 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:57:23.079139 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', 'iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:57:23.098793 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:57:23.099490 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:57:23.100086 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:57:23.100338 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:57:23.100803 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:57:23.101134 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:57:23.115844 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:57:23.115844 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:23.121564 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:57:23.121564 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:23.130332 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a] added
May 28 01:57:23.130332 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:57:23.130332 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:57:23.130332 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:57:23.130332 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:57:23.130332 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:57:23.130332 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:23.130332 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:57:23.130674 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0301(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:57:23.130674 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:57:23.142615 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a] added
May 28 01:57:23.142615 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:57:23.142615 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:57:23.142615 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:57:23.142615 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:57:23.142615 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:57:23.142615 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:23.142892 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:57:23.143064 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0419(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:57:23.143303 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:57:23.271164 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:23.274693 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:57:23.276998 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933443.276766, fbe845bb-c11e-4c97-85b8-4f3759e1bd22 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:57:23.277187 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] VM Resumed (Lifecycle Event)
May 28 01:57:23.310256 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Took 24.08 seconds to build instance.
May 28 01:57:23.384300 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0ddfbe58-2a6e-44ec-8406-3b6a8e575930 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:57:23.384540 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-0ddfbe58-2a6e-44ec-8406-3b6a8e575930 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:57:23.779817 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:57:23.781892 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:57:23.816063 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ece0d7f1-8ca3-4b44-9885-8569f45dda69 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "fbe845bb-c11e-4c97-85b8-4f3759e1bd22" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.599s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:23.890107 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-0ddfbe58-2a6e-44ec-8406-3b6a8e575930 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:57:24.131115 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:57:24.142671 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:57:24.142671 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:24.147069 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:57:24.159338 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:57:24.164595 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:57:24.164595 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:24.177590 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805 (non-flash)
May 28 01:57:24.177590 np0000001583 nova-compute[98241]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805 (non-flash)
May 28 01:57:24.177590 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:57:24.177818 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsi session list stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805 (non-flash)
May 28 01:57:24.177818 np0000001583 nova-compute[98241]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805 (non-flash)
May 28 01:57:24.177818 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:57:24.186144 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:24.201441 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805 (non-flash)
May 28 01:57:24.201441 np0000001583 nova-compute[98241]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805 (non-flash)
May 28 01:57:24.201441 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:57:24.201441 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsi session list stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805 (non-flash)
May 28 01:57:24.201441 np0000001583 nova-compute[98241]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805 (non-flash)
May 28 01:57:24.201441 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:57:24.214973 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a, portal: 192.168.40.100,3260]
May 28 01:57:24.214973 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a, portal: 192.168.40.100,3260] successful.
May 28 01:57:24.214973 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:24.231006 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:24.240404 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a, portal: 192.168.50.100,3260]
May 28 01:57:24.240404 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a, portal: 192.168.50.100,3260] successful.
May 28 01:57:24.240404 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:24.251122 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805 (non-flash)
May 28 01:57:24.251122 np0000001583 nova-compute[98241]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805 (non-flash)
May 28 01:57:24.251122 np0000001583 nova-compute[98241]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:24.251122 np0000001583 nova-compute[98241]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:24.251122 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:57:24.251393 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsi session list stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805 (non-flash)
May 28 01:57:24.251393 np0000001583 nova-compute[98241]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805 (non-flash)
May 28 01:57:24.251393 np0000001583 nova-compute[98241]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:24.251393 np0000001583 nova-compute[98241]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:24.251393 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:57:24.251621 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.152s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:57:24.251768 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:57:24.252641 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] HCTL ('7', '-', '-', 0) found on session 60 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:57:24.252790 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:57:24.259676 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:24.277609 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Searching for a device in session 60 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:57:24.279662 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805 (non-flash)
May 28 01:57:24.279662 np0000001583 nova-compute[98241]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805 (non-flash)
May 28 01:57:24.279662 np0000001583 nova-compute[98241]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:24.279662 np0000001583 nova-compute[98241]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:24.279662 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:57:24.279955 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:57:24.280284 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsi session list stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805 (non-flash)
May 28 01:57:24.280284 np0000001583 nova-compute[98241]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805 (non-flash)
May 28 01:57:24.280284 np0000001583 nova-compute[98241]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:24.280284 np0000001583 nova-compute[98241]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:24.280284 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:57:24.280576 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.180s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:57:24.280708 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:57:24.281393 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] HCTL ('8', '-', '-', 0) found on session 61 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:57:24.281520 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:57:24.306313 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Searching for a device in session 61 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:57:24.306512 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:57:24.311040 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Swapping old allocation on dict_keys(['cfa1af79-477d-460a-869d-84a19fa91765']) held by migration 58ebb15c-8f8a-42f0-b0e7-e0a6f68f17e9 for instance
May 28 01:57:24.327117 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:57:24.327117 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:57:24.327117 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:57:24.327117 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:57:24.327117 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:57:24.327554 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:57:24.328276 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:57:24.328561 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:57:24.328738 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 01:57:24.329689 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:57:24.396009 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0ddfbe58-2a6e-44ec-8406-3b6a8e575930 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.673s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:24.401230 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-67cbfd3c-bcca-468c-a0bb-b349af40cd9f tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.228s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:24.417716 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3caf6f2e-9a1e-4527-b63e-381bf346b829 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "fbe845bb-c11e-4c97-85b8-4f3759e1bd22" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:24.418034 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3caf6f2e-9a1e-4527-b63e-381bf346b829 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "fbe845bb-c11e-4c97-85b8-4f3759e1bd22" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:24.418369 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3caf6f2e-9a1e-4527-b63e-381bf346b829 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "fbe845bb-c11e-4c97-85b8-4f3759e1bd22-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:24.418590 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3caf6f2e-9a1e-4527-b63e-381bf346b829 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "fbe845bb-c11e-4c97-85b8-4f3759e1bd22-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:24.418687 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3caf6f2e-9a1e-4527-b63e-381bf346b829 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "fbe845bb-c11e-4c97-85b8-4f3759e1bd22-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:24.422663 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-3caf6f2e-9a1e-4527-b63e-381bf346b829 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Terminating instance
May 28 01:57:24.426671 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Overwriting current allocation {'allocations': {'cfa1af79-477d-460a-869d-84a19fa91765': {'resources': {'VCPU': 1, 'MEMORY_MB': 256, 'DISK_GB': 1}, 'generation': 35}}, 'project_id': '2db0b9fa3fcc47408dad261c2004e4a5', 'user_id': '8f68ae604d0442439a927020cec740c0', 'consumer_generation': 1} on consumer 7078fbb1-fa4a-4589-9f95-9d95dee381e0 {{(pid=98241) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2036}}
May 28 01:57:24.513700 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-0ddfbe58-2a6e-44ec-8406-3b6a8e575930 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Deleted allocations for instance 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4
May 28 01:57:24.555848 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:24.668664 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Acquiring lock "refresh_cache-7078fbb1-fa4a-4589-9f95-9d95dee381e0" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:57:24.668910 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Acquired lock "refresh_cache-7078fbb1-fa4a-4589-9f95-9d95dee381e0" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:57:24.669096 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:57:24.825053 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:24.837673 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:24.933829 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3caf6f2e-9a1e-4527-b63e-381bf346b829 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:57:24.953218 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:24.956808 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:24.983071 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:24.985306 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:24.993313 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-67cbfd3c-bcca-468c-a0bb-b349af40cd9f tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:57:24.993313 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-67cbfd3c-bcca-468c-a0bb-b349af40cd9f tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:57:25.018026 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:25.100851 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:57:25.118247 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-47aa6310-bfd4-4b8f-a4ec-a99ac06cfbeb req-beeb7b1e-5ae5-4e94-a16b-388018613aff service nova] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Received event network-vif-unplugged-51d1e24b-97cd-4966-b67c-17e8092be898 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:57:25.118735 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-47aa6310-bfd4-4b8f-a4ec-a99ac06cfbeb req-beeb7b1e-5ae5-4e94-a16b-388018613aff service nova] Acquiring lock "fbe845bb-c11e-4c97-85b8-4f3759e1bd22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:25.119009 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-47aa6310-bfd4-4b8f-a4ec-a99ac06cfbeb req-beeb7b1e-5ae5-4e94-a16b-388018613aff service nova] Lock "fbe845bb-c11e-4c97-85b8-4f3759e1bd22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:25.119180 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-47aa6310-bfd4-4b8f-a4ec-a99ac06cfbeb req-beeb7b1e-5ae5-4e94-a16b-388018613aff service nova] Lock "fbe845bb-c11e-4c97-85b8-4f3759e1bd22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:25.119369 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-47aa6310-bfd4-4b8f-a4ec-a99ac06cfbeb req-beeb7b1e-5ae5-4e94-a16b-388018613aff service nova] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] No waiting events found dispatching network-vif-unplugged-51d1e24b-97cd-4966-b67c-17e8092be898 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:57:25.119548 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-47aa6310-bfd4-4b8f-a4ec-a99ac06cfbeb req-beeb7b1e-5ae5-4e94-a16b-388018613aff service nova] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Received event network-vif-unplugged-51d1e24b-97cd-4966-b67c-17e8092be898 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:57:25.172051 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:25.289208 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999636566999925 future=<Future at 0x7724ec48c200 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:25.295224 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Instance destroyed successfully.
May 28 01:57:25.296640 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-3caf6f2e-9a1e-4527-b63e-381bf346b829 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lazy-loading 'resources' on Instance uuid fbe845bb-c11e-4c97-85b8-4f3759e1bd22 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:57:25.424917 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:25.493608 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-67cbfd3c-bcca-468c-a0bb-b349af40cd9f tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:57:25.522656 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:25.529263 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0ddfbe58-2a6e-44ec-8406-3b6a8e575930 tempest-ServerStableDeviceRescueTest-1096447838 tempest-ServerStableDeviceRescueTest-1096447838-project-member] Lock "8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.250s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:25.656238 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Updating instance_info_cache with network_info: [{"id": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "address": "fa:16:3e:30:bd:e8", "network": {"id": "11b2c699-14f1-4eba-bbe6-b7655c6f17cc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1044342879-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2db0b9fa3fcc47408dad261c2004e4a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7567636b-72", "ovs_interfaceid": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:57:25.798474 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-3caf6f2e-9a1e-4527-b63e-381bf346b829 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:56:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-952825136',display_name='tempest-TestVolumeBootPattern-server-952825136',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testvolumebootpattern-server-952825136',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:57:22Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='432aa1094ced436494def17a875aa8e1',ramdisk_id='',reservation_id='r-4sgy7b5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestVolumeBootPattern-1031057169',owner_user_name='tempest-TestVolumeBootPattern-1031057169-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:57:23Z,user_data=None,user_id='6be314b4eed642c3b2c72fe115860220',uuid=fbe845bb-c11e-4c97-85b8-4f3759e1bd22,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51d1e24b-97cd-4966-b67c-17e8092be898", "address": "fa:16:3e:35:0c:91", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51d1e24b-97", "ovs_interfaceid": "51d1e24b-97cd-4966-b67c-17e8092be898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:57:25.798662 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-3caf6f2e-9a1e-4527-b63e-381bf346b829 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converting VIF {"id": "51d1e24b-97cd-4966-b67c-17e8092be898", "address": "fa:16:3e:35:0c:91", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51d1e24b-97", "ovs_interfaceid": "51d1e24b-97cd-4966-b67c-17e8092be898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:57:25.799195 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-3caf6f2e-9a1e-4527-b63e-381bf346b829 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:0c:91,bridge_name='br-int',has_traffic_filtering=True,id=51d1e24b-97cd-4966-b67c-17e8092be898,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51d1e24b-97') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:57:25.799865 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-3caf6f2e-9a1e-4527-b63e-381bf346b829 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:0c:91,bridge_name='br-int',has_traffic_filtering=True,id=51d1e24b-97cd-4966-b67c-17e8092be898,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51d1e24b-97') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:57:25.801815 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:25.801815 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51d1e24b-97, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:25.810192 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:25.810845 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:57:25.812229 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:25.812980 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:25.813123 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=83fe72c0-ec4f-4cc7-a431-33bcdebdb3d3) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:25.814732 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:25.815402 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:57:25.820442 np0000001583 nova-compute[98241]: INFO os_vif [None req-3caf6f2e-9a1e-4527-b63e-381bf346b829 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:0c:91,bridge_name='br-int',has_traffic_filtering=True,id=51d1e24b-97cd-4966-b67c-17e8092be898,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51d1e24b-97')
May 28 01:57:25.823436 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3caf6f2e-9a1e-4527-b63e-381bf346b829 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:57:25.823839 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3caf6f2e-9a1e-4527-b63e-381bf346b829 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805', 'iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4eea4106-b0fc-4a86-9288-5bf9167cb805', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:57:25.824030 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-3caf6f2e-9a1e-4527-b63e-381bf346b829 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:57:26.000689 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-67cbfd3c-bcca-468c-a0bb-b349af40cd9f tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.600s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:26.002364 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.730s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:26.062891 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-67cbfd3c-bcca-468c-a0bb-b349af40cd9f tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Deleted allocations for instance ea9459ae-6246-4d11-b46b-733449884b1b
May 28 01:57:26.117733 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Found WWN 330000000acc6074f for multipath device dm-0 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:57:26.118070 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:57:26.118333 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '330000000acc6074f', 'path': '/dev/dm-0', 'multipath_id': '330000000acc6074f'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:57:26.118496 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000acc6074f', 'path': '/dev/dm-0', 'multipath_id': '330000000acc6074f'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:57:26.118888 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-3caf6f2e-9a1e-4527-b63e-381bf346b829 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.295s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:57:26.119336 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3caf6f2e-9a1e-4527-b63e-381bf346b829 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805', 'iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4eea4106-b0fc-4a86-9288-5bf9167cb805', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:57:26.119532 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3caf6f2e-9a1e-4527-b63e-381bf346b829 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:57:26.146925 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3caf6f2e-9a1e-4527-b63e-381bf346b829 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805 (non-flash)
May 28 01:57:26.146925 np0000001583 nova-compute[98241]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805 (non-flash)
May 28 01:57:26.146925 np0000001583 nova-compute[98241]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:26.146925 np0000001583 nova-compute[98241]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:26.146925 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:57:26.147196 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3caf6f2e-9a1e-4527-b63e-381bf346b829 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805 (non-flash)
May 28 01:57:26.147196 np0000001583 nova-compute[98241]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805 (non-flash)
May 28 01:57:26.147196 np0000001583 nova-compute[98241]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:26.147196 np0000001583 nova-compute[98241]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:26.147196 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:57:26.147325 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3caf6f2e-9a1e-4527-b63e-381bf346b829 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805', '58'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805', '59'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', '60'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', '61')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:57:26.147397 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3caf6f2e-9a1e-4527-b63e-381bf346b829 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805', '58')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:57:26.148254 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3caf6f2e-9a1e-4527-b63e-381bf346b829 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805', '59')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:57:26.149162 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3caf6f2e-9a1e-4527-b63e-381bf346b829 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f8155e40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805'): ({'sde'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:57:26.149401 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3caf6f2e-9a1e-4527-b63e-381bf346b829 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Removing multipathed devices sdd, sde {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:57:26.149646 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3caf6f2e-9a1e-4527-b63e-381bf346b829 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Flush multipath device 330000000fa18cbaf {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:57:26.159237 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Releasing lock "refresh_cache-7078fbb1-fa4a-4589-9f95-9d95dee381e0" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:57:26.159237 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:57:26.171510 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:57:26.191783 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3caf6f2e-9a1e-4527-b63e-381bf346b829 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:57:26.198839 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:57:26.240134 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:57:26.240581 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:57:26.251311 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:57:26.252699 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe63:2bb1', 'fe80::e43a:d5ff:fecc:27fe', 'fe80::fc16:3eff:fe27:be54', 'fe80::a0e4:60ff:fe3f:73d6', 'fe80::fc16:3eff:fe92:e25b', 'fe80::ecb9:b7ff:fe00:dc63'] 
May 28 01:57:26.252898 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:57:26.255856 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:57:26.255856 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] <== get_connector_properties: return (94ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:57:26.256395 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3caf6f2e-9a1e-4527-b63e-381bf346b829 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:57:26.321725 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3caf6f2e-9a1e-4527-b63e-381bf346b829 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:57:26.322177 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3caf6f2e-9a1e-4527-b63e-381bf346b829 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:57:26.323499 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3caf6f2e-9a1e-4527-b63e-381bf346b829 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:57:26.338453 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3caf6f2e-9a1e-4527-b63e-381bf346b829 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:57:26.338739 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3caf6f2e-9a1e-4527-b63e-381bf346b829 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:57:26.352572 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3caf6f2e-9a1e-4527-b63e-381bf346b829 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:26.385731 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3caf6f2e-9a1e-4527-b63e-381bf346b829 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805, portal: 192.168.40.100,3260]
May 28 01:57:26.385731 np0000001583 nova-compute[98241]: Logout of [sid: 58, target: iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805, portal: 192.168.40.100,3260] successful.
May 28 01:57:26.385731 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:26.414893 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3caf6f2e-9a1e-4527-b63e-381bf346b829 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:26.427368 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3caf6f2e-9a1e-4527-b63e-381bf346b829 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:26.452008 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3caf6f2e-9a1e-4527-b63e-381bf346b829 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805, portal: 192.168.50.100,3260]
May 28 01:57:26.452008 np0000001583 nova-compute[98241]: Logout of [sid: 59, target: iqn.2023-03.storpool.com:os--volume-4eea4106-b0fc-4a86-9288-5bf9167cb805, portal: 192.168.50.100,3260] successful.
May 28 01:57:26.452008 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:26.469645 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3caf6f2e-9a1e-4527-b63e-381bf346b829 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:26.470870 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-3caf6f2e-9a1e-4527-b63e-381bf346b829 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:57:26.470989 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3caf6f2e-9a1e-4527-b63e-381bf346b829 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] <== disconnect_volume: return (647ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:57:26.471157 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3caf6f2e-9a1e-4527-b63e-381bf346b829 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:57:26.471446 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-3caf6f2e-9a1e-4527-b63e-381bf346b829 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Deleting instance files /opt/stack/data/nova/instances/fbe845bb-c11e-4c97-85b8-4f3759e1bd22_del
May 28 01:57:26.471998 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-3caf6f2e-9a1e-4527-b63e-381bf346b829 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Deletion of /opt/stack/data/nova/instances/fbe845bb-c11e-4c97-85b8-4f3759e1bd22_del complete
May 28 01:57:26.523651 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:57:26.523993 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:57:26.607763 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.003663983000024018 future=<Future at 0x7724f847dc10 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:26.607892 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:26.607984 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=5.245748817000049 future=<Future at 0x7724ec1a9520 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:26.608099 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=5.245628677000013 future=<Future at 0x7724ec1a9520 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:26.609037 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Emitting event <LifecycleEvent: 1779933431.603914, 45a73c95-ff10-4b74-9ab8-4014a244a7d3 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:57:26.609657 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] VM Stopped (Lifecycle Event)
May 28 01:57:26.624112 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:56:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1837652712',display_name='tempest-ServerActionsTestOtherA-server-1837652712',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001583',hostname='tempest-serveractionstestothera-server-1837652712',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIePG0IU7S1SlFjpc/VmXFCBBKIijsN+gHQMlnhYfGPcl665nwX9JP0OwVOuueebU/mRc6FRuLr9ai0zvPAu2rDRN1UE1FBgnGgOOoImTJFqPL9BfFXoi8JNvWclsGpwzg==',key_name='tempest-keypair-1911990843',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:57:02Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001583',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='60fbdf5ed38b4dc485a81c49b3303ed2',ramdisk_id='',reservation_id='r-t6bk0usf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1714646345',owner_user_name='tempest-ServerActionsTestOtherA-1714646345-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:57:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27c90c0a8eb148fda8ae718f07ff1ed4',uuid=12f40ca4-b4b3-43f4-8c0b-cb208f59935c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bce4c127-622b-4001-a5df-94a04616b08e", "address": "fa:16:3e:b1:89:97", "network": {"id": "b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-280876007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-280876007-network", "vif_mac": "fa:16:3e:b1:89:97"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60fbdf5ed38b4dc485a81c49b3303ed2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbce4c127-62", "ovs_interfaceid": "bce4c127-622b-4001-a5df-94a04616b08e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:57:26.624353 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Converting VIF {"id": "bce4c127-622b-4001-a5df-94a04616b08e", "address": "fa:16:3e:b1:89:97", "network": {"id": "b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-280876007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-280876007-network", "vif_mac": "fa:16:3e:b1:89:97"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60fbdf5ed38b4dc485a81c49b3303ed2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbce4c127-62", "ovs_interfaceid": "bce4c127-622b-4001-a5df-94a04616b08e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:57:26.624983 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:89:97,bridge_name='br-int',has_traffic_filtering=True,id=bce4c127-622b-4001-a5df-94a04616b08e,network=Network(b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbce4c127-62') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:57:26.626644 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] End _get_guest_xml xml=<domain type="qemu">
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:   <uuid>12f40ca4-b4b3-43f4-8c0b-cb208f59935c</uuid>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:   <name>instance-00000018</name>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:   <memory>262144</memory>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:       <nova:name>tempest-ServerActionsTestOtherA-server-1837652712</nova:name>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:57:22</nova:creationTime>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.micro" id="84">
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:         <nova:memory>256</nova:memory>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:       <nova:image uuid="">
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:         <nova:user uuid="27c90c0a8eb148fda8ae718f07ff1ed4">tempest-ServerActionsTestOtherA-1714646345-project-member</nova:user>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:         <nova:project uuid="60fbdf5ed38b4dc485a81c49b3303ed2">tempest-ServerActionsTestOtherA-1714646345</nova:project>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:       <nova:root type="volume" uuid=""/>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:         <nova:port uuid="bce4c127-622b-4001-a5df-94a04616b08e">
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:     <system>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:       <entry name="serial">12f40ca4-b4b3-43f4-8c0b-cb208f59935c</entry>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:       <entry name="uuid">12f40ca4-b4b3-43f4-8c0b-cb208f59935c</entry>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:     </system>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:   <os>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:   </os>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:   <features>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:   </features>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:   <devices>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/12f40ca4-b4b3-43f4-8c0b-cb208f59935c/disk.config"/>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:     </disk>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:     <disk type="block" device="disk">
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:       <alias name="ua-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a"/>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:       <source dev="/dev/dm-0"/>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:       <serial>78c187c7-3cb4-4c4d-a525-9e431e3d0d1a</serial>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:     </disk>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:b1:89:97"/>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:       <target dev="tapbce4c127-62"/>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:     </interface>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/12f40ca4-b4b3-43f4-8c0b-cb208f59935c/console.log" append="off"/>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:     </serial>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:     <video>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:     </video>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:     </rng>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:   </devices>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]: </domain>
May 28 01:57:26.626644 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:57:26.628404 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:56:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1837652712',display_name='tempest-ServerActionsTestOtherA-server-1837652712',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001583',hostname='tempest-serveractionstestothera-server-1837652712',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIePG0IU7S1SlFjpc/VmXFCBBKIijsN+gHQMlnhYfGPcl665nwX9JP0OwVOuueebU/mRc6FRuLr9ai0zvPAu2rDRN1UE1FBgnGgOOoImTJFqPL9BfFXoi8JNvWclsGpwzg==',key_name='tempest-keypair-1911990843',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:57:02Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001583',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='60fbdf5ed38b4dc485a81c49b3303ed2',ramdisk_id='',reservation_id='r-t6bk0usf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1714646345',owner_user_name='tempest-ServerActionsTestOtherA-1714646345-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:57:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27c90c0a8eb148fda8ae718f07ff1ed4',uuid=12f40ca4-b4b3-43f4-8c0b-cb208f59935c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bce4c127-622b-4001-a5df-94a04616b08e", "address": "fa:16:3e:b1:89:97", "network": {"id": "b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-280876007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-280876007-network", "vif_mac": "fa:16:3e:b1:89:97"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60fbdf5ed38b4dc485a81c49b3303ed2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbce4c127-62", "ovs_interfaceid": "bce4c127-622b-4001-a5df-94a04616b08e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:57:26.628580 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Converting VIF {"id": "bce4c127-622b-4001-a5df-94a04616b08e", "address": "fa:16:3e:b1:89:97", "network": {"id": "b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-280876007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-280876007-network", "vif_mac": "fa:16:3e:b1:89:97"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60fbdf5ed38b4dc485a81c49b3303ed2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbce4c127-62", "ovs_interfaceid": "bce4c127-622b-4001-a5df-94a04616b08e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:57:26.629070 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:89:97,bridge_name='br-int',has_traffic_filtering=True,id=bce4c127-622b-4001-a5df-94a04616b08e,network=Network(b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbce4c127-62') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:57:26.629432 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:89:97,bridge_name='br-int',has_traffic_filtering=True,id=bce4c127-622b-4001-a5df-94a04616b08e,network=Network(b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbce4c127-62') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:57:26.630223 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:26.630671 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:26.631038 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:57:26.631795 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:26.632001 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c6a7b9d9-c297-5b42-92df-565144da91cd', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:26.632909 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:26.633832 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:57:26.635373 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:26.638156 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:26.638697 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbce4c127-62, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:26.639220 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbce4c127-62, col_values=(('qos', UUID('889f965a-83a6-43d0-88da-b893fcceeb6c')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:26.639340 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbce4c127-62, col_values=(('external_ids', {'iface-id': 'bce4c127-622b-4001-a5df-94a04616b08e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:89:97', 'vm-uuid': '12f40ca4-b4b3-43f4-8c0b-cb208f59935c'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:26.640800 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:26.642403 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:57:26.645991 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:26.647135 np0000001583 nova-compute[98241]: INFO os_vif [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:89:97,bridge_name='br-int',has_traffic_filtering=True,id=bce4c127-622b-4001-a5df-94a04616b08e,network=Network(b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbce4c127-62')
May 28 01:57:26.982495 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-3caf6f2e-9a1e-4527-b63e-381bf346b829 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Took 2.05 seconds to destroy the instance on the hypervisor.
May 28 01:57:26.982495 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-3caf6f2e-9a1e-4527-b63e-381bf346b829 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:57:26.986101 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:57:26.986101 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:57:26.986101 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:27.027584 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:57:27.067103 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:27.074211 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-67cbfd3c-bcca-468c-a0bb-b349af40cd9f tempest-AttachVolumeShelveTestJSON-1906404591 tempest-AttachVolumeShelveTestJSON-1906404591-project-member] Lock "ea9459ae-6246-4d11-b46b-733449884b1b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.118s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:27.112951 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 45a73c95-ff10-4b74-9ab8-4014a244a7d3] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:57:27.181052 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-42c4f1ae-c15e-4d85-8fc3-f68fafe0b547 req-6f7c970d-870e-4648-974e-1f3db9daab84 service nova] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Received event network-vif-unplugged-51d1e24b-97cd-4966-b67c-17e8092be898 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:57:27.181664 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-42c4f1ae-c15e-4d85-8fc3-f68fafe0b547 req-6f7c970d-870e-4648-974e-1f3db9daab84 service nova] Acquiring lock "fbe845bb-c11e-4c97-85b8-4f3759e1bd22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:27.182062 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-42c4f1ae-c15e-4d85-8fc3-f68fafe0b547 req-6f7c970d-870e-4648-974e-1f3db9daab84 service nova] Lock "fbe845bb-c11e-4c97-85b8-4f3759e1bd22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:27.182427 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-42c4f1ae-c15e-4d85-8fc3-f68fafe0b547 req-6f7c970d-870e-4648-974e-1f3db9daab84 service nova] Lock "fbe845bb-c11e-4c97-85b8-4f3759e1bd22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:27.182711 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-42c4f1ae-c15e-4d85-8fc3-f68fafe0b547 req-6f7c970d-870e-4648-974e-1f3db9daab84 service nova] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] No waiting events found dispatching network-vif-unplugged-51d1e24b-97cd-4966-b67c-17e8092be898 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:57:27.182711 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-42c4f1ae-c15e-4d85-8fc3-f68fafe0b547 req-6f7c970d-870e-4648-974e-1f3db9daab84 service nova] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Received event network-vif-unplugged-51d1e24b-97cd-4966-b67c-17e8092be898 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:57:27.354190 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Starting finish_revert_migration {{(pid=98241) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12932}}
May 28 01:57:27.374223 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7195e34f-259a-402e-9afd-251c687762c5 req-b6648ab5-40b3-438b-8dcb-5b1cedde3b1a service nova] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Received event network-vif-deleted-51d1e24b-97cd-4966-b67c-17e8092be898 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:57:27.374405 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-7195e34f-259a-402e-9afd-251c687762c5 req-b6648ab5-40b3-438b-8dcb-5b1cedde3b1a service nova] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Neutron deleted interface 51d1e24b-97cd-4966-b67c-17e8092be898; detaching it from the instance and deleting it from the info cache
May 28 01:57:27.379565 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Start _get_guest_xml network_info=[{"id": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "address": "fa:16:3e:30:bd:e8", "network": {"id": "11b2c699-14f1-4eba-bbe6-b7655c6f17cc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1044342879-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2db0b9fa3fcc47408dad261c2004e4a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7567636b-72", "ovs_interfaceid": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '7078fbb1-fa4a-4589-9f95-9d95dee381e0', 'attached_at': '2026-05-28T01:57:26.000000', 'detached_at': '', 'volume_id': 'ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'serial': 'ba26e203-0d5a-4c3d-b50d-9d38c042d9d2'}, 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'attachment_id': '44f585f3-f8e6-40f9-b809-f074dd5db735', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:57:27.380965 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7195e34f-259a-402e-9afd-251c687762c5 req-b6648ab5-40b3-438b-8dcb-5b1cedde3b1a service nova] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Detach interface failed, port_id=51d1e24b-97cd-4966-b67c-17e8092be898, reason: Instance fbe845bb-c11e-4c97-85b8-4f3759e1bd22 could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:57:27.383314 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:57:27.385321 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-1792038090', uuid='7078fbb1-fa4a-4589-9f95-9d95dee381e0'), owner=OwnerMeta(userid='8f68ae604d0442439a927020cec740c0', username='tempest-ServerActionsTestOtherB-640844130-project-member', projectid='2db0b9fa3fcc47408dad261c2004e4a5', projectname='tempest-ServerActionsTestOtherB-640844130'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "address": "fa:16:3e:30:bd:e8", "network": {"id": "11b2c699-14f1-4eba-bbe6-b7655c6f17cc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1044342879-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2db0b9fa3fcc47408dad261c2004e4a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7567636b-72", "ovs_interfaceid": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933447.3844068) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:57:27.386643 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:57:27.386984 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:57:27.387965 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:57:27.388180 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:57:27.389376 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:57:27.389743 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:57:27.390339 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:57:27.390479 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:57:27.390635 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:57:27.390757 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:57:27.390887 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:57:27.391086 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:57:27.391241 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:57:27.391393 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:57:27.391530 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:57:27.391678 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:57:27.391861 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7078fbb1-fa4a-4589-9f95-9d95dee381e0 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:57:27.542608 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.542s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:27.544457 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 2.707s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:27.544988 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:27.545281 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Auditing locally available compute resources for np0000001583 (node: np0000001583) {{(pid=98241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 01:57:27.611446 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Deleted allocations for instance 533f5dcc-2e48-4280-84b3-facb02dea136
May 28 01:57:27.810730 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:57:27.913978 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0/disk.config --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:57:27.993533 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0/disk.config --force-share --output=json" returned: 0 in 0.079s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:57:27.993803 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Acquiring lock "/opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:27.994155 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "/opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:27.994745 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "/opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:27.995204 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:57:27.995671 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:57:27.995845 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:57:27.996236 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:57:27.996533 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:57:28.008023 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:57:28.008887 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:57:28.009361 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:57:28.010324 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:57:28.010921 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:57:28.011236 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:57:28.021098 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:57:28.021098 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:28.027098 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:57:28.027098 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:28.034830 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2] added
May 28 01:57:28.034830 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:57:28.034830 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:57:28.034830 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:57:28.034830 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:57:28.034830 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:57:28.034830 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:28.034969 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:57:28.035135 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0255(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:57:28.035336 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:57:28.042945 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2] added
May 28 01:57:28.042945 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:57:28.042945 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:57:28.042945 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:57:28.042945 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:57:28.042945 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:57:28.042945 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:28.043148 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:57:28.043306 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0321(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:57:28.043487 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:57:28.065716 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:28.166461 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:57:28.166461 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:57:28.166461 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] No VIF found with MAC fa:16:3e:b1:89:97, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:57:28.166461 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Using config drive
May 28 01:57:28.313028 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Took 1.33 seconds to deallocate network for instance.
May 28 01:57:28.515009 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:28.579505 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1100d127-f3d6-416e-a646-b072660980bc/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:57:28.629249 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-34af2c32-3096-4b14-859f-c8033827679a tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "533f5dcc-2e48-4280-84b3-facb02dea136" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.174s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:28.642189 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:28.672661 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:28.700315 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1100d127-f3d6-416e-a646-b072660980bc/disk --force-share --output=json" returned: 0 in 0.121s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:57:28.700987 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1100d127-f3d6-416e-a646-b072660980bc/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:57:28.792398 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:28.814022 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1100d127-f3d6-416e-a646-b072660980bc/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:57:28.822107 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c36895c-9d2c-49be-b545-3658f535964a/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:57:28.848703 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:28.874163 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-3caf6f2e-9a1e-4527-b63e-381bf346b829 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Took 0.56 seconds to detach 1 volumes for instance.
May 28 01:57:28.923200 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c36895c-9d2c-49be-b545-3658f535964a/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:57:28.923729 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c36895c-9d2c-49be-b545-3658f535964a/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:57:29.013983 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c36895c-9d2c-49be-b545-3658f535964a/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:57:29.019267 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c911c7-ae44-4902-989f-3f0655243f3f/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:57:29.036684 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:57:29.044058 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:57:29.051511 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:57:29.051511 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:57:29.062838 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:57:29.062838 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:29.070727 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:29.077347 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:29.087508 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:29.087508 np0000001583 nova-compute[98241]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:29.087508 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:57:29.087759 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsi session list stdout=tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:29.087759 np0000001583 nova-compute[98241]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:29.087759 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:57:29.098516 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:29.098516 np0000001583 nova-compute[98241]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:29.098516 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:57:29.098945 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsi session list stdout=tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:29.098945 np0000001583 nova-compute[98241]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:29.098945 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:57:29.121906 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2, portal: 192.168.40.100,3260]
May 28 01:57:29.121906 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2, portal: 192.168.40.100,3260] successful.
May 28 01:57:29.121906 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:29.124414 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c911c7-ae44-4902-989f-3f0655243f3f/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:57:29.124763 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c911c7-ae44-4902-989f-3f0655243f3f/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:57:29.142147 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:29.145583 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2, portal: 192.168.50.100,3260]
May 28 01:57:29.145583 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2, portal: 192.168.50.100,3260] successful.
May 28 01:57:29.145583 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:29.158714 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:29.158714 np0000001583 nova-compute[98241]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:29.158714 np0000001583 nova-compute[98241]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:57:29.158714 np0000001583 nova-compute[98241]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:57:29.158714 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:57:29.160421 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsi session list stdout=tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:29.160421 np0000001583 nova-compute[98241]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:29.160421 np0000001583 nova-compute[98241]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:57:29.160421 np0000001583 nova-compute[98241]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:57:29.160421 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:57:29.160421 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.151s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:57:29.160421 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:57:29.160966 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] HCTL ('9', '-', '-', 0) found on session 62 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:57:29.161097 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:57:29.169806 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:29.182547 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Searching for a device in session 62 and hctl ['9', '*', '*', 0] yield: None {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:57:29.186504 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:29.186504 np0000001583 nova-compute[98241]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:29.186504 np0000001583 nova-compute[98241]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:57:29.186504 np0000001583 nova-compute[98241]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:57:29.186504 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:57:29.186647 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsi session list stdout=tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:29.186647 np0000001583 nova-compute[98241]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:29.186647 np0000001583 nova-compute[98241]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:57:29.186647 np0000001583 nova-compute[98241]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:57:29.186647 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:57:29.186953 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.176s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:57:29.187297 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:57:29.187853 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] HCTL ('10', '-', '-', 0) found on session 63 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:57:29.187961 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:57:29.209954 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Searching for a device in session 63 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:57:29.210368 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:57:29.236106 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c911c7-ae44-4902-989f-3f0655243f3f/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:57:29.242555 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:57:29.248772 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:57:29.250429 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:57:29.299938 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.050s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:57:29.300494 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Hypervisor/Node resource view: name=np0000001583 free_ram=13113MB free_disk=73.96930694580078GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 01:57:29.302057 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:29.302057 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:29.386531 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3caf6f2e-9a1e-4527-b63e-381bf346b829 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:29.479882 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-416d5da6-a367-420a-a551-0e29bf3cc73e req-a020cd0c-88e9-4a37-8ca5-5990d2687367 service nova] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Received event network-vif-plugged-bce4c127-622b-4001-a5df-94a04616b08e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:57:29.481031 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-416d5da6-a367-420a-a551-0e29bf3cc73e req-a020cd0c-88e9-4a37-8ca5-5990d2687367 service nova] Acquiring lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:29.481031 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-416d5da6-a367-420a-a551-0e29bf3cc73e req-a020cd0c-88e9-4a37-8ca5-5990d2687367 service nova] Lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:29.481031 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-416d5da6-a367-420a-a551-0e29bf3cc73e req-a020cd0c-88e9-4a37-8ca5-5990d2687367 service nova] Lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:29.481031 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-416d5da6-a367-420a-a551-0e29bf3cc73e req-a020cd0c-88e9-4a37-8ca5-5990d2687367 service nova] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] No waiting events found dispatching network-vif-plugged-bce4c127-622b-4001-a5df-94a04616b08e {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:57:29.481031 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-416d5da6-a367-420a-a551-0e29bf3cc73e req-a020cd0c-88e9-4a37-8ca5-5990d2687367 service nova] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Received unexpected event network-vif-plugged-bce4c127-622b-4001-a5df-94a04616b08e for instance with vm_state active and task_state resize_finish.
May 28 01:57:29.481031 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-416d5da6-a367-420a-a551-0e29bf3cc73e req-a020cd0c-88e9-4a37-8ca5-5990d2687367 service nova] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Received event network-vif-plugged-bce4c127-622b-4001-a5df-94a04616b08e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:57:29.481031 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-416d5da6-a367-420a-a551-0e29bf3cc73e req-a020cd0c-88e9-4a37-8ca5-5990d2687367 service nova] Acquiring lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:29.481031 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-416d5da6-a367-420a-a551-0e29bf3cc73e req-a020cd0c-88e9-4a37-8ca5-5990d2687367 service nova] Lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:29.481031 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-416d5da6-a367-420a-a551-0e29bf3cc73e req-a020cd0c-88e9-4a37-8ca5-5990d2687367 service nova] Lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:29.481762 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-416d5da6-a367-420a-a551-0e29bf3cc73e req-a020cd0c-88e9-4a37-8ca5-5990d2687367 service nova] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] No waiting events found dispatching network-vif-plugged-bce4c127-622b-4001-a5df-94a04616b08e {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:57:29.481762 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-416d5da6-a367-420a-a551-0e29bf3cc73e req-a020cd0c-88e9-4a37-8ca5-5990d2687367 service nova] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Received unexpected event network-vif-plugged-bce4c127-622b-4001-a5df-94a04616b08e for instance with vm_state active and task_state resize_finish.
May 28 01:57:29.675294 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Removed pending STOPPED event for 12f40ca4-b4b3-43f4-8c0b-cb208f59935c due to new event <LifecycleEvent: 1779933449.6748064, 12f40ca4-b4b3-43f4-8c0b-cb208f59935c => Resumed> {{(pid=98241) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 01:57:29.676119 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Instance event wait completed in 0 seconds for  {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:57:29.676657 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933449.6748064, 12f40ca4-b4b3-43f4-8c0b-cb208f59935c => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:57:29.676877 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] VM Resumed (Lifecycle Event)
May 28 01:57:29.680490 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Instance running successfully.
May 28 01:57:29.681822 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Failed to set time: agent not configured {{(pid=98241) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 28 01:57:29.682004 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a74c8360-b38e-499c-b548-d1e6e232ecbd tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] finish_migration finished successfully. {{(pid=98241) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 28 01:57:29.940145 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4a8a7022-31c2-4fb9-97ed-cc1dce8aba3c tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "75c911c7-ae44-4902-989f-3f0655243f3f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:29.940393 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4a8a7022-31c2-4fb9-97ed-cc1dce8aba3c tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "75c911c7-ae44-4902-989f-3f0655243f3f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:29.940492 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4a8a7022-31c2-4fb9-97ed-cc1dce8aba3c tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "75c911c7-ae44-4902-989f-3f0655243f3f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:29.940625 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4a8a7022-31c2-4fb9-97ed-cc1dce8aba3c tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "75c911c7-ae44-4902-989f-3f0655243f3f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:29.940725 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4a8a7022-31c2-4fb9-97ed-cc1dce8aba3c tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "75c911c7-ae44-4902-989f-3f0655243f3f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:29.943289 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-4a8a7022-31c2-4fb9-97ed-cc1dce8aba3c tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Terminating instance
May 28 01:57:30.179547 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:57:30.182988 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Searching for a device in session 62 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:57:30.183192 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:57:30.183440 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:57:30.320635 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Applying migration context for instance 12f40ca4-b4b3-43f4-8c0b-cb208f59935c as it has an incoming, in-progress migration fb013581-358b-4004-8e04-ae891cc5e071. Migration status is finished {{(pid=98241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}}
May 28 01:57:30.322504 np0000001583 nova-compute[98241]: INFO nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Updating resource usage from migration fb013581-358b-4004-8e04-ae891cc5e071
May 28 01:57:30.384163 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 5c36895c-9d2c-49be-b545-3658f535964a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:57:30.384320 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 75c911c7-ae44-4902-989f-3f0655243f3f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:57:30.384535 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 7078fbb1-fa4a-4589-9f95-9d95dee381e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:57:30.384716 np0000001583 nova-compute[98241]: WARNING nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance fbe845bb-c11e-4c97-85b8-4f3759e1bd22 is not being actively managed by this compute host but has allocations referencing this compute host: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. Skipping heal of allocation because we do not know what to do.
May 28 01:57:30.384868 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 1100d127-f3d6-416e-a646-b072660980bc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:57:30.385015 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Migration fb013581-358b-4004-8e04-ae891cc5e071 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}}
May 28 01:57:30.385197 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 12f40ca4-b4b3-43f4-8c0b-cb208f59935c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 256}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:57:30.385412 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 01:57:30.385580 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Final resource view: name=np0000001583 phys_ram=24030MB used_ram=1728MB phys_disk=95GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 01:57:29 up 33 min,  2 users,  load average: 7.57, 6.51, 3.41\n', 'num_instances': '5', 'num_vm_active': '4', 'num_task_None': '3', 'num_os_type_None': '5', 'num_proj_60fbdf5ed38b4dc485a81c49b3303ed2': '2', 'io_workload': '0', 'num_proj_2ba381dad8364a488a98b80c04cce8fb': '1', 'num_vm_resized': '1', 'num_task_resize_reverting': '1', 'num_proj_2db0b9fa3fcc47408dad261c2004e4a5': '1', 'num_task_resize_finish': '1', 'num_proj_837663bcfa40402aaf583729dfbb26cd': '1'} {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 01:57:30.453518 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-4a8a7022-31c2-4fb9-97ed-cc1dce8aba3c tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:57:30.479726 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:30.503567 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:30.540421 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:30.686055 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 28 01:57:30.686546 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933450.686174, 12f40ca4-b4b3-43f4-8c0b-cb208f59935c => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:57:30.686598 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] VM Started (Lifecycle Event)
May 28 01:57:30.710428 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-1fa7f3f1-0d2f-4a5d-8015-211a3034a2a3 req-0a1c39ce-8b4a-4d37-abfe-31f82ff84393 service nova] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Received event network-vif-unplugged-ba6c883b-68ef-4562-9163-932ef65f675c {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:57:30.713051 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-1fa7f3f1-0d2f-4a5d-8015-211a3034a2a3 req-0a1c39ce-8b4a-4d37-abfe-31f82ff84393 service nova] Acquiring lock "75c911c7-ae44-4902-989f-3f0655243f3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:30.713051 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-1fa7f3f1-0d2f-4a5d-8015-211a3034a2a3 req-0a1c39ce-8b4a-4d37-abfe-31f82ff84393 service nova] Lock "75c911c7-ae44-4902-989f-3f0655243f3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:30.713051 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-1fa7f3f1-0d2f-4a5d-8015-211a3034a2a3 req-0a1c39ce-8b4a-4d37-abfe-31f82ff84393 service nova] Lock "75c911c7-ae44-4902-989f-3f0655243f3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:30.713051 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-1fa7f3f1-0d2f-4a5d-8015-211a3034a2a3 req-0a1c39ce-8b4a-4d37-abfe-31f82ff84393 service nova] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] No waiting events found dispatching network-vif-unplugged-ba6c883b-68ef-4562-9163-932ef65f675c {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:57:30.713051 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-1fa7f3f1-0d2f-4a5d-8015-211a3034a2a3 req-0a1c39ce-8b4a-4d37-abfe-31f82ff84393 service nova] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Received event network-vif-unplugged-ba6c883b-68ef-4562-9163-932ef65f675c for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:57:30.826971 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Instance destroyed successfully.
May 28 01:57:30.828770 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-4a8a7022-31c2-4fb9-97ed-cc1dce8aba3c tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lazy-loading 'resources' on Instance uuid 75c911c7-ae44-4902-989f-3f0655243f3f {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:57:30.951890 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:57:30.952375 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:57:31.033348 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Found WWN 3300000002607d8cf for multipath device dm-1 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:57:31.033902 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:57:31.034179 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] <== connect_volume: return (3038ms) {'type': 'block', 'scsi_wwn': '3300000002607d8cf', 'path': '/dev/dm-1', 'multipath_id': '3300000002607d8cf'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:57:31.034390 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002607d8cf', 'path': '/dev/dm-1', 'multipath_id': '3300000002607d8cf'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:57:31.192795 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:57:31.194856 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:57:31.331185 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-4a8a7022-31c2-4fb9-97ed-cc1dce8aba3c tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:54:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-447134881',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-serverbootfromvolumestablerescuetest-server-447134881',id=14,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:54:45Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ba381dad8364a488a98b80c04cce8fb',ramdisk_id='',reservation_id='r-15vrmhqd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1211567633',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:54:55Z,user_data=None,user_id='c3a7b14e31ee40cf9e4f4bba084ccaa5',uuid=75c911c7-ae44-4902-989f-3f0655243f3f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba6c883b-68ef-4562-9163-932ef65f675c", "address": "fa:16:3e:27:be:54", "network": {"id": "2ee43c4e-569f-4726-9700-add40d768203", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ba381dad8364a488a98b80c04cce8fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba6c883b-68", "ovs_interfaceid": "ba6c883b-68ef-4562-9163-932ef65f675c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:57:31.331435 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-4a8a7022-31c2-4fb9-97ed-cc1dce8aba3c tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Converting VIF {"id": "ba6c883b-68ef-4562-9163-932ef65f675c", "address": "fa:16:3e:27:be:54", "network": {"id": "2ee43c4e-569f-4726-9700-add40d768203", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1396213262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ba381dad8364a488a98b80c04cce8fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba6c883b-68", "ovs_interfaceid": "ba6c883b-68ef-4562-9163-932ef65f675c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:57:31.332191 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-4a8a7022-31c2-4fb9-97ed-cc1dce8aba3c tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:be:54,bridge_name='br-int',has_traffic_filtering=True,id=ba6c883b-68ef-4562-9163-932ef65f675c,network=Network(2ee43c4e-569f-4726-9700-add40d768203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba6c883b-68') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:57:31.332497 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-4a8a7022-31c2-4fb9-97ed-cc1dce8aba3c tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:be:54,bridge_name='br-int',has_traffic_filtering=True,id=ba6c883b-68ef-4562-9163-932ef65f675c,network=Network(2ee43c4e-569f-4726-9700-add40d768203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba6c883b-68') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:57:31.334387 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:31.334733 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba6c883b-68, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:31.335761 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:31.336532 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:57:31.337362 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:31.338652 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:31.338879 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3b591eb5-b029-4de8-9a67-070c552d86d4) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:31.339702 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:31.340640 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:57:31.342683 np0000001583 nova-compute[98241]: INFO os_vif [None req-4a8a7022-31c2-4fb9-97ed-cc1dce8aba3c tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:be:54,bridge_name='br-int',has_traffic_filtering=True,id=ba6c883b-68ef-4562-9163-932ef65f675c,network=Network(2ee43c4e-569f-4726-9700-add40d768203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba6c883b-68')
May 28 01:57:31.344099 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-4a8a7022-31c2-4fb9-97ed-cc1dce8aba3c tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Deleting instance files /opt/stack/data/nova/instances/75c911c7-ae44-4902-989f-3f0655243f3f_del
May 28 01:57:31.344099 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-4a8a7022-31c2-4fb9-97ed-cc1dce8aba3c tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Deletion of /opt/stack/data/nova/instances/75c911c7-ae44-4902-989f-3f0655243f3f_del complete
May 28 01:57:31.373470 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-dd89a88a-fade-4da4-8458-9d9ca21b176a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:31.373695 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-dd89a88a-fade-4da4-8458-9d9ca21b176a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:31.373760 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-dd89a88a-fade-4da4-8458-9d9ca21b176a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Going to confirm migration 2 {{(pid=98241) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}}
May 28 01:57:31.455322 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:57:31.540310 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:55:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1792038090',display_name='tempest-ServerActionsTestOtherB-server-1792038090',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-serveractionstestotherb-server-1792038090',id=21,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNeqI2aR1ssi4HNJOeFKCNjp+Pt+IJYlcdzP/eafAClJj6eROY4EAGFoc44ZS4UJO1qzGM7qaA7m9ha8h0zhGTrn53zFMwGuQ42KOAfa++4mKlE3DbzUB8ddEdTJR9n/hA==',key_name='tempest-keypair-738336147',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:57:12Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001583',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2db0b9fa3fcc47408dad261c2004e4a5',ramdisk_id='',reservation_id='r-aqj2v230',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-640844130',owner_user_name='tempest-ServerActionsTestOtherB-640844130-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:57:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f68ae604d0442439a927020cec740c0',uuid=7078fbb1-fa4a-4589-9f95-9d95dee381e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "address": "fa:16:3e:30:bd:e8", "network": {"id": "11b2c699-14f1-4eba-bbe6-b7655c6f17cc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1044342879-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2db0b9fa3fcc47408dad261c2004e4a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7567636b-72", "ovs_interfaceid": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:57:31.540550 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Converting VIF {"id": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "address": "fa:16:3e:30:bd:e8", "network": {"id": "11b2c699-14f1-4eba-bbe6-b7655c6f17cc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1044342879-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2db0b9fa3fcc47408dad261c2004e4a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7567636b-72", "ovs_interfaceid": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:57:31.541174 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:bd:e8,bridge_name='br-int',has_traffic_filtering=True,id=7567636b-7225-4025-b9f0-d4c8eb5abe43,network=Network(11b2c699-14f1-4eba-bbe6-b7655c6f17cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7567636b-72') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:57:31.544571 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] End _get_guest_xml xml=<domain type="qemu">
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:   <uuid>7078fbb1-fa4a-4589-9f95-9d95dee381e0</uuid>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:   <name>instance-00000015</name>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:       <nova:name>tempest-ServerActionsTestOtherB-server-1792038090</nova:name>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:57:27</nova:creationTime>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:         <nova:user uuid="8f68ae604d0442439a927020cec740c0">tempest-ServerActionsTestOtherB-640844130-project-member</nova:user>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:         <nova:project uuid="2db0b9fa3fcc47408dad261c2004e4a5">tempest-ServerActionsTestOtherB-640844130</nova:project>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:         <nova:port uuid="7567636b-7225-4025-b9f0-d4c8eb5abe43">
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:     <system>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:       <entry name="serial">7078fbb1-fa4a-4589-9f95-9d95dee381e0</entry>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:       <entry name="uuid">7078fbb1-fa4a-4589-9f95-9d95dee381e0</entry>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:     </system>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:   <os>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:   </os>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:   <features>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:   </features>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:   <devices>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0/disk"/>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:     </disk>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0/disk.config"/>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:     </disk>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:     <disk type="block" device="disk">
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:       <alias name="ua-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2"/>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:       <source dev="/dev/dm-1"/>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:       <target dev="vdb" bus="virtio"/>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:       <serial>ba26e203-0d5a-4c3d-b50d-9d38c042d9d2</serial>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:     </disk>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:30:bd:e8"/>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:       <target dev="tap7567636b-72"/>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:     </interface>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0/console.log" append="off"/>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:     </serial>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:     <video>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:     </video>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:     </rng>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:   </devices>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]: </domain>
May 28 01:57:31.544571 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:57:31.544571 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Preparing to wait for external event network-vif-plugged-7567636b-7225-4025-b9f0-d4c8eb5abe43 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:57:31.547190 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Acquiring lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:31.547190 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:31.547190 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:31.547190 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:55:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1792038090',display_name='tempest-ServerActionsTestOtherB-server-1792038090',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-serveractionstestotherb-server-1792038090',id=21,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNeqI2aR1ssi4HNJOeFKCNjp+Pt+IJYlcdzP/eafAClJj6eROY4EAGFoc44ZS4UJO1qzGM7qaA7m9ha8h0zhGTrn53zFMwGuQ42KOAfa++4mKlE3DbzUB8ddEdTJR9n/hA==',key_name='tempest-keypair-738336147',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:57:12Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001583',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2db0b9fa3fcc47408dad261c2004e4a5',ramdisk_id='',reservation_id='r-aqj2v230',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-640844130',owner_user_name='tempest-ServerActionsTestOtherB-640844130-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:57:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f68ae604d0442439a927020cec740c0',uuid=7078fbb1-fa4a-4589-9f95-9d95dee381e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "address": "fa:16:3e:30:bd:e8", "network": {"id": "11b2c699-14f1-4eba-bbe6-b7655c6f17cc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1044342879-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2db0b9fa3fcc47408dad261c2004e4a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7567636b-72", "ovs_interfaceid": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:57:31.547190 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Converting VIF {"id": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "address": "fa:16:3e:30:bd:e8", "network": {"id": "11b2c699-14f1-4eba-bbe6-b7655c6f17cc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1044342879-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2db0b9fa3fcc47408dad261c2004e4a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7567636b-72", "ovs_interfaceid": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:57:31.549102 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:bd:e8,bridge_name='br-int',has_traffic_filtering=True,id=7567636b-7225-4025-b9f0-d4c8eb5abe43,network=Network(11b2c699-14f1-4eba-bbe6-b7655c6f17cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7567636b-72') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:57:31.549102 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:bd:e8,bridge_name='br-int',has_traffic_filtering=True,id=7567636b-7225-4025-b9f0-d4c8eb5abe43,network=Network(11b2c699-14f1-4eba-bbe6-b7655c6f17cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7567636b-72') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:57:31.550931 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:31.555243 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:31.555514 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:57:31.556397 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:31.556682 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '15af2633-77b4-5bbb-af75-e68dce2f4585', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:31.558326 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:31.559183 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:57:31.588935 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:31.591003 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:31.591874 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7567636b-72, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:31.592238 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7567636b-72, col_values=(('qos', UUID('832d165e-65f0-4dc6-9e25-43ca773a30c9')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:31.592446 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7567636b-72, col_values=(('external_ids', {'iface-id': '7567636b-7225-4025-b9f0-d4c8eb5abe43', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:bd:e8', 'vm-uuid': '7078fbb1-fa4a-4589-9f95-9d95dee381e0'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:31.594043 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:31.595564 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:57:31.599050 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:31.600101 np0000001583 nova-compute[98241]: INFO os_vif [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:bd:e8,bridge_name='br-int',has_traffic_filtering=True,id=7567636b-7225-4025-b9f0-d4c8eb5abe43,network=Network(11b2c699-14f1-4eba-bbe6-b7655c6f17cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7567636b-72')
May 28 01:57:31.697388 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.99966842799995 future=<Future at 0x7724ec47b410 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:31.850669 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-4a8a7022-31c2-4fb9-97ed-cc1dce8aba3c tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Took 1.40 seconds to destroy the instance on the hypervisor.
May 28 01:57:31.851910 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-4a8a7022-31c2-4fb9-97ed-cc1dce8aba3c tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:57:31.852255 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:57:31.852479 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:57:31.852693 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:31.855332 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0015839229999983218 future=<Future at 0x7724ec1a9520 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:31.855469 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:31.855512 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=0.6015869489999659 future=<Future at 0x7724ec1aa7b0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:31.855680 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=0.6014813079998476 future=<Future at 0x7724ec1aa7b0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:31.881922 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-dd89a88a-fade-4da4-8458-9d9ca21b176a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:31.925333 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:31.964053 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Compute_service record updated for np0000001583:np0000001583 {{(pid=98241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 01:57:31.964053 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.662s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:31.964349 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 60.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:57:31.964780 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3caf6f2e-9a1e-4527-b63e-381bf346b829 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.578s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:31.967205 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3caf6f2e-9a1e-4527-b63e-381bf346b829 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:32.004127 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-dd89a88a-fade-4da4-8458-9d9ca21b176a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:32.004368 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-dd89a88a-fade-4da4-8458-9d9ca21b176a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "refresh_cache-12f40ca4-b4b3-43f4-8c0b-cb208f59935c" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:57:32.004485 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-dd89a88a-fade-4da4-8458-9d9ca21b176a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquired lock "refresh_cache-12f40ca4-b4b3-43f4-8c0b-cb208f59935c" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:57:32.004642 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-dd89a88a-fade-4da4-8458-9d9ca21b176a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:57:32.004786 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-dd89a88a-fade-4da4-8458-9d9ca21b176a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lazy-loading 'info_cache' on Instance uuid 12f40ca4-b4b3-43f4-8c0b-cb208f59935c {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:57:32.045568 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-3caf6f2e-9a1e-4527-b63e-381bf346b829 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Deleted allocations for instance fbe845bb-c11e-4c97-85b8-4f3759e1bd22
May 28 01:57:32.059511 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:32.068214 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:32.092751 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:32.215948 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:32.339602 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f06a3ad3-ce8c-44b7-920c-73ef87c4e541 req-5e696e9b-cac4-4434-a3fc-3484774da9ee service nova] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Received event network-vif-deleted-ba6c883b-68ef-4562-9163-932ef65f675c {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:57:32.340247 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-f06a3ad3-ce8c-44b7-920c-73ef87c4e541 req-5e696e9b-cac4-4434-a3fc-3484774da9ee service nova] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Neutron deleted interface ba6c883b-68ef-4562-9163-932ef65f675c; detaching it from the instance and deleting it from the info cache
May 28 01:57:32.343783 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f06a3ad3-ce8c-44b7-920c-73ef87c4e541 req-5e696e9b-cac4-4434-a3fc-3484774da9ee service nova] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Detach interface failed, port_id=ba6c883b-68ef-4562-9163-932ef65f675c, reason: Instance 75c911c7-ae44-4902-989f-3f0655243f3f could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:57:32.457810 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0005195520000143006 future=<Future at 0x7724ec1aa7b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:32.461319 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Emitting event <LifecycleEvent: 1779933437.4570546, 7078fbb1-fa4a-4589-9f95-9d95dee381e0 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:57:32.461706 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:32.461872 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=0.6748779239999294 future=<Future at 0x7724f82ef7d0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:32.462161 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=0.6747649479998472 future=<Future at 0x7724f82ef7d0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:32.463356 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] VM Stopped (Lifecycle Event)
May 28 01:57:32.505101 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:32.511826 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:32.536568 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:32.749840 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:57:32.790529 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-adb982f4-58fc-4563-aae6-909c2781a16f req-40d5c3b0-410c-4e10-965c-971f87c4a7d9 service nova] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Received event network-vif-unplugged-ba6c883b-68ef-4562-9163-932ef65f675c {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:57:32.790772 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-adb982f4-58fc-4563-aae6-909c2781a16f req-40d5c3b0-410c-4e10-965c-971f87c4a7d9 service nova] Acquiring lock "75c911c7-ae44-4902-989f-3f0655243f3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:32.790893 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-adb982f4-58fc-4563-aae6-909c2781a16f req-40d5c3b0-410c-4e10-965c-971f87c4a7d9 service nova] Lock "75c911c7-ae44-4902-989f-3f0655243f3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:32.791071 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-adb982f4-58fc-4563-aae6-909c2781a16f req-40d5c3b0-410c-4e10-965c-971f87c4a7d9 service nova] Lock "75c911c7-ae44-4902-989f-3f0655243f3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:32.791263 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-adb982f4-58fc-4563-aae6-909c2781a16f req-40d5c3b0-410c-4e10-965c-971f87c4a7d9 service nova] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] No waiting events found dispatching network-vif-unplugged-ba6c883b-68ef-4562-9163-932ef65f675c {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:57:32.791717 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-adb982f4-58fc-4563-aae6-909c2781a16f req-40d5c3b0-410c-4e10-965c-971f87c4a7d9 service nova] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Received event network-vif-unplugged-ba6c883b-68ef-4562-9163-932ef65f675c for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:57:32.791867 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-adb982f4-58fc-4563-aae6-909c2781a16f req-40d5c3b0-410c-4e10-965c-971f87c4a7d9 service nova] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Received event network-vif-plugged-7567636b-7225-4025-b9f0-d4c8eb5abe43 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:57:32.792005 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-adb982f4-58fc-4563-aae6-909c2781a16f req-40d5c3b0-410c-4e10-965c-971f87c4a7d9 service nova] Acquiring lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:32.792172 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-adb982f4-58fc-4563-aae6-909c2781a16f req-40d5c3b0-410c-4e10-965c-971f87c4a7d9 service nova] Lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:32.792298 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-adb982f4-58fc-4563-aae6-909c2781a16f req-40d5c3b0-410c-4e10-965c-971f87c4a7d9 service nova] Lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:32.792427 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-adb982f4-58fc-4563-aae6-909c2781a16f req-40d5c3b0-410c-4e10-965c-971f87c4a7d9 service nova] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Processing event network-vif-plugged-7567636b-7225-4025-b9f0-d4c8eb5abe43 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:57:32.792573 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-adb982f4-58fc-4563-aae6-909c2781a16f req-40d5c3b0-410c-4e10-965c-971f87c4a7d9 service nova] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Received event network-vif-plugged-7567636b-7225-4025-b9f0-d4c8eb5abe43 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:57:32.792710 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-adb982f4-58fc-4563-aae6-909c2781a16f req-40d5c3b0-410c-4e10-965c-971f87c4a7d9 service nova] Acquiring lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:32.792961 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-adb982f4-58fc-4563-aae6-909c2781a16f req-40d5c3b0-410c-4e10-965c-971f87c4a7d9 service nova] Lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:32.793143 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-adb982f4-58fc-4563-aae6-909c2781a16f req-40d5c3b0-410c-4e10-965c-971f87c4a7d9 service nova] Lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:32.793281 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-adb982f4-58fc-4563-aae6-909c2781a16f req-40d5c3b0-410c-4e10-965c-971f87c4a7d9 service nova] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] No waiting events found dispatching network-vif-plugged-7567636b-7225-4025-b9f0-d4c8eb5abe43 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:57:32.793870 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-adb982f4-58fc-4563-aae6-909c2781a16f req-40d5c3b0-410c-4e10-965c-971f87c4a7d9 service nova] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Received unexpected event network-vif-plugged-7567636b-7225-4025-b9f0-d4c8eb5abe43 for instance with vm_state resized and task_state resize_reverting.
May 28 01:57:32.965656 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:57:33.012891 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-dd89a88a-fade-4da4-8458-9d9ca21b176a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:33.057386 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3caf6f2e-9a1e-4527-b63e-381bf346b829 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "fbe845bb-c11e-4c97-85b8-4f3759e1bd22" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.639s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:33.076803 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:33.082615 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:57:33.083369 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933453.0829816, 7078fbb1-fa4a-4589-9f95-9d95dee381e0 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:57:33.083584 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] VM Started (Lifecycle Event)
May 28 01:57:33.092175 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Instance running successfully.
May 28 01:57:33.092554 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] finish_revert_migration finished successfully. {{(pid=98241) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12978}}
May 28 01:57:33.137146 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.00035364200016374525 future=<Future at 0x7724f82ef7d0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:33.137367 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:33.137765 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] Emitting event <LifecycleEvent: 1779933438.1366765, 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:57:33.137984 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] VM Stopped (Lifecycle Event)
May 28 01:57:33.139213 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=0.65968040499979 future=<Future at 0x7724f82ee930 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:33.139811 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=0.6590921719998732 future=<Future at 0x7724f82ee930 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:33.252530 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Took 1.40 seconds to deallocate network for instance.
May 28 01:57:33.399012 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-dd89a88a-fade-4da4-8458-9d9ca21b176a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:33.589822 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:57:33.591493 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:57:33.599403 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-dd89a88a-fade-4da4-8458-9d9ca21b176a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Updating instance_info_cache with network_info: [{"id": "bce4c127-622b-4001-a5df-94a04616b08e", "address": "fa:16:3e:b1:89:97", "network": {"id": "b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-280876007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60fbdf5ed38b4dc485a81c49b3303ed2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbce4c127-62", "ovs_interfaceid": "bce4c127-622b-4001-a5df-94a04616b08e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:57:33.642829 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a18f6712-80d8-4b32-b13d-64aedb66630f tempest-TaggedBootDevicesTest-1330490836 tempest-TaggedBootDevicesTest-1330490836-project-member] [instance: 8ca40c7c-3673-4e3d-8a7b-af1f1b056fc4] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:57:33.760047 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4a8a7022-31c2-4fb9-97ed-cc1dce8aba3c tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:33.760047 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4a8a7022-31c2-4fb9-97ed-cc1dce8aba3c tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:33.800060 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0011517750001530658 future=<Future at 0x7724f82ee930 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:33.800168 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:33.800270 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=0.4759592100001555 future=<Future at 0x7724ec34dac0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:33.800342 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=0.47587803500005066 future=<Future at 0x7724ec34dac0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:33.802196 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Emitting event <LifecycleEvent: 1779933438.79882, ea9459ae-6246-4d11-b46b-733449884b1b => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:57:33.802842 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] VM Stopped (Lifecycle Event)
May 28 01:57:34.098208 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] During sync_power_state the instance has a pending task (resize_reverting). Skip.
May 28 01:57:34.099826 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933454.0986292, 7078fbb1-fa4a-4589-9f95-9d95dee381e0 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:57:34.099826 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] VM Paused (Lifecycle Event)
May 28 01:57:34.112511 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-dd89a88a-fade-4da4-8458-9d9ca21b176a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Releasing lock "refresh_cache-12f40ca4-b4b3-43f4-8c0b-cb208f59935c" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:57:34.112739 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-dd89a88a-fade-4da4-8458-9d9ca21b176a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lazy-loading 'migration_context' on Instance uuid 12f40ca4-b4b3-43f4-8c0b-cb208f59935c {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:57:34.170861 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-a71cc3bc-c5b9-4f21-babf-a96949f84de4 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Updating instance to original state: 'active'
May 28 01:57:34.190096 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4a8a7022-31c2-4fb9-97ed-cc1dce8aba3c tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:57:34.190096 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-4a8a7022-31c2-4fb9-97ed-cc1dce8aba3c tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:57:34.276913 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0006058599999505532 future=<Future at 0x7724ec34dac0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:34.277563 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-a48597d6-d1e4-4992-8756-342c7ee11329 None None] Emitting event <LifecycleEvent: 1779933439.276176, 533f5dcc-2e48-4280-84b3-facb02dea136 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:57:34.277732 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:34.277996 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-a48597d6-d1e4-4992-8756-342c7ee11329 None None] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] VM Stopped (Lifecycle Event)
May 28 01:57:34.280317 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=6.008509776999972 future=<Future at 0x7724ec48c200 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:34.280449 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=6.008338200999788 future=<Future at 0x7724ec48c200 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:34.305352 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: ea9459ae-6246-4d11-b46b-733449884b1b] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:57:34.311090 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:57:34.605736 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:57:34.607423 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933454.6071584, 7078fbb1-fa4a-4589-9f95-9d95dee381e0 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:57:34.607770 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] VM Resumed (Lifecycle Event)
May 28 01:57:34.620176 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-dd89a88a-fade-4da4-8458-9d9ca21b176a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Object Instance<12f40ca4-b4b3-43f4-8c0b-cb208f59935c> lazy-loaded attributes: info_cache,migration_context {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:57:34.621624 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-dd89a88a-fade-4da4-8458-9d9ca21b176a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:34.690814 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-4a8a7022-31c2-4fb9-97ed-cc1dce8aba3c tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:57:34.780465 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a48597d6-d1e4-4992-8756-342c7ee11329 None None] [instance: 533f5dcc-2e48-4280-84b3-facb02dea136] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:57:35.111659 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:57:35.117608 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:57:35.199658 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4a8a7022-31c2-4fb9-97ed-cc1dce8aba3c tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.440s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:35.201550 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-dd89a88a-fade-4da4-8458-9d9ca21b176a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.578s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:35.275436 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-4a8a7022-31c2-4fb9-97ed-cc1dce8aba3c tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Deleted allocations for instance 75c911c7-ae44-4902-989f-3f0655243f3f
May 28 01:57:36.106153 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-dd89a88a-fade-4da4-8458-9d9ca21b176a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:57:36.106153 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-dd89a88a-fade-4da4-8458-9d9ca21b176a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:57:36.291837 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4a8a7022-31c2-4fb9-97ed-cc1dce8aba3c tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Lock "75c911c7-ae44-4902-989f-3f0655243f3f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.351s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:36.359659 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Acquiring lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:36.359895 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:36.360171 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Acquiring lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:36.360366 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:36.360509 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:36.363988 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Terminating instance
May 28 01:57:36.594768 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:36.607448 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-dd89a88a-fade-4da4-8458-9d9ca21b176a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:57:36.866106 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:57:36.892366 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:36.897980 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:36.923875 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:36.927368 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:36.961965 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:36.966028 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:37.053972 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-82c2dc45-5ea6-496a-a4de-b9f7d4c28f73 req-8dc4a262-6b2d-457a-ad81-05ca538f3992 service nova] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Received event network-vif-unplugged-7567636b-7225-4025-b9f0-d4c8eb5abe43 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:57:37.054190 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-82c2dc45-5ea6-496a-a4de-b9f7d4c28f73 req-8dc4a262-6b2d-457a-ad81-05ca538f3992 service nova] Acquiring lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:37.054689 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-82c2dc45-5ea6-496a-a4de-b9f7d4c28f73 req-8dc4a262-6b2d-457a-ad81-05ca538f3992 service nova] Lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:37.055033 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-82c2dc45-5ea6-496a-a4de-b9f7d4c28f73 req-8dc4a262-6b2d-457a-ad81-05ca538f3992 service nova] Lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:37.055386 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-82c2dc45-5ea6-496a-a4de-b9f7d4c28f73 req-8dc4a262-6b2d-457a-ad81-05ca538f3992 service nova] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] No waiting events found dispatching network-vif-unplugged-7567636b-7225-4025-b9f0-d4c8eb5abe43 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:57:37.055658 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-82c2dc45-5ea6-496a-a4de-b9f7d4c28f73 req-8dc4a262-6b2d-457a-ad81-05ca538f3992 service nova] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Received event network-vif-unplugged-7567636b-7225-4025-b9f0-d4c8eb5abe43 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:57:37.170815 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:37.200535 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:37.225651 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999579006999966 future=<Future at 0x7724f82ee930 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:37.229474 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Instance destroyed successfully.
May 28 01:57:37.229474 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lazy-loading 'resources' on Instance uuid 7078fbb1-fa4a-4589-9f95-9d95dee381e0 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:57:37.619136 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:37.621443 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-dd89a88a-fade-4da4-8458-9d9ca21b176a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 2.421s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:37.626011 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:37.629966 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:37.657175 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:37.665122 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:37.736384 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:55:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1792038090',display_name='tempest-ServerActionsTestOtherB-server-1792038090',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-serveractionstestotherb-server-1792038090',id=21,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNeqI2aR1ssi4HNJOeFKCNjp+Pt+IJYlcdzP/eafAClJj6eROY4EAGFoc44ZS4UJO1qzGM7qaA7m9ha8h0zhGTrn53zFMwGuQ42KOAfa++4mKlE3DbzUB8ddEdTJR9n/hA==',key_name='tempest-keypair-738336147',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:57:33Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2db0b9fa3fcc47408dad261c2004e4a5',ramdisk_id='',reservation_id='r-aqj2v230',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-640844130',owner_user_name='tempest-ServerActionsTestOtherB-640844130-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:57:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f68ae604d0442439a927020cec740c0',uuid=7078fbb1-fa4a-4589-9f95-9d95dee381e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "address": "fa:16:3e:30:bd:e8", "network": {"id": "11b2c699-14f1-4eba-bbe6-b7655c6f17cc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1044342879-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2db0b9fa3fcc47408dad261c2004e4a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7567636b-72", "ovs_interfaceid": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:57:37.736622 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Converting VIF {"id": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "address": "fa:16:3e:30:bd:e8", "network": {"id": "11b2c699-14f1-4eba-bbe6-b7655c6f17cc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1044342879-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2db0b9fa3fcc47408dad261c2004e4a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7567636b-72", "ovs_interfaceid": "7567636b-7225-4025-b9f0-d4c8eb5abe43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:57:37.737321 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:bd:e8,bridge_name='br-int',has_traffic_filtering=True,id=7567636b-7225-4025-b9f0-d4c8eb5abe43,network=Network(11b2c699-14f1-4eba-bbe6-b7655c6f17cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7567636b-72') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:57:37.737637 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:bd:e8,bridge_name='br-int',has_traffic_filtering=True,id=7567636b-7225-4025-b9f0-d4c8eb5abe43,network=Network(11b2c699-14f1-4eba-bbe6-b7655c6f17cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7567636b-72') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:57:37.740401 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:37.740401 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7567636b-72, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:37.742258 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:37.743869 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:57:37.744358 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:37.744509 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=832d165e-65f0-4dc6-9e25-43ca773a30c9) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:37.745698 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:37.746875 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:57:37.748739 np0000001583 nova-compute[98241]: INFO os_vif [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:bd:e8,bridge_name='br-int',has_traffic_filtering=True,id=7567636b-7225-4025-b9f0-d4c8eb5abe43,network=Network(11b2c699-14f1-4eba-bbe6-b7655c6f17cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7567636b-72')
May 28 01:57:37.750146 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:57:37.750506 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:57:37.750688 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:57:37.751066 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:57:37.751381 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:57:37.751545 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:57:37.770720 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "258fd5d8-1ab7-4d19-afe7-421297b99684" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:37.771016 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "258fd5d8-1ab7-4d19-afe7-421297b99684" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:37.777700 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:37.780469 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:37.784799 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:37.784799 np0000001583 nova-compute[98241]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:37.784799 np0000001583 nova-compute[98241]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:57:37.784799 np0000001583 nova-compute[98241]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:57:37.784799 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:57:37.784799 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsi session list stdout=tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:37.784799 np0000001583 nova-compute[98241]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:37.784799 np0000001583 nova-compute[98241]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:57:37.784799 np0000001583 nova-compute[98241]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2 (non-flash)
May 28 01:57:37.784799 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:57:37.785107 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', '60'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', '61'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', '62'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', '63')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:57:37.785169 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', '62')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:57:37.790786 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2', '63')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:57:37.791752 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f8155300>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2'): ({'sde'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:57:37.792042 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Removing multipathed devices sdd, sde {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:57:37.792385 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Flush multipath device 3300000002607d8cf {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:57:37.813234 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:37.830751 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:57:37.873220 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:57:37.928032 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:57:37.929040 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:57:37.929040 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:57:37.944573 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:57:37.944573 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:57:37.958111 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:37.994181 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2, portal: 192.168.40.100,3260]
May 28 01:57:37.994181 np0000001583 nova-compute[98241]: Logout of [sid: 62, target: iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2, portal: 192.168.40.100,3260] successful.
May 28 01:57:37.994181 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:38.010777 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:38.022177 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:38.049985 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2, portal: 192.168.50.100,3260]
May 28 01:57:38.049985 np0000001583 nova-compute[98241]: Logout of [sid: 63, target: iqn.2023-03.storpool.com:os--volume-ba26e203-0d5a-4c3d-b50d-9d38c042d9d2, portal: 192.168.50.100,3260] successful.
May 28 01:57:38.049985 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:38.065931 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:38.066189 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:57:38.066373 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] <== disconnect_volume: return (315ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:57:38.066520 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:57:38.067398 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Deleting instance files /opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0_del
May 28 01:57:38.072425 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Deletion of /opt/stack/data/nova/instances/7078fbb1-fa4a-4589-9f95-9d95dee381e0_del complete
May 28 01:57:38.076228 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:38.274928 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-dd89a88a-fade-4da4-8458-9d9ca21b176a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Deleted allocation for migration fb013581-358b-4004-8e04-ae891cc5e071
May 28 01:57:38.278916 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:57:38.581578 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Took 1.72 seconds to destroy the instance on the hypervisor.
May 28 01:57:38.582824 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:57:38.582946 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:57:38.583063 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:57:38.583306 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:38.678235 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:38.728105 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:38.787110 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-dd89a88a-fade-4da4-8458-9d9ca21b176a tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 7.411s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:38.840493 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:38.840665 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:38.844313 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:57:38.844475 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Claim successful on node np0000001583
May 28 01:57:39.143660 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e9d036f3-cc58-408e-adb6-eb35a4079d9f req-fb4d13d7-6bfe-48c7-b41f-6a6a0d0d9077 service nova] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Received event network-vif-unplugged-7567636b-7225-4025-b9f0-d4c8eb5abe43 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:57:39.144015 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e9d036f3-cc58-408e-adb6-eb35a4079d9f req-fb4d13d7-6bfe-48c7-b41f-6a6a0d0d9077 service nova] Acquiring lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:39.144432 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e9d036f3-cc58-408e-adb6-eb35a4079d9f req-fb4d13d7-6bfe-48c7-b41f-6a6a0d0d9077 service nova] Lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:39.144432 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e9d036f3-cc58-408e-adb6-eb35a4079d9f req-fb4d13d7-6bfe-48c7-b41f-6a6a0d0d9077 service nova] Lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:39.144951 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e9d036f3-cc58-408e-adb6-eb35a4079d9f req-fb4d13d7-6bfe-48c7-b41f-6a6a0d0d9077 service nova] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] No waiting events found dispatching network-vif-unplugged-7567636b-7225-4025-b9f0-d4c8eb5abe43 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:57:39.145039 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e9d036f3-cc58-408e-adb6-eb35a4079d9f req-fb4d13d7-6bfe-48c7-b41f-6a6a0d0d9077 service nova] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Received event network-vif-unplugged-7567636b-7225-4025-b9f0-d4c8eb5abe43 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:57:39.266488 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9906e232-536e-4719-9ada-e884d96424da req-ef481d62-897c-4593-acbf-cf550ec28855 service nova] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Received event network-vif-deleted-7567636b-7225-4025-b9f0-d4c8eb5abe43 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:57:39.267340 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-9906e232-536e-4719-9ada-e884d96424da req-ef481d62-897c-4593-acbf-cf550ec28855 service nova] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Neutron deleted interface 7567636b-7225-4025-b9f0-d4c8eb5abe43; detaching it from the instance and deleting it from the info cache
May 28 01:57:39.269445 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9906e232-536e-4719-9ada-e884d96424da req-ef481d62-897c-4593-acbf-cf550ec28855 service nova] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Detach interface failed, port_id=7567636b-7225-4025-b9f0-d4c8eb5abe43, reason: Instance 7078fbb1-fa4a-4589-9f95-9d95dee381e0 could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:57:39.347209 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-db27fb8b-bcb6-4ab5-84ea-0908bf9a8722 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Get console output
May 28 01:57:39.454316 np0000001583 nova-compute[98241]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
May 28 01:57:39.692517 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:57:40.188709 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:57:40.188922 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:57:40.195757 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Took 1.61 seconds to deallocate network for instance.
May 28 01:57:40.289216 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.00036951200013390917 future=<Future at 0x7724ec48c200 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:40.289426 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:40.289660 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Emitting event <LifecycleEvent: 1779933445.2887297, fbe845bb-c11e-4c97-85b8-4f3759e1bd22 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:57:40.289833 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=6.40721121699994 future=<Future at 0x7724ec47b410 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:40.289990 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] VM Stopped (Lifecycle Event)
May 28 01:57:40.291573 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=6.405443474999856 future=<Future at 0x7724ec47b410 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:40.691999 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:57:40.767260 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Took 0.57 seconds to detach 1 volumes for instance.
May 28 01:57:40.793506 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: fbe845bb-c11e-4c97-85b8-4f3759e1bd22] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:57:41.203610 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.363s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:41.203983 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:57:41.273423 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:41.273590 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:41.639974 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:57:41.640250 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:57:41.713403 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:57:41.713826 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:57:41.714309 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:41.714435 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:41.812944 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6be314b4eed642c3b2c72fe115860220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432aa1094ced436494def17a875aa8e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:57:42.145018 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:57:42.218947 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:57:42.241807 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Successfully created port: e2e9b3d8-d03e-4deb-99a4-92bd5370674d {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:57:42.658401 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.385s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:42.721559 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:57:42.725596 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Deleted allocations for instance 7078fbb1-fa4a-4589-9f95-9d95dee381e0
May 28 01:57:42.745455 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:42.859056 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Successfully updated port: e2e9b3d8-d03e-4deb-99a4-92bd5370674d {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:57:42.941500 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-52b9680c-1960-4b09-b110-e197472a0229 req-813ae18a-fc75-4d05-a9cb-95b58b0ae55b service nova] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Received event network-changed-e2e9b3d8-d03e-4deb-99a4-92bd5370674d {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:57:42.942386 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-52b9680c-1960-4b09-b110-e197472a0229 req-813ae18a-fc75-4d05-a9cb-95b58b0ae55b service nova] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Refreshing instance network info cache due to event network-changed-e2e9b3d8-d03e-4deb-99a4-92bd5370674d. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:57:42.942457 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-52b9680c-1960-4b09-b110-e197472a0229 req-813ae18a-fc75-4d05-a9cb-95b58b0ae55b service nova] Acquiring lock "refresh_cache-258fd5d8-1ab7-4d19-afe7-421297b99684" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:57:42.942525 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-52b9680c-1960-4b09-b110-e197472a0229 req-813ae18a-fc75-4d05-a9cb-95b58b0ae55b service nova] Acquired lock "refresh_cache-258fd5d8-1ab7-4d19-afe7-421297b99684" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:57:42.942635 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-52b9680c-1960-4b09-b110-e197472a0229 req-813ae18a-fc75-4d05-a9cb-95b58b0ae55b service nova] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Refreshing network info cache for port e2e9b3d8-d03e-4deb-99a4-92bd5370674d {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:57:43.077934 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:43.226320 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Booting with volume 652e60a5-d4d1-48ab-9219-95bf7e8bf048 at /dev/vda
May 28 01:57:43.280721 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:57:43.293110 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:57:43.322108 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:57:43.360506 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:57:43.362800 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "refresh_cache-258fd5d8-1ab7-4d19-afe7-421297b99684" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:57:43.363383 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:57:43.372197 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:57:43.375191 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe63:2bb1', 'fe80::e43a:d5ff:fecc:27fe', 'fe80::fc16:3eff:fe92:e25b', 'fe80::ecb9:b7ff:fe00:dc63', 'fe80::fc16:3eff:feb1:8997'] 
May 28 01:57:43.375191 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:57:43.375191 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:57:43.375191 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] <== get_connector_properties: return (93ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:57:43.375191 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Updating existing volume attachment record: 9059ae69-0408-4c9f-b04c-0ffc97b480dc {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:57:43.446146 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-52b9680c-1960-4b09-b110-e197472a0229 req-813ae18a-fc75-4d05-a9cb-95b58b0ae55b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:43.476380 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:43.557260 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-52b9680c-1960-4b09-b110-e197472a0229 req-813ae18a-fc75-4d05-a9cb-95b58b0ae55b service nova] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:57:43.738885 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-bd132064-1ad3-4fff-982a-ef7b154056c6 tempest-ServerActionsTestOtherB-640844130 tempest-ServerActionsTestOtherB-640844130-project-member] Lock "7078fbb1-fa4a-4589-9f95-9d95dee381e0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.379s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:43.766780 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-52b9680c-1960-4b09-b110-e197472a0229 req-813ae18a-fc75-4d05-a9cb-95b58b0ae55b service nova] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:57:44.270560 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-52b9680c-1960-4b09-b110-e197472a0229 req-813ae18a-fc75-4d05-a9cb-95b58b0ae55b service nova] Releasing lock "refresh_cache-258fd5d8-1ab7-4d19-afe7-421297b99684" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:57:44.271089 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquired lock "refresh_cache-258fd5d8-1ab7-4d19-afe7-421297b99684" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:57:44.271259 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:57:44.852192 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:57:45.013104 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:45.161734 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Updating instance_info_cache with network_info: [{"id": "e2e9b3d8-d03e-4deb-99a4-92bd5370674d", "address": "fa:16:3e:ee:f0:63", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e9b3d8-d0", "ovs_interfaceid": "e2e9b3d8-d03e-4deb-99a4-92bd5370674d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:57:45.507636 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:57:45.508764 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:57:45.509001 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Creating image(s)
May 28 01:57:45.509338 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Did not create local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 01:57:45.509493 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Ensure instance console log exists: /opt/stack/data/nova/instances/258fd5d8-1ab7-4d19-afe7-421297b99684/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:57:45.509737 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:45.509906 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:45.510017 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:45.549614 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:45.666817 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Releasing lock "refresh_cache-258fd5d8-1ab7-4d19-afe7-421297b99684" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:57:45.667104 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Instance network_info: |[{"id": "e2e9b3d8-d03e-4deb-99a4-92bd5370674d", "address": "fa:16:3e:ee:f0:63", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e9b3d8-d0", "ovs_interfaceid": "e2e9b3d8-d03e-4deb-99a4-92bd5370674d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:57:45.667699 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Start _get_guest_xml network_info=[{"id": "e2e9b3d8-d03e-4deb-99a4-92bd5370674d", "address": "fa:16:3e:ee:f0:63", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e9b3d8-d0", "ovs_interfaceid": "e2e9b3d8-d03e-4deb-99a4-92bd5370674d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048', 'iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '652e60a5-d4d1-48ab-9219-95bf7e8bf048', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '258fd5d8-1ab7-4d19-afe7-421297b99684', 'attached_at': '', 'detached_at': '', 'volume_id': '652e60a5-d4d1-48ab-9219-95bf7e8bf048', 'serial': '652e60a5-d4d1-48ab-9219-95bf7e8bf048'}, 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '9059ae69-0408-4c9f-b04c-0ffc97b480dc', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:57:45.670581 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:57:45.671757 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1286123612', uuid='258fd5d8-1ab7-4d19-afe7-421297b99684'), owner=OwnerMeta(userid='6be314b4eed642c3b2c72fe115860220', username='tempest-TestVolumeBootPattern-1031057169-project-member', projectid='432aa1094ced436494def17a875aa8e1', projectname='tempest-TestVolumeBootPattern-1031057169'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e2e9b3d8-d03e-4deb-99a4-92bd5370674d", "address": "fa:16:3e:ee:f0:63", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e9b3d8-d0", "ovs_interfaceid": "e2e9b3d8-d03e-4deb-99a4-92bd5370674d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933465.6713295) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:57:45.673674 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:57:45.673987 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:57:45.674766 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:57:45.674928 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:57:45.675790 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:57:45.676049 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:57:45.676230 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:57:45.676321 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:57:45.676435 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:57:45.676513 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:57:45.676600 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:57:45.676759 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:57:45.676845 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:57:45.676948 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:57:45.677058 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:57:45.677204 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:57:45.686502 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:57:45.686799 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048', 'iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '652e60a5-d4d1-48ab-9219-95bf7e8bf048', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:57:45.686954 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:57:45.687291 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:57:45.687467 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048', 'iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '652e60a5-d4d1-48ab-9219-95bf7e8bf048', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:57:45.700458 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:57:45.700917 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:57:45.701313 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:57:45.701488 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:57:45.702548 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:57:45.702548 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:57:45.713499 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:57:45.713499 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:45.722133 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:57:45.722133 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:45.728288 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048] added
May 28 01:57:45.728288 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:57:45.728288 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:57:45.728288 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:57:45.728288 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:57:45.728288 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:57:45.728288 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:45.728503 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:57:45.728854 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0272(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:57:45.729057 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:57:45.738321 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048] added
May 28 01:57:45.738321 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:57:45.738321 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:57:45.738321 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:57:45.738321 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:57:45.738321 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:57:45.738321 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:45.738600 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:57:45.738600 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0361(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:57:45.738736 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:57:46.697580 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0005248840000149357 future=<Future at 0x7724ec47b410 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:46.699196 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Emitting event <LifecycleEvent: 1779933451.696929, 75c911c7-ae44-4902-989f-3f0655243f3f => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:57:46.699676 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] VM Stopped (Lifecycle Event)
May 28 01:57:46.705494 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:46.705494 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=5.519855599000039 future=<Future at 0x7724f82ee930 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:46.705494 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=5.519692467999903 future=<Future at 0x7724f82ee930 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:46.730346 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:57:46.740509 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:57:46.754267 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:57:46.754267 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:57:46.764815 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:57:46.764815 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:46.774948 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:46.781024 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:46.794888 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:46.794888 np0000001583 nova-compute[98241]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:46.794888 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:57:46.794888 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:46.794888 np0000001583 nova-compute[98241]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:46.794888 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:57:46.801454 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:46.801454 np0000001583 nova-compute[98241]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:46.801454 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:57:46.801636 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:46.801636 np0000001583 nova-compute[98241]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:46.801636 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:57:46.828802 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048, portal: 192.168.40.100,3260]
May 28 01:57:46.828802 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048, portal: 192.168.40.100,3260] successful.
May 28 01:57:46.828802 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:46.842098 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048, portal: 192.168.50.100,3260]
May 28 01:57:46.842098 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048, portal: 192.168.50.100,3260] successful.
May 28 01:57:46.842098 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:46.848918 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:46.858161 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:46.867921 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:46.867921 np0000001583 nova-compute[98241]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:46.867921 np0000001583 nova-compute[98241]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048 (non-flash)
May 28 01:57:46.867921 np0000001583 nova-compute[98241]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048 (non-flash)
May 28 01:57:46.867921 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:57:46.868193 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:46.868193 np0000001583 nova-compute[98241]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:46.868193 np0000001583 nova-compute[98241]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048 (non-flash)
May 28 01:57:46.868193 np0000001583 nova-compute[98241]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048 (non-flash)
May 28 01:57:46.868193 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:57:46.868352 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.167s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:57:46.868624 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:57:46.869206 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] HCTL ('9', '-', '-', 0) found on session 64 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:57:46.869318 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:57:46.879568 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:46.879568 np0000001583 nova-compute[98241]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:46.879568 np0000001583 nova-compute[98241]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048 (non-flash)
May 28 01:57:46.879568 np0000001583 nova-compute[98241]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048 (non-flash)
May 28 01:57:46.879568 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:57:46.879814 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:46.879814 np0000001583 nova-compute[98241]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:46.879814 np0000001583 nova-compute[98241]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048 (non-flash)
May 28 01:57:46.879814 np0000001583 nova-compute[98241]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048 (non-flash)
May 28 01:57:46.879814 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:57:46.879960 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.178s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:57:46.880094 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:57:46.880677 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] HCTL ('10', '-', '-', 0) found on session 65 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:57:46.880763 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:57:46.897008 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Searching for a device in session 64 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:57:46.897008 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '652e60a5-d4d1-48ab-9219-95bf7e8bf048', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:57:46.907769 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Searching for a device in session 65 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:57:46.907872 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '652e60a5-d4d1-48ab-9219-95bf7e8bf048', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:57:47.207338 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1632c1d5-8ae9-4e92-8651-3ae24867a2e3 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 75c911c7-ae44-4902-989f-3f0655243f3f] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:57:47.648579 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquiring lock "659c56a6-743a-45e2-aa21-7d45c672f094" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:47.648869 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "659c56a6-743a-45e2-aa21-7d45c672f094" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:47.705492 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:57:47.748611 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:47.766233 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:48.079510 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:48.151195 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:57:48.405888 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquiring lock "0d87a47f-2eb6-4e25-b44a-848fe2225962" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:48.406038 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "0d87a47f-2eb6-4e25-b44a-848fe2225962" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:48.695704 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:48.695951 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:48.699644 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:57:48.699812 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Claim successful on node np0000001583
May 28 01:57:48.721526 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Found WWN 3300000001af12c99 for multipath device dm-1 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:57:48.721940 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:57:48.723286 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] <== connect_volume: return (3036ms) {'type': 'block', 'scsi_wwn': '3300000001af12c99', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '3300000001af12c99'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:57:48.723442 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000001af12c99', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '3300000001af12c99'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:57:48.755950 np0000001583 nova-compute[98241]: DEBUG os_brick.encryptors [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048', 'iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '652e60a5-d4d1-48ab-9219-95bf7e8bf048', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, 'status': 'reserved', 'instance': '258fd5d8-1ab7-4d19-afe7-421297b99684', 'attached_at': '', 'detached_at': '', 'volume_id': '652e60a5-d4d1-48ab-9219-95bf7e8bf048', 'serial': '652e60a5-d4d1-48ab-9219-95bf7e8bf048'} {{(pid=98241) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 01:57:48.756908 np0000001583 nova-compute[98241]: WARNING stevedore.named [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 01:57:48.757277 np0000001583 nova-compute[98241]: WARNING castellan.key_manager [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 01:57:48.757536 np0000001583 nova-compute[98241]: WARNING nova.keymgr.conf_key_mgr [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 01:57:48.758269 np0000001583 nova-compute[98241]: DEBUG os_brick.encryptors [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x7724ec496210>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048', 'iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '652e60a5-d4d1-48ab-9219-95bf7e8bf048', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, 'status': 'reserved', 'instance': '258fd5d8-1ab7-4d19-afe7-421297b99684', 'attached_at': '', 'detached_at': '', 'volume_id': '652e60a5-d4d1-48ab-9219-95bf7e8bf048', 'serial': '652e60a5-d4d1-48ab-9219-95bf7e8bf048'} {{(pid=98241) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 28 01:57:48.758501 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] os_brick.utils.get_passphrase_from_secret: the secret is not of type passphrase and will be converted using hex representation {{(pid=98241) get_passphrase_from_secret /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:486}}
May 28 01:57:48.758683 np0000001583 nova-compute[98241]: DEBUG os_brick.encryptors.luks [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] opening encrypted volume /dev/dm-1 {{(pid=98241) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 28 01:57:48.796500 np0000001583 nova-compute[98241]: WARNING os_brick.encryptors.luks [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 28 01:57:48.796732 np0000001583 nova-compute[98241]: INFO os_brick.encryptors.luks [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] /dev/dm-1 is not a valid LUKS device; formatting device for first use
May 28 01:57:48.796901 np0000001583 nova-compute[98241]: DEBUG os_brick.encryptors.luks [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] formatting encrypted volume /dev/dm-1 {{(pid=98241) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 28 01:57:48.908857 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:57:49.470915 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:50.067477 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:57:50.067942 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:57:50.571489 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:57:51.084227 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.388s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:51.085601 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.617s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:51.085812 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:57:51.092477 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:57:51.092690 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Claim successful on node np0000001583
May 28 01:57:51.592425 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:57:51.592725 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:57:51.593265 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:51.593611 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:51.687925 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '435dfce8f05e4e01b380797bd07bd4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65617e71571457f8906997583100678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:57:52.095300 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:57:52.137428 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:52.184042 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Successfully created port: 51ab6198-7fa5-4b12-8d53-effcff16e287 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:57:52.232500 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.007268888999988121 future=<Future at 0x7724f82ee930 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:52.232635 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:57:52.233541 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Emitting event <LifecycleEvent: 1779933457.2251203, 7078fbb1-fa4a-4589-9f95-9d95dee381e0 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:57:52.235255 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] VM Stopped (Lifecycle Event)
May 28 01:57:52.604860 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:57:52.631624 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:57:52.631946 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:57:52.739786 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: 7078fbb1-fa4a-4589-9f95-9d95dee381e0] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:57:52.752586 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:52.933755 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Successfully updated port: 51ab6198-7fa5-4b12-8d53-effcff16e287 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:57:52.992287 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-43d01ac0-ce83-4229-9a7d-758652ec52ba req-2d6e4daf-089d-4662-8ca1-e628c4351ff7 service nova] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Received event network-changed-51ab6198-7fa5-4b12-8d53-effcff16e287 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:57:52.992765 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-43d01ac0-ce83-4229-9a7d-758652ec52ba req-2d6e4daf-089d-4662-8ca1-e628c4351ff7 service nova] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Refreshing instance network info cache due to event network-changed-51ab6198-7fa5-4b12-8d53-effcff16e287. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:57:52.993011 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-43d01ac0-ce83-4229-9a7d-758652ec52ba req-2d6e4daf-089d-4662-8ca1-e628c4351ff7 service nova] Acquiring lock "refresh_cache-659c56a6-743a-45e2-aa21-7d45c672f094" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:57:52.993143 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-43d01ac0-ce83-4229-9a7d-758652ec52ba req-2d6e4daf-089d-4662-8ca1-e628c4351ff7 service nova] Acquired lock "refresh_cache-659c56a6-743a-45e2-aa21-7d45c672f094" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:57:52.993300 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-43d01ac0-ce83-4229-9a7d-758652ec52ba req-2d6e4daf-089d-4662-8ca1-e628c4351ff7 service nova] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Refreshing network info cache for port 51ab6198-7fa5-4b12-8d53-effcff16e287 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:57:53.081531 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:53.138101 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:57:53.435680 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquiring lock "refresh_cache-659c56a6-743a-45e2-aa21-7d45c672f094" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:57:53.496701 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-43d01ac0-ce83-4229-9a7d-758652ec52ba req-2d6e4daf-089d-4662-8ca1-e628c4351ff7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:53.578795 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-43d01ac0-ce83-4229-9a7d-758652ec52ba req-2d6e4daf-089d-4662-8ca1-e628c4351ff7 service nova] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:57:53.616470 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:57:53.617356 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:57:53.617764 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Creating image(s)
May 28 01:57:53.618332 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquiring lock "/opt/stack/data/nova/instances/659c56a6-743a-45e2-aa21-7d45c672f094/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:53.618493 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "/opt/stack/data/nova/instances/659c56a6-743a-45e2-aa21-7d45c672f094/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:53.618920 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "/opt/stack/data/nova/instances/659c56a6-743a-45e2-aa21-7d45c672f094/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:53.619479 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:57:53.622073 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:57:53.623635 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:57:53.657319 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.571s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:53.657674 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:57:53.734615 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.111s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:57:53.735204 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:53.736762 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:53.737555 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:57:53.745648 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:57:53.746747 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:57:53.843886 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.097s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:57:53.845392 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/659c56a6-743a-45e2-aa21-7d45c672f094/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:57:53.861635 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-43d01ac0-ce83-4229-9a7d-758652ec52ba req-2d6e4daf-089d-4662-8ca1-e628c4351ff7 service nova] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:57:53.902467 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/659c56a6-743a-45e2-aa21-7d45c672f094/disk 1073741824" returned: 0 in 0.057s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:57:53.902954 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.166s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:53.903423 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:57:53.980346 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "1100d127-f3d6-416e-a646-b072660980bc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:53.980973 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "1100d127-f3d6-416e-a646-b072660980bc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:54.012678 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.109s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:57:54.013065 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Checking if we can resize image /opt/stack/data/nova/instances/659c56a6-743a-45e2-aa21-7d45c672f094/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:57:54.013720 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659c56a6-743a-45e2-aa21-7d45c672f094/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:57:54.115931 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659c56a6-743a-45e2-aa21-7d45c672f094/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:57:54.116507 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Cannot resize image /opt/stack/data/nova/instances/659c56a6-743a-45e2-aa21-7d45c672f094/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:57:54.117185 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:57:54.117444 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Ensure instance console log exists: /opt/stack/data/nova/instances/659c56a6-743a-45e2-aa21-7d45c672f094/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:57:54.117802 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:54.118073 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:54.118277 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:54.169736 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:57:54.170136 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:57:54.170406 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:54.170702 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:54.254340 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '435dfce8f05e4e01b380797bd07bd4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65617e71571457f8906997583100678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:57:54.367539 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-43d01ac0-ce83-4229-9a7d-758652ec52ba req-2d6e4daf-089d-4662-8ca1-e628c4351ff7 service nova] Releasing lock "refresh_cache-659c56a6-743a-45e2-aa21-7d45c672f094" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:57:54.368948 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquired lock "refresh_cache-659c56a6-743a-45e2-aa21-7d45c672f094" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:57:54.369178 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:57:54.485900 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lazy-loading 'flavor' on Instance uuid 1100d127-f3d6-416e-a646-b072660980bc {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:57:54.670163 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:57:54.743102 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Successfully created port: f23d344d-9e4c-41b4-a61f-b324ba3c9794 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:57:54.761580 np0000001583 nova-compute[98241]: DEBUG os_brick.encryptors.luks [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] opening encrypted volume /dev/dm-1 {{(pid=98241) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 28 01:57:54.857399 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:54.980430 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:57:55.173103 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:57:55.188489 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:55.375160 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Updating instance_info_cache with network_info: [{"id": "51ab6198-7fa5-4b12-8d53-effcff16e287", "address": "fa:16:3e:ae:1e:12", "network": {"id": "e1d5d073-f27b-4ff1-9ed3-99f57407c76f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f65617e71571457f8906997583100678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ab6198-7f", "ovs_interfaceid": "51ab6198-7fa5-4b12-8d53-effcff16e287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:57:55.499937 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "1100d127-f3d6-416e-a646-b072660980bc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.519s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:55.876933 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Releasing lock "refresh_cache-659c56a6-743a-45e2-aa21-7d45c672f094" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:57:55.877226 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Instance network_info: |[{"id": "51ab6198-7fa5-4b12-8d53-effcff16e287", "address": "fa:16:3e:ae:1e:12", "network": {"id": "e1d5d073-f27b-4ff1-9ed3-99f57407c76f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f65617e71571457f8906997583100678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ab6198-7f", "ovs_interfaceid": "51ab6198-7fa5-4b12-8d53-effcff16e287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:57:55.880829 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Start _get_guest_xml network_info=[{"id": "51ab6198-7fa5-4b12-8d53-effcff16e287", "address": "fa:16:3e:ae:1e:12", "network": {"id": "e1d5d073-f27b-4ff1-9ed3-99f57407c76f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f65617e71571457f8906997583100678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ab6198-7f", "ovs_interfaceid": "51ab6198-7fa5-4b12-8d53-effcff16e287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:57:55.889293 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:57:55.891013 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1830325230', uuid='659c56a6-743a-45e2-aa21-7d45c672f094'), owner=OwnerMeta(userid='435dfce8f05e4e01b380797bd07bd4dc', username='tempest-ServerRescueNegativeTestJSON-1821941242-project-member', projectid='f65617e71571457f8906997583100678', projectname='tempest-ServerRescueNegativeTestJSON-1821941242'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "51ab6198-7fa5-4b12-8d53-effcff16e287", "address": "fa:16:3e:ae:1e:12", "network": {"id": "e1d5d073-f27b-4ff1-9ed3-99f57407c76f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f65617e71571457f8906997583100678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ab6198-7f", "ovs_interfaceid": "51ab6198-7fa5-4b12-8d53-effcff16e287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933475.8905346) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:57:55.895815 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ba455176-d4b3-40ee-bf4d-83c5ee2a89ab req-d2d74a63-2955-4366-b7c7-9d006b381ec8 service nova] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Received event network-vif-unplugged-51ab6198-7fa5-4b12-8d53-effcff16e287 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:57:55.896129 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ba455176-d4b3-40ee-bf4d-83c5ee2a89ab req-d2d74a63-2955-4366-b7c7-9d006b381ec8 service nova] Acquiring lock "659c56a6-743a-45e2-aa21-7d45c672f094-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:55.898136 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ba455176-d4b3-40ee-bf4d-83c5ee2a89ab req-d2d74a63-2955-4366-b7c7-9d006b381ec8 service nova] Lock "659c56a6-743a-45e2-aa21-7d45c672f094-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:55.898136 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ba455176-d4b3-40ee-bf4d-83c5ee2a89ab req-d2d74a63-2955-4366-b7c7-9d006b381ec8 service nova] Lock "659c56a6-743a-45e2-aa21-7d45c672f094-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:55.898136 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ba455176-d4b3-40ee-bf4d-83c5ee2a89ab req-d2d74a63-2955-4366-b7c7-9d006b381ec8 service nova] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] No waiting events found dispatching network-vif-unplugged-51ab6198-7fa5-4b12-8d53-effcff16e287 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:57:55.898136 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-ba455176-d4b3-40ee-bf4d-83c5ee2a89ab req-d2d74a63-2955-4366-b7c7-9d006b381ec8 service nova] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Received unexpected event network-vif-unplugged-51ab6198-7fa5-4b12-8d53-effcff16e287 for instance with vm_state building and task_state spawning.
May 28 01:57:55.901309 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:57:55.902475 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:57:55.903665 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:57:55.904482 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:57:55.905828 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:57:55.906206 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:57:55.906367 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:57:55.906463 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:57:55.906645 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:57:55.906776 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:57:55.906889 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:57:55.907045 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:57:55.907181 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:57:55.907307 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:57:55.907450 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:57:55.907629 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:57:55.925714 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:57:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1830325230',display_name='tempest-ServerRescueNegativeTestJSON-server-1830325230',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-serverrescuenegativetestjson-server-1830325230',id=28,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f65617e71571457f8906997583100678',ramdisk_id='',reservation_id='r-0bu7sx5m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1821941242',owner_user_name='tempest-ServerRescueNegativeTestJSON-1821941242-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:57:53Z,user_data=None,user_id='435dfce8f05e4e01b380797bd07bd4dc',uuid=659c56a6-743a-45e2-aa21-7d45c672f094,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51ab6198-7fa5-4b12-8d53-effcff16e287", "address": "fa:16:3e:ae:1e:12", "network": {"id": "e1d5d073-f27b-4ff1-9ed3-99f57407c76f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f65617e71571457f8906997583100678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ab6198-7f", "ovs_interfaceid": "51ab6198-7fa5-4b12-8d53-effcff16e287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:57:55.925971 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Converting VIF {"id": "51ab6198-7fa5-4b12-8d53-effcff16e287", "address": "fa:16:3e:ae:1e:12", "network": {"id": "e1d5d073-f27b-4ff1-9ed3-99f57407c76f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f65617e71571457f8906997583100678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ab6198-7f", "ovs_interfaceid": "51ab6198-7fa5-4b12-8d53-effcff16e287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:57:55.927258 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:1e:12,bridge_name='br-int',has_traffic_filtering=True,id=51ab6198-7fa5-4b12-8d53-effcff16e287,network=Network(e1d5d073-f27b-4ff1-9ed3-99f57407c76f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ab6198-7f') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:57:55.927682 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lazy-loading 'pci_devices' on Instance uuid 659c56a6-743a-45e2-aa21-7d45c672f094 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:57:56.081866 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Successfully updated port: f23d344d-9e4c-41b4-a61f-b324ba3c9794 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:57:56.185871 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:57:56.187748 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:57:56.188142 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Creating image(s)
May 28 01:57:56.189214 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquiring lock "/opt/stack/data/nova/instances/0d87a47f-2eb6-4e25-b44a-848fe2225962/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:56.189456 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "/opt/stack/data/nova/instances/0d87a47f-2eb6-4e25-b44a-848fe2225962/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:56.190099 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "/opt/stack/data/nova/instances/0d87a47f-2eb6-4e25-b44a-848fe2225962/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:56.190779 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:57:56.194837 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:57:56.197475 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:57:56.315168 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.117s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:57:56.315553 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:56.315962 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:56.319692 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:57:56.322400 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:57:56.322742 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:57:56.424187 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.101s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:57:56.424897 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/0d87a47f-2eb6-4e25-b44a-848fe2225962/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:57:56.447105 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] End _get_guest_xml xml=<domain type="qemu">
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:   <uuid>659c56a6-743a-45e2-aa21-7d45c672f094</uuid>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:   <name>instance-0000001c</name>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1830325230</nova:name>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:57:55</nova:creationTime>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:         <nova:user uuid="435dfce8f05e4e01b380797bd07bd4dc">tempest-ServerRescueNegativeTestJSON-1821941242-project-member</nova:user>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:         <nova:project uuid="f65617e71571457f8906997583100678">tempest-ServerRescueNegativeTestJSON-1821941242</nova:project>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:         <nova:port uuid="51ab6198-7fa5-4b12-8d53-effcff16e287">
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:     <system>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:       <entry name="serial">659c56a6-743a-45e2-aa21-7d45c672f094</entry>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:       <entry name="uuid">659c56a6-743a-45e2-aa21-7d45c672f094</entry>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:     </system>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:   <os>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:   </os>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:   <features>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:   </features>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:   <devices>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/659c56a6-743a-45e2-aa21-7d45c672f094/disk"/>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:     </disk>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/659c56a6-743a-45e2-aa21-7d45c672f094/disk.config"/>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:     </disk>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:ae:1e:12"/>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:       <target dev="tap51ab6198-7f"/>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:     </interface>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/659c56a6-743a-45e2-aa21-7d45c672f094/console.log" append="off"/>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:     </serial>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:     <video>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:     </video>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:     </rng>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:   </devices>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]: </domain>
May 28 01:57:56.447105 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:57:56.447105 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Preparing to wait for external event network-vif-plugged-51ab6198-7fa5-4b12-8d53-effcff16e287 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:57:56.447105 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquiring lock "659c56a6-743a-45e2-aa21-7d45c672f094-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:56.447105 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "659c56a6-743a-45e2-aa21-7d45c672f094-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:56.447105 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "659c56a6-743a-45e2-aa21-7d45c672f094-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:56.450886 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:57:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1830325230',display_name='tempest-ServerRescueNegativeTestJSON-server-1830325230',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-serverrescuenegativetestjson-server-1830325230',id=28,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f65617e71571457f8906997583100678',ramdisk_id='',reservation_id='r-0bu7sx5m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1821941242',owner_user_name='tempest-ServerRescueNegativeTestJSON-1821941242-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:57:53Z,user_data=None,user_id='435dfce8f05e4e01b380797bd07bd4dc',uuid=659c56a6-743a-45e2-aa21-7d45c672f094,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51ab6198-7fa5-4b12-8d53-effcff16e287", "address": "fa:16:3e:ae:1e:12", "network": {"id": "e1d5d073-f27b-4ff1-9ed3-99f57407c76f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f65617e71571457f8906997583100678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ab6198-7f", "ovs_interfaceid": "51ab6198-7fa5-4b12-8d53-effcff16e287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:57:56.450886 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Converting VIF {"id": "51ab6198-7fa5-4b12-8d53-effcff16e287", "address": "fa:16:3e:ae:1e:12", "network": {"id": "e1d5d073-f27b-4ff1-9ed3-99f57407c76f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f65617e71571457f8906997583100678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ab6198-7f", "ovs_interfaceid": "51ab6198-7fa5-4b12-8d53-effcff16e287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:57:56.450886 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:1e:12,bridge_name='br-int',has_traffic_filtering=True,id=51ab6198-7fa5-4b12-8d53-effcff16e287,network=Network(e1d5d073-f27b-4ff1-9ed3-99f57407c76f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ab6198-7f') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:57:56.450886 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:1e:12,bridge_name='br-int',has_traffic_filtering=True,id=51ab6198-7fa5-4b12-8d53-effcff16e287,network=Network(e1d5d073-f27b-4ff1-9ed3-99f57407c76f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ab6198-7f') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:57:56.450886 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:56.451304 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:56.451659 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:57:56.452771 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:56.453387 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4ff0158e-e437-5b7f-9375-c7c803d5d1e5', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:56.454142 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:56.455093 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:57:56.457503 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:56.461325 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:56.461548 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51ab6198-7f, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:56.462009 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap51ab6198-7f, col_values=(('qos', UUID('d9637722-32ee-435a-b430-cc2965d9dae7')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:56.462227 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap51ab6198-7f, col_values=(('external_ids', {'iface-id': '51ab6198-7fa5-4b12-8d53-effcff16e287', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:1e:12', 'vm-uuid': '659c56a6-743a-45e2-aa21-7d45c672f094'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:56.463483 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:56.465727 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:57:56.471667 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:56.472318 np0000001583 nova-compute[98241]: INFO os_vif [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:1e:12,bridge_name='br-int',has_traffic_filtering=True,id=51ab6198-7fa5-4b12-8d53-effcff16e287,network=Network(e1d5d073-f27b-4ff1-9ed3-99f57407c76f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ab6198-7f')
May 28 01:57:56.487227 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/0d87a47f-2eb6-4e25-b44a-848fe2225962/disk 1073741824" returned: 0 in 0.062s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:57:56.488157 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.172s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:56.488586 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:57:56.581759 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.093s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:57:56.582220 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0d87a47f-2eb6-4e25-b44a-848fe2225962/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:57:56.582520 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d87a47f-2eb6-4e25-b44a-848fe2225962/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:57:56.597920 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquiring lock "refresh_cache-0d87a47f-2eb6-4e25-b44a-848fe2225962" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:57:56.598507 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquired lock "refresh_cache-0d87a47f-2eb6-4e25-b44a-848fe2225962" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:57:56.598888 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:57:56.613467 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "1100d127-f3d6-416e-a646-b072660980bc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:56.613732 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "1100d127-f3d6-416e-a646-b072660980bc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:56.614027 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Attaching volume 26d4395d-39cc-4b5f-a50d-fff1446bdcaa to /dev/vdb
May 28 01:57:56.673376 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:57:56.687288 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:57:56.701953 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d87a47f-2eb6-4e25-b44a-848fe2225962/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:57:56.705094 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Cannot resize image /opt/stack/data/nova/instances/0d87a47f-2eb6-4e25-b44a-848fe2225962/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:57:56.705476 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:57:56.705686 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Ensure instance console log exists: /opt/stack/data/nova/instances/0d87a47f-2eb6-4e25-b44a-848fe2225962/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:57:56.705960 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:56.706133 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:56.706280 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:56.715066 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:57:56.768470 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:57:56.768788 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:57:56.781261 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:57:56.782284 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe63:2bb1', 'fe80::e43a:d5ff:fecc:27fe', 'fe80::fc16:3eff:fe92:e25b', 'fe80::ecb9:b7ff:fe00:dc63', 'fe80::fc16:3eff:feb1:8997'] 
May 28 01:57:56.782440 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:57:56.782534 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:57:56.782771 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:57:56.783010 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Updating existing volume attachment record: 526ea0bf-e657-4b6e-8599-ecf9d403f3fd {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:57:57.176769 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:57:57.339817 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:57:57.340254 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa', 'iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '26d4395d-39cc-4b5f-a50d-fff1446bdcaa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:57:57.340503 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:57:57.341187 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:57:57.341379 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa', 'iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '26d4395d-39cc-4b5f-a50d-fff1446bdcaa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:57:57.356057 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:57:57.356793 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:57:57.357471 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:57:57.357816 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:57:57.358189 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:57:57.358411 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:57:57.376470 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:57:57.376470 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:57.382112 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:57:57.382112 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:57.393244 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa] added
May 28 01:57:57.393244 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:57:57.393244 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:57:57.393244 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:57:57.393244 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:57:57.393244 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:57:57.393244 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:57.393572 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:57:57.393683 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0359(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:57:57.393887 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:57:57.397723 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:57.399998 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa] added
May 28 01:57:57.399998 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:57:57.399998 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:57:57.399998 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:57:57.399998 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:57:57.399998 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:57:57.399998 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:57.400269 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:57:57.400516 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0421(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:57:57.400709 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:57:57.467101 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:57:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1286123612',display_name='tempest-TestVolumeBootPattern-server-1286123612',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testvolumebootpattern-server-1286123612',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='432aa1094ced436494def17a875aa8e1',ramdisk_id='',reservation_id='r-pqel2ql8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1031057169',owner_user_name='tempest-TestVolumeBootPattern-1031057169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:57:43Z,user_data=None,user_id='6be314b4eed642c3b2c72fe115860220',uuid=258fd5d8-1ab7-4d19-afe7-421297b99684,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2e9b3d8-d03e-4deb-99a4-92bd5370674d", "address": "fa:16:3e:ee:f0:63", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e9b3d8-d0", "ovs_interfaceid": "e2e9b3d8-d03e-4deb-99a4-92bd5370674d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:57:57.467352 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converting VIF {"id": "e2e9b3d8-d03e-4deb-99a4-92bd5370674d", "address": "fa:16:3e:ee:f0:63", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e9b3d8-d0", "ovs_interfaceid": "e2e9b3d8-d03e-4deb-99a4-92bd5370674d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:57:57.467995 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:f0:63,bridge_name='br-int',has_traffic_filtering=True,id=e2e9b3d8-d03e-4deb-99a4-92bd5370674d,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2e9b3d8-d0') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:57:57.468771 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lazy-loading 'pci_devices' on Instance uuid 258fd5d8-1ab7-4d19-afe7-421297b99684 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:57:57.557827 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Updating instance_info_cache with network_info: [{"id": "f23d344d-9e4c-41b4-a61f-b324ba3c9794", "address": "fa:16:3e:ca:d6:49", "network": {"id": "e1d5d073-f27b-4ff1-9ed3-99f57407c76f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f65617e71571457f8906997583100678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf23d344d-9e", "ovs_interfaceid": "f23d344d-9e4c-41b4-a61f-b324ba3c9794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:57:57.968549 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-4af08416-ba89-4e74-913c-a888094f97e4 req-32771e7b-67fa-4c98-8215-6601322269a8 service nova] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Received event network-changed-f23d344d-9e4c-41b4-a61f-b324ba3c9794 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:57:57.968724 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-4af08416-ba89-4e74-913c-a888094f97e4 req-32771e7b-67fa-4c98-8215-6601322269a8 service nova] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Refreshing instance network info cache due to event network-changed-f23d344d-9e4c-41b4-a61f-b324ba3c9794. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:57:57.968803 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-4af08416-ba89-4e74-913c-a888094f97e4 req-32771e7b-67fa-4c98-8215-6601322269a8 service nova] Acquiring lock "refresh_cache-0d87a47f-2eb6-4e25-b44a-848fe2225962" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:57:57.972097 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] End _get_guest_xml xml=<domain type="qemu">
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:   <uuid>258fd5d8-1ab7-4d19-afe7-421297b99684</uuid>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:   <name>instance-0000001b</name>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:       <nova:name>tempest-TestVolumeBootPattern-server-1286123612</nova:name>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:57:45</nova:creationTime>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:       <nova:image uuid="">
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:         <nova:properties/>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:         <nova:user uuid="6be314b4eed642c3b2c72fe115860220">tempest-TestVolumeBootPattern-1031057169-project-member</nova:user>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:         <nova:project uuid="432aa1094ced436494def17a875aa8e1">tempest-TestVolumeBootPattern-1031057169</nova:project>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:       <nova:root type="volume" uuid=""/>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:         <nova:port uuid="e2e9b3d8-d03e-4deb-99a4-92bd5370674d">
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:     <system>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:       <entry name="serial">258fd5d8-1ab7-4d19-afe7-421297b99684</entry>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:       <entry name="uuid">258fd5d8-1ab7-4d19-afe7-421297b99684</entry>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:     </system>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:   <os>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:   </os>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:   <features>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:   </features>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:   <devices>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/258fd5d8-1ab7-4d19-afe7-421297b99684/disk.config"/>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:     </disk>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:     <disk type="block" device="disk">
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:       <alias name="ua-652e60a5-d4d1-48ab-9219-95bf7e8bf048"/>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:       <serial>652e60a5-d4d1-48ab-9219-95bf7e8bf048</serial>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:     </disk>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:ee:f0:63"/>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:       <target dev="tape2e9b3d8-d0"/>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:     </interface>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/258fd5d8-1ab7-4d19-afe7-421297b99684/console.log" append="off"/>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:     </serial>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:     <video>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:     </video>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:     </rng>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:   </devices>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]: </domain>
May 28 01:57:57.972097 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:57:57.976591 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Preparing to wait for external event network-vif-plugged-e2e9b3d8-d03e-4deb-99a4-92bd5370674d {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:57:57.976591 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "258fd5d8-1ab7-4d19-afe7-421297b99684-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:57.976591 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "258fd5d8-1ab7-4d19-afe7-421297b99684-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:57.976591 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "258fd5d8-1ab7-4d19-afe7-421297b99684-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:57.976591 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:57:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1286123612',display_name='tempest-TestVolumeBootPattern-server-1286123612',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testvolumebootpattern-server-1286123612',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='432aa1094ced436494def17a875aa8e1',ramdisk_id='',reservation_id='r-pqel2ql8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1031057169',owner_user_name='tempest-TestVolumeBootPattern-1031057169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:57:43Z,user_data=None,user_id='6be314b4eed642c3b2c72fe115860220',uuid=258fd5d8-1ab7-4d19-afe7-421297b99684,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2e9b3d8-d03e-4deb-99a4-92bd5370674d", "address": "fa:16:3e:ee:f0:63", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e9b3d8-d0", "ovs_interfaceid": "e2e9b3d8-d03e-4deb-99a4-92bd5370674d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:57:57.976591 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converting VIF {"id": "e2e9b3d8-d03e-4deb-99a4-92bd5370674d", "address": "fa:16:3e:ee:f0:63", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e9b3d8-d0", "ovs_interfaceid": "e2e9b3d8-d03e-4deb-99a4-92bd5370674d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:57:57.976591 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:f0:63,bridge_name='br-int',has_traffic_filtering=True,id=e2e9b3d8-d03e-4deb-99a4-92bd5370674d,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2e9b3d8-d0') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:57:57.976591 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:f0:63,bridge_name='br-int',has_traffic_filtering=True,id=e2e9b3d8-d03e-4deb-99a4-92bd5370674d,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2e9b3d8-d0') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:57:57.976591 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:57.976591 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:57.976591 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:57:57.976591 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:57.976591 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'acd5ed3c-9186-5d1d-b3a0-98abc2a7eb52', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:57.979092 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:57.979092 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:57:57.983416 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:57.984469 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:57.984651 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape2e9b3d8-d0, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:57.984934 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape2e9b3d8-d0, col_values=(('qos', UUID('b620e1f0-6dff-43d3-990c-290927686bfe')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:57.985093 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape2e9b3d8-d0, col_values=(('external_ids', {'iface-id': 'e2e9b3d8-d03e-4deb-99a4-92bd5370674d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:f0:63', 'vm-uuid': '258fd5d8-1ab7-4d19-afe7-421297b99684'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:57.985964 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:57.987500 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:57:57.998984 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:57:57.998984 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:57:57.998984 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] No VIF found with MAC fa:16:3e:ae:1e:12, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:57:57.998984 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Using config drive
May 28 01:57:58.003209 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:58.005447 np0000001583 nova-compute[98241]: INFO os_vif [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:f0:63,bridge_name='br-int',has_traffic_filtering=True,id=e2e9b3d8-d03e-4deb-99a4-92bd5370674d,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2e9b3d8-d0')
May 28 01:57:58.061370 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Releasing lock "refresh_cache-0d87a47f-2eb6-4e25-b44a-848fe2225962" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:57:58.061797 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Instance network_info: |[{"id": "f23d344d-9e4c-41b4-a61f-b324ba3c9794", "address": "fa:16:3e:ca:d6:49", "network": {"id": "e1d5d073-f27b-4ff1-9ed3-99f57407c76f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f65617e71571457f8906997583100678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf23d344d-9e", "ovs_interfaceid": "f23d344d-9e4c-41b4-a61f-b324ba3c9794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:57:58.062116 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-4af08416-ba89-4e74-913c-a888094f97e4 req-32771e7b-67fa-4c98-8215-6601322269a8 service nova] Acquired lock "refresh_cache-0d87a47f-2eb6-4e25-b44a-848fe2225962" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:57:58.064472 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-4af08416-ba89-4e74-913c-a888094f97e4 req-32771e7b-67fa-4c98-8215-6601322269a8 service nova] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Refreshing network info cache for port f23d344d-9e4c-41b4-a61f-b324ba3c9794 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:57:58.067072 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Start _get_guest_xml network_info=[{"id": "f23d344d-9e4c-41b4-a61f-b324ba3c9794", "address": "fa:16:3e:ca:d6:49", "network": {"id": "e1d5d073-f27b-4ff1-9ed3-99f57407c76f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f65617e71571457f8906997583100678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf23d344d-9e", "ovs_interfaceid": "f23d344d-9e4c-41b4-a61f-b324ba3c9794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:57:58.072105 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:57:58.073555 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-823002783', uuid='0d87a47f-2eb6-4e25-b44a-848fe2225962'), owner=OwnerMeta(userid='435dfce8f05e4e01b380797bd07bd4dc', username='tempest-ServerRescueNegativeTestJSON-1821941242-project-member', projectid='f65617e71571457f8906997583100678', projectname='tempest-ServerRescueNegativeTestJSON-1821941242'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f23d344d-9e4c-41b4-a61f-b324ba3c9794", "address": "fa:16:3e:ca:d6:49", "network": {"id": "e1d5d073-f27b-4ff1-9ed3-99f57407c76f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f65617e71571457f8906997583100678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf23d344d-9e", "ovs_interfaceid": "f23d344d-9e4c-41b4-a61f-b324ba3c9794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933478.0730307) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:57:58.075868 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:57:58.076463 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:57:58.077560 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:57:58.077807 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:57:58.078856 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:57:58.079888 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:57:58.080217 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:57:58.080636 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:57:58.080852 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:57:58.080943 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:57:58.081037 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:57:58.081218 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:57:58.081325 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:57:58.081437 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:57:58.081537 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:57:58.082064 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:57:58.094504 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:58.104460 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:57:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-823002783',display_name='tempest-ServerRescueNegativeTestJSON-server-823002783',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-serverrescuenegativetestjson-server-823002783',id=29,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f65617e71571457f8906997583100678',ramdisk_id='',reservation_id='r-9b82bcpk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1821941242',owner_user_name='tempest-ServerRescueNegativeTestJSON-1821941242-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:57:55Z,user_data=None,user_id='435dfce8f05e4e01b380797bd07bd4dc',uuid=0d87a47f-2eb6-4e25-b44a-848fe2225962,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f23d344d-9e4c-41b4-a61f-b324ba3c9794", "address": "fa:16:3e:ca:d6:49", "network": {"id": "e1d5d073-f27b-4ff1-9ed3-99f57407c76f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f65617e71571457f8906997583100678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf23d344d-9e", "ovs_interfaceid": "f23d344d-9e4c-41b4-a61f-b324ba3c9794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:57:58.104716 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Converting VIF {"id": "f23d344d-9e4c-41b4-a61f-b324ba3c9794", "address": "fa:16:3e:ca:d6:49", "network": {"id": "e1d5d073-f27b-4ff1-9ed3-99f57407c76f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f65617e71571457f8906997583100678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf23d344d-9e", "ovs_interfaceid": "f23d344d-9e4c-41b4-a61f-b324ba3c9794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:57:58.105310 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:d6:49,bridge_name='br-int',has_traffic_filtering=True,id=f23d344d-9e4c-41b4-a61f-b324ba3c9794,network=Network(e1d5d073-f27b-4ff1-9ed3-99f57407c76f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf23d344d-9e') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:57:58.105918 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lazy-loading 'pci_devices' on Instance uuid 0d87a47f-2eb6-4e25-b44a-848fe2225962 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:57:58.322556 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "e50227a8-b484-447b-abc6-3a3c1379e7ff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:58.322773 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "e50227a8-b484-447b-abc6-3a3c1379e7ff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:58.395584 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:57:58.401190 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:57:58.411358 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:57:58.411358 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:57:58.417450 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:57:58.417450 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:58.428098 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:58.433022 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:58.446160 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:58.446160 np0000001583 nova-compute[98241]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:58.446160 np0000001583 nova-compute[98241]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048 (non-flash)
May 28 01:57:58.446160 np0000001583 nova-compute[98241]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048 (non-flash)
May 28 01:57:58.446160 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:57:58.446468 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsi session list stdout=tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:58.446468 np0000001583 nova-compute[98241]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:58.446468 np0000001583 nova-compute[98241]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048 (non-flash)
May 28 01:57:58.446468 np0000001583 nova-compute[98241]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048 (non-flash)
May 28 01:57:58.446468 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:57:58.447999 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:58.447999 np0000001583 nova-compute[98241]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:58.447999 np0000001583 nova-compute[98241]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048 (non-flash)
May 28 01:57:58.447999 np0000001583 nova-compute[98241]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048 (non-flash)
May 28 01:57:58.447999 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:57:58.448231 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsi session list stdout=tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:58.448231 np0000001583 nova-compute[98241]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:58.448231 np0000001583 nova-compute[98241]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048 (non-flash)
May 28 01:57:58.448231 np0000001583 nova-compute[98241]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048 (non-flash)
May 28 01:57:58.448231 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:57:58.487555 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa, portal: 192.168.40.100,3260]
May 28 01:57:58.487555 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa, portal: 192.168.40.100,3260] successful.
May 28 01:57:58.487555 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:58.495322 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa, portal: 192.168.50.100,3260]
May 28 01:57:58.495322 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa, portal: 192.168.50.100,3260] successful.
May 28 01:57:58.495322 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:58.504918 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:58.517205 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:58.519353 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:57:58.522255 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:58.522255 np0000001583 nova-compute[98241]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:58.522255 np0000001583 nova-compute[98241]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048 (non-flash)
May 28 01:57:58.522255 np0000001583 nova-compute[98241]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048 (non-flash)
May 28 01:57:58.522255 np0000001583 nova-compute[98241]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa (non-flash)
May 28 01:57:58.522255 np0000001583 nova-compute[98241]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa (non-flash)
May 28 01:57:58.522255 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:57:58.522535 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsi session list stdout=tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:58.522535 np0000001583 nova-compute[98241]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:58.522535 np0000001583 nova-compute[98241]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048 (non-flash)
May 28 01:57:58.522535 np0000001583 nova-compute[98241]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048 (non-flash)
May 28 01:57:58.522535 np0000001583 nova-compute[98241]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa (non-flash)
May 28 01:57:58.522535 np0000001583 nova-compute[98241]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa (non-flash)
May 28 01:57:58.522535 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:57:58.522752 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.165s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:57:58.522829 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:57:58.523984 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] HCTL ('11', '-', '-', 0) found on session 66 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:57:58.524121 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:57:58.540620 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:58.540620 np0000001583 nova-compute[98241]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:58.540620 np0000001583 nova-compute[98241]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048 (non-flash)
May 28 01:57:58.540620 np0000001583 nova-compute[98241]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048 (non-flash)
May 28 01:57:58.540620 np0000001583 nova-compute[98241]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa (non-flash)
May 28 01:57:58.540620 np0000001583 nova-compute[98241]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa (non-flash)
May 28 01:57:58.540620 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:57:58.540956 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsi session list stdout=tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:58.540956 np0000001583 nova-compute[98241]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:57:58.540956 np0000001583 nova-compute[98241]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048 (non-flash)
May 28 01:57:58.540956 np0000001583 nova-compute[98241]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048 (non-flash)
May 28 01:57:58.540956 np0000001583 nova-compute[98241]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa (non-flash)
May 28 01:57:58.540956 np0000001583 nova-compute[98241]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa (non-flash)
May 28 01:57:58.540956 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:57:58.543094 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.183s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:57:58.543094 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:57:58.549195 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Searching for a device in session 66 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:57:58.549615 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '26d4395d-39cc-4b5f-a50d-fff1446bdcaa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:57:58.550923 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] HCTL ('12', '-', '-', 0) found on session 67 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:57:58.551179 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:57:58.568123 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Searching for a device in session 67 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:57:58.568123 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '26d4395d-39cc-4b5f-a50d-fff1446bdcaa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:57:58.569644 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-4af08416-ba89-4e74-913c-a888094f97e4 req-32771e7b-67fa-4c98-8215-6601322269a8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:58.611994 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] End _get_guest_xml xml=<domain type="qemu">
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:   <uuid>0d87a47f-2eb6-4e25-b44a-848fe2225962</uuid>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:   <name>instance-0000001d</name>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-823002783</nova:name>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:57:58</nova:creationTime>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:         <nova:user uuid="435dfce8f05e4e01b380797bd07bd4dc">tempest-ServerRescueNegativeTestJSON-1821941242-project-member</nova:user>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:         <nova:project uuid="f65617e71571457f8906997583100678">tempest-ServerRescueNegativeTestJSON-1821941242</nova:project>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:         <nova:port uuid="f23d344d-9e4c-41b4-a61f-b324ba3c9794">
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:     <system>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:       <entry name="serial">0d87a47f-2eb6-4e25-b44a-848fe2225962</entry>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:       <entry name="uuid">0d87a47f-2eb6-4e25-b44a-848fe2225962</entry>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:     </system>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:   <os>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:   </os>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:   <features>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:   </features>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:   <devices>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/0d87a47f-2eb6-4e25-b44a-848fe2225962/disk"/>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:     </disk>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/0d87a47f-2eb6-4e25-b44a-848fe2225962/disk.config"/>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:     </disk>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:ca:d6:49"/>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:       <target dev="tapf23d344d-9e"/>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:     </interface>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/0d87a47f-2eb6-4e25-b44a-848fe2225962/console.log" append="off"/>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:     </serial>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:     <video>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:     </video>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:     </rng>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:   </devices>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]: </domain>
May 28 01:57:58.611994 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:57:58.611994 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Preparing to wait for external event network-vif-plugged-f23d344d-9e4c-41b4-a61f-b324ba3c9794 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:57:58.611994 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquiring lock "0d87a47f-2eb6-4e25-b44a-848fe2225962-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:58.616841 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "0d87a47f-2eb6-4e25-b44a-848fe2225962-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:58.616841 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "0d87a47f-2eb6-4e25-b44a-848fe2225962-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:57:58.616841 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:57:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-823002783',display_name='tempest-ServerRescueNegativeTestJSON-server-823002783',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-serverrescuenegativetestjson-server-823002783',id=29,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f65617e71571457f8906997583100678',ramdisk_id='',reservation_id='r-9b82bcpk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1821941242',owner_user_name='tempest-ServerRescueNegativeTestJSON-1821941242-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:57:55Z,user_data=None,user_id='435dfce8f05e4e01b380797bd07bd4dc',uuid=0d87a47f-2eb6-4e25-b44a-848fe2225962,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f23d344d-9e4c-41b4-a61f-b324ba3c9794", "address": "fa:16:3e:ca:d6:49", "network": {"id": "e1d5d073-f27b-4ff1-9ed3-99f57407c76f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f65617e71571457f8906997583100678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf23d344d-9e", "ovs_interfaceid": "f23d344d-9e4c-41b4-a61f-b324ba3c9794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:57:58.616841 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Converting VIF {"id": "f23d344d-9e4c-41b4-a61f-b324ba3c9794", "address": "fa:16:3e:ca:d6:49", "network": {"id": "e1d5d073-f27b-4ff1-9ed3-99f57407c76f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f65617e71571457f8906997583100678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf23d344d-9e", "ovs_interfaceid": "f23d344d-9e4c-41b4-a61f-b324ba3c9794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:57:58.616841 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:d6:49,bridge_name='br-int',has_traffic_filtering=True,id=f23d344d-9e4c-41b4-a61f-b324ba3c9794,network=Network(e1d5d073-f27b-4ff1-9ed3-99f57407c76f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf23d344d-9e') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:57:58.616841 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:d6:49,bridge_name='br-int',has_traffic_filtering=True,id=f23d344d-9e4c-41b4-a61f-b324ba3c9794,network=Network(e1d5d073-f27b-4ff1-9ed3-99f57407c76f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf23d344d-9e') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:57:58.616841 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:58.616841 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:58.616841 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:57:58.617771 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:58.617771 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd573c192-91a0-5b5f-9362-1cc869e49c8e', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:58.619179 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:58.619596 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:57:58.633841 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:58.645007 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:58.647281 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf23d344d-9e, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:58.647281 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf23d344d-9e, col_values=(('qos', UUID('2b7143a9-e801-4451-9819-b72319314ccd')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:58.647281 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf23d344d-9e, col_values=(('external_ids', {'iface-id': 'f23d344d-9e4c-41b4-a61f-b324ba3c9794', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:d6:49', 'vm-uuid': '0d87a47f-2eb6-4e25-b44a-848fe2225962'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:57:58.650980 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:58.652014 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:57:58.669450 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:58.675823 np0000001583 nova-compute[98241]: INFO os_vif [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:d6:49,bridge_name='br-int',has_traffic_filtering=True,id=f23d344d-9e4c-41b4-a61f-b324ba3c9794,network=Network(e1d5d073-f27b-4ff1-9ed3-99f57407c76f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf23d344d-9e')
May 28 01:57:58.741968 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Creating config drive at /opt/stack/data/nova/instances/659c56a6-743a-45e2-aa21-7d45c672f094/disk.config
May 28 01:57:58.748601 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/659c56a6-743a-45e2-aa21-7d45c672f094/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpi8bk6kgf {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:57:58.804775 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/659c56a6-743a-45e2-aa21-7d45c672f094/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpi8bk6kgf" returned: 0 in 0.056s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:57:58.829901 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:57:58.928706 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-4af08416-ba89-4e74-913c-a888094f97e4 req-32771e7b-67fa-4c98-8215-6601322269a8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:57:59.065557 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-4af08416-ba89-4e74-913c-a888094f97e4 req-32771e7b-67fa-4c98-8215-6601322269a8 service nova] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Updated VIF entry in instance network info cache for port f23d344d-9e4c-41b4-a61f-b324ba3c9794. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:57:59.065857 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-4af08416-ba89-4e74-913c-a888094f97e4 req-32771e7b-67fa-4c98-8215-6601322269a8 service nova] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Updating instance_info_cache with network_info: [{"id": "f23d344d-9e4c-41b4-a61f-b324ba3c9794", "address": "fa:16:3e:ca:d6:49", "network": {"id": "e1d5d073-f27b-4ff1-9ed3-99f57407c76f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f65617e71571457f8906997583100678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf23d344d-9e", "ovs_interfaceid": "f23d344d-9e4c-41b4-a61f-b324ba3c9794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:57:59.261413 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:59.295427 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:59.357661 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:57:59.387466 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:57:59.387757 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:57:59.388111 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:59.396755 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:57:59.397248 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Claim successful on node np0000001583
May 28 01:57:59.530181 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:57:59.530338 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:57:59.530468 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] No VIF found with MAC fa:16:3e:ee:f0:63, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:57:59.530962 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Using config drive
May 28 01:57:59.568361 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-4af08416-ba89-4e74-913c-a888094f97e4 req-32771e7b-67fa-4c98-8215-6601322269a8 service nova] Releasing lock "refresh_cache-0d87a47f-2eb6-4e25-b44a-848fe2225962" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:57:59.631426 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:59.642315 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:59.650303 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:59.679963 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:57:59.694341 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:00.040803 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:00.054791 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-33040801-a29e-452b-ae26-f1aca28441c5 req-cc35ed06-3061-4073-88c6-211271908ef9 service nova] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Received event network-vif-plugged-51ab6198-7fa5-4b12-8d53-effcff16e287 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:00.054791 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-33040801-a29e-452b-ae26-f1aca28441c5 req-cc35ed06-3061-4073-88c6-211271908ef9 service nova] Acquiring lock "659c56a6-743a-45e2-aa21-7d45c672f094-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:00.054791 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-33040801-a29e-452b-ae26-f1aca28441c5 req-cc35ed06-3061-4073-88c6-211271908ef9 service nova] Lock "659c56a6-743a-45e2-aa21-7d45c672f094-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:00.054791 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-33040801-a29e-452b-ae26-f1aca28441c5 req-cc35ed06-3061-4073-88c6-211271908ef9 service nova] Lock "659c56a6-743a-45e2-aa21-7d45c672f094-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:00.054975 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-33040801-a29e-452b-ae26-f1aca28441c5 req-cc35ed06-3061-4073-88c6-211271908ef9 service nova] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Processing event network-vif-plugged-51ab6198-7fa5-4b12-8d53-effcff16e287 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:58:00.055028 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-33040801-a29e-452b-ae26-f1aca28441c5 req-cc35ed06-3061-4073-88c6-211271908ef9 service nova] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Received event network-vif-plugged-51ab6198-7fa5-4b12-8d53-effcff16e287 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:00.055134 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-33040801-a29e-452b-ae26-f1aca28441c5 req-cc35ed06-3061-4073-88c6-211271908ef9 service nova] Acquiring lock "659c56a6-743a-45e2-aa21-7d45c672f094-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:00.055280 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-33040801-a29e-452b-ae26-f1aca28441c5 req-cc35ed06-3061-4073-88c6-211271908ef9 service nova] Lock "659c56a6-743a-45e2-aa21-7d45c672f094-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:00.055473 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-33040801-a29e-452b-ae26-f1aca28441c5 req-cc35ed06-3061-4073-88c6-211271908ef9 service nova] Lock "659c56a6-743a-45e2-aa21-7d45c672f094-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:00.057672 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-33040801-a29e-452b-ae26-f1aca28441c5 req-cc35ed06-3061-4073-88c6-211271908ef9 service nova] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] No waiting events found dispatching network-vif-plugged-51ab6198-7fa5-4b12-8d53-effcff16e287 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:58:00.057672 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-33040801-a29e-452b-ae26-f1aca28441c5 req-cc35ed06-3061-4073-88c6-211271908ef9 service nova] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Received unexpected event network-vif-plugged-51ab6198-7fa5-4b12-8d53-effcff16e287 for instance with vm_state building and task_state spawning.
May 28 01:58:00.206117 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:58:00.206325 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:58:00.206325 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] No VIF found with MAC fa:16:3e:ca:d6:49, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:58:00.206325 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Using config drive
May 28 01:58:00.220980 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Creating config drive at /opt/stack/data/nova/instances/258fd5d8-1ab7-4d19-afe7-421297b99684/disk.config
May 28 01:58:00.229032 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/258fd5d8-1ab7-4d19-afe7-421297b99684/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphiyo7519 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:00.262297 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-30625552-25ce-4061-baf0-e9f20e952aec req-362b80b0-5e1e-4a7a-a64a-b40b0a8b237b service nova] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Received event network-vif-unplugged-f23d344d-9e4c-41b4-a61f-b324ba3c9794 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:00.262523 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-30625552-25ce-4061-baf0-e9f20e952aec req-362b80b0-5e1e-4a7a-a64a-b40b0a8b237b service nova] Acquiring lock "0d87a47f-2eb6-4e25-b44a-848fe2225962-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:00.262679 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-30625552-25ce-4061-baf0-e9f20e952aec req-362b80b0-5e1e-4a7a-a64a-b40b0a8b237b service nova] Lock "0d87a47f-2eb6-4e25-b44a-848fe2225962-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:00.262859 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-30625552-25ce-4061-baf0-e9f20e952aec req-362b80b0-5e1e-4a7a-a64a-b40b0a8b237b service nova] Lock "0d87a47f-2eb6-4e25-b44a-848fe2225962-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:00.263011 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-30625552-25ce-4061-baf0-e9f20e952aec req-362b80b0-5e1e-4a7a-a64a-b40b0a8b237b service nova] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] No event matching network-vif-unplugged-f23d344d-9e4c-41b4-a61f-b324ba3c9794 in dict_keys([('network-vif-plugged', 'f23d344d-9e4c-41b4-a61f-b324ba3c9794')]) {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 01:58:00.263218 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-30625552-25ce-4061-baf0-e9f20e952aec req-362b80b0-5e1e-4a7a-a64a-b40b0a8b237b service nova] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Received unexpected event network-vif-unplugged-f23d344d-9e4c-41b4-a61f-b324ba3c9794 for instance with vm_state building and task_state spawning.
May 28 01:58:00.288067 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/258fd5d8-1ab7-4d19-afe7-421297b99684/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphiyo7519" returned: 0 in 0.059s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:00.379438 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Found WWN 3300000002afce0fc for multipath device dm-5 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:58:00.379438 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:58:00.379438 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] <== connect_volume: return (3038ms) {'type': 'block', 'scsi_wwn': '3300000002afce0fc', 'path': '/dev/dm-5', 'multipath_id': '3300000002afce0fc'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:58:00.379438 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002afce0fc', 'path': '/dev/dm-5', 'multipath_id': '3300000002afce0fc'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:58:00.385574 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lazy-loading 'flavor' on Instance uuid 1100d127-f3d6-416e-a646-b072660980bc {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:58:00.477646 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933480.4769492, 659c56a6-743a-45e2-aa21-7d45c672f094 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:58:00.477646 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] VM Started (Lifecycle Event)
May 28 01:58:00.478843 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:58:00.484616 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:58:00.488443 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Instance spawned successfully.
May 28 01:58:00.488443 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:58:00.717257 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:00.774989 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:00.808405 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:00.813029 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:00.829616 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-326f2eaa-d720-403e-b995-c2592798d539 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:00.829616 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-326f2eaa-d720-403e-b995-c2592798d539 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:00.829616 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-326f2eaa-d720-403e-b995-c2592798d539 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:00.829616 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-326f2eaa-d720-403e-b995-c2592798d539 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:00.829616 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-326f2eaa-d720-403e-b995-c2592798d539 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:00.833683 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-326f2eaa-d720-403e-b995-c2592798d539 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Terminating instance
May 28 01:58:00.891792 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Attempting to attach volume 26d4395d-39cc-4b5f-a50d-fff1446bdcaa with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98241) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 01:58:00.898599 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] attach device xml: <disk type="block" device="disk">
May 28 01:58:00.898599 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:58:00.898599 np0000001583 nova-compute[98241]:   <alias name="ua-26d4395d-39cc-4b5f-a50d-fff1446bdcaa"/>
May 28 01:58:00.898599 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-5"/>
May 28 01:58:00.898599 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 01:58:00.898599 np0000001583 nova-compute[98241]:   <serial>26d4395d-39cc-4b5f-a50d-fff1446bdcaa</serial>
May 28 01:58:00.898599 np0000001583 nova-compute[98241]: </disk>
May 28 01:58:00.898599 np0000001583 nova-compute[98241]:  {{(pid=98241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 01:58:00.941617 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Creating config drive at /opt/stack/data/nova/instances/0d87a47f-2eb6-4e25-b44a-848fe2225962/disk.config
May 28 01:58:00.949645 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0d87a47f-2eb6-4e25-b44a-848fe2225962/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpm5r003qy {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:00.972325 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:00.979095 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:58:00.979095 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:58:00.989430 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:58:00.998274 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:58:01.004463 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:58:01.006004 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:58:01.006004 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:58:01.006004 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:58:01.006004 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:58:01.006196 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:58:01.013765 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0d87a47f-2eb6-4e25-b44a-848fe2225962/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpm5r003qy" returned: 0 in 0.063s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:01.206278 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:01.222555 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:01.224514 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:01.253202 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:01.259203 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:01.337868 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-326f2eaa-d720-403e-b995-c2592798d539 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:58:01.369567 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:01.372138 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:01.399745 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:01.491013 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:58:01.504614 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:58:01.504614 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933481.504091, 659c56a6-743a-45e2-aa21-7d45c672f094 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:58:01.504614 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] VM Paused (Lifecycle Event)
May 28 01:58:01.517093 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Took 7.90 seconds to spawn the instance on the hypervisor.
May 28 01:58:01.517352 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:58:01.559048 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:01.571099 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:01.654464 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:01.698041 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:01.752477 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:01.799304 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:01.799304 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:01.821950 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:01.883224 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:01.891237 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:01.918910 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Instance destroyed successfully.
May 28 01:58:01.920710 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-326f2eaa-d720-403e-b995-c2592798d539 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lazy-loading 'resources' on Instance uuid 12f40ca4-b4b3-43f4-8c0b-cb208f59935c {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:58:01.925381 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:02.008102 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.618s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:02.008102 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:58:02.011009 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:58:02.026070 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933482.022814, 659c56a6-743a-45e2-aa21-7d45c672f094 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:58:02.026070 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] VM Resumed (Lifecycle Event)
May 28 01:58:02.048208 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Took 13.39 seconds to build instance.
May 28 01:58:02.101982 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:02.110558 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:02.164702 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-61322007-f42c-4e20-bddb-78bf2d5b3c4a req-4d2501e4-378e-4392-8ad6-2c1694d02cdd service nova] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Received event network-vif-plugged-e2e9b3d8-d03e-4deb-99a4-92bd5370674d {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:02.164702 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-61322007-f42c-4e20-bddb-78bf2d5b3c4a req-4d2501e4-378e-4392-8ad6-2c1694d02cdd service nova] Acquiring lock "258fd5d8-1ab7-4d19-afe7-421297b99684-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:02.165159 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-61322007-f42c-4e20-bddb-78bf2d5b3c4a req-4d2501e4-378e-4392-8ad6-2c1694d02cdd service nova] Lock "258fd5d8-1ab7-4d19-afe7-421297b99684-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:02.166892 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-61322007-f42c-4e20-bddb-78bf2d5b3c4a req-4d2501e4-378e-4392-8ad6-2c1694d02cdd service nova] Lock "258fd5d8-1ab7-4d19-afe7-421297b99684-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:02.166892 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-61322007-f42c-4e20-bddb-78bf2d5b3c4a req-4d2501e4-378e-4392-8ad6-2c1694d02cdd service nova] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Processing event network-vif-plugged-e2e9b3d8-d03e-4deb-99a4-92bd5370674d {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:58:02.166892 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-61322007-f42c-4e20-bddb-78bf2d5b3c4a req-4d2501e4-378e-4392-8ad6-2c1694d02cdd service nova] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Received event network-vif-plugged-e2e9b3d8-d03e-4deb-99a4-92bd5370674d {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:02.166892 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-61322007-f42c-4e20-bddb-78bf2d5b3c4a req-4d2501e4-378e-4392-8ad6-2c1694d02cdd service nova] Acquiring lock "258fd5d8-1ab7-4d19-afe7-421297b99684-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:02.166892 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-61322007-f42c-4e20-bddb-78bf2d5b3c4a req-4d2501e4-378e-4392-8ad6-2c1694d02cdd service nova] Lock "258fd5d8-1ab7-4d19-afe7-421297b99684-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:02.167044 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-61322007-f42c-4e20-bddb-78bf2d5b3c4a req-4d2501e4-378e-4392-8ad6-2c1694d02cdd service nova] Lock "258fd5d8-1ab7-4d19-afe7-421297b99684-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:02.167394 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-61322007-f42c-4e20-bddb-78bf2d5b3c4a req-4d2501e4-378e-4392-8ad6-2c1694d02cdd service nova] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] No waiting events found dispatching network-vif-plugged-e2e9b3d8-d03e-4deb-99a4-92bd5370674d {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:58:02.167660 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-61322007-f42c-4e20-bddb-78bf2d5b3c4a req-4d2501e4-378e-4392-8ad6-2c1694d02cdd service nova] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Received unexpected event network-vif-plugged-e2e9b3d8-d03e-4deb-99a4-92bd5370674d for instance with vm_state building and task_state spawning.
May 28 01:58:02.168554 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-61322007-f42c-4e20-bddb-78bf2d5b3c4a req-4d2501e4-378e-4392-8ad6-2c1694d02cdd service nova] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Received event network-vif-unplugged-bce4c127-622b-4001-a5df-94a04616b08e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:02.168554 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-61322007-f42c-4e20-bddb-78bf2d5b3c4a req-4d2501e4-378e-4392-8ad6-2c1694d02cdd service nova] Acquiring lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:02.168654 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-61322007-f42c-4e20-bddb-78bf2d5b3c4a req-4d2501e4-378e-4392-8ad6-2c1694d02cdd service nova] Lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:02.168774 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-61322007-f42c-4e20-bddb-78bf2d5b3c4a req-4d2501e4-378e-4392-8ad6-2c1694d02cdd service nova] Lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:02.170521 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-61322007-f42c-4e20-bddb-78bf2d5b3c4a req-4d2501e4-378e-4392-8ad6-2c1694d02cdd service nova] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] No waiting events found dispatching network-vif-unplugged-bce4c127-622b-4001-a5df-94a04616b08e {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:58:02.170521 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-61322007-f42c-4e20-bddb-78bf2d5b3c4a req-4d2501e4-378e-4392-8ad6-2c1694d02cdd service nova] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Received event network-vif-unplugged-bce4c127-622b-4001-a5df-94a04616b08e for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:58:02.303049 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:02.310180 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:02.336888 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5245c787-f87f-4c5f-8536-617f30617251 req-836b2fc4-ec2d-43cc-8a05-bda932e710b1 service nova] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Received event network-vif-plugged-f23d344d-9e4c-41b4-a61f-b324ba3c9794 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:02.337151 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5245c787-f87f-4c5f-8536-617f30617251 req-836b2fc4-ec2d-43cc-8a05-bda932e710b1 service nova] Acquiring lock "0d87a47f-2eb6-4e25-b44a-848fe2225962-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:02.339986 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5245c787-f87f-4c5f-8536-617f30617251 req-836b2fc4-ec2d-43cc-8a05-bda932e710b1 service nova] Lock "0d87a47f-2eb6-4e25-b44a-848fe2225962-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:02.340672 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5245c787-f87f-4c5f-8536-617f30617251 req-836b2fc4-ec2d-43cc-8a05-bda932e710b1 service nova] Lock "0d87a47f-2eb6-4e25-b44a-848fe2225962-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:02.340826 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5245c787-f87f-4c5f-8536-617f30617251 req-836b2fc4-ec2d-43cc-8a05-bda932e710b1 service nova] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Processing event network-vif-plugged-f23d344d-9e4c-41b4-a61f-b324ba3c9794 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:58:02.423316 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-326f2eaa-d720-403e-b995-c2592798d539 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:56:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1837652712',display_name='tempest-ServerActionsTestOtherA-server-1837652712',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001583',hostname='tempest-serveractionstestothera-server-1837652712',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIePG0IU7S1SlFjpc/VmXFCBBKIijsN+gHQMlnhYfGPcl665nwX9JP0OwVOuueebU/mRc6FRuLr9ai0zvPAu2rDRN1UE1FBgnGgOOoImTJFqPL9BfFXoi8JNvWclsGpwzg==',key_name='tempest-keypair-1911990843',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:57:30Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60fbdf5ed38b4dc485a81c49b3303ed2',ramdisk_id='',reservation_id='r-t6bk0usf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1714646345',owner_user_name='tempest-ServerActionsTestOtherA-1714646345-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:57:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27c90c0a8eb148fda8ae718f07ff1ed4',uuid=12f40ca4-b4b3-43f4-8c0b-cb208f59935c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bce4c127-622b-4001-a5df-94a04616b08e", "address": "fa:16:3e:b1:89:97", "network": {"id": "b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-280876007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60fbdf5ed38b4dc485a81c49b3303ed2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbce4c127-62", "ovs_interfaceid": "bce4c127-622b-4001-a5df-94a04616b08e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:58:02.423503 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-326f2eaa-d720-403e-b995-c2592798d539 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Converting VIF {"id": "bce4c127-622b-4001-a5df-94a04616b08e", "address": "fa:16:3e:b1:89:97", "network": {"id": "b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-280876007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60fbdf5ed38b4dc485a81c49b3303ed2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbce4c127-62", "ovs_interfaceid": "bce4c127-622b-4001-a5df-94a04616b08e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:58:02.424775 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-326f2eaa-d720-403e-b995-c2592798d539 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b1:89:97,bridge_name='br-int',has_traffic_filtering=True,id=bce4c127-622b-4001-a5df-94a04616b08e,network=Network(b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbce4c127-62') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:58:02.425089 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-326f2eaa-d720-403e-b995-c2592798d539 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:89:97,bridge_name='br-int',has_traffic_filtering=True,id=bce4c127-622b-4001-a5df-94a04616b08e,network=Network(b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbce4c127-62') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:58:02.429786 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:02.430118 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbce4c127-62, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:58:02.431195 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:02.435135 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:58:02.435135 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:02.435135 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:02.435135 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=889f965a-83a6-43d0-88da-b893fcceeb6c) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:58:02.435135 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:02.435135 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:58:02.435367 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:02.438489 np0000001583 nova-compute[98241]: INFO os_vif [None req-326f2eaa-d720-403e-b995-c2592798d539 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:89:97,bridge_name='br-int',has_traffic_filtering=True,id=bce4c127-622b-4001-a5df-94a04616b08e,network=Network(b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbce4c127-62')
May 28 01:58:02.444632 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-326f2eaa-d720-403e-b995-c2592798d539 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:58:02.445031 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-326f2eaa-d720-403e-b995-c2592798d539 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', 'iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:58:02.445239 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-326f2eaa-d720-403e-b995-c2592798d539 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:58:02.445704 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-326f2eaa-d720-403e-b995-c2592798d539 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:58:02.445947 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-326f2eaa-d720-403e-b995-c2592798d539 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', 'iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:58:02.446111 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-326f2eaa-d720-403e-b995-c2592798d539 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:58:02.472043 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-326f2eaa-d720-403e-b995-c2592798d539 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:58:02.472043 np0000001583 nova-compute[98241]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:58:02.472043 np0000001583 nova-compute[98241]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048 (non-flash)
May 28 01:58:02.472043 np0000001583 nova-compute[98241]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048 (non-flash)
May 28 01:58:02.472043 np0000001583 nova-compute[98241]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa (non-flash)
May 28 01:58:02.472043 np0000001583 nova-compute[98241]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa (non-flash)
May 28 01:58:02.472043 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:58:02.472280 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-326f2eaa-d720-403e-b995-c2592798d539 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsi session list stdout=tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:58:02.472280 np0000001583 nova-compute[98241]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a (non-flash)
May 28 01:58:02.472280 np0000001583 nova-compute[98241]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048 (non-flash)
May 28 01:58:02.472280 np0000001583 nova-compute[98241]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048 (non-flash)
May 28 01:58:02.472280 np0000001583 nova-compute[98241]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa (non-flash)
May 28 01:58:02.472280 np0000001583 nova-compute[98241]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa (non-flash)
May 28 01:58:02.472280 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:58:02.472280 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-326f2eaa-d720-403e-b995-c2592798d539 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', '60'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', '61'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048', '64'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048', '65'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa', '67')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:58:02.472454 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-326f2eaa-d720-403e-b995-c2592798d539 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', '60')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:58:02.473134 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-326f2eaa-d720-403e-b995-c2592798d539 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a', '61')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:58:02.473769 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-326f2eaa-d720-403e-b995-c2592798d539 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f817fb00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a'): ({'sdc'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:58:02.473959 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-326f2eaa-d720-403e-b995-c2592798d539 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Removing multipathed devices sdc, sdb {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:58:02.474287 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-326f2eaa-d720-403e-b995-c2592798d539 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Flush multipath device 330000000acc6074f {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:58:02.517937 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:58:02.517937 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:58:02.517937 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:02.517937 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:02.526712 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:58:02.532044 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:58:02.537004 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-326f2eaa-d720-403e-b995-c2592798d539 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:58:02.553103 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-13b126b3-0f63-48fb-bb5a-506f537571a4 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "659c56a6-743a-45e2-aa21-7d45c672f094" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.902s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:02.670071 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-326f2eaa-d720-403e-b995-c2592798d539 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:58:02.670071 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cadb612e41314b06914d5f5f47570e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0474090f4f2d4950b51bc317f4302266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:58:02.670071 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-326f2eaa-d720-403e-b995-c2592798d539 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:58:02.670071 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-326f2eaa-d720-403e-b995-c2592798d539 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:58:02.670071 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-326f2eaa-d720-403e-b995-c2592798d539 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:58:02.670071 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-326f2eaa-d720-403e-b995-c2592798d539 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:58:02.670071 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-326f2eaa-d720-403e-b995-c2592798d539 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:58:02.670071 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-326f2eaa-d720-403e-b995-c2592798d539 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:58:02.702504 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-326f2eaa-d720-403e-b995-c2592798d539 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a, portal: 192.168.40.100,3260]
May 28 01:58:02.702504 np0000001583 nova-compute[98241]: Logout of [sid: 60, target: iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a, portal: 192.168.40.100,3260] successful.
May 28 01:58:02.702504 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:58:02.731610 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-326f2eaa-d720-403e-b995-c2592798d539 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:58:02.746252 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-326f2eaa-d720-403e-b995-c2592798d539 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:58:02.780267 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-326f2eaa-d720-403e-b995-c2592798d539 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a, portal: 192.168.50.100,3260]
May 28 01:58:02.780267 np0000001583 nova-compute[98241]: Logout of [sid: 61, target: iqn.2023-03.storpool.com:os--volume-78c187c7-3cb4-4c4d-a525-9e431e3d0d1a, portal: 192.168.50.100,3260] successful.
May 28 01:58:02.780267 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:58:02.796522 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:58:02.798354 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:58:02.805334 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-326f2eaa-d720-403e-b995-c2592798d539 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:58:02.805605 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-326f2eaa-d720-403e-b995-c2592798d539 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:58:02.809910 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-326f2eaa-d720-403e-b995-c2592798d539 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] <== disconnect_volume: return (360ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:58:02.809910 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-326f2eaa-d720-403e-b995-c2592798d539 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:58:02.809910 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-326f2eaa-d720-403e-b995-c2592798d539 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Deleting instance files /opt/stack/data/nova/instances/12f40ca4-b4b3-43f4-8c0b-cb208f59935c_del
May 28 01:58:02.810392 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-326f2eaa-d720-403e-b995-c2592798d539 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Deletion of /opt/stack/data/nova/instances/12f40ca4-b4b3-43f4-8c0b-cb208f59935c_del complete
May 28 01:58:02.813121 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Instance spawned successfully.
May 28 01:58:02.816132 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:58:02.824124 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:58:02.824124 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:58:02.824124 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:58:02.824124 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] No VIF found with MAC fa:16:3e:92:e2:5b, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:58:03.017070 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:58:03.034807 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999643028000264 future=<Future at 0x7724ec16cb60 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:58:03.035246 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999178973000198 future=<Future at 0x7724ec16cb60 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:58:03.035385 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999002466000093 future=<Future at 0x7724ec16cb60 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:58:03.035708 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933483.0354428, 258fd5d8-1ab7-4d19-afe7-421297b99684 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:58:03.035859 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] VM Started (Lifecycle Event)
May 28 01:58:03.084631 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:03.169582 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:58:03.171622 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:58:03.175864 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Instance spawned successfully.
May 28 01:58:03.176192 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:58:03.320501 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-326f2eaa-d720-403e-b995-c2592798d539 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Took 1.98 seconds to destroy the instance on the hypervisor.
May 28 01:58:03.321137 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-326f2eaa-d720-403e-b995-c2592798d539 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:58:03.321469 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:58:03.321602 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:58:03.321952 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:03.325839 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:58:03.326073 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:58:03.327391 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:58:03.327391 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:58:03.327391 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:58:03.327391 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:58:03.493055 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:03.520862 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:58:03.540844 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:58:03.542652 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:58:03.685798 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:58:03.685968 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:58:03.686431 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:58:03.686721 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:58:03.686987 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:58:03.687287 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:58:03.775113 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Successfully created port: 012d880f-9a02-47db-a8d6-2ea821b0bd72 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:58:03.833986 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Took 18.33 seconds to spawn the instance on the hypervisor.
May 28 01:58:03.834136 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:58:04.026369 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Booting with volume 4f727671-7b59-48c4-9bb3-9fc3f3a25a71 at /dev/vda
May 28 01:58:04.045456 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:58:04.045790 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933484.0455875, 258fd5d8-1ab7-4d19-afe7-421297b99684 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:58:04.045945 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] VM Paused (Lifecycle Event)
May 28 01:58:04.108483 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:58:04.122190 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:58:04.149429 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:04.203801 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Took 8.01 seconds to spawn the instance on the hypervisor.
May 28 01:58:04.203801 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:58:04.203801 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:58:04.203801 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:58:04.214054 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:58:04.215618 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe63:2bb1', 'fe80::e43a:d5ff:fecc:27fe', 'fe80::fc16:3eff:fe92:e25b', 'fe80::ecb9:b7ff:fe00:dc63', 'fe80::fc16:3eff:feae:1e12', 'fe80::8832:afff:fe8a:cd4c', 'fe80::fc16:3eff:feee:f063', 'fe80::34e0:eeff:fee2:bede', 'fe80::fc16:3eff:feca:d649'] 
May 28 01:58:04.216066 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:58:04.216258 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:58:04.216571 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:58:04.216853 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Updating existing volume attachment record: 78e5d4ff-2f15-4b67-8e6d-2ddd0dcbbf85 {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:58:04.249736 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2e547e10-8fbd-4b3f-ac14-e757eca20cbe req-1c2945fd-4213-47a5-be24-cb380cffc6e9 service nova] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Received event network-vif-unplugged-bce4c127-622b-4001-a5df-94a04616b08e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:04.259520 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2e547e10-8fbd-4b3f-ac14-e757eca20cbe req-1c2945fd-4213-47a5-be24-cb380cffc6e9 service nova] Acquiring lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:04.259520 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2e547e10-8fbd-4b3f-ac14-e757eca20cbe req-1c2945fd-4213-47a5-be24-cb380cffc6e9 service nova] Lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:04.259520 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2e547e10-8fbd-4b3f-ac14-e757eca20cbe req-1c2945fd-4213-47a5-be24-cb380cffc6e9 service nova] Lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:04.259520 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2e547e10-8fbd-4b3f-ac14-e757eca20cbe req-1c2945fd-4213-47a5-be24-cb380cffc6e9 service nova] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] No waiting events found dispatching network-vif-unplugged-bce4c127-622b-4001-a5df-94a04616b08e {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:58:04.259520 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2e547e10-8fbd-4b3f-ac14-e757eca20cbe req-1c2945fd-4213-47a5-be24-cb380cffc6e9 service nova] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Received event network-vif-unplugged-bce4c127-622b-4001-a5df-94a04616b08e for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:58:04.259520 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2e547e10-8fbd-4b3f-ac14-e757eca20cbe req-1c2945fd-4213-47a5-be24-cb380cffc6e9 service nova] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Received event network-vif-plugged-bce4c127-622b-4001-a5df-94a04616b08e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:04.259520 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2e547e10-8fbd-4b3f-ac14-e757eca20cbe req-1c2945fd-4213-47a5-be24-cb380cffc6e9 service nova] Acquiring lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:04.259520 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2e547e10-8fbd-4b3f-ac14-e757eca20cbe req-1c2945fd-4213-47a5-be24-cb380cffc6e9 service nova] Lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:04.259520 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2e547e10-8fbd-4b3f-ac14-e757eca20cbe req-1c2945fd-4213-47a5-be24-cb380cffc6e9 service nova] Lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:04.259520 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2e547e10-8fbd-4b3f-ac14-e757eca20cbe req-1c2945fd-4213-47a5-be24-cb380cffc6e9 service nova] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] No waiting events found dispatching network-vif-plugged-bce4c127-622b-4001-a5df-94a04616b08e {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:58:04.259520 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-2e547e10-8fbd-4b3f-ac14-e757eca20cbe req-1c2945fd-4213-47a5-be24-cb380cffc6e9 service nova] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Received unexpected event network-vif-plugged-bce4c127-622b-4001-a5df-94a04616b08e for instance with vm_state active and task_state deleting.
May 28 01:58:04.259520 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2e547e10-8fbd-4b3f-ac14-e757eca20cbe req-1c2945fd-4213-47a5-be24-cb380cffc6e9 service nova] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Received event network-vif-plugged-bce4c127-622b-4001-a5df-94a04616b08e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:04.259520 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2e547e10-8fbd-4b3f-ac14-e757eca20cbe req-1c2945fd-4213-47a5-be24-cb380cffc6e9 service nova] Acquiring lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:04.259520 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2e547e10-8fbd-4b3f-ac14-e757eca20cbe req-1c2945fd-4213-47a5-be24-cb380cffc6e9 service nova] Lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:04.259520 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2e547e10-8fbd-4b3f-ac14-e757eca20cbe req-1c2945fd-4213-47a5-be24-cb380cffc6e9 service nova] Lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:04.259520 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2e547e10-8fbd-4b3f-ac14-e757eca20cbe req-1c2945fd-4213-47a5-be24-cb380cffc6e9 service nova] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] No waiting events found dispatching network-vif-plugged-bce4c127-622b-4001-a5df-94a04616b08e {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:58:04.259520 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-2e547e10-8fbd-4b3f-ac14-e757eca20cbe req-1c2945fd-4213-47a5-be24-cb380cffc6e9 service nova] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Received unexpected event network-vif-plugged-bce4c127-622b-4001-a5df-94a04616b08e for instance with vm_state active and task_state deleting.
May 28 01:58:04.259520 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2e547e10-8fbd-4b3f-ac14-e757eca20cbe req-1c2945fd-4213-47a5-be24-cb380cffc6e9 service nova] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Received event network-vif-unplugged-bce4c127-622b-4001-a5df-94a04616b08e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:04.259520 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2e547e10-8fbd-4b3f-ac14-e757eca20cbe req-1c2945fd-4213-47a5-be24-cb380cffc6e9 service nova] Acquiring lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:04.259520 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2e547e10-8fbd-4b3f-ac14-e757eca20cbe req-1c2945fd-4213-47a5-be24-cb380cffc6e9 service nova] Lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:04.259520 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2e547e10-8fbd-4b3f-ac14-e757eca20cbe req-1c2945fd-4213-47a5-be24-cb380cffc6e9 service nova] Lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:04.259520 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2e547e10-8fbd-4b3f-ac14-e757eca20cbe req-1c2945fd-4213-47a5-be24-cb380cffc6e9 service nova] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] No waiting events found dispatching network-vif-unplugged-bce4c127-622b-4001-a5df-94a04616b08e {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:58:04.259520 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2e547e10-8fbd-4b3f-ac14-e757eca20cbe req-1c2945fd-4213-47a5-be24-cb380cffc6e9 service nova] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Received event network-vif-unplugged-bce4c127-622b-4001-a5df-94a04616b08e for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:58:04.259520 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2e547e10-8fbd-4b3f-ac14-e757eca20cbe req-1c2945fd-4213-47a5-be24-cb380cffc6e9 service nova] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Received event network-vif-unplugged-bce4c127-622b-4001-a5df-94a04616b08e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:04.259520 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2e547e10-8fbd-4b3f-ac14-e757eca20cbe req-1c2945fd-4213-47a5-be24-cb380cffc6e9 service nova] Acquiring lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:04.261603 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2e547e10-8fbd-4b3f-ac14-e757eca20cbe req-1c2945fd-4213-47a5-be24-cb380cffc6e9 service nova] Lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:04.261603 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2e547e10-8fbd-4b3f-ac14-e757eca20cbe req-1c2945fd-4213-47a5-be24-cb380cffc6e9 service nova] Lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:04.261603 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2e547e10-8fbd-4b3f-ac14-e757eca20cbe req-1c2945fd-4213-47a5-be24-cb380cffc6e9 service nova] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] No waiting events found dispatching network-vif-unplugged-bce4c127-622b-4001-a5df-94a04616b08e {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:58:04.261603 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2e547e10-8fbd-4b3f-ac14-e757eca20cbe req-1c2945fd-4213-47a5-be24-cb380cffc6e9 service nova] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Received event network-vif-unplugged-bce4c127-622b-4001-a5df-94a04616b08e for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:58:04.353603 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Took 25.57 seconds to build instance.
May 28 01:58:04.438209 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-142e0d0e-fae5-4cae-b0c7-ffc49c181262 req-da3f07ee-223f-4770-b73c-d34e8ad2ff80 service nova] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Received event network-vif-plugged-f23d344d-9e4c-41b4-a61f-b324ba3c9794 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:04.438481 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-142e0d0e-fae5-4cae-b0c7-ffc49c181262 req-da3f07ee-223f-4770-b73c-d34e8ad2ff80 service nova] Acquiring lock "0d87a47f-2eb6-4e25-b44a-848fe2225962-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:04.438656 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-142e0d0e-fae5-4cae-b0c7-ffc49c181262 req-da3f07ee-223f-4770-b73c-d34e8ad2ff80 service nova] Lock "0d87a47f-2eb6-4e25-b44a-848fe2225962-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:04.439555 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-142e0d0e-fae5-4cae-b0c7-ffc49c181262 req-da3f07ee-223f-4770-b73c-d34e8ad2ff80 service nova] Lock "0d87a47f-2eb6-4e25-b44a-848fe2225962-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:04.439555 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-142e0d0e-fae5-4cae-b0c7-ffc49c181262 req-da3f07ee-223f-4770-b73c-d34e8ad2ff80 service nova] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] No waiting events found dispatching network-vif-plugged-f23d344d-9e4c-41b4-a61f-b324ba3c9794 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:58:04.440349 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-142e0d0e-fae5-4cae-b0c7-ffc49c181262 req-da3f07ee-223f-4770-b73c-d34e8ad2ff80 service nova] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Received unexpected event network-vif-plugged-f23d344d-9e4c-41b4-a61f-b324ba3c9794 for instance with vm_state active and task_state None.
May 28 01:58:04.459696 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e3e08fff-a220-41d8-a98e-437515e42b29 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "1100d127-f3d6-416e-a646-b072660980bc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.845s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:04.552385 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:58:04.557875 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933484.5558257, 258fd5d8-1ab7-4d19-afe7-421297b99684 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:58:04.557875 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] VM Resumed (Lifecycle Event)
May 28 01:58:04.582671 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Successfully updated port: 012d880f-9a02-47db-a8d6-2ea821b0bd72 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:58:04.668578 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b775d996-4773-40a6-be66-bce660af71be req-aebd6852-b458-4371-9443-839a45c65e11 service nova] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Received event network-changed-012d880f-9a02-47db-a8d6-2ea821b0bd72 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:04.668578 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b775d996-4773-40a6-be66-bce660af71be req-aebd6852-b458-4371-9443-839a45c65e11 service nova] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Refreshing instance network info cache due to event network-changed-012d880f-9a02-47db-a8d6-2ea821b0bd72. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:58:04.668578 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b775d996-4773-40a6-be66-bce660af71be req-aebd6852-b458-4371-9443-839a45c65e11 service nova] Acquiring lock "refresh_cache-e50227a8-b484-447b-abc6-3a3c1379e7ff" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:58:04.668578 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b775d996-4773-40a6-be66-bce660af71be req-aebd6852-b458-4371-9443-839a45c65e11 service nova] Acquired lock "refresh_cache-e50227a8-b484-447b-abc6-3a3c1379e7ff" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:58:04.668578 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-b775d996-4773-40a6-be66-bce660af71be req-aebd6852-b458-4371-9443-839a45c65e11 service nova] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Refreshing network info cache for port 012d880f-9a02-47db-a8d6-2ea821b0bd72 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:58:04.716253 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Took 15.30 seconds to build instance.
May 28 01:58:04.727025 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:58:04.855422 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "258fd5d8-1ab7-4d19-afe7-421297b99684" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.084s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:05.063376 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:58:05.067035 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:58:05.085456 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "refresh_cache-e50227a8-b484-447b-abc6-3a3c1379e7ff" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:58:05.169746 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-b775d996-4773-40a6-be66-bce660af71be req-aebd6852-b458-4371-9443-839a45c65e11 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:05.220632 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "0d87a47f-2eb6-4e25-b44a-848fe2225962" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.815s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:05.229278 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Took 1.91 seconds to deallocate network for instance.
May 28 01:58:05.289493 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-b775d996-4773-40a6-be66-bce660af71be req-aebd6852-b458-4371-9443-839a45c65e11 service nova] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:58:05.508417 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-b775d996-4773-40a6-be66-bce660af71be req-aebd6852-b458-4371-9443-839a45c65e11 service nova] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:58:05.572937 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933485.5726125, 0d87a47f-2eb6-4e25-b44a-848fe2225962 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:58:05.573350 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] VM Started (Lifecycle Event)
May 28 01:58:05.867596 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-326f2eaa-d720-403e-b995-c2592798d539 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Took 0.64 seconds to detach 1 volumes for instance.
May 28 01:58:05.869985 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-326f2eaa-d720-403e-b995-c2592798d539 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Deleting volume: 78c187c7-3cb4-4c4d-a525-9e431e3d0d1a {{(pid=98241) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 28 01:58:05.875251 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Rescuing
May 28 01:58:05.875933 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquiring lock "refresh_cache-0d87a47f-2eb6-4e25-b44a-848fe2225962" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:58:05.877536 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquired lock "refresh_cache-0d87a47f-2eb6-4e25-b44a-848fe2225962" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:58:05.877536 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:58:06.012341 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b775d996-4773-40a6-be66-bce660af71be req-aebd6852-b458-4371-9443-839a45c65e11 service nova] Releasing lock "refresh_cache-e50227a8-b484-447b-abc6-3a3c1379e7ff" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:58:06.012404 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquired lock "refresh_cache-e50227a8-b484-447b-abc6-3a3c1379e7ff" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:58:06.013494 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:58:06.077527 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:58:06.079971 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:58:06.108802 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "258fd5d8-1ab7-4d19-afe7-421297b99684" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:06.109001 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "258fd5d8-1ab7-4d19-afe7-421297b99684" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:06.109244 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "258fd5d8-1ab7-4d19-afe7-421297b99684-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:06.109722 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "258fd5d8-1ab7-4d19-afe7-421297b99684-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:06.109722 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "258fd5d8-1ab7-4d19-afe7-421297b99684-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:06.114615 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Terminating instance
May 28 01:58:06.305580 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b02297cc-3ba3-49c4-bb1b-20f8f1e8c0e3 req-6a0c72e9-be0a-4756-b468-ba51fbdff813 service nova] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Received event network-vif-deleted-bce4c127-622b-4001-a5df-94a04616b08e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:06.384104 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:06.454440 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:58:06.455468 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:58:06.456422 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Creating image(s)
May 28 01:58:06.457186 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Did not create local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 01:58:06.460118 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Ensure instance console log exists: /opt/stack/data/nova/instances/e50227a8-b484-447b-abc6-3a3c1379e7ff/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:58:06.463775 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:06.464499 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:06.464499 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:06.504436 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-326f2eaa-d720-403e-b995-c2592798d539 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:06.504645 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-326f2eaa-d720-403e-b995-c2592798d539 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:06.507772 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-326f2eaa-d720-403e-b995-c2592798d539 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.003s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:06.583899 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] During sync_power_state the instance has a pending task (rescuing). Skip.
May 28 01:58:06.584443 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933486.5839653, 0d87a47f-2eb6-4e25-b44a-848fe2225962 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:58:06.584443 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] VM Paused (Lifecycle Event)
May 28 01:58:06.602345 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-326f2eaa-d720-403e-b995-c2592798d539 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Deleted allocations for instance 12f40ca4-b4b3-43f4-8c0b-cb208f59935c
May 28 01:58:06.607438 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:58:06.623815 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:58:06.656719 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:06.683873 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:06.684350 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:06.711965 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:06.776104 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:06.878347 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:06.942320 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Updating instance_info_cache with network_info: [{"id": "f23d344d-9e4c-41b4-a61f-b324ba3c9794", "address": "fa:16:3e:ca:d6:49", "network": {"id": "e1d5d073-f27b-4ff1-9ed3-99f57407c76f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f65617e71571457f8906997583100678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf23d344d-9e", "ovs_interfaceid": "f23d344d-9e4c-41b4-a61f-b324ba3c9794", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:58:06.969730 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Instance destroyed successfully.
May 28 01:58:06.970906 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lazy-loading 'resources' on Instance uuid 258fd5d8-1ab7-4d19-afe7-421297b99684 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:58:07.088523 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:58:07.090782 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Updating instance_info_cache with network_info: [{"id": "012d880f-9a02-47db-a8d6-2ea821b0bd72", "address": "fa:16:3e:48:7d:7b", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap012d880f-9a", "ovs_interfaceid": "012d880f-9a02-47db-a8d6-2ea821b0bd72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:58:07.094478 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933487.094218, 0d87a47f-2eb6-4e25-b44a-848fe2225962 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:58:07.095469 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] VM Resumed (Lifecycle Event)
May 28 01:58:07.435433 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:07.444300 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Releasing lock "refresh_cache-0d87a47f-2eb6-4e25-b44a-848fe2225962" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:58:07.476707 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:57:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1286123612',display_name='tempest-TestVolumeBootPattern-server-1286123612',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testvolumebootpattern-server-1286123612',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:58:03Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='432aa1094ced436494def17a875aa8e1',ramdisk_id='',reservation_id='r-pqel2ql8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestVolumeBootPattern-1031057169',owner_user_name='tempest-TestVolumeBootPattern-1031057169-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:58:04Z,user_data=None,user_id='6be314b4eed642c3b2c72fe115860220',uuid=258fd5d8-1ab7-4d19-afe7-421297b99684,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2e9b3d8-d03e-4deb-99a4-92bd5370674d", "address": "fa:16:3e:ee:f0:63", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e9b3d8-d0", "ovs_interfaceid": "e2e9b3d8-d03e-4deb-99a4-92bd5370674d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:58:07.476707 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converting VIF {"id": "e2e9b3d8-d03e-4deb-99a4-92bd5370674d", "address": "fa:16:3e:ee:f0:63", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e9b3d8-d0", "ovs_interfaceid": "e2e9b3d8-d03e-4deb-99a4-92bd5370674d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:58:07.477560 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:f0:63,bridge_name='br-int',has_traffic_filtering=True,id=e2e9b3d8-d03e-4deb-99a4-92bd5370674d,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2e9b3d8-d0') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:58:07.477884 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:f0:63,bridge_name='br-int',has_traffic_filtering=True,id=e2e9b3d8-d03e-4deb-99a4-92bd5370674d,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2e9b3d8-d0') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:58:07.479639 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:07.479965 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape2e9b3d8-d0, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:58:07.481027 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:07.481820 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:58:07.482057 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:07.482978 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:07.483187 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b620e1f0-6dff-43d3-990c-290927686bfe) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:58:07.483682 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:07.484189 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:58:07.484350 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:07.486537 np0000001583 nova-compute[98241]: INFO os_vif [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:f0:63,bridge_name='br-int',has_traffic_filtering=True,id=e2e9b3d8-d03e-4deb-99a4-92bd5370674d,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2e9b3d8-d0')
May 28 01:58:07.546869 np0000001583 nova-compute[98241]: DEBUG os_brick.encryptors [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048', 'iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '652e60a5-d4d1-48ab-9219-95bf7e8bf048', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, 'status': 'reserved', 'instance': '258fd5d8-1ab7-4d19-afe7-421297b99684', 'attached_at': '', 'detached_at': '', 'volume_id': '652e60a5-d4d1-48ab-9219-95bf7e8bf048', 'serial': '652e60a5-d4d1-48ab-9219-95bf7e8bf048'} {{(pid=98241) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 01:58:07.547430 np0000001583 nova-compute[98241]: WARNING stevedore.named [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 01:58:07.547661 np0000001583 nova-compute[98241]: WARNING castellan.key_manager [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 01:58:07.547824 np0000001583 nova-compute[98241]: WARNING nova.keymgr.conf_key_mgr [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 01:58:07.548359 np0000001583 nova-compute[98241]: DEBUG os_brick.encryptors [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x7724f879e000>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048', 'iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '652e60a5-d4d1-48ab-9219-95bf7e8bf048', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, 'status': 'reserved', 'instance': '258fd5d8-1ab7-4d19-afe7-421297b99684', 'attached_at': '', 'detached_at': '', 'volume_id': '652e60a5-d4d1-48ab-9219-95bf7e8bf048', 'serial': '652e60a5-d4d1-48ab-9219-95bf7e8bf048'} {{(pid=98241) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 28 01:58:07.548506 np0000001583 nova-compute[98241]: DEBUG os_brick.encryptors.luks [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] closing encrypted volume /dev/dm-4 {{(pid=98241) _close_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:207}}
May 28 01:58:07.581662 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:58:07.582209 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048', 'iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '652e60a5-d4d1-48ab-9219-95bf7e8bf048', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:58:07.582459 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:58:07.582761 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:58:07.583371 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048', 'iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '652e60a5-d4d1-48ab-9219-95bf7e8bf048', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:58:07.583484 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:58:07.593954 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Releasing lock "refresh_cache-e50227a8-b484-447b-abc6-3a3c1379e7ff" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:58:07.596273 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Instance network_info: |[{"id": "012d880f-9a02-47db-a8d6-2ea821b0bd72", "address": "fa:16:3e:48:7d:7b", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap012d880f-9a", "ovs_interfaceid": "012d880f-9a02-47db-a8d6-2ea821b0bd72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:58:07.597069 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Start _get_guest_xml network_info=[{"id": "012d880f-9a02-47db-a8d6-2ea821b0bd72", "address": "fa:16:3e:48:7d:7b", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap012d880f-9a", "ovs_interfaceid": "012d880f-9a02-47db-a8d6-2ea821b0bd72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4f727671-7b59-48c4-9bb3-9fc3f3a25a71', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'e50227a8-b484-447b-abc6-3a3c1379e7ff', 'attached_at': '', 'detached_at': '', 'volume_id': '4f727671-7b59-48c4-9bb3-9fc3f3a25a71', 'serial': '4f727671-7b59-48c4-9bb3-9fc3f3a25a71', 'multiattach': True}, 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '78e5d4ff-2f15-4b67-8e6d-2ddd0dcbbf85', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:58:07.598218 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:58:07.604653 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:58:07.607039 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "668cf051-44c2-4db1-bfd1-dfeed0c6b5a4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:07.610241 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeMultiAttachTest-server-255087748', uuid='e50227a8-b484-447b-abc6-3a3c1379e7ff'), owner=OwnerMeta(userid='cadb612e41314b06914d5f5f47570e98', username='tempest-AttachVolumeMultiAttachTest-857456921-project-member', projectid='0474090f4f2d4950b51bc317f4302266', projectname='tempest-AttachVolumeMultiAttachTest-857456921'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "012d880f-9a02-47db-a8d6-2ea821b0bd72", "address": "fa:16:3e:48:7d:7b", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap012d880f-9a", "ovs_interfaceid": "012d880f-9a02-47db-a8d6-2ea821b0bd72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933487.6062088) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:58:07.616982 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "668cf051-44c2-4db1-bfd1-dfeed0c6b5a4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:07.621325 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:58:07.624633 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:58:07.628150 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-326f2eaa-d720-403e-b995-c2592798d539 tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "12f40ca4-b4b3-43f4-8c0b-cb208f59935c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.799s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:07.629499 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:58:07.633767 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:58:07.633767 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:58:07.636164 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:58:07.637004 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:58:07.637261 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:58:07.637531 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:58:07.638259 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:58:07.638426 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:58:07.638957 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:58:07.639213 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:58:07.639374 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:58:07.639532 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:58:07.639678 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:58:07.640470 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:58:07.652099 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048 (non-flash)
May 28 01:58:07.652099 np0000001583 nova-compute[98241]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048 (non-flash)
May 28 01:58:07.652099 np0000001583 nova-compute[98241]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa (non-flash)
May 28 01:58:07.652099 np0000001583 nova-compute[98241]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa (non-flash)
May 28 01:58:07.652099 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:58:07.652397 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048 (non-flash)
May 28 01:58:07.652397 np0000001583 nova-compute[98241]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048 (non-flash)
May 28 01:58:07.652397 np0000001583 nova-compute[98241]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa (non-flash)
May 28 01:58:07.652397 np0000001583 nova-compute[98241]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa (non-flash)
May 28 01:58:07.652397 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:58:07.652570 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048', '64'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048', '65'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa', '67')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:58:07.652760 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048', '64')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:58:07.658038 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:58:07.658429 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4f727671-7b59-48c4-9bb3-9fc3f3a25a71', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:58:07.658541 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:58:07.661012 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048', '65')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:58:07.661012 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f83d7600>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048'): ({'sde'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:58:07.661012 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Removing multipathed devices sdd, sde {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:58:07.661230 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Flush multipath device 3300000001af12c99 {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:58:07.721959 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:58:07.778887 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:58:07.826192 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:58:07.826192 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:58:07.826327 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:58:07.843746 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:58:07.844072 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:58:07.856194 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:58:07.887225 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 64, target: iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048, portal: 192.168.40.100,3260]
May 28 01:58:07.887225 np0000001583 nova-compute[98241]: Logout of [sid: 64, target: iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048, portal: 192.168.40.100,3260] successful.
May 28 01:58:07.887225 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:58:07.900940 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:58:07.913145 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:58:07.946586 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 65, target: iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048, portal: 192.168.50.100,3260]
May 28 01:58:07.946586 np0000001583 nova-compute[98241]: Logout of [sid: 65, target: iqn.2023-03.storpool.com:os--volume-652e60a5-d4d1-48ab-9219-95bf7e8bf048, portal: 192.168.50.100,3260] successful.
May 28 01:58:07.946586 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:58:07.959132 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:58:07.960250 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:58:07.960430 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] <== disconnect_volume: return (377ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:58:07.960583 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:58:07.960863 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Deleting instance files /opt/stack/data/nova/instances/258fd5d8-1ab7-4d19-afe7-421297b99684_del
May 28 01:58:07.961433 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Deletion of /opt/stack/data/nova/instances/258fd5d8-1ab7-4d19-afe7-421297b99684_del complete
May 28 01:58:07.963998 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.305s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:58:07.964247 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4f727671-7b59-48c4-9bb3-9fc3f3a25a71', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:58:07.982540 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:58:07.985060 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:58:07.985060 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:58:07.985060 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:58:07.985277 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:58:07.985372 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:58:07.996573 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:58:07.996573 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:58:08.004623 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:58:08.004623 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:58:08.017831 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71] added
May 28 01:58:08.017831 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:58:08.017831 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:58:08.017831 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:58:08.017831 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:58:08.017831 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:58:08.017831 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:58:08.017831 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:58:08.017831 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0335(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:58:08.017831 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:58:08.020185 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71] added
May 28 01:58:08.020185 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:58:08.020185 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:58:08.020185 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:58:08.020185 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:58:08.020185 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:58:08.020185 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:58:08.020185 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:58:08.020185 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0342(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:58:08.020185 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:58:08.095974 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:08.129746 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:58:08.129746 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] During sync_power_state the instance has a pending task (rescuing). Skip.
May 28 01:58:08.129746 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999810419000369 future=<Future at 0x7724ec2efb30 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:58:08.403631 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-acf52cdc-42dd-46d2-98e9-138b119addfb req-058589f3-718b-4360-b937-d639917c3acf service nova] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Received event network-vif-unplugged-e2e9b3d8-d03e-4deb-99a4-92bd5370674d {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:08.403894 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-acf52cdc-42dd-46d2-98e9-138b119addfb req-058589f3-718b-4360-b937-d639917c3acf service nova] Acquiring lock "258fd5d8-1ab7-4d19-afe7-421297b99684-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:08.405893 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-acf52cdc-42dd-46d2-98e9-138b119addfb req-058589f3-718b-4360-b937-d639917c3acf service nova] Lock "258fd5d8-1ab7-4d19-afe7-421297b99684-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:08.405893 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-acf52cdc-42dd-46d2-98e9-138b119addfb req-058589f3-718b-4360-b937-d639917c3acf service nova] Lock "258fd5d8-1ab7-4d19-afe7-421297b99684-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:08.405893 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-acf52cdc-42dd-46d2-98e9-138b119addfb req-058589f3-718b-4360-b937-d639917c3acf service nova] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] No waiting events found dispatching network-vif-unplugged-e2e9b3d8-d03e-4deb-99a4-92bd5370674d {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:58:08.405893 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-acf52cdc-42dd-46d2-98e9-138b119addfb req-058589f3-718b-4360-b937-d639917c3acf service nova] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Received event network-vif-unplugged-e2e9b3d8-d03e-4deb-99a4-92bd5370674d for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:58:08.405893 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-acf52cdc-42dd-46d2-98e9-138b119addfb req-058589f3-718b-4360-b937-d639917c3acf service nova] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Received event network-vif-unplugged-e2e9b3d8-d03e-4deb-99a4-92bd5370674d {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:08.405893 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-acf52cdc-42dd-46d2-98e9-138b119addfb req-058589f3-718b-4360-b937-d639917c3acf service nova] Acquiring lock "258fd5d8-1ab7-4d19-afe7-421297b99684-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:08.405893 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-acf52cdc-42dd-46d2-98e9-138b119addfb req-058589f3-718b-4360-b937-d639917c3acf service nova] Lock "258fd5d8-1ab7-4d19-afe7-421297b99684-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:08.405893 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-acf52cdc-42dd-46d2-98e9-138b119addfb req-058589f3-718b-4360-b937-d639917c3acf service nova] Lock "258fd5d8-1ab7-4d19-afe7-421297b99684-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:08.405893 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-acf52cdc-42dd-46d2-98e9-138b119addfb req-058589f3-718b-4360-b937-d639917c3acf service nova] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] No waiting events found dispatching network-vif-unplugged-e2e9b3d8-d03e-4deb-99a4-92bd5370674d {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:58:08.405893 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-acf52cdc-42dd-46d2-98e9-138b119addfb req-058589f3-718b-4360-b937-d639917c3acf service nova] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Received event network-vif-unplugged-e2e9b3d8-d03e-4deb-99a4-92bd5370674d for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:58:08.474356 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Took 1.85 seconds to destroy the instance on the hypervisor.
May 28 01:58:08.474815 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:58:08.474965 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:58:08.475063 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:58:08.475556 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:08.545511 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:08.673835 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:08.674709 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:08.679090 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:58:08.679090 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Claim successful on node np0000001583
May 28 01:58:08.920526 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7da03d57-149b-444f-9daf-a4f53da9a50e req-4e7329e7-ba94-468b-b298-779c6095c7ed service nova] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Received event network-vif-deleted-e2e9b3d8-d03e-4deb-99a4-92bd5370674d {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:08.923097 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-7da03d57-149b-444f-9daf-a4f53da9a50e req-4e7329e7-ba94-468b-b298-779c6095c7ed service nova] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Neutron deleted interface e2e9b3d8-d03e-4deb-99a4-92bd5370674d; detaching it from the instance and deleting it from the info cache
May 28 01:58:08.925862 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7da03d57-149b-444f-9daf-a4f53da9a50e req-4e7329e7-ba94-468b-b298-779c6095c7ed service nova] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Detach interface failed, port_id=e2e9b3d8-d03e-4deb-99a4-92bd5370674d, reason: Instance 258fd5d8-1ab7-4d19-afe7-421297b99684 could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:58:09.018356 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:58:09.020165 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:58:09.030496 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:58:09.030496 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:58:09.033970 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:58:09.033970 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:58:09.046160 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:58:09.046482 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:58:09.058367 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa (non-flash)
May 28 01:58:09.058367 np0000001583 nova-compute[98241]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa (non-flash)
May 28 01:58:09.058367 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:58:09.058367 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa (non-flash)
May 28 01:58:09.058367 np0000001583 nova-compute[98241]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa (non-flash)
May 28 01:58:09.058367 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:58:09.062955 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa (non-flash)
May 28 01:58:09.062955 np0000001583 nova-compute[98241]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa (non-flash)
May 28 01:58:09.062955 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:58:09.063111 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa (non-flash)
May 28 01:58:09.063111 np0000001583 nova-compute[98241]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa (non-flash)
May 28 01:58:09.063111 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:58:09.087931 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71, portal: 192.168.40.100,3260]
May 28 01:58:09.087931 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71, portal: 192.168.40.100,3260] successful.
May 28 01:58:09.087931 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:58:09.103978 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:58:09.112997 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:09.113484 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:09.123773 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71, portal: 192.168.50.100,3260]
May 28 01:58:09.123773 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71, portal: 192.168.50.100,3260] successful.
May 28 01:58:09.123773 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:58:09.126897 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa (non-flash)
May 28 01:58:09.126897 np0000001583 nova-compute[98241]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa (non-flash)
May 28 01:58:09.126897 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:58:09.126897 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:58:09.126897 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:58:09.127071 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa (non-flash)
May 28 01:58:09.127071 np0000001583 nova-compute[98241]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa (non-flash)
May 28 01:58:09.127071 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:58:09.127071 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:58:09.127071 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:58:09.127421 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.143s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:58:09.127555 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:58:09.133734 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] HCTL ('7', '-', '-', 0) found on session 68 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:58:09.133734 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:58:09.140024 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:58:09.142745 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:09.151132 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Searching for a device in session 68 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:58:09.151346 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4f727671-7b59-48c4-9bb3-9fc3f3a25a71', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:58:09.161704 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa (non-flash)
May 28 01:58:09.161704 np0000001583 nova-compute[98241]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa (non-flash)
May 28 01:58:09.161704 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:58:09.161704 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:58:09.161704 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:58:09.163313 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa (non-flash)
May 28 01:58:09.163313 np0000001583 nova-compute[98241]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa (non-flash)
May 28 01:58:09.163313 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:58:09.163313 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:58:09.163313 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:58:09.163313 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.177s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:58:09.163313 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:58:09.163313 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] HCTL ('8', '-', '-', 0) found on session 69 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:58:09.163313 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:58:09.180174 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Searching for a device in session 69 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:58:09.180174 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '4f727671-7b59-48c4-9bb3-9fc3f3a25a71', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:58:09.328382 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:09.336638 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:09.345019 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:58:09.428578 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:09.463025 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999727820999851 future=<Future at 0x7724f8697da0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:58:09.470382 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:09.470382 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Instance destroyed successfully.
May 28 01:58:09.471443 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:09.472392 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lazy-loading 'numa_topology' on Instance uuid 0d87a47f-2eb6-4e25-b44a-848fe2225962 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:58:09.496193 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:09.612360 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:09.620423 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:09.802448 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:09.809418 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:09.846986 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Took 1.37 seconds to deallocate network for instance.
May 28 01:58:09.976921 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Attempting rescue
May 28 01:58:09.977671 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98241) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 28 01:58:09.982929 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Instance directory exists: not creating {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 01:58:09.983159 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Creating image(s)
May 28 01:58:09.983763 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquiring lock "/opt/stack/data/nova/instances/0d87a47f-2eb6-4e25-b44a-848fe2225962/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:09.983940 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "/opt/stack/data/nova/instances/0d87a47f-2eb6-4e25-b44a-848fe2225962/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:09.984732 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "/opt/stack/data/nova/instances/0d87a47f-2eb6-4e25-b44a-848fe2225962/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:09.985065 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0d87a47f-2eb6-4e25-b44a-848fe2225962 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:58:09.986518 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:58:10.080728 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-66efd923-00d3-424a-90f7-cfe2c8afa3ac tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "5c36895c-9d2c-49be-b545-3658f535964a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:10.080882 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-66efd923-00d3-424a-90f7-cfe2c8afa3ac tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "5c36895c-9d2c-49be-b545-3658f535964a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:10.081069 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-66efd923-00d3-424a-90f7-cfe2c8afa3ac tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "5c36895c-9d2c-49be-b545-3658f535964a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:10.081264 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-66efd923-00d3-424a-90f7-cfe2c8afa3ac tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "5c36895c-9d2c-49be-b545-3658f535964a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:10.081357 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-66efd923-00d3-424a-90f7-cfe2c8afa3ac tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "5c36895c-9d2c-49be-b545-3658f535964a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:10.083279 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-66efd923-00d3-424a-90f7-cfe2c8afa3ac tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Terminating instance
May 28 01:58:10.114999 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:58:10.115354 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:58:10.427129 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Took 0.58 seconds to detach 1 volumes for instance.
May 28 01:58:10.490114 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Object Instance<0d87a47f-2eb6-4e25-b44a-848fe2225962> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:58:10.490114 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:58:10.491023 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:58:10.491876 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:10.492209 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:10.492472 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:58:10.496246 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:58:10.496843 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:10.583171 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.086s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:10.583687 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/0d87a47f-2eb6-4e25-b44a-848fe2225962/disk.rescue {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:10.597041 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-66efd923-00d3-424a-90f7-cfe2c8afa3ac tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:58:10.620246 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:58:10.628548 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:10.653242 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/0d87a47f-2eb6-4e25-b44a-848fe2225962/disk.rescue" returned: 0 in 0.069s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:10.655783 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.161s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:10.655783 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lazy-loading 'migration_context' on Instance uuid 0d87a47f-2eb6-4e25-b44a-848fe2225962 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:58:10.657122 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:10.689945 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:10.808148 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ff3eba6b-09b2-46ca-a6e0-7f2102dfe07a req-2ca6721a-0123-4166-8cd8-06fc6782aa1d service nova] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Received event network-vif-unplugged-fcf662e6-60ad-4e4c-b3da-ce3edf11d15b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:10.811407 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ff3eba6b-09b2-46ca-a6e0-7f2102dfe07a req-2ca6721a-0123-4166-8cd8-06fc6782aa1d service nova] Acquiring lock "5c36895c-9d2c-49be-b545-3658f535964a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:10.811407 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ff3eba6b-09b2-46ca-a6e0-7f2102dfe07a req-2ca6721a-0123-4166-8cd8-06fc6782aa1d service nova] Lock "5c36895c-9d2c-49be-b545-3658f535964a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:10.811407 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ff3eba6b-09b2-46ca-a6e0-7f2102dfe07a req-2ca6721a-0123-4166-8cd8-06fc6782aa1d service nova] Lock "5c36895c-9d2c-49be-b545-3658f535964a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:10.811407 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ff3eba6b-09b2-46ca-a6e0-7f2102dfe07a req-2ca6721a-0123-4166-8cd8-06fc6782aa1d service nova] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] No waiting events found dispatching network-vif-unplugged-fcf662e6-60ad-4e4c-b3da-ce3edf11d15b {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:58:10.811407 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ff3eba6b-09b2-46ca-a6e0-7f2102dfe07a req-2ca6721a-0123-4166-8cd8-06fc6782aa1d service nova] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Received event network-vif-unplugged-fcf662e6-60ad-4e4c-b3da-ce3edf11d15b for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:58:10.938315 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:10.962052 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999679948999983 future=<Future at 0x7724f82f0b60 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:58:10.964704 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Instance destroyed successfully.
May 28 01:58:10.965392 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-66efd923-00d3-424a-90f7-cfe2c8afa3ac tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lazy-loading 'resources' on Instance uuid 5c36895c-9d2c-49be-b545-3658f535964a {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:58:11.011096 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Found WWN 330000000adc57e53 for multipath device dm-0 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:58:11.011588 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.048s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:58:11.012134 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] <== connect_volume: return (3353ms) {'type': 'block', 'scsi_wwn': '330000000adc57e53', 'path': '/dev/dm-0', 'multipath_id': '330000000adc57e53'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:58:11.015042 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000adc57e53', 'path': '/dev/dm-0', 'multipath_id': '330000000adc57e53'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:58:11.022855 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ea78311b-4f1d-477e-90a0-119014b230ee req-ed7b1378-af31-4e46-aeb9-8cb63bee0a7b service nova] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Received event network-vif-unplugged-f23d344d-9e4c-41b4-a61f-b324ba3c9794 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:11.023116 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ea78311b-4f1d-477e-90a0-119014b230ee req-ed7b1378-af31-4e46-aeb9-8cb63bee0a7b service nova] Acquiring lock "0d87a47f-2eb6-4e25-b44a-848fe2225962-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:11.024896 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ea78311b-4f1d-477e-90a0-119014b230ee req-ed7b1378-af31-4e46-aeb9-8cb63bee0a7b service nova] Lock "0d87a47f-2eb6-4e25-b44a-848fe2225962-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:11.025460 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ea78311b-4f1d-477e-90a0-119014b230ee req-ed7b1378-af31-4e46-aeb9-8cb63bee0a7b service nova] Lock "0d87a47f-2eb6-4e25-b44a-848fe2225962-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:11.025696 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ea78311b-4f1d-477e-90a0-119014b230ee req-ed7b1378-af31-4e46-aeb9-8cb63bee0a7b service nova] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] No waiting events found dispatching network-vif-unplugged-f23d344d-9e4c-41b4-a61f-b324ba3c9794 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:58:11.025967 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-ea78311b-4f1d-477e-90a0-119014b230ee req-ed7b1378-af31-4e46-aeb9-8cb63bee0a7b service nova] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Received unexpected event network-vif-unplugged-f23d344d-9e4c-41b4-a61f-b324ba3c9794 for instance with vm_state active and task_state rescuing.
May 28 01:58:11.026142 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ea78311b-4f1d-477e-90a0-119014b230ee req-ed7b1378-af31-4e46-aeb9-8cb63bee0a7b service nova] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Received event network-vif-unplugged-f23d344d-9e4c-41b4-a61f-b324ba3c9794 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:11.027487 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ea78311b-4f1d-477e-90a0-119014b230ee req-ed7b1378-af31-4e46-aeb9-8cb63bee0a7b service nova] Acquiring lock "0d87a47f-2eb6-4e25-b44a-848fe2225962-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:11.027487 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ea78311b-4f1d-477e-90a0-119014b230ee req-ed7b1378-af31-4e46-aeb9-8cb63bee0a7b service nova] Lock "0d87a47f-2eb6-4e25-b44a-848fe2225962-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:11.027487 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ea78311b-4f1d-477e-90a0-119014b230ee req-ed7b1378-af31-4e46-aeb9-8cb63bee0a7b service nova] Lock "0d87a47f-2eb6-4e25-b44a-848fe2225962-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:11.034219 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ea78311b-4f1d-477e-90a0-119014b230ee req-ed7b1378-af31-4e46-aeb9-8cb63bee0a7b service nova] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] No waiting events found dispatching network-vif-unplugged-f23d344d-9e4c-41b4-a61f-b324ba3c9794 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:58:11.034219 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-ea78311b-4f1d-477e-90a0-119014b230ee req-ed7b1378-af31-4e46-aeb9-8cb63bee0a7b service nova] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Received unexpected event network-vif-unplugged-f23d344d-9e4c-41b4-a61f-b324ba3c9794 for instance with vm_state active and task_state rescuing.
May 28 01:58:11.034219 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ea78311b-4f1d-477e-90a0-119014b230ee req-ed7b1378-af31-4e46-aeb9-8cb63bee0a7b service nova] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Received event network-vif-plugged-f23d344d-9e4c-41b4-a61f-b324ba3c9794 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:11.034219 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ea78311b-4f1d-477e-90a0-119014b230ee req-ed7b1378-af31-4e46-aeb9-8cb63bee0a7b service nova] Acquiring lock "0d87a47f-2eb6-4e25-b44a-848fe2225962-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:11.034219 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ea78311b-4f1d-477e-90a0-119014b230ee req-ed7b1378-af31-4e46-aeb9-8cb63bee0a7b service nova] Lock "0d87a47f-2eb6-4e25-b44a-848fe2225962-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:11.034219 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ea78311b-4f1d-477e-90a0-119014b230ee req-ed7b1378-af31-4e46-aeb9-8cb63bee0a7b service nova] Lock "0d87a47f-2eb6-4e25-b44a-848fe2225962-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:11.034219 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ea78311b-4f1d-477e-90a0-119014b230ee req-ed7b1378-af31-4e46-aeb9-8cb63bee0a7b service nova] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] No waiting events found dispatching network-vif-plugged-f23d344d-9e4c-41b4-a61f-b324ba3c9794 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:58:11.034219 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-ea78311b-4f1d-477e-90a0-119014b230ee req-ed7b1378-af31-4e46-aeb9-8cb63bee0a7b service nova] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Received unexpected event network-vif-plugged-f23d344d-9e4c-41b4-a61f-b324ba3c9794 for instance with vm_state active and task_state rescuing.
May 28 01:58:11.034219 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ea78311b-4f1d-477e-90a0-119014b230ee req-ed7b1378-af31-4e46-aeb9-8cb63bee0a7b service nova] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Received event network-vif-plugged-f23d344d-9e4c-41b4-a61f-b324ba3c9794 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:11.034219 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ea78311b-4f1d-477e-90a0-119014b230ee req-ed7b1378-af31-4e46-aeb9-8cb63bee0a7b service nova] Acquiring lock "0d87a47f-2eb6-4e25-b44a-848fe2225962-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:11.034219 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ea78311b-4f1d-477e-90a0-119014b230ee req-ed7b1378-af31-4e46-aeb9-8cb63bee0a7b service nova] Lock "0d87a47f-2eb6-4e25-b44a-848fe2225962-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:11.034219 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ea78311b-4f1d-477e-90a0-119014b230ee req-ed7b1378-af31-4e46-aeb9-8cb63bee0a7b service nova] Lock "0d87a47f-2eb6-4e25-b44a-848fe2225962-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:11.034219 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ea78311b-4f1d-477e-90a0-119014b230ee req-ed7b1378-af31-4e46-aeb9-8cb63bee0a7b service nova] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] No waiting events found dispatching network-vif-plugged-f23d344d-9e4c-41b4-a61f-b324ba3c9794 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:58:11.034219 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-ea78311b-4f1d-477e-90a0-119014b230ee req-ed7b1378-af31-4e46-aeb9-8cb63bee0a7b service nova] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Received unexpected event network-vif-plugged-f23d344d-9e4c-41b4-a61f-b324ba3c9794 for instance with vm_state active and task_state rescuing.
May 28 01:58:11.034219 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ea78311b-4f1d-477e-90a0-119014b230ee req-ed7b1378-af31-4e46-aeb9-8cb63bee0a7b service nova] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Received event network-vif-unplugged-f23d344d-9e4c-41b4-a61f-b324ba3c9794 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:11.034219 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ea78311b-4f1d-477e-90a0-119014b230ee req-ed7b1378-af31-4e46-aeb9-8cb63bee0a7b service nova] Acquiring lock "0d87a47f-2eb6-4e25-b44a-848fe2225962-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:11.034219 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ea78311b-4f1d-477e-90a0-119014b230ee req-ed7b1378-af31-4e46-aeb9-8cb63bee0a7b service nova] Lock "0d87a47f-2eb6-4e25-b44a-848fe2225962-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:11.034219 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ea78311b-4f1d-477e-90a0-119014b230ee req-ed7b1378-af31-4e46-aeb9-8cb63bee0a7b service nova] Lock "0d87a47f-2eb6-4e25-b44a-848fe2225962-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:11.034219 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ea78311b-4f1d-477e-90a0-119014b230ee req-ed7b1378-af31-4e46-aeb9-8cb63bee0a7b service nova] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] No waiting events found dispatching network-vif-unplugged-f23d344d-9e4c-41b4-a61f-b324ba3c9794 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:58:11.034219 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-ea78311b-4f1d-477e-90a0-119014b230ee req-ed7b1378-af31-4e46-aeb9-8cb63bee0a7b service nova] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Received unexpected event network-vif-unplugged-f23d344d-9e4c-41b4-a61f-b324ba3c9794 for instance with vm_state active and task_state rescuing.
May 28 01:58:11.034219 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ea78311b-4f1d-477e-90a0-119014b230ee req-ed7b1378-af31-4e46-aeb9-8cb63bee0a7b service nova] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Received event network-vif-unplugged-f23d344d-9e4c-41b4-a61f-b324ba3c9794 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:11.034219 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ea78311b-4f1d-477e-90a0-119014b230ee req-ed7b1378-af31-4e46-aeb9-8cb63bee0a7b service nova] Acquiring lock "0d87a47f-2eb6-4e25-b44a-848fe2225962-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:11.034219 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ea78311b-4f1d-477e-90a0-119014b230ee req-ed7b1378-af31-4e46-aeb9-8cb63bee0a7b service nova] Lock "0d87a47f-2eb6-4e25-b44a-848fe2225962-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:11.034219 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ea78311b-4f1d-477e-90a0-119014b230ee req-ed7b1378-af31-4e46-aeb9-8cb63bee0a7b service nova] Lock "0d87a47f-2eb6-4e25-b44a-848fe2225962-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:11.034219 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ea78311b-4f1d-477e-90a0-119014b230ee req-ed7b1378-af31-4e46-aeb9-8cb63bee0a7b service nova] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] No waiting events found dispatching network-vif-unplugged-f23d344d-9e4c-41b4-a61f-b324ba3c9794 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:58:11.034219 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-ea78311b-4f1d-477e-90a0-119014b230ee req-ed7b1378-af31-4e46-aeb9-8cb63bee0a7b service nova] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Received unexpected event network-vif-unplugged-f23d344d-9e4c-41b4-a61f-b324ba3c9794 for instance with vm_state active and task_state rescuing.
May 28 01:58:11.136943 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.462s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:11.138123 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.199s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:11.138456 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:58:11.160202 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Object Instance<0d87a47f-2eb6-4e25-b44a-848fe2225962> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:58:11.160613 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:58:11.161329 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Start _get_guest_xml network_info=[{"id": "f23d344d-9e4c-41b4-a61f-b324ba3c9794", "address": "fa:16:3e:ca:d6:49", "network": {"id": "e1d5d073-f27b-4ff1-9ed3-99f57407c76f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "vif_mac": "fa:16:3e:ca:d6:49"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f65617e71571457f8906997583100678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf23d344d-9e", "ovs_interfaceid": "f23d344d-9e4c-41b4-a61f-b324ba3c9794", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:58:11.165039 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lazy-loading 'resources' on Instance uuid 0d87a47f-2eb6-4e25-b44a-848fe2225962 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:58:11.467744 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-66efd923-00d3-424a-90f7-cfe2c8afa3ac tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:53:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1021645679',display_name='tempest-ServerActionsTestOtherA-server-1021645679',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-serveractionstestothera-server-1021645679',id=10,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIePG0IU7S1SlFjpc/VmXFCBBKIijsN+gHQMlnhYfGPcl665nwX9JP0OwVOuueebU/mRc6FRuLr9ai0zvPAu2rDRN1UE1FBgnGgOOoImTJFqPL9BfFXoi8JNvWclsGpwzg==',key_name='tempest-keypair-1911990843',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:53:33Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60fbdf5ed38b4dc485a81c49b3303ed2',ramdisk_id='',reservation_id='r-pciy66au',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1714646345',owner_user_name='tempest-ServerActionsTestOtherA-1714646345-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:53:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27c90c0a8eb148fda8ae718f07ff1ed4',uuid=5c36895c-9d2c-49be-b545-3658f535964a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fcf662e6-60ad-4e4c-b3da-ce3edf11d15b", "address": "fa:16:3e:63:2b:b1", "network": {"id": "b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-280876007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60fbdf5ed38b4dc485a81c49b3303ed2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf662e6-60", "ovs_interfaceid": "fcf662e6-60ad-4e4c-b3da-ce3edf11d15b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:58:11.468031 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-66efd923-00d3-424a-90f7-cfe2c8afa3ac tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Converting VIF {"id": "fcf662e6-60ad-4e4c-b3da-ce3edf11d15b", "address": "fa:16:3e:63:2b:b1", "network": {"id": "b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-280876007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60fbdf5ed38b4dc485a81c49b3303ed2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf662e6-60", "ovs_interfaceid": "fcf662e6-60ad-4e4c-b3da-ce3edf11d15b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:58:11.468697 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-66efd923-00d3-424a-90f7-cfe2c8afa3ac tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:2b:b1,bridge_name='br-int',has_traffic_filtering=True,id=fcf662e6-60ad-4e4c-b3da-ce3edf11d15b,network=Network(b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf662e6-60') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:58:11.468967 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-66efd923-00d3-424a-90f7-cfe2c8afa3ac tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:2b:b1,bridge_name='br-int',has_traffic_filtering=True,id=fcf662e6-60ad-4e4c-b3da-ce3edf11d15b,network=Network(b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf662e6-60') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:58:11.470371 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:11.470622 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfcf662e6-60, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:58:11.471757 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:11.472813 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:58:11.478678 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:11.479538 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:11.479707 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eb81a700-791a-4e2b-aab5-13101fb07214) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:58:11.481164 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:11.481813 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:58:11.487692 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:11.489866 np0000001583 nova-compute[98241]: INFO os_vif [None req-66efd923-00d3-424a-90f7-cfe2c8afa3ac tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:2b:b1,bridge_name='br-int',has_traffic_filtering=True,id=fcf662e6-60ad-4e4c-b3da-ce3edf11d15b,network=Network(b6ee7840-bb27-4a9c-a0ff-fe2ddf812e5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf662e6-60')
May 28 01:58:11.490437 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-66efd923-00d3-424a-90f7-cfe2c8afa3ac tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Deleting instance files /opt/stack/data/nova/instances/5c36895c-9d2c-49be-b545-3658f535964a_del
May 28 01:58:11.491365 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-66efd923-00d3-424a-90f7-cfe2c8afa3ac tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Deletion of /opt/stack/data/nova/instances/5c36895c-9d2c-49be-b545-3658f535964a_del complete
May 28 01:58:11.521032 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:57:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-255087748',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-attachvolumemultiattachtest-server-255087748',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0474090f4f2d4950b51bc317f4302266',ramdisk_id='',reservation_id='r-hmv2n306',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-857456921',owner_user_name='tempest-AttachVolumeMultiAttachTest-857456921-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:58:04Z,user_data=None,user_id='cadb612e41314b06914d5f5f47570e98',uuid=e50227a8-b484-447b-abc6-3a3c1379e7ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "012d880f-9a02-47db-a8d6-2ea821b0bd72", "address": "fa:16:3e:48:7d:7b", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap012d880f-9a", "ovs_interfaceid": "012d880f-9a02-47db-a8d6-2ea821b0bd72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:58:11.521032 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Converting VIF {"id": "012d880f-9a02-47db-a8d6-2ea821b0bd72", "address": "fa:16:3e:48:7d:7b", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap012d880f-9a", "ovs_interfaceid": "012d880f-9a02-47db-a8d6-2ea821b0bd72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:58:11.521032 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:7d:7b,bridge_name='br-int',has_traffic_filtering=True,id=012d880f-9a02-47db-a8d6-2ea821b0bd72,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap012d880f-9a') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:58:11.521032 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lazy-loading 'pci_devices' on Instance uuid e50227a8-b484-447b-abc6-3a3c1379e7ff {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:58:11.529049 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:58:11.529412 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:58:11.645740 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:58:11.650099 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:58:11.650099 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:11.650099 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:11.666120 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Object Instance<0d87a47f-2eb6-4e25-b44a-848fe2225962> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:58:11.669177 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:58:11.670441 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-823002783', uuid='0d87a47f-2eb6-4e25-b44a-848fe2225962'), owner=OwnerMeta(userid='435dfce8f05e4e01b380797bd07bd4dc', username='tempest-ServerRescueNegativeTestJSON-1821941242-project-member', projectid='f65617e71571457f8906997583100678', projectname='tempest-ServerRescueNegativeTestJSON-1821941242'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f23d344d-9e4c-41b4-a61f-b324ba3c9794", "address": "fa:16:3e:ca:d6:49", "network": {"id": "e1d5d073-f27b-4ff1-9ed3-99f57407c76f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "vif_mac": "fa:16:3e:ca:d6:49"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f65617e71571457f8906997583100678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf23d344d-9e", "ovs_interfaceid": "f23d344d-9e4c-41b4-a61f-b324ba3c9794", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933491.670036) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:58:11.673224 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:58:11.673224 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:58:11.674020 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:58:11.674245 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:58:11.675165 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:58:11.675518 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:58:11.675718 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:58:11.675870 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:58:11.676058 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:58:11.676211 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:58:11.676586 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:58:11.676586 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:58:11.676781 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:58:11.676836 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:58:11.676962 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:58:11.677173 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:58:11.677365 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0d87a47f-2eb6-4e25-b44a-848fe2225962 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:58:11.746363 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '00cb6190618b45eb994dd16d3c657f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837663bcfa40402aaf583729dfbb26cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:58:11.997415 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-66efd923-00d3-424a-90f7-cfe2c8afa3ac tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Took 1.40 seconds to destroy the instance on the hypervisor.
May 28 01:58:11.998012 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-66efd923-00d3-424a-90f7-cfe2c8afa3ac tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:58:11.998351 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:58:11.998435 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:58:11.998628 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:12.023895 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] End _get_guest_xml xml=<domain type="qemu">
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:   <uuid>e50227a8-b484-447b-abc6-3a3c1379e7ff</uuid>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:   <name>instance-0000001e</name>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:       <nova:name>tempest-AttachVolumeMultiAttachTest-server-255087748</nova:name>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:58:07</nova:creationTime>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:       <nova:image uuid="">
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:         <nova:user uuid="cadb612e41314b06914d5f5f47570e98">tempest-AttachVolumeMultiAttachTest-857456921-project-member</nova:user>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:         <nova:project uuid="0474090f4f2d4950b51bc317f4302266">tempest-AttachVolumeMultiAttachTest-857456921</nova:project>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:       <nova:root type="volume" uuid=""/>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:         <nova:port uuid="012d880f-9a02-47db-a8d6-2ea821b0bd72">
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:     <system>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:       <entry name="serial">e50227a8-b484-447b-abc6-3a3c1379e7ff</entry>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:       <entry name="uuid">e50227a8-b484-447b-abc6-3a3c1379e7ff</entry>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:     </system>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:   <os>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:   </os>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:   <features>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:   </features>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:   <devices>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/e50227a8-b484-447b-abc6-3a3c1379e7ff/disk.config"/>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:     </disk>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:     <disk type="block" device="disk">
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:       <alias name="ua-4f727671-7b59-48c4-9bb3-9fc3f3a25a71"/>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:       <source dev="/dev/dm-0"/>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:       <serial>4f727671-7b59-48c4-9bb3-9fc3f3a25a71</serial>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:       <shareable/>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:     </disk>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:48:7d:7b"/>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:       <target dev="tap012d880f-9a"/>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:     </interface>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/e50227a8-b484-447b-abc6-3a3c1379e7ff/console.log" append="off"/>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:     </serial>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:     <video>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:     </video>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:     </rng>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:   </devices>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]: </domain>
May 28 01:58:12.023895 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:58:12.026908 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Preparing to wait for external event network-vif-plugged-012d880f-9a02-47db-a8d6-2ea821b0bd72 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:58:12.026908 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "e50227a8-b484-447b-abc6-3a3c1379e7ff-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:12.026908 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "e50227a8-b484-447b-abc6-3a3c1379e7ff-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:12.026908 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "e50227a8-b484-447b-abc6-3a3c1379e7ff-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:12.026908 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:57:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-255087748',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-attachvolumemultiattachtest-server-255087748',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0474090f4f2d4950b51bc317f4302266',ramdisk_id='',reservation_id='r-hmv2n306',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-857456921',owner_user_name='tempest-AttachVolumeMultiAttachTest-857456921-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:58:04Z,user_data=None,user_id='cadb612e41314b06914d5f5f47570e98',uuid=e50227a8-b484-447b-abc6-3a3c1379e7ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "012d880f-9a02-47db-a8d6-2ea821b0bd72", "address": "fa:16:3e:48:7d:7b", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap012d880f-9a", "ovs_interfaceid": "012d880f-9a02-47db-a8d6-2ea821b0bd72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:58:12.026908 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Converting VIF {"id": "012d880f-9a02-47db-a8d6-2ea821b0bd72", "address": "fa:16:3e:48:7d:7b", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap012d880f-9a", "ovs_interfaceid": "012d880f-9a02-47db-a8d6-2ea821b0bd72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:58:12.026908 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:7d:7b,bridge_name='br-int',has_traffic_filtering=True,id=012d880f-9a02-47db-a8d6-2ea821b0bd72,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap012d880f-9a') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:58:12.026908 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:7d:7b,bridge_name='br-int',has_traffic_filtering=True,id=012d880f-9a02-47db-a8d6-2ea821b0bd72,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap012d880f-9a') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:58:12.026908 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:12.026908 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:58:12.027362 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:58:12.028212 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:12.028403 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fd2987ed-58b3-5780-aa71-791cf45f215e', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:58:12.029070 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:12.030451 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:58:12.032746 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:58:12.039116 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:12.044619 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:12.044619 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap012d880f-9a, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:58:12.044812 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap012d880f-9a, col_values=(('qos', UUID('6dc5d630-202c-4d53-9a18-556102004057')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:58:12.044844 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap012d880f-9a, col_values=(('external_ids', {'iface-id': '012d880f-9a02-47db-a8d6-2ea821b0bd72', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:7d:7b', 'vm-uuid': 'e50227a8-b484-447b-abc6-3a3c1379e7ff'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:58:12.045827 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:12.047986 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:58:12.059929 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:12.061074 np0000001583 nova-compute[98241]: INFO os_vif [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:7d:7b,bridge_name='br-int',has_traffic_filtering=True,id=012d880f-9a02-47db-a8d6-2ea821b0bd72,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap012d880f-9a')
May 28 01:58:12.086632 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:12.147308 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:58:12.179565 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Object Instance<0d87a47f-2eb6-4e25-b44a-848fe2225962> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:58:12.198278 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:57:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-823002783',display_name='tempest-ServerRescueNegativeTestJSON-server-823002783',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-serverrescuenegativetestjson-server-823002783',id=29,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:58:04Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f65617e71571457f8906997583100678',ramdisk_id='',reservation_id='r-9b82bcpk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1821941242',owner_user_name='tempest-ServerRescueNegativeTestJSON-1821941242-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:58:04Z,user_data=None,user_id='435dfce8f05e4e01b380797bd07bd4dc',uuid=0d87a47f-2eb6-4e25-b44a-848fe2225962,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f23d344d-9e4c-41b4-a61f-b324ba3c9794", "address": "fa:16:3e:ca:d6:49", "network": {"id": "e1d5d073-f27b-4ff1-9ed3-99f57407c76f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "vif_mac": "fa:16:3e:ca:d6:49"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f65617e71571457f8906997583100678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf23d344d-9e", "ovs_interfaceid": "f23d344d-9e4c-41b4-a61f-b324ba3c9794", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:58:12.198278 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Converting VIF {"id": "f23d344d-9e4c-41b4-a61f-b324ba3c9794", "address": "fa:16:3e:ca:d6:49", "network": {"id": "e1d5d073-f27b-4ff1-9ed3-99f57407c76f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "vif_mac": "fa:16:3e:ca:d6:49"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f65617e71571457f8906997583100678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf23d344d-9e", "ovs_interfaceid": "f23d344d-9e4c-41b4-a61f-b324ba3c9794", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:58:12.198278 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:d6:49,bridge_name='br-int',has_traffic_filtering=True,id=f23d344d-9e4c-41b4-a61f-b324ba3c9794,network=Network(e1d5d073-f27b-4ff1-9ed3-99f57407c76f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf23d344d-9e') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:58:12.199353 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lazy-loading 'pci_devices' on Instance uuid 0d87a47f-2eb6-4e25-b44a-848fe2225962 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:58:12.317151 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Successfully created port: 5a4bd986-18c1-42d1-9574-9080c2f65867 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:58:12.542008 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.405s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:12.619749 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Deleted allocations for instance 258fd5d8-1ab7-4d19-afe7-421297b99684
May 28 01:58:12.651486 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:58:12.702918 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Object Instance<0d87a47f-2eb6-4e25-b44a-848fe2225962> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:58:12.702918 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] End _get_guest_xml xml=<domain type="qemu">
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:   <uuid>0d87a47f-2eb6-4e25-b44a-848fe2225962</uuid>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:   <name>instance-0000001d</name>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-823002783</nova:name>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:58:11</nova:creationTime>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:         <nova:user uuid="435dfce8f05e4e01b380797bd07bd4dc">tempest-ServerRescueNegativeTestJSON-1821941242-project-member</nova:user>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:         <nova:project uuid="f65617e71571457f8906997583100678">tempest-ServerRescueNegativeTestJSON-1821941242</nova:project>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:         <nova:port uuid="f23d344d-9e4c-41b4-a61f-b324ba3c9794">
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:     <system>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:       <entry name="serial">0d87a47f-2eb6-4e25-b44a-848fe2225962</entry>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:       <entry name="uuid">0d87a47f-2eb6-4e25-b44a-848fe2225962</entry>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:     </system>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:   <os>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:   </os>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:   <features>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:   </features>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:   <devices>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/0d87a47f-2eb6-4e25-b44a-848fe2225962/disk.rescue"/>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:     </disk>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/0d87a47f-2eb6-4e25-b44a-848fe2225962/disk"/>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:       <target dev="vdb" bus="virtio"/>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:     </disk>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/0d87a47f-2eb6-4e25-b44a-848fe2225962/disk.config.rescue"/>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:     </disk>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:ca:d6:49"/>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:       <target dev="tapf23d344d-9e"/>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:     </interface>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/0d87a47f-2eb6-4e25-b44a-848fe2225962/console.log" append="off"/>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:     </serial>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:     <video>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:     </video>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:     </rng>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:   </devices>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]: </domain>
May 28 01:58:12.702918 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:58:12.717915 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Instance destroyed successfully.
May 28 01:58:12.859538 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:58:12.915775 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-4e3ea883-4540-4eac-9697-42073b88a209 req-22df8563-9530-4e16-835f-621551dcd5d1 service nova] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Received event network-vif-unplugged-fcf662e6-60ad-4e4c-b3da-ce3edf11d15b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:12.915775 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-4e3ea883-4540-4eac-9697-42073b88a209 req-22df8563-9530-4e16-835f-621551dcd5d1 service nova] Acquiring lock "5c36895c-9d2c-49be-b545-3658f535964a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:12.915978 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-4e3ea883-4540-4eac-9697-42073b88a209 req-22df8563-9530-4e16-835f-621551dcd5d1 service nova] Lock "5c36895c-9d2c-49be-b545-3658f535964a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:12.916193 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-4e3ea883-4540-4eac-9697-42073b88a209 req-22df8563-9530-4e16-835f-621551dcd5d1 service nova] Lock "5c36895c-9d2c-49be-b545-3658f535964a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:12.916359 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-4e3ea883-4540-4eac-9697-42073b88a209 req-22df8563-9530-4e16-835f-621551dcd5d1 service nova] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] No waiting events found dispatching network-vif-unplugged-fcf662e6-60ad-4e4c-b3da-ce3edf11d15b {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:58:12.916477 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-4e3ea883-4540-4eac-9697-42073b88a209 req-22df8563-9530-4e16-835f-621551dcd5d1 service nova] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Received event network-vif-unplugged-fcf662e6-60ad-4e4c-b3da-ce3edf11d15b for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:58:13.032700 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Successfully updated port: 5a4bd986-18c1-42d1-9574-9080c2f65867 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:58:13.087261 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-17acb8ba-632c-4fc1-b47c-d75178c6aced req-1e7d0407-7e00-478a-be7a-60f23798d4f4 service nova] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Received event network-vif-deleted-fcf662e6-60ad-4e4c-b3da-ce3edf11d15b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:13.097550 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:13.100358 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7ef6788b-a088-4844-9c5f-ac55f1acb11a req-9249a86c-63af-4cdc-9342-b8c58b172915 service nova] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Received event network-changed-5a4bd986-18c1-42d1-9574-9080c2f65867 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:13.100452 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7ef6788b-a088-4844-9c5f-ac55f1acb11a req-9249a86c-63af-4cdc-9342-b8c58b172915 service nova] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Refreshing instance network info cache due to event network-changed-5a4bd986-18c1-42d1-9574-9080c2f65867. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:58:13.100709 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7ef6788b-a088-4844-9c5f-ac55f1acb11a req-9249a86c-63af-4cdc-9342-b8c58b172915 service nova] Acquiring lock "refresh_cache-668cf051-44c2-4db1-bfd1-dfeed0c6b5a4" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:58:13.100782 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7ef6788b-a088-4844-9c5f-ac55f1acb11a req-9249a86c-63af-4cdc-9342-b8c58b172915 service nova] Acquired lock "refresh_cache-668cf051-44c2-4db1-bfd1-dfeed0c6b5a4" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:58:13.100996 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-7ef6788b-a088-4844-9c5f-ac55f1acb11a req-9249a86c-63af-4cdc-9342-b8c58b172915 service nova] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Refreshing network info cache for port 5a4bd986-18c1-42d1-9574-9080c2f65867 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:58:13.361515 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Took 1.36 seconds to deallocate network for instance.
May 28 01:58:13.535967 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "refresh_cache-668cf051-44c2-4db1-bfd1-dfeed0c6b5a4" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:58:13.589037 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:58:13.589226 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:58:13.589377 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] No VIF found with MAC fa:16:3e:48:7d:7b, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:58:13.589812 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Using config drive
May 28 01:58:13.603429 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-7ef6788b-a088-4844-9c5f-ac55f1acb11a req-9249a86c-63af-4cdc-9342-b8c58b172915 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:13.631675 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-620c539e-1b7b-4633-a2f3-46e8083ab975 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "258fd5d8-1ab7-4d19-afe7-421297b99684" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.523s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:13.660885 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:58:13.661906 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:58:13.662161 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Creating image(s)
May 28 01:58:13.662677 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "/opt/stack/data/nova/instances/668cf051-44c2-4db1-bfd1-dfeed0c6b5a4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:13.662798 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "/opt/stack/data/nova/instances/668cf051-44c2-4db1-bfd1-dfeed0c6b5a4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:13.663612 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "/opt/stack/data/nova/instances/668cf051-44c2-4db1-bfd1-dfeed0c6b5a4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:13.664145 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:58:13.666847 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:58:13.669427 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-7ef6788b-a088-4844-9c5f-ac55f1acb11a req-9249a86c-63af-4cdc-9342-b8c58b172915 service nova] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:58:13.671158 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:13.752527 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.081s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:13.753493 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:13.753907 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:13.754470 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:58:13.757064 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:58:13.757560 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:13.851708 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-7ef6788b-a088-4844-9c5f-ac55f1acb11a req-9249a86c-63af-4cdc-9342-b8c58b172915 service nova] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:58:13.854051 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.096s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:13.854705 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/668cf051-44c2-4db1-bfd1-dfeed0c6b5a4/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:13.874525 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-66efd923-00d3-424a-90f7-cfe2c8afa3ac tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:13.875641 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-66efd923-00d3-424a-90f7-cfe2c8afa3ac tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:13.942834 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/668cf051-44c2-4db1-bfd1-dfeed0c6b5a4/disk 1073741824" returned: 0 in 0.088s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:13.943530 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:13.943889 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:14.035390 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.091s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:14.035828 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Checking if we can resize image /opt/stack/data/nova/instances/668cf051-44c2-4db1-bfd1-dfeed0c6b5a4/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:58:14.036064 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668cf051-44c2-4db1-bfd1-dfeed0c6b5a4/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:14.097592 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:14.129513 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668cf051-44c2-4db1-bfd1-dfeed0c6b5a4/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:14.129930 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Cannot resize image /opt/stack/data/nova/instances/668cf051-44c2-4db1-bfd1-dfeed0c6b5a4/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:58:14.130305 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:58:14.130539 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Ensure instance console log exists: /opt/stack/data/nova/instances/668cf051-44c2-4db1-bfd1-dfeed0c6b5a4/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:58:14.130875 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:14.131163 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:14.131314 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:14.256630 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:58:14.256812 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:58:14.256967 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:58:14.257158 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] No VIF found with MAC fa:16:3e:ca:d6:49, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:58:14.257899 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Using config drive
May 28 01:58:14.284563 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Creating config drive at /opt/stack/data/nova/instances/e50227a8-b484-447b-abc6-3a3c1379e7ff/disk.config
May 28 01:58:14.292711 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e50227a8-b484-447b-abc6-3a3c1379e7ff/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp16pmtd2h {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:14.341245 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e50227a8-b484-447b-abc6-3a3c1379e7ff/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp16pmtd2h" returned: 0 in 0.048s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:14.356489 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7ef6788b-a088-4844-9c5f-ac55f1acb11a req-9249a86c-63af-4cdc-9342-b8c58b172915 service nova] Releasing lock "refresh_cache-668cf051-44c2-4db1-bfd1-dfeed0c6b5a4" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:58:14.357568 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquired lock "refresh_cache-668cf051-44c2-4db1-bfd1-dfeed0c6b5a4" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:58:14.358150 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:58:14.363706 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-66efd923-00d3-424a-90f7-cfe2c8afa3ac tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:58:14.364044 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-66efd923-00d3-424a-90f7-cfe2c8afa3ac tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:58:14.764791 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lazy-loading 'ec2_ids' on Instance uuid 0d87a47f-2eb6-4e25-b44a-848fe2225962 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:58:14.774889 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:14.807829 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:14.869500 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-66efd923-00d3-424a-90f7-cfe2c8afa3ac tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:58:14.908404 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:14.971888 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:58:15.159571 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:15.163792 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:15.195774 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:15.198497 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:15.205335 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:15.212402 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-290b89a0-ac8c-4b65-aaa1-9a5985d49e05 req-0f629179-ef4b-4af4-b77d-e3c93513a9c7 service nova] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Received event network-vif-plugged-012d880f-9a02-47db-a8d6-2ea821b0bd72 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:15.213122 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-290b89a0-ac8c-4b65-aaa1-9a5985d49e05 req-0f629179-ef4b-4af4-b77d-e3c93513a9c7 service nova] Acquiring lock "e50227a8-b484-447b-abc6-3a3c1379e7ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:15.213391 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-290b89a0-ac8c-4b65-aaa1-9a5985d49e05 req-0f629179-ef4b-4af4-b77d-e3c93513a9c7 service nova] Lock "e50227a8-b484-447b-abc6-3a3c1379e7ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:15.213601 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-290b89a0-ac8c-4b65-aaa1-9a5985d49e05 req-0f629179-ef4b-4af4-b77d-e3c93513a9c7 service nova] Lock "e50227a8-b484-447b-abc6-3a3c1379e7ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:15.213851 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-290b89a0-ac8c-4b65-aaa1-9a5985d49e05 req-0f629179-ef4b-4af4-b77d-e3c93513a9c7 service nova] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Processing event network-vif-plugged-012d880f-9a02-47db-a8d6-2ea821b0bd72 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:58:15.268273 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Object Instance<0d87a47f-2eb6-4e25-b44a-848fe2225962> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:58:15.268460 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lazy-loading 'keypairs' on Instance uuid 0d87a47f-2eb6-4e25-b44a-848fe2225962 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:58:15.376198 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-66efd923-00d3-424a-90f7-cfe2c8afa3ac tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.501s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:15.481520 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Updating instance_info_cache with network_info: [{"id": "5a4bd986-18c1-42d1-9574-9080c2f65867", "address": "fa:16:3e:17:7e:4a", "network": {"id": "62e7cc38-1758-4b09-a352-4635adc9cfea", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587967507-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "837663bcfa40402aaf583729dfbb26cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a4bd986-18", "ovs_interfaceid": "5a4bd986-18c1-42d1-9574-9080c2f65867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:58:15.484576 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-66efd923-00d3-424a-90f7-cfe2c8afa3ac tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Deleted allocations for instance 5c36895c-9d2c-49be-b545-3658f535964a
May 28 01:58:15.771981 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Object Instance<0d87a47f-2eb6-4e25-b44a-848fe2225962> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:58:15.779444 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:15.946056 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:58:15.948149 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933495.9463358, e50227a8-b484-447b-abc6-3a3c1379e7ff => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:58:15.948149 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] VM Started (Lifecycle Event)
May 28 01:58:15.963979 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Creating config drive at /opt/stack/data/nova/instances/0d87a47f-2eb6-4e25-b44a-848fe2225962/disk.config.rescue
May 28 01:58:15.964197 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:58:15.972152 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Instance spawned successfully.
May 28 01:58:15.972152 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:58:15.980465 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0d87a47f-2eb6-4e25-b44a-848fe2225962/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9xtv27ue {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:16.008323 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Releasing lock "refresh_cache-668cf051-44c2-4db1-bfd1-dfeed0c6b5a4" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:58:16.010646 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Instance network_info: |[{"id": "5a4bd986-18c1-42d1-9574-9080c2f65867", "address": "fa:16:3e:17:7e:4a", "network": {"id": "62e7cc38-1758-4b09-a352-4635adc9cfea", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587967507-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "837663bcfa40402aaf583729dfbb26cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a4bd986-18", "ovs_interfaceid": "5a4bd986-18c1-42d1-9574-9080c2f65867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:58:16.015568 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Start _get_guest_xml network_info=[{"id": "5a4bd986-18c1-42d1-9574-9080c2f65867", "address": "fa:16:3e:17:7e:4a", "network": {"id": "62e7cc38-1758-4b09-a352-4635adc9cfea", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587967507-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "837663bcfa40402aaf583729dfbb26cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a4bd986-18", "ovs_interfaceid": "5a4bd986-18c1-42d1-9574-9080c2f65867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:58:16.026066 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:58:16.028937 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-1000769287', uuid='668cf051-44c2-4db1-bfd1-dfeed0c6b5a4'), owner=OwnerMeta(userid='00cb6190618b45eb994dd16d3c657f01', username='tempest-AttachVolumeNegativeTest-169599115-project-member', projectid='837663bcfa40402aaf583729dfbb26cd', projectname='tempest-AttachVolumeNegativeTest-169599115'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5a4bd986-18c1-42d1-9574-9080c2f65867", "address": "fa:16:3e:17:7e:4a", "network": {"id": "62e7cc38-1758-4b09-a352-4635adc9cfea", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587967507-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "837663bcfa40402aaf583729dfbb26cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a4bd986-18", "ovs_interfaceid": "5a4bd986-18c1-42d1-9574-9080c2f65867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933496.028448) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:58:16.031746 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:58:16.032948 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:58:16.037239 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:58:16.037530 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:58:16.038534 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:58:16.038865 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:58:16.039007 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:58:16.039124 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:58:16.039267 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:58:16.039353 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:58:16.039447 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:58:16.039624 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:58:16.039726 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:58:16.039835 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:58:16.039935 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:58:16.040051 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:58:16.051444 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0d87a47f-2eb6-4e25-b44a-848fe2225962/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9xtv27ue" returned: 0 in 0.072s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:16.052427 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:58:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1000769287',display_name='tempest-AttachVolumeNegativeTest-server-1000769287',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-attachvolumenegativetest-server-1000769287',id=31,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7Xdpnhyu2YUr/bc277ZeRyYDf6SVPYURvHJQ6FoalS6x51jEcm2K+7ouUXKf/qn0HMrsRFUcmvOmcRtkAgZ12WpS9aYp6A2F97ZjJk1x7X2rkqQMDqC5NsVvaw6/M6gA==',key_name='tempest-keypair-1135506250',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='837663bcfa40402aaf583729dfbb26cd',ramdisk_id='',reservation_id='r-lmp40x4s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-169599115',owner_user_name='tempest-AttachVolumeNegativeTest-169599115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:58:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='00cb6190618b45eb994dd16d3c657f01',uuid=668cf051-44c2-4db1-bfd1-dfeed0c6b5a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a4bd986-18c1-42d1-9574-9080c2f65867", "address": "fa:16:3e:17:7e:4a", "network": {"id": "62e7cc38-1758-4b09-a352-4635adc9cfea", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587967507-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "837663bcfa40402aaf583729dfbb26cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a4bd986-18", "ovs_interfaceid": "5a4bd986-18c1-42d1-9574-9080c2f65867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:58:16.052775 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Converting VIF {"id": "5a4bd986-18c1-42d1-9574-9080c2f65867", "address": "fa:16:3e:17:7e:4a", "network": {"id": "62e7cc38-1758-4b09-a352-4635adc9cfea", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587967507-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "837663bcfa40402aaf583729dfbb26cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a4bd986-18", "ovs_interfaceid": "5a4bd986-18c1-42d1-9574-9080c2f65867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:58:16.053455 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:7e:4a,bridge_name='br-int',has_traffic_filtering=True,id=5a4bd986-18c1-42d1-9574-9080c2f65867,network=Network(62e7cc38-1758-4b09-a352-4635adc9cfea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a4bd986-18') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:58:16.054303 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lazy-loading 'pci_devices' on Instance uuid 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:58:16.449978 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:58:16.463963 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:58:16.479325 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:58:16.479563 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:58:16.479872 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:58:16.480163 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:58:16.480862 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:58:16.480862 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:58:16.508732 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-66efd923-00d3-424a-90f7-cfe2c8afa3ac tempest-ServerActionsTestOtherA-1714646345 tempest-ServerActionsTestOtherA-1714646345-project-member] Lock "5c36895c-9d2c-49be-b545-3658f535964a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.428s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:16.559141 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] End _get_guest_xml xml=<domain type="qemu">
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:   <uuid>668cf051-44c2-4db1-bfd1-dfeed0c6b5a4</uuid>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:   <name>instance-0000001f</name>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1000769287</nova:name>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:58:16</nova:creationTime>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:         <nova:user uuid="00cb6190618b45eb994dd16d3c657f01">tempest-AttachVolumeNegativeTest-169599115-project-member</nova:user>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:         <nova:project uuid="837663bcfa40402aaf583729dfbb26cd">tempest-AttachVolumeNegativeTest-169599115</nova:project>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:         <nova:port uuid="5a4bd986-18c1-42d1-9574-9080c2f65867">
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:     <system>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:       <entry name="serial">668cf051-44c2-4db1-bfd1-dfeed0c6b5a4</entry>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:       <entry name="uuid">668cf051-44c2-4db1-bfd1-dfeed0c6b5a4</entry>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:     </system>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:   <os>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:   </os>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:   <features>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:   </features>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:   <devices>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/668cf051-44c2-4db1-bfd1-dfeed0c6b5a4/disk"/>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:     </disk>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/668cf051-44c2-4db1-bfd1-dfeed0c6b5a4/disk.config"/>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:     </disk>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:17:7e:4a"/>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:       <target dev="tap5a4bd986-18"/>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:     </interface>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/668cf051-44c2-4db1-bfd1-dfeed0c6b5a4/console.log" append="off"/>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:     </serial>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:     <video>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:     </video>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:     </rng>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:   </devices>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]: </domain>
May 28 01:58:16.559141 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:58:16.559141 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Preparing to wait for external event network-vif-plugged-5a4bd986-18c1-42d1-9574-9080c2f65867 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:58:16.559141 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "668cf051-44c2-4db1-bfd1-dfeed0c6b5a4-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:16.559141 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "668cf051-44c2-4db1-bfd1-dfeed0c6b5a4-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:16.559141 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "668cf051-44c2-4db1-bfd1-dfeed0c6b5a4-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:16.559141 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:58:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1000769287',display_name='tempest-AttachVolumeNegativeTest-server-1000769287',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-attachvolumenegativetest-server-1000769287',id=31,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7Xdpnhyu2YUr/bc277ZeRyYDf6SVPYURvHJQ6FoalS6x51jEcm2K+7ouUXKf/qn0HMrsRFUcmvOmcRtkAgZ12WpS9aYp6A2F97ZjJk1x7X2rkqQMDqC5NsVvaw6/M6gA==',key_name='tempest-keypair-1135506250',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='837663bcfa40402aaf583729dfbb26cd',ramdisk_id='',reservation_id='r-lmp40x4s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-169599115',owner_user_name='tempest-AttachVolumeNegativeTest-169599115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:58:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='00cb6190618b45eb994dd16d3c657f01',uuid=668cf051-44c2-4db1-bfd1-dfeed0c6b5a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a4bd986-18c1-42d1-9574-9080c2f65867", "address": "fa:16:3e:17:7e:4a", "network": {"id": "62e7cc38-1758-4b09-a352-4635adc9cfea", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587967507-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "837663bcfa40402aaf583729dfbb26cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a4bd986-18", "ovs_interfaceid": "5a4bd986-18c1-42d1-9574-9080c2f65867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:58:16.559141 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Converting VIF {"id": "5a4bd986-18c1-42d1-9574-9080c2f65867", "address": "fa:16:3e:17:7e:4a", "network": {"id": "62e7cc38-1758-4b09-a352-4635adc9cfea", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587967507-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "837663bcfa40402aaf583729dfbb26cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a4bd986-18", "ovs_interfaceid": "5a4bd986-18c1-42d1-9574-9080c2f65867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:58:16.559141 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:7e:4a,bridge_name='br-int',has_traffic_filtering=True,id=5a4bd986-18c1-42d1-9574-9080c2f65867,network=Network(62e7cc38-1758-4b09-a352-4635adc9cfea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a4bd986-18') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:58:16.562254 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:7e:4a,bridge_name='br-int',has_traffic_filtering=True,id=5a4bd986-18c1-42d1-9574-9080c2f65867,network=Network(62e7cc38-1758-4b09-a352-4635adc9cfea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a4bd986-18') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:58:16.563643 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:16.563643 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:58:16.563643 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:58:16.564530 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:16.564795 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '65f425ae-1c10-5ad8-9457-82d82114f067', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:58:16.565734 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:16.566674 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:58:16.571962 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:16.574375 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:16.575770 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5a4bd986-18, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:58:16.575770 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5a4bd986-18, col_values=(('qos', UUID('b12c94d3-512d-4855-bdab-f5ffc7814f23')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:58:16.575770 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5a4bd986-18, col_values=(('external_ids', {'iface-id': '5a4bd986-18c1-42d1-9574-9080c2f65867', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:7e:4a', 'vm-uuid': '668cf051-44c2-4db1-bfd1-dfeed0c6b5a4'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:58:16.578141 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:16.578840 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:58:16.590841 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:16.592125 np0000001583 nova-compute[98241]: INFO os_vif [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:7e:4a,bridge_name='br-int',has_traffic_filtering=True,id=5a4bd986-18c1-42d1-9574-9080c2f65867,network=Network(62e7cc38-1758-4b09-a352-4635adc9cfea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a4bd986-18')
May 28 01:58:16.605663 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:16.634392 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:16.741541 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:16.786543 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:16.793169 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:16.831812 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-960622e7-a81c-478e-8bac-85c47a741af6 req-23ef51b8-f73d-4023-8d84-1961f70b63e4 service nova] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Received event network-vif-plugged-f23d344d-9e4c-41b4-a61f-b324ba3c9794 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:16.832010 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-960622e7-a81c-478e-8bac-85c47a741af6 req-23ef51b8-f73d-4023-8d84-1961f70b63e4 service nova] Acquiring lock "0d87a47f-2eb6-4e25-b44a-848fe2225962-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:16.832188 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-960622e7-a81c-478e-8bac-85c47a741af6 req-23ef51b8-f73d-4023-8d84-1961f70b63e4 service nova] Lock "0d87a47f-2eb6-4e25-b44a-848fe2225962-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:16.832314 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-960622e7-a81c-478e-8bac-85c47a741af6 req-23ef51b8-f73d-4023-8d84-1961f70b63e4 service nova] Lock "0d87a47f-2eb6-4e25-b44a-848fe2225962-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:16.832419 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-960622e7-a81c-478e-8bac-85c47a741af6 req-23ef51b8-f73d-4023-8d84-1961f70b63e4 service nova] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] No waiting events found dispatching network-vif-plugged-f23d344d-9e4c-41b4-a61f-b324ba3c9794 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:58:16.832850 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-960622e7-a81c-478e-8bac-85c47a741af6 req-23ef51b8-f73d-4023-8d84-1961f70b63e4 service nova] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Received unexpected event network-vif-plugged-f23d344d-9e4c-41b4-a61f-b324ba3c9794 for instance with vm_state active and task_state rescuing.
May 28 01:58:16.966281 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:58:16.966576 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933496.9663765, e50227a8-b484-447b-abc6-3a3c1379e7ff => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:58:16.966749 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] VM Paused (Lifecycle Event)
May 28 01:58:16.986810 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Took 10.53 seconds to spawn the instance on the hypervisor.
May 28 01:58:16.986810 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:58:17.302892 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2d589f8f-5dbd-4347-993f-e1269f4e447d req-b1d3f2dc-bea1-4d6f-b941-ca4591599980 service nova] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Received event network-vif-plugged-012d880f-9a02-47db-a8d6-2ea821b0bd72 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:17.303175 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2d589f8f-5dbd-4347-993f-e1269f4e447d req-b1d3f2dc-bea1-4d6f-b941-ca4591599980 service nova] Acquiring lock "e50227a8-b484-447b-abc6-3a3c1379e7ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:17.303407 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2d589f8f-5dbd-4347-993f-e1269f4e447d req-b1d3f2dc-bea1-4d6f-b941-ca4591599980 service nova] Lock "e50227a8-b484-447b-abc6-3a3c1379e7ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:17.303589 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2d589f8f-5dbd-4347-993f-e1269f4e447d req-b1d3f2dc-bea1-4d6f-b941-ca4591599980 service nova] Lock "e50227a8-b484-447b-abc6-3a3c1379e7ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:17.303727 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2d589f8f-5dbd-4347-993f-e1269f4e447d req-b1d3f2dc-bea1-4d6f-b941-ca4591599980 service nova] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] No waiting events found dispatching network-vif-plugged-012d880f-9a02-47db-a8d6-2ea821b0bd72 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:58:17.303868 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-2d589f8f-5dbd-4347-993f-e1269f4e447d req-b1d3f2dc-bea1-4d6f-b941-ca4591599980 service nova] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Received unexpected event network-vif-plugged-012d880f-9a02-47db-a8d6-2ea821b0bd72 for instance with vm_state active and task_state None.
May 28 01:58:17.469439 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:58:17.474406 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933497.47415, e50227a8-b484-447b-abc6-3a3c1379e7ff => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:58:17.474593 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] VM Resumed (Lifecycle Event)
May 28 01:58:17.501966 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Took 18.16 seconds to build instance.
May 28 01:58:17.774350 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-757cf731-6a5c-4877-80a3-b26de3168f2b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:58:17.977966 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:58:17.983108 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:58:18.006104 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ebae6d40-4b5a-4a4b-a1da-2a541df5208f tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "e50227a8-b484-447b-abc6-3a3c1379e7ff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.681s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:18.034926 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.00048061799998322385 future=<Future at 0x7724ec16cb60 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:58:18.035505 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Emitting event <LifecycleEvent: 1779933483.0343087, 12f40ca4-b4b3-43f4-8c0b-cb208f59935c => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:58:18.035705 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:58:18.035776 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=5.093290555000294 future=<Future at 0x7724ec2efb30 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:58:18.035884 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=5.093189562000134 future=<Future at 0x7724ec2efb30 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:58:18.036010 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] VM Stopped (Lifecycle Event)
May 28 01:58:18.099247 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:18.120697 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:58:18.120856 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:58:18.120960 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] No VIF found with MAC fa:16:3e:17:7e:4a, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:58:18.121507 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Using config drive
May 28 01:58:18.486333 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Removed pending STOPPED event for 0d87a47f-2eb6-4e25-b44a-848fe2225962 due to new event <LifecycleEvent: 1779933498.4859324, 0d87a47f-2eb6-4e25-b44a-848fe2225962 => Resumed> {{(pid=98241) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 01:58:18.486773 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933498.4859324, 0d87a47f-2eb6-4e25-b44a-848fe2225962 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:58:18.486773 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] VM Resumed (Lifecycle Event)
May 28 01:58:18.540854 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a4f6d453-6324-4b11-80ef-c07b5accef59 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 12f40ca4-b4b3-43f4-8c0b-cb208f59935c] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:58:18.627592 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:18.841672 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Creating config drive at /opt/stack/data/nova/instances/668cf051-44c2-4db1-bfd1-dfeed0c6b5a4/disk.config
May 28 01:58:18.845667 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/668cf051-44c2-4db1-bfd1-dfeed0c6b5a4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmprxjtl4tx {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:18.906818 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/668cf051-44c2-4db1-bfd1-dfeed0c6b5a4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmprxjtl4tx" returned: 0 in 0.061s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:18.994143 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:58:19.000417 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:58:19.166947 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9f00b227-1012-45ed-8dee-841ec32eebb1 req-eb6206a7-3d15-4ed7-97a0-66fc046c487e service nova] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Received event network-vif-plugged-f23d344d-9e4c-41b4-a61f-b324ba3c9794 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:19.167280 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9f00b227-1012-45ed-8dee-841ec32eebb1 req-eb6206a7-3d15-4ed7-97a0-66fc046c487e service nova] Acquiring lock "0d87a47f-2eb6-4e25-b44a-848fe2225962-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:19.167525 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9f00b227-1012-45ed-8dee-841ec32eebb1 req-eb6206a7-3d15-4ed7-97a0-66fc046c487e service nova] Lock "0d87a47f-2eb6-4e25-b44a-848fe2225962-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:19.167667 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9f00b227-1012-45ed-8dee-841ec32eebb1 req-eb6206a7-3d15-4ed7-97a0-66fc046c487e service nova] Lock "0d87a47f-2eb6-4e25-b44a-848fe2225962-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:19.167799 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9f00b227-1012-45ed-8dee-841ec32eebb1 req-eb6206a7-3d15-4ed7-97a0-66fc046c487e service nova] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] No waiting events found dispatching network-vif-plugged-f23d344d-9e4c-41b4-a61f-b324ba3c9794 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:58:19.167948 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-9f00b227-1012-45ed-8dee-841ec32eebb1 req-eb6206a7-3d15-4ed7-97a0-66fc046c487e service nova] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Received unexpected event network-vif-plugged-f23d344d-9e4c-41b4-a61f-b324ba3c9794 for instance with vm_state rescued and task_state None.
May 28 01:58:19.451876 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:19.502778 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:19.504268 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933499.5037835, 0d87a47f-2eb6-4e25-b44a-848fe2225962 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:58:19.504404 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] VM Started (Lifecycle Event)
May 28 01:58:19.589165 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:19.657132 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:19.658597 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:19.791102 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-21510cbe-98c5-4c6d-be3d-aa54530569c5 req-2b59bee6-9236-4d2d-85af-8560068badf0 service nova] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Received event network-vif-plugged-5a4bd986-18c1-42d1-9574-9080c2f65867 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:19.791309 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-21510cbe-98c5-4c6d-be3d-aa54530569c5 req-2b59bee6-9236-4d2d-85af-8560068badf0 service nova] Acquiring lock "668cf051-44c2-4db1-bfd1-dfeed0c6b5a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:19.791528 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-21510cbe-98c5-4c6d-be3d-aa54530569c5 req-2b59bee6-9236-4d2d-85af-8560068badf0 service nova] Lock "668cf051-44c2-4db1-bfd1-dfeed0c6b5a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:19.794924 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-21510cbe-98c5-4c6d-be3d-aa54530569c5 req-2b59bee6-9236-4d2d-85af-8560068badf0 service nova] Lock "668cf051-44c2-4db1-bfd1-dfeed0c6b5a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:19.795163 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-21510cbe-98c5-4c6d-be3d-aa54530569c5 req-2b59bee6-9236-4d2d-85af-8560068badf0 service nova] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Processing event network-vif-plugged-5a4bd986-18c1-42d1-9574-9080c2f65867 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:58:20.010381 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:58:20.017866 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:58:20.741061 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:58:20.745566 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933500.7452295, 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:58:20.747010 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] VM Started (Lifecycle Event)
May 28 01:58:20.750884 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:58:20.757398 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Instance spawned successfully.
May 28 01:58:20.763221 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:58:20.806343 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:20.824166 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "5516d92e-c69f-40a2-bb82-a07c1aca64e7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:20.824805 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "5516d92e-c69f-40a2-bb82-a07c1aca64e7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:21.255228 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:58:21.260640 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:58:21.272818 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:58:21.273126 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:58:21.274111 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:58:21.274111 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:58:21.274263 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:58:21.274619 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:58:21.296538 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Rescuing
May 28 01:58:21.297018 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquiring lock "refresh_cache-659c56a6-743a-45e2-aa21-7d45c672f094" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:58:21.297357 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquired lock "refresh_cache-659c56a6-743a-45e2-aa21-7d45c672f094" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:58:21.298955 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:58:21.332657 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:58:21.437033 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "22bbb8cf-c11d-4025-8551-4c1c3557264a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:21.437314 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "22bbb8cf-c11d-4025-8551-4c1c3557264a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:21.576923 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:21.763456 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:58:21.764931 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933501.7635524, 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:58:21.764931 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] VM Paused (Lifecycle Event)
May 28 01:58:21.786892 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Took 8.13 seconds to spawn the instance on the hypervisor.
May 28 01:58:21.787656 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:58:21.806408 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:21.905852 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-cc2fb915-ccc4-446a-8057-b466ae3e433c req-0517beaf-9b0c-4c9b-8644-c605ee3b07f0 service nova] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Received event network-vif-plugged-5a4bd986-18c1-42d1-9574-9080c2f65867 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:21.906591 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-cc2fb915-ccc4-446a-8057-b466ae3e433c req-0517beaf-9b0c-4c9b-8644-c605ee3b07f0 service nova] Acquiring lock "668cf051-44c2-4db1-bfd1-dfeed0c6b5a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:21.907097 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-cc2fb915-ccc4-446a-8057-b466ae3e433c req-0517beaf-9b0c-4c9b-8644-c605ee3b07f0 service nova] Lock "668cf051-44c2-4db1-bfd1-dfeed0c6b5a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:21.907097 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-cc2fb915-ccc4-446a-8057-b466ae3e433c req-0517beaf-9b0c-4c9b-8644-c605ee3b07f0 service nova] Lock "668cf051-44c2-4db1-bfd1-dfeed0c6b5a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:21.907097 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-cc2fb915-ccc4-446a-8057-b466ae3e433c req-0517beaf-9b0c-4c9b-8644-c605ee3b07f0 service nova] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] No waiting events found dispatching network-vif-plugged-5a4bd986-18c1-42d1-9574-9080c2f65867 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:58:21.907270 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-cc2fb915-ccc4-446a-8057-b466ae3e433c req-0517beaf-9b0c-4c9b-8644-c605ee3b07f0 service nova] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Received unexpected event network-vif-plugged-5a4bd986-18c1-42d1-9574-9080c2f65867 for instance with vm_state building and task_state spawning.
May 28 01:58:21.932497 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:21.933049 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:21.939171 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:58:21.939171 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Claim successful on node np0000001583
May 28 01:58:21.942534 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:58:22.267165 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:58:22.279537 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933502.2792711, 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:58:22.279866 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] VM Resumed (Lifecycle Event)
May 28 01:58:22.314765 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Took 13.68 seconds to build instance.
May 28 01:58:22.358651 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:22.514991 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:22.570714 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Updating instance_info_cache with network_info: [{"id": "51ab6198-7fa5-4b12-8d53-effcff16e287", "address": "fa:16:3e:ae:1e:12", "network": {"id": "e1d5d073-f27b-4ff1-9ed3-99f57407c76f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f65617e71571457f8906997583100678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ab6198-7f", "ovs_interfaceid": "51ab6198-7fa5-4b12-8d53-effcff16e287", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:58:22.783761 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:58:22.786973 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:58:22.820444 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "668cf051-44c2-4db1-bfd1-dfeed0c6b5a4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.212s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:23.073384 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Releasing lock "refresh_cache-659c56a6-743a-45e2-aa21-7d45c672f094" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:58:23.101657 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:23.131867 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.00271850999979506 future=<Future at 0x7724ec2efb30 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:58:23.132088 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:58:23.132187 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=1.3306120699999155 future=<Future at 0x7724f8697da0 state=cancelled>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:58:23.133024 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=1.3297812340001656 future=<Future at 0x7724f8697da0 state=cancelled>) was cancelled while queued, skipping {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:58:23.133277 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] Emitting event <LifecycleEvent: 1779933488.1290174, 258fd5d8-1ab7-4d19-afe7-421297b99684 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:58:23.133408 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:58:23.133540 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=2.828102139999828 future=<Future at 0x7724f82f0b60 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:58:23.133662 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=2.827997441000207 future=<Future at 0x7724f82f0b60 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:58:23.135360 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] VM Stopped (Lifecycle Event)
May 28 01:58:23.535569 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:58:23.535569 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:58:23.639275 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-6d069679-c8e5-4b01-a086-c4f1295b7a43 tempest-ServerBootFromVolumeStableRescueTest-1211567633 tempest-ServerBootFromVolumeStableRescueTest-1211567633-project-member] [instance: 258fd5d8-1ab7-4d19-afe7-421297b99684] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:58:24.036884 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:58:24.228704 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-3ae6d299-e800-456e-a85d-df9c80ada217 req-32152c4c-298c-4552-9acd-36c932bf82db service nova] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Received event network-changed-5a4bd986-18c1-42d1-9574-9080c2f65867 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:24.228855 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-3ae6d299-e800-456e-a85d-df9c80ada217 req-32152c4c-298c-4552-9acd-36c932bf82db service nova] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Refreshing instance network info cache due to event network-changed-5a4bd986-18c1-42d1-9574-9080c2f65867. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:58:24.231129 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-3ae6d299-e800-456e-a85d-df9c80ada217 req-32152c4c-298c-4552-9acd-36c932bf82db service nova] Acquiring lock "refresh_cache-668cf051-44c2-4db1-bfd1-dfeed0c6b5a4" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:58:24.231400 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-3ae6d299-e800-456e-a85d-df9c80ada217 req-32152c4c-298c-4552-9acd-36c932bf82db service nova] Acquired lock "refresh_cache-668cf051-44c2-4db1-bfd1-dfeed0c6b5a4" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:58:24.232596 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-3ae6d299-e800-456e-a85d-df9c80ada217 req-32152c4c-298c-4552-9acd-36c932bf82db service nova] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Refreshing network info cache for port 5a4bd986-18c1-42d1-9574-9080c2f65867 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:58:24.548378 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.615s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:24.549090 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.034s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:24.549366 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:58:24.556265 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:58:24.556421 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Claim successful on node np0000001583
May 28 01:58:24.736320 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-3ae6d299-e800-456e-a85d-df9c80ada217 req-32152c4c-298c-4552-9acd-36c932bf82db service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:24.765233 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:24.795004 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:24.986802 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:24.991721 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:25.047357 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:25.057790 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:58:25.058597 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:58:25.060525 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:25.060525 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:25.083613 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999456973000179 future=<Future at 0x7724f859b680 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:58:25.084164 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:25.088479 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Instance destroyed successfully.
May 28 01:58:25.091347 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lazy-loading 'numa_topology' on Instance uuid 659c56a6-743a-45e2-aa21-7d45c672f094 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:58:25.169396 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6be314b4eed642c3b2c72fe115860220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432aa1094ced436494def17a875aa8e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:58:25.233147 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-3ae6d299-e800-456e-a85d-df9c80ada217 req-32152c4c-298c-4552-9acd-36c932bf82db service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:25.263867 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:25.271809 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:25.430435 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-3ae6d299-e800-456e-a85d-df9c80ada217 req-32152c4c-298c-4552-9acd-36c932bf82db service nova] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Updated VIF entry in instance network info cache for port 5a4bd986-18c1-42d1-9574-9080c2f65867. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:58:25.430435 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-3ae6d299-e800-456e-a85d-df9c80ada217 req-32152c4c-298c-4552-9acd-36c932bf82db service nova] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Updating instance_info_cache with network_info: [{"id": "5a4bd986-18c1-42d1-9574-9080c2f65867", "address": "fa:16:3e:17:7e:4a", "network": {"id": "62e7cc38-1758-4b09-a352-4635adc9cfea", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587967507-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "837663bcfa40402aaf583729dfbb26cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a4bd986-18", "ovs_interfaceid": "5a4bd986-18c1-42d1-9574-9080c2f65867", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:58:25.477568 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:25.484205 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:25.577333 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:58:25.602206 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Attempting rescue
May 28 01:58:25.602857 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98241) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 28 01:58:25.616620 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Instance directory exists: not creating {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 01:58:25.616851 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Creating image(s)
May 28 01:58:25.621606 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquiring lock "/opt/stack/data/nova/instances/659c56a6-743a-45e2-aa21-7d45c672f094/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:25.621606 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "/opt/stack/data/nova/instances/659c56a6-743a-45e2-aa21-7d45c672f094/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:25.621606 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "/opt/stack/data/nova/instances/659c56a6-743a-45e2-aa21-7d45c672f094/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:25.621999 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lazy-loading 'trusted_certs' on Instance uuid 659c56a6-743a-45e2-aa21-7d45c672f094 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:58:25.657736 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:25.934985 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-3ae6d299-e800-456e-a85d-df9c80ada217 req-32152c4c-298c-4552-9acd-36c932bf82db service nova] Releasing lock "refresh_cache-668cf051-44c2-4db1-bfd1-dfeed0c6b5a4" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:58:25.962150 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0004300840000723838 future=<Future at 0x7724f82f0b60 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:58:25.962620 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Emitting event <LifecycleEvent: 1779933490.9615786, 5c36895c-9d2c-49be-b545-3658f535964a => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:58:25.962782 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:58:25.963205 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] VM Stopped (Lifecycle Event)
May 28 01:58:25.963815 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.119253793000098 future=<Future at 0x7724f859b680 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:58:25.965442 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.117629723000391 future=<Future at 0x7724f859b680 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:58:25.971811 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Successfully created port: 3ea23ee8-f2dc-4506-8207-7f2fb70c03b8 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:58:26.086129 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:58:26.091427 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:58:26.091756 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:58:26.128164 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Object Instance<659c56a6-743a-45e2-aa21-7d45c672f094> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:58:26.128164 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:58:26.129790 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:58:26.132061 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:26.132586 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:26.138140 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:58:26.139137 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:58:26.140013 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:26.261543 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.121s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:26.266104 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/659c56a6-743a-45e2-aa21-7d45c672f094/disk.rescue {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:26.325156 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7ac31244-6889-4ab0-a6f8-0904daf3ff88 req-ccd2c252-e7a4-4b43-8ae8-87c5aa05b2bc service nova] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Received event network-vif-unplugged-51ab6198-7fa5-4b12-8d53-effcff16e287 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:26.326646 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7ac31244-6889-4ab0-a6f8-0904daf3ff88 req-ccd2c252-e7a4-4b43-8ae8-87c5aa05b2bc service nova] Acquiring lock "659c56a6-743a-45e2-aa21-7d45c672f094-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:26.326826 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7ac31244-6889-4ab0-a6f8-0904daf3ff88 req-ccd2c252-e7a4-4b43-8ae8-87c5aa05b2bc service nova] Lock "659c56a6-743a-45e2-aa21-7d45c672f094-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:26.327008 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7ac31244-6889-4ab0-a6f8-0904daf3ff88 req-ccd2c252-e7a4-4b43-8ae8-87c5aa05b2bc service nova] Lock "659c56a6-743a-45e2-aa21-7d45c672f094-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:26.327193 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7ac31244-6889-4ab0-a6f8-0904daf3ff88 req-ccd2c252-e7a4-4b43-8ae8-87c5aa05b2bc service nova] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] No waiting events found dispatching network-vif-unplugged-51ab6198-7fa5-4b12-8d53-effcff16e287 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:58:26.327343 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-7ac31244-6889-4ab0-a6f8-0904daf3ff88 req-ccd2c252-e7a4-4b43-8ae8-87c5aa05b2bc service nova] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Received unexpected event network-vif-unplugged-51ab6198-7fa5-4b12-8d53-effcff16e287 for instance with vm_state active and task_state rescuing.
May 28 01:58:26.327472 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7ac31244-6889-4ab0-a6f8-0904daf3ff88 req-ccd2c252-e7a4-4b43-8ae8-87c5aa05b2bc service nova] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Received event network-vif-unplugged-51ab6198-7fa5-4b12-8d53-effcff16e287 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:26.327644 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7ac31244-6889-4ab0-a6f8-0904daf3ff88 req-ccd2c252-e7a4-4b43-8ae8-87c5aa05b2bc service nova] Acquiring lock "659c56a6-743a-45e2-aa21-7d45c672f094-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:26.327796 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7ac31244-6889-4ab0-a6f8-0904daf3ff88 req-ccd2c252-e7a4-4b43-8ae8-87c5aa05b2bc service nova] Lock "659c56a6-743a-45e2-aa21-7d45c672f094-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:26.327918 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7ac31244-6889-4ab0-a6f8-0904daf3ff88 req-ccd2c252-e7a4-4b43-8ae8-87c5aa05b2bc service nova] Lock "659c56a6-743a-45e2-aa21-7d45c672f094-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:26.328349 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7ac31244-6889-4ab0-a6f8-0904daf3ff88 req-ccd2c252-e7a4-4b43-8ae8-87c5aa05b2bc service nova] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] No waiting events found dispatching network-vif-unplugged-51ab6198-7fa5-4b12-8d53-effcff16e287 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:58:26.328491 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-7ac31244-6889-4ab0-a6f8-0904daf3ff88 req-ccd2c252-e7a4-4b43-8ae8-87c5aa05b2bc service nova] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Received unexpected event network-vif-unplugged-51ab6198-7fa5-4b12-8d53-effcff16e287 for instance with vm_state active and task_state rescuing.
May 28 01:58:26.337687 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/659c56a6-743a-45e2-aa21-7d45c672f094/disk.rescue" returned: 0 in 0.074s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:26.339647 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:26.339647 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lazy-loading 'migration_context' on Instance uuid 659c56a6-743a-45e2-aa21-7d45c672f094 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:58:26.467498 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-832d18c9-b8ba-4c2b-b971-88cc24abf724 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 5c36895c-9d2c-49be-b545-3658f535964a] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:58:26.578645 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:26.591452 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Booting with volume b9d4f964-bf92-4184-a936-b3d05b7d8d1b at /dev/vda
May 28 01:58:26.595441 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:58:26.643326 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Successfully updated port: 3ea23ee8-f2dc-4506-8207-7f2fb70c03b8 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:58:26.661613 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:58:26.673110 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:58:26.705273 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-8af9d165-5b79-4d73-a67d-32d18b0abe58 req-843eb051-2dbb-4ce6-a13d-661921e31d2b service nova] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Received event network-changed-3ea23ee8-f2dc-4506-8207-7f2fb70c03b8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:26.705479 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-8af9d165-5b79-4d73-a67d-32d18b0abe58 req-843eb051-2dbb-4ce6-a13d-661921e31d2b service nova] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Refreshing instance network info cache due to event network-changed-3ea23ee8-f2dc-4506-8207-7f2fb70c03b8. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:58:26.705670 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-8af9d165-5b79-4d73-a67d-32d18b0abe58 req-843eb051-2dbb-4ce6-a13d-661921e31d2b service nova] Acquiring lock "refresh_cache-5516d92e-c69f-40a2-bb82-a07c1aca64e7" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:58:26.705765 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-8af9d165-5b79-4d73-a67d-32d18b0abe58 req-843eb051-2dbb-4ce6-a13d-661921e31d2b service nova] Acquired lock "refresh_cache-5516d92e-c69f-40a2-bb82-a07c1aca64e7" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:58:26.706315 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-8af9d165-5b79-4d73-a67d-32d18b0abe58 req-843eb051-2dbb-4ce6-a13d-661921e31d2b service nova] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Refreshing network info cache for port 3ea23ee8-f2dc-4506-8207-7f2fb70c03b8 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:58:26.707794 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:26.753308 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:58:26.753949 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:58:26.764856 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:58:26.766296 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe92:e25b', 'fe80::ecb9:b7ff:fe00:dc63', 'fe80::8832:afff:fe8a:cd4c', 'fe80::fc16:3eff:fe48:7d7b', 'fe80::d0cf:7bff:fef9:3cc3', 'fe80::fc16:3eff:feca:d649', 'fe80::fc16:3eff:fe17:7e4a'] 
May 28 01:58:26.766446 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:58:26.766559 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:58:26.766855 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] <== get_connector_properties: return (105ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:58:26.767306 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Updating existing volume attachment record: 6d25fb4e-aaea-48d4-8beb-d7510f1bc32b {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:58:26.845782 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Object Instance<659c56a6-743a-45e2-aa21-7d45c672f094> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:58:26.845782 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:58:26.845782 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Start _get_guest_xml network_info=[{"id": "51ab6198-7fa5-4b12-8d53-effcff16e287", "address": "fa:16:3e:ae:1e:12", "network": {"id": "e1d5d073-f27b-4ff1-9ed3-99f57407c76f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "vif_mac": "fa:16:3e:ae:1e:12"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f65617e71571457f8906997583100678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ab6198-7f", "ovs_interfaceid": "51ab6198-7fa5-4b12-8d53-effcff16e287", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:58:26.845782 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lazy-loading 'resources' on Instance uuid 659c56a6-743a-45e2-aa21-7d45c672f094 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:58:27.110577 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.561s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:27.110577 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:58:27.145788 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "refresh_cache-5516d92e-c69f-40a2-bb82-a07c1aca64e7" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:58:27.210180 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-8af9d165-5b79-4d73-a67d-32d18b0abe58 req-843eb051-2dbb-4ce6-a13d-661921e31d2b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:27.274311 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:27.298269 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-8af9d165-5b79-4d73-a67d-32d18b0abe58 req-843eb051-2dbb-4ce6-a13d-661921e31d2b service nova] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:58:27.347920 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Object Instance<659c56a6-743a-45e2-aa21-7d45c672f094> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:58:27.354402 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:58:27.356467 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1830325230', uuid='659c56a6-743a-45e2-aa21-7d45c672f094'), owner=OwnerMeta(userid='435dfce8f05e4e01b380797bd07bd4dc', username='tempest-ServerRescueNegativeTestJSON-1821941242-project-member', projectid='f65617e71571457f8906997583100678', projectname='tempest-ServerRescueNegativeTestJSON-1821941242'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "51ab6198-7fa5-4b12-8d53-effcff16e287", "address": "fa:16:3e:ae:1e:12", "network": {"id": "e1d5d073-f27b-4ff1-9ed3-99f57407c76f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "vif_mac": "fa:16:3e:ae:1e:12"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f65617e71571457f8906997583100678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ab6198-7f", "ovs_interfaceid": "51ab6198-7fa5-4b12-8d53-effcff16e287", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933507.355797) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:58:27.367592 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:58:27.367592 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:58:27.370309 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:58:27.370509 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:58:27.371509 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:58:27.371839 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:58:27.372008 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:58:27.372103 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:58:27.372602 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:58:27.375055 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:58:27.375189 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:58:27.375377 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:58:27.375486 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:58:27.375636 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:58:27.375764 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:58:27.375876 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:58:27.376090 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lazy-loading 'vcpu_model' on Instance uuid 659c56a6-743a-45e2-aa21-7d45c672f094 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:58:27.545395 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-8af9d165-5b79-4d73-a67d-32d18b0abe58 req-843eb051-2dbb-4ce6-a13d-661921e31d2b service nova] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:58:27.618116 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:58:27.618116 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:58:27.618722 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:27.618722 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:27.752064 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cadb612e41314b06914d5f5f47570e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0474090f4f2d4950b51bc317f4302266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:58:27.878754 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Object Instance<659c56a6-743a-45e2-aa21-7d45c672f094> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:58:27.903022 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:57:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1830325230',display_name='tempest-ServerRescueNegativeTestJSON-server-1830325230',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-serverrescuenegativetestjson-server-1830325230',id=28,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:58:01Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f65617e71571457f8906997583100678',ramdisk_id='',reservation_id='r-0bu7sx5m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1821941242',owner_user_name='tempest-ServerRescueNegativeTestJSON-1821941242-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:58:02Z,user_data=None,user_id='435dfce8f05e4e01b380797bd07bd4dc',uuid=659c56a6-743a-45e2-aa21-7d45c672f094,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51ab6198-7fa5-4b12-8d53-effcff16e287", "address": "fa:16:3e:ae:1e:12", "network": {"id": "e1d5d073-f27b-4ff1-9ed3-99f57407c76f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "vif_mac": "fa:16:3e:ae:1e:12"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f65617e71571457f8906997583100678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ab6198-7f", "ovs_interfaceid": "51ab6198-7fa5-4b12-8d53-effcff16e287", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:58:27.905273 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Converting VIF {"id": "51ab6198-7fa5-4b12-8d53-effcff16e287", "address": "fa:16:3e:ae:1e:12", "network": {"id": "e1d5d073-f27b-4ff1-9ed3-99f57407c76f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "vif_mac": "fa:16:3e:ae:1e:12"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f65617e71571457f8906997583100678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ab6198-7f", "ovs_interfaceid": "51ab6198-7fa5-4b12-8d53-effcff16e287", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:58:27.909098 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:1e:12,bridge_name='br-int',has_traffic_filtering=True,id=51ab6198-7fa5-4b12-8d53-effcff16e287,network=Network(e1d5d073-f27b-4ff1-9ed3-99f57407c76f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ab6198-7f') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:58:27.909098 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lazy-loading 'pci_devices' on Instance uuid 659c56a6-743a-45e2-aa21-7d45c672f094 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:58:28.047623 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-8af9d165-5b79-4d73-a67d-32d18b0abe58 req-843eb051-2dbb-4ce6-a13d-661921e31d2b service nova] Releasing lock "refresh_cache-5516d92e-c69f-40a2-bb82-a07c1aca64e7" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:58:28.048091 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquired lock "refresh_cache-5516d92e-c69f-40a2-bb82-a07c1aca64e7" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:58:28.048323 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:58:28.103618 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:28.121327 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:58:28.411172 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Object Instance<659c56a6-743a-45e2-aa21-7d45c672f094> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:58:28.412260 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] End _get_guest_xml xml=<domain type="qemu">
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:   <uuid>659c56a6-743a-45e2-aa21-7d45c672f094</uuid>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:   <name>instance-0000001c</name>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1830325230</nova:name>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:58:27</nova:creationTime>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:         <nova:user uuid="435dfce8f05e4e01b380797bd07bd4dc">tempest-ServerRescueNegativeTestJSON-1821941242-project-member</nova:user>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:         <nova:project uuid="f65617e71571457f8906997583100678">tempest-ServerRescueNegativeTestJSON-1821941242</nova:project>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:         <nova:port uuid="51ab6198-7fa5-4b12-8d53-effcff16e287">
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:     <system>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:       <entry name="serial">659c56a6-743a-45e2-aa21-7d45c672f094</entry>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:       <entry name="uuid">659c56a6-743a-45e2-aa21-7d45c672f094</entry>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:     </system>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:   <os>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:   </os>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:   <features>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:   </features>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:   <devices>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/659c56a6-743a-45e2-aa21-7d45c672f094/disk.rescue"/>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:     </disk>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/659c56a6-743a-45e2-aa21-7d45c672f094/disk"/>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:       <target dev="vdb" bus="virtio"/>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:     </disk>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/659c56a6-743a-45e2-aa21-7d45c672f094/disk.config.rescue"/>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:     </disk>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:ae:1e:12"/>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:       <target dev="tap51ab6198-7f"/>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:     </interface>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/659c56a6-743a-45e2-aa21-7d45c672f094/console.log" append="off"/>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:     </serial>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:     <video>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:     </video>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:     </rng>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:   </devices>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]: </domain>
May 28 01:58:28.412260 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:58:28.418474 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Instance destroyed successfully.
May 28 01:58:28.627231 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:58:28.641932 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:58:28.965457 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:58:28.965457 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:58:28.965457 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Creating image(s)
May 28 01:58:28.965457 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Did not create local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 01:58:28.965457 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Ensure instance console log exists: /opt/stack/data/nova/instances/5516d92e-c69f-40a2-bb82-a07c1aca64e7/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:58:28.966850 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:28.966850 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:28.966850 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:28.984402 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:29.088970 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Successfully created port: cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:58:29.544879 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:29.578591 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Updating instance_info_cache with network_info: [{"id": "3ea23ee8-f2dc-4506-8207-7f2fb70c03b8", "address": "fa:16:3e:20:c7:50", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ea23ee8-f2", "ovs_interfaceid": "3ea23ee8-f2dc-4506-8207-7f2fb70c03b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:58:29.637150 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:58:29.637941 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:58:29.638102 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Creating image(s)
May 28 01:58:29.638562 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "/opt/stack/data/nova/instances/22bbb8cf-c11d-4025-8551-4c1c3557264a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:29.638698 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "/opt/stack/data/nova/instances/22bbb8cf-c11d-4025-8551-4c1c3557264a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:29.639633 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "/opt/stack/data/nova/instances/22bbb8cf-c11d-4025-8551-4c1c3557264a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:29.640293 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:58:29.645268 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:58:29.646951 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:29.756145 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.109s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:29.756940 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:29.757816 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:29.758548 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:58:29.764018 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:58:29.764798 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:29.887899 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.123s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:29.889346 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/22bbb8cf-c11d-4025-8551-4c1c3557264a/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:29.945767 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/22bbb8cf-c11d-4025-8551-4c1c3557264a/disk 1073741824" returned: 0 in 0.057s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:29.946605 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:29.947041 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:29.968739 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:58:29.969088 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:58:29.969321 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:58:29.969740 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] No VIF found with MAC fa:16:3e:ae:1e:12, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:58:29.971324 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Using config drive
May 28 01:58:30.058295 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.111s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:30.058690 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Checking if we can resize image /opt/stack/data/nova/instances/22bbb8cf-c11d-4025-8551-4c1c3557264a/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:58:30.061245 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bbb8cf-c11d-4025-8551-4c1c3557264a/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:30.081652 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Releasing lock "refresh_cache-5516d92e-c69f-40a2-bb82-a07c1aca64e7" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:58:30.085279 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Instance network_info: |[{"id": "3ea23ee8-f2dc-4506-8207-7f2fb70c03b8", "address": "fa:16:3e:20:c7:50", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ea23ee8-f2", "ovs_interfaceid": "3ea23ee8-f2dc-4506-8207-7f2fb70c03b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:58:30.089697 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Start _get_guest_xml network_info=[{"id": "3ea23ee8-f2dc-4506-8207-7f2fb70c03b8", "address": "fa:16:3e:20:c7:50", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ea23ee8-f2", "ovs_interfaceid": "3ea23ee8-f2dc-4506-8207-7f2fb70c03b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b', 'iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b9d4f964-bf92-4184-a936-b3d05b7d8d1b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '5516d92e-c69f-40a2-bb82-a07c1aca64e7', 'attached_at': '', 'detached_at': '', 'volume_id': 'b9d4f964-bf92-4184-a936-b3d05b7d8d1b', 'serial': 'b9d4f964-bf92-4184-a936-b3d05b7d8d1b'}, 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '6d25fb4e-aaea-48d4-8beb-d7510f1bc32b', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:58:30.096989 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:58:30.099108 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-2002538727', uuid='5516d92e-c69f-40a2-bb82-a07c1aca64e7'), owner=OwnerMeta(userid='6be314b4eed642c3b2c72fe115860220', username='tempest-TestVolumeBootPattern-1031057169-project-member', projectid='432aa1094ced436494def17a875aa8e1', projectname='tempest-TestVolumeBootPattern-1031057169'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3ea23ee8-f2dc-4506-8207-7f2fb70c03b8", "address": "fa:16:3e:20:c7:50", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ea23ee8-f2", "ovs_interfaceid": "3ea23ee8-f2dc-4506-8207-7f2fb70c03b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933510.098501) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:58:30.100692 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:58:30.101376 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:58:30.102692 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:58:30.102922 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:58:30.104868 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:58:30.105467 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:58:30.106648 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:58:30.106648 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:58:30.106648 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:58:30.106648 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:58:30.106648 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:58:30.106866 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:58:30.106995 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:58:30.107179 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:58:30.109113 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:58:30.109113 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:58:30.125372 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:58:30.126126 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b', 'iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b9d4f964-bf92-4184-a936-b3d05b7d8d1b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:58:30.126358 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:58:30.127009 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:58:30.127341 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b', 'iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b9d4f964-bf92-4184-a936-b3d05b7d8d1b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:58:30.143642 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:58:30.144143 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:58:30.149109 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:58:30.149109 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:58:30.152261 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.006s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:58:30.152261 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:58:30.164683 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:58:30.164683 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:58:30.174258 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:58:30.174258 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:58:30.180098 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bbb8cf-c11d-4025-8551-4c1c3557264a/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:30.180098 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Cannot resize image /opt/stack/data/nova/instances/22bbb8cf-c11d-4025-8551-4c1c3557264a/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:58:30.180795 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:58:30.180795 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Ensure instance console log exists: /opt/stack/data/nova/instances/22bbb8cf-c11d-4025-8551-4c1c3557264a/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:58:30.181053 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:30.181312 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:30.182265 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:30.184457 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b] added
May 28 01:58:30.184457 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:58:30.184457 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:58:30.184457 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:58:30.184457 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:58:30.184457 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:58:30.184457 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:58:30.184721 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:58:30.184860 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0364(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:58:30.185429 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:58:30.190527 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b] added
May 28 01:58:30.190527 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:58:30.190527 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:58:30.190527 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:58:30.190527 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:58:30.190527 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:58:30.190527 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:58:30.190744 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:58:30.190871 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0402(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:58:30.191033 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:58:30.478868 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lazy-loading 'ec2_ids' on Instance uuid 659c56a6-743a-45e2-aa21-7d45c672f094 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:58:30.652807 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Successfully updated port: cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:58:30.722616 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b5357607-2893-4ee7-a3ad-a4402a28ec11 req-221208c6-afac-4ee7-ab93-ac33dfccf193 service nova] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Received event network-changed-cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:30.723764 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b5357607-2893-4ee7-a3ad-a4402a28ec11 req-221208c6-afac-4ee7-ab93-ac33dfccf193 service nova] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Refreshing instance network info cache due to event network-changed-cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:58:30.723983 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b5357607-2893-4ee7-a3ad-a4402a28ec11 req-221208c6-afac-4ee7-ab93-ac33dfccf193 service nova] Acquiring lock "refresh_cache-22bbb8cf-c11d-4025-8551-4c1c3557264a" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:58:30.724154 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b5357607-2893-4ee7-a3ad-a4402a28ec11 req-221208c6-afac-4ee7-ab93-ac33dfccf193 service nova] Acquired lock "refresh_cache-22bbb8cf-c11d-4025-8551-4c1c3557264a" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:58:30.724293 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-b5357607-2893-4ee7-a3ad-a4402a28ec11 req-221208c6-afac-4ee7-ab93-ac33dfccf193 service nova] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Refreshing network info cache for port cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:58:30.985890 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Object Instance<659c56a6-743a-45e2-aa21-7d45c672f094> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:58:30.986503 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lazy-loading 'keypairs' on Instance uuid 659c56a6-743a-45e2-aa21-7d45c672f094 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:58:31.154987 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "refresh_cache-22bbb8cf-c11d-4025-8551-4c1c3557264a" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:58:31.185994 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:58:31.191446 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:58:31.203484 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:58:31.203484 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:58:31.212146 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:58:31.212146 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:58:31.220255 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:58:31.229103 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-b5357607-2893-4ee7-a3ad-a4402a28ec11 req-221208c6-afac-4ee7-ab93-ac33dfccf193 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:31.230553 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:58:31.244878 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa (non-flash)
May 28 01:58:31.244878 np0000001583 nova-compute[98241]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa (non-flash)
May 28 01:58:31.244878 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:58:31.244878 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:58:31.244878 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:58:31.245298 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa (non-flash)
May 28 01:58:31.245298 np0000001583 nova-compute[98241]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa (non-flash)
May 28 01:58:31.245298 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:58:31.245298 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:58:31.245298 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:58:31.252767 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa (non-flash)
May 28 01:58:31.252767 np0000001583 nova-compute[98241]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa (non-flash)
May 28 01:58:31.252767 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:58:31.252767 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:58:31.252767 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:58:31.252767 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa (non-flash)
May 28 01:58:31.252767 np0000001583 nova-compute[98241]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa (non-flash)
May 28 01:58:31.252767 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:58:31.252767 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:58:31.252767 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:58:31.290835 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b, portal: 192.168.40.100,3260]
May 28 01:58:31.290835 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b, portal: 192.168.40.100,3260] successful.
May 28 01:58:31.290835 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:58:31.294222 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b, portal: 192.168.50.100,3260]
May 28 01:58:31.294222 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b, portal: 192.168.50.100,3260] successful.
May 28 01:58:31.294222 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:58:31.307026 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:58:31.315986 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:58:31.326395 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-b5357607-2893-4ee7-a3ad-a4402a28ec11 req-221208c6-afac-4ee7-ab93-ac33dfccf193 service nova] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:58:31.329358 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa (non-flash)
May 28 01:58:31.329358 np0000001583 nova-compute[98241]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa (non-flash)
May 28 01:58:31.329358 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:58:31.329358 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:58:31.329358 np0000001583 nova-compute[98241]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:58:31.329358 np0000001583 nova-compute[98241]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:58:31.329358 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:58:31.329903 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa (non-flash)
May 28 01:58:31.329903 np0000001583 nova-compute[98241]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa (non-flash)
May 28 01:58:31.329903 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:58:31.329903 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:58:31.329903 np0000001583 nova-compute[98241]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:58:31.329903 np0000001583 nova-compute[98241]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:58:31.329903 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:58:31.330139 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.181s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:58:31.330450 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:58:31.331149 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] HCTL ('10', '-', '-', 0) found on session 71 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:58:31.331245 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:58:31.339010 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa (non-flash)
May 28 01:58:31.339010 np0000001583 nova-compute[98241]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa (non-flash)
May 28 01:58:31.339010 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:58:31.339010 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:58:31.339010 np0000001583 nova-compute[98241]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:58:31.339010 np0000001583 nova-compute[98241]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:58:31.339010 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:58:31.339295 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa (non-flash)
May 28 01:58:31.339295 np0000001583 nova-compute[98241]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa (non-flash)
May 28 01:58:31.339295 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:58:31.339295 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:58:31.339295 np0000001583 nova-compute[98241]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:58:31.339295 np0000001583 nova-compute[98241]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:58:31.339295 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:58:31.339491 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.191s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:58:31.339491 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:58:31.340353 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] HCTL ('9', '-', '-', 0) found on session 70 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:58:31.340620 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:58:31.356274 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Searching for a device in session 71 and hctl ['10', '*', '*', 0] yield: sdd {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:58:31.356671 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b9d4f964-bf92-4184-a936-b3d05b7d8d1b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:58:31.372987 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Searching for a device in session 70 and hctl ['9', '*', '*', 0] yield: sde {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:58:31.372987 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b9d4f964-bf92-4184-a936-b3d05b7d8d1b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:58:31.491470 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Object Instance<659c56a6-743a-45e2-aa21-7d45c672f094> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:58:31.494103 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:31.580806 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:31.782526 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-b5357607-2893-4ee7-a3ad-a4402a28ec11 req-221208c6-afac-4ee7-ab93-ac33dfccf193 service nova] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:58:31.809761 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Creating config drive at /opt/stack/data/nova/instances/659c56a6-743a-45e2-aa21-7d45c672f094/disk.config.rescue
May 28 01:58:31.813132 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/659c56a6-743a-45e2-aa21-7d45c672f094/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptsgelwoa {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:31.883701 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/659c56a6-743a-45e2-aa21-7d45c672f094/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptsgelwoa" returned: 0 in 0.070s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:31.967047 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:58:31.967047 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:58:31.967047 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:58:31.967047 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:58:31.967047 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:58:31.967047 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:58:31.967047 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:58:31.967047 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 01:58:31.967355 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:58:32.145790 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:58:32.286169 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b5357607-2893-4ee7-a3ad-a4402a28ec11 req-221208c6-afac-4ee7-ab93-ac33dfccf193 service nova] Releasing lock "refresh_cache-22bbb8cf-c11d-4025-8551-4c1c3557264a" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:58:32.287871 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquired lock "refresh_cache-22bbb8cf-c11d-4025-8551-4c1c3557264a" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:58:32.287871 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:58:32.413905 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:32.444965 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:32.474111 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:32.474436 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:32.474760 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:32.474760 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Auditing locally available compute resources for np0000001583 (node: np0000001583) {{(pid=98241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 01:58:32.534284 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:32.556927 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:32.616615 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:32.961681 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:58:33.104422 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:33.165778 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Found WWN 330000000a79276d2 for multipath device dm-3 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:58:33.166215 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:58:33.166448 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '330000000a79276d2', 'path': '/dev/dm-3', 'multipath_id': '330000000a79276d2'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:58:33.166600 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a79276d2', 'path': '/dev/dm-3', 'multipath_id': '330000000a79276d2'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:58:33.286369 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:33.475403 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Updating instance_info_cache with network_info: [{"id": "cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b", "address": "fa:16:3e:d3:cd:06", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc6fcb39-fe", "ovs_interfaceid": "cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:58:33.562340 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Acquiring lock "d4fad20b-d51e-47c9-8f55-3aa085a10891" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:33.562340 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "d4fad20b-d51e-47c9-8f55-3aa085a10891" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:33.617481 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Removed pending STOPPED event for 659c56a6-743a-45e2-aa21-7d45c672f094 due to new event <LifecycleEvent: 1779933513.617034, 659c56a6-743a-45e2-aa21-7d45c672f094 => Resumed> {{(pid=98241) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 01:58:33.617653 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933513.617034, 659c56a6-743a-45e2-aa21-7d45c672f094 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:58:33.617852 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] VM Resumed (Lifecycle Event)
May 28 01:58:33.620065 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-363365c7-944e-488b-ba01-f9935f7ef8cd tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:58:33.681777 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d87a47f-2eb6-4e25-b44a-848fe2225962/disk.rescue --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:33.702471 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2002538727',display_name='tempest-TestVolumeBootPattern-server-2002538727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testvolumebootpattern-server-2002538727',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHAn6voYFucbngoRAJmnotzf66o58JwFX9NzCclmFCkNWIpHP6gjxjIluJ06OrAC9KC6sFrZoSxqHD83jV1GFKJlsmFEn3NHoSu4eJes1JfWwWo6nJb9nsd53fF4Dpwmw==',key_name='tempest-keypair-11480058',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='432aa1094ced436494def17a875aa8e1',ramdisk_id='',reservation_id='r-5ats8qhz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1031057169',owner_user_name='tempest-TestVolumeBootPattern-1031057169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:58:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6be314b4eed642c3b2c72fe115860220',uuid=5516d92e-c69f-40a2-bb82-a07c1aca64e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ea23ee8-f2dc-4506-8207-7f2fb70c03b8", "address": "fa:16:3e:20:c7:50", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ea23ee8-f2", "ovs_interfaceid": "3ea23ee8-f2dc-4506-8207-7f2fb70c03b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:58:33.703063 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converting VIF {"id": "3ea23ee8-f2dc-4506-8207-7f2fb70c03b8", "address": "fa:16:3e:20:c7:50", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ea23ee8-f2", "ovs_interfaceid": "3ea23ee8-f2dc-4506-8207-7f2fb70c03b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:58:33.704622 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:c7:50,bridge_name='br-int',has_traffic_filtering=True,id=3ea23ee8-f2dc-4506-8207-7f2fb70c03b8,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ea23ee8-f2') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:58:33.707450 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lazy-loading 'pci_devices' on Instance uuid 5516d92e-c69f-40a2-bb82-a07c1aca64e7 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:58:33.788126 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d87a47f-2eb6-4e25-b44a-848fe2225962/disk.rescue --force-share --output=json" returned: 0 in 0.107s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:33.788717 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d87a47f-2eb6-4e25-b44a-848fe2225962/disk.rescue --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:33.915594 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d87a47f-2eb6-4e25-b44a-848fe2225962/disk.rescue --force-share --output=json" returned: 0 in 0.125s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:33.915969 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d87a47f-2eb6-4e25-b44a-848fe2225962/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:33.979322 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Releasing lock "refresh_cache-22bbb8cf-c11d-4025-8551-4c1c3557264a" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:58:33.986005 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Instance network_info: |[{"id": "cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b", "address": "fa:16:3e:d3:cd:06", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc6fcb39-fe", "ovs_interfaceid": "cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:58:33.992611 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Start _get_guest_xml network_info=[{"id": "cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b", "address": "fa:16:3e:d3:cd:06", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc6fcb39-fe", "ovs_interfaceid": "cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:58:34.000042 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:58:34.003347 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='22bbb8cf-c11d-4025-8551-4c1c3557264a'), owner=OwnerMeta(userid='cadb612e41314b06914d5f5f47570e98', username='tempest-AttachVolumeMultiAttachTest-857456921-project-member', projectid='0474090f4f2d4950b51bc317f4302266', projectname='tempest-AttachVolumeMultiAttachTest-857456921'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b", "address": "fa:16:3e:d3:cd:06", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc6fcb39-fe", "ovs_interfaceid": "cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933514.001997) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:58:34.005533 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:58:34.006811 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:58:34.009783 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:58:34.010709 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:58:34.012865 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:58:34.014021 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:58:34.015511 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:58:34.016317 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:58:34.020106 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:58:34.020106 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:58:34.020106 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:58:34.020106 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:58:34.020106 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:58:34.020106 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:58:34.020106 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:58:34.020106 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:58:34.037387 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:58:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='multiattach-server-0',id=33,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAP7CI9wuY8JR5OGc0CpqFzQg3rj7cqVgHC4sPYHH38XlmtTRa9WHg3S3WcIsSpd43tWEYYLHF1/yDpoSsozR5Hrjk+cgmLbTDwUHC3YheiC8VnlV/ymBtBFe0b8oxSz5w==',key_name='tempest-keypair-1713929294',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0474090f4f2d4950b51bc317f4302266',ramdisk_id='',reservation_id='r-yz328fm1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-857456921',owner_user_name='tempest-AttachVolumeMultiAttachTest-857456921-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:58:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cadb612e41314b06914d5f5f47570e98',uuid=22bbb8cf-c11d-4025-8551-4c1c3557264a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b", "address": "fa:16:3e:d3:cd:06", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc6fcb39-fe", "ovs_interfaceid": "cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:58:34.037922 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Converting VIF {"id": "cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b", "address": "fa:16:3e:d3:cd:06", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc6fcb39-fe", "ovs_interfaceid": "cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:58:34.038865 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:cd:06,bridge_name='br-int',has_traffic_filtering=True,id=cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc6fcb39-fe') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:58:34.040518 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d87a47f-2eb6-4e25-b44a-848fe2225962/disk --force-share --output=json" returned: 0 in 0.123s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:34.040751 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lazy-loading 'pci_devices' on Instance uuid 22bbb8cf-c11d-4025-8551-4c1c3557264a {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:58:34.042500 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d87a47f-2eb6-4e25-b44a-848fe2225962/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:34.065271 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:58:34.123014 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:58:34.127617 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:58:34.155920 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d87a47f-2eb6-4e25-b44a-848fe2225962/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:34.158249 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659c56a6-743a-45e2-aa21-7d45c672f094/disk.rescue --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:34.217644 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] End _get_guest_xml xml=<domain type="qemu">
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:   <uuid>5516d92e-c69f-40a2-bb82-a07c1aca64e7</uuid>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:   <name>instance-00000020</name>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:       <nova:name>tempest-TestVolumeBootPattern-server-2002538727</nova:name>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:58:30</nova:creationTime>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:       <nova:image uuid="">
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:         <nova:user uuid="6be314b4eed642c3b2c72fe115860220">tempest-TestVolumeBootPattern-1031057169-project-member</nova:user>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:         <nova:project uuid="432aa1094ced436494def17a875aa8e1">tempest-TestVolumeBootPattern-1031057169</nova:project>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:       <nova:root type="volume" uuid=""/>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:         <nova:port uuid="3ea23ee8-f2dc-4506-8207-7f2fb70c03b8">
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:     <system>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:       <entry name="serial">5516d92e-c69f-40a2-bb82-a07c1aca64e7</entry>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:       <entry name="uuid">5516d92e-c69f-40a2-bb82-a07c1aca64e7</entry>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:     </system>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:   <os>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:   </os>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:   <features>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:   </features>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:   <devices>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/5516d92e-c69f-40a2-bb82-a07c1aca64e7/disk.config"/>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:     </disk>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:     <disk type="block" device="disk">
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:       <alias name="ua-b9d4f964-bf92-4184-a936-b3d05b7d8d1b"/>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:       <source dev="/dev/dm-3"/>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:       <serial>b9d4f964-bf92-4184-a936-b3d05b7d8d1b</serial>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:     </disk>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:20:c7:50"/>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:       <target dev="tap3ea23ee8-f2"/>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:     </interface>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/5516d92e-c69f-40a2-bb82-a07c1aca64e7/console.log" append="off"/>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:     </serial>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:     <video>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:     </video>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:     </rng>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:   </devices>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]: </domain>
May 28 01:58:34.217644 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:58:34.220513 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Preparing to wait for external event network-vif-plugged-3ea23ee8-f2dc-4506-8207-7f2fb70c03b8 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:58:34.220513 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "5516d92e-c69f-40a2-bb82-a07c1aca64e7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:34.220513 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "5516d92e-c69f-40a2-bb82-a07c1aca64e7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:34.220513 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "5516d92e-c69f-40a2-bb82-a07c1aca64e7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:34.220513 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2002538727',display_name='tempest-TestVolumeBootPattern-server-2002538727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testvolumebootpattern-server-2002538727',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHAn6voYFucbngoRAJmnotzf66o58JwFX9NzCclmFCkNWIpHP6gjxjIluJ06OrAC9KC6sFrZoSxqHD83jV1GFKJlsmFEn3NHoSu4eJes1JfWwWo6nJb9nsd53fF4Dpwmw==',key_name='tempest-keypair-11480058',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='432aa1094ced436494def17a875aa8e1',ramdisk_id='',reservation_id='r-5ats8qhz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1031057169',owner_user_name='tempest-TestVolumeBootPattern-1031057169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:58:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6be314b4eed642c3b2c72fe115860220',uuid=5516d92e-c69f-40a2-bb82-a07c1aca64e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ea23ee8-f2dc-4506-8207-7f2fb70c03b8", "address": "fa:16:3e:20:c7:50", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ea23ee8-f2", "ovs_interfaceid": "3ea23ee8-f2dc-4506-8207-7f2fb70c03b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:58:34.220513 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converting VIF {"id": "3ea23ee8-f2dc-4506-8207-7f2fb70c03b8", "address": "fa:16:3e:20:c7:50", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ea23ee8-f2", "ovs_interfaceid": "3ea23ee8-f2dc-4506-8207-7f2fb70c03b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:58:34.221733 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:c7:50,bridge_name='br-int',has_traffic_filtering=True,id=3ea23ee8-f2dc-4506-8207-7f2fb70c03b8,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ea23ee8-f2') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:58:34.222848 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:c7:50,bridge_name='br-int',has_traffic_filtering=True,id=3ea23ee8-f2dc-4506-8207-7f2fb70c03b8,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ea23ee8-f2') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:58:34.223200 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:34.223772 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:58:34.226093 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:58:34.228611 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:34.229249 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '727d6944-1910-5c9a-88b2-6215c77ade81', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:58:34.231041 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:34.231661 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:58:34.235247 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:34.235402 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ea23ee8-f2, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:58:34.235810 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3ea23ee8-f2, col_values=(('qos', UUID('2d7c9d7e-7f62-463e-b11f-c6be125ccffb')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:58:34.236010 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3ea23ee8-f2, col_values=(('external_ids', {'iface-id': '3ea23ee8-f2dc-4506-8207-7f2fb70c03b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:c7:50', 'vm-uuid': '5516d92e-c69f-40a2-bb82-a07c1aca64e7'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:58:34.238397 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:34.241201 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:58:34.245689 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:34.246719 np0000001583 nova-compute[98241]: INFO os_vif [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:c7:50,bridge_name='br-int',has_traffic_filtering=True,id=3ea23ee8-f2dc-4506-8207-7f2fb70c03b8,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ea23ee8-f2')
May 28 01:58:34.294305 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659c56a6-743a-45e2-aa21-7d45c672f094/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:34.299302 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659c56a6-743a-45e2-aa21-7d45c672f094/disk.rescue --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:34.419823 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659c56a6-743a-45e2-aa21-7d45c672f094/disk.rescue --force-share --output=json" returned: 0 in 0.120s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:34.419823 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659c56a6-743a-45e2-aa21-7d45c672f094/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:34.528027 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659c56a6-743a-45e2-aa21-7d45c672f094/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:34.528609 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659c56a6-743a-45e2-aa21-7d45c672f094/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:34.570943 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] End _get_guest_xml xml=<domain type="qemu">
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:   <uuid>22bbb8cf-c11d-4025-8551-4c1c3557264a</uuid>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:   <name>instance-00000021</name>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:       <nova:name>multiattach-server-0</nova:name>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:58:34</nova:creationTime>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:         <nova:user uuid="cadb612e41314b06914d5f5f47570e98">tempest-AttachVolumeMultiAttachTest-857456921-project-member</nova:user>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:         <nova:project uuid="0474090f4f2d4950b51bc317f4302266">tempest-AttachVolumeMultiAttachTest-857456921</nova:project>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:         <nova:port uuid="cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b">
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:     <system>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:       <entry name="serial">22bbb8cf-c11d-4025-8551-4c1c3557264a</entry>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:       <entry name="uuid">22bbb8cf-c11d-4025-8551-4c1c3557264a</entry>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:     </system>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:   <os>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:   </os>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:   <features>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:   </features>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:   <devices>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/22bbb8cf-c11d-4025-8551-4c1c3557264a/disk"/>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:     </disk>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/22bbb8cf-c11d-4025-8551-4c1c3557264a/disk.config"/>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:     </disk>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:d3:cd:06"/>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:       <target dev="tapcc6fcb39-fe"/>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:     </interface>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/22bbb8cf-c11d-4025-8551-4c1c3557264a/console.log" append="off"/>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:     </serial>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:     <video>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:     </video>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:     </rng>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:   </devices>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]: </domain>
May 28 01:58:34.570943 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:58:34.570943 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Preparing to wait for external event network-vif-plugged-cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:58:34.570943 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "22bbb8cf-c11d-4025-8551-4c1c3557264a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:34.570943 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "22bbb8cf-c11d-4025-8551-4c1c3557264a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:34.570943 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "22bbb8cf-c11d-4025-8551-4c1c3557264a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:34.573511 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:58:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='multiattach-server-0',id=33,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAP7CI9wuY8JR5OGc0CpqFzQg3rj7cqVgHC4sPYHH38XlmtTRa9WHg3S3WcIsSpd43tWEYYLHF1/yDpoSsozR5Hrjk+cgmLbTDwUHC3YheiC8VnlV/ymBtBFe0b8oxSz5w==',key_name='tempest-keypair-1713929294',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0474090f4f2d4950b51bc317f4302266',ramdisk_id='',reservation_id='r-yz328fm1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-857456921',owner_user_name='tempest-AttachVolumeMultiAttachTest-857456921-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:58:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cadb612e41314b06914d5f5f47570e98',uuid=22bbb8cf-c11d-4025-8551-4c1c3557264a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b", "address": "fa:16:3e:d3:cd:06", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc6fcb39-fe", "ovs_interfaceid": "cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:58:34.573511 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Converting VIF {"id": "cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b", "address": "fa:16:3e:d3:cd:06", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc6fcb39-fe", "ovs_interfaceid": "cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:58:34.575397 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:cd:06,bridge_name='br-int',has_traffic_filtering=True,id=cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc6fcb39-fe') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:58:34.575495 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:cd:06,bridge_name='br-int',has_traffic_filtering=True,id=cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc6fcb39-fe') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:58:34.576325 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:34.577185 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:58:34.577822 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:58:34.582619 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:34.588727 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bddfa800-fefd-5faa-a3bd-6a36fc58bfce', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:58:34.590921 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:58:34.597677 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:34.603449 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:34.603730 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc6fcb39-fe, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:58:34.604240 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcc6fcb39-fe, col_values=(('qos', UUID('1fbd1def-e7d4-4f6c-82c9-41510235ac56')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:58:34.604657 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcc6fcb39-fe, col_values=(('external_ids', {'iface-id': 'cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:cd:06', 'vm-uuid': '22bbb8cf-c11d-4025-8551-4c1c3557264a'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:58:34.607417 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:34.609366 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:58:34.619968 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:34.621586 np0000001583 nova-compute[98241]: INFO os_vif [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:cd:06,bridge_name='br-int',has_traffic_filtering=True,id=cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc6fcb39-fe')
May 28 01:58:34.632098 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933514.631686, 659c56a6-743a-45e2-aa21-7d45c672f094 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:58:34.632317 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] VM Started (Lifecycle Event)
May 28 01:58:34.670125 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659c56a6-743a-45e2-aa21-7d45c672f094/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:34.675955 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:58:34.679687 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:34.679984 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:34.681974 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1100d127-f3d6-416e-a646-b072660980bc/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:34.711304 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:58:34.714355 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Claim successful on node np0000001583
May 28 01:58:34.778223 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1100d127-f3d6-416e-a646-b072660980bc/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:34.778461 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1100d127-f3d6-416e-a646-b072660980bc/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:34.870241 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1100d127-f3d6-416e-a646-b072660980bc/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:34.870770 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/dm-5 (vdb) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:58:34.874159 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668cf051-44c2-4db1-bfd1-dfeed0c6b5a4/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:34.908356 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:34.973510 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668cf051-44c2-4db1-bfd1-dfeed0c6b5a4/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:34.976115 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668cf051-44c2-4db1-bfd1-dfeed0c6b5a4/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:35.073880 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668cf051-44c2-4db1-bfd1-dfeed0c6b5a4/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:35.079057 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:58:35.079633 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:35.134896 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.055s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:35.135369 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Hypervisor/Node resource view: name=np0000001583 free_ram=12702MB free_disk=73.96571731567383GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 01:58:35.135507 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:35.139329 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:58:35.144060 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:58:35.152594 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-5c009af1-683d-46d4-a34b-02a73db0dfe3 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Unrescuing
May 28 01:58:35.152796 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5c009af1-683d-46d4-a34b-02a73db0dfe3 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquiring lock "refresh_cache-659c56a6-743a-45e2-aa21-7d45c672f094" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:58:35.152895 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5c009af1-683d-46d4-a34b-02a73db0dfe3 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquired lock "refresh_cache-659c56a6-743a-45e2-aa21-7d45c672f094" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:58:35.153009 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-5c009af1-683d-46d4-a34b-02a73db0dfe3 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:58:35.646835 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 28 01:58:35.657125 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-5c009af1-683d-46d4-a34b-02a73db0dfe3 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:35.790091 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:58:35.790091 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:58:35.790091 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] No VIF found with MAC fa:16:3e:20:c7:50, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:58:35.790509 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Using config drive
May 28 01:58:35.801735 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-93145528-fb78-4204-af42-a8ba90271bd0 req-b5beb494-d5b7-412b-9350-bbc5260fe87e service nova] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Received event network-vif-plugged-51ab6198-7fa5-4b12-8d53-effcff16e287 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:35.802946 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-93145528-fb78-4204-af42-a8ba90271bd0 req-b5beb494-d5b7-412b-9350-bbc5260fe87e service nova] Acquiring lock "659c56a6-743a-45e2-aa21-7d45c672f094-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:35.802946 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-93145528-fb78-4204-af42-a8ba90271bd0 req-b5beb494-d5b7-412b-9350-bbc5260fe87e service nova] Lock "659c56a6-743a-45e2-aa21-7d45c672f094-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:35.802946 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-93145528-fb78-4204-af42-a8ba90271bd0 req-b5beb494-d5b7-412b-9350-bbc5260fe87e service nova] Lock "659c56a6-743a-45e2-aa21-7d45c672f094-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:35.802946 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-93145528-fb78-4204-af42-a8ba90271bd0 req-b5beb494-d5b7-412b-9350-bbc5260fe87e service nova] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] No waiting events found dispatching network-vif-plugged-51ab6198-7fa5-4b12-8d53-effcff16e287 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:58:35.803352 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-93145528-fb78-4204-af42-a8ba90271bd0 req-b5beb494-d5b7-412b-9350-bbc5260fe87e service nova] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Received unexpected event network-vif-plugged-51ab6198-7fa5-4b12-8d53-effcff16e287 for instance with vm_state rescued and task_state unrescuing.
May 28 01:58:36.184566 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:58:36.184566 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:58:36.184566 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] No VIF found with MAC fa:16:3e:d3:cd:06, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:58:36.184566 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Using config drive
May 28 01:58:36.303782 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:36.407557 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-5c009af1-683d-46d4-a34b-02a73db0dfe3 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:36.421821 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:58:36.422141 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:58:36.542503 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:36.632188 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Creating config drive at /opt/stack/data/nova/instances/5516d92e-c69f-40a2-bb82-a07c1aca64e7/disk.config
May 28 01:58:36.637861 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5516d92e-c69f-40a2-bb82-a07c1aca64e7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmum7c96t {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:36.693897 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:36.721869 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5516d92e-c69f-40a2-bb82-a07c1aca64e7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmum7c96t" returned: 0 in 0.084s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:36.847995 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-5c009af1-683d-46d4-a34b-02a73db0dfe3 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Updating instance_info_cache with network_info: [{"id": "51ab6198-7fa5-4b12-8d53-effcff16e287", "address": "fa:16:3e:ae:1e:12", "network": {"id": "e1d5d073-f27b-4ff1-9ed3-99f57407c76f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f65617e71571457f8906997583100678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ab6198-7f", "ovs_interfaceid": "51ab6198-7fa5-4b12-8d53-effcff16e287", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:58:36.929638 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:58:36.969939 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Creating config drive at /opt/stack/data/nova/instances/22bbb8cf-c11d-4025-8551-4c1c3557264a/disk.config
May 28 01:58:36.977123 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/22bbb8cf-c11d-4025-8551-4c1c3557264a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpla2_4_yf {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:37.037635 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/22bbb8cf-c11d-4025-8551-4c1c3557264a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpla2_4_yf" returned: 0 in 0.060s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:37.352532 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5c009af1-683d-46d4-a34b-02a73db0dfe3 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Releasing lock "refresh_cache-659c56a6-743a-45e2-aa21-7d45c672f094" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:58:37.356720 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:37.359542 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-5c009af1-683d-46d4-a34b-02a73db0dfe3 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lazy-loading 'flavor' on Instance uuid 659c56a6-743a-45e2-aa21-7d45c672f094 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:58:37.393520 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:37.438006 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.758s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:37.440690 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 2.303s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:37.441637 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:58:37.777613 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:37.791401 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:37.799982 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:37.804638 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:37.831472 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:37.842356 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:37.905179 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-02de74a1-55b7-4bb4-b4c8-dce60ff406f2 req-def67f1e-77f0-4fc1-b10f-2bcf3d3a27a7 service nova] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Received event network-vif-plugged-51ab6198-7fa5-4b12-8d53-effcff16e287 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:37.908055 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-02de74a1-55b7-4bb4-b4c8-dce60ff406f2 req-def67f1e-77f0-4fc1-b10f-2bcf3d3a27a7 service nova] Acquiring lock "659c56a6-743a-45e2-aa21-7d45c672f094-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:37.908055 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-02de74a1-55b7-4bb4-b4c8-dce60ff406f2 req-def67f1e-77f0-4fc1-b10f-2bcf3d3a27a7 service nova] Lock "659c56a6-743a-45e2-aa21-7d45c672f094-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:37.908055 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-02de74a1-55b7-4bb4-b4c8-dce60ff406f2 req-def67f1e-77f0-4fc1-b10f-2bcf3d3a27a7 service nova] Lock "659c56a6-743a-45e2-aa21-7d45c672f094-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:37.917870 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-02de74a1-55b7-4bb4-b4c8-dce60ff406f2 req-def67f1e-77f0-4fc1-b10f-2bcf3d3a27a7 service nova] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] No waiting events found dispatching network-vif-plugged-51ab6198-7fa5-4b12-8d53-effcff16e287 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:58:37.917870 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-02de74a1-55b7-4bb4-b4c8-dce60ff406f2 req-def67f1e-77f0-4fc1-b10f-2bcf3d3a27a7 service nova] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Received unexpected event network-vif-plugged-51ab6198-7fa5-4b12-8d53-effcff16e287 for instance with vm_state rescued and task_state unrescuing.
May 28 01:58:37.917870 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:37.930387 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:37.934215 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:37.951063 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:58:37.951176 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:58:37.952145 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:37.958740 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:37.979854 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:38.047884 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '164f3d08de954440bd716afe5eb1054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ce4063a6ac4afdb5ee359a5c1105d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:58:38.109577 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:38.176503 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:38.183906 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:38.275872 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999570409999706 future=<Future at 0x7724ec1edac0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:58:38.283428 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Instance destroyed successfully.
May 28 01:58:38.283891 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-5c009af1-683d-46d4-a34b-02a73db0dfe3 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lazy-loading 'numa_topology' on Instance uuid 659c56a6-743a-45e2-aa21-7d45c672f094 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:58:38.399458 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:38.407942 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:38.464771 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:58:38.538510 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 1100d127-f3d6-416e-a646-b072660980bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:58:38.538510 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 659c56a6-743a-45e2-aa21-7d45c672f094 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:58:38.538510 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 0d87a47f-2eb6-4e25-b44a-848fe2225962 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:58:38.538510 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance e50227a8-b484-447b-abc6-3a3c1379e7ff actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:58:38.538510 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:58:38.538510 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 5516d92e-c69f-40a2-bb82-a07c1aca64e7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:58:38.538510 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 22bbb8cf-c11d-4025-8551-4c1c3557264a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:58:38.538510 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance d4fad20b-d51e-47c9-8f55-3aa085a10891 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:58:38.538510 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 01:58:38.538510 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Final resource view: name=np0000001583 phys_ram=24030MB used_ram=2048MB phys_disk=95GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 01:58:35 up 34 min,  2 users,  load average: 9.59, 7.25, 3.87\n', 'num_instances': '8', 'num_vm_active': '3', 'num_task_None': '5', 'num_os_type_None': '8', 'num_proj_837663bcfa40402aaf583729dfbb26cd': '2', 'io_workload': '3', 'num_vm_rescued': '2', 'num_task_unrescuing': '1', 'num_proj_f65617e71571457f8906997583100678': '2', 'num_proj_0474090f4f2d4950b51bc317f4302266': '2', 'num_vm_building': '3', 'num_task_spawning': '2', 'num_proj_432aa1094ced436494def17a875aa8e1': '1', 'num_proj_04ce4063a6ac4afdb5ee359a5c1105d3': '1'} {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 01:58:38.755643 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Successfully created port: 0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:58:38.791036 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-5c009af1-683d-46d4-a34b-02a73db0dfe3 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Object Instance<659c56a6-743a-45e2-aa21-7d45c672f094> lazy-loaded attributes: flavor,numa_topology {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:58:38.969987 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:58:39.125383 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933519.1248295, 5516d92e-c69f-40a2-bb82-a07c1aca64e7 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:58:39.125487 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] VM Started (Lifecycle Event)
May 28 01:58:39.171434 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:58:39.171667 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:58:39.393947 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:39.423771 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:39.521686 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Successfully updated port: 0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:58:39.551997 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:39.565274 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:39.606789 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:39.629930 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:58:39.635886 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b450d91a-0a88-4f84-81c7-df510d71423b req-8afcbad7-af6d-4daa-9584-e27de6af5c7e service nova] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Received event network-changed-0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:39.638576 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933519.6363175, 5516d92e-c69f-40a2-bb82-a07c1aca64e7 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:58:39.638804 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] VM Paused (Lifecycle Event)
May 28 01:58:39.640716 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b450d91a-0a88-4f84-81c7-df510d71423b req-8afcbad7-af6d-4daa-9584-e27de6af5c7e service nova] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Refreshing instance network info cache due to event network-changed-0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:58:39.640716 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b450d91a-0a88-4f84-81c7-df510d71423b req-8afcbad7-af6d-4daa-9584-e27de6af5c7e service nova] Acquiring lock "refresh_cache-d4fad20b-d51e-47c9-8f55-3aa085a10891" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:58:39.640716 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b450d91a-0a88-4f84-81c7-df510d71423b req-8afcbad7-af6d-4daa-9584-e27de6af5c7e service nova] Acquired lock "refresh_cache-d4fad20b-d51e-47c9-8f55-3aa085a10891" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:58:39.641059 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-b450d91a-0a88-4f84-81c7-df510d71423b req-8afcbad7-af6d-4daa-9584-e27de6af5c7e service nova] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Refreshing network info cache for port 0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:58:39.644269 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:39.676244 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:58:39.985927 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:58:39.989235 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:58:39.989235 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Creating image(s)
May 28 01:58:39.993323 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Acquiring lock "/opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:39.993323 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "/opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:39.993323 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "/opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:39.993323 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:58:40.000381 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:58:40.001777 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:40.019987 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f159a40a-efb3-446a-adc5-48932c7b031a req-f01a0a15-3c50-45ec-a5b8-f8ea8f51d2c7 service nova] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Received event network-vif-unplugged-51ab6198-7fa5-4b12-8d53-effcff16e287 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:40.020493 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f159a40a-efb3-446a-adc5-48932c7b031a req-f01a0a15-3c50-45ec-a5b8-f8ea8f51d2c7 service nova] Acquiring lock "659c56a6-743a-45e2-aa21-7d45c672f094-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:40.021567 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f159a40a-efb3-446a-adc5-48932c7b031a req-f01a0a15-3c50-45ec-a5b8-f8ea8f51d2c7 service nova] Lock "659c56a6-743a-45e2-aa21-7d45c672f094-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:40.022534 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f159a40a-efb3-446a-adc5-48932c7b031a req-f01a0a15-3c50-45ec-a5b8-f8ea8f51d2c7 service nova] Lock "659c56a6-743a-45e2-aa21-7d45c672f094-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:40.022900 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f159a40a-efb3-446a-adc5-48932c7b031a req-f01a0a15-3c50-45ec-a5b8-f8ea8f51d2c7 service nova] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] No waiting events found dispatching network-vif-unplugged-51ab6198-7fa5-4b12-8d53-effcff16e287 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:58:40.023159 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-f159a40a-efb3-446a-adc5-48932c7b031a req-f01a0a15-3c50-45ec-a5b8-f8ea8f51d2c7 service nova] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Received unexpected event network-vif-unplugged-51ab6198-7fa5-4b12-8d53-effcff16e287 for instance with vm_state rescued and task_state unrescuing.
May 28 01:58:40.023357 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f159a40a-efb3-446a-adc5-48932c7b031a req-f01a0a15-3c50-45ec-a5b8-f8ea8f51d2c7 service nova] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Received event network-vif-unplugged-51ab6198-7fa5-4b12-8d53-effcff16e287 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:40.023575 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f159a40a-efb3-446a-adc5-48932c7b031a req-f01a0a15-3c50-45ec-a5b8-f8ea8f51d2c7 service nova] Acquiring lock "659c56a6-743a-45e2-aa21-7d45c672f094-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:40.023801 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f159a40a-efb3-446a-adc5-48932c7b031a req-f01a0a15-3c50-45ec-a5b8-f8ea8f51d2c7 service nova] Lock "659c56a6-743a-45e2-aa21-7d45c672f094-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:40.024019 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f159a40a-efb3-446a-adc5-48932c7b031a req-f01a0a15-3c50-45ec-a5b8-f8ea8f51d2c7 service nova] Lock "659c56a6-743a-45e2-aa21-7d45c672f094-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:40.024269 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f159a40a-efb3-446a-adc5-48932c7b031a req-f01a0a15-3c50-45ec-a5b8-f8ea8f51d2c7 service nova] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] No waiting events found dispatching network-vif-unplugged-51ab6198-7fa5-4b12-8d53-effcff16e287 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:58:40.024485 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-f159a40a-efb3-446a-adc5-48932c7b031a req-f01a0a15-3c50-45ec-a5b8-f8ea8f51d2c7 service nova] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Received unexpected event network-vif-unplugged-51ab6198-7fa5-4b12-8d53-effcff16e287 for instance with vm_state rescued and task_state unrescuing.
May 28 01:58:40.024720 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f159a40a-efb3-446a-adc5-48932c7b031a req-f01a0a15-3c50-45ec-a5b8-f8ea8f51d2c7 service nova] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Received event network-vif-plugged-51ab6198-7fa5-4b12-8d53-effcff16e287 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:40.025171 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f159a40a-efb3-446a-adc5-48932c7b031a req-f01a0a15-3c50-45ec-a5b8-f8ea8f51d2c7 service nova] Acquiring lock "659c56a6-743a-45e2-aa21-7d45c672f094-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:40.025404 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f159a40a-efb3-446a-adc5-48932c7b031a req-f01a0a15-3c50-45ec-a5b8-f8ea8f51d2c7 service nova] Lock "659c56a6-743a-45e2-aa21-7d45c672f094-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:40.025641 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f159a40a-efb3-446a-adc5-48932c7b031a req-f01a0a15-3c50-45ec-a5b8-f8ea8f51d2c7 service nova] Lock "659c56a6-743a-45e2-aa21-7d45c672f094-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:40.025939 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f159a40a-efb3-446a-adc5-48932c7b031a req-f01a0a15-3c50-45ec-a5b8-f8ea8f51d2c7 service nova] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] No waiting events found dispatching network-vif-plugged-51ab6198-7fa5-4b12-8d53-effcff16e287 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:58:40.026172 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-f159a40a-efb3-446a-adc5-48932c7b031a req-f01a0a15-3c50-45ec-a5b8-f8ea8f51d2c7 service nova] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Received unexpected event network-vif-plugged-51ab6198-7fa5-4b12-8d53-effcff16e287 for instance with vm_state rescued and task_state unrescuing.
May 28 01:58:40.028211 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Acquiring lock "refresh_cache-d4fad20b-d51e-47c9-8f55-3aa085a10891" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:58:40.083489 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0004042959999424056 future=<Future at 0x7724f859b680 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:58:40.083562 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:58:40.083686 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=13.19166031099985 future=<Future at 0x7724ec1edac0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:58:40.083755 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=13.191587090999747 future=<Future at 0x7724ec1edac0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:58:40.128582 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.127s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:40.129092 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:40.129588 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:40.130153 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:58:40.134313 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:58:40.134765 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:40.149740 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:58:40.152409 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-b450d91a-0a88-4f84-81c7-df510d71423b req-8afcbad7-af6d-4daa-9584-e27de6af5c7e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:40.166554 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:58:40.190186 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Compute_service record updated for np0000001583:np0000001583 {{(pid=98241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 01:58:40.190536 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.752s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:40.191866 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 39.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:58:40.233920 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-b450d91a-0a88-4f84-81c7-df510d71423b req-8afcbad7-af6d-4daa-9584-e27de6af5c7e service nova] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:58:40.245386 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.111s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:40.245795 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:40.307007 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/disk 1073741824" returned: 0 in 0.061s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:40.308332 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.178s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:40.308446 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:40.394240 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-5c009af1-683d-46d4-a34b-02a73db0dfe3 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:58:40.417609 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.109s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:40.418123 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:58:40.418924 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:40.468481 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-b450d91a-0a88-4f84-81c7-df510d71423b req-8afcbad7-af6d-4daa-9584-e27de6af5c7e service nova] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:58:40.532447 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:40.533091 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Cannot resize image /opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:58:40.533477 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:58:40.533732 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Ensure instance console log exists: /opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:58:40.534059 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:40.535068 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:40.535068 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:40.676177 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:58:40.676177 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933520.6742492, 22bbb8cf-c11d-4025-8551-4c1c3557264a => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:58:40.676177 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] VM Started (Lifecycle Event)
May 28 01:58:40.973422 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b450d91a-0a88-4f84-81c7-df510d71423b req-8afcbad7-af6d-4daa-9584-e27de6af5c7e service nova] Releasing lock "refresh_cache-d4fad20b-d51e-47c9-8f55-3aa085a10891" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:58:40.973422 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Acquired lock "refresh_cache-d4fad20b-d51e-47c9-8f55-3aa085a10891" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:58:40.973422 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:58:41.181904 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:58:41.185996 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933521.185655, 22bbb8cf-c11d-4025-8551-4c1c3557264a => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:58:41.187485 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] VM Paused (Lifecycle Event)
May 28 01:58:41.563119 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:58:41.626165 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:41.689070 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:58:41.694770 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:58:42.694543 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:42.694543 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Updating instance_info_cache with network_info: [{"id": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "address": "fa:16:3e:ca:8c:e2", "network": {"id": "d4bf7f94-4ac7-4145-be11-d2aeeafb6c02", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-972487534-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "04ce4063a6ac4afdb5ee359a5c1105d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e39a69e-35", "ovs_interfaceid": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:58:42.694543 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-14f65362-b4e6-4502-b035-b9abf2dffc77 req-b701facd-0bca-4f73-8bcf-cddfe51e68f5 service nova] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Received event network-vif-plugged-51ab6198-7fa5-4b12-8d53-effcff16e287 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:42.694543 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-14f65362-b4e6-4502-b035-b9abf2dffc77 req-b701facd-0bca-4f73-8bcf-cddfe51e68f5 service nova] Acquiring lock "659c56a6-743a-45e2-aa21-7d45c672f094-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:42.694543 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-14f65362-b4e6-4502-b035-b9abf2dffc77 req-b701facd-0bca-4f73-8bcf-cddfe51e68f5 service nova] Lock "659c56a6-743a-45e2-aa21-7d45c672f094-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:42.694543 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-14f65362-b4e6-4502-b035-b9abf2dffc77 req-b701facd-0bca-4f73-8bcf-cddfe51e68f5 service nova] Lock "659c56a6-743a-45e2-aa21-7d45c672f094-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:42.694543 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-14f65362-b4e6-4502-b035-b9abf2dffc77 req-b701facd-0bca-4f73-8bcf-cddfe51e68f5 service nova] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] No waiting events found dispatching network-vif-plugged-51ab6198-7fa5-4b12-8d53-effcff16e287 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:58:42.694543 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-14f65362-b4e6-4502-b035-b9abf2dffc77 req-b701facd-0bca-4f73-8bcf-cddfe51e68f5 service nova] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Received unexpected event network-vif-plugged-51ab6198-7fa5-4b12-8d53-effcff16e287 for instance with vm_state active and task_state None.
May 28 01:58:42.694543 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:58:42.694543 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Removed pending STOPPED event for 659c56a6-743a-45e2-aa21-7d45c672f094 due to new event <LifecycleEvent: 1779933522.2062905, 659c56a6-743a-45e2-aa21-7d45c672f094 => Resumed> {{(pid=98241) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 01:58:42.694543 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933522.2062905, 659c56a6-743a-45e2-aa21-7d45c672f094 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:58:42.694543 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] VM Resumed (Lifecycle Event)
May 28 01:58:42.694543 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:42.694543 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Releasing lock "refresh_cache-d4fad20b-d51e-47c9-8f55-3aa085a10891" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:58:42.694543 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Instance network_info: |[{"id": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "address": "fa:16:3e:ca:8c:e2", "network": {"id": "d4bf7f94-4ac7-4145-be11-d2aeeafb6c02", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-972487534-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "04ce4063a6ac4afdb5ee359a5c1105d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e39a69e-35", "ovs_interfaceid": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:58:42.694543 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Start _get_guest_xml network_info=[{"id": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "address": "fa:16:3e:ca:8c:e2", "network": {"id": "d4bf7f94-4ac7-4145-be11-d2aeeafb6c02", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-972487534-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "04ce4063a6ac4afdb5ee359a5c1105d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e39a69e-35", "ovs_interfaceid": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:58:42.694543 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:58:42.694543 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-522410549', uuid='d4fad20b-d51e-47c9-8f55-3aa085a10891'), owner=OwnerMeta(userid='164f3d08de954440bd716afe5eb1054a', username='tempest-AttachVolumeTestJSON-1276932129-project-member', projectid='04ce4063a6ac4afdb5ee359a5c1105d3', projectname='tempest-AttachVolumeTestJSON-1276932129'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "address": "fa:16:3e:ca:8c:e2", "network": {"id": "d4bf7f94-4ac7-4145-be11-d2aeeafb6c02", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-972487534-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "04ce4063a6ac4afdb5ee359a5c1105d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e39a69e-35", "ovs_interfaceid": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933522.5807745) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:58:42.694543 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:58:42.694543 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:58:42.694543 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:58:42.694543 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:58:42.694543 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:58:42.698374 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:58:42.698374 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:58:42.698374 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:58:42.698374 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:58:42.698374 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:58:42.698374 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:58:42.698374 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:58:42.698374 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:58:42.698374 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:58:42.698374 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:58:42.698374 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:58:42.698374 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:58:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-522410549',display_name='tempest-AttachVolumeTestJSON-server-522410549',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-attachvolumetestjson-server-522410549',id=34,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/SX3aLhOteyGwrFqR0CEL4C04Fp6fWjwsBRpIz44V+NdHV7WRnAaFAuCSewkCiCwsHBAYVT3CCSkcBu9Z5deiFWGGYvkB/zQRpMDdHuyRrvPU5bkBQzk+aQ10B/g2ZJA==',key_name='tempest-keypair-487865295',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04ce4063a6ac4afdb5ee359a5c1105d3',ramdisk_id='',reservation_id='r-q0lo3p0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1276932129',owner_user_name='tempest-AttachVolumeTestJSON-1276932129-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:58:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='164f3d08de954440bd716afe5eb1054a',uuid=d4fad20b-d51e-47c9-8f55-3aa085a10891,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "address": "fa:16:3e:ca:8c:e2", "network": {"id": "d4bf7f94-4ac7-4145-be11-d2aeeafb6c02", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-972487534-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "04ce4063a6ac4afdb5ee359a5c1105d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e39a69e-35", "ovs_interfaceid": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:58:42.698374 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Converting VIF {"id": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "address": "fa:16:3e:ca:8c:e2", "network": {"id": "d4bf7f94-4ac7-4145-be11-d2aeeafb6c02", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-972487534-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "04ce4063a6ac4afdb5ee359a5c1105d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e39a69e-35", "ovs_interfaceid": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:58:42.698374 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:8c:e2,bridge_name='br-int',has_traffic_filtering=True,id=0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b,network=Network(d4bf7f94-4ac7-4145-be11-d2aeeafb6c02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e39a69e-35') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:58:42.698374 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lazy-loading 'pci_devices' on Instance uuid d4fad20b-d51e-47c9-8f55-3aa085a10891 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:58:42.710182 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:58:42.716943 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:58:43.109849 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] End _get_guest_xml xml=<domain type="qemu">
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:   <uuid>d4fad20b-d51e-47c9-8f55-3aa085a10891</uuid>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:   <name>instance-00000022</name>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:       <nova:name>tempest-AttachVolumeTestJSON-server-522410549</nova:name>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:58:42</nova:creationTime>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:         <nova:user uuid="164f3d08de954440bd716afe5eb1054a">tempest-AttachVolumeTestJSON-1276932129-project-member</nova:user>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:         <nova:project uuid="04ce4063a6ac4afdb5ee359a5c1105d3">tempest-AttachVolumeTestJSON-1276932129</nova:project>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:         <nova:port uuid="0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b">
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:     <system>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:       <entry name="serial">d4fad20b-d51e-47c9-8f55-3aa085a10891</entry>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:       <entry name="uuid">d4fad20b-d51e-47c9-8f55-3aa085a10891</entry>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:     </system>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:   <os>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:   </os>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:   <features>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:   </features>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:   <devices>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/disk"/>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:     </disk>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/disk.config"/>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:     </disk>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:ca:8c:e2"/>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:       <target dev="tap0e39a69e-35"/>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:     </interface>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/console.log" append="off"/>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:     </serial>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:     <video>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:     </video>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:     </rng>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:   </devices>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]: </domain>
May 28 01:58:43.109849 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:58:43.112996 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Preparing to wait for external event network-vif-plugged-0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:58:43.112996 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Acquiring lock "d4fad20b-d51e-47c9-8f55-3aa085a10891-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:43.112996 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "d4fad20b-d51e-47c9-8f55-3aa085a10891-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:43.112996 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "d4fad20b-d51e-47c9-8f55-3aa085a10891-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:43.112996 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:58:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-522410549',display_name='tempest-AttachVolumeTestJSON-server-522410549',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-attachvolumetestjson-server-522410549',id=34,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/SX3aLhOteyGwrFqR0CEL4C04Fp6fWjwsBRpIz44V+NdHV7WRnAaFAuCSewkCiCwsHBAYVT3CCSkcBu9Z5deiFWGGYvkB/zQRpMDdHuyRrvPU5bkBQzk+aQ10B/g2ZJA==',key_name='tempest-keypair-487865295',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04ce4063a6ac4afdb5ee359a5c1105d3',ramdisk_id='',reservation_id='r-q0lo3p0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1276932129',owner_user_name='tempest-AttachVolumeTestJSON-1276932129-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:58:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='164f3d08de954440bd716afe5eb1054a',uuid=d4fad20b-d51e-47c9-8f55-3aa085a10891,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "address": "fa:16:3e:ca:8c:e2", "network": {"id": "d4bf7f94-4ac7-4145-be11-d2aeeafb6c02", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-972487534-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "04ce4063a6ac4afdb5ee359a5c1105d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e39a69e-35", "ovs_interfaceid": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:58:43.112996 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Converting VIF {"id": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "address": "fa:16:3e:ca:8c:e2", "network": {"id": "d4bf7f94-4ac7-4145-be11-d2aeeafb6c02", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-972487534-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "04ce4063a6ac4afdb5ee359a5c1105d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e39a69e-35", "ovs_interfaceid": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:58:43.112996 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:8c:e2,bridge_name='br-int',has_traffic_filtering=True,id=0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b,network=Network(d4bf7f94-4ac7-4145-be11-d2aeeafb6c02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e39a69e-35') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:58:43.113878 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:8c:e2,bridge_name='br-int',has_traffic_filtering=True,id=0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b,network=Network(d4bf7f94-4ac7-4145-be11-d2aeeafb6c02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e39a69e-35') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:58:43.114967 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:43.115315 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:58:43.115600 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:58:43.116678 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:43.116929 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ba3c78f9-de7a-55b7-bdb7-031dda98db4b', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:58:43.119440 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:43.120293 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:58:43.122188 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:43.128306 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:43.128507 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0e39a69e-35, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:58:43.129014 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0e39a69e-35, col_values=(('qos', UUID('c9846ad9-5206-4ca5-aa8c-b8f05cb7cf31')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:58:43.129102 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0e39a69e-35, col_values=(('external_ids', {'iface-id': '0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:8c:e2', 'vm-uuid': 'd4fad20b-d51e-47c9-8f55-3aa085a10891'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:58:43.133774 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:43.135292 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:58:43.141565 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:43.142751 np0000001583 nova-compute[98241]: INFO os_vif [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:8c:e2,bridge_name='br-int',has_traffic_filtering=True,id=0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b,network=Network(d4bf7f94-4ac7-4145-be11-d2aeeafb6c02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e39a69e-35')
May 28 01:58:43.225617 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933523.2251883, 659c56a6-743a-45e2-aa21-7d45c672f094 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:58:43.225866 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] VM Started (Lifecycle Event)
May 28 01:58:43.728390 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:58:43.730241 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:58:44.075768 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-c7ead04c-f0a4-404c-b838-b8225b92574b req-305618ad-6c48-4cf7-b926-f263917065ac service nova] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Received event network-vif-plugged-3ea23ee8-f2dc-4506-8207-7f2fb70c03b8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:44.075923 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c7ead04c-f0a4-404c-b838-b8225b92574b req-305618ad-6c48-4cf7-b926-f263917065ac service nova] Acquiring lock "5516d92e-c69f-40a2-bb82-a07c1aca64e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:44.076138 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c7ead04c-f0a4-404c-b838-b8225b92574b req-305618ad-6c48-4cf7-b926-f263917065ac service nova] Lock "5516d92e-c69f-40a2-bb82-a07c1aca64e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:44.076322 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c7ead04c-f0a4-404c-b838-b8225b92574b req-305618ad-6c48-4cf7-b926-f263917065ac service nova] Lock "5516d92e-c69f-40a2-bb82-a07c1aca64e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:44.076510 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-c7ead04c-f0a4-404c-b838-b8225b92574b req-305618ad-6c48-4cf7-b926-f263917065ac service nova] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Processing event network-vif-plugged-3ea23ee8-f2dc-4506-8207-7f2fb70c03b8 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:58:44.077339 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Instance event wait completed in 4 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:58:44.080497 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:58:44.083767 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Instance spawned successfully.
May 28 01:58:44.084140 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:58:44.232889 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933524.2325013, 5516d92e-c69f-40a2-bb82-a07c1aca64e7 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:58:44.233040 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] VM Resumed (Lifecycle Event)
May 28 01:58:44.594484 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:58:44.595302 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:58:44.596066 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:58:44.596369 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:58:44.597930 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:58:44.599116 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:58:44.665058 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:58:44.665289 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:58:44.665473 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] No VIF found with MAC fa:16:3e:ca:8c:e2, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:58:44.666039 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Using config drive
May 28 01:58:44.735895 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:58:44.739964 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:58:45.058732 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquiring lock "27c37404-4df0-4ded-bf5b-6002e26d4222" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:45.059055 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "27c37404-4df0-4ded-bf5b-6002e26d4222" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:45.109401 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Took 16.15 seconds to spawn the instance on the hypervisor.
May 28 01:58:45.109641 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:58:45.181956 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:45.244572 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:58:45.298503 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Acquiring lock "63688346-f8e2-4fbe-987d-bf55df9fa3a4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:45.300616 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "63688346-f8e2-4fbe-987d-bf55df9fa3a4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:45.356366 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Creating config drive at /opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/disk.config
May 28 01:58:45.361023 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqu9ozi10 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:45.433000 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqu9ozi10" returned: 0 in 0.071s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:45.563273 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:58:45.629861 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Took 23.79 seconds to build instance.
May 28 01:58:45.806151 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:58:45.929230 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:45.965388 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:46.067827 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:46.131738 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2c3cf624-3aa7-4bad-93a0-91f77b05875d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "5516d92e-c69f-40a2-bb82-a07c1aca64e7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.307s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:46.147122 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:46.147248 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:46.161179 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:58:46.161179 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Claim successful on node np0000001583
May 28 01:58:46.207047 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9778449a-3b26-4ba5-8d1a-e17daff6d7b4 req-46c4a818-2095-465f-86e0-b59267e20714 service nova] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Received event network-vif-plugged-3ea23ee8-f2dc-4506-8207-7f2fb70c03b8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:46.207344 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9778449a-3b26-4ba5-8d1a-e17daff6d7b4 req-46c4a818-2095-465f-86e0-b59267e20714 service nova] Acquiring lock "5516d92e-c69f-40a2-bb82-a07c1aca64e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:46.207551 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9778449a-3b26-4ba5-8d1a-e17daff6d7b4 req-46c4a818-2095-465f-86e0-b59267e20714 service nova] Lock "5516d92e-c69f-40a2-bb82-a07c1aca64e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:46.207711 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9778449a-3b26-4ba5-8d1a-e17daff6d7b4 req-46c4a818-2095-465f-86e0-b59267e20714 service nova] Lock "5516d92e-c69f-40a2-bb82-a07c1aca64e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:46.207832 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9778449a-3b26-4ba5-8d1a-e17daff6d7b4 req-46c4a818-2095-465f-86e0-b59267e20714 service nova] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] No waiting events found dispatching network-vif-plugged-3ea23ee8-f2dc-4506-8207-7f2fb70c03b8 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:58:46.207986 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-9778449a-3b26-4ba5-8d1a-e17daff6d7b4 req-46c4a818-2095-465f-86e0-b59267e20714 service nova] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Received unexpected event network-vif-plugged-3ea23ee8-f2dc-4506-8207-7f2fb70c03b8 for instance with vm_state active and task_state None.
May 28 01:58:46.209139 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9778449a-3b26-4ba5-8d1a-e17daff6d7b4 req-46c4a818-2095-465f-86e0-b59267e20714 service nova] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Received event network-vif-plugged-cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:46.209139 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9778449a-3b26-4ba5-8d1a-e17daff6d7b4 req-46c4a818-2095-465f-86e0-b59267e20714 service nova] Acquiring lock "22bbb8cf-c11d-4025-8551-4c1c3557264a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:46.209139 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9778449a-3b26-4ba5-8d1a-e17daff6d7b4 req-46c4a818-2095-465f-86e0-b59267e20714 service nova] Lock "22bbb8cf-c11d-4025-8551-4c1c3557264a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:46.209139 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9778449a-3b26-4ba5-8d1a-e17daff6d7b4 req-46c4a818-2095-465f-86e0-b59267e20714 service nova] Lock "22bbb8cf-c11d-4025-8551-4c1c3557264a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:46.209139 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9778449a-3b26-4ba5-8d1a-e17daff6d7b4 req-46c4a818-2095-465f-86e0-b59267e20714 service nova] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Processing event network-vif-plugged-cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:58:46.209426 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9778449a-3b26-4ba5-8d1a-e17daff6d7b4 req-46c4a818-2095-465f-86e0-b59267e20714 service nova] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Received event network-vif-plugged-cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:46.209461 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9778449a-3b26-4ba5-8d1a-e17daff6d7b4 req-46c4a818-2095-465f-86e0-b59267e20714 service nova] Acquiring lock "22bbb8cf-c11d-4025-8551-4c1c3557264a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:46.209655 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9778449a-3b26-4ba5-8d1a-e17daff6d7b4 req-46c4a818-2095-465f-86e0-b59267e20714 service nova] Lock "22bbb8cf-c11d-4025-8551-4c1c3557264a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:46.209819 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9778449a-3b26-4ba5-8d1a-e17daff6d7b4 req-46c4a818-2095-465f-86e0-b59267e20714 service nova] Lock "22bbb8cf-c11d-4025-8551-4c1c3557264a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:46.210060 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9778449a-3b26-4ba5-8d1a-e17daff6d7b4 req-46c4a818-2095-465f-86e0-b59267e20714 service nova] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] No waiting events found dispatching network-vif-plugged-cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:58:46.210177 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-9778449a-3b26-4ba5-8d1a-e17daff6d7b4 req-46c4a818-2095-465f-86e0-b59267e20714 service nova] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Received unexpected event network-vif-plugged-cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b for instance with vm_state building and task_state spawning.
May 28 01:58:46.211712 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9778449a-3b26-4ba5-8d1a-e17daff6d7b4 req-46c4a818-2095-465f-86e0-b59267e20714 service nova] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Received event network-vif-unplugged-0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:46.211712 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9778449a-3b26-4ba5-8d1a-e17daff6d7b4 req-46c4a818-2095-465f-86e0-b59267e20714 service nova] Acquiring lock "d4fad20b-d51e-47c9-8f55-3aa085a10891-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:46.211712 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9778449a-3b26-4ba5-8d1a-e17daff6d7b4 req-46c4a818-2095-465f-86e0-b59267e20714 service nova] Lock "d4fad20b-d51e-47c9-8f55-3aa085a10891-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:46.211712 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Instance event wait completed in 6 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:58:46.211861 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9778449a-3b26-4ba5-8d1a-e17daff6d7b4 req-46c4a818-2095-465f-86e0-b59267e20714 service nova] Lock "d4fad20b-d51e-47c9-8f55-3aa085a10891-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:46.212141 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9778449a-3b26-4ba5-8d1a-e17daff6d7b4 req-46c4a818-2095-465f-86e0-b59267e20714 service nova] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] No event matching network-vif-unplugged-0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b in dict_keys([('network-vif-plugged', '0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b')]) {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 01:58:46.212234 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-9778449a-3b26-4ba5-8d1a-e17daff6d7b4 req-46c4a818-2095-465f-86e0-b59267e20714 service nova] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Received unexpected event network-vif-unplugged-0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b for instance with vm_state building and task_state spawning.
May 28 01:58:46.216838 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933526.214936, 22bbb8cf-c11d-4025-8551-4c1c3557264a => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:58:46.216838 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] VM Resumed (Lifecycle Event)
May 28 01:58:46.220024 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:58:46.226353 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Instance spawned successfully.
May 28 01:58:46.227103 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:58:46.385612 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:46.389131 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:46.416401 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:46.539208 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Acquiring lock "8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:46.539461 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:46.720841 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:58:46.725447 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:58:46.739050 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:58:46.739270 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:58:46.739646 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:58:46.740199 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:58:46.740356 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:58:46.740654 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:58:47.041613 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:58:47.230162 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:58:47.230860 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933527.2306492, d4fad20b-d51e-47c9-8f55-3aa085a10891 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:58:47.231065 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] VM Started (Lifecycle Event)
May 28 01:58:47.248903 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Took 17.61 seconds to spawn the instance on the hypervisor.
May 28 01:58:47.249303 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:58:47.487048 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-6d1d4899-b8db-427d-938b-3bc30889acda req-7427836c-b056-4b5c-87c3-4133f92c8b8a service nova] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Received event network-changed-3ea23ee8-f2dc-4506-8207-7f2fb70c03b8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:47.487048 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-6d1d4899-b8db-427d-938b-3bc30889acda req-7427836c-b056-4b5c-87c3-4133f92c8b8a service nova] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Refreshing instance network info cache due to event network-changed-3ea23ee8-f2dc-4506-8207-7f2fb70c03b8. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:58:47.487048 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-6d1d4899-b8db-427d-938b-3bc30889acda req-7427836c-b056-4b5c-87c3-4133f92c8b8a service nova] Acquiring lock "refresh_cache-5516d92e-c69f-40a2-bb82-a07c1aca64e7" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:58:47.487048 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-6d1d4899-b8db-427d-938b-3bc30889acda req-7427836c-b056-4b5c-87c3-4133f92c8b8a service nova] Acquired lock "refresh_cache-5516d92e-c69f-40a2-bb82-a07c1aca64e7" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:58:47.487048 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-6d1d4899-b8db-427d-938b-3bc30889acda req-7427836c-b056-4b5c-87c3-4133f92c8b8a service nova] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Refreshing network info cache for port 3ea23ee8-f2dc-4506-8207-7f2fb70c03b8 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:58:47.629855 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:47.737938 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:58:47.741241 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933527.7409785, d4fad20b-d51e-47c9-8f55-3aa085a10891 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:58:47.742424 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] VM Paused (Lifecycle Event)
May 28 01:58:47.758025 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Took 25.30 seconds to build instance.
May 28 01:58:47.875728 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:58:47.876293 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:58:47.989234 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-6d1d4899-b8db-427d-938b-3bc30889acda req-7427836c-b056-4b5c-87c3-4133f92c8b8a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:48.126094 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:48.134062 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:48.244676 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:58:48.249463 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:58:48.265965 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fd362821-32bf-4e21-a79f-8dd34b5d6b50 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "22bbb8cf-c11d-4025-8551-4c1c3557264a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.829s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:48.293821 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f2593680-4782-49cc-97c7-4c0a8f14f8d6 req-67614dc4-8aa1-4ca6-9fd9-abf0de56d23f service nova] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Received event network-vif-plugged-0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:48.293821 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f2593680-4782-49cc-97c7-4c0a8f14f8d6 req-67614dc4-8aa1-4ca6-9fd9-abf0de56d23f service nova] Acquiring lock "d4fad20b-d51e-47c9-8f55-3aa085a10891-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:48.294753 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f2593680-4782-49cc-97c7-4c0a8f14f8d6 req-67614dc4-8aa1-4ca6-9fd9-abf0de56d23f service nova] Lock "d4fad20b-d51e-47c9-8f55-3aa085a10891-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:48.296889 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f2593680-4782-49cc-97c7-4c0a8f14f8d6 req-67614dc4-8aa1-4ca6-9fd9-abf0de56d23f service nova] Lock "d4fad20b-d51e-47c9-8f55-3aa085a10891-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:48.298735 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f2593680-4782-49cc-97c7-4c0a8f14f8d6 req-67614dc4-8aa1-4ca6-9fd9-abf0de56d23f service nova] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Processing event network-vif-plugged-0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:58:48.299027 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f2593680-4782-49cc-97c7-4c0a8f14f8d6 req-67614dc4-8aa1-4ca6-9fd9-abf0de56d23f service nova] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Received event network-vif-plugged-0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:48.299743 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:58:48.299962 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f2593680-4782-49cc-97c7-4c0a8f14f8d6 req-67614dc4-8aa1-4ca6-9fd9-abf0de56d23f service nova] Acquiring lock "d4fad20b-d51e-47c9-8f55-3aa085a10891-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:48.300204 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f2593680-4782-49cc-97c7-4c0a8f14f8d6 req-67614dc4-8aa1-4ca6-9fd9-abf0de56d23f service nova] Lock "d4fad20b-d51e-47c9-8f55-3aa085a10891-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:48.300350 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f2593680-4782-49cc-97c7-4c0a8f14f8d6 req-67614dc4-8aa1-4ca6-9fd9-abf0de56d23f service nova] Lock "d4fad20b-d51e-47c9-8f55-3aa085a10891-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:48.300508 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f2593680-4782-49cc-97c7-4c0a8f14f8d6 req-67614dc4-8aa1-4ca6-9fd9-abf0de56d23f service nova] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] No waiting events found dispatching network-vif-plugged-0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:58:48.300645 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-f2593680-4782-49cc-97c7-4c0a8f14f8d6 req-67614dc4-8aa1-4ca6-9fd9-abf0de56d23f service nova] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Received unexpected event network-vif-plugged-0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b for instance with vm_state building and task_state spawning.
May 28 01:58:48.302867 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:58:48.304891 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Instance spawned successfully.
May 28 01:58:48.305287 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:58:48.380192 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:58:48.397419 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-6d1d4899-b8db-427d-938b-3bc30889acda req-7427836c-b056-4b5c-87c3-4133f92c8b8a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:48.535225 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-cf2f4c22-7fbe-455c-92b2-22e4c736e952 req-94d40ff3-e531-42f8-bdef-3b933df2b517 service nova] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Received event network-changed-cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:48.535402 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-cf2f4c22-7fbe-455c-92b2-22e4c736e952 req-94d40ff3-e531-42f8-bdef-3b933df2b517 service nova] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Refreshing instance network info cache due to event network-changed-cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:58:48.535710 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-cf2f4c22-7fbe-455c-92b2-22e4c736e952 req-94d40ff3-e531-42f8-bdef-3b933df2b517 service nova] Acquiring lock "refresh_cache-22bbb8cf-c11d-4025-8551-4c1c3557264a" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:58:48.535942 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-cf2f4c22-7fbe-455c-92b2-22e4c736e952 req-94d40ff3-e531-42f8-bdef-3b933df2b517 service nova] Acquired lock "refresh_cache-22bbb8cf-c11d-4025-8551-4c1c3557264a" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:58:48.536271 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-cf2f4c22-7fbe-455c-92b2-22e4c736e952 req-94d40ff3-e531-42f8-bdef-3b933df2b517 service nova] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Refreshing network info cache for port cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:58:48.594186 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-6d1d4899-b8db-427d-938b-3bc30889acda req-7427836c-b056-4b5c-87c3-4133f92c8b8a service nova] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Updated VIF entry in instance network info cache for port 3ea23ee8-f2dc-4506-8207-7f2fb70c03b8. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:58:48.595859 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-6d1d4899-b8db-427d-938b-3bc30889acda req-7427836c-b056-4b5c-87c3-4133f92c8b8a service nova] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Updating instance_info_cache with network_info: [{"id": "3ea23ee8-f2dc-4506-8207-7f2fb70c03b8", "address": "fa:16:3e:20:c7:50", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ea23ee8-f2", "ovs_interfaceid": "3ea23ee8-f2dc-4506-8207-7f2fb70c03b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:58:48.757310 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:58:48.757628 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933528.7574172, d4fad20b-d51e-47c9-8f55-3aa085a10891 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:58:48.757771 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] VM Resumed (Lifecycle Event)
May 28 01:58:48.815063 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:58:48.815325 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:58:48.815625 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:58:48.815903 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:58:48.816273 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:58:48.816547 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:58:48.887431 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.740s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:48.887927 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:58:48.890456 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.506s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:48.896134 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:58:48.896502 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Claim successful on node np0000001583
May 28 01:58:49.042110 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-cf2f4c22-7fbe-455c-92b2-22e4c736e952 req-94d40ff3-e531-42f8-bdef-3b933df2b517 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:49.097028 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-6d1d4899-b8db-427d-938b-3bc30889acda req-7427836c-b056-4b5c-87c3-4133f92c8b8a service nova] Releasing lock "refresh_cache-5516d92e-c69f-40a2-bb82-a07c1aca64e7" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:58:49.260632 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:58:49.265377 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:58:49.322423 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Took 9.34 seconds to spawn the instance on the hypervisor.
May 28 01:58:49.327233 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:58:49.408241 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:58:49.408601 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:58:49.409143 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:49.410009 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:49.487367 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-cf2f4c22-7fbe-455c-92b2-22e4c736e952 req-94d40ff3-e531-42f8-bdef-3b933df2b517 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:49.514682 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '435dfce8f05e4e01b380797bd07bd4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65617e71571457f8906997583100678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:58:49.731879 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-cf2f4c22-7fbe-455c-92b2-22e4c736e952 req-94d40ff3-e531-42f8-bdef-3b933df2b517 service nova] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Updated VIF entry in instance network info cache for port cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:58:49.732550 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-cf2f4c22-7fbe-455c-92b2-22e4c736e952 req-94d40ff3-e531-42f8-bdef-3b933df2b517 service nova] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Updating instance_info_cache with network_info: [{"id": "cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b", "address": "fa:16:3e:d3:cd:06", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc6fcb39-fe", "ovs_interfaceid": "cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:58:49.769322 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:58:49.844216 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Took 15.26 seconds to build instance.
May 28 01:58:49.914477 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:58:50.228449 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "e3e9a0d0-72cd-459e-8bc4-cf080adb5267" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:50.228620 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "e3e9a0d0-72cd-459e-8bc4-cf080adb5267" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:50.237180 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-cf2f4c22-7fbe-455c-92b2-22e4c736e952 req-94d40ff3-e531-42f8-bdef-3b933df2b517 service nova] Releasing lock "refresh_cache-22bbb8cf-c11d-4025-8551-4c1c3557264a" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:58:50.298500 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Successfully created port: 967dfb76-814b-43ba-ba2b-c14f407ff45e {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:58:50.348157 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "d4fad20b-d51e-47c9-8f55-3aa085a10891" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.786s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:50.421097 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:58:50.736116 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:58:50.763302 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:58:50.763706 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:58:51.058405 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Successfully updated port: 967dfb76-814b-43ba-ba2b-c14f407ff45e {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:58:51.126483 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-6f2a2422-d94d-419f-9f60-85696e30280e req-f69c8f1b-a551-46d7-a61f-921a07dbedc5 service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Received event network-changed-967dfb76-814b-43ba-ba2b-c14f407ff45e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:51.128183 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-6f2a2422-d94d-419f-9f60-85696e30280e req-f69c8f1b-a551-46d7-a61f-921a07dbedc5 service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Refreshing instance network info cache due to event network-changed-967dfb76-814b-43ba-ba2b-c14f407ff45e. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:58:51.128183 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-6f2a2422-d94d-419f-9f60-85696e30280e req-f69c8f1b-a551-46d7-a61f-921a07dbedc5 service nova] Acquiring lock "refresh_cache-27c37404-4df0-4ded-bf5b-6002e26d4222" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:58:51.128183 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-6f2a2422-d94d-419f-9f60-85696e30280e req-f69c8f1b-a551-46d7-a61f-921a07dbedc5 service nova] Acquired lock "refresh_cache-27c37404-4df0-4ded-bf5b-6002e26d4222" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:58:51.128183 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-6f2a2422-d94d-419f-9f60-85696e30280e req-f69c8f1b-a551-46d7-a61f-921a07dbedc5 service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Refreshing network info cache for port 967dfb76-814b-43ba-ba2b-c14f407ff45e {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:58:51.133150 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-192a2260-9748-49dc-a2c1-47645ba3c27c req-4d044ed1-4e60-481d-bc90-3f2748b22768 service nova] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Received event network-changed-0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:51.133759 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-192a2260-9748-49dc-a2c1-47645ba3c27c req-4d044ed1-4e60-481d-bc90-3f2748b22768 service nova] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Refreshing instance network info cache due to event network-changed-0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:58:51.134223 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-192a2260-9748-49dc-a2c1-47645ba3c27c req-4d044ed1-4e60-481d-bc90-3f2748b22768 service nova] Acquiring lock "refresh_cache-d4fad20b-d51e-47c9-8f55-3aa085a10891" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:58:51.134604 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-192a2260-9748-49dc-a2c1-47645ba3c27c req-4d044ed1-4e60-481d-bc90-3f2748b22768 service nova] Acquired lock "refresh_cache-d4fad20b-d51e-47c9-8f55-3aa085a10891" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:58:51.134604 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-192a2260-9748-49dc-a2c1-47645ba3c27c req-4d044ed1-4e60-481d-bc90-3f2748b22768 service nova] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Refreshing network info cache for port 0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:58:51.269711 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:58:51.319307 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:51.433960 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:58:51.436229 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:58:51.436614 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Creating image(s)
May 28 01:58:51.437337 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquiring lock "/opt/stack/data/nova/instances/27c37404-4df0-4ded-bf5b-6002e26d4222/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:51.438698 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "/opt/stack/data/nova/instances/27c37404-4df0-4ded-bf5b-6002e26d4222/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:51.438698 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "/opt/stack/data/nova/instances/27c37404-4df0-4ded-bf5b-6002e26d4222/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:51.439449 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:58:51.442901 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:58:51.445411 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:51.560474 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.115s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:51.561011 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:51.561678 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:51.562342 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:58:51.567957 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquiring lock "refresh_cache-27c37404-4df0-4ded-bf5b-6002e26d4222" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:58:51.572464 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:58:51.573050 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:51.640378 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-192a2260-9748-49dc-a2c1-47645ba3c27c req-4d044ed1-4e60-481d-bc90-3f2748b22768 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:51.646244 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-6f2a2422-d94d-419f-9f60-85696e30280e req-f69c8f1b-a551-46d7-a61f-921a07dbedc5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:51.692769 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.119s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:51.693381 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/27c37404-4df0-4ded-bf5b-6002e26d4222/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:51.760828 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/27c37404-4df0-4ded-bf5b-6002e26d4222/disk 1073741824" returned: 0 in 0.067s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:51.761661 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:51.762022 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:51.788561 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.900s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:51.789344 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:58:51.797539 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 4.160s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:51.801390 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-6f2a2422-d94d-419f-9f60-85696e30280e req-f69c8f1b-a551-46d7-a61f-921a07dbedc5 service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:58:51.814376 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:58:51.814572 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Claim successful on node np0000001583
May 28 01:58:51.889127 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.124s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:51.891113 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Checking if we can resize image /opt/stack/data/nova/instances/27c37404-4df0-4ded-bf5b-6002e26d4222/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:58:51.891113 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27c37404-4df0-4ded-bf5b-6002e26d4222/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:52.036947 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27c37404-4df0-4ded-bf5b-6002e26d4222/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:52.037651 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Cannot resize image /opt/stack/data/nova/instances/27c37404-4df0-4ded-bf5b-6002e26d4222/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:58:52.039799 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:58:52.039799 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Ensure instance console log exists: /opt/stack/data/nova/instances/27c37404-4df0-4ded-bf5b-6002e26d4222/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:58:52.039799 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:52.040028 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:52.040068 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:52.061000 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-6f2a2422-d94d-419f-9f60-85696e30280e req-f69c8f1b-a551-46d7-a61f-921a07dbedc5 service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:58:52.210465 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-192a2260-9748-49dc-a2c1-47645ba3c27c req-4d044ed1-4e60-481d-bc90-3f2748b22768 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:52.310925 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:58:52.311261 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:58:52.313247 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:52.319942 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:52.427864 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-192a2260-9748-49dc-a2c1-47645ba3c27c req-4d044ed1-4e60-481d-bc90-3f2748b22768 service nova] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Updated VIF entry in instance network info cache for port 0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:58:52.428303 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-192a2260-9748-49dc-a2c1-47645ba3c27c req-4d044ed1-4e60-481d-bc90-3f2748b22768 service nova] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Updating instance_info_cache with network_info: [{"id": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "address": "fa:16:3e:ca:8c:e2", "network": {"id": "d4bf7f94-4ac7-4145-be11-d2aeeafb6c02", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-972487534-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "04ce4063a6ac4afdb5ee359a5c1105d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e39a69e-35", "ovs_interfaceid": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:58:52.467930 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e1a32813f26c4bb28a681856ad1e9019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae04c11a3de34d419d69e1fdf4c7d311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:58:52.563829 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-6f2a2422-d94d-419f-9f60-85696e30280e req-f69c8f1b-a551-46d7-a61f-921a07dbedc5 service nova] Releasing lock "refresh_cache-27c37404-4df0-4ded-bf5b-6002e26d4222" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:58:52.564434 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquired lock "refresh_cache-27c37404-4df0-4ded-bf5b-6002e26d4222" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:58:52.564623 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:58:52.815850 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:58:52.933173 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-192a2260-9748-49dc-a2c1-47645ba3c27c req-4d044ed1-4e60-481d-bc90-3f2748b22768 service nova] Releasing lock "refresh_cache-d4fad20b-d51e-47c9-8f55-3aa085a10891" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:58:53.130329 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:53.184772 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:58:53.265300 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Successfully created port: def344c1-e586-48f0-ad54-d24138b95457 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:58:53.275698 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0002979680002681562 future=<Future at 0x7724ec1edac0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:58:53.275855 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:58:53.320893 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:58:53.444892 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:53.675661 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Updating instance_info_cache with network_info: [{"id": "967dfb76-814b-43ba-ba2b-c14f407ff45e", "address": "fa:16:3e:e8:00:1f", "network": {"id": "e1d5d073-f27b-4ff1-9ed3-99f57407c76f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f65617e71571457f8906997583100678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap967dfb76-81", "ovs_interfaceid": "967dfb76-814b-43ba-ba2b-c14f407ff45e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:58:53.707851 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:58:53.708231 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:58:53.864646 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Successfully updated port: def344c1-e586-48f0-ad54-d24138b95457 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:58:53.928177 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-65c1e14c-b59f-438b-8fa2-cc6b43fccffb req-178fab8a-053e-4051-95f4-752be8a8e0d8 service nova] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Received event network-changed-def344c1-e586-48f0-ad54-d24138b95457 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:53.928177 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-65c1e14c-b59f-438b-8fa2-cc6b43fccffb req-178fab8a-053e-4051-95f4-752be8a8e0d8 service nova] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Refreshing instance network info cache due to event network-changed-def344c1-e586-48f0-ad54-d24138b95457. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:58:53.929181 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-65c1e14c-b59f-438b-8fa2-cc6b43fccffb req-178fab8a-053e-4051-95f4-752be8a8e0d8 service nova] Acquiring lock "refresh_cache-63688346-f8e2-4fbe-987d-bf55df9fa3a4" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:58:53.929181 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-65c1e14c-b59f-438b-8fa2-cc6b43fccffb req-178fab8a-053e-4051-95f4-752be8a8e0d8 service nova] Acquired lock "refresh_cache-63688346-f8e2-4fbe-987d-bf55df9fa3a4" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:58:53.929181 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-65c1e14c-b59f-438b-8fa2-cc6b43fccffb req-178fab8a-053e-4051-95f4-752be8a8e0d8 service nova] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Refreshing network info cache for port def344c1-e586-48f0-ad54-d24138b95457 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:58:54.178163 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Releasing lock "refresh_cache-27c37404-4df0-4ded-bf5b-6002e26d4222" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:58:54.178447 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Instance network_info: |[{"id": "967dfb76-814b-43ba-ba2b-c14f407ff45e", "address": "fa:16:3e:e8:00:1f", "network": {"id": "e1d5d073-f27b-4ff1-9ed3-99f57407c76f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f65617e71571457f8906997583100678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap967dfb76-81", "ovs_interfaceid": "967dfb76-814b-43ba-ba2b-c14f407ff45e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:58:54.182844 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Start _get_guest_xml network_info=[{"id": "967dfb76-814b-43ba-ba2b-c14f407ff45e", "address": "fa:16:3e:e8:00:1f", "network": {"id": "e1d5d073-f27b-4ff1-9ed3-99f57407c76f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f65617e71571457f8906997583100678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap967dfb76-81", "ovs_interfaceid": "967dfb76-814b-43ba-ba2b-c14f407ff45e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:58:54.186054 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:58:54.187687 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1984510406', uuid='27c37404-4df0-4ded-bf5b-6002e26d4222'), owner=OwnerMeta(userid='435dfce8f05e4e01b380797bd07bd4dc', username='tempest-ServerRescueNegativeTestJSON-1821941242-project-member', projectid='f65617e71571457f8906997583100678', projectname='tempest-ServerRescueNegativeTestJSON-1821941242'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "967dfb76-814b-43ba-ba2b-c14f407ff45e", "address": "fa:16:3e:e8:00:1f", "network": {"id": "e1d5d073-f27b-4ff1-9ed3-99f57407c76f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f65617e71571457f8906997583100678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap967dfb76-81", "ovs_interfaceid": "967dfb76-814b-43ba-ba2b-c14f407ff45e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933534.1871667) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:58:54.189207 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:58:54.189721 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:58:54.193237 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:58:54.193586 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:58:54.194887 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:58:54.195413 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:58:54.195616 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:58:54.195773 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:58:54.195954 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:58:54.196214 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:58:54.196559 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:58:54.196850 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:58:54.197054 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:58:54.197241 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:58:54.197384 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:58:54.197668 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:58:54.213211 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:58:54.222282 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:58:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1984510406',display_name='tempest-ServerRescueNegativeTestJSON-server-1984510406',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-serverrescuenegativetestjson-server-1984510406',id=35,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgRFt+zoylZH7ImyqBxzXxwawOcfJNh1kWIzkZgWDpOFw1or+RHRCJDV1CeY464D6GQlptlWjI1DBsvXTx+mpaMK5Xo0FMreDEmYX82LF0E6+YVrbbjZw424HLlD4pjew==',key_name='tempest-keypair-1186596023',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f65617e71571457f8906997583100678',ramdisk_id='',reservation_id='r-62oluqi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1821941242',owner_user_name='tempest-ServerRescueNegativeTestJSON-1821941242-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:58:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='435dfce8f05e4e01b380797bd07bd4dc',uuid=27c37404-4df0-4ded-bf5b-6002e26d4222,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "967dfb76-814b-43ba-ba2b-c14f407ff45e", "address": "fa:16:3e:e8:00:1f", "network": {"id": "e1d5d073-f27b-4ff1-9ed3-99f57407c76f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f65617e71571457f8906997583100678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap967dfb76-81", "ovs_interfaceid": "967dfb76-814b-43ba-ba2b-c14f407ff45e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:58:54.222517 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Converting VIF {"id": "967dfb76-814b-43ba-ba2b-c14f407ff45e", "address": "fa:16:3e:e8:00:1f", "network": {"id": "e1d5d073-f27b-4ff1-9ed3-99f57407c76f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f65617e71571457f8906997583100678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap967dfb76-81", "ovs_interfaceid": "967dfb76-814b-43ba-ba2b-c14f407ff45e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:58:54.223390 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:00:1f,bridge_name='br-int',has_traffic_filtering=True,id=967dfb76-814b-43ba-ba2b-c14f407ff45e,network=Network(e1d5d073-f27b-4ff1-9ed3-99f57407c76f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap967dfb76-81') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:58:54.224254 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lazy-loading 'pci_devices' on Instance uuid 27c37404-4df0-4ded-bf5b-6002e26d4222 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:58:54.330974 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:58:54.334915 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:58:54.334915 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Creating image(s)
May 28 01:58:54.334915 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Acquiring lock "/opt/stack/data/nova/instances/63688346-f8e2-4fbe-987d-bf55df9fa3a4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:54.334915 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "/opt/stack/data/nova/instances/63688346-f8e2-4fbe-987d-bf55df9fa3a4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:54.335559 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "/opt/stack/data/nova/instances/63688346-f8e2-4fbe-987d-bf55df9fa3a4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:54.336384 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:58:54.340271 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:58:54.343304 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:54.371935 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Acquiring lock "refresh_cache-63688346-f8e2-4fbe-987d-bf55df9fa3a4" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:58:54.434391 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-65c1e14c-b59f-438b-8fa2-cc6b43fccffb req-178fab8a-053e-4051-95f4-752be8a8e0d8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:54.444404 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.101s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:54.448346 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:54.448346 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:54.448346 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:58:54.453593 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:58:54.454410 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:54.537999 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-65c1e14c-b59f-438b-8fa2-cc6b43fccffb req-178fab8a-053e-4051-95f4-752be8a8e0d8 service nova] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:58:54.577402 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.123s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:54.581154 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/63688346-f8e2-4fbe-987d-bf55df9fa3a4/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:54.657182 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/63688346-f8e2-4fbe-987d-bf55df9fa3a4/disk 1073741824" returned: 0 in 0.079s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:54.657782 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:54.658210 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:54.721407 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.931s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:54.721951 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:58:54.727052 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 3.408s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:54.729770 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] End _get_guest_xml xml=<domain type="qemu">
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:   <uuid>27c37404-4df0-4ded-bf5b-6002e26d4222</uuid>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:   <name>instance-00000023</name>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1984510406</nova:name>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:58:54</nova:creationTime>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:         <nova:user uuid="435dfce8f05e4e01b380797bd07bd4dc">tempest-ServerRescueNegativeTestJSON-1821941242-project-member</nova:user>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:         <nova:project uuid="f65617e71571457f8906997583100678">tempest-ServerRescueNegativeTestJSON-1821941242</nova:project>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:         <nova:port uuid="967dfb76-814b-43ba-ba2b-c14f407ff45e">
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:     <system>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:       <entry name="serial">27c37404-4df0-4ded-bf5b-6002e26d4222</entry>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:       <entry name="uuid">27c37404-4df0-4ded-bf5b-6002e26d4222</entry>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:     </system>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:   <os>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:   </os>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:   <features>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:   </features>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:   <devices>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/27c37404-4df0-4ded-bf5b-6002e26d4222/disk"/>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:     </disk>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/27c37404-4df0-4ded-bf5b-6002e26d4222/disk.config"/>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:     </disk>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:e8:00:1f"/>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:       <target dev="tap967dfb76-81"/>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:     </interface>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/27c37404-4df0-4ded-bf5b-6002e26d4222/console.log" append="off"/>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:     </serial>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:     <video>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:     </video>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:     </rng>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:   </devices>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]: </domain>
May 28 01:58:54.729770 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:58:54.734583 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Preparing to wait for external event network-vif-plugged-967dfb76-814b-43ba-ba2b-c14f407ff45e {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:58:54.734583 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquiring lock "27c37404-4df0-4ded-bf5b-6002e26d4222-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:54.734583 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "27c37404-4df0-4ded-bf5b-6002e26d4222-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:54.734583 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "27c37404-4df0-4ded-bf5b-6002e26d4222-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:54.734583 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:58:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1984510406',display_name='tempest-ServerRescueNegativeTestJSON-server-1984510406',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-serverrescuenegativetestjson-server-1984510406',id=35,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgRFt+zoylZH7ImyqBxzXxwawOcfJNh1kWIzkZgWDpOFw1or+RHRCJDV1CeY464D6GQlptlWjI1DBsvXTx+mpaMK5Xo0FMreDEmYX82LF0E6+YVrbbjZw424HLlD4pjew==',key_name='tempest-keypair-1186596023',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f65617e71571457f8906997583100678',ramdisk_id='',reservation_id='r-62oluqi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1821941242',owner_user_name='tempest-ServerRescueNegativeTestJSON-1821941242-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:58:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='435dfce8f05e4e01b380797bd07bd4dc',uuid=27c37404-4df0-4ded-bf5b-6002e26d4222,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "967dfb76-814b-43ba-ba2b-c14f407ff45e", "address": "fa:16:3e:e8:00:1f", "network": {"id": "e1d5d073-f27b-4ff1-9ed3-99f57407c76f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f65617e71571457f8906997583100678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap967dfb76-81", "ovs_interfaceid": "967dfb76-814b-43ba-ba2b-c14f407ff45e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:58:54.734583 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Converting VIF {"id": "967dfb76-814b-43ba-ba2b-c14f407ff45e", "address": "fa:16:3e:e8:00:1f", "network": {"id": "e1d5d073-f27b-4ff1-9ed3-99f57407c76f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f65617e71571457f8906997583100678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap967dfb76-81", "ovs_interfaceid": "967dfb76-814b-43ba-ba2b-c14f407ff45e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:58:54.734583 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:00:1f,bridge_name='br-int',has_traffic_filtering=True,id=967dfb76-814b-43ba-ba2b-c14f407ff45e,network=Network(e1d5d073-f27b-4ff1-9ed3-99f57407c76f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap967dfb76-81') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:58:54.734583 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:00:1f,bridge_name='br-int',has_traffic_filtering=True,id=967dfb76-814b-43ba-ba2b-c14f407ff45e,network=Network(e1d5d073-f27b-4ff1-9ed3-99f57407c76f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap967dfb76-81') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:58:54.734583 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:54.735260 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:58:54.735545 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:58:54.740737 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:58:54.741093 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Claim successful on node np0000001583
May 28 01:58:54.744034 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:54.744343 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1a3c49cc-b1a5-51a0-9acf-a1de443d4aa8', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:58:54.747117 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:54.749052 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:54.749260 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap967dfb76-81, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:58:54.749682 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap967dfb76-81, col_values=(('qos', UUID('c9763554-26e7-4a8e-a6b4-bf563acea73d')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:58:54.749873 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap967dfb76-81, col_values=(('external_ids', {'iface-id': '967dfb76-814b-43ba-ba2b-c14f407ff45e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:00:1f', 'vm-uuid': '27c37404-4df0-4ded-bf5b-6002e26d4222'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:58:54.753889 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:58:54.761981 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:54.765446 np0000001583 nova-compute[98241]: INFO os_vif [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:00:1f,bridge_name='br-int',has_traffic_filtering=True,id=967dfb76-814b-43ba-ba2b-c14f407ff45e,network=Network(e1d5d073-f27b-4ff1-9ed3-99f57407c76f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap967dfb76-81')
May 28 01:58:54.766533 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.108s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:54.769246 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Checking if we can resize image /opt/stack/data/nova/instances/63688346-f8e2-4fbe-987d-bf55df9fa3a4/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:58:54.769246 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63688346-f8e2-4fbe-987d-bf55df9fa3a4/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:54.804532 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-65c1e14c-b59f-438b-8fa2-cc6b43fccffb req-178fab8a-053e-4051-95f4-752be8a8e0d8 service nova] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:58:54.887810 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63688346-f8e2-4fbe-987d-bf55df9fa3a4/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:54.889440 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Cannot resize image /opt/stack/data/nova/instances/63688346-f8e2-4fbe-987d-bf55df9fa3a4/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:58:54.890518 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:58:54.890805 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Ensure instance console log exists: /opt/stack/data/nova/instances/63688346-f8e2-4fbe-987d-bf55df9fa3a4/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:58:54.891540 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:54.891937 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:54.892418 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:55.238247 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:58:55.239095 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:58:55.239527 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:55.239808 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:55.316636 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-65c1e14c-b59f-438b-8fa2-cc6b43fccffb req-178fab8a-053e-4051-95f4-752be8a8e0d8 service nova] Releasing lock "refresh_cache-63688346-f8e2-4fbe-987d-bf55df9fa3a4" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:58:55.317532 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Acquired lock "refresh_cache-63688346-f8e2-4fbe-987d-bf55df9fa3a4" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:58:55.319205 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:58:55.352744 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f52a7ae7fbc644deb82f3382de3a4edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cfe906dd24a10819b92c144f7f06f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:58:55.742992 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:58:55.941649 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:58:55.955808 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Successfully created port: 1bce33b1-57be-4de9-9e81-1a05535ae317 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:58:56.187755 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:56.246737 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:58:56.338815 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:58:56.338815 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:58:56.339038 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] No VIF found with MAC fa:16:3e:e8:00:1f, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:58:56.339561 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Using config drive
May 28 01:58:56.395880 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Updating instance_info_cache with network_info: [{"id": "def344c1-e586-48f0-ad54-d24138b95457", "address": "fa:16:3e:24:bb:c4", "network": {"id": "e8c2820e-c0c4-4756-9e11-38375b138d97", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-50364578-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ae04c11a3de34d419d69e1fdf4c7d311", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdef344c1-e5", "ovs_interfaceid": "def344c1-e586-48f0-ad54-d24138b95457", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:58:56.550857 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:58:56.551757 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:58:56.685995 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Successfully updated port: 1bce33b1-57be-4de9-9e81-1a05535ae317 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:58:56.771305 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-83aefb61-593d-4d59-9921-bc2d0ef951ba req-650364d5-defe-42e8-83a9-3f936e65ea46 service nova] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Received event network-changed-1bce33b1-57be-4de9-9e81-1a05535ae317 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:56.772124 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-83aefb61-593d-4d59-9921-bc2d0ef951ba req-650364d5-defe-42e8-83a9-3f936e65ea46 service nova] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Refreshing instance network info cache due to event network-changed-1bce33b1-57be-4de9-9e81-1a05535ae317. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:58:56.772124 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-83aefb61-593d-4d59-9921-bc2d0ef951ba req-650364d5-defe-42e8-83a9-3f936e65ea46 service nova] Acquiring lock "refresh_cache-8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:58:56.772224 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-83aefb61-593d-4d59-9921-bc2d0ef951ba req-650364d5-defe-42e8-83a9-3f936e65ea46 service nova] Acquired lock "refresh_cache-8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:58:56.772376 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-83aefb61-593d-4d59-9921-bc2d0ef951ba req-650364d5-defe-42e8-83a9-3f936e65ea46 service nova] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Refreshing network info cache for port 1bce33b1-57be-4de9-9e81-1a05535ae317 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:58:56.848919 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:56.898511 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Releasing lock "refresh_cache-63688346-f8e2-4fbe-987d-bf55df9fa3a4" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:58:56.898919 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Instance network_info: |[{"id": "def344c1-e586-48f0-ad54-d24138b95457", "address": "fa:16:3e:24:bb:c4", "network": {"id": "e8c2820e-c0c4-4756-9e11-38375b138d97", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-50364578-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ae04c11a3de34d419d69e1fdf4c7d311", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdef344c1-e5", "ovs_interfaceid": "def344c1-e586-48f0-ad54-d24138b95457", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:58:56.901349 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Start _get_guest_xml network_info=[{"id": "def344c1-e586-48f0-ad54-d24138b95457", "address": "fa:16:3e:24:bb:c4", "network": {"id": "e8c2820e-c0c4-4756-9e11-38375b138d97", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-50364578-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ae04c11a3de34d419d69e1fdf4c7d311", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdef344c1-e5", "ovs_interfaceid": "def344c1-e586-48f0-ad54-d24138b95457", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:58:56.906329 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:58:56.907490 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-VolumesBackupsTest-instance-1564007949', uuid='63688346-f8e2-4fbe-987d-bf55df9fa3a4'), owner=OwnerMeta(userid='e1a32813f26c4bb28a681856ad1e9019', username='tempest-VolumesBackupsTest-759555243-project-member', projectid='ae04c11a3de34d419d69e1fdf4c7d311', projectname='tempest-VolumesBackupsTest-759555243'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "def344c1-e586-48f0-ad54-d24138b95457", "address": "fa:16:3e:24:bb:c4", "network": {"id": "e8c2820e-c0c4-4756-9e11-38375b138d97", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-50364578-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ae04c11a3de34d419d69e1fdf4c7d311", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdef344c1-e5", "ovs_interfaceid": "def344c1-e586-48f0-ad54-d24138b95457", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933536.9071133) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:58:56.908855 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:58:56.909579 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:58:56.910862 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:58:56.911136 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:58:56.912308 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:58:56.912775 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:58:56.912970 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:58:56.913142 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:58:56.913337 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:58:56.913594 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:58:56.913884 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:58:56.914132 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:58:56.914298 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:58:56.914483 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:58:56.914661 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:58:56.914875 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:58:56.930884 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:58:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-1564007949',display_name='tempest-VolumesBackupsTest-instance-1564007949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-volumesbackupstest-instance-1564007949',id=36,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjJ7j/eklYN41DgZ8gspcgJf6GlmggO5dAw1zVrzlzslErHgX8xTvKj/UHRW9SOcfUnDtJ+G8on/nS9Z1naHaKkmNif+4Sb1CcMANP9N37O0T/rJg6c0cJUTEFMGn4GiA==',key_name='tempest-keypair-550377710',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae04c11a3de34d419d69e1fdf4c7d311',ramdisk_id='',reservation_id='r-30min8hn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-759555243',owner_user_name='tempest-VolumesBackupsTest-759555243-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:58:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1a32813f26c4bb28a681856ad1e9019',uuid=63688346-f8e2-4fbe-987d-bf55df9fa3a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "def344c1-e586-48f0-ad54-d24138b95457", "address": "fa:16:3e:24:bb:c4", "network": {"id": "e8c2820e-c0c4-4756-9e11-38375b138d97", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-50364578-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ae04c11a3de34d419d69e1fdf4c7d311", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdef344c1-e5", "ovs_interfaceid": "def344c1-e586-48f0-ad54-d24138b95457", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:58:56.931121 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Converting VIF {"id": "def344c1-e586-48f0-ad54-d24138b95457", "address": "fa:16:3e:24:bb:c4", "network": {"id": "e8c2820e-c0c4-4756-9e11-38375b138d97", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-50364578-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ae04c11a3de34d419d69e1fdf4c7d311", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdef344c1-e5", "ovs_interfaceid": "def344c1-e586-48f0-ad54-d24138b95457", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:58:56.931583 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:bb:c4,bridge_name='br-int',has_traffic_filtering=True,id=def344c1-e586-48f0-ad54-d24138b95457,network=Network(e8c2820e-c0c4-4756-9e11-38375b138d97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdef344c1-e5') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:58:56.932395 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lazy-loading 'pci_devices' on Instance uuid 63688346-f8e2-4fbe-987d-bf55df9fa3a4 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:58:57.005337 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Creating config drive at /opt/stack/data/nova/instances/27c37404-4df0-4ded-bf5b-6002e26d4222/disk.config
May 28 01:58:57.009584 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/27c37404-4df0-4ded-bf5b-6002e26d4222/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp89cs6epx {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:57.056712 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:58:57.065749 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/27c37404-4df0-4ded-bf5b-6002e26d4222/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp89cs6epx" returned: 0 in 0.056s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:57.190095 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Acquiring lock "refresh_cache-8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:58:57.260948 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:58:57.263136 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:58:57.265204 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Creating image(s)
May 28 01:58:57.265204 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Acquiring lock "/opt/stack/data/nova/instances/8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:57.265204 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "/opt/stack/data/nova/instances/8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:57.265204 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "/opt/stack/data/nova/instances/8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:57.265573 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Acquiring lock "a33b178235b2834843c883f14aa71de50d42329d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:57.266067 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "a33b178235b2834843c883f14aa71de50d42329d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:57.279240 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-83aefb61-593d-4d59-9921-bc2d0ef951ba req-650364d5-defe-42e8-83a9-3f936e65ea46 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:57.384403 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-83aefb61-593d-4d59-9921-bc2d0ef951ba req-650364d5-defe-42e8-83a9-3f936e65ea46 service nova] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:58:57.436428 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] End _get_guest_xml xml=<domain type="qemu">
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:   <uuid>63688346-f8e2-4fbe-987d-bf55df9fa3a4</uuid>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:   <name>instance-00000024</name>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:       <nova:name>tempest-VolumesBackupsTest-instance-1564007949</nova:name>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:58:56</nova:creationTime>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:         <nova:user uuid="e1a32813f26c4bb28a681856ad1e9019">tempest-VolumesBackupsTest-759555243-project-member</nova:user>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:         <nova:project uuid="ae04c11a3de34d419d69e1fdf4c7d311">tempest-VolumesBackupsTest-759555243</nova:project>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:         <nova:port uuid="def344c1-e586-48f0-ad54-d24138b95457">
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:     <system>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:       <entry name="serial">63688346-f8e2-4fbe-987d-bf55df9fa3a4</entry>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:       <entry name="uuid">63688346-f8e2-4fbe-987d-bf55df9fa3a4</entry>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:     </system>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:   <os>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:   </os>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:   <features>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:   </features>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:   <devices>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/63688346-f8e2-4fbe-987d-bf55df9fa3a4/disk"/>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:     </disk>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/63688346-f8e2-4fbe-987d-bf55df9fa3a4/disk.config"/>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:     </disk>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:24:bb:c4"/>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:       <target dev="tapdef344c1-e5"/>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:     </interface>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/63688346-f8e2-4fbe-987d-bf55df9fa3a4/console.log" append="off"/>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:     </serial>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:     <video>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:     </video>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:     </rng>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:   </devices>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]: </domain>
May 28 01:58:57.436428 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:58:57.438429 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Preparing to wait for external event network-vif-plugged-def344c1-e586-48f0-ad54-d24138b95457 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:58:57.438429 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Acquiring lock "63688346-f8e2-4fbe-987d-bf55df9fa3a4-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:57.438429 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "63688346-f8e2-4fbe-987d-bf55df9fa3a4-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:57.438429 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "63688346-f8e2-4fbe-987d-bf55df9fa3a4-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:57.440308 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:58:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-1564007949',display_name='tempest-VolumesBackupsTest-instance-1564007949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-volumesbackupstest-instance-1564007949',id=36,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjJ7j/eklYN41DgZ8gspcgJf6GlmggO5dAw1zVrzlzslErHgX8xTvKj/UHRW9SOcfUnDtJ+G8on/nS9Z1naHaKkmNif+4Sb1CcMANP9N37O0T/rJg6c0cJUTEFMGn4GiA==',key_name='tempest-keypair-550377710',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae04c11a3de34d419d69e1fdf4c7d311',ramdisk_id='',reservation_id='r-30min8hn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-759555243',owner_user_name='tempest-VolumesBackupsTest-759555243-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:58:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1a32813f26c4bb28a681856ad1e9019',uuid=63688346-f8e2-4fbe-987d-bf55df9fa3a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "def344c1-e586-48f0-ad54-d24138b95457", "address": "fa:16:3e:24:bb:c4", "network": {"id": "e8c2820e-c0c4-4756-9e11-38375b138d97", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-50364578-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ae04c11a3de34d419d69e1fdf4c7d311", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdef344c1-e5", "ovs_interfaceid": "def344c1-e586-48f0-ad54-d24138b95457", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:58:57.440308 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Converting VIF {"id": "def344c1-e586-48f0-ad54-d24138b95457", "address": "fa:16:3e:24:bb:c4", "network": {"id": "e8c2820e-c0c4-4756-9e11-38375b138d97", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-50364578-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ae04c11a3de34d419d69e1fdf4c7d311", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdef344c1-e5", "ovs_interfaceid": "def344c1-e586-48f0-ad54-d24138b95457", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:58:57.440308 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:bb:c4,bridge_name='br-int',has_traffic_filtering=True,id=def344c1-e586-48f0-ad54-d24138b95457,network=Network(e8c2820e-c0c4-4756-9e11-38375b138d97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdef344c1-e5') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:58:57.440601 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:bb:c4,bridge_name='br-int',has_traffic_filtering=True,id=def344c1-e586-48f0-ad54-d24138b95457,network=Network(e8c2820e-c0c4-4756-9e11-38375b138d97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdef344c1-e5') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:58:57.441188 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:57.441519 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:58:57.441891 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:58:57.443206 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:57.443946 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c0095479-eb36-5660-b2b8-26c48d8db633', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:58:57.444611 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:57.446722 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:58:57.452521 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:57.455497 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:57.455708 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdef344c1-e5, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:58:57.457351 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdef344c1-e5, col_values=(('qos', UUID('29fb942b-6ec6-410c-b7ee-575ca4361042')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:58:57.457351 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdef344c1-e5, col_values=(('external_ids', {'iface-id': 'def344c1-e586-48f0-ad54-d24138b95457', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:bb:c4', 'vm-uuid': '63688346-f8e2-4fbe-987d-bf55df9fa3a4'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:58:57.458725 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:57.462515 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:58:57.470332 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:57.471520 np0000001583 nova-compute[98241]: INFO os_vif [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:bb:c4,bridge_name='br-int',has_traffic_filtering=True,id=def344c1-e586-48f0-ad54-d24138b95457,network=Network(e8c2820e-c0c4-4756-9e11-38375b138d97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdef344c1-e5')
May 28 01:58:57.575501 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.847s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:57.575635 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:58:57.593101 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-83aefb61-593d-4d59-9921-bc2d0ef951ba req-650364d5-defe-42e8-83a9-3f936e65ea46 service nova] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:58:57.625540 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:57.670498 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:57.852111 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:58.001248 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9181621e-936f-429e-8352-69a73f92588f req-0ed3b445-d8c1-4d7c-8cd4-82158152071f service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Received event network-vif-plugged-967dfb76-814b-43ba-ba2b-c14f407ff45e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:58:58.001248 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9181621e-936f-429e-8352-69a73f92588f req-0ed3b445-d8c1-4d7c-8cd4-82158152071f service nova] Acquiring lock "27c37404-4df0-4ded-bf5b-6002e26d4222-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:58.001248 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:58.001248 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9181621e-936f-429e-8352-69a73f92588f req-0ed3b445-d8c1-4d7c-8cd4-82158152071f service nova] Lock "27c37404-4df0-4ded-bf5b-6002e26d4222-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:58.002135 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9181621e-936f-429e-8352-69a73f92588f req-0ed3b445-d8c1-4d7c-8cd4-82158152071f service nova] Lock "27c37404-4df0-4ded-bf5b-6002e26d4222-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:58.002135 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9181621e-936f-429e-8352-69a73f92588f req-0ed3b445-d8c1-4d7c-8cd4-82158152071f service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Processing event network-vif-plugged-967dfb76-814b-43ba-ba2b-c14f407ff45e {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:58:58.010058 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:58.050532 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:58:58.056403 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:58:58.057641 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a33b178235b2834843c883f14aa71de50d42329d.part --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:58.101329 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-83aefb61-593d-4d59-9921-bc2d0ef951ba req-650364d5-defe-42e8-83a9-3f936e65ea46 service nova] Releasing lock "refresh_cache-8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:58:58.102316 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Acquired lock "refresh_cache-8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:58:58.103595 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:58:58.103595 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:58:58.104943 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:58:58.107302 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:58.107909 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:58.136594 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:58:58.213012 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a33b178235b2834843c883f14aa71de50d42329d.part --force-share --output=json" returned: 0 in 0.156s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:58.213843 np0000001583 nova-compute[98241]: DEBUG nova.virt.images [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] 2cc2ffd4-9757-447d-a451-53527f5bcc1f was qcow2, converting to raw {{(pid=98241) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 01:58:58.215558 np0000001583 nova-compute[98241]: DEBUG nova.privsep.utils [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98241) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 01:58:58.215558 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a33b178235b2834843c883f14aa71de50d42329d.part /opt/stack/data/nova/instances/_base/a33b178235b2834843c883f14aa71de50d42329d.converted {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:58.254147 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cadb612e41314b06914d5f5f47570e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0474090f4f2d4950b51bc317f4302266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:58:58.452995 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a33b178235b2834843c883f14aa71de50d42329d.part /opt/stack/data/nova/instances/_base/a33b178235b2834843c883f14aa71de50d42329d.converted" returned: 0 in 0.237s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:58.459287 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a33b178235b2834843c883f14aa71de50d42329d.converted --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:58.586585 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a33b178235b2834843c883f14aa71de50d42329d.converted --force-share --output=json" returned: 0 in 0.127s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:58.587382 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "a33b178235b2834843c883f14aa71de50d42329d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.321s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:58.588033 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:58:58.594418 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:58:58.596362 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a33b178235b2834843c883f14aa71de50d42329d --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:58.611093 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:58:58.714239 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:58:58.721702 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a33b178235b2834843c883f14aa71de50d42329d --force-share --output=json" returned: 0 in 0.125s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:58.722316 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Acquiring lock "a33b178235b2834843c883f14aa71de50d42329d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:58.724035 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "a33b178235b2834843c883f14aa71de50d42329d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:58.724966 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:58:58.728783 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:58:58.729880 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a33b178235b2834843c883f14aa71de50d42329d --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:58.841122 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a33b178235b2834843c883f14aa71de50d42329d --force-share --output=json" returned: 0 in 0.110s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:58.841122 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a33b178235b2834843c883f14aa71de50d42329d,backing_fmt=raw /opt/stack/data/nova/instances/8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:58.927994 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a33b178235b2834843c883f14aa71de50d42329d,backing_fmt=raw /opt/stack/data/nova/instances/8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d/disk 1073741824" returned: 0 in 0.087s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:58.928973 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "a33b178235b2834843c883f14aa71de50d42329d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:58.929229 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a33b178235b2834843c883f14aa71de50d42329d --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:59.013116 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933539.0099623, 27c37404-4df0-4ded-bf5b-6002e26d4222 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:58:59.013116 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] VM Started (Lifecycle Event)
May 28 01:58:59.018628 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:58:59.024048 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:58:59.024200 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:58:59.024345 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] No VIF found with MAC fa:16:3e:24:bb:c4, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:58:59.025155 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Using config drive
May 28 01:58:59.033227 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:58:59.039004 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Instance spawned successfully.
May 28 01:58:59.044553 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:58:59.064517 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a33b178235b2834843c883f14aa71de50d42329d --force-share --output=json" returned: 0 in 0.132s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:59.066251 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:58:59.066251 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:59.082504 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:59.124539 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:58:59.160362 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Successfully created port: aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:58:59.202655 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:59.207641 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Cannot resize image /opt/stack/data/nova/instances/8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:58:59.208021 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:58:59.210169 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Ensure instance console log exists: /opt/stack/data/nova/instances/8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:58:59.210547 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:58:59.210824 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:58:59.211007 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:58:59.316330 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Updating instance_info_cache with network_info: [{"id": "1bce33b1-57be-4de9-9e81-1a05535ae317", "address": "fa:16:3e:ae:cc:0f", "network": {"id": "c18d43cf-482c-4814-96a1-09aab2287be4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2071326233-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d5cfe906dd24a10819b92c144f7f06f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bce33b1-57", "ovs_interfaceid": "1bce33b1-57be-4de9-9e81-1a05535ae317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:58:59.522498 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:58:59.536762 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:58:59.539277 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:58:59.574539 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:58:59.575205 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:58:59.575205 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:58:59.575517 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:58:59.575894 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:58:59.579594 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:58:59.778648 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Creating config drive at /opt/stack/data/nova/instances/63688346-f8e2-4fbe-987d-bf55df9fa3a4/disk.config
May 28 01:58:59.785101 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/63688346-f8e2-4fbe-987d-bf55df9fa3a4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwdfy2boc {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:58:59.827869 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Releasing lock "refresh_cache-8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:58:59.828543 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Instance network_info: |[{"id": "1bce33b1-57be-4de9-9e81-1a05535ae317", "address": "fa:16:3e:ae:cc:0f", "network": {"id": "c18d43cf-482c-4814-96a1-09aab2287be4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2071326233-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d5cfe906dd24a10819b92c144f7f06f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bce33b1-57", "ovs_interfaceid": "1bce33b1-57be-4de9-9e81-1a05535ae317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:58:59.832107 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Start _get_guest_xml network_info=[{"id": "1bce33b1-57be-4de9-9e81-1a05535ae317", "address": "fa:16:3e:ae:cc:0f", "network": {"id": "c18d43cf-482c-4814-96a1-09aab2287be4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2071326233-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d5cfe906dd24a10819b92c144f7f06f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bce33b1-57", "ovs_interfaceid": "1bce33b1-57be-4de9-9e81-1a05535ae317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:58:43Z,direct_url=<?>,disk_format='qcow2',id=2cc2ffd4-9757-447d-a451-53527f5bcc1f,min_disk=0,min_ram=0,name='tempest-scenario-img--1246379676',owner='1d5cfe906dd24a10819b92c144f7f06f',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:58:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '2cc2ffd4-9757-447d-a451-53527f5bcc1f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:58:59.841257 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:58:59.843919 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='2cc2ffd4-9757-447d-a451-53527f5bcc1f', instance_meta=NovaInstanceMeta(name='tempest-TestMinimumBasicScenario-server-1116550051', uuid='8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d'), owner=OwnerMeta(userid='f52a7ae7fbc644deb82f3382de3a4edd', username='tempest-TestMinimumBasicScenario-1092247749-project-member', projectid='1d5cfe906dd24a10819b92c144f7f06f', projectname='tempest-TestMinimumBasicScenario-1092247749'), image=ImageMeta(id='2cc2ffd4-9757-447d-a451-53527f5bcc1f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1bce33b1-57be-4de9-9e81-1a05535ae317", "address": "fa:16:3e:ae:cc:0f", "network": {"id": "c18d43cf-482c-4814-96a1-09aab2287be4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2071326233-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d5cfe906dd24a10819b92c144f7f06f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bce33b1-57", "ovs_interfaceid": "1bce33b1-57be-4de9-9e81-1a05535ae317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933539.84323) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:58:59.849108 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:58:59.849108 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:58:59.858010 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:58:59.858345 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:58:59.862041 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:58:59.862661 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:58:43Z,direct_url=<?>,disk_format='qcow2',id=2cc2ffd4-9757-447d-a451-53527f5bcc1f,min_disk=0,min_ram=0,name='tempest-scenario-img--1246379676',owner='1d5cfe906dd24a10819b92c144f7f06f',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:58:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:58:59.864738 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:58:59.864917 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:58:59.866541 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:58:59.866541 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:58:59.866733 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:58:59.866973 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:58:59.867437 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:58:59.867437 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:58:59.867528 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:58:59.868060 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:58:59.880953 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/63688346-f8e2-4fbe-987d-bf55df9fa3a4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwdfy2boc" returned: 0 in 0.083s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:58:59.894216 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:58:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1116550051',display_name='tempest-TestMinimumBasicScenario-server-1116550051',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testminimumbasicscenario-server-1116550051',id=37,image_ref='2cc2ffd4-9757-447d-a451-53527f5bcc1f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMULG2kTEY+WhVbRzbS6xOD6CJCgxm22CYbbQxg0BTn9Kii/R8Mt6h4nIBTEe0X4SkZIt8ct5xyc3FmGuzZLRtxpNB61Zb7jVrz/BvdWxTdtIMJsifze5TU8LnUgQB0QDQ==',key_name='tempest-TestMinimumBasicScenario-2031915617',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d5cfe906dd24a10819b92c144f7f06f',ramdisk_id='',reservation_id='r-q03o3420',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2cc2ffd4-9757-447d-a451-53527f5bcc1f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1092247749',owner_user_name='tempest-TestMinimumBasicScenario-1092247749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:58:56Z,user_data=None,user_id='f52a7ae7fbc644deb82f3382de3a4edd',uuid=8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1bce33b1-57be-4de9-9e81-1a05535ae317", "address": "fa:16:3e:ae:cc:0f", "network": {"id": "c18d43cf-482c-4814-96a1-09aab2287be4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2071326233-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d5cfe906dd24a10819b92c144f7f06f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bce33b1-57", "ovs_interfaceid": "1bce33b1-57be-4de9-9e81-1a05535ae317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:58:59.894699 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Converting VIF {"id": "1bce33b1-57be-4de9-9e81-1a05535ae317", "address": "fa:16:3e:ae:cc:0f", "network": {"id": "c18d43cf-482c-4814-96a1-09aab2287be4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2071326233-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d5cfe906dd24a10819b92c144f7f06f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bce33b1-57", "ovs_interfaceid": "1bce33b1-57be-4de9-9e81-1a05535ae317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:58:59.895799 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:cc:0f,bridge_name='br-int',has_traffic_filtering=True,id=1bce33b1-57be-4de9-9e81-1a05535ae317,network=Network(c18d43cf-482c-4814-96a1-09aab2287be4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bce33b1-57') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:58:59.896192 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lazy-loading 'pci_devices' on Instance uuid 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:59:00.040763 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Successfully updated port: aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:59:00.046329 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:59:00.047405 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933540.046697, 27c37404-4df0-4ded-bf5b-6002e26d4222 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:59:00.047757 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] VM Paused (Lifecycle Event)
May 28 01:59:00.092488 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Took 8.66 seconds to spawn the instance on the hypervisor.
May 28 01:59:00.092701 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:59:00.111178 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-82bcdb8c-aa78-4b94-8776-eef1dd450c31 req-448a5898-d3d9-4d98-83a0-7fec62552076 service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Received event network-vif-plugged-967dfb76-814b-43ba-ba2b-c14f407ff45e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:59:00.112646 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-82bcdb8c-aa78-4b94-8776-eef1dd450c31 req-448a5898-d3d9-4d98-83a0-7fec62552076 service nova] Acquiring lock "27c37404-4df0-4ded-bf5b-6002e26d4222-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:00.113017 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-82bcdb8c-aa78-4b94-8776-eef1dd450c31 req-448a5898-d3d9-4d98-83a0-7fec62552076 service nova] Lock "27c37404-4df0-4ded-bf5b-6002e26d4222-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:00.114226 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-82bcdb8c-aa78-4b94-8776-eef1dd450c31 req-448a5898-d3d9-4d98-83a0-7fec62552076 service nova] Lock "27c37404-4df0-4ded-bf5b-6002e26d4222-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:00.114569 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-82bcdb8c-aa78-4b94-8776-eef1dd450c31 req-448a5898-d3d9-4d98-83a0-7fec62552076 service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] No waiting events found dispatching network-vif-plugged-967dfb76-814b-43ba-ba2b-c14f407ff45e {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:59:00.114785 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-82bcdb8c-aa78-4b94-8776-eef1dd450c31 req-448a5898-d3d9-4d98-83a0-7fec62552076 service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Received unexpected event network-vif-plugged-967dfb76-814b-43ba-ba2b-c14f407ff45e for instance with vm_state building and task_state spawning.
May 28 01:59:00.143430 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:59:00.148492 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:59:00.150089 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Creating image(s)
May 28 01:59:00.150995 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "/opt/stack/data/nova/instances/e3e9a0d0-72cd-459e-8bc4-cf080adb5267/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:00.151281 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "/opt/stack/data/nova/instances/e3e9a0d0-72cd-459e-8bc4-cf080adb5267/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:00.152319 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "/opt/stack/data/nova/instances/e3e9a0d0-72cd-459e-8bc4-cf080adb5267/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:00.153486 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:59:00.158882 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:59:00.160322 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:00.289281 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.128s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:59:00.289949 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:00.290662 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:00.291258 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:59:00.296420 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:59:00.297690 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:00.402878 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] End _get_guest_xml xml=<domain type="qemu">
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:   <uuid>8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d</uuid>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:   <name>instance-00000025</name>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:       <nova:name>tempest-TestMinimumBasicScenario-server-1116550051</nova:name>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:58:59</nova:creationTime>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:       <nova:image uuid="2cc2ffd4-9757-447d-a451-53527f5bcc1f">
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:         <nova:properties/>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:         <nova:user uuid="f52a7ae7fbc644deb82f3382de3a4edd">tempest-TestMinimumBasicScenario-1092247749-project-member</nova:user>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:         <nova:project uuid="1d5cfe906dd24a10819b92c144f7f06f">tempest-TestMinimumBasicScenario-1092247749</nova:project>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="2cc2ffd4-9757-447d-a451-53527f5bcc1f"/>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:         <nova:port uuid="1bce33b1-57be-4de9-9e81-1a05535ae317">
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:     <system>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:       <entry name="serial">8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d</entry>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:       <entry name="uuid">8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d</entry>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:     </system>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:   <os>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:   </os>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:   <features>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:   </features>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:   <devices>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d/disk"/>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:     </disk>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d/disk.config"/>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:     </disk>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:ae:cc:0f"/>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:       <target dev="tap1bce33b1-57"/>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:     </interface>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d/console.log" append="off"/>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:     </serial>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:     <video>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:     </video>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:     </rng>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:   </devices>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]: </domain>
May 28 01:59:00.402878 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:59:00.405414 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Preparing to wait for external event network-vif-plugged-1bce33b1-57be-4de9-9e81-1a05535ae317 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:59:00.405414 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Acquiring lock "8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:00.405414 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:00.405414 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:00.405414 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:58:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1116550051',display_name='tempest-TestMinimumBasicScenario-server-1116550051',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testminimumbasicscenario-server-1116550051',id=37,image_ref='2cc2ffd4-9757-447d-a451-53527f5bcc1f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMULG2kTEY+WhVbRzbS6xOD6CJCgxm22CYbbQxg0BTn9Kii/R8Mt6h4nIBTEe0X4SkZIt8ct5xyc3FmGuzZLRtxpNB61Zb7jVrz/BvdWxTdtIMJsifze5TU8LnUgQB0QDQ==',key_name='tempest-TestMinimumBasicScenario-2031915617',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d5cfe906dd24a10819b92c144f7f06f',ramdisk_id='',reservation_id='r-q03o3420',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2cc2ffd4-9757-447d-a451-53527f5bcc1f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1092247749',owner_user_name='tempest-TestMinimumBasicScenario-1092247749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:58:56Z,user_data=None,user_id='f52a7ae7fbc644deb82f3382de3a4edd',uuid=8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1bce33b1-57be-4de9-9e81-1a05535ae317", "address": "fa:16:3e:ae:cc:0f", "network": {"id": "c18d43cf-482c-4814-96a1-09aab2287be4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2071326233-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d5cfe906dd24a10819b92c144f7f06f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bce33b1-57", "ovs_interfaceid": "1bce33b1-57be-4de9-9e81-1a05535ae317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:59:00.405770 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Converting VIF {"id": "1bce33b1-57be-4de9-9e81-1a05535ae317", "address": "fa:16:3e:ae:cc:0f", "network": {"id": "c18d43cf-482c-4814-96a1-09aab2287be4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2071326233-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d5cfe906dd24a10819b92c144f7f06f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bce33b1-57", "ovs_interfaceid": "1bce33b1-57be-4de9-9e81-1a05535ae317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:59:00.406631 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:cc:0f,bridge_name='br-int',has_traffic_filtering=True,id=1bce33b1-57be-4de9-9e81-1a05535ae317,network=Network(c18d43cf-482c-4814-96a1-09aab2287be4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bce33b1-57') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:59:00.406881 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:cc:0f,bridge_name='br-int',has_traffic_filtering=True,id=1bce33b1-57be-4de9-9e81-1a05535ae317,network=Network(c18d43cf-482c-4814-96a1-09aab2287be4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bce33b1-57') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:59:00.407329 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:00.407716 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:59:00.408333 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:59:00.410198 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.113s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:59:00.411618 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:00.411618 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd1481867-2406-5c03-8d12-08621c5f18a9', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:59:00.411618 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/e3e9a0d0-72cd-459e-8bc4-cf080adb5267/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:00.423665 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:00.427687 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:59:00.433924 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:00.434403 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1bce33b1-57, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:59:00.435376 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1bce33b1-57, col_values=(('qos', UUID('e8e761a8-209d-4f26-9893-1c834ab7070d')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:59:00.435897 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1bce33b1-57, col_values=(('external_ids', {'iface-id': '1bce33b1-57be-4de9-9e81-1a05535ae317', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:cc:0f', 'vm-uuid': '8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:59:00.437485 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:00.439343 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:59:00.452215 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:00.453134 np0000001583 nova-compute[98241]: INFO os_vif [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:cc:0f,bridge_name='br-int',has_traffic_filtering=True,id=1bce33b1-57be-4de9-9e81-1a05535ae317,network=Network(c18d43cf-482c-4814-96a1-09aab2287be4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bce33b1-57')
May 28 01:59:00.469575 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:00.475205 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/e3e9a0d0-72cd-459e-8bc4-cf080adb5267/disk 1073741824" returned: 0 in 0.063s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:59:00.475205 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.184s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:00.475205 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:00.514143 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:00.549390 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "refresh_cache-e3e9a0d0-72cd-459e-8bc4-cf080adb5267" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:59:00.549390 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquired lock "refresh_cache-e3e9a0d0-72cd-459e-8bc4-cf080adb5267" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:59:00.549390 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:59:00.557349 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:59:00.572770 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933540.5723217, 27c37404-4df0-4ded-bf5b-6002e26d4222 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:59:00.574182 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] VM Resumed (Lifecycle Event)
May 28 01:59:00.610906 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Took 14.54 seconds to build instance.
May 28 01:59:00.627396 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:00.641244 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.166s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:59:00.643148 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e3e9a0d0-72cd-459e-8bc4-cf080adb5267/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:59:00.643298 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e9a0d0-72cd-459e-8bc4-cf080adb5267/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:00.779809 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e9a0d0-72cd-459e-8bc4-cf080adb5267/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:59:00.780235 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Cannot resize image /opt/stack/data/nova/instances/e3e9a0d0-72cd-459e-8bc4-cf080adb5267/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:59:00.780934 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:59:00.784452 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Ensure instance console log exists: /opt/stack/data/nova/instances/e3e9a0d0-72cd-459e-8bc4-cf080adb5267/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:59:00.784452 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:00.784452 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:00.784452 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:00.851628 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0453fb57-39fe-4b00-8c63-f3938e65952e tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "668cf051-44c2-4db1-bfd1-dfeed0c6b5a4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:00.853257 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0453fb57-39fe-4b00-8c63-f3938e65952e tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "668cf051-44c2-4db1-bfd1-dfeed0c6b5a4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:00.853257 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0453fb57-39fe-4b00-8c63-f3938e65952e tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "668cf051-44c2-4db1-bfd1-dfeed0c6b5a4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:00.853743 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0453fb57-39fe-4b00-8c63-f3938e65952e tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "668cf051-44c2-4db1-bfd1-dfeed0c6b5a4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:00.858180 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0453fb57-39fe-4b00-8c63-f3938e65952e tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "668cf051-44c2-4db1-bfd1-dfeed0c6b5a4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:00.861757 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-0453fb57-39fe-4b00-8c63-f3938e65952e tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Terminating instance
May 28 01:59:00.975434 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:00.985717 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:00.992690 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-1bda3102-cf9b-498a-a284-9f104acfffba req-1d8377f7-05d3-4353-b1cb-51aa549eeb46 service nova] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Received event network-vif-plugged-def344c1-e586-48f0-ad54-d24138b95457 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:59:00.993838 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-1bda3102-cf9b-498a-a284-9f104acfffba req-1d8377f7-05d3-4353-b1cb-51aa549eeb46 service nova] Acquiring lock "63688346-f8e2-4fbe-987d-bf55df9fa3a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:00.994681 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:00.996674 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-1bda3102-cf9b-498a-a284-9f104acfffba req-1d8377f7-05d3-4353-b1cb-51aa549eeb46 service nova] Lock "63688346-f8e2-4fbe-987d-bf55df9fa3a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:00.996952 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-1bda3102-cf9b-498a-a284-9f104acfffba req-1d8377f7-05d3-4353-b1cb-51aa549eeb46 service nova] Lock "63688346-f8e2-4fbe-987d-bf55df9fa3a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:00.997505 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-1bda3102-cf9b-498a-a284-9f104acfffba req-1d8377f7-05d3-4353-b1cb-51aa549eeb46 service nova] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Processing event network-vif-plugged-def344c1-e586-48f0-ad54-d24138b95457 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:59:01.019564 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:01.032333 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:01.082313 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:59:01.094473 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:59:01.117022 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a9844091-af78-4790-9470-04b3811af480 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "27c37404-4df0-4ded-bf5b-6002e26d4222" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.057s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:01.213876 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:59:01.369380 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-0453fb57-39fe-4b00-8c63-f3938e65952e tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:59:01.407190 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:01.678220 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:59:01.678787 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:59:01.678787 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] No VIF found with MAC fa:16:3e:ae:cc:0f, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:59:01.679827 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Using config drive
May 28 01:59:01.688251 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:59:01.720876 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:01.741636 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:01.748345 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999597009999889 future=<Future at 0x7724f8190650 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:59:01.749566 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.998366309000176 future=<Future at 0x7724f8190650 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:59:01.749839 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.998138574000222 future=<Future at 0x7724f8190650 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:59:01.756474 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Instance destroyed successfully.
May 28 01:59:01.757020 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-0453fb57-39fe-4b00-8c63-f3938e65952e tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lazy-loading 'resources' on Instance uuid 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:59:01.842116 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933541.8402255, 63688346-f8e2-4fbe-987d-bf55df9fa3a4 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:59:01.842116 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] VM Started (Lifecycle Event)
May 28 01:59:01.844516 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:59:01.849738 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:59:01.857569 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Instance spawned successfully.
May 28 01:59:01.858155 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:59:01.929544 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Updating instance_info_cache with network_info: [{"id": "aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8", "address": "fa:16:3e:df:45:21", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaec0d58f-da", "ovs_interfaceid": "aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:59:02.191997 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:59:02.215297 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-103ec748-bba7-4f6e-8847-21bcef1d0220 req-e1a87118-62e6-4aed-9f2d-abcf13ec1783 service nova] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Received event network-changed-aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:59:02.217407 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-103ec748-bba7-4f6e-8847-21bcef1d0220 req-e1a87118-62e6-4aed-9f2d-abcf13ec1783 service nova] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Refreshing instance network info cache due to event network-changed-aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:59:02.217626 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-103ec748-bba7-4f6e-8847-21bcef1d0220 req-e1a87118-62e6-4aed-9f2d-abcf13ec1783 service nova] Acquiring lock "refresh_cache-e3e9a0d0-72cd-459e-8bc4-cf080adb5267" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:59:02.264961 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-0453fb57-39fe-4b00-8c63-f3938e65952e tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:58:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1000769287',display_name='tempest-AttachVolumeNegativeTest-server-1000769287',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-attachvolumenegativetest-server-1000769287',id=31,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7Xdpnhyu2YUr/bc277ZeRyYDf6SVPYURvHJQ6FoalS6x51jEcm2K+7ouUXKf/qn0HMrsRFUcmvOmcRtkAgZ12WpS9aYp6A2F97ZjJk1x7X2rkqQMDqC5NsVvaw6/M6gA==',key_name='tempest-keypair-1135506250',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:58:21Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='837663bcfa40402aaf583729dfbb26cd',ramdisk_id='',reservation_id='r-lmp40x4s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-169599115',owner_user_name='tempest-AttachVolumeNegativeTest-169599115-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:58:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='00cb6190618b45eb994dd16d3c657f01',uuid=668cf051-44c2-4db1-bfd1-dfeed0c6b5a4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a4bd986-18c1-42d1-9574-9080c2f65867", "address": "fa:16:3e:17:7e:4a", "network": {"id": "62e7cc38-1758-4b09-a352-4635adc9cfea", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587967507-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "837663bcfa40402aaf583729dfbb26cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a4bd986-18", "ovs_interfaceid": "5a4bd986-18c1-42d1-9574-9080c2f65867", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:59:02.264961 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-0453fb57-39fe-4b00-8c63-f3938e65952e tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Converting VIF {"id": "5a4bd986-18c1-42d1-9574-9080c2f65867", "address": "fa:16:3e:17:7e:4a", "network": {"id": "62e7cc38-1758-4b09-a352-4635adc9cfea", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587967507-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "837663bcfa40402aaf583729dfbb26cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a4bd986-18", "ovs_interfaceid": "5a4bd986-18c1-42d1-9574-9080c2f65867", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:59:02.264961 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-0453fb57-39fe-4b00-8c63-f3938e65952e tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:7e:4a,bridge_name='br-int',has_traffic_filtering=True,id=5a4bd986-18c1-42d1-9574-9080c2f65867,network=Network(62e7cc38-1758-4b09-a352-4635adc9cfea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a4bd986-18') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:59:02.264961 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-0453fb57-39fe-4b00-8c63-f3938e65952e tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:7e:4a,bridge_name='br-int',has_traffic_filtering=True,id=5a4bd986-18c1-42d1-9574-9080c2f65867,network=Network(62e7cc38-1758-4b09-a352-4635adc9cfea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a4bd986-18') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:59:02.265459 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:02.265459 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a4bd986-18, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:59:02.267248 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:02.268281 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:59:02.274989 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:02.275974 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:02.276304 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b12c94d3-512d-4855-bdab-f5ffc7814f23) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:59:02.279985 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:02.279985 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:59:02.286124 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:02.291284 np0000001583 nova-compute[98241]: INFO os_vif [None req-0453fb57-39fe-4b00-8c63-f3938e65952e tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:7e:4a,bridge_name='br-int',has_traffic_filtering=True,id=5a4bd986-18c1-42d1-9574-9080c2f65867,network=Network(62e7cc38-1758-4b09-a352-4635adc9cfea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a4bd986-18')
May 28 01:59:02.291284 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-0453fb57-39fe-4b00-8c63-f3938e65952e tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Deleting instance files /opt/stack/data/nova/instances/668cf051-44c2-4db1-bfd1-dfeed0c6b5a4_del
May 28 01:59:02.291879 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-0453fb57-39fe-4b00-8c63-f3938e65952e tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Deletion of /opt/stack/data/nova/instances/668cf051-44c2-4db1-bfd1-dfeed0c6b5a4_del complete
May 28 01:59:02.344512 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:59:02.350548 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:59:02.370397 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:59:02.370727 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:59:02.371714 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:59:02.371714 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:59:02.372609 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:59:02.372609 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:59:02.382880 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Creating config drive at /opt/stack/data/nova/instances/8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d/disk.config
May 28 01:59:02.389744 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdtapa99m {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:02.424185 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-cf8c5829-1b35-4083-b745-4028578b24c4 req-cc79482a-efa0-4c14-a291-c793d3587aa5 service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Received event network-changed-967dfb76-814b-43ba-ba2b-c14f407ff45e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:59:02.425887 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-cf8c5829-1b35-4083-b745-4028578b24c4 req-cc79482a-efa0-4c14-a291-c793d3587aa5 service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Refreshing instance network info cache due to event network-changed-967dfb76-814b-43ba-ba2b-c14f407ff45e. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:59:02.425887 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-cf8c5829-1b35-4083-b745-4028578b24c4 req-cc79482a-efa0-4c14-a291-c793d3587aa5 service nova] Acquiring lock "refresh_cache-27c37404-4df0-4ded-bf5b-6002e26d4222" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:59:02.426281 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-cf8c5829-1b35-4083-b745-4028578b24c4 req-cc79482a-efa0-4c14-a291-c793d3587aa5 service nova] Acquired lock "refresh_cache-27c37404-4df0-4ded-bf5b-6002e26d4222" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:59:02.426803 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-cf8c5829-1b35-4083-b745-4028578b24c4 req-cc79482a-efa0-4c14-a291-c793d3587aa5 service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Refreshing network info cache for port 967dfb76-814b-43ba-ba2b-c14f407ff45e {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:59:02.432807 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Releasing lock "refresh_cache-e3e9a0d0-72cd-459e-8bc4-cf080adb5267" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:59:02.433769 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Instance network_info: |[{"id": "aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8", "address": "fa:16:3e:df:45:21", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaec0d58f-da", "ovs_interfaceid": "aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:59:02.435549 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-103ec748-bba7-4f6e-8847-21bcef1d0220 req-e1a87118-62e6-4aed-9f2d-abcf13ec1783 service nova] Acquired lock "refresh_cache-e3e9a0d0-72cd-459e-8bc4-cf080adb5267" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:59:02.436136 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-103ec748-bba7-4f6e-8847-21bcef1d0220 req-e1a87118-62e6-4aed-9f2d-abcf13ec1783 service nova] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Refreshing network info cache for port aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:59:02.440708 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Start _get_guest_xml network_info=[{"id": "aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8", "address": "fa:16:3e:df:45:21", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaec0d58f-da", "ovs_interfaceid": "aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:59:02.446624 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:59:02.448162 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='e3e9a0d0-72cd-459e-8bc4-cf080adb5267'), owner=OwnerMeta(userid='cadb612e41314b06914d5f5f47570e98', username='tempest-AttachVolumeMultiAttachTest-857456921-project-member', projectid='0474090f4f2d4950b51bc317f4302266', projectname='tempest-AttachVolumeMultiAttachTest-857456921'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8", "address": "fa:16:3e:df:45:21", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaec0d58f-da", "ovs_interfaceid": "aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933542.4477005) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:59:02.451724 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:59:02.452235 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:59:02.453074 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:59:02.453283 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:59:02.454408 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:59:02.454757 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:59:02.455225 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:59:02.455379 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:59:02.455560 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:59:02.456543 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:59:02.456740 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:59:02.456949 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:59:02.457138 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:59:02.458252 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:59:02.458403 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:59:02.458529 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:59:02.468105 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdtapa99m" returned: 0 in 0.078s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:59:02.473371 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:58:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='multiattach-server-1',id=38,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAP7CI9wuY8JR5OGc0CpqFzQg3rj7cqVgHC4sPYHH38XlmtTRa9WHg3S3WcIsSpd43tWEYYLHF1/yDpoSsozR5Hrjk+cgmLbTDwUHC3YheiC8VnlV/ymBtBFe0b8oxSz5w==',key_name='tempest-keypair-1713929294',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0474090f4f2d4950b51bc317f4302266',ramdisk_id='',reservation_id='r-8z0cwax6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-857456921',owner_user_name='tempest-AttachVolumeMultiAttachTest-857456921-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:58:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cadb612e41314b06914d5f5f47570e98',uuid=e3e9a0d0-72cd-459e-8bc4-cf080adb5267,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8", "address": "fa:16:3e:df:45:21", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaec0d58f-da", "ovs_interfaceid": "aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:59:02.474233 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Converting VIF {"id": "aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8", "address": "fa:16:3e:df:45:21", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaec0d58f-da", "ovs_interfaceid": "aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:59:02.475231 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:45:21,bridge_name='br-int',has_traffic_filtering=True,id=aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaec0d58f-da') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:59:02.476495 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lazy-loading 'pci_devices' on Instance uuid e3e9a0d0-72cd-459e-8bc4-cf080adb5267 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:59:02.801269 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-0453fb57-39fe-4b00-8c63-f3938e65952e tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Took 1.43 seconds to destroy the instance on the hypervisor.
May 28 01:59:02.803451 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-0453fb57-39fe-4b00-8c63-f3938e65952e tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:59:02.803900 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:59:02.804029 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:59:02.804465 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:59:02.854232 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:59:02.854373 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933542.8541656, 63688346-f8e2-4fbe-987d-bf55df9fa3a4 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:59:02.854572 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] VM Paused (Lifecycle Event)
May 28 01:59:02.886664 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Took 8.56 seconds to spawn the instance on the hypervisor.
May 28 01:59:02.886977 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:59:02.893624 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:59:02.932945 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-cf8c5829-1b35-4083-b745-4028578b24c4 req-cc79482a-efa0-4c14-a291-c793d3587aa5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:59:02.942110 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-103ec748-bba7-4f6e-8847-21bcef1d0220 req-e1a87118-62e6-4aed-9f2d-abcf13ec1783 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:59:02.980145 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:02.993899 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] End _get_guest_xml xml=<domain type="qemu">
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:   <uuid>e3e9a0d0-72cd-459e-8bc4-cf080adb5267</uuid>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:   <name>instance-00000026</name>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:       <nova:name>multiattach-server-1</nova:name>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:59:02</nova:creationTime>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:         <nova:user uuid="cadb612e41314b06914d5f5f47570e98">tempest-AttachVolumeMultiAttachTest-857456921-project-member</nova:user>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:         <nova:project uuid="0474090f4f2d4950b51bc317f4302266">tempest-AttachVolumeMultiAttachTest-857456921</nova:project>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:         <nova:port uuid="aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8">
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:     <system>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:       <entry name="serial">e3e9a0d0-72cd-459e-8bc4-cf080adb5267</entry>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:       <entry name="uuid">e3e9a0d0-72cd-459e-8bc4-cf080adb5267</entry>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:     </system>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:   <os>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:   </os>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:   <features>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:   </features>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:   <devices>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/e3e9a0d0-72cd-459e-8bc4-cf080adb5267/disk"/>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:     </disk>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/e3e9a0d0-72cd-459e-8bc4-cf080adb5267/disk.config"/>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:     </disk>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:df:45:21"/>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:       <target dev="tapaec0d58f-da"/>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:     </interface>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/e3e9a0d0-72cd-459e-8bc4-cf080adb5267/console.log" append="off"/>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:     </serial>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:     <video>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:     </video>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:     </rng>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:   </devices>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]: </domain>
May 28 01:59:02.993899 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:59:02.993899 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Preparing to wait for external event network-vif-plugged-aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:59:02.993899 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "e3e9a0d0-72cd-459e-8bc4-cf080adb5267-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:02.993899 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "e3e9a0d0-72cd-459e-8bc4-cf080adb5267-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:02.993899 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "e3e9a0d0-72cd-459e-8bc4-cf080adb5267-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:02.998337 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:58:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='multiattach-server-1',id=38,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAP7CI9wuY8JR5OGc0CpqFzQg3rj7cqVgHC4sPYHH38XlmtTRa9WHg3S3WcIsSpd43tWEYYLHF1/yDpoSsozR5Hrjk+cgmLbTDwUHC3YheiC8VnlV/ymBtBFe0b8oxSz5w==',key_name='tempest-keypair-1713929294',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0474090f4f2d4950b51bc317f4302266',ramdisk_id='',reservation_id='r-8z0cwax6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-857456921',owner_user_name='tempest-AttachVolumeMultiAttachTest-857456921-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:58:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cadb612e41314b06914d5f5f47570e98',uuid=e3e9a0d0-72cd-459e-8bc4-cf080adb5267,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8", "address": "fa:16:3e:df:45:21", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaec0d58f-da", "ovs_interfaceid": "aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:59:02.998337 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Converting VIF {"id": "aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8", "address": "fa:16:3e:df:45:21", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaec0d58f-da", "ovs_interfaceid": "aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:59:03.000183 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:45:21,bridge_name='br-int',has_traffic_filtering=True,id=aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaec0d58f-da') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:59:03.002244 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:45:21,bridge_name='br-int',has_traffic_filtering=True,id=aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaec0d58f-da') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:59:03.007486 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:59:03.007486 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:59:03.023033 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:03.026015 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e5004fae-0a64-5fd0-bf5c-6238b451c850', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:59:03.032414 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:03.035740 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:59:03.042520 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:03.042946 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaec0d58f-da, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:59:03.045411 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaec0d58f-da, col_values=(('qos', UUID('c1519c44-4683-4def-aab4-cc03a7dc32d4')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:59:03.049424 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaec0d58f-da, col_values=(('external_ids', {'iface-id': 'aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:45:21', 'vm-uuid': 'e3e9a0d0-72cd-459e-8bc4-cf080adb5267'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:59:03.057926 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:59:03.063509 np0000001583 nova-compute[98241]: INFO os_vif [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:45:21,bridge_name='br-int',has_traffic_filtering=True,id=aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaec0d58f-da')
May 28 01:59:03.145197 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:03.160882 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:03.180429 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-849e656e-272f-4393-9536-6abf812a177b req-c8f96d3c-e044-4a80-b164-a3365801734e service nova] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Received event network-vif-plugged-def344c1-e586-48f0-ad54-d24138b95457 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:59:03.180594 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-849e656e-272f-4393-9536-6abf812a177b req-c8f96d3c-e044-4a80-b164-a3365801734e service nova] Acquiring lock "63688346-f8e2-4fbe-987d-bf55df9fa3a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:03.180831 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-849e656e-272f-4393-9536-6abf812a177b req-c8f96d3c-e044-4a80-b164-a3365801734e service nova] Lock "63688346-f8e2-4fbe-987d-bf55df9fa3a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:03.180966 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-849e656e-272f-4393-9536-6abf812a177b req-c8f96d3c-e044-4a80-b164-a3365801734e service nova] Lock "63688346-f8e2-4fbe-987d-bf55df9fa3a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:03.181155 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-849e656e-272f-4393-9536-6abf812a177b req-c8f96d3c-e044-4a80-b164-a3365801734e service nova] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] No waiting events found dispatching network-vif-plugged-def344c1-e586-48f0-ad54-d24138b95457 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:59:03.181330 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-849e656e-272f-4393-9536-6abf812a177b req-c8f96d3c-e044-4a80-b164-a3365801734e service nova] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Received unexpected event network-vif-plugged-def344c1-e586-48f0-ad54-d24138b95457 for instance with vm_state active and task_state None.
May 28 01:59:03.182150 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-849e656e-272f-4393-9536-6abf812a177b req-c8f96d3c-e044-4a80-b164-a3365801734e service nova] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Received event network-vif-unplugged-5a4bd986-18c1-42d1-9574-9080c2f65867 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:59:03.182150 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-849e656e-272f-4393-9536-6abf812a177b req-c8f96d3c-e044-4a80-b164-a3365801734e service nova] Acquiring lock "668cf051-44c2-4db1-bfd1-dfeed0c6b5a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:03.182150 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-849e656e-272f-4393-9536-6abf812a177b req-c8f96d3c-e044-4a80-b164-a3365801734e service nova] Lock "668cf051-44c2-4db1-bfd1-dfeed0c6b5a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:03.182150 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-849e656e-272f-4393-9536-6abf812a177b req-c8f96d3c-e044-4a80-b164-a3365801734e service nova] Lock "668cf051-44c2-4db1-bfd1-dfeed0c6b5a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:03.184428 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-849e656e-272f-4393-9536-6abf812a177b req-c8f96d3c-e044-4a80-b164-a3365801734e service nova] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] No waiting events found dispatching network-vif-unplugged-5a4bd986-18c1-42d1-9574-9080c2f65867 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:59:03.184428 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-849e656e-272f-4393-9536-6abf812a177b req-c8f96d3c-e044-4a80-b164-a3365801734e service nova] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Received event network-vif-unplugged-5a4bd986-18c1-42d1-9574-9080c2f65867 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:59:03.184428 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-849e656e-272f-4393-9536-6abf812a177b req-c8f96d3c-e044-4a80-b164-a3365801734e service nova] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Received event network-vif-unplugged-5a4bd986-18c1-42d1-9574-9080c2f65867 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:59:03.184612 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-849e656e-272f-4393-9536-6abf812a177b req-c8f96d3c-e044-4a80-b164-a3365801734e service nova] Acquiring lock "668cf051-44c2-4db1-bfd1-dfeed0c6b5a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:03.186047 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-849e656e-272f-4393-9536-6abf812a177b req-c8f96d3c-e044-4a80-b164-a3365801734e service nova] Lock "668cf051-44c2-4db1-bfd1-dfeed0c6b5a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:03.186047 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-849e656e-272f-4393-9536-6abf812a177b req-c8f96d3c-e044-4a80-b164-a3365801734e service nova] Lock "668cf051-44c2-4db1-bfd1-dfeed0c6b5a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:03.186047 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-849e656e-272f-4393-9536-6abf812a177b req-c8f96d3c-e044-4a80-b164-a3365801734e service nova] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] No waiting events found dispatching network-vif-unplugged-5a4bd986-18c1-42d1-9574-9080c2f65867 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:59:03.186047 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-849e656e-272f-4393-9536-6abf812a177b req-c8f96d3c-e044-4a80-b164-a3365801734e service nova] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Received event network-vif-unplugged-5a4bd986-18c1-42d1-9574-9080c2f65867 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:59:03.362990 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:59:03.388121 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933543.3872614, 63688346-f8e2-4fbe-987d-bf55df9fa3a4 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:59:03.388121 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] VM Resumed (Lifecycle Event)
May 28 01:59:03.414248 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Took 17.10 seconds to build instance.
May 28 01:59:03.531025 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:03.540389 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:03.544869 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:03.575407 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:03.606284 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-cf8c5829-1b35-4083-b745-4028578b24c4 req-cc79482a-efa0-4c14-a291-c793d3587aa5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:59:03.618766 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-103ec748-bba7-4f6e-8847-21bcef1d0220 req-e1a87118-62e6-4aed-9f2d-abcf13ec1783 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:59:03.841609 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-103ec748-bba7-4f6e-8847-21bcef1d0220 req-e1a87118-62e6-4aed-9f2d-abcf13ec1783 service nova] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Updated VIF entry in instance network info cache for port aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:59:03.842115 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-103ec748-bba7-4f6e-8847-21bcef1d0220 req-e1a87118-62e6-4aed-9f2d-abcf13ec1783 service nova] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Updating instance_info_cache with network_info: [{"id": "aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8", "address": "fa:16:3e:df:45:21", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaec0d58f-da", "ovs_interfaceid": "aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:59:03.892906 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-cf8c5829-1b35-4083-b745-4028578b24c4 req-cc79482a-efa0-4c14-a291-c793d3587aa5 service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Updated VIF entry in instance network info cache for port 967dfb76-814b-43ba-ba2b-c14f407ff45e. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:59:03.894868 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-cf8c5829-1b35-4083-b745-4028578b24c4 req-cc79482a-efa0-4c14-a291-c793d3587aa5 service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Updating instance_info_cache with network_info: [{"id": "967dfb76-814b-43ba-ba2b-c14f407ff45e", "address": "fa:16:3e:e8:00:1f", "network": {"id": "e1d5d073-f27b-4ff1-9ed3-99f57407c76f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f65617e71571457f8906997583100678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap967dfb76-81", "ovs_interfaceid": "967dfb76-814b-43ba-ba2b-c14f407ff45e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:59:03.895724 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:59:03.902114 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:59:03.920049 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "63688346-f8e2-4fbe-987d-bf55df9fa3a4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.621s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:04.328670 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a27bc39e-faf6-4918-bedb-95ee75f4ed3e req-d469cb71-f824-4d1e-8794-d02764e1a42f service nova] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Received event network-vif-plugged-1bce33b1-57be-4de9-9e81-1a05535ae317 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:59:04.328860 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a27bc39e-faf6-4918-bedb-95ee75f4ed3e req-d469cb71-f824-4d1e-8794-d02764e1a42f service nova] Acquiring lock "8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:04.330460 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a27bc39e-faf6-4918-bedb-95ee75f4ed3e req-d469cb71-f824-4d1e-8794-d02764e1a42f service nova] Lock "8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:04.330460 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a27bc39e-faf6-4918-bedb-95ee75f4ed3e req-d469cb71-f824-4d1e-8794-d02764e1a42f service nova] Lock "8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:04.330460 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a27bc39e-faf6-4918-bedb-95ee75f4ed3e req-d469cb71-f824-4d1e-8794-d02764e1a42f service nova] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Processing event network-vif-plugged-1bce33b1-57be-4de9-9e81-1a05535ae317 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:59:04.330834 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:59:04.334371 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:59:04.336773 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Instance spawned successfully.
May 28 01:59:04.337249 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:59:04.348178 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-103ec748-bba7-4f6e-8847-21bcef1d0220 req-e1a87118-62e6-4aed-9f2d-abcf13ec1783 service nova] Releasing lock "refresh_cache-e3e9a0d0-72cd-459e-8bc4-cf080adb5267" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:59:04.396523 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-cf8c5829-1b35-4083-b745-4028578b24c4 req-cc79482a-efa0-4c14-a291-c793d3587aa5 service nova] Releasing lock "refresh_cache-27c37404-4df0-4ded-bf5b-6002e26d4222" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:59:04.408154 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933544.4078197, 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:59:04.408361 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] VM Started (Lifecycle Event)
May 28 01:59:04.602294 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:59:04.602294 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:59:04.603017 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] No VIF found with MAC fa:16:3e:df:45:21, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:59:04.604586 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Using config drive
May 28 01:59:04.844561 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:59:04.845062 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:59:04.845062 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:59:04.845062 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:59:04.845255 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:59:04.845459 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:59:04.915051 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:59:04.917584 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:59:05.047251 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:59:05.114453 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:59:05.275347 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Creating config drive at /opt/stack/data/nova/instances/e3e9a0d0-72cd-459e-8bc4-cf080adb5267/disk.config
May 28 01:59:05.281482 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e3e9a0d0-72cd-459e-8bc4-cf080adb5267/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpsof1o_0v {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:05.303749 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b25830ef-6e6f-41b3-b464-5e091284458f req-20b63aef-81f5-424f-bc4c-db0fc06e4888 service nova] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Received event network-changed-def344c1-e586-48f0-ad54-d24138b95457 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:59:05.304933 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b25830ef-6e6f-41b3-b464-5e091284458f req-20b63aef-81f5-424f-bc4c-db0fc06e4888 service nova] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Refreshing instance network info cache due to event network-changed-def344c1-e586-48f0-ad54-d24138b95457. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:59:05.305742 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b25830ef-6e6f-41b3-b464-5e091284458f req-20b63aef-81f5-424f-bc4c-db0fc06e4888 service nova] Acquiring lock "refresh_cache-63688346-f8e2-4fbe-987d-bf55df9fa3a4" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:59:05.305870 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b25830ef-6e6f-41b3-b464-5e091284458f req-20b63aef-81f5-424f-bc4c-db0fc06e4888 service nova] Acquired lock "refresh_cache-63688346-f8e2-4fbe-987d-bf55df9fa3a4" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:59:05.306067 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-b25830ef-6e6f-41b3-b464-5e091284458f req-20b63aef-81f5-424f-bc4c-db0fc06e4888 service nova] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Refreshing network info cache for port def344c1-e586-48f0-ad54-d24138b95457 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:59:05.346032 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e3e9a0d0-72cd-459e-8bc4-cf080adb5267/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpsof1o_0v" returned: 0 in 0.064s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:59:05.352096 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Took 8.09 seconds to spawn the instance on the hypervisor.
May 28 01:59:05.352895 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:59:05.421429 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:59:05.421873 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933545.4215767, 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:59:05.422046 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] VM Paused (Lifecycle Event)
May 28 01:59:05.551370 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Took 2.75 seconds to deallocate network for instance.
May 28 01:59:05.811571 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-b25830ef-6e6f-41b3-b464-5e091284458f req-20b63aef-81f5-424f-bc4c-db0fc06e4888 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:59:05.873599 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:05.879261 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Took 18.33 seconds to build instance.
May 28 01:59:05.910448 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:05.926136 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:59:05.932004 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933545.9316385, 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:59:05.932225 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] VM Resumed (Lifecycle Event)
May 28 01:59:06.023265 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:06.060298 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0453fb57-39fe-4b00-8c63-f3938e65952e tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:06.060370 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0453fb57-39fe-4b00-8c63-f3938e65952e tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:06.173821 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:06.174018 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:06.381938 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.842s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:06.402994 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-b25830ef-6e6f-41b3-b464-5e091284458f req-20b63aef-81f5-424f-bc4c-db0fc06e4888 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:59:06.437593 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:59:06.447270 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:59:06.491382 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-33499978-9dcf-4c26-9e1d-02405cd17f39 req-9a432c41-4b10-42e4-b00f-d5215653b28e service nova] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Received event network-vif-plugged-1bce33b1-57be-4de9-9e81-1a05535ae317 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:59:06.492793 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-33499978-9dcf-4c26-9e1d-02405cd17f39 req-9a432c41-4b10-42e4-b00f-d5215653b28e service nova] Acquiring lock "8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:06.493014 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-33499978-9dcf-4c26-9e1d-02405cd17f39 req-9a432c41-4b10-42e4-b00f-d5215653b28e service nova] Lock "8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:06.493213 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-33499978-9dcf-4c26-9e1d-02405cd17f39 req-9a432c41-4b10-42e4-b00f-d5215653b28e service nova] Lock "8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:06.493467 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-33499978-9dcf-4c26-9e1d-02405cd17f39 req-9a432c41-4b10-42e4-b00f-d5215653b28e service nova] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] No waiting events found dispatching network-vif-plugged-1bce33b1-57be-4de9-9e81-1a05535ae317 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:59:06.493596 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-33499978-9dcf-4c26-9e1d-02405cd17f39 req-9a432c41-4b10-42e4-b00f-d5215653b28e service nova] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Received unexpected event network-vif-plugged-1bce33b1-57be-4de9-9e81-1a05535ae317 for instance with vm_state active and task_state None.
May 28 01:59:06.493757 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-33499978-9dcf-4c26-9e1d-02405cd17f39 req-9a432c41-4b10-42e4-b00f-d5215653b28e service nova] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Received event network-vif-deleted-5a4bd986-18c1-42d1-9574-9080c2f65867 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:59:06.493861 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-33499978-9dcf-4c26-9e1d-02405cd17f39 req-9a432c41-4b10-42e4-b00f-d5215653b28e service nova] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Received event network-vif-plugged-aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:59:06.494146 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-33499978-9dcf-4c26-9e1d-02405cd17f39 req-9a432c41-4b10-42e4-b00f-d5215653b28e service nova] Acquiring lock "e3e9a0d0-72cd-459e-8bc4-cf080adb5267-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:06.494205 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-33499978-9dcf-4c26-9e1d-02405cd17f39 req-9a432c41-4b10-42e4-b00f-d5215653b28e service nova] Lock "e3e9a0d0-72cd-459e-8bc4-cf080adb5267-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:06.494323 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-33499978-9dcf-4c26-9e1d-02405cd17f39 req-9a432c41-4b10-42e4-b00f-d5215653b28e service nova] Lock "e3e9a0d0-72cd-459e-8bc4-cf080adb5267-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:06.494560 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-33499978-9dcf-4c26-9e1d-02405cd17f39 req-9a432c41-4b10-42e4-b00f-d5215653b28e service nova] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Processing event network-vif-plugged-aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:59:06.652988 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-b25830ef-6e6f-41b3-b464-5e091284458f req-20b63aef-81f5-424f-bc4c-db0fc06e4888 service nova] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Updated VIF entry in instance network info cache for port def344c1-e586-48f0-ad54-d24138b95457. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:59:06.653574 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-b25830ef-6e6f-41b3-b464-5e091284458f req-20b63aef-81f5-424f-bc4c-db0fc06e4888 service nova] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Updating instance_info_cache with network_info: [{"id": "def344c1-e586-48f0-ad54-d24138b95457", "address": "fa:16:3e:24:bb:c4", "network": {"id": "e8c2820e-c0c4-4756-9e11-38375b138d97", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-50364578-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ae04c11a3de34d419d69e1fdf4c7d311", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdef344c1-e5", "ovs_interfaceid": "def344c1-e586-48f0-ad54-d24138b95457", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:59:07.000688 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0453fb57-39fe-4b00-8c63-f3938e65952e tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:59:07.001140 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-0453fb57-39fe-4b00-8c63-f3938e65952e tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:59:07.051401 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:59:07.052213 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933547.0518763, e3e9a0d0-72cd-459e-8bc4-cf080adb5267 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:59:07.052985 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] VM Started (Lifecycle Event)
May 28 01:59:07.058882 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:59:07.062097 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Instance spawned successfully.
May 28 01:59:07.062486 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:59:07.156923 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b25830ef-6e6f-41b3-b464-5e091284458f req-20b63aef-81f5-424f-bc4c-db0fc06e4888 service nova] Releasing lock "refresh_cache-63688346-f8e2-4fbe-987d-bf55df9fa3a4" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:59:07.506450 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-0453fb57-39fe-4b00-8c63-f3938e65952e tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:59:07.559364 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:59:07.561196 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:59:07.570008 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:59:07.570008 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:59:07.570008 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:59:07.571137 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:59:07.571281 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:59:07.571811 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:59:08.022702 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0453fb57-39fe-4b00-8c63-f3938e65952e tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.962s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:08.051235 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:08.064525 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:59:08.064883 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933548.0646138, e3e9a0d0-72cd-459e-8bc4-cf080adb5267 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:59:08.065702 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] VM Paused (Lifecycle Event)
May 28 01:59:08.080197 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Took 7.94 seconds to spawn the instance on the hypervisor.
May 28 01:59:08.080309 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:59:08.108948 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-0453fb57-39fe-4b00-8c63-f3938e65952e tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Deleted allocations for instance 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4
May 28 01:59:08.162474 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:08.572464 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:59:08.574315 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f2c12da0-12ec-4a4d-a38c-22e5361d7cad req-cb5f2c4f-f204-449c-b645-5067f584b809 service nova] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Received event network-vif-plugged-aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:59:08.574465 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f2c12da0-12ec-4a4d-a38c-22e5361d7cad req-cb5f2c4f-f204-449c-b645-5067f584b809 service nova] Acquiring lock "e3e9a0d0-72cd-459e-8bc4-cf080adb5267-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:08.574884 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f2c12da0-12ec-4a4d-a38c-22e5361d7cad req-cb5f2c4f-f204-449c-b645-5067f584b809 service nova] Lock "e3e9a0d0-72cd-459e-8bc4-cf080adb5267-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:08.574884 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f2c12da0-12ec-4a4d-a38c-22e5361d7cad req-cb5f2c4f-f204-449c-b645-5067f584b809 service nova] Lock "e3e9a0d0-72cd-459e-8bc4-cf080adb5267-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:08.574884 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f2c12da0-12ec-4a4d-a38c-22e5361d7cad req-cb5f2c4f-f204-449c-b645-5067f584b809 service nova] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] No waiting events found dispatching network-vif-plugged-aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:59:08.574884 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-f2c12da0-12ec-4a4d-a38c-22e5361d7cad req-cb5f2c4f-f204-449c-b645-5067f584b809 service nova] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Received unexpected event network-vif-plugged-aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8 for instance with vm_state active and task_state None.
May 28 01:59:08.576453 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933548.576277, e3e9a0d0-72cd-459e-8bc4-cf080adb5267 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:59:08.576558 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] VM Resumed (Lifecycle Event)
May 28 01:59:08.597353 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Took 17.34 seconds to build instance.
May 28 01:59:08.786395 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Acquiring lock "8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:08.786845 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:09.078674 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:59:09.080316 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:59:09.099313 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-443be3a8-d90f-4400-9102-e89dd2b35fc2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "e3e9a0d0-72cd-459e-8bc4-cf080adb5267" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.870s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:09.121984 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0453fb57-39fe-4b00-8c63-f3938e65952e tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "668cf051-44c2-4db1-bfd1-dfeed0c6b5a4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.269s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:09.290982 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lazy-loading 'flavor' on Instance uuid 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:59:09.482515 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-10e368a8-d050-4b1b-a4b5-706bcff0bf68 req-d767bfed-05f5-487b-b691-81cbcf58b16f service nova] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Received event network-changed-cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:59:09.482715 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-10e368a8-d050-4b1b-a4b5-706bcff0bf68 req-d767bfed-05f5-487b-b691-81cbcf58b16f service nova] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Refreshing instance network info cache due to event network-changed-cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:59:09.482982 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-10e368a8-d050-4b1b-a4b5-706bcff0bf68 req-d767bfed-05f5-487b-b691-81cbcf58b16f service nova] Acquiring lock "refresh_cache-22bbb8cf-c11d-4025-8551-4c1c3557264a" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:59:09.483402 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-10e368a8-d050-4b1b-a4b5-706bcff0bf68 req-d767bfed-05f5-487b-b691-81cbcf58b16f service nova] Acquired lock "refresh_cache-22bbb8cf-c11d-4025-8551-4c1c3557264a" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:59:09.483402 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-10e368a8-d050-4b1b-a4b5-706bcff0bf68 req-d767bfed-05f5-487b-b691-81cbcf58b16f service nova] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Refreshing network info cache for port cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:59:09.990962 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-10e368a8-d050-4b1b-a4b5-706bcff0bf68 req-d767bfed-05f5-487b-b691-81cbcf58b16f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:59:10.303644 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.516s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:10.392529 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-10e368a8-d050-4b1b-a4b5-706bcff0bf68 req-d767bfed-05f5-487b-b691-81cbcf58b16f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:59:10.541449 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-046b87cc-05de-41af-ae98-284ab36f02f5 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "1100d127-f3d6-416e-a646-b072660980bc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:10.541449 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-046b87cc-05de-41af-ae98-284ab36f02f5 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "1100d127-f3d6-416e-a646-b072660980bc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:10.558891 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-10e368a8-d050-4b1b-a4b5-706bcff0bf68 req-d767bfed-05f5-487b-b691-81cbcf58b16f service nova] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Updated VIF entry in instance network info cache for port cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:59:10.559295 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-10e368a8-d050-4b1b-a4b5-706bcff0bf68 req-d767bfed-05f5-487b-b691-81cbcf58b16f service nova] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Updating instance_info_cache with network_info: [{"id": "cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b", "address": "fa:16:3e:d3:cd:06", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc6fcb39-fe", "ovs_interfaceid": "cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:59:11.043728 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-046b87cc-05de-41af-ae98-284ab36f02f5 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Detaching volume 26d4395d-39cc-4b5f-a50d-fff1446bdcaa
May 28 01:59:11.061576 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-10e368a8-d050-4b1b-a4b5-706bcff0bf68 req-d767bfed-05f5-487b-b691-81cbcf58b16f service nova] Releasing lock "refresh_cache-22bbb8cf-c11d-4025-8551-4c1c3557264a" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:59:11.086297 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-046b87cc-05de-41af-ae98-284ab36f02f5 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Attempting to driver detach volume 26d4395d-39cc-4b5f-a50d-fff1446bdcaa from mountpoint /dev/vdb
May 28 01:59:11.093169 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-046b87cc-05de-41af-ae98-284ab36f02f5 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Found disk vdb by alias ua-26d4395d-39cc-4b5f-a50d-fff1446bdcaa {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:59:11.098735 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-046b87cc-05de-41af-ae98-284ab36f02f5 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Found disk vdb by alias ua-26d4395d-39cc-4b5f-a50d-fff1446bdcaa {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:59:11.098914 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-046b87cc-05de-41af-ae98-284ab36f02f5 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Attempting to detach device vdb from instance 1100d127-f3d6-416e-a646-b072660980bc from the persistent domain config. {{(pid=98241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 01:59:11.099447 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-046b87cc-05de-41af-ae98-284ab36f02f5 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:59:11.099447 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:59:11.099447 np0000001583 nova-compute[98241]:   <alias name="ua-26d4395d-39cc-4b5f-a50d-fff1446bdcaa"/>
May 28 01:59:11.099447 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-5"/>
May 28 01:59:11.099447 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 01:59:11.099447 np0000001583 nova-compute[98241]:   <serial>26d4395d-39cc-4b5f-a50d-fff1446bdcaa</serial>
May 28 01:59:11.099447 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:59:11.099447 np0000001583 nova-compute[98241]: </disk>
May 28 01:59:11.099447 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:59:11.105936 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-046b87cc-05de-41af-ae98-284ab36f02f5 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Successfully detached device vdb from instance 1100d127-f3d6-416e-a646-b072660980bc from the persistent domain config.
May 28 01:59:11.106233 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-046b87cc-05de-41af-ae98-284ab36f02f5 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] (1/8): Attempting to detach device vdb with device alias ua-26d4395d-39cc-4b5f-a50d-fff1446bdcaa from instance 1100d127-f3d6-416e-a646-b072660980bc from the live domain config. {{(pid=98241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 01:59:11.106545 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-046b87cc-05de-41af-ae98-284ab36f02f5 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:59:11.106545 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:59:11.106545 np0000001583 nova-compute[98241]:   <alias name="ua-26d4395d-39cc-4b5f-a50d-fff1446bdcaa"/>
May 28 01:59:11.106545 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-5"/>
May 28 01:59:11.106545 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 01:59:11.106545 np0000001583 nova-compute[98241]:   <serial>26d4395d-39cc-4b5f-a50d-fff1446bdcaa</serial>
May 28 01:59:11.106545 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:59:11.106545 np0000001583 nova-compute[98241]: </disk>
May 28 01:59:11.106545 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:59:11.326922 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "22bbb8cf-c11d-4025-8551-4c1c3557264a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:11.327481 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "22bbb8cf-c11d-4025-8551-4c1c3557264a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:11.500014 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Acquiring lock "8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:11.500329 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:11.500549 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Attaching volume fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 to /dev/vdb
May 28 01:59:11.553787 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:59:11.557258 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d04d4b40-0633-4edd-bda0-52429730ec0e req-85f98092-f5ab-466a-891b-f43c46ce6d7c service nova] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Received event network-changed-aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:59:11.557525 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d04d4b40-0633-4edd-bda0-52429730ec0e req-85f98092-f5ab-466a-891b-f43c46ce6d7c service nova] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Refreshing instance network info cache due to event network-changed-aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:59:11.557770 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d04d4b40-0633-4edd-bda0-52429730ec0e req-85f98092-f5ab-466a-891b-f43c46ce6d7c service nova] Acquiring lock "refresh_cache-e3e9a0d0-72cd-459e-8bc4-cf080adb5267" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:59:11.557889 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d04d4b40-0633-4edd-bda0-52429730ec0e req-85f98092-f5ab-466a-891b-f43c46ce6d7c service nova] Acquired lock "refresh_cache-e3e9a0d0-72cd-459e-8bc4-cf080adb5267" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:59:11.558057 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-d04d4b40-0633-4edd-bda0-52429730ec0e req-85f98092-f5ab-466a-891b-f43c46ce6d7c service nova] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Refreshing network info cache for port aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:59:11.566546 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:59:11.592869 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:11.640679 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:59:11.641038 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:59:11.649306 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:59:11.651195 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe92:e25b', 'fe80::ecb9:b7ff:fe00:dc63', 'fe80::8832:afff:fe8a:cd4c', 'fe80::fc16:3eff:fe48:7d7b', 'fe80::d0cf:7bff:fef9:3cc3', 'fe80::fc16:3eff:feca:d649', 'fe80::fc16:3eff:fe20:c750', 'fe80::34e0:eeff:fee2:bede', 'fe80::fc16:3eff:fed3:cd06', 'fe80::fc16:3eff:feae:1e12', 'fe80::fc16:3eff:feca:8ce2', 'fe80::5048:4dff:fe67:fb12', 'fe80::fc16:3eff:fee8:1f', 'fe80::fc16:3eff:fe24:bbc4', 'fe80::b0dd:40ff:feb5:6704', 'fe80::fc16:3eff:feae:cc0f', 'fe80::9020:88ff:fe40:d02', 'fe80::fc16:3eff:fedf:4521'] 
May 28 01:59:11.651360 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:59:11.651493 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:59:11.651788 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] <== get_connector_properties: return (97ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:59:11.656500 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Updating existing volume attachment record: f3dc0162-8926-43c9-9c9d-61d0463fc1b8 {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:59:11.659612 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Received event <DeviceRemovedEvent: 1779933551.6565702, 1100d127-f3d6-416e-a646-b072660980bc => ua-26d4395d-39cc-4b5f-a50d-fff1446bdcaa> from libvirt while the driver is waiting for it; dispatched. {{(pid=98241) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 01:59:11.660378 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-046b87cc-05de-41af-ae98-284ab36f02f5 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-26d4395d-39cc-4b5f-a50d-fff1446bdcaa for instance 1100d127-f3d6-416e-a646-b072660980bc {{(pid=98241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 01:59:11.662737 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-046b87cc-05de-41af-ae98-284ab36f02f5 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Successfully detached device vdb from instance 1100d127-f3d6-416e-a646-b072660980bc from the live domain config.
May 28 01:59:11.663684 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-046b87cc-05de-41af-ae98-284ab36f02f5 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 1100d127-f3d6-416e-a646-b072660980bc] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:59:11.664029 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-046b87cc-05de-41af-ae98-284ab36f02f5 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa', 'iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '26d4395d-39cc-4b5f-a50d-fff1446bdcaa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:59:11.664193 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-046b87cc-05de-41af-ae98-284ab36f02f5 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:59:11.664588 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-046b87cc-05de-41af-ae98-284ab36f02f5 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:59:11.664841 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-046b87cc-05de-41af-ae98-284ab36f02f5 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa', 'iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '26d4395d-39cc-4b5f-a50d-fff1446bdcaa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:59:11.664977 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-046b87cc-05de-41af-ae98-284ab36f02f5 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:59:11.698723 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-046b87cc-05de-41af-ae98-284ab36f02f5 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa (non-flash)
May 28 01:59:11.698723 np0000001583 nova-compute[98241]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa (non-flash)
May 28 01:59:11.698723 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:11.698723 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:11.698723 np0000001583 nova-compute[98241]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:11.698723 np0000001583 nova-compute[98241]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:11.698723 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:59:11.698723 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-046b87cc-05de-41af-ae98-284ab36f02f5 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa (non-flash)
May 28 01:59:11.698723 np0000001583 nova-compute[98241]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa (non-flash)
May 28 01:59:11.698723 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:11.698723 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:11.698723 np0000001583 nova-compute[98241]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:11.698723 np0000001583 nova-compute[98241]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:11.698723 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:59:11.699336 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-046b87cc-05de-41af-ae98-284ab36f02f5 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', '68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', '69'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b', '70'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b', '71')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:59:11.699443 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-046b87cc-05de-41af-ae98-284ab36f02f5 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa', '66')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:59:11.700496 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-046b87cc-05de-41af-ae98-284ab36f02f5 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa', '67')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:59:11.701046 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-046b87cc-05de-41af-ae98-284ab36f02f5 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f8331d00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa'): ({'sdg'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:59:11.701208 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-046b87cc-05de-41af-ae98-284ab36f02f5 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Removing multipathed devices sdf, sdg {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:59:11.701775 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-046b87cc-05de-41af-ae98-284ab36f02f5 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Flush multipath device 3300000002afce0fc {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:59:11.742182 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-046b87cc-05de-41af-ae98-284ab36f02f5 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:59:11.799623 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-046b87cc-05de-41af-ae98-284ab36f02f5 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:59:11.833483 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lazy-loading 'flavor' on Instance uuid 22bbb8cf-c11d-4025-8551-4c1c3557264a {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:59:11.838502 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-046b87cc-05de-41af-ae98-284ab36f02f5 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:59:11.838699 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-046b87cc-05de-41af-ae98-284ab36f02f5 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:59:11.839899 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-046b87cc-05de-41af-ae98-284ab36f02f5 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:59:11.851715 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-046b87cc-05de-41af-ae98-284ab36f02f5 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:59:11.851940 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-046b87cc-05de-41af-ae98-284ab36f02f5 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:59:11.863023 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-046b87cc-05de-41af-ae98-284ab36f02f5 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:11.890863 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-046b87cc-05de-41af-ae98-284ab36f02f5 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 66, target: iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa, portal: 192.168.40.100,3260]
May 28 01:59:11.890863 np0000001583 nova-compute[98241]: Logout of [sid: 66, target: iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa, portal: 192.168.40.100,3260] successful.
May 28 01:59:11.890863 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:11.905423 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-046b87cc-05de-41af-ae98-284ab36f02f5 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:11.917734 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-046b87cc-05de-41af-ae98-284ab36f02f5 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:11.951270 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-046b87cc-05de-41af-ae98-284ab36f02f5 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa, portal: 192.168.50.100,3260]
May 28 01:59:11.951270 np0000001583 nova-compute[98241]: Logout of [sid: 67, target: iqn.2023-03.storpool.com:os--volume-26d4395d-39cc-4b5f-a50d-fff1446bdcaa, portal: 192.168.50.100,3260] successful.
May 28 01:59:11.951270 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:11.967943 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-046b87cc-05de-41af-ae98-284ab36f02f5 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:11.968514 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-046b87cc-05de-41af-ae98-284ab36f02f5 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:59:11.968514 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-046b87cc-05de-41af-ae98-284ab36f02f5 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] <== disconnect_volume: return (303ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:59:11.968514 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-046b87cc-05de-41af-ae98-284ab36f02f5 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:59:12.061230 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-d04d4b40-0633-4edd-bda0-52429730ec0e req-85f98092-f5ab-466a-891b-f43c46ce6d7c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:59:12.211210 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:59:12.211210 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', 'iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:59:12.211210 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:59:12.211210 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:59:12.211469 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', 'iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:59:12.226946 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:59:12.227387 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:59:12.230876 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:59:12.230876 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:59:12.230876 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:59:12.230876 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:59:12.243104 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:59:12.243104 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:12.261177 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:59:12.261177 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:12.262026 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9] added
May 28 01:59:12.262026 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:59:12.262026 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:59:12.262026 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:59:12.262026 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:59:12.262026 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:59:12.262026 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:12.263153 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:59:12.263153 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0349(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:59:12.263350 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:59:12.275752 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9] added
May 28 01:59:12.275752 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:59:12.275752 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:59:12.275752 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:59:12.275752 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:59:12.275752 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:59:12.275752 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:12.275983 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:59:12.277993 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0473(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:59:12.277993 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:59:12.441307 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-d04d4b40-0633-4edd-bda0-52429730ec0e req-85f98092-f5ab-466a-891b-f43c46ce6d7c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:59:12.535205 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-046b87cc-05de-41af-ae98-284ab36f02f5 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lazy-loading 'flavor' on Instance uuid 1100d127-f3d6-416e-a646-b072660980bc {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:59:12.583768 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-d04d4b40-0633-4edd-bda0-52429730ec0e req-85f98092-f5ab-466a-891b-f43c46ce6d7c service nova] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Updated VIF entry in instance network info cache for port aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:59:12.584023 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-d04d4b40-0633-4edd-bda0-52429730ec0e req-85f98092-f5ab-466a-891b-f43c46ce6d7c service nova] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Updating instance_info_cache with network_info: [{"id": "aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8", "address": "fa:16:3e:df:45:21", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaec0d58f-da", "ovs_interfaceid": "aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:59:12.840321 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "22bbb8cf-c11d-4025-8551-4c1c3557264a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.513s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:13.053254 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:13.085881 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d04d4b40-0633-4edd-bda0-52429730ec0e req-85f98092-f5ab-466a-891b-f43c46ce6d7c service nova] Releasing lock "refresh_cache-e3e9a0d0-72cd-459e-8bc4-cf080adb5267" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:59:13.166936 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:13.263835 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:59:13.276873 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:59:13.278067 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:59:13.278067 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:59:13.295928 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:59:13.295928 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:13.306566 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:13.313950 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:13.328491 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:13.328491 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:13.328491 np0000001583 nova-compute[98241]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:13.328491 np0000001583 nova-compute[98241]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:13.328491 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:59:13.328722 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:13.328722 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:13.328722 np0000001583 nova-compute[98241]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:13.328722 np0000001583 nova-compute[98241]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:13.328722 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:59:13.338640 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:13.338640 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:13.338640 np0000001583 nova-compute[98241]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:13.338640 np0000001583 nova-compute[98241]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:13.338640 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:59:13.338930 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:13.338930 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:13.338930 np0000001583 nova-compute[98241]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:13.338930 np0000001583 nova-compute[98241]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:13.338930 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:59:13.370743 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9, portal: 192.168.40.100,3260]
May 28 01:59:13.370743 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9, portal: 192.168.40.100,3260] successful.
May 28 01:59:13.370743 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:13.386476 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9, portal: 192.168.50.100,3260]
May 28 01:59:13.386476 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9, portal: 192.168.50.100,3260] successful.
May 28 01:59:13.386476 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:13.394062 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:13.404935 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:13.419800 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:13.419800 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:13.419800 np0000001583 nova-compute[98241]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:13.419800 np0000001583 nova-compute[98241]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:13.419800 np0000001583 nova-compute[98241]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:13.419800 np0000001583 nova-compute[98241]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:13.419800 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:59:13.419800 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:13.419800 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:13.419800 np0000001583 nova-compute[98241]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:13.419800 np0000001583 nova-compute[98241]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:13.419800 np0000001583 nova-compute[98241]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:13.419800 np0000001583 nova-compute[98241]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:13.419800 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:59:13.419800 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.191s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:59:13.419800 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:59:13.421164 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] HCTL ('11', '-', '-', 0) found on session 72 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:59:13.421164 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:59:13.431467 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:13.431467 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:13.431467 np0000001583 nova-compute[98241]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:13.431467 np0000001583 nova-compute[98241]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:13.431467 np0000001583 nova-compute[98241]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:13.431467 np0000001583 nova-compute[98241]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:13.431467 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:59:13.431467 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:13.431467 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:13.431467 np0000001583 nova-compute[98241]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:13.431467 np0000001583 nova-compute[98241]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:13.431467 np0000001583 nova-compute[98241]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:13.431467 np0000001583 nova-compute[98241]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:13.431467 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:59:13.431804 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.203s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:59:13.431804 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:59:13.432547 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] HCTL ('12', '-', '-', 0) found on session 73 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:59:13.432630 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:59:13.444364 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Searching for a device in session 72 and hctl ['11', '*', '*', 0] yield: None {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:59:13.456063 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Searching for a device in session 73 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:59:13.456063 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:59:13.542292 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-046b87cc-05de-41af-ae98-284ab36f02f5 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "1100d127-f3d6-416e-a646-b072660980bc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:13.918899 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-cb8c12c5-4d9e-45b7-a2a1-0a9efd4201a7 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "1100d127-f3d6-416e-a646-b072660980bc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:13.919036 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-cb8c12c5-4d9e-45b7-a2a1-0a9efd4201a7 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "1100d127-f3d6-416e-a646-b072660980bc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:13.919260 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-cb8c12c5-4d9e-45b7-a2a1-0a9efd4201a7 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "1100d127-f3d6-416e-a646-b072660980bc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:13.919448 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-cb8c12c5-4d9e-45b7-a2a1-0a9efd4201a7 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "1100d127-f3d6-416e-a646-b072660980bc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:13.919627 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-cb8c12c5-4d9e-45b7-a2a1-0a9efd4201a7 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "1100d127-f3d6-416e-a646-b072660980bc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:13.922001 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cb8c12c5-4d9e-45b7-a2a1-0a9efd4201a7 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Terminating instance
May 28 01:59:14.055422 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "22bbb8cf-c11d-4025-8551-4c1c3557264a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:14.055597 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "22bbb8cf-c11d-4025-8551-4c1c3557264a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:14.055760 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Attaching volume 146fbda9-15e8-4bd7-911b-f03b9308c11b to /dev/vdb
May 28 01:59:14.109483 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:59:14.122265 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:59:14.150027 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:14.188631 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:59:14.188927 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:59:14.201395 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:59:14.203524 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe92:e25b', 'fe80::ecb9:b7ff:fe00:dc63', 'fe80::8832:afff:fe8a:cd4c', 'fe80::fc16:3eff:fe48:7d7b', 'fe80::d0cf:7bff:fef9:3cc3', 'fe80::fc16:3eff:feca:d649', 'fe80::fc16:3eff:fe20:c750', 'fe80::34e0:eeff:fee2:bede', 'fe80::fc16:3eff:fed3:cd06', 'fe80::fc16:3eff:feae:1e12', 'fe80::fc16:3eff:feca:8ce2', 'fe80::5048:4dff:fe67:fb12', 'fe80::fc16:3eff:fee8:1f', 'fe80::fc16:3eff:fe24:bbc4', 'fe80::b0dd:40ff:feb5:6704', 'fe80::fc16:3eff:feae:cc0f', 'fe80::9020:88ff:fe40:d02', 'fe80::fc16:3eff:fedf:4521'] 
May 28 01:59:14.203684 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:59:14.203789 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:59:14.204095 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] <== get_connector_properties: return (94ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:59:14.204422 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Updating existing volume attachment record: 7c15f25e-767a-4a0d-a148-027ab1e8f647 {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:59:14.427043 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cb8c12c5-4d9e-45b7-a2a1-0a9efd4201a7 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:59:14.445341 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Searching for a device in session 72 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:59:14.445724 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:59:14.458265 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:14.512219 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:14.543250 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:14.646429 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9d373970-4722-480b-a013-51569ae57401 req-b6f71bd0-09fc-43da-80a3-3dc53f44c63c service nova] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Received event network-vif-unplugged-addc7428-573c-4e5e-bb8f-096648f17132 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:59:14.646429 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9d373970-4722-480b-a013-51569ae57401 req-b6f71bd0-09fc-43da-80a3-3dc53f44c63c service nova] Acquiring lock "1100d127-f3d6-416e-a646-b072660980bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:14.652149 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9d373970-4722-480b-a013-51569ae57401 req-b6f71bd0-09fc-43da-80a3-3dc53f44c63c service nova] Lock "1100d127-f3d6-416e-a646-b072660980bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:14.652909 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9d373970-4722-480b-a013-51569ae57401 req-b6f71bd0-09fc-43da-80a3-3dc53f44c63c service nova] Lock "1100d127-f3d6-416e-a646-b072660980bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.007s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:14.653066 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9d373970-4722-480b-a013-51569ae57401 req-b6f71bd0-09fc-43da-80a3-3dc53f44c63c service nova] [instance: 1100d127-f3d6-416e-a646-b072660980bc] No waiting events found dispatching network-vif-unplugged-addc7428-573c-4e5e-bb8f-096648f17132 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:59:14.653223 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9d373970-4722-480b-a013-51569ae57401 req-b6f71bd0-09fc-43da-80a3-3dc53f44c63c service nova] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Received event network-vif-unplugged-addc7428-573c-4e5e-bb8f-096648f17132 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:59:14.781613 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:59:14.781613 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b', 'iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '146fbda9-15e8-4bd7-911b-f03b9308c11b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:59:14.781613 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:59:14.786973 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999604784999974 future=<Future at 0x7724f831ac90 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:59:14.788976 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Instance destroyed successfully.
May 28 01:59:14.789748 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-cb8c12c5-4d9e-45b7-a2a1-0a9efd4201a7 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lazy-loading 'resources' on Instance uuid 1100d127-f3d6-416e-a646-b072660980bc {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:59:15.248340 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Found WWN 330000000f1131f9e for multipath device dm-5 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:59:15.248654 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:59:15.249097 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] <== connect_volume: return (3038ms) {'type': 'block', 'scsi_wwn': '330000000f1131f9e', 'path': '/dev/dm-5', 'multipath_id': '330000000f1131f9e'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:59:15.249278 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f1131f9e', 'path': '/dev/dm-5', 'multipath_id': '330000000f1131f9e'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:59:15.249697 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.468s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:59:15.250270 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b', 'iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '146fbda9-15e8-4bd7-911b-f03b9308c11b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:59:15.252160 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lazy-loading 'flavor' on Instance uuid 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:59:15.265586 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:59:15.266044 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:59:15.266601 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:59:15.266811 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:59:15.267296 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:59:15.267487 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:59:15.282942 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:59:15.282942 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:15.291321 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:59:15.291321 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:15.294450 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-cb8c12c5-4d9e-45b7-a2a1-0a9efd4201a7 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:56:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-62369716',display_name='tempest-AttachVolumeNegativeTest-server-62369716',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-attachvolumenegativetest-server-62369716',id=26,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBfW7IFXJjWOYq3eCq2aqExUMzvjYvgU907FlYR/n8nl7Vof3eMqYKZUQnxzR4TW0LrAMe7GgYL2dH4bjZ1gr2Pe89Z3BD2G3RVOrg7fW4OHXlv3ASmhxMYDzifFzgLWg==',key_name='tempest-keypair-1768809071',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:57:14Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='837663bcfa40402aaf583729dfbb26cd',ramdisk_id='',reservation_id='r-qt95u7wp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-169599115',owner_user_name='tempest-AttachVolumeNegativeTest-169599115-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:57:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='00cb6190618b45eb994dd16d3c657f01',uuid=1100d127-f3d6-416e-a646-b072660980bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "addc7428-573c-4e5e-bb8f-096648f17132", "address": "fa:16:3e:92:e2:5b", "network": {"id": "62e7cc38-1758-4b09-a352-4635adc9cfea", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587967507-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "837663bcfa40402aaf583729dfbb26cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaddc7428-57", "ovs_interfaceid": "addc7428-573c-4e5e-bb8f-096648f17132", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:59:15.294721 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-cb8c12c5-4d9e-45b7-a2a1-0a9efd4201a7 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Converting VIF {"id": "addc7428-573c-4e5e-bb8f-096648f17132", "address": "fa:16:3e:92:e2:5b", "network": {"id": "62e7cc38-1758-4b09-a352-4635adc9cfea", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587967507-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "837663bcfa40402aaf583729dfbb26cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaddc7428-57", "ovs_interfaceid": "addc7428-573c-4e5e-bb8f-096648f17132", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:59:15.297015 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-cb8c12c5-4d9e-45b7-a2a1-0a9efd4201a7 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:e2:5b,bridge_name='br-int',has_traffic_filtering=True,id=addc7428-573c-4e5e-bb8f-096648f17132,network=Network(62e7cc38-1758-4b09-a352-4635adc9cfea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaddc7428-57') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:59:15.297319 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-cb8c12c5-4d9e-45b7-a2a1-0a9efd4201a7 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:e2:5b,bridge_name='br-int',has_traffic_filtering=True,id=addc7428-573c-4e5e-bb8f-096648f17132,network=Network(62e7cc38-1758-4b09-a352-4635adc9cfea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaddc7428-57') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:59:15.299274 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:15.299764 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaddc7428-57, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:59:15.302322 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b] added
May 28 01:59:15.302322 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:59:15.302322 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:59:15.302322 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:59:15.302322 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:59:15.302322 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:59:15.302322 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:15.302695 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:59:15.305205 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0359(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:59:15.305205 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:15.305205 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:59:15.305205 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:59:15.305642 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:15.305802 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=68697d5a-6cb9-43f7-b8d2-c11920819da9) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:59:15.307094 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:15.307289 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:59:15.308037 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b] added
May 28 01:59:15.308037 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:59:15.308037 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:59:15.308037 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:59:15.308037 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:59:15.308037 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:59:15.308037 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:15.308272 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:15.308428 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:59:15.308558 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0411(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:59:15.308715 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:59:15.311174 np0000001583 nova-compute[98241]: INFO os_vif [None req-cb8c12c5-4d9e-45b7-a2a1-0a9efd4201a7 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:e2:5b,bridge_name='br-int',has_traffic_filtering=True,id=addc7428-573c-4e5e-bb8f-096648f17132,network=Network(62e7cc38-1758-4b09-a352-4635adc9cfea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaddc7428-57')
May 28 01:59:15.311557 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-cb8c12c5-4d9e-45b7-a2a1-0a9efd4201a7 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Deleting instance files /opt/stack/data/nova/instances/1100d127-f3d6-416e-a646-b072660980bc_del
May 28 01:59:15.312507 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-cb8c12c5-4d9e-45b7-a2a1-0a9efd4201a7 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Deletion of /opt/stack/data/nova/instances/1100d127-f3d6-416e-a646-b072660980bc_del complete
May 28 01:59:15.755678 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Attempting to attach volume fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98241) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 01:59:15.757102 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] attach device xml: <disk type="block" device="disk">
May 28 01:59:15.757102 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:59:15.757102 np0000001583 nova-compute[98241]:   <alias name="ua-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9"/>
May 28 01:59:15.757102 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-5"/>
May 28 01:59:15.757102 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 01:59:15.757102 np0000001583 nova-compute[98241]:   <serial>fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9</serial>
May 28 01:59:15.757102 np0000001583 nova-compute[98241]: </disk>
May 28 01:59:15.757102 np0000001583 nova-compute[98241]:  {{(pid=98241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 01:59:15.821238 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cb8c12c5-4d9e-45b7-a2a1-0a9efd4201a7 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Took 1.40 seconds to destroy the instance on the hypervisor.
May 28 01:59:15.821714 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-cb8c12c5-4d9e-45b7-a2a1-0a9efd4201a7 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:59:15.821870 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:59:15.822000 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 1100d127-f3d6-416e-a646-b072660980bc] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:59:15.822329 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:59:15.978202 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:59:16.305043 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:59:16.309513 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:59:16.319685 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:59:16.319685 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:59:16.331057 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:59:16.331057 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:16.339871 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:16.351949 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:16.362645 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:16.362645 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:16.362645 np0000001583 nova-compute[98241]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:16.362645 np0000001583 nova-compute[98241]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:16.362645 np0000001583 nova-compute[98241]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:16.362645 np0000001583 nova-compute[98241]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:16.362645 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:59:16.362847 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:16.362847 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:16.362847 np0000001583 nova-compute[98241]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:16.362847 np0000001583 nova-compute[98241]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:16.362847 np0000001583 nova-compute[98241]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:16.362847 np0000001583 nova-compute[98241]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:16.362847 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:59:16.373782 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:16.373782 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:16.373782 np0000001583 nova-compute[98241]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:16.373782 np0000001583 nova-compute[98241]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:16.373782 np0000001583 nova-compute[98241]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:16.373782 np0000001583 nova-compute[98241]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:16.373782 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:59:16.373782 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:16.373782 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:16.373782 np0000001583 nova-compute[98241]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:16.373782 np0000001583 nova-compute[98241]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:16.373782 np0000001583 nova-compute[98241]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:16.373782 np0000001583 nova-compute[98241]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:16.373782 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:59:16.414477 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b, portal: 192.168.50.100,3260]
May 28 01:59:16.414477 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b, portal: 192.168.50.100,3260] successful.
May 28 01:59:16.414477 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:16.424646 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b, portal: 192.168.40.100,3260]
May 28 01:59:16.424646 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b, portal: 192.168.40.100,3260] successful.
May 28 01:59:16.424646 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:16.432296 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:16.441709 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:16.454637 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:16.454637 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:16.454637 np0000001583 nova-compute[98241]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:16.454637 np0000001583 nova-compute[98241]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:16.454637 np0000001583 nova-compute[98241]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:16.454637 np0000001583 nova-compute[98241]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:16.454637 np0000001583 nova-compute[98241]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b (non-flash)
May 28 01:59:16.454637 np0000001583 nova-compute[98241]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b (non-flash)
May 28 01:59:16.454637 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:59:16.454637 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:16.454637 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:16.454637 np0000001583 nova-compute[98241]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:16.454637 np0000001583 nova-compute[98241]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:16.454637 np0000001583 nova-compute[98241]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:16.454637 np0000001583 nova-compute[98241]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:16.454637 np0000001583 nova-compute[98241]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b (non-flash)
May 28 01:59:16.454637 np0000001583 nova-compute[98241]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b (non-flash)
May 28 01:59:16.454637 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:59:16.454637 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.188s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:59:16.454637 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:59:16.457949 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] HCTL ('13', '-', '-', 0) found on session 74 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:59:16.457949 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:59:16.464818 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:16.464818 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:16.464818 np0000001583 nova-compute[98241]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:16.464818 np0000001583 nova-compute[98241]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:16.464818 np0000001583 nova-compute[98241]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:16.464818 np0000001583 nova-compute[98241]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:16.464818 np0000001583 nova-compute[98241]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b (non-flash)
May 28 01:59:16.464818 np0000001583 nova-compute[98241]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b (non-flash)
May 28 01:59:16.464818 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:59:16.465393 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:16.465393 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:16.465393 np0000001583 nova-compute[98241]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:16.465393 np0000001583 nova-compute[98241]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:16.465393 np0000001583 nova-compute[98241]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:16.465393 np0000001583 nova-compute[98241]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:16.465393 np0000001583 nova-compute[98241]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b (non-flash)
May 28 01:59:16.465393 np0000001583 nova-compute[98241]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b (non-flash)
May 28 01:59:16.465393 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:59:16.465831 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.199s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:59:16.466596 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:59:16.468772 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] HCTL ('14', '-', '-', 0) found on session 75 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:59:16.470042 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:59:16.483506 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Searching for a device in session 74 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:59:16.483590 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '146fbda9-15e8-4bd7-911b-f03b9308c11b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:59:16.499036 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Searching for a device in session 75 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:59:16.499036 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '146fbda9-15e8-4bd7-911b-f03b9308c11b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:59:16.604807 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b5a5f554-1074-4b35-aa0a-428df991926a req-5f068fdc-da32-493f-a61b-d3ad9d0996ca service nova] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Received event network-vif-deleted-addc7428-573c-4e5e-bb8f-096648f17132 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:59:16.605739 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-b5a5f554-1074-4b35-aa0a-428df991926a req-5f068fdc-da32-493f-a61b-d3ad9d0996ca service nova] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Neutron deleted interface addc7428-573c-4e5e-bb8f-096648f17132; detaching it from the instance and deleting it from the info cache
May 28 01:59:16.607113 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b5a5f554-1074-4b35-aa0a-428df991926a req-5f068fdc-da32-493f-a61b-d3ad9d0996ca service nova] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Detach interface failed, port_id=addc7428-573c-4e5e-bb8f-096648f17132, reason: Instance 1100d127-f3d6-416e-a646-b072660980bc could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:59:16.743422 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b78c4146-8471-4187-86f4-36f1816d4584 req-b9c0506b-142c-4956-961b-bf2e80ce0a83 service nova] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Received event network-vif-unplugged-addc7428-573c-4e5e-bb8f-096648f17132 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:59:16.744150 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b78c4146-8471-4187-86f4-36f1816d4584 req-b9c0506b-142c-4956-961b-bf2e80ce0a83 service nova] Acquiring lock "1100d127-f3d6-416e-a646-b072660980bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:16.744432 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b78c4146-8471-4187-86f4-36f1816d4584 req-b9c0506b-142c-4956-961b-bf2e80ce0a83 service nova] Lock "1100d127-f3d6-416e-a646-b072660980bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:16.744658 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b78c4146-8471-4187-86f4-36f1816d4584 req-b9c0506b-142c-4956-961b-bf2e80ce0a83 service nova] Lock "1100d127-f3d6-416e-a646-b072660980bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:16.744846 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b78c4146-8471-4187-86f4-36f1816d4584 req-b9c0506b-142c-4956-961b-bf2e80ce0a83 service nova] [instance: 1100d127-f3d6-416e-a646-b072660980bc] No waiting events found dispatching network-vif-unplugged-addc7428-573c-4e5e-bb8f-096648f17132 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:59:16.744976 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b78c4146-8471-4187-86f4-36f1816d4584 req-b9c0506b-142c-4956-961b-bf2e80ce0a83 service nova] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Received event network-vif-unplugged-addc7428-573c-4e5e-bb8f-096648f17132 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:59:16.748167 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.00027425799999036826 future=<Future at 0x7724f8190650 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:59:16.748283 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:59:16.748336 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=13.038172263999968 future=<Future at 0x7724f831ac90 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:59:16.748422 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=13.038106968999728 future=<Future at 0x7724f831ac90 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:59:16.750687 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] Emitting event <LifecycleEvent: 1779933541.7478049, 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:59:16.750687 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] VM Stopped (Lifecycle Event)
May 28 01:59:17.032220 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:59:17.253243 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f300951c-772c-4fc7-acfd-840c96f6aa49 tempest-TaggedAttachmentsTest-1060566416 tempest-TaggedAttachmentsTest-1060566416-project-member] [instance: 668cf051-44c2-4db1-bfd1-dfeed0c6b5a4] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:59:17.268185 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:59:17.419501 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:59:17.419839 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:59:17.420103 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:59:17.420186 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] No VIF found with MAC fa:16:3e:ae:cc:0f, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:59:17.534384 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Took 1.71 seconds to deallocate network for instance.
May 28 01:59:18.044125 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-cb8c12c5-4d9e-45b7-a2a1-0a9efd4201a7 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:18.044125 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-cb8c12c5-4d9e-45b7-a2a1-0a9efd4201a7 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:18.168746 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:18.288922 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Found WWN 330000000400f98cc for multipath device dm-7 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:59:18.289276 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:59:18.289501 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] <== connect_volume: return (3507ms) {'type': 'block', 'scsi_wwn': '330000000400f98cc', 'path': '/dev/dm-7', 'multipath_id': '330000000400f98cc'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:59:18.289650 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000400f98cc', 'path': '/dev/dm-7', 'multipath_id': '330000000400f98cc'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:59:18.297854 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lazy-loading 'flavor' on Instance uuid 22bbb8cf-c11d-4025-8551-4c1c3557264a {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:59:18.629311 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cb8c12c5-4d9e-45b7-a2a1-0a9efd4201a7 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:59:18.629681 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-cb8c12c5-4d9e-45b7-a2a1-0a9efd4201a7 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:59:18.801416 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Attempting to attach volume 146fbda9-15e8-4bd7-911b-f03b9308c11b with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98241) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 01:59:18.802890 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] attach device xml: <disk type="block" device="disk">
May 28 01:59:18.802890 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:59:18.802890 np0000001583 nova-compute[98241]:   <alias name="ua-146fbda9-15e8-4bd7-911b-f03b9308c11b"/>
May 28 01:59:18.802890 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-7"/>
May 28 01:59:18.802890 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 01:59:18.802890 np0000001583 nova-compute[98241]:   <serial>146fbda9-15e8-4bd7-911b-f03b9308c11b</serial>
May 28 01:59:18.802890 np0000001583 nova-compute[98241]:   <shareable/>
May 28 01:59:18.802890 np0000001583 nova-compute[98241]: </disk>
May 28 01:59:18.802890 np0000001583 nova-compute[98241]:  {{(pid=98241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 01:59:18.991065 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-47725828-15c6-45e5-9fce-3328ba1e0a35 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.490s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:19.132634 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-cb8c12c5-4d9e-45b7-a2a1-0a9efd4201a7 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:59:19.195931 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:59:19.195931 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:59:19.195931 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:59:19.195931 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:59:19.195931 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:59:19.195931 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:59:19.195931 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:59:19.195931 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:59:19.195931 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 01:59:19.195931 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:59:19.640886 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-cb8c12c5-4d9e-45b7-a2a1-0a9efd4201a7 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.599s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:19.696896 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-cb8c12c5-4d9e-45b7-a2a1-0a9efd4201a7 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Deleted allocations for instance 1100d127-f3d6-416e-a646-b072660980bc
May 28 01:59:19.701211 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:19.701428 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:19.701581 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:19.701721 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Auditing locally available compute resources for np0000001583 (node: np0000001583) {{(pid=98241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 01:59:20.307803 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:20.487552 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:59:20.487776 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:59:20.487924 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:59:20.488038 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] No VIF found with MAC fa:16:3e:d3:cd:06, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:59:20.715031 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-cb8c12c5-4d9e-45b7-a2a1-0a9efd4201a7 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "1100d127-f3d6-416e-a646-b072660980bc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.795s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:20.756624 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:20.896655 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:59:20.896655 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:21.021692 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d/disk --force-share --output=json" returned: 0 in 0.124s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:59:21.021692 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/dm-5 (vdb) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:59:21.029169 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e9a0d0-72cd-459e-8bc4-cf080adb5267/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:21.167985 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e9a0d0-72cd-459e-8bc4-cf080adb5267/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:59:21.169764 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e9a0d0-72cd-459e-8bc4-cf080adb5267/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:21.298637 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e9a0d0-72cd-459e-8bc4-cf080adb5267/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:59:21.308499 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bbb8cf-c11d-4025-8551-4c1c3557264a/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:21.434503 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bbb8cf-c11d-4025-8551-4c1c3557264a/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:59:21.435016 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bbb8cf-c11d-4025-8551-4c1c3557264a/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:21.563203 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bbb8cf-c11d-4025-8551-4c1c3557264a/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:59:21.563203 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/dm-7 (vdb) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:59:21.572579 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:21.707704 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:59:21.709105 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:21.846810 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:59:21.851756 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27c37404-4df0-4ded-bf5b-6002e26d4222/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:21.975166 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27c37404-4df0-4ded-bf5b-6002e26d4222/disk --force-share --output=json" returned: 0 in 0.123s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:59:21.978038 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27c37404-4df0-4ded-bf5b-6002e26d4222/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:22.079936 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27c37404-4df0-4ded-bf5b-6002e26d4222/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:59:22.089053 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659c56a6-743a-45e2-aa21-7d45c672f094/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:22.116808 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4733676e-be82-4def-98d9-f815d153da08 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "22bbb8cf-c11d-4025-8551-4c1c3557264a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.060s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:22.216235 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659c56a6-743a-45e2-aa21-7d45c672f094/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:59:22.216705 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659c56a6-743a-45e2-aa21-7d45c672f094/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:22.348581 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a841b998-9bde-46db-b165-2c84a2adf6fe req-c9ac561e-5e2e-4ca9-8163-a148a85b3a13 service nova] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Received event network-changed-1bce33b1-57be-4de9-9e81-1a05535ae317 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:59:22.350152 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a841b998-9bde-46db-b165-2c84a2adf6fe req-c9ac561e-5e2e-4ca9-8163-a148a85b3a13 service nova] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Refreshing instance network info cache due to event network-changed-1bce33b1-57be-4de9-9e81-1a05535ae317. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:59:22.350152 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a841b998-9bde-46db-b165-2c84a2adf6fe req-c9ac561e-5e2e-4ca9-8163-a148a85b3a13 service nova] Acquiring lock "refresh_cache-8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:59:22.350152 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a841b998-9bde-46db-b165-2c84a2adf6fe req-c9ac561e-5e2e-4ca9-8163-a148a85b3a13 service nova] Acquired lock "refresh_cache-8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:59:22.350152 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-a841b998-9bde-46db-b165-2c84a2adf6fe req-c9ac561e-5e2e-4ca9-8163-a148a85b3a13 service nova] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Refreshing network info cache for port 1bce33b1-57be-4de9-9e81-1a05535ae317 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:59:22.357807 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659c56a6-743a-45e2-aa21-7d45c672f094/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:59:22.364408 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:59:22.370604 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:59:22.377167 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d87a47f-2eb6-4e25-b44a-848fe2225962/disk.rescue --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:22.432123 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "e3e9a0d0-72cd-459e-8bc4-cf080adb5267" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:22.432416 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "e3e9a0d0-72cd-459e-8bc4-cf080adb5267" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.004s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:22.494422 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d87a47f-2eb6-4e25-b44a-848fe2225962/disk.rescue --force-share --output=json" returned: 0 in 0.119s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:59:22.495134 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d87a47f-2eb6-4e25-b44a-848fe2225962/disk.rescue --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:22.598152 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d87a47f-2eb6-4e25-b44a-848fe2225962/disk.rescue --force-share --output=json" returned: 0 in 0.102s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:59:22.599816 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d87a47f-2eb6-4e25-b44a-848fe2225962/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:22.711822 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d87a47f-2eb6-4e25-b44a-848fe2225962/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:59:22.712474 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d87a47f-2eb6-4e25-b44a-848fe2225962/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:22.815332 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d87a47f-2eb6-4e25-b44a-848fe2225962/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:59:22.819621 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63688346-f8e2-4fbe-987d-bf55df9fa3a4/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:22.856653 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-a841b998-9bde-46db-b165-2c84a2adf6fe req-c9ac561e-5e2e-4ca9-8163-a148a85b3a13 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:59:22.943947 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lazy-loading 'flavor' on Instance uuid e3e9a0d0-72cd-459e-8bc4-cf080adb5267 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:59:22.947120 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63688346-f8e2-4fbe-987d-bf55df9fa3a4/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:59:22.949277 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63688346-f8e2-4fbe-987d-bf55df9fa3a4/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:23.052582 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63688346-f8e2-4fbe-987d-bf55df9fa3a4/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:59:23.066264 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:59:23.067812 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:23.121267 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.053s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:59:23.121803 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Hypervisor/Node resource view: name=np0000001583 free_ram=10731MB free_disk=73.75286102294922GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 01:59:23.121985 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:23.122261 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:23.172374 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:23.335979 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-a841b998-9bde-46db-b165-2c84a2adf6fe req-c9ac561e-5e2e-4ca9-8163-a148a85b3a13 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:59:23.510000 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-a841b998-9bde-46db-b165-2c84a2adf6fe req-c9ac561e-5e2e-4ca9-8163-a148a85b3a13 service nova] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Updated VIF entry in instance network info cache for port 1bce33b1-57be-4de9-9e81-1a05535ae317. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:59:23.510551 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-a841b998-9bde-46db-b165-2c84a2adf6fe req-c9ac561e-5e2e-4ca9-8163-a148a85b3a13 service nova] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Updating instance_info_cache with network_info: [{"id": "1bce33b1-57be-4de9-9e81-1a05535ae317", "address": "fa:16:3e:ae:cc:0f", "network": {"id": "c18d43cf-482c-4814-96a1-09aab2287be4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2071326233-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d5cfe906dd24a10819b92c144f7f06f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bce33b1-57", "ovs_interfaceid": "1bce33b1-57be-4de9-9e81-1a05535ae317", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:59:23.954024 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "e3e9a0d0-72cd-459e-8bc4-cf080adb5267" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.522s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:24.012707 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a841b998-9bde-46db-b165-2c84a2adf6fe req-c9ac561e-5e2e-4ca9-8163-a148a85b3a13 service nova] Releasing lock "refresh_cache-8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:59:24.207374 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 659c56a6-743a-45e2-aa21-7d45c672f094 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:59:24.207480 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 0d87a47f-2eb6-4e25-b44a-848fe2225962 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:59:24.207594 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance e50227a8-b484-447b-abc6-3a3c1379e7ff actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:59:24.207670 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 5516d92e-c69f-40a2-bb82-a07c1aca64e7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:59:24.207741 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 22bbb8cf-c11d-4025-8551-4c1c3557264a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:59:24.207840 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance d4fad20b-d51e-47c9-8f55-3aa085a10891 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:59:24.207973 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 27c37404-4df0-4ded-bf5b-6002e26d4222 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:59:24.208056 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 63688346-f8e2-4fbe-987d-bf55df9fa3a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:59:24.208232 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:59:24.208319 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance e3e9a0d0-72cd-459e-8bc4-cf080adb5267 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:59:24.208566 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 01:59:24.208734 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Final resource view: name=np0000001583 phys_ram=24030MB used_ram=2432MB phys_disk=95GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 01:59:23 up 35 min,  2 users,  load average: 11.32, 8.12, 4.35\n', 'num_instances': '10', 'num_vm_active': '9', 'num_task_None': '10', 'num_os_type_None': '10', 'num_proj_f65617e71571457f8906997583100678': '3', 'io_workload': '0', 'num_vm_rescued': '1', 'num_proj_0474090f4f2d4950b51bc317f4302266': '3', 'num_proj_432aa1094ced436494def17a875aa8e1': '1', 'num_proj_04ce4063a6ac4afdb5ee359a5c1105d3': '1', 'num_proj_ae04c11a3de34d419d69e1fdf4c7d311': '1', 'num_proj_1d5cfe906dd24a10819b92c144f7f06f': '1'} {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 01:59:24.512311 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-622eb4b9-db2a-46b5-8406-ecf866059c7f req-0adac08e-7999-41cd-a0f9-cf8a71b413ad service nova] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Received event network-changed-1bce33b1-57be-4de9-9e81-1a05535ae317 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:59:24.512311 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-622eb4b9-db2a-46b5-8406-ecf866059c7f req-0adac08e-7999-41cd-a0f9-cf8a71b413ad service nova] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Refreshing instance network info cache due to event network-changed-1bce33b1-57be-4de9-9e81-1a05535ae317. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:59:24.512879 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-622eb4b9-db2a-46b5-8406-ecf866059c7f req-0adac08e-7999-41cd-a0f9-cf8a71b413ad service nova] Acquiring lock "refresh_cache-8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:59:24.512879 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-622eb4b9-db2a-46b5-8406-ecf866059c7f req-0adac08e-7999-41cd-a0f9-cf8a71b413ad service nova] Acquired lock "refresh_cache-8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:59:24.512879 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-622eb4b9-db2a-46b5-8406-ecf866059c7f req-0adac08e-7999-41cd-a0f9-cf8a71b413ad service nova] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Refreshing network info cache for port 1bce33b1-57be-4de9-9e81-1a05535ae317 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:59:24.584550 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "d203e779-f827-4964-a8a9-368a89aab0e2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:24.585390 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "d203e779-f827-4964-a8a9-368a89aab0e2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:24.864094 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:59:24.864329 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:59:25.020825 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-622eb4b9-db2a-46b5-8406-ecf866059c7f req-0adac08e-7999-41cd-a0f9-cf8a71b413ad service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:59:25.091169 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:59:25.101156 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "e3e9a0d0-72cd-459e-8bc4-cf080adb5267" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:25.101156 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "e3e9a0d0-72cd-459e-8bc4-cf080adb5267" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:25.101156 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Attaching volume 146fbda9-15e8-4bd7-911b-f03b9308c11b to /dev/vdb
May 28 01:59:25.157567 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:59:25.168564 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:59:25.200142 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:25.240241 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:59:25.240727 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:59:25.252164 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:59:25.252164 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::8832:afff:fe8a:cd4c', 'fe80::fc16:3eff:fe48:7d7b', 'fe80::d0cf:7bff:fef9:3cc3', 'fe80::fc16:3eff:feca:d649', 'fe80::fc16:3eff:fe20:c750', 'fe80::34e0:eeff:fee2:bede', 'fe80::fc16:3eff:fed3:cd06', 'fe80::fc16:3eff:feae:1e12', 'fe80::fc16:3eff:feca:8ce2', 'fe80::5048:4dff:fe67:fb12', 'fe80::fc16:3eff:fee8:1f', 'fe80::fc16:3eff:fe24:bbc4', 'fe80::b0dd:40ff:feb5:6704', 'fe80::fc16:3eff:feae:cc0f', 'fe80::9020:88ff:fe40:d02', 'fe80::fc16:3eff:fedf:4521'] 
May 28 01:59:25.252164 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:59:25.252164 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:59:25.252164 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] <== get_connector_properties: return (94ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:59:25.252758 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Updating existing volume attachment record: 5c9c573f-1808-4a23-b104-210c74877ea1 {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:59:25.308422 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:25.368429 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:59:25.443577 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-622eb4b9-db2a-46b5-8406-ecf866059c7f req-0adac08e-7999-41cd-a0f9-cf8a71b413ad service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:59:25.607142 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-622eb4b9-db2a-46b5-8406-ecf866059c7f req-0adac08e-7999-41cd-a0f9-cf8a71b413ad service nova] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Updated VIF entry in instance network info cache for port 1bce33b1-57be-4de9-9e81-1a05535ae317. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:59:25.607669 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-622eb4b9-db2a-46b5-8406-ecf866059c7f req-0adac08e-7999-41cd-a0f9-cf8a71b413ad service nova] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Updating instance_info_cache with network_info: [{"id": "1bce33b1-57be-4de9-9e81-1a05535ae317", "address": "fa:16:3e:ae:cc:0f", "network": {"id": "c18d43cf-482c-4814-96a1-09aab2287be4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2071326233-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d5cfe906dd24a10819b92c144f7f06f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bce33b1-57", "ovs_interfaceid": "1bce33b1-57be-4de9-9e81-1a05535ae317", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:59:25.667661 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:25.814066 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:59:25.815539 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b', 'iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '146fbda9-15e8-4bd7-911b-f03b9308c11b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:59:25.815539 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:59:25.815539 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:59:25.815539 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b', 'iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '146fbda9-15e8-4bd7-911b-f03b9308c11b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:59:25.827230 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:59:25.828013 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:59:25.828690 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:59:25.829057 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:59:25.829567 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:59:25.829778 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: node.startup = automatic
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: node.session.scan = manual
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:59:25.844234 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:59:25.844234 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: node.startup = automatic
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: node.session.scan = manual
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:59:25.851440 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:59:25.851440 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:25.860404 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:25.869212 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:25.880764 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:25.880764 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:25.880764 np0000001583 nova-compute[98241]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:25.880764 np0000001583 nova-compute[98241]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:25.880764 np0000001583 nova-compute[98241]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:25.880764 np0000001583 nova-compute[98241]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:25.880764 np0000001583 nova-compute[98241]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b (non-flash)
May 28 01:59:25.880764 np0000001583 nova-compute[98241]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b (non-flash)
May 28 01:59:25.880764 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:59:25.881055 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:25.881055 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:25.881055 np0000001583 nova-compute[98241]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:25.881055 np0000001583 nova-compute[98241]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:25.881055 np0000001583 nova-compute[98241]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:25.881055 np0000001583 nova-compute[98241]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:25.881055 np0000001583 nova-compute[98241]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b (non-flash)
May 28 01:59:25.881055 np0000001583 nova-compute[98241]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b (non-flash)
May 28 01:59:25.881055 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:59:25.881529 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.053s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:59:25.881782 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:59:25.882914 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] HCTL ('14', '0', '0', 0) found on session 75 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:59:25.883156 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Scanning host 14 c: 0, t: 0, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:59:25.884846 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Compute_service record updated for np0000001583:np0000001583 {{(pid=98241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 01:59:25.885480 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.763s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:25.886096 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:59:25.886253 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Cleaning up deleted instances {{(pid=98241) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}}
May 28 01:59:25.887946 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.219s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:25.891667 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:59:25.891857 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Claim successful on node np0000001583
May 28 01:59:25.896205 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:25.896205 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:25.896205 np0000001583 nova-compute[98241]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:25.896205 np0000001583 nova-compute[98241]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:25.896205 np0000001583 nova-compute[98241]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:25.896205 np0000001583 nova-compute[98241]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:25.896205 np0000001583 nova-compute[98241]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b (non-flash)
May 28 01:59:25.896205 np0000001583 nova-compute[98241]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b (non-flash)
May 28 01:59:25.896205 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:59:25.896551 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:25.896551 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:25.896551 np0000001583 nova-compute[98241]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:25.896551 np0000001583 nova-compute[98241]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:25.896551 np0000001583 nova-compute[98241]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:25.896551 np0000001583 nova-compute[98241]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:25.896551 np0000001583 nova-compute[98241]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b (non-flash)
May 28 01:59:25.896551 np0000001583 nova-compute[98241]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b (non-flash)
May 28 01:59:25.896551 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:59:25.896753 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.067s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:59:25.896753 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:59:25.897747 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Searching for a device in session 75 and hctl ('14', '0', '0', 0) yield: sdi {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:59:25.897936 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '146fbda9-15e8-4bd7-911b-f03b9308c11b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:59:25.901457 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] HCTL ('13', '0', '0', 0) found on session 74 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:59:25.901591 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Scanning host 13 c: 0, t: 0, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:59:25.911868 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Searching for a device in session 74 and hctl ('13', '0', '0', 0) yield: sdh {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:59:25.912202 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '146fbda9-15e8-4bd7-911b-f03b9308c11b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:59:26.109561 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-622eb4b9-db2a-46b5-8406-ecf866059c7f req-0adac08e-7999-41cd-a0f9-cf8a71b413ad service nova] Releasing lock "refresh_cache-8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:59:26.400422 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] There are 0 instances to clean {{(pid=98241) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}}
May 28 01:59:26.401428 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:59:26.401569 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98241) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}}
May 28 01:59:26.830324 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:59:26.905089 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:59:27.406934 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 47.60 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:59:27.508458 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:59:27.508766 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:59:27.850700 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Found WWN 330000000400f98cc for multipath device dm-7 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:59:27.851222 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.036s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:59:27.851222 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] <== connect_volume: return (2036ms) {'type': 'block', 'scsi_wwn': '330000000400f98cc', 'path': '/dev/dm-7', 'multipath_id': '330000000400f98cc'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:59:27.851777 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000400f98cc', 'path': '/dev/dm-7', 'multipath_id': '330000000400f98cc'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:59:27.853986 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lazy-loading 'flavor' on Instance uuid e3e9a0d0-72cd-459e-8bc4-cf080adb5267 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:59:28.011871 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:59:28.176024 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:28.348746 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b2498037-4d09-4f11-8121-a4771fb73675 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "5516d92e-c69f-40a2-bb82-a07c1aca64e7" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:28.348999 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b2498037-4d09-4f11-8121-a4771fb73675 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "5516d92e-c69f-40a2-bb82-a07c1aca64e7" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:28.349202 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-b2498037-4d09-4f11-8121-a4771fb73675 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:59:28.351372 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-b2498037-4d09-4f11-8121-a4771fb73675 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=98241) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 28 01:59:28.351901 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-b2498037-4d09-4f11-8121-a4771fb73675 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lazy-loading 'flavor' on Instance uuid 5516d92e-c69f-40a2-bb82-a07c1aca64e7 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:59:28.356748 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Attempting to attach volume 146fbda9-15e8-4bd7-911b-f03b9308c11b with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98241) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 01:59:28.359931 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] attach device xml: <disk type="block" device="disk">
May 28 01:59:28.359931 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:59:28.359931 np0000001583 nova-compute[98241]:   <alias name="ua-146fbda9-15e8-4bd7-911b-f03b9308c11b"/>
May 28 01:59:28.359931 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-7"/>
May 28 01:59:28.359931 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 01:59:28.359931 np0000001583 nova-compute[98241]:   <serial>146fbda9-15e8-4bd7-911b-f03b9308c11b</serial>
May 28 01:59:28.359931 np0000001583 nova-compute[98241]:   <shareable/>
May 28 01:59:28.359931 np0000001583 nova-compute[98241]: </disk>
May 28 01:59:28.359931 np0000001583 nova-compute[98241]:  {{(pid=98241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 01:59:28.519045 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.633s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:28.519484 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:59:29.025591 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:59:29.026039 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:59:29.026181 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:59:29.026486 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:59:29.112961 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '00cb6190618b45eb994dd16d3c657f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837663bcfa40402aaf583729dfbb26cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:59:29.388168 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:29.392129 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:29.419172 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:29.443854 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:29.444744 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:29.529061 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:59:29.532103 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:29.571811 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a4b93e1c-79ad-4241-a925-1a40d7423487 req-9d64cc18-af31-499b-996c-de459c87a9fd service nova] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Received event network-vif-unplugged-3ea23ee8-f2dc-4506-8207-7f2fb70c03b8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:59:29.572845 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a4b93e1c-79ad-4241-a925-1a40d7423487 req-9d64cc18-af31-499b-996c-de459c87a9fd service nova] Acquiring lock "5516d92e-c69f-40a2-bb82-a07c1aca64e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:29.572845 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a4b93e1c-79ad-4241-a925-1a40d7423487 req-9d64cc18-af31-499b-996c-de459c87a9fd service nova] Lock "5516d92e-c69f-40a2-bb82-a07c1aca64e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:29.572845 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a4b93e1c-79ad-4241-a925-1a40d7423487 req-9d64cc18-af31-499b-996c-de459c87a9fd service nova] Lock "5516d92e-c69f-40a2-bb82-a07c1aca64e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:29.572845 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a4b93e1c-79ad-4241-a925-1a40d7423487 req-9d64cc18-af31-499b-996c-de459c87a9fd service nova] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] No waiting events found dispatching network-vif-unplugged-3ea23ee8-f2dc-4506-8207-7f2fb70c03b8 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:59:29.572845 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-a4b93e1c-79ad-4241-a925-1a40d7423487 req-9d64cc18-af31-499b-996c-de459c87a9fd service nova] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Received unexpected event network-vif-unplugged-3ea23ee8-f2dc-4506-8207-7f2fb70c03b8 for instance with vm_state active and task_state powering-off.
May 28 01:59:29.684129 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:29.695320 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:29.713332 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999570500000118 future=<Future at 0x7724f83b2a50 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:59:29.720032 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Instance destroyed successfully.
May 28 01:59:29.720623 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-b2498037-4d09-4f11-8121-a4771fb73675 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lazy-loading 'numa_topology' on Instance uuid 5516d92e-c69f-40a2-bb82-a07c1aca64e7 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:59:29.788416 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.001860900000338006 future=<Future at 0x7724f831ac90 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:59:29.789160 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Emitting event <LifecycleEvent: 1779933554.7864313, 1100d127-f3d6-416e-a646-b072660980bc => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:59:29.789396 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:59:29.789666 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 1100d127-f3d6-416e-a646-b072660980bc] VM Stopped (Lifecycle Event)
May 28 01:59:29.790385 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.922505769000054 future=<Future at 0x7724f83b2a50 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:59:29.790582 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.922269767999751 future=<Future at 0x7724f83b2a50 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:59:29.827993 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Successfully created port: 64151141-350a-4b34-b2a6-316b8dbefd14 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:59:29.998192 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:59:29.998348 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:59:29.998544 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:59:29.998544 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] No VIF found with MAC fa:16:3e:df:45:21, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:59:30.036289 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:59:30.223314 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-b2498037-4d09-4f11-8121-a4771fb73675 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Object Instance<5516d92e-c69f-40a2-bb82-a07c1aca64e7> lazy-loaded attributes: flavor,numa_topology {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:59:30.223449 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-b2498037-4d09-4f11-8121-a4771fb73675 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:59:30.293795 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 1100d127-f3d6-416e-a646-b072660980bc] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:59:30.311562 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:30.436232 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Successfully updated port: 64151141-350a-4b34-b2a6-316b8dbefd14 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:59:30.509231 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-3b0ae2a0-42d9-4b78-9198-01926f5f7e88 req-89ebbf29-19c9-4b04-8086-97ac5c33175d service nova] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Received event network-changed-64151141-350a-4b34-b2a6-316b8dbefd14 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:59:30.509320 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-3b0ae2a0-42d9-4b78-9198-01926f5f7e88 req-89ebbf29-19c9-4b04-8086-97ac5c33175d service nova] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Refreshing instance network info cache due to event network-changed-64151141-350a-4b34-b2a6-316b8dbefd14. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:59:30.509565 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-3b0ae2a0-42d9-4b78-9198-01926f5f7e88 req-89ebbf29-19c9-4b04-8086-97ac5c33175d service nova] Acquiring lock "refresh_cache-d203e779-f827-4964-a8a9-368a89aab0e2" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:59:30.509713 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-3b0ae2a0-42d9-4b78-9198-01926f5f7e88 req-89ebbf29-19c9-4b04-8086-97ac5c33175d service nova] Acquired lock "refresh_cache-d203e779-f827-4964-a8a9-368a89aab0e2" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:59:30.509796 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-3b0ae2a0-42d9-4b78-9198-01926f5f7e88 req-89ebbf29-19c9-4b04-8086-97ac5c33175d service nova] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Refreshing network info cache for port 64151141-350a-4b34-b2a6-316b8dbefd14 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:59:30.729745 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b2498037-4d09-4f11-8121-a4771fb73675 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "5516d92e-c69f-40a2-bb82-a07c1aca64e7" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.381s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:30.938703 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "refresh_cache-d203e779-f827-4964-a8a9-368a89aab0e2" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:59:31.012276 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-3b0ae2a0-42d9-4b78-9198-01926f5f7e88 req-89ebbf29-19c9-4b04-8086-97ac5c33175d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:59:31.045818 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:59:31.047041 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:59:31.047333 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Creating image(s)
May 28 01:59:31.047876 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "/opt/stack/data/nova/instances/d203e779-f827-4964-a8a9-368a89aab0e2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:31.048071 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "/opt/stack/data/nova/instances/d203e779-f827-4964-a8a9-368a89aab0e2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:31.052829 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "/opt/stack/data/nova/instances/d203e779-f827-4964-a8a9-368a89aab0e2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:31.053506 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:59:31.057755 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:59:31.059227 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:31.095127 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-3b0ae2a0-42d9-4b78-9198-01926f5f7e88 req-89ebbf29-19c9-4b04-8086-97ac5c33175d service nova] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:59:31.163039 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.104s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:59:31.163669 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:31.164393 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:31.165005 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:59:31.169771 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:59:31.170897 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:31.258335 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.087s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:59:31.258879 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/d203e779-f827-4964-a8a9-368a89aab0e2/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:31.298282 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-3b0ae2a0-42d9-4b78-9198-01926f5f7e88 req-89ebbf29-19c9-4b04-8086-97ac5c33175d service nova] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:59:31.313131 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/d203e779-f827-4964-a8a9-368a89aab0e2/disk 1073741824" returned: 0 in 0.054s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:59:31.313606 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.149s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:31.313994 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:31.405277 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.091s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:59:31.406379 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d203e779-f827-4964-a8a9-368a89aab0e2/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:59:31.406841 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d203e779-f827-4964-a8a9-368a89aab0e2/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:31.496776 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d203e779-f827-4964-a8a9-368a89aab0e2/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:59:31.497221 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Cannot resize image /opt/stack/data/nova/instances/d203e779-f827-4964-a8a9-368a89aab0e2/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:59:31.497586 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:59:31.497741 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Ensure instance console log exists: /opt/stack/data/nova/instances/d203e779-f827-4964-a8a9-368a89aab0e2/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:59:31.498023 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:31.498271 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:31.498398 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:31.595315 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-87ec1f27-7698-4bda-8856-c9e5e4e0f974 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "e3e9a0d0-72cd-459e-8bc4-cf080adb5267" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.497s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:31.657060 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-571d64a7-99b5-412c-b5eb-973e7e641561 req-e6b4f468-2c6b-4baa-96a0-f92281c235b8 service nova] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Received event network-vif-unplugged-3ea23ee8-f2dc-4506-8207-7f2fb70c03b8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:59:31.657060 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-571d64a7-99b5-412c-b5eb-973e7e641561 req-e6b4f468-2c6b-4baa-96a0-f92281c235b8 service nova] Acquiring lock "5516d92e-c69f-40a2-bb82-a07c1aca64e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:31.657166 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-571d64a7-99b5-412c-b5eb-973e7e641561 req-e6b4f468-2c6b-4baa-96a0-f92281c235b8 service nova] Lock "5516d92e-c69f-40a2-bb82-a07c1aca64e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:31.657287 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-571d64a7-99b5-412c-b5eb-973e7e641561 req-e6b4f468-2c6b-4baa-96a0-f92281c235b8 service nova] Lock "5516d92e-c69f-40a2-bb82-a07c1aca64e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:31.657401 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-571d64a7-99b5-412c-b5eb-973e7e641561 req-e6b4f468-2c6b-4baa-96a0-f92281c235b8 service nova] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] No waiting events found dispatching network-vif-unplugged-3ea23ee8-f2dc-4506-8207-7f2fb70c03b8 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:59:31.657514 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-571d64a7-99b5-412c-b5eb-973e7e641561 req-e6b4f468-2c6b-4baa-96a0-f92281c235b8 service nova] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Received unexpected event network-vif-unplugged-3ea23ee8-f2dc-4506-8207-7f2fb70c03b8 for instance with vm_state stopped and task_state None.
May 28 01:59:31.801917 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-3b0ae2a0-42d9-4b78-9198-01926f5f7e88 req-89ebbf29-19c9-4b04-8086-97ac5c33175d service nova] Releasing lock "refresh_cache-d203e779-f827-4964-a8a9-368a89aab0e2" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:59:31.802766 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquired lock "refresh_cache-d203e779-f827-4964-a8a9-368a89aab0e2" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:59:31.803025 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:59:31.940330 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Acquiring lock "d4fad20b-d51e-47c9-8f55-3aa085a10891" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:31.940565 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "d4fad20b-d51e-47c9-8f55-3aa085a10891" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:32.049927 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-aa6d8eba-2148-472f-9142-41ffabc85fc9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "22bbb8cf-c11d-4025-8551-4c1c3557264a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:32.050356 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-aa6d8eba-2148-472f-9142-41ffabc85fc9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "22bbb8cf-c11d-4025-8551-4c1c3557264a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:32.387912 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:59:32.445018 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lazy-loading 'flavor' on Instance uuid d4fad20b-d51e-47c9-8f55-3aa085a10891 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:59:32.553043 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-aa6d8eba-2148-472f-9142-41ffabc85fc9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Detaching volume 146fbda9-15e8-4bd7-911b-f03b9308c11b
May 28 01:59:32.568254 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:59:32.605137 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-aa6d8eba-2148-472f-9142-41ffabc85fc9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Attempting to driver detach volume 146fbda9-15e8-4bd7-911b-f03b9308c11b from mountpoint /dev/vdb
May 28 01:59:32.615906 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-aa6d8eba-2148-472f-9142-41ffabc85fc9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Found disk vdb by alias ua-146fbda9-15e8-4bd7-911b-f03b9308c11b {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:59:32.619992 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-aa6d8eba-2148-472f-9142-41ffabc85fc9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Found disk vdb by alias ua-146fbda9-15e8-4bd7-911b-f03b9308c11b {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:59:32.620169 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-aa6d8eba-2148-472f-9142-41ffabc85fc9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Attempting to detach device vdb from instance 22bbb8cf-c11d-4025-8551-4c1c3557264a from the persistent domain config. {{(pid=98241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 01:59:32.620443 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-aa6d8eba-2148-472f-9142-41ffabc85fc9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:59:32.620443 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:59:32.620443 np0000001583 nova-compute[98241]:   <alias name="ua-146fbda9-15e8-4bd7-911b-f03b9308c11b"/>
May 28 01:59:32.620443 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-7"/>
May 28 01:59:32.620443 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 01:59:32.620443 np0000001583 nova-compute[98241]:   <serial>146fbda9-15e8-4bd7-911b-f03b9308c11b</serial>
May 28 01:59:32.620443 np0000001583 nova-compute[98241]:   <shareable/>
May 28 01:59:32.620443 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:59:32.620443 np0000001583 nova-compute[98241]: </disk>
May 28 01:59:32.620443 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:59:32.634243 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-aa6d8eba-2148-472f-9142-41ffabc85fc9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Successfully detached device vdb from instance 22bbb8cf-c11d-4025-8551-4c1c3557264a from the persistent domain config.
May 28 01:59:32.634674 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-aa6d8eba-2148-472f-9142-41ffabc85fc9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] (1/8): Attempting to detach device vdb with device alias ua-146fbda9-15e8-4bd7-911b-f03b9308c11b from instance 22bbb8cf-c11d-4025-8551-4c1c3557264a from the live domain config. {{(pid=98241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 01:59:32.636223 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-aa6d8eba-2148-472f-9142-41ffabc85fc9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:59:32.636223 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:59:32.636223 np0000001583 nova-compute[98241]:   <alias name="ua-146fbda9-15e8-4bd7-911b-f03b9308c11b"/>
May 28 01:59:32.636223 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-7"/>
May 28 01:59:32.636223 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 01:59:32.636223 np0000001583 nova-compute[98241]:   <serial>146fbda9-15e8-4bd7-911b-f03b9308c11b</serial>
May 28 01:59:32.636223 np0000001583 nova-compute[98241]:   <shareable/>
May 28 01:59:32.636223 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:59:32.636223 np0000001583 nova-compute[98241]: </disk>
May 28 01:59:32.636223 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:59:32.707294 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Updating instance_info_cache with network_info: [{"id": "64151141-350a-4b34-b2a6-316b8dbefd14", "address": "fa:16:3e:f3:68:03", "network": {"id": "62e7cc38-1758-4b09-a352-4635adc9cfea", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587967507-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "837663bcfa40402aaf583729dfbb26cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap64151141-35", "ovs_interfaceid": "64151141-350a-4b34-b2a6-316b8dbefd14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:59:33.177070 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:33.209900 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Releasing lock "refresh_cache-d203e779-f827-4964-a8a9-368a89aab0e2" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:59:33.210308 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Instance network_info: |[{"id": "64151141-350a-4b34-b2a6-316b8dbefd14", "address": "fa:16:3e:f3:68:03", "network": {"id": "62e7cc38-1758-4b09-a352-4635adc9cfea", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587967507-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "837663bcfa40402aaf583729dfbb26cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap64151141-35", "ovs_interfaceid": "64151141-350a-4b34-b2a6-316b8dbefd14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:59:33.211932 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Start _get_guest_xml network_info=[{"id": "64151141-350a-4b34-b2a6-316b8dbefd14", "address": "fa:16:3e:f3:68:03", "network": {"id": "62e7cc38-1758-4b09-a352-4635adc9cfea", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587967507-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "837663bcfa40402aaf583729dfbb26cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap64151141-35", "ovs_interfaceid": "64151141-350a-4b34-b2a6-316b8dbefd14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:59:33.214640 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:59:33.216108 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-218353403', uuid='d203e779-f827-4964-a8a9-368a89aab0e2'), owner=OwnerMeta(userid='00cb6190618b45eb994dd16d3c657f01', username='tempest-AttachVolumeNegativeTest-169599115-project-member', projectid='837663bcfa40402aaf583729dfbb26cd', projectname='tempest-AttachVolumeNegativeTest-169599115'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "64151141-350a-4b34-b2a6-316b8dbefd14", "address": "fa:16:3e:f3:68:03", "network": {"id": "62e7cc38-1758-4b09-a352-4635adc9cfea", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587967507-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "837663bcfa40402aaf583729dfbb26cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap64151141-35", "ovs_interfaceid": "64151141-350a-4b34-b2a6-316b8dbefd14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933573.215679) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:59:33.217832 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:59:33.218419 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:59:33.219647 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:59:33.219972 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:59:33.221169 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:59:33.221615 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:59:33.221801 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:59:33.222020 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:59:33.222290 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:59:33.222420 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:59:33.222560 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:59:33.222762 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:59:33.222912 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:59:33.223064 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:59:33.223247 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:59:33.223412 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:59:33.241071 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:59:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-218353403',display_name='tempest-AttachVolumeNegativeTest-server-218353403',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-attachvolumenegativetest-server-218353403',id=39,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAR6qm2SzAM5ZRji1PwP4aBBgg7bEEInlQx+Ub4Z75TCmWKgZhzsWZympeTvtcR03nPN6xXXb4c5Iods7GMRDClU886h3X/tIS57gWA/xe1JPrTHz9BC20e6/FeY5iKvTQ==',key_name='tempest-keypair-1570349597',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='837663bcfa40402aaf583729dfbb26cd',ramdisk_id='',reservation_id='r-v1g4jqdj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-169599115',owner_user_name='tempest-AttachVolumeNegativeTest-169599115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:59:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='00cb6190618b45eb994dd16d3c657f01',uuid=d203e779-f827-4964-a8a9-368a89aab0e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64151141-350a-4b34-b2a6-316b8dbefd14", "address": "fa:16:3e:f3:68:03", "network": {"id": "62e7cc38-1758-4b09-a352-4635adc9cfea", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587967507-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "837663bcfa40402aaf583729dfbb26cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap64151141-35", "ovs_interfaceid": "64151141-350a-4b34-b2a6-316b8dbefd14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:59:33.241330 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Converting VIF {"id": "64151141-350a-4b34-b2a6-316b8dbefd14", "address": "fa:16:3e:f3:68:03", "network": {"id": "62e7cc38-1758-4b09-a352-4635adc9cfea", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587967507-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "837663bcfa40402aaf583729dfbb26cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap64151141-35", "ovs_interfaceid": "64151141-350a-4b34-b2a6-316b8dbefd14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:59:33.242163 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:68:03,bridge_name='br-int',has_traffic_filtering=True,id=64151141-350a-4b34-b2a6-316b8dbefd14,network=Network(62e7cc38-1758-4b09-a352-4635adc9cfea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64151141-35') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:59:33.242840 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lazy-loading 'pci_devices' on Instance uuid d203e779-f827-4964-a8a9-368a89aab0e2 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:59:33.285613 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Received event <DeviceRemovedEvent: 1779933573.285175, 22bbb8cf-c11d-4025-8551-4c1c3557264a => ua-146fbda9-15e8-4bd7-911b-f03b9308c11b> from libvirt while the driver is waiting for it; dispatched. {{(pid=98241) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 01:59:33.286453 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-aa6d8eba-2148-472f-9142-41ffabc85fc9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-146fbda9-15e8-4bd7-911b-f03b9308c11b for instance 22bbb8cf-c11d-4025-8551-4c1c3557264a {{(pid=98241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 01:59:33.288863 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-aa6d8eba-2148-472f-9142-41ffabc85fc9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Successfully detached device vdb from instance 22bbb8cf-c11d-4025-8551-4c1c3557264a from the live domain config.
May 28 01:59:33.450746 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "d4fad20b-d51e-47c9-8f55-3aa085a10891" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:33.745510 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] End _get_guest_xml xml=<domain type="qemu">
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:   <uuid>d203e779-f827-4964-a8a9-368a89aab0e2</uuid>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:   <name>instance-00000027</name>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:       <nova:name>tempest-AttachVolumeNegativeTest-server-218353403</nova:name>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:59:33</nova:creationTime>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:         <nova:user uuid="00cb6190618b45eb994dd16d3c657f01">tempest-AttachVolumeNegativeTest-169599115-project-member</nova:user>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:         <nova:project uuid="837663bcfa40402aaf583729dfbb26cd">tempest-AttachVolumeNegativeTest-169599115</nova:project>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:         <nova:port uuid="64151141-350a-4b34-b2a6-316b8dbefd14">
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:     <system>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:       <entry name="serial">d203e779-f827-4964-a8a9-368a89aab0e2</entry>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:       <entry name="uuid">d203e779-f827-4964-a8a9-368a89aab0e2</entry>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:     </system>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:   <os>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:   </os>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:   <features>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:   </features>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:   <devices>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/d203e779-f827-4964-a8a9-368a89aab0e2/disk"/>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:     </disk>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/d203e779-f827-4964-a8a9-368a89aab0e2/disk.config"/>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:     </disk>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:f3:68:03"/>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:       <target dev="tap64151141-35"/>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:     </interface>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/d203e779-f827-4964-a8a9-368a89aab0e2/console.log" append="off"/>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:     </serial>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:     <video>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:     </video>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:     </rng>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:   </devices>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]: </domain>
May 28 01:59:33.745510 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:59:33.747292 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Preparing to wait for external event network-vif-plugged-64151141-350a-4b34-b2a6-316b8dbefd14 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:59:33.747292 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "d203e779-f827-4964-a8a9-368a89aab0e2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:33.747292 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "d203e779-f827-4964-a8a9-368a89aab0e2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:33.747292 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "d203e779-f827-4964-a8a9-368a89aab0e2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:33.747292 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:59:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-218353403',display_name='tempest-AttachVolumeNegativeTest-server-218353403',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-attachvolumenegativetest-server-218353403',id=39,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAR6qm2SzAM5ZRji1PwP4aBBgg7bEEInlQx+Ub4Z75TCmWKgZhzsWZympeTvtcR03nPN6xXXb4c5Iods7GMRDClU886h3X/tIS57gWA/xe1JPrTHz9BC20e6/FeY5iKvTQ==',key_name='tempest-keypair-1570349597',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='837663bcfa40402aaf583729dfbb26cd',ramdisk_id='',reservation_id='r-v1g4jqdj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-169599115',owner_user_name='tempest-AttachVolumeNegativeTest-169599115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:59:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='00cb6190618b45eb994dd16d3c657f01',uuid=d203e779-f827-4964-a8a9-368a89aab0e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64151141-350a-4b34-b2a6-316b8dbefd14", "address": "fa:16:3e:f3:68:03", "network": {"id": "62e7cc38-1758-4b09-a352-4635adc9cfea", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587967507-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "837663bcfa40402aaf583729dfbb26cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap64151141-35", "ovs_interfaceid": "64151141-350a-4b34-b2a6-316b8dbefd14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:59:33.748195 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Converting VIF {"id": "64151141-350a-4b34-b2a6-316b8dbefd14", "address": "fa:16:3e:f3:68:03", "network": {"id": "62e7cc38-1758-4b09-a352-4635adc9cfea", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587967507-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "837663bcfa40402aaf583729dfbb26cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap64151141-35", "ovs_interfaceid": "64151141-350a-4b34-b2a6-316b8dbefd14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:59:33.748680 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:68:03,bridge_name='br-int',has_traffic_filtering=True,id=64151141-350a-4b34-b2a6-316b8dbefd14,network=Network(62e7cc38-1758-4b09-a352-4635adc9cfea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64151141-35') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:59:33.748946 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:68:03,bridge_name='br-int',has_traffic_filtering=True,id=64151141-350a-4b34-b2a6-316b8dbefd14,network=Network(62e7cc38-1758-4b09-a352-4635adc9cfea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64151141-35') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:59:33.749715 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:33.749950 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:59:33.750170 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:59:33.751227 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:33.751397 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6b01949e-00fc-53ca-8e68-1a0397f37c74', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:59:33.760718 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:33.761418 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:59:33.765985 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:33.768905 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:33.769050 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64151141-35, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:59:33.769386 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap64151141-35, col_values=(('qos', UUID('ab93d03b-928b-4a71-be09-bebf9db91307')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:59:33.769538 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap64151141-35, col_values=(('external_ids', {'iface-id': '64151141-350a-4b34-b2a6-316b8dbefd14', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:68:03', 'vm-uuid': 'd203e779-f827-4964-a8a9-368a89aab0e2'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:59:33.770436 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:33.771493 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:59:33.780123 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:33.781176 np0000001583 nova-compute[98241]: INFO os_vif [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:68:03,bridge_name='br-int',has_traffic_filtering=True,id=64151141-350a-4b34-b2a6-316b8dbefd14,network=Network(62e7cc38-1758-4b09-a352-4635adc9cfea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64151141-35')
May 28 01:59:33.839309 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-aa6d8eba-2148-472f-9142-41ffabc85fc9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Detected multiple connections on this host for volume: 146fbda9-15e8-4bd7-911b-f03b9308c11b, skipping target disconnect.
May 28 01:59:34.313639 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:59:34.391906 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-aa6d8eba-2148-472f-9142-41ffabc85fc9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lazy-loading 'flavor' on Instance uuid 22bbb8cf-c11d-4025-8551-4c1c3557264a {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:59:34.519991 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Acquiring lock "d4fad20b-d51e-47c9-8f55-3aa085a10891" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:34.520280 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "d4fad20b-d51e-47c9-8f55-3aa085a10891" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:34.520514 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Attaching volume 8ea99ade-a69e-46e2-9c9d-6251e4f69a57 to /dev/vdb
May 28 01:59:34.566295 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "5516d92e-c69f-40a2-bb82-a07c1aca64e7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:34.566295 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "5516d92e-c69f-40a2-bb82-a07c1aca64e7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:34.566802 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "5516d92e-c69f-40a2-bb82-a07c1aca64e7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:34.568328 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:59:34.570151 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "5516d92e-c69f-40a2-bb82-a07c1aca64e7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:34.570151 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "5516d92e-c69f-40a2-bb82-a07c1aca64e7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:34.572860 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Terminating instance
May 28 01:59:34.584659 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:59:34.609315 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:34.662652 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:59:34.662967 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:59:34.674028 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:59:34.674841 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::8832:afff:fe8a:cd4c', 'fe80::fc16:3eff:fe48:7d7b', 'fe80::d0cf:7bff:fef9:3cc3', 'fe80::fc16:3eff:feca:d649', 'fe80::fc16:3eff:fed3:cd06', 'fe80::fc16:3eff:feae:1e12', 'fe80::fc16:3eff:feca:8ce2', 'fe80::5048:4dff:fe67:fb12', 'fe80::fc16:3eff:fee8:1f', 'fe80::fc16:3eff:fe24:bbc4', 'fe80::b0dd:40ff:feb5:6704', 'fe80::fc16:3eff:feae:cc0f', 'fe80::9020:88ff:fe40:d02', 'fe80::fc16:3eff:fedf:4521'] 
May 28 01:59:34.675176 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:59:34.675458 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:59:34.675747 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:59:34.676069 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Updating existing volume attachment record: a2a98c44-e0e7-44a3-ae75-798180d6f360 {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:59:35.077115 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:59:35.082696 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Instance destroyed successfully.
May 28 01:59:35.083191 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lazy-loading 'resources' on Instance uuid 5516d92e-c69f-40a2-bb82-a07c1aca64e7 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:59:35.243162 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:59:35.244886 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57', 'iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8ea99ade-a69e-46e2-9c9d-6251e4f69a57', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:59:35.244886 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:59:35.244886 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:59:35.244886 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57', 'iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8ea99ade-a69e-46e2-9c9d-6251e4f69a57', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:59:35.255877 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:59:35.256449 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:59:35.256959 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:59:35.257189 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:59:35.257525 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:59:35.257708 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:59:35.271544 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:59:35.271544 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:35.276762 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:59:35.276762 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:35.285574 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57] added
May 28 01:59:35.285574 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:59:35.285574 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:59:35.285574 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:59:35.285574 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:59:35.285574 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:59:35.285574 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:35.285794 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:59:35.285945 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0287(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:59:35.286177 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:59:35.288599 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57] added
May 28 01:59:35.288599 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:59:35.288599 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:59:35.288599 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:59:35.288599 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:59:35.288599 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:59:35.288599 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:35.288802 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:59:35.289019 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0312(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:59:35.289249 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:59:35.300024 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:59:35.300024 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:59:35.300024 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] No VIF found with MAC fa:16:3e:f3:68:03, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:59:35.300024 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Using config drive
May 28 01:59:35.402259 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-aa6d8eba-2148-472f-9142-41ffabc85fc9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "22bbb8cf-c11d-4025-8551-4c1c3557264a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.352s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:35.462110 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-341793d5-ceb0-40ee-ba9b-c73aedd16cc8 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "e3e9a0d0-72cd-459e-8bc4-cf080adb5267" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:35.462292 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-341793d5-ceb0-40ee-ba9b-c73aedd16cc8 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "e3e9a0d0-72cd-459e-8bc4-cf080adb5267" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:35.586763 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2002538727',display_name='tempest-TestVolumeBootPattern-server-2002538727',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testvolumebootpattern-server-2002538727',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHAn6voYFucbngoRAJmnotzf66o58JwFX9NzCclmFCkNWIpHP6gjxjIluJ06OrAC9KC6sFrZoSxqHD83jV1GFKJlsmFEn3NHoSu4eJes1JfWwWo6nJb9nsd53fF4Dpwmw==',key_name='tempest-keypair-11480058',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:58:45Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='432aa1094ced436494def17a875aa8e1',ramdisk_id='',reservation_id='r-5ats8qhz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1031057169',owner_user_name='tempest-TestVolumeBootPattern-1031057169-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:59:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6be314b4eed642c3b2c72fe115860220',uuid=5516d92e-c69f-40a2-bb82-a07c1aca64e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3ea23ee8-f2dc-4506-8207-7f2fb70c03b8", "address": "fa:16:3e:20:c7:50", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ea23ee8-f2", "ovs_interfaceid": "3ea23ee8-f2dc-4506-8207-7f2fb70c03b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:59:35.586956 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converting VIF {"id": "3ea23ee8-f2dc-4506-8207-7f2fb70c03b8", "address": "fa:16:3e:20:c7:50", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ea23ee8-f2", "ovs_interfaceid": "3ea23ee8-f2dc-4506-8207-7f2fb70c03b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:59:35.587523 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:c7:50,bridge_name='br-int',has_traffic_filtering=True,id=3ea23ee8-f2dc-4506-8207-7f2fb70c03b8,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ea23ee8-f2') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:59:35.587740 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:c7:50,bridge_name='br-int',has_traffic_filtering=True,id=3ea23ee8-f2dc-4506-8207-7f2fb70c03b8,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ea23ee8-f2') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:59:35.589040 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:35.589503 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ea23ee8-f2, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:59:35.591004 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:35.592085 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:59:35.598660 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:35.599253 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:35.599442 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2d7c9d7e-7f62-463e-b11f-c6be125ccffb) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:59:35.599912 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:35.600523 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:59:35.605746 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:35.607532 np0000001583 nova-compute[98241]: INFO os_vif [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:c7:50,bridge_name='br-int',has_traffic_filtering=True,id=3ea23ee8-f2dc-4506-8207-7f2fb70c03b8,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ea23ee8-f2')
May 28 01:59:35.608617 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:59:35.608876 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b', 'iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b9d4f964-bf92-4184-a936-b3d05b7d8d1b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:59:35.609008 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:59:35.806475 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:59:35.967629 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Creating config drive at /opt/stack/data/nova/instances/d203e779-f827-4964-a8a9-368a89aab0e2/disk.config
May 28 01:59:35.968611 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-341793d5-ceb0-40ee-ba9b-c73aedd16cc8 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Detaching volume 146fbda9-15e8-4bd7-911b-f03b9308c11b
May 28 01:59:35.974552 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d203e779-f827-4964-a8a9-368a89aab0e2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpm15ef9nx {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:36.042457 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d203e779-f827-4964-a8a9-368a89aab0e2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpm15ef9nx" returned: 0 in 0.068s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:59:36.062219 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-341793d5-ceb0-40ee-ba9b-c73aedd16cc8 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Attempting to driver detach volume 146fbda9-15e8-4bd7-911b-f03b9308c11b from mountpoint /dev/vdb
May 28 01:59:36.065370 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-341793d5-ceb0-40ee-ba9b-c73aedd16cc8 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Found disk vdb by alias ua-146fbda9-15e8-4bd7-911b-f03b9308c11b {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:59:36.066580 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-341793d5-ceb0-40ee-ba9b-c73aedd16cc8 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Found disk vdb by alias ua-146fbda9-15e8-4bd7-911b-f03b9308c11b {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:59:36.067919 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-341793d5-ceb0-40ee-ba9b-c73aedd16cc8 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Attempting to detach device vdb from instance e3e9a0d0-72cd-459e-8bc4-cf080adb5267 from the persistent domain config. {{(pid=98241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 01:59:36.067919 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-341793d5-ceb0-40ee-ba9b-c73aedd16cc8 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:59:36.067919 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:59:36.067919 np0000001583 nova-compute[98241]:   <alias name="ua-146fbda9-15e8-4bd7-911b-f03b9308c11b"/>
May 28 01:59:36.067919 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-7"/>
May 28 01:59:36.067919 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 01:59:36.067919 np0000001583 nova-compute[98241]:   <serial>146fbda9-15e8-4bd7-911b-f03b9308c11b</serial>
May 28 01:59:36.067919 np0000001583 nova-compute[98241]:   <shareable/>
May 28 01:59:36.067919 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:59:36.067919 np0000001583 nova-compute[98241]: </disk>
May 28 01:59:36.067919 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:59:36.077459 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-341793d5-ceb0-40ee-ba9b-c73aedd16cc8 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Successfully detached device vdb from instance e3e9a0d0-72cd-459e-8bc4-cf080adb5267 from the persistent domain config.
May 28 01:59:36.077459 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-341793d5-ceb0-40ee-ba9b-c73aedd16cc8 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] (1/8): Attempting to detach device vdb with device alias ua-146fbda9-15e8-4bd7-911b-f03b9308c11b from instance e3e9a0d0-72cd-459e-8bc4-cf080adb5267 from the live domain config. {{(pid=98241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 01:59:36.077459 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-341793d5-ceb0-40ee-ba9b-c73aedd16cc8 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:59:36.077459 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:59:36.077459 np0000001583 nova-compute[98241]:   <alias name="ua-146fbda9-15e8-4bd7-911b-f03b9308c11b"/>
May 28 01:59:36.077459 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-7"/>
May 28 01:59:36.077459 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 01:59:36.077459 np0000001583 nova-compute[98241]:   <serial>146fbda9-15e8-4bd7-911b-f03b9308c11b</serial>
May 28 01:59:36.077459 np0000001583 nova-compute[98241]:   <shareable/>
May 28 01:59:36.077459 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:59:36.077459 np0000001583 nova-compute[98241]: </disk>
May 28 01:59:36.077459 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:59:36.286678 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:59:36.290932 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:59:36.304200 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:59:36.304200 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:59:36.311620 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:59:36.311620 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:36.318204 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:36.328715 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:36.340223 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:36.340223 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:36.340223 np0000001583 nova-compute[98241]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:36.340223 np0000001583 nova-compute[98241]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:36.340223 np0000001583 nova-compute[98241]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:36.340223 np0000001583 nova-compute[98241]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:36.340223 np0000001583 nova-compute[98241]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b (non-flash)
May 28 01:59:36.340223 np0000001583 nova-compute[98241]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b (non-flash)
May 28 01:59:36.340223 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:59:36.340223 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:36.340223 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:36.340223 np0000001583 nova-compute[98241]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:36.340223 np0000001583 nova-compute[98241]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:36.340223 np0000001583 nova-compute[98241]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:36.340223 np0000001583 nova-compute[98241]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:36.340223 np0000001583 nova-compute[98241]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b (non-flash)
May 28 01:59:36.340223 np0000001583 nova-compute[98241]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b (non-flash)
May 28 01:59:36.340223 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:59:36.353104 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:36.353104 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:36.353104 np0000001583 nova-compute[98241]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:36.353104 np0000001583 nova-compute[98241]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:36.353104 np0000001583 nova-compute[98241]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:36.353104 np0000001583 nova-compute[98241]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:36.353104 np0000001583 nova-compute[98241]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b (non-flash)
May 28 01:59:36.353104 np0000001583 nova-compute[98241]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b (non-flash)
May 28 01:59:36.353104 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:59:36.353104 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:36.353104 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:36.353104 np0000001583 nova-compute[98241]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:36.353104 np0000001583 nova-compute[98241]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:36.353104 np0000001583 nova-compute[98241]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:36.353104 np0000001583 nova-compute[98241]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:36.353104 np0000001583 nova-compute[98241]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b (non-flash)
May 28 01:59:36.353104 np0000001583 nova-compute[98241]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b (non-flash)
May 28 01:59:36.353104 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:59:36.384039 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57, portal: 192.168.50.100,3260]
May 28 01:59:36.384039 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57, portal: 192.168.50.100,3260] successful.
May 28 01:59:36.384039 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:36.399232 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:36.410953 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57, portal: 192.168.40.100,3260]
May 28 01:59:36.410953 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57, portal: 192.168.40.100,3260] successful.
May 28 01:59:36.410953 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:36.418170 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:36.418170 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:36.418170 np0000001583 nova-compute[98241]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:36.418170 np0000001583 nova-compute[98241]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:36.418170 np0000001583 nova-compute[98241]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:36.418170 np0000001583 nova-compute[98241]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:36.418170 np0000001583 nova-compute[98241]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b (non-flash)
May 28 01:59:36.418170 np0000001583 nova-compute[98241]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b (non-flash)
May 28 01:59:36.418170 np0000001583 nova-compute[98241]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:36.418170 np0000001583 nova-compute[98241]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:36.418170 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:59:36.418446 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:36.418446 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:36.418446 np0000001583 nova-compute[98241]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:36.418446 np0000001583 nova-compute[98241]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:36.418446 np0000001583 nova-compute[98241]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:36.418446 np0000001583 nova-compute[98241]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:36.418446 np0000001583 nova-compute[98241]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b (non-flash)
May 28 01:59:36.418446 np0000001583 nova-compute[98241]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b (non-flash)
May 28 01:59:36.418446 np0000001583 nova-compute[98241]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:36.418446 np0000001583 nova-compute[98241]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:36.418446 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:59:36.418865 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.162s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:59:36.419018 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:59:36.420824 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] HCTL ('15', '-', '-', 0) found on session 76 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:59:36.420944 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:59:36.427902 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:36.443291 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Searching for a device in session 76 and hctl ['15', '*', '*', 0] yield: None {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:59:36.458767 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:36.458767 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:36.458767 np0000001583 nova-compute[98241]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:36.458767 np0000001583 nova-compute[98241]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:36.458767 np0000001583 nova-compute[98241]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:36.458767 np0000001583 nova-compute[98241]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:36.458767 np0000001583 nova-compute[98241]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b (non-flash)
May 28 01:59:36.458767 np0000001583 nova-compute[98241]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b (non-flash)
May 28 01:59:36.458767 np0000001583 nova-compute[98241]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:36.458767 np0000001583 nova-compute[98241]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:36.458767 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:59:36.459038 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:36.459038 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:36.459038 np0000001583 nova-compute[98241]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:36.459038 np0000001583 nova-compute[98241]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:36.459038 np0000001583 nova-compute[98241]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:36.459038 np0000001583 nova-compute[98241]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:36.459038 np0000001583 nova-compute[98241]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b (non-flash)
May 28 01:59:36.459038 np0000001583 nova-compute[98241]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b (non-flash)
May 28 01:59:36.459038 np0000001583 nova-compute[98241]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:36.459038 np0000001583 nova-compute[98241]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:36.459038 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:59:36.459535 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.202s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:59:36.459679 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:59:36.460949 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] HCTL ('16', '-', '-', 0) found on session 77 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:59:36.461092 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:59:36.481831 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Searching for a device in session 77 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:59:36.482021 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8ea99ade-a69e-46e2-9c9d-6251e4f69a57', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:59:36.585836 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:36.627528 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:36.632830 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:36.728707 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:36.870520 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-56980e5e-a73b-4d18-afdb-85c754c329bd req-d52be28f-8998-4b5f-9cef-9953f94c4451 service nova] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Received event network-vif-plugged-64151141-350a-4b34-b2a6-316b8dbefd14 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:59:36.870773 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-56980e5e-a73b-4d18-afdb-85c754c329bd req-d52be28f-8998-4b5f-9cef-9953f94c4451 service nova] Acquiring lock "d203e779-f827-4964-a8a9-368a89aab0e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:36.871011 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-56980e5e-a73b-4d18-afdb-85c754c329bd req-d52be28f-8998-4b5f-9cef-9953f94c4451 service nova] Lock "d203e779-f827-4964-a8a9-368a89aab0e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:36.871952 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-56980e5e-a73b-4d18-afdb-85c754c329bd req-d52be28f-8998-4b5f-9cef-9953f94c4451 service nova] Lock "d203e779-f827-4964-a8a9-368a89aab0e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:36.872156 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-56980e5e-a73b-4d18-afdb-85c754c329bd req-d52be28f-8998-4b5f-9cef-9953f94c4451 service nova] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Processing event network-vif-plugged-64151141-350a-4b34-b2a6-316b8dbefd14 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:59:36.995047 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:36.997102 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:36.999008 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:37.022347 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:37.442072 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933577.4416118, d203e779-f827-4964-a8a9-368a89aab0e2 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:59:37.442496 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] VM Started (Lifecycle Event)
May 28 01:59:37.444438 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Searching for a device in session 76 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:59:37.444639 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8ea99ade-a69e-46e2-9c9d-6251e4f69a57', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:59:37.445710 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:59:37.456487 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:59:37.459320 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Instance spawned successfully.
May 28 01:59:37.460011 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:59:37.948618 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:59:37.951498 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:59:37.974462 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:59:37.974594 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:59:37.974914 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:59:37.975181 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:59:37.975499 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:59:37.975840 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:59:38.179628 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:38.275050 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Found WWN 330000000279bfb87 for multipath device dm-8 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:59:38.277825 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:59:38.277825 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] <== connect_volume: return (3032ms) {'type': 'block', 'scsi_wwn': '330000000279bfb87', 'path': '/dev/dm-8', 'multipath_id': '330000000279bfb87'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:59:38.277825 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000279bfb87', 'path': '/dev/dm-8', 'multipath_id': '330000000279bfb87'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:59:38.277825 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.668s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:59:38.277825 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b', 'iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b9d4f964-bf92-4184-a936-b3d05b7d8d1b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:59:38.277825 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:59:38.281710 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lazy-loading 'flavor' on Instance uuid d4fad20b-d51e-47c9-8f55-3aa085a10891 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:59:38.307146 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:38.307146 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:38.307146 np0000001583 nova-compute[98241]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:38.307146 np0000001583 nova-compute[98241]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:38.307146 np0000001583 nova-compute[98241]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:38.307146 np0000001583 nova-compute[98241]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:38.307146 np0000001583 nova-compute[98241]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b (non-flash)
May 28 01:59:38.307146 np0000001583 nova-compute[98241]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b (non-flash)
May 28 01:59:38.307146 np0000001583 nova-compute[98241]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:38.307146 np0000001583 nova-compute[98241]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:38.307146 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:59:38.307601 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:38.307601 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:38.307601 np0000001583 nova-compute[98241]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:38.307601 np0000001583 nova-compute[98241]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b (non-flash)
May 28 01:59:38.307601 np0000001583 nova-compute[98241]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:38.307601 np0000001583 nova-compute[98241]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:38.307601 np0000001583 nova-compute[98241]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b (non-flash)
May 28 01:59:38.307601 np0000001583 nova-compute[98241]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b (non-flash)
May 28 01:59:38.307601 np0000001583 nova-compute[98241]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:38.307601 np0000001583 nova-compute[98241]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:38.307601 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:59:38.307601 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', '68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', '69'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b', '70'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b', '71'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', '72'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', '73'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b', '74'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b', '75'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57', '76'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57', '77')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:59:38.307601 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b', '71')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:59:38.309018 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b', '70')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:59:38.310217 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724ec1aed40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b'): ({'sde'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:59:38.310482 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Removing multipathed devices sdd, sde {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:59:38.310747 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Flush multipath device 330000000a79276d2 {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:59:38.358000 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:59:38.399697 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:59:38.443633 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:59:38.443633 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:59:38.443633 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:59:38.453883 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:59:38.454151 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933578.4539466, d203e779-f827-4964-a8a9-368a89aab0e2 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:59:38.454279 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] VM Paused (Lifecycle Event)
May 28 01:59:38.458444 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:59:38.458773 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:59:38.472195 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:38.481101 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Took 7.43 seconds to spawn the instance on the hypervisor.
May 28 01:59:38.481337 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:59:38.512403 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 71, target: iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b, portal: 192.168.40.100,3260]
May 28 01:59:38.512403 np0000001583 nova-compute[98241]: Logout of [sid: 71, target: iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b, portal: 192.168.40.100,3260] successful.
May 28 01:59:38.512403 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:38.526169 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquiring lock "27c37404-4df0-4ded-bf5b-6002e26d4222" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:38.526577 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "27c37404-4df0-4ded-bf5b-6002e26d4222" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:38.534166 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:38.549660 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:38.580532 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b, portal: 192.168.50.100,3260]
May 28 01:59:38.580532 np0000001583 nova-compute[98241]: Logout of [sid: 70, target: iqn.2023-03.storpool.com:os--volume-b9d4f964-bf92-4184-a936-b3d05b7d8d1b, portal: 192.168.50.100,3260] successful.
May 28 01:59:38.580532 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:38.601172 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:38.601982 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:59:38.601982 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] <== disconnect_volume: return (2992ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:59:38.601982 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:59:38.601982 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Deleting instance files /opt/stack/data/nova/instances/5516d92e-c69f-40a2-bb82-a07c1aca64e7_del
May 28 01:59:38.602511 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Deletion of /opt/stack/data/nova/instances/5516d92e-c69f-40a2-bb82-a07c1aca64e7_del complete
May 28 01:59:38.785730 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Attempting to attach volume 8ea99ade-a69e-46e2-9c9d-6251e4f69a57 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98241) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 01:59:38.787560 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] attach device xml: <disk type="block" device="disk">
May 28 01:59:38.787560 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:59:38.787560 np0000001583 nova-compute[98241]:   <alias name="ua-8ea99ade-a69e-46e2-9c9d-6251e4f69a57"/>
May 28 01:59:38.787560 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-8"/>
May 28 01:59:38.787560 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 01:59:38.787560 np0000001583 nova-compute[98241]:   <serial>8ea99ade-a69e-46e2-9c9d-6251e4f69a57</serial>
May 28 01:59:38.787560 np0000001583 nova-compute[98241]: </disk>
May 28 01:59:38.787560 np0000001583 nova-compute[98241]:  {{(pid=98241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 01:59:38.933472 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-23d55173-55a5-48c6-a21e-45a3990cd446 req-bf67d894-8506-4d09-9710-c2d92df276fc service nova] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Received event network-vif-plugged-64151141-350a-4b34-b2a6-316b8dbefd14 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:59:38.933472 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-23d55173-55a5-48c6-a21e-45a3990cd446 req-bf67d894-8506-4d09-9710-c2d92df276fc service nova] Acquiring lock "d203e779-f827-4964-a8a9-368a89aab0e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:38.933472 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-23d55173-55a5-48c6-a21e-45a3990cd446 req-bf67d894-8506-4d09-9710-c2d92df276fc service nova] Lock "d203e779-f827-4964-a8a9-368a89aab0e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:38.933472 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-23d55173-55a5-48c6-a21e-45a3990cd446 req-bf67d894-8506-4d09-9710-c2d92df276fc service nova] Lock "d203e779-f827-4964-a8a9-368a89aab0e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:38.933472 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-23d55173-55a5-48c6-a21e-45a3990cd446 req-bf67d894-8506-4d09-9710-c2d92df276fc service nova] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] No waiting events found dispatching network-vif-plugged-64151141-350a-4b34-b2a6-316b8dbefd14 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:59:38.933472 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-23d55173-55a5-48c6-a21e-45a3990cd446 req-bf67d894-8506-4d09-9710-c2d92df276fc service nova] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Received unexpected event network-vif-plugged-64151141-350a-4b34-b2a6-316b8dbefd14 for instance with vm_state active and task_state None.
May 28 01:59:38.958505 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:59:38.961909 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933578.961619, d203e779-f827-4964-a8a9-368a89aab0e2 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:59:38.962023 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] VM Resumed (Lifecycle Event)
May 28 01:59:38.993391 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Took 13.40 seconds to build instance.
May 28 01:59:39.031004 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lazy-loading 'flavor' on Instance uuid 27c37404-4df0-4ded-bf5b-6002e26d4222 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:59:39.108779 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Took 4.03 seconds to destroy the instance on the hypervisor.
May 28 01:59:39.110275 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:59:39.110275 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:59:39.110275 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:59:39.110275 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:59:39.246782 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:59:39.432215 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-341793d5-ceb0-40ee-ba9b-c73aedd16cc8 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-146fbda9-15e8-4bd7-911b-f03b9308c11b for instance e3e9a0d0-72cd-459e-8bc4-cf080adb5267 {{(pid=98241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 01:59:39.471489 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:59:39.477419 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:59:39.495012 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "d203e779-f827-4964-a8a9-368a89aab0e2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.910s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:39.980486 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Received event <DeviceRemovedEvent: 1779933579.980143, e3e9a0d0-72cd-459e-8bc4-cf080adb5267 => ua-146fbda9-15e8-4bd7-911b-f03b9308c11b> from libvirt while the driver is waiting for it; dispatched. {{(pid=98241) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 01:59:39.983189 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-341793d5-ceb0-40ee-ba9b-c73aedd16cc8 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Successfully detached device vdb from instance e3e9a0d0-72cd-459e-8bc4-cf080adb5267 from the live domain config.
May 28 01:59:40.018936 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-341793d5-ceb0-40ee-ba9b-c73aedd16cc8 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:59:40.019228 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-341793d5-ceb0-40ee-ba9b-c73aedd16cc8 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b', 'iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '146fbda9-15e8-4bd7-911b-f03b9308c11b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': False}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:59:40.019332 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-341793d5-ceb0-40ee-ba9b-c73aedd16cc8 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:59:40.019641 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-341793d5-ceb0-40ee-ba9b-c73aedd16cc8 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:59:40.019866 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-341793d5-ceb0-40ee-ba9b-c73aedd16cc8 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b', 'iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '146fbda9-15e8-4bd7-911b-f03b9308c11b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:59:40.019977 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-341793d5-ceb0-40ee-ba9b-c73aedd16cc8 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:59:40.036095 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "27c37404-4df0-4ded-bf5b-6002e26d4222" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:40.047990 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-341793d5-ceb0-40ee-ba9b-c73aedd16cc8 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:40.047990 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:40.047990 np0000001583 nova-compute[98241]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:40.047990 np0000001583 nova-compute[98241]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:40.047990 np0000001583 nova-compute[98241]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b (non-flash)
May 28 01:59:40.047990 np0000001583 nova-compute[98241]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b (non-flash)
May 28 01:59:40.047990 np0000001583 nova-compute[98241]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:40.047990 np0000001583 nova-compute[98241]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:40.047990 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:59:40.048310 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-341793d5-ceb0-40ee-ba9b-c73aedd16cc8 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:40.048310 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:40.048310 np0000001583 nova-compute[98241]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:40.048310 np0000001583 nova-compute[98241]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:40.048310 np0000001583 nova-compute[98241]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b (non-flash)
May 28 01:59:40.048310 np0000001583 nova-compute[98241]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b (non-flash)
May 28 01:59:40.048310 np0000001583 nova-compute[98241]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:40.048310 np0000001583 nova-compute[98241]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:40.048310 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:59:40.048599 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-341793d5-ceb0-40ee-ba9b-c73aedd16cc8 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', '68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', '69'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', '72'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', '73'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b', '74'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b', '75'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57', '76'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57', '77')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:59:40.048599 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-341793d5-ceb0-40ee-ba9b-c73aedd16cc8 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b', '75')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:59:40.049490 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-341793d5-ceb0-40ee-ba9b-c73aedd16cc8 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b', '74')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:59:40.050287 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-341793d5-ceb0-40ee-ba9b-c73aedd16cc8 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f870c860>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b'): ({'sdh'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:59:40.050485 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-341793d5-ceb0-40ee-ba9b-c73aedd16cc8 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Removing multipathed devices sdh, sdi {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:59:40.050755 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-341793d5-ceb0-40ee-ba9b-c73aedd16cc8 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Flush multipath device 330000000400f98cc {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:59:40.082575 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-341793d5-ceb0-40ee-ba9b-c73aedd16cc8 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:59:40.143828 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-341793d5-ceb0-40ee-ba9b-c73aedd16cc8 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:59:40.145469 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:59:40.210542 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-341793d5-ceb0-40ee-ba9b-c73aedd16cc8 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:59:40.210832 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-341793d5-ceb0-40ee-ba9b-c73aedd16cc8 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:59:40.212276 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-341793d5-ceb0-40ee-ba9b-c73aedd16cc8 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:59:40.225990 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-341793d5-ceb0-40ee-ba9b-c73aedd16cc8 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:59:40.226276 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-341793d5-ceb0-40ee-ba9b-c73aedd16cc8 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:59:40.241703 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-341793d5-ceb0-40ee-ba9b-c73aedd16cc8 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:40.278074 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-341793d5-ceb0-40ee-ba9b-c73aedd16cc8 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 75, target: iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b, portal: 192.168.40.100,3260]
May 28 01:59:40.278074 np0000001583 nova-compute[98241]: Logout of [sid: 75, target: iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b, portal: 192.168.40.100,3260] successful.
May 28 01:59:40.278074 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:40.295487 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-341793d5-ceb0-40ee-ba9b-c73aedd16cc8 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:40.311159 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-341793d5-ceb0-40ee-ba9b-c73aedd16cc8 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:40.347327 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-341793d5-ceb0-40ee-ba9b-c73aedd16cc8 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 74, target: iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b, portal: 192.168.50.100,3260]
May 28 01:59:40.347327 np0000001583 nova-compute[98241]: Logout of [sid: 74, target: iqn.2023-03.storpool.com:os--volume-146fbda9-15e8-4bd7-911b-f03b9308c11b, portal: 192.168.50.100,3260] successful.
May 28 01:59:40.347327 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:40.369687 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-341793d5-ceb0-40ee-ba9b-c73aedd16cc8 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:40.369900 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-341793d5-ceb0-40ee-ba9b-c73aedd16cc8 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:59:40.370236 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-341793d5-ceb0-40ee-ba9b-c73aedd16cc8 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] <== disconnect_volume: return (350ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:59:40.370236 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-341793d5-ceb0-40ee-ba9b-c73aedd16cc8 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:59:40.450473 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:59:40.450682 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:59:40.450837 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:59:40.450986 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] No VIF found with MAC fa:16:3e:ca:8c:e2, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:59:40.604574 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:40.607753 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Acquiring lock "63688346-f8e2-4fbe-987d-bf55df9fa3a4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:40.608014 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "63688346-f8e2-4fbe-987d-bf55df9fa3a4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:40.647726 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Took 1.54 seconds to deallocate network for instance.
May 28 01:59:40.728248 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2752fa0c-fad8-4e64-90c2-155c7b765911 req-f0b3cca1-5b8c-4419-9ddb-c0888c4d8410 service nova] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Received event network-changed-64151141-350a-4b34-b2a6-316b8dbefd14 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:59:40.728458 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2752fa0c-fad8-4e64-90c2-155c7b765911 req-f0b3cca1-5b8c-4419-9ddb-c0888c4d8410 service nova] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Refreshing instance network info cache due to event network-changed-64151141-350a-4b34-b2a6-316b8dbefd14. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:59:40.728640 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2752fa0c-fad8-4e64-90c2-155c7b765911 req-f0b3cca1-5b8c-4419-9ddb-c0888c4d8410 service nova] Acquiring lock "refresh_cache-d203e779-f827-4964-a8a9-368a89aab0e2" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:59:40.728752 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2752fa0c-fad8-4e64-90c2-155c7b765911 req-f0b3cca1-5b8c-4419-9ddb-c0888c4d8410 service nova] Acquired lock "refresh_cache-d203e779-f827-4964-a8a9-368a89aab0e2" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:59:40.728955 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-2752fa0c-fad8-4e64-90c2-155c7b765911 req-f0b3cca1-5b8c-4419-9ddb-c0888c4d8410 service nova] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Refreshing network info cache for port 64151141-350a-4b34-b2a6-316b8dbefd14 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:59:40.924940 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-341793d5-ceb0-40ee-ba9b-c73aedd16cc8 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lazy-loading 'flavor' on Instance uuid e3e9a0d0-72cd-459e-8bc4-cf080adb5267 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:59:41.007696 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d48a0095-c936-477b-99ab-d34c514dc8c5 req-976d1c09-bf27-4741-8baa-e3af87e9907b service nova] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Received event network-vif-deleted-3ea23ee8-f2dc-4506-8207-7f2fb70c03b8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:59:41.103784 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquiring lock "27c37404-4df0-4ded-bf5b-6002e26d4222" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:41.104049 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "27c37404-4df0-4ded-bf5b-6002e26d4222" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:41.104328 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Attaching volume 427b9388-1867-4ed3-b48c-dde22e23e376 to /dev/vdb
May 28 01:59:41.114734 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lazy-loading 'flavor' on Instance uuid 63688346-f8e2-4fbe-987d-bf55df9fa3a4 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:59:41.155751 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:59:41.169974 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:59:41.197450 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:41.219652 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Took 0.57 seconds to detach 1 volumes for instance.
May 28 01:59:41.232072 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-2752fa0c-fad8-4e64-90c2-155c7b765911 req-f0b3cca1-5b8c-4419-9ddb-c0888c4d8410 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:59:41.251852 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:59:41.252219 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:59:41.264849 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:59:41.267793 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::8832:afff:fe8a:cd4c', 'fe80::fc16:3eff:fe48:7d7b', 'fe80::d0cf:7bff:fef9:3cc3', 'fe80::fc16:3eff:feca:d649', 'fe80::fc16:3eff:fed3:cd06', 'fe80::fc16:3eff:feae:1e12', 'fe80::fc16:3eff:feca:8ce2', 'fe80::5048:4dff:fe67:fb12', 'fe80::fc16:3eff:fee8:1f', 'fe80::fc16:3eff:fe24:bbc4', 'fe80::b0dd:40ff:feb5:6704', 'fe80::fc16:3eff:feae:cc0f', 'fe80::9020:88ff:fe40:d02', 'fe80::fc16:3eff:fedf:4521', 'fe80::fc16:3eff:fef3:6803', 'fe80::ecb9:b7ff:fe00:dc63'] 
May 28 01:59:41.267922 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:59:41.269891 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:59:41.269891 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:59:41.270497 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Updating existing volume attachment record: 86472a32-c7bc-458e-a100-63595378f49c {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:59:41.617390 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Ignoring supplied device name: /dev/vdb
May 28 01:59:41.648117 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-2752fa0c-fad8-4e64-90c2-155c7b765911 req-f0b3cca1-5b8c-4419-9ddb-c0888c4d8410 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:59:41.733311 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:41.733557 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:41.804450 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-2752fa0c-fad8-4e64-90c2-155c7b765911 req-f0b3cca1-5b8c-4419-9ddb-c0888c4d8410 service nova] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Updated VIF entry in instance network info cache for port 64151141-350a-4b34-b2a6-316b8dbefd14. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:59:41.804700 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-2752fa0c-fad8-4e64-90c2-155c7b765911 req-f0b3cca1-5b8c-4419-9ddb-c0888c4d8410 service nova] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Updating instance_info_cache with network_info: [{"id": "64151141-350a-4b34-b2a6-316b8dbefd14", "address": "fa:16:3e:f3:68:03", "network": {"id": "62e7cc38-1758-4b09-a352-4635adc9cfea", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587967507-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "837663bcfa40402aaf583729dfbb26cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap64151141-35", "ovs_interfaceid": "64151141-350a-4b34-b2a6-316b8dbefd14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:59:41.843038 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:59:41.844543 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376', 'iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '427b9388-1867-4ed3-b48c-dde22e23e376', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:59:41.845322 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:59:41.845898 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:59:41.846222 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376', 'iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '427b9388-1867-4ed3-b48c-dde22e23e376', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:59:41.859047 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:59:41.859686 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:59:41.860292 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:59:41.860501 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:59:41.860959 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:59:41.861173 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:59:41.874316 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:59:41.874316 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:41.879116 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:59:41.879116 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:41.889500 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376] added
May 28 01:59:41.889500 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:59:41.889500 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:59:41.889500 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:59:41.889500 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:59:41.889500 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:59:41.889500 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:41.890225 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:59:41.890225 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0295(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:59:41.890344 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:59:41.891041 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376] added
May 28 01:59:41.891041 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:59:41.891041 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:59:41.891041 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:59:41.891041 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:59:41.891041 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:59:41.891041 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:41.891306 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:59:41.891306 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0302(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:59:41.891430 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:59:41.894984 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Acquiring lock "8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:41.895181 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:41.895389 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Rebooting instance
May 28 01:59:41.920226 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Refreshing inventories for resource provider cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 28 01:59:41.932327 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-341793d5-ceb0-40ee-ba9b-c73aedd16cc8 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "e3e9a0d0-72cd-459e-8bc4-cf080adb5267" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.470s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:41.974380 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Updating ProviderTree inventory for provider cfa1af79-477d-460a-869d-84a19fa91765 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 28 01:59:41.974554 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Updating inventory in ProviderTree for provider cfa1af79-477d-460a-869d-84a19fa91765 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 28 01:59:42.014326 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Refreshing aggregate associations for resource provider cfa1af79-477d-460a-869d-84a19fa91765, aggregates: None {{(pid=98241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 28 01:59:42.041706 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-72679ec2-59ef-4688-a46a-e9e1646dffc7 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "d4fad20b-d51e-47c9-8f55-3aa085a10891" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.521s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:42.064713 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Refreshing trait associations for resource provider cfa1af79-477d-460a-869d-84a19fa91765, traits: COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_NET_VIF_MODEL_IGB,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_ARCH_AARCH64,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_ARCH_S390X,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ARCH_MIPSEL,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,COMPUTE_SOUND_MODEL_USB,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ARCH_X86_64,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ARCH_RISCV64,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ARCH_PPC64LE,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_SOUND_MODEL_SB16,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_SOUND_MODEL_AC97,COMPUTE_RESCUE_BFV,HW_ARCH_X86_64,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=98241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 28 01:59:42.120148 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "63688346-f8e2-4fbe-987d-bf55df9fa3a4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:42.306535 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2752fa0c-fad8-4e64-90c2-155c7b765911 req-f0b3cca1-5b8c-4419-9ddb-c0888c4d8410 service nova] Releasing lock "refresh_cache-d203e779-f827-4964-a8a9-368a89aab0e2" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:59:42.410781 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6c872ee3-e3a4-4810-b7a0-eaad10d7a58c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Acquiring lock "d4fad20b-d51e-47c9-8f55-3aa085a10891" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:42.410973 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6c872ee3-e3a4-4810-b7a0-eaad10d7a58c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "d4fad20b-d51e-47c9-8f55-3aa085a10891" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:42.411148 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-6c872ee3-e3a4-4810-b7a0-eaad10d7a58c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:59:42.415597 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-6c872ee3-e3a4-4810-b7a0-eaad10d7a58c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=98241) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 28 01:59:42.416503 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-6c872ee3-e3a4-4810-b7a0-eaad10d7a58c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lazy-loading 'flavor' on Instance uuid d4fad20b-d51e-47c9-8f55-3aa085a10891 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:59:42.476454 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Acquiring lock "refresh_cache-8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:59:42.476683 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Acquired lock "refresh_cache-8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:59:42.476862 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:59:42.682328 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:59:42.682853 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:59:42.890898 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:59:42.894406 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:59:42.907701 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:59:42.907701 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:59:42.916446 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:59:42.916446 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:42.930380 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:42.938599 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:42.950512 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:42.950512 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:42.950512 np0000001583 nova-compute[98241]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:42.950512 np0000001583 nova-compute[98241]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:42.950512 np0000001583 nova-compute[98241]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:42.950512 np0000001583 nova-compute[98241]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:42.950512 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:59:42.950785 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:42.950785 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:42.950785 np0000001583 nova-compute[98241]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:42.950785 np0000001583 nova-compute[98241]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:42.950785 np0000001583 nova-compute[98241]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:42.950785 np0000001583 nova-compute[98241]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:42.950785 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:59:42.958204 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:42.958204 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:42.958204 np0000001583 nova-compute[98241]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:42.958204 np0000001583 nova-compute[98241]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:42.958204 np0000001583 nova-compute[98241]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:42.958204 np0000001583 nova-compute[98241]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:42.958204 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:59:42.958616 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:42.958616 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:42.958616 np0000001583 nova-compute[98241]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:42.958616 np0000001583 nova-compute[98241]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:42.958616 np0000001583 nova-compute[98241]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:42.958616 np0000001583 nova-compute[98241]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:42.958616 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:59:42.979418 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:59:42.991163 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376, portal: 192.168.50.100,3260]
May 28 01:59:42.991163 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376, portal: 192.168.50.100,3260] successful.
May 28 01:59:42.991163 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:43.006796 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:43.013555 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376, portal: 192.168.40.100,3260]
May 28 01:59:43.013555 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376, portal: 192.168.40.100,3260] successful.
May 28 01:59:43.013555 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:43.025836 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:43.025836 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:43.025836 np0000001583 nova-compute[98241]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:43.025836 np0000001583 nova-compute[98241]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:43.025836 np0000001583 nova-compute[98241]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:43.025836 np0000001583 nova-compute[98241]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:43.025836 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:43.025836 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:43.025836 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:59:43.025836 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:43.025836 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:43.025836 np0000001583 nova-compute[98241]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:43.025836 np0000001583 nova-compute[98241]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:43.025836 np0000001583 nova-compute[98241]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:43.025836 np0000001583 nova-compute[98241]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:43.025836 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:43.025836 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:43.025836 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:59:43.026250 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.166s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:59:43.026250 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:59:43.027288 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] HCTL ('9', '-', '-', 0) found on session 78 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:59:43.027437 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:59:43.031520 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:43.052551 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Searching for a device in session 78 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:59:43.052551 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '427b9388-1867-4ed3-b48c-dde22e23e376', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:59:43.061575 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:43.061575 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:43.061575 np0000001583 nova-compute[98241]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:43.061575 np0000001583 nova-compute[98241]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:43.061575 np0000001583 nova-compute[98241]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:43.061575 np0000001583 nova-compute[98241]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:43.061575 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:43.061575 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:43.061575 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:59:43.063941 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:43.063941 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:43.063941 np0000001583 nova-compute[98241]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:43.063941 np0000001583 nova-compute[98241]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:43.063941 np0000001583 nova-compute[98241]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:43.063941 np0000001583 nova-compute[98241]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:43.063941 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:43.063941 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:43.063941 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:59:43.063941 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.201s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:59:43.063941 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:59:43.063941 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] HCTL ('10', '-', '-', 0) found on session 79 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:59:43.063941 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:59:43.086046 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Searching for a device in session 79 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:59:43.087049 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '427b9388-1867-4ed3-b48c-dde22e23e376', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:59:43.185558 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:59:43.193433 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:43.227928 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Acquiring lock "63688346-f8e2-4fbe-987d-bf55df9fa3a4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:43.228285 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "63688346-f8e2-4fbe-987d-bf55df9fa3a4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:43.229606 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Attaching volume eb978e57-12a6-44b0-8770-f1a5a2411c21 to /dev/vdb
May 28 01:59:43.284186 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:59:43.301418 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:59:43.329357 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:43.370405 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:59:43.372226 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:59:43.380047 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:59:43.383410 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:59:43.384786 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::8832:afff:fe8a:cd4c', 'fe80::fc16:3eff:fe48:7d7b', 'fe80::d0cf:7bff:fef9:3cc3', 'fe80::fc16:3eff:feca:d649', 'fe80::fc16:3eff:fed3:cd06', 'fe80::fc16:3eff:feae:1e12', 'fe80::fc16:3eff:feca:8ce2', 'fe80::5048:4dff:fe67:fb12', 'fe80::fc16:3eff:fee8:1f', 'fe80::fc16:3eff:fe24:bbc4', 'fe80::b0dd:40ff:feb5:6704', 'fe80::fc16:3eff:feae:cc0f', 'fe80::9020:88ff:fe40:d02', 'fe80::fc16:3eff:fedf:4521', 'fe80::fc16:3eff:fef3:6803', 'fe80::ecb9:b7ff:fe00:dc63'] 
May 28 01:59:43.384958 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:59:43.385015 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:59:43.385364 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] <== get_connector_properties: return (100ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:59:43.385614 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Updating existing volume attachment record: 958fae9f-4f05-48d1-9c72-0003b7b0d5e9 {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:59:43.451598 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:43.455280 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:43.480639 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:43.486122 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:43.517516 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:43.519467 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:43.557419 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Updating instance_info_cache with network_info: [{"id": "1bce33b1-57be-4de9-9e81-1a05535ae317", "address": "fa:16:3e:ae:cc:0f", "network": {"id": "c18d43cf-482c-4814-96a1-09aab2287be4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2071326233-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d5cfe906dd24a10819b92c144f7f06f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bce33b1-57", "ovs_interfaceid": "1bce33b1-57be-4de9-9e81-1a05535ae317", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:59:43.652175 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a93bbf66-626b-4880-9e8c-6c78f7a26be4 req-271871d5-fe6f-4d3b-9a4c-60cc1c904186 service nova] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Received event network-vif-unplugged-0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:59:43.652175 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a93bbf66-626b-4880-9e8c-6c78f7a26be4 req-271871d5-fe6f-4d3b-9a4c-60cc1c904186 service nova] Acquiring lock "d4fad20b-d51e-47c9-8f55-3aa085a10891-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:43.652175 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a93bbf66-626b-4880-9e8c-6c78f7a26be4 req-271871d5-fe6f-4d3b-9a4c-60cc1c904186 service nova] Lock "d4fad20b-d51e-47c9-8f55-3aa085a10891-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:43.652175 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a93bbf66-626b-4880-9e8c-6c78f7a26be4 req-271871d5-fe6f-4d3b-9a4c-60cc1c904186 service nova] Lock "d4fad20b-d51e-47c9-8f55-3aa085a10891-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:43.652400 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a93bbf66-626b-4880-9e8c-6c78f7a26be4 req-271871d5-fe6f-4d3b-9a4c-60cc1c904186 service nova] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] No waiting events found dispatching network-vif-unplugged-0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:59:43.652653 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-a93bbf66-626b-4880-9e8c-6c78f7a26be4 req-271871d5-fe6f-4d3b-9a4c-60cc1c904186 service nova] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Received unexpected event network-vif-unplugged-0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b for instance with vm_state active and task_state powering-off.
May 28 01:59:43.702648 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.969s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:43.742351 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:43.750058 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:43.780014 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Deleted allocations for instance 5516d92e-c69f-40a2-bb82-a07c1aca64e7
May 28 01:59:43.785837 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999598552999942 future=<Future at 0x7724f872f7d0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:59:43.788518 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Instance destroyed successfully.
May 28 01:59:43.789053 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-6c872ee3-e3a4-4810-b7a0-eaad10d7a58c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lazy-loading 'numa_topology' on Instance uuid d4fad20b-d51e-47c9-8f55-3aa085a10891 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:59:43.861204 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:59:43.944660 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:59:43.945104 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21', 'iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'eb978e57-12a6-44b0-8770-f1a5a2411c21', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:59:43.945283 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:59:44.059184 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "8b2a5f31-1b3d-447f-939e-94fd0be5eb85" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:44.059438 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "8b2a5f31-1b3d-447f-939e-94fd0be5eb85" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:44.060518 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Releasing lock "refresh_cache-8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:59:44.292796 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-6c872ee3-e3a4-4810-b7a0-eaad10d7a58c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Object Instance<d4fad20b-d51e-47c9-8f55-3aa085a10891> lazy-loaded attributes: flavor,numa_topology {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:59:44.292953 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-6c872ee3-e3a4-4810-b7a0-eaad10d7a58c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:59:44.564589 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:59:44.567319 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:59:44.713281 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0004019829998469504 future=<Future at 0x7724f83b2a50 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:59:44.714445 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Emitting event <LifecycleEvent: 1779933569.712772, 5516d92e-c69f-40a2-bb82-a07c1aca64e7 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:59:44.714670 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:59:44.714931 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] VM Stopped (Lifecycle Event)
May 28 01:59:44.716247 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.069290302999889 future=<Future at 0x7724f872f7d0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:59:44.716247 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.069134877000124 future=<Future at 0x7724f872f7d0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:59:44.790022 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-aef33a10-2096-469a-8adc-b65e804ebbbd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "5516d92e-c69f-40a2-bb82-a07c1aca64e7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.224s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:44.801180 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6c872ee3-e3a4-4810-b7a0-eaad10d7a58c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "d4fad20b-d51e-47c9-8f55-3aa085a10891" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.390s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:44.877311 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Found WWN 330000000f6df55ac for multipath device dm-3 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:59:44.877682 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:59:44.877877 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] <== connect_volume: return (3033ms) {'type': 'block', 'scsi_wwn': '330000000f6df55ac', 'path': '/dev/dm-3', 'multipath_id': '330000000f6df55ac'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:59:44.878003 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f6df55ac', 'path': '/dev/dm-3', 'multipath_id': '330000000f6df55ac'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:59:44.878690 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.933s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:59:44.879022 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21', 'iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'eb978e57-12a6-44b0-8770-f1a5a2411c21', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:59:44.881234 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lazy-loading 'flavor' on Instance uuid 27c37404-4df0-4ded-bf5b-6002e26d4222 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:59:44.895602 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:59:44.897097 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:59:44.898812 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:59:44.899675 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:59:44.900450 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:59:44.900650 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:59:44.914033 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:59:44.914033 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:44.919902 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:59:44.919902 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:44.929011 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21] added
May 28 01:59:44.929011 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:59:44.929011 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:59:44.929011 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:59:44.929011 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:59:44.929011 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:59:44.929011 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:44.930739 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:59:44.930739 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0308(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:59:44.930739 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:59:44.933309 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21] added
May 28 01:59:44.933309 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:59:44.933309 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:59:44.933309 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:59:44.933309 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:59:44.933309 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:59:44.933309 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:44.933879 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:59:44.933879 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.033(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:59:44.933879 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:59:45.127595 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:45.127847 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:45.131054 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:59:45.131259 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Claim successful on node np0000001583
May 28 01:59:45.218439 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 5516d92e-c69f-40a2-bb82-a07c1aca64e7] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:59:45.259470 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lazy-loading 'flavor' on Instance uuid d4fad20b-d51e-47c9-8f55-3aa085a10891 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:59:45.384215 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Attempting to attach volume 427b9388-1867-4ed3-b48c-dde22e23e376 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98241) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 01:59:45.385883 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] attach device xml: <disk type="block" device="disk">
May 28 01:59:45.385883 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:59:45.385883 np0000001583 nova-compute[98241]:   <alias name="ua-427b9388-1867-4ed3-b48c-dde22e23e376"/>
May 28 01:59:45.385883 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-3"/>
May 28 01:59:45.385883 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 01:59:45.385883 np0000001583 nova-compute[98241]:   <serial>427b9388-1867-4ed3-b48c-dde22e23e376</serial>
May 28 01:59:45.385883 np0000001583 nova-compute[98241]: </disk>
May 28 01:59:45.385883 np0000001583 nova-compute[98241]:  {{(pid=98241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 01:59:45.605605 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:45.610919 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:45.619577 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:45.638688 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:45.641836 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:45.679803 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:45.713584 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5ee35d85-7ddd-4572-b43c-1570c4f2b00d req-76a40fe5-91f1-4d68-b511-971b0d50470e service nova] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Received event network-vif-unplugged-0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:59:45.714492 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5ee35d85-7ddd-4572-b43c-1570c4f2b00d req-76a40fe5-91f1-4d68-b511-971b0d50470e service nova] Acquiring lock "d4fad20b-d51e-47c9-8f55-3aa085a10891-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:45.715413 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5ee35d85-7ddd-4572-b43c-1570c4f2b00d req-76a40fe5-91f1-4d68-b511-971b0d50470e service nova] Lock "d4fad20b-d51e-47c9-8f55-3aa085a10891-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:45.715697 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5ee35d85-7ddd-4572-b43c-1570c4f2b00d req-76a40fe5-91f1-4d68-b511-971b0d50470e service nova] Lock "d4fad20b-d51e-47c9-8f55-3aa085a10891-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:45.716638 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5ee35d85-7ddd-4572-b43c-1570c4f2b00d req-76a40fe5-91f1-4d68-b511-971b0d50470e service nova] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] No waiting events found dispatching network-vif-unplugged-0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:59:45.716638 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-5ee35d85-7ddd-4572-b43c-1570c4f2b00d req-76a40fe5-91f1-4d68-b511-971b0d50470e service nova] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Received unexpected event network-vif-unplugged-0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b for instance with vm_state stopped and task_state powering-on.
May 28 01:59:45.763501 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Acquiring lock "refresh_cache-d4fad20b-d51e-47c9-8f55-3aa085a10891" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:59:45.763501 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Acquired lock "refresh_cache-d4fad20b-d51e-47c9-8f55-3aa085a10891" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:59:45.763659 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:59:45.763740 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lazy-loading 'info_cache' on Instance uuid d4fad20b-d51e-47c9-8f55-3aa085a10891 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:59:45.808689 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-c299c094-c2b0-4452-af77-6ad4fe9e2908 req-51b97b28-8531-4625-8f50-bbc25d42171b service nova] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Received event network-vif-unplugged-1bce33b1-57be-4de9-9e81-1a05535ae317 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:59:45.809355 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c299c094-c2b0-4452-af77-6ad4fe9e2908 req-51b97b28-8531-4625-8f50-bbc25d42171b service nova] Acquiring lock "8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:45.809643 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c299c094-c2b0-4452-af77-6ad4fe9e2908 req-51b97b28-8531-4625-8f50-bbc25d42171b service nova] Lock "8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:45.809903 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c299c094-c2b0-4452-af77-6ad4fe9e2908 req-51b97b28-8531-4625-8f50-bbc25d42171b service nova] Lock "8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:45.810596 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-c299c094-c2b0-4452-af77-6ad4fe9e2908 req-51b97b28-8531-4625-8f50-bbc25d42171b service nova] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] No waiting events found dispatching network-vif-unplugged-1bce33b1-57be-4de9-9e81-1a05535ae317 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:59:45.810703 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-c299c094-c2b0-4452-af77-6ad4fe9e2908 req-51b97b28-8531-4625-8f50-bbc25d42171b service nova] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Received unexpected event network-vif-unplugged-1bce33b1-57be-4de9-9e81-1a05535ae317 for instance with vm_state active and task_state reboot_started_hard.
May 28 01:59:45.931247 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:59:45.939144 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:59:45.952522 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:59:45.952522 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:45.955464 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999629992999871 future=<Future at 0x7724ec4b1520 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:59:45.956969 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Instance destroyed successfully.
May 28 01:59:45.957649 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lazy-loading 'resources' on Instance uuid 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:59:45.963542 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:59:45.963542 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:45.971559 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:45.979723 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:45.992836 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:45.992836 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:45.992836 np0000001583 nova-compute[98241]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:45.992836 np0000001583 nova-compute[98241]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:45.992836 np0000001583 nova-compute[98241]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:45.992836 np0000001583 nova-compute[98241]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:45.992836 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:45.992836 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:45.992836 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:59:45.993929 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:45.993929 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:45.993929 np0000001583 nova-compute[98241]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:45.993929 np0000001583 nova-compute[98241]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:45.993929 np0000001583 nova-compute[98241]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:45.993929 np0000001583 nova-compute[98241]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:45.993929 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:45.993929 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:45.993929 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:59:46.007430 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:46.007430 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:46.007430 np0000001583 nova-compute[98241]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:46.007430 np0000001583 nova-compute[98241]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:46.007430 np0000001583 nova-compute[98241]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:46.007430 np0000001583 nova-compute[98241]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:46.007430 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:46.007430 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:46.007430 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:59:46.007430 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:46.007430 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:46.007430 np0000001583 nova-compute[98241]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:46.007430 np0000001583 nova-compute[98241]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:46.007430 np0000001583 nova-compute[98241]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:46.007430 np0000001583 nova-compute[98241]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:46.007430 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:46.007430 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:46.007430 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:59:46.049489 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21, portal: 192.168.40.100,3260]
May 28 01:59:46.049489 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21, portal: 192.168.40.100,3260] successful.
May 28 01:59:46.049489 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:46.061679 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:46.067309 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21, portal: 192.168.50.100,3260]
May 28 01:59:46.067309 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21, portal: 192.168.50.100,3260] successful.
May 28 01:59:46.067309 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:46.081758 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:46.082603 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:46.082603 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:46.082603 np0000001583 nova-compute[98241]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:46.082603 np0000001583 nova-compute[98241]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:46.082603 np0000001583 nova-compute[98241]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:46.082603 np0000001583 nova-compute[98241]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:46.082603 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:46.082603 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:46.082603 np0000001583 nova-compute[98241]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:46.082603 np0000001583 nova-compute[98241]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:46.082603 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:59:46.083011 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:46.083011 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:46.083011 np0000001583 nova-compute[98241]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:46.083011 np0000001583 nova-compute[98241]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:46.083011 np0000001583 nova-compute[98241]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:46.083011 np0000001583 nova-compute[98241]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:46.083011 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:46.083011 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:46.083011 np0000001583 nova-compute[98241]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:46.083011 np0000001583 nova-compute[98241]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:46.083011 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:59:46.083301 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.184s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:59:46.083385 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:59:46.084445 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] HCTL ('13', '-', '-', 0) found on session 80 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:59:46.084585 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:59:46.100223 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Searching for a device in session 80 and hctl ['13', '*', '*', 0] yield: None {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:59:46.109701 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:46.109701 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:46.109701 np0000001583 nova-compute[98241]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:46.109701 np0000001583 nova-compute[98241]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:46.109701 np0000001583 nova-compute[98241]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:46.109701 np0000001583 nova-compute[98241]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:46.109701 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:46.109701 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:46.109701 np0000001583 nova-compute[98241]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:46.109701 np0000001583 nova-compute[98241]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:46.109701 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:59:46.109701 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:46.109701 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:46.109701 np0000001583 nova-compute[98241]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:46.109701 np0000001583 nova-compute[98241]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:46.109701 np0000001583 nova-compute[98241]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:46.109701 np0000001583 nova-compute[98241]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:46.109701 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:46.109701 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:46.109701 np0000001583 nova-compute[98241]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:46.109701 np0000001583 nova-compute[98241]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:46.109701 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:59:46.109701 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.203s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:59:46.109701 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:59:46.109701 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] HCTL ('14', '-', '-', 0) found on session 81 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:59:46.109701 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:59:46.122791 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Searching for a device in session 81 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:59:46.123018 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'eb978e57-12a6-44b0-8770-f1a5a2411c21', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:59:46.270683 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Object Instance<d4fad20b-d51e-47c9-8f55-3aa085a10891> lazy-loaded attributes: flavor,info_cache {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:59:46.461259 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:58:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1116550051',display_name='tempest-TestMinimumBasicScenario-server-1116550051',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testminimumbasicscenario-server-1116550051',id=37,image_ref='2cc2ffd4-9757-447d-a451-53527f5bcc1f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMULG2kTEY+WhVbRzbS6xOD6CJCgxm22CYbbQxg0BTn9Kii/R8Mt6h4nIBTEe0X4SkZIt8ct5xyc3FmGuzZLRtxpNB61Zb7jVrz/BvdWxTdtIMJsifze5TU8LnUgQB0QDQ==',key_name='tempest-TestMinimumBasicScenario-2031915617',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:59:05Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d5cfe906dd24a10819b92c144f7f06f',ramdisk_id='',reservation_id='r-q03o3420',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2cc2ffd4-9757-447d-a451-53527f5bcc1f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1092247749',owner_user_name='tempest-TestMinimumBasicScenario-1092247749-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:59:45Z,user_data=None,user_id='f52a7ae7fbc644deb82f3382de3a4edd',uuid=8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1bce33b1-57be-4de9-9e81-1a05535ae317", "address": "fa:16:3e:ae:cc:0f", "network": {"id": "c18d43cf-482c-4814-96a1-09aab2287be4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2071326233-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d5cfe906dd24a10819b92c144f7f06f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bce33b1-57", "ovs_interfaceid": "1bce33b1-57be-4de9-9e81-1a05535ae317", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:59:46.461451 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Converting VIF {"id": "1bce33b1-57be-4de9-9e81-1a05535ae317", "address": "fa:16:3e:ae:cc:0f", "network": {"id": "c18d43cf-482c-4814-96a1-09aab2287be4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2071326233-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d5cfe906dd24a10819b92c144f7f06f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bce33b1-57", "ovs_interfaceid": "1bce33b1-57be-4de9-9e81-1a05535ae317", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:59:46.462147 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:cc:0f,bridge_name='br-int',has_traffic_filtering=True,id=1bce33b1-57be-4de9-9e81-1a05535ae317,network=Network(c18d43cf-482c-4814-96a1-09aab2287be4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bce33b1-57') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:59:46.462362 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:cc:0f,bridge_name='br-int',has_traffic_filtering=True,id=1bce33b1-57be-4de9-9e81-1a05535ae317,network=Network(c18d43cf-482c-4814-96a1-09aab2287be4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bce33b1-57') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:59:46.465542 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:46.465794 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1bce33b1-57, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:59:46.472404 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:46.473572 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:59:46.480115 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:46.480115 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e8e761a8-209d-4f26-9893-1c834ab7070d) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:59:46.480115 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:46.480115 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:59:46.485999 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:46.488422 np0000001583 nova-compute[98241]: INFO os_vif [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:cc:0f,bridge_name='br-int',has_traffic_filtering=True,id=1bce33b1-57be-4de9-9e81-1a05535ae317,network=Network(c18d43cf-482c-4814-96a1-09aab2287be4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bce33b1-57')
May 28 01:59:46.490941 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:59:46.491244 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', 'iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:59:46.491362 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:59:46.746335 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:59:46.746684 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:59:46.774066 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:59:47.051397 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:59:47.051536 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:59:47.051639 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:59:47.051740 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] No VIF found with MAC fa:16:3e:e8:00:1f, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:59:47.101041 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Searching for a device in session 80 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:59:47.101297 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'eb978e57-12a6-44b0-8770-f1a5a2411c21', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:59:47.122510 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:59:47.249096 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:59:47.277598 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Updating instance_info_cache with network_info: [{"id": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "address": "fa:16:3e:ca:8c:e2", "network": {"id": "d4bf7f94-4ac7-4145-be11-d2aeeafb6c02", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-972487534-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "04ce4063a6ac4afdb5ee359a5c1105d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e39a69e-35", "ovs_interfaceid": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:59:47.755488 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.628s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:47.756038 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:59:47.781721 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Releasing lock "refresh_cache-d4fad20b-d51e-47c9-8f55-3aa085a10891" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:59:47.861741 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ca79ea99-4ed9-4089-b042-2a9aac704ea0 req-e3344ee5-c4cc-4d29-adff-a2b820f86e11 service nova] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Received event network-vif-unplugged-1bce33b1-57be-4de9-9e81-1a05535ae317 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:59:47.861855 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ca79ea99-4ed9-4089-b042-2a9aac704ea0 req-e3344ee5-c4cc-4d29-adff-a2b820f86e11 service nova] Acquiring lock "8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:47.862041 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ca79ea99-4ed9-4089-b042-2a9aac704ea0 req-e3344ee5-c4cc-4d29-adff-a2b820f86e11 service nova] Lock "8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:47.862197 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ca79ea99-4ed9-4089-b042-2a9aac704ea0 req-e3344ee5-c4cc-4d29-adff-a2b820f86e11 service nova] Lock "8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:47.862329 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ca79ea99-4ed9-4089-b042-2a9aac704ea0 req-e3344ee5-c4cc-4d29-adff-a2b820f86e11 service nova] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] No waiting events found dispatching network-vif-unplugged-1bce33b1-57be-4de9-9e81-1a05535ae317 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:59:47.862439 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-ca79ea99-4ed9-4089-b042-2a9aac704ea0 req-e3344ee5-c4cc-4d29-adff-a2b820f86e11 service nova] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Received unexpected event network-vif-unplugged-1bce33b1-57be-4de9-9e81-1a05535ae317 for instance with vm_state active and task_state reboot_started_hard.
May 28 01:59:47.916221 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Found WWN 330000000317bc286 for multipath device dm-4 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:59:47.916464 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:59:47.916717 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] <== connect_volume: return (3971ms) {'type': 'block', 'scsi_wwn': '330000000317bc286', 'path': '/dev/dm-4', 'multipath_id': '330000000317bc286'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:59:47.916829 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000317bc286', 'path': '/dev/dm-4', 'multipath_id': '330000000317bc286'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:59:47.917293 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.426s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:59:47.917588 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', 'iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:59:47.917708 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:59:47.922864 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lazy-loading 'flavor' on Instance uuid 63688346-f8e2-4fbe-987d-bf55df9fa3a4 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:59:47.946588 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:47.946588 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:47.946588 np0000001583 nova-compute[98241]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:47.946588 np0000001583 nova-compute[98241]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:47.946588 np0000001583 nova-compute[98241]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:47.946588 np0000001583 nova-compute[98241]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:47.946588 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:47.946588 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:47.946588 np0000001583 nova-compute[98241]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:47.946588 np0000001583 nova-compute[98241]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:47.946588 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:59:47.946951 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:47.946951 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:47.946951 np0000001583 nova-compute[98241]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:47.946951 np0000001583 nova-compute[98241]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:47.946951 np0000001583 nova-compute[98241]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:47.946951 np0000001583 nova-compute[98241]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:47.946951 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:47.946951 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:47.946951 np0000001583 nova-compute[98241]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:47.946951 np0000001583 nova-compute[98241]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:47.946951 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:59:47.946951 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', '68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', '69'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', '72'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', '73'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57', '76'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57', '77'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376', '78'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376', '79'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21', '80'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21', '81')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:59:47.946951 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', '72')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:59:47.947910 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', '73')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:59:47.948724 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f829ec00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9'): ({'sdg'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:59:47.948906 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Removing multipathed devices sdf, sdg {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:59:47.949167 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Flush multipath device 330000000f1131f9e {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:59:47.994596 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:59:48.047829 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:59:48.095002 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:59:48.095305 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:59:48.096237 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:59:48.109257 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:59:48.109442 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:59:48.127029 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:48.163610 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 72, target: iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9, portal: 192.168.40.100,3260]
May 28 01:59:48.163610 np0000001583 nova-compute[98241]: Logout of [sid: 72, target: iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9, portal: 192.168.40.100,3260] successful.
May 28 01:59:48.163610 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:48.182735 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:48.186899 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:48.195626 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:48.234310 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 73, target: iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9, portal: 192.168.50.100,3260]
May 28 01:59:48.234310 np0000001583 nova-compute[98241]: Logout of [sid: 73, target: iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9, portal: 192.168.50.100,3260] successful.
May 28 01:59:48.234310 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:48.251866 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:48.251866 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:59:48.251866 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] <== disconnect_volume: return (1760ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:59:48.251866 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:59:48.258008 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Start _get_guest_xml network_info=[{"id": "1bce33b1-57be-4de9-9e81-1a05535ae317", "address": "fa:16:3e:ae:cc:0f", "network": {"id": "c18d43cf-482c-4814-96a1-09aab2287be4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2071326233-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d5cfe906dd24a10819b92c144f7f06f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bce33b1-57", "ovs_interfaceid": "1bce33b1-57be-4de9-9e81-1a05535ae317", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2cc2ffd4-9757-447d-a451-53527f5bcc1f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '2cc2ffd4-9757-447d-a451-53527f5bcc1f'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', 'iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, 'status': 'reserved', 'instance': '8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d', 'attached_at': '', 'detached_at': '', 'volume_id': 'fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', 'serial': 'fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9'}, 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'attachment_id': 'f3dc0162-8926-43c9-9c9d-61d0463fc1b8', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:59:48.261355 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:59:48.261716 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:59:48.261955 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:59:48.262172 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:59:48.265185 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:59:48.266256 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='2cc2ffd4-9757-447d-a451-53527f5bcc1f', instance_meta=NovaInstanceMeta(name='tempest-TestMinimumBasicScenario-server-1116550051', uuid='8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d'), owner=OwnerMeta(userid='f52a7ae7fbc644deb82f3382de3a4edd', username='tempest-TestMinimumBasicScenario-1092247749-project-member', projectid='1d5cfe906dd24a10819b92c144f7f06f', projectname='tempest-TestMinimumBasicScenario-1092247749'), image=ImageMeta(id='2cc2ffd4-9757-447d-a451-53527f5bcc1f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1bce33b1-57be-4de9-9e81-1a05535ae317", "address": "fa:16:3e:ae:cc:0f", "network": {"id": "c18d43cf-482c-4814-96a1-09aab2287be4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2071326233-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d5cfe906dd24a10819b92c144f7f06f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bce33b1-57", "ovs_interfaceid": "1bce33b1-57be-4de9-9e81-1a05535ae317", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933588.2659252) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:59:48.267511 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:59:48.270019 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:59:48.271029 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:59:48.271242 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:59:48.272178 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:59:48.272434 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2cc2ffd4-9757-447d-a451-53527f5bcc1f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:59:48.272549 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:59:48.272658 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:59:48.272754 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:59:48.272831 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:59:48.272932 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:59:48.273090 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:59:48.273186 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:59:48.273283 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:59:48.273378 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:59:48.273481 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:59:48.273837 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:59:48.342715 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cadb612e41314b06914d5f5f47570e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0474090f4f2d4950b51bc317f4302266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:59:48.428016 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Attempting to attach volume eb978e57-12a6-44b0-8770-f1a5a2411c21 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98241) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 01:59:48.431595 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] attach device xml: <disk type="block" device="disk">
May 28 01:59:48.431595 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:59:48.431595 np0000001583 nova-compute[98241]:   <alias name="ua-eb978e57-12a6-44b0-8770-f1a5a2411c21"/>
May 28 01:59:48.431595 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-4"/>
May 28 01:59:48.431595 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 01:59:48.431595 np0000001583 nova-compute[98241]:   <serial>eb978e57-12a6-44b0-8770-f1a5a2411c21</serial>
May 28 01:59:48.431595 np0000001583 nova-compute[98241]: </disk>
May 28 01:59:48.431595 np0000001583 nova-compute[98241]:  {{(pid=98241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 01:59:48.629115 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f94155e1-b02b-430a-9625-22cc4849fe69 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "27c37404-4df0-4ded-bf5b-6002e26d4222" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.525s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:48.766122 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:59:48.783589 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Object Instance<8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d> lazy-loaded attributes: resources,vcpu_model {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:59:48.798759 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d/disk.config --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:48.828458 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Instance destroyed successfully.
May 28 01:59:48.829731 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lazy-loading 'numa_topology' on Instance uuid d4fad20b-d51e-47c9-8f55-3aa085a10891 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:59:48.887902 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d/disk.config --force-share --output=json" returned: 0 in 0.090s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:59:48.888719 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Acquiring lock "/opt/stack/data/nova/instances/8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:48.888998 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "/opt/stack/data/nova/instances/8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:48.889575 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "/opt/stack/data/nova/instances/8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:48.889994 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:59:48.890417 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', 'iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:59:48.890578 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:59:48.890993 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:59:48.891304 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', 'iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:59:48.908407 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:59:48.908999 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:59:48.909653 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:59:48.909864 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:59:48.910350 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:59:48.910436 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:59:48.925411 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Successfully created port: 77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:59:48.928886 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:59:48.928886 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:48.934066 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:59:48.934066 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:48.944026 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9] added
May 28 01:59:48.944026 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:59:48.944026 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:59:48.944026 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:59:48.944026 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:59:48.944026 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:59:48.944026 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:48.944375 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:59:48.944375 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0345(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:59:48.944503 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:59:48.946344 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9] added
May 28 01:59:48.946344 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:59:48.946344 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:59:48.946344 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:59:48.946344 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:59:48.946344 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:59:48.946344 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:48.946574 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:59:48.946785 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0363(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:59:48.946976 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:59:49.078180 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Rescuing
May 28 01:59:49.080380 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquiring lock "refresh_cache-27c37404-4df0-4ded-bf5b-6002e26d4222" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:59:49.080532 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquired lock "refresh_cache-27c37404-4df0-4ded-bf5b-6002e26d4222" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:59:49.080692 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:59:49.269571 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:59:49.335466 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Object Instance<d4fad20b-d51e-47c9-8f55-3aa085a10891> lazy-loaded attributes: flavor,info_cache,numa_topology {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:59:49.335466 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lazy-loading 'resources' on Instance uuid d4fad20b-d51e-47c9-8f55-3aa085a10891 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:59:49.462700 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Successfully updated port: 77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:59:49.515068 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-8df14424-b14b-4ecf-98c9-422650e87c36 req-32a33728-53d6-4baf-a4e1-185b4e850996 service nova] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Received event network-changed-77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:59:49.515242 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-8df14424-b14b-4ecf-98c9-422650e87c36 req-32a33728-53d6-4baf-a4e1-185b4e850996 service nova] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Refreshing instance network info cache due to event network-changed-77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:59:49.515421 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-8df14424-b14b-4ecf-98c9-422650e87c36 req-32a33728-53d6-4baf-a4e1-185b4e850996 service nova] Acquiring lock "refresh_cache-8b2a5f31-1b3d-447f-939e-94fd0be5eb85" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:59:49.515549 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-8df14424-b14b-4ecf-98c9-422650e87c36 req-32a33728-53d6-4baf-a4e1-185b4e850996 service nova] Acquired lock "refresh_cache-8b2a5f31-1b3d-447f-939e-94fd0be5eb85" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:59:49.515951 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-8df14424-b14b-4ecf-98c9-422650e87c36 req-32a33728-53d6-4baf-a4e1-185b4e850996 service nova] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Refreshing network info cache for port 77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:59:49.585009 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:59:49.837038 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Object Instance<d4fad20b-d51e-47c9-8f55-3aa085a10891> lazy-loaded attributes: flavor,info_cache,numa_topology,resources {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:59:49.837755 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:58:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-522410549',display_name='tempest-AttachVolumeTestJSON-server-522410549',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-attachvolumetestjson-server-522410549',id=34,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/SX3aLhOteyGwrFqR0CEL4C04Fp6fWjwsBRpIz44V+NdHV7WRnAaFAuCSewkCiCwsHBAYVT3CCSkcBu9Z5deiFWGGYvkB/zQRpMDdHuyRrvPU5bkBQzk+aQ10B/g2ZJA==',key_name='tempest-keypair-487865295',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:58:49Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='04ce4063a6ac4afdb5ee359a5c1105d3',ramdisk_id='',reservation_id='r-q0lo3p0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1276932129',owner_user_name='tempest-AttachVolumeTestJSON-1276932129-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:59:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='164f3d08de954440bd716afe5eb1054a',uuid=d4fad20b-d51e-47c9-8f55-3aa085a10891,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "address": "fa:16:3e:ca:8c:e2", "network": {"id": "d4bf7f94-4ac7-4145-be11-d2aeeafb6c02", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-972487534-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "04ce4063a6ac4afdb5ee359a5c1105d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e39a69e-35", "ovs_interfaceid": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:59:49.837971 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Converting VIF {"id": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "address": "fa:16:3e:ca:8c:e2", "network": {"id": "d4bf7f94-4ac7-4145-be11-d2aeeafb6c02", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-972487534-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "04ce4063a6ac4afdb5ee359a5c1105d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e39a69e-35", "ovs_interfaceid": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:59:49.838616 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:8c:e2,bridge_name='br-int',has_traffic_filtering=True,id=0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b,network=Network(d4bf7f94-4ac7-4145-be11-d2aeeafb6c02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e39a69e-35') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:59:49.839133 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:8c:e2,bridge_name='br-int',has_traffic_filtering=True,id=0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b,network=Network(d4bf7f94-4ac7-4145-be11-d2aeeafb6c02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e39a69e-35') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:59:49.840802 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:49.841140 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0e39a69e-35, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:59:49.842266 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:49.843025 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:59:49.843998 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:49.844794 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:49.844943 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c9846ad9-5206-4ca5-aa8c-b8f05cb7cf31) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:59:49.846215 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:49.846215 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:59:49.846797 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:49.849308 np0000001583 nova-compute[98241]: INFO os_vif [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:8c:e2,bridge_name='br-int',has_traffic_filtering=True,id=0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b,network=Network(d4bf7f94-4ac7-4145-be11-d2aeeafb6c02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e39a69e-35')
May 28 01:59:49.853326 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:59:49.853699 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57', 'iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8ea99ade-a69e-46e2-9c9d-6251e4f69a57', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:59:49.853880 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:59:49.886766 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:59:49.945002 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:59:49.947407 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:59:49.962976 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:59:49.962976 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:49.968303 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "refresh_cache-8b2a5f31-1b3d-447f-939e-94fd0be5eb85" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:59:49.974961 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:59:49.974961 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:49.980806 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:49.988110 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:49.996888 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:49.996888 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:49.996888 np0000001583 nova-compute[98241]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:49.996888 np0000001583 nova-compute[98241]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:49.996888 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:49.996888 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:49.996888 np0000001583 nova-compute[98241]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:49.996888 np0000001583 nova-compute[98241]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:49.996888 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:59:49.997132 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:49.997132 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:49.997132 np0000001583 nova-compute[98241]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:49.997132 np0000001583 nova-compute[98241]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:49.997132 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:49.997132 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:49.997132 np0000001583 nova-compute[98241]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:49.997132 np0000001583 nova-compute[98241]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:49.997132 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:59:50.010064 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:50.010064 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:50.010064 np0000001583 nova-compute[98241]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:50.010064 np0000001583 nova-compute[98241]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:50.010064 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:50.010064 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:50.010064 np0000001583 nova-compute[98241]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:50.010064 np0000001583 nova-compute[98241]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:50.010064 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:59:50.010376 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:50.010376 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:50.010376 np0000001583 nova-compute[98241]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:50.010376 np0000001583 nova-compute[98241]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:50.010376 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:50.010376 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:50.010376 np0000001583 nova-compute[98241]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:50.010376 np0000001583 nova-compute[98241]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:50.010376 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:59:50.018169 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-8df14424-b14b-4ecf-98c9-422650e87c36 req-32a33728-53d6-4baf-a4e1-185b4e850996 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:59:50.052673 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9, portal: 192.168.50.100,3260]
May 28 01:59:50.052673 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9, portal: 192.168.50.100,3260] successful.
May 28 01:59:50.052673 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:50.063462 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Updating instance_info_cache with network_info: [{"id": "967dfb76-814b-43ba-ba2b-c14f407ff45e", "address": "fa:16:3e:e8:00:1f", "network": {"id": "e1d5d073-f27b-4ff1-9ed3-99f57407c76f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f65617e71571457f8906997583100678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap967dfb76-81", "ovs_interfaceid": "967dfb76-814b-43ba-ba2b-c14f407ff45e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:59:50.064829 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:50.074426 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9, portal: 192.168.40.100,3260]
May 28 01:59:50.074426 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9, portal: 192.168.40.100,3260] successful.
May 28 01:59:50.074426 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:50.083736 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:50.083736 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:50.083736 np0000001583 nova-compute[98241]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:50.083736 np0000001583 nova-compute[98241]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:50.083736 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:50.083736 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:50.083736 np0000001583 nova-compute[98241]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:50.083736 np0000001583 nova-compute[98241]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:50.083736 np0000001583 nova-compute[98241]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:50.083736 np0000001583 nova-compute[98241]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:50.083736 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:59:50.084101 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:50.084101 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:50.084101 np0000001583 nova-compute[98241]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:50.084101 np0000001583 nova-compute[98241]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:50.084101 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:50.084101 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:50.084101 np0000001583 nova-compute[98241]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:50.084101 np0000001583 nova-compute[98241]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:50.084101 np0000001583 nova-compute[98241]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:50.084101 np0000001583 nova-compute[98241]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:50.084101 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:59:50.084281 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.175s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:59:50.084473 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:59:50.086411 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] HCTL ('11', '-', '-', 0) found on session 82 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:59:50.086616 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:59:50.092331 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-8df14424-b14b-4ecf-98c9-422650e87c36 req-32a33728-53d6-4baf-a4e1-185b4e850996 service nova] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:59:50.096360 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:59:50.096360 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:59:50.096360 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:59:50.096360 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] No VIF found with MAC fa:16:3e:24:bb:c4, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:59:50.097257 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:50.111100 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Searching for a device in session 82 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:59:50.111100 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:59:50.118526 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:50.118526 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:50.118526 np0000001583 nova-compute[98241]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:50.118526 np0000001583 nova-compute[98241]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:50.118526 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:50.118526 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:50.118526 np0000001583 nova-compute[98241]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:50.118526 np0000001583 nova-compute[98241]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:50.118526 np0000001583 nova-compute[98241]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:50.118526 np0000001583 nova-compute[98241]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:50.118526 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:59:50.118799 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:50.118799 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:50.118799 np0000001583 nova-compute[98241]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:50.118799 np0000001583 nova-compute[98241]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:50.118799 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:50.118799 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:50.118799 np0000001583 nova-compute[98241]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:50.118799 np0000001583 nova-compute[98241]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:50.118799 np0000001583 nova-compute[98241]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:50.118799 np0000001583 nova-compute[98241]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:50.118799 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:59:50.119090 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.209s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:59:50.119262 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:59:50.120779 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] HCTL ('12', '-', '-', 0) found on session 83 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:59:50.120920 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:59:50.138308 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Searching for a device in session 83 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:59:50.142473 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:59:50.275348 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-8df14424-b14b-4ecf-98c9-422650e87c36 req-32a33728-53d6-4baf-a4e1-185b4e850996 service nova] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:59:50.279044 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:59:50.280248 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:59:50.280621 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Creating image(s)
May 28 01:59:50.281858 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "/opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:50.281858 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "/opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:50.282791 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "/opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:50.282791 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:59:50.291527 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:59:50.293963 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:50.392062 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.097s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:59:50.392276 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:50.392896 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:50.393508 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:59:50.398253 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:59:50.398747 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:50.452250 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:50.452635 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:50.507618 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.109s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:59:50.507979 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:50.567482 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/disk 1073741824" returned: 0 in 0.059s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:59:50.567906 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.175s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:50.568754 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Releasing lock "refresh_cache-27c37404-4df0-4ded-bf5b-6002e26d4222" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:59:50.571232 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:50.654715 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.083s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:59:50.656276 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:59:50.656849 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:50.756257 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:59:50.756607 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Cannot resize image /opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:59:50.756941 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:59:50.757128 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Ensure instance console log exists: /opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:59:50.757420 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:50.757553 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:50.757665 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:50.778036 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-8df14424-b14b-4ecf-98c9-422650e87c36 req-32a33728-53d6-4baf-a4e1-185b4e850996 service nova] Releasing lock "refresh_cache-8b2a5f31-1b3d-447f-939e-94fd0be5eb85" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:59:50.778172 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquired lock "refresh_cache-8b2a5f31-1b3d-447f-939e-94fd0be5eb85" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:59:50.778332 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:59:50.910488 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:59:50.957527 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:59:51.350260 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:59:51.532761 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:51.533030 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:51.536092 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:59:51.541756 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:59:51.541996 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Claim successful on node np0000001583
May 28 01:59:51.663608 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-84faf1f5-ca39-4f97-8daf-3f0da21a1bd1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "63688346-f8e2-4fbe-987d-bf55df9fa3a4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.435s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:51.682571 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Updating instance_info_cache with network_info: [{"id": "77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0", "address": "fa:16:3e:76:c5:3f", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77a0d5b8-3f", "ovs_interfaceid": "77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:59:51.925434 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Found WWN 330000000f1131f9e for multipath device dm-5 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:59:51.925849 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:59:51.926009 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '330000000f1131f9e', 'path': '/dev/dm-5', 'multipath_id': '330000000f1131f9e'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:59:51.927371 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f1131f9e', 'path': '/dev/dm-5', 'multipath_id': '330000000f1131f9e'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:59:51.927371 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.073s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:59:51.927371 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57', 'iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8ea99ade-a69e-46e2-9c9d-6251e4f69a57', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:59:51.927371 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:59:51.955448 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:51.955448 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:51.955448 np0000001583 nova-compute[98241]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:51.955448 np0000001583 nova-compute[98241]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:51.955448 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:51.955448 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:51.955448 np0000001583 nova-compute[98241]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:51.955448 np0000001583 nova-compute[98241]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:51.955448 np0000001583 nova-compute[98241]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:51.955448 np0000001583 nova-compute[98241]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:51.955448 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:59:51.955448 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:51.955448 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:51.955448 np0000001583 nova-compute[98241]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:51.955448 np0000001583 nova-compute[98241]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:51.955448 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:51.955448 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:51.955448 np0000001583 nova-compute[98241]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:51.955448 np0000001583 nova-compute[98241]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:51.955448 np0000001583 nova-compute[98241]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:51.955448 np0000001583 nova-compute[98241]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:51.955448 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:59:51.955448 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', '68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', '69'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57', '76'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57', '77'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376', '78'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376', '79'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21', '80'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21', '81'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', '82'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', '83')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:59:51.955448 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57', '77')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:59:51.956975 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57', '76')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:59:51.957995 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f817c680>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57'): ({'sdj'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:59:51.958689 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Removing multipathed devices sdk, sdj {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:59:51.958689 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Flush multipath device 330000000279bfb87 {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:59:51.990620 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:59:52.039163 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:59:52.085870 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Checking to see if SCSI volumes sdk, sdj have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:59:52.086913 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] SCSI volumes sdk, sdj have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:59:52.088019 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Checking to see if device paths {'sdk', 'sdj'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:59:52.101273 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Device paths {'sdk', 'sdj'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:59:52.102257 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:59:52.113127 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:52.160234 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 77, target: iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57, portal: 192.168.40.100,3260]
May 28 01:59:52.160234 np0000001583 nova-compute[98241]: Logout of [sid: 77, target: iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57, portal: 192.168.40.100,3260] successful.
May 28 01:59:52.160234 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:52.177744 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:52.186663 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Releasing lock "refresh_cache-8b2a5f31-1b3d-447f-939e-94fd0be5eb85" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:59:52.186963 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Instance network_info: |[{"id": "77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0", "address": "fa:16:3e:76:c5:3f", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77a0d5b8-3f", "ovs_interfaceid": "77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:59:52.188413 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Start _get_guest_xml network_info=[{"id": "77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0", "address": "fa:16:3e:76:c5:3f", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77a0d5b8-3f", "ovs_interfaceid": "77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:59:52.191339 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:52.192275 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:59:52.193368 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='8b2a5f31-1b3d-447f-939e-94fd0be5eb85'), owner=OwnerMeta(userid='cadb612e41314b06914d5f5f47570e98', username='tempest-AttachVolumeMultiAttachTest-857456921-project-member', projectid='0474090f4f2d4950b51bc317f4302266', projectname='tempest-AttachVolumeMultiAttachTest-857456921'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0", "address": "fa:16:3e:76:c5:3f", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77a0d5b8-3f", "ovs_interfaceid": "77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933592.1930306) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:59:52.194458 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:59:52.194776 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:59:52.196389 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:59:52.196389 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:59:52.197061 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:59:52.197478 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:59:52.197662 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:59:52.197804 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:59:52.197977 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:59:52.198094 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:59:52.198288 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:59:52.198426 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:59:52.198546 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:59:52.198678 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:59:52.198817 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:59:52.198951 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:59:52.211769 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:52.219015 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:59:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='multiattach-server-0',id=40,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAP7CI9wuY8JR5OGc0CpqFzQg3rj7cqVgHC4sPYHH38XlmtTRa9WHg3S3WcIsSpd43tWEYYLHF1/yDpoSsozR5Hrjk+cgmLbTDwUHC3YheiC8VnlV/ymBtBFe0b8oxSz5w==',key_name='tempest-keypair-1713929294',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0474090f4f2d4950b51bc317f4302266',ramdisk_id='',reservation_id='r-rozqlw8g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-857456921',owner_user_name='tempest-AttachVolumeMultiAttachTest-857456921-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:59:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cadb612e41314b06914d5f5f47570e98',uuid=8b2a5f31-1b3d-447f-939e-94fd0be5eb85,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0", "address": "fa:16:3e:76:c5:3f", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77a0d5b8-3f", "ovs_interfaceid": "77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:59:52.219015 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Converting VIF {"id": "77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0", "address": "fa:16:3e:76:c5:3f", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77a0d5b8-3f", "ovs_interfaceid": "77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:59:52.219285 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:c5:3f,bridge_name='br-int',has_traffic_filtering=True,id=77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77a0d5b8-3f') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:59:52.220415 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lazy-loading 'pci_devices' on Instance uuid 8b2a5f31-1b3d-447f-939e-94fd0be5eb85 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:59:52.243950 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:52.246762 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 76, target: iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57, portal: 192.168.50.100,3260]
May 28 01:59:52.246762 np0000001583 nova-compute[98241]: Logout of [sid: 76, target: iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57, portal: 192.168.50.100,3260] successful.
May 28 01:59:52.246762 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:52.265590 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:52.265590 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:59:52.265590 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] <== disconnect_volume: return (2411ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:59:52.265590 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:59:52.274244 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Start _get_guest_xml network_info=[{"id": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "address": "fa:16:3e:ca:8c:e2", "network": {"id": "d4bf7f94-4ac7-4145-be11-d2aeeafb6c02", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-972487534-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "04ce4063a6ac4afdb5ee359a5c1105d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e39a69e-35", "ovs_interfaceid": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57', 'iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8ea99ade-a69e-46e2-9c9d-6251e4f69a57', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, 'status': 'reserved', 'instance': 'd4fad20b-d51e-47c9-8f55-3aa085a10891', 'attached_at': '', 'detached_at': '', 'volume_id': '8ea99ade-a69e-46e2-9c9d-6251e4f69a57', 'serial': '8ea99ade-a69e-46e2-9c9d-6251e4f69a57'}, 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'attachment_id': 'a2a98c44-e0e7-44a3-ae75-798180d6f360', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:59:52.276958 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:59:52.278033 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-522410549', uuid='d4fad20b-d51e-47c9-8f55-3aa085a10891'), owner=OwnerMeta(userid='164f3d08de954440bd716afe5eb1054a', username='tempest-AttachVolumeTestJSON-1276932129-project-member', projectid='04ce4063a6ac4afdb5ee359a5c1105d3', projectname='tempest-AttachVolumeTestJSON-1276932129'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "address": "fa:16:3e:ca:8c:e2", "network": {"id": "d4bf7f94-4ac7-4145-be11-d2aeeafb6c02", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-972487534-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "04ce4063a6ac4afdb5ee359a5c1105d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e39a69e-35", "ovs_interfaceid": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933592.2777207) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:59:52.280745 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:59:52.280745 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:59:52.282939 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:59:52.283443 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:59:52.285288 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:59:52.285951 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:59:52.286254 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:59:52.286430 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:59:52.286666 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:59:52.286774 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:59:52.286886 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:59:52.287030 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:59:52.287145 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:59:52.287269 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:59:52.287371 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:59:52.287482 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:59:52.287654 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lazy-loading 'vcpu_model' on Instance uuid d4fad20b-d51e-47c9-8f55-3aa085a10891 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:59:52.391351 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-8ac09ff2-06a5-4aa7-9125-595044f785cf req-60266907-1f3a-4109-acd0-8645a97c2cc7 service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Received event network-vif-unplugged-967dfb76-814b-43ba-ba2b-c14f407ff45e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:59:52.392212 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-8ac09ff2-06a5-4aa7-9125-595044f785cf req-60266907-1f3a-4109-acd0-8645a97c2cc7 service nova] Acquiring lock "27c37404-4df0-4ded-bf5b-6002e26d4222-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:52.392418 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-8ac09ff2-06a5-4aa7-9125-595044f785cf req-60266907-1f3a-4109-acd0-8645a97c2cc7 service nova] Lock "27c37404-4df0-4ded-bf5b-6002e26d4222-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:52.392598 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-8ac09ff2-06a5-4aa7-9125-595044f785cf req-60266907-1f3a-4109-acd0-8645a97c2cc7 service nova] Lock "27c37404-4df0-4ded-bf5b-6002e26d4222-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:52.392746 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-8ac09ff2-06a5-4aa7-9125-595044f785cf req-60266907-1f3a-4109-acd0-8645a97c2cc7 service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] No waiting events found dispatching network-vif-unplugged-967dfb76-814b-43ba-ba2b-c14f407ff45e {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:59:52.392945 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-8ac09ff2-06a5-4aa7-9125-595044f785cf req-60266907-1f3a-4109-acd0-8645a97c2cc7 service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Received unexpected event network-vif-unplugged-967dfb76-814b-43ba-ba2b-c14f407ff45e for instance with vm_state active and task_state rescuing.
May 28 01:59:52.407765 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:52.413417 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:52.434422 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:58:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1116550051',display_name='tempest-TestMinimumBasicScenario-server-1116550051',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testminimumbasicscenario-server-1116550051',id=37,image_ref='2cc2ffd4-9757-447d-a451-53527f5bcc1f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMULG2kTEY+WhVbRzbS6xOD6CJCgxm22CYbbQxg0BTn9Kii/R8Mt6h4nIBTEe0X4SkZIt8ct5xyc3FmGuzZLRtxpNB61Zb7jVrz/BvdWxTdtIMJsifze5TU8LnUgQB0QDQ==',key_name='tempest-TestMinimumBasicScenario-2031915617',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:59:05Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d5cfe906dd24a10819b92c144f7f06f',ramdisk_id='',reservation_id='r-q03o3420',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2cc2ffd4-9757-447d-a451-53527f5bcc1f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1092247749',owner_user_name='tempest-TestMinimumBasicScenario-1092247749-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:59:45Z,user_data=None,user_id='f52a7ae7fbc644deb82f3382de3a4edd',uuid=8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1bce33b1-57be-4de9-9e81-1a05535ae317", "address": "fa:16:3e:ae:cc:0f", "network": {"id": "c18d43cf-482c-4814-96a1-09aab2287be4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2071326233-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d5cfe906dd24a10819b92c144f7f06f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bce33b1-57", "ovs_interfaceid": "1bce33b1-57be-4de9-9e81-1a05535ae317", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:59:52.434636 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Converting VIF {"id": "1bce33b1-57be-4de9-9e81-1a05535ae317", "address": "fa:16:3e:ae:cc:0f", "network": {"id": "c18d43cf-482c-4814-96a1-09aab2287be4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2071326233-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d5cfe906dd24a10819b92c144f7f06f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bce33b1-57", "ovs_interfaceid": "1bce33b1-57be-4de9-9e81-1a05535ae317", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:59:52.435360 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:cc:0f,bridge_name='br-int',has_traffic_filtering=True,id=1bce33b1-57be-4de9-9e81-1a05535ae317,network=Network(c18d43cf-482c-4814-96a1-09aab2287be4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bce33b1-57') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:59:52.436472 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lazy-loading 'pci_devices' on Instance uuid 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:59:52.558286 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999640325999735 future=<Future at 0x7724ec2d3350 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:59:52.561466 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Instance destroyed successfully.
May 28 01:59:52.563598 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lazy-loading 'numa_topology' on Instance uuid 27c37404-4df0-4ded-bf5b-6002e26d4222 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:59:52.725107 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] End _get_guest_xml xml=<domain type="qemu">
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:   <uuid>8b2a5f31-1b3d-447f-939e-94fd0be5eb85</uuid>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:   <name>instance-00000028</name>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:       <nova:name>multiattach-server-0</nova:name>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:59:52</nova:creationTime>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:         <nova:user uuid="cadb612e41314b06914d5f5f47570e98">tempest-AttachVolumeMultiAttachTest-857456921-project-member</nova:user>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:         <nova:project uuid="0474090f4f2d4950b51bc317f4302266">tempest-AttachVolumeMultiAttachTest-857456921</nova:project>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:         <nova:port uuid="77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0">
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:     <system>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:       <entry name="serial">8b2a5f31-1b3d-447f-939e-94fd0be5eb85</entry>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:       <entry name="uuid">8b2a5f31-1b3d-447f-939e-94fd0be5eb85</entry>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:     </system>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:   <os>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:   </os>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:   <features>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:   </features>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:   <devices>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/disk"/>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:     </disk>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/disk.config"/>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:     </disk>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:76:c5:3f"/>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:       <target dev="tap77a0d5b8-3f"/>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:     </interface>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/console.log" append="off"/>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:     </serial>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:     <video>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:     </video>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:     </rng>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:   </devices>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]: </domain>
May 28 01:59:52.725107 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:59:52.726953 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Preparing to wait for external event network-vif-plugged-77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:59:52.726953 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "8b2a5f31-1b3d-447f-939e-94fd0be5eb85-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:52.726953 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "8b2a5f31-1b3d-447f-939e-94fd0be5eb85-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:52.726953 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "8b2a5f31-1b3d-447f-939e-94fd0be5eb85-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:52.726953 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:59:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='multiattach-server-0',id=40,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAP7CI9wuY8JR5OGc0CpqFzQg3rj7cqVgHC4sPYHH38XlmtTRa9WHg3S3WcIsSpd43tWEYYLHF1/yDpoSsozR5Hrjk+cgmLbTDwUHC3YheiC8VnlV/ymBtBFe0b8oxSz5w==',key_name='tempest-keypair-1713929294',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0474090f4f2d4950b51bc317f4302266',ramdisk_id='',reservation_id='r-rozqlw8g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-857456921',owner_user_name='tempest-AttachVolumeMultiAttachTest-857456921-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:59:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cadb612e41314b06914d5f5f47570e98',uuid=8b2a5f31-1b3d-447f-939e-94fd0be5eb85,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0", "address": "fa:16:3e:76:c5:3f", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77a0d5b8-3f", "ovs_interfaceid": "77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:59:52.727226 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Converting VIF {"id": "77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0", "address": "fa:16:3e:76:c5:3f", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77a0d5b8-3f", "ovs_interfaceid": "77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:59:52.727677 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:c5:3f,bridge_name='br-int',has_traffic_filtering=True,id=77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77a0d5b8-3f') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:59:52.728011 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:c5:3f,bridge_name='br-int',has_traffic_filtering=True,id=77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77a0d5b8-3f') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:59:52.730236 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:52.730490 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:59:52.730737 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:59:52.731835 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:52.731994 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7918c768-a20b-5e62-8050-bb7660c1e9f7', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:59:52.732715 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:52.733291 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:59:52.738695 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:52.741162 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:52.741330 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap77a0d5b8-3f, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:59:52.741669 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap77a0d5b8-3f, col_values=(('qos', UUID('3330fec2-002e-4daf-b366-07f35ab7b20d')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:59:52.741825 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap77a0d5b8-3f, col_values=(('external_ids', {'iface-id': '77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:c5:3f', 'vm-uuid': '8b2a5f31-1b3d-447f-939e-94fd0be5eb85'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:59:52.742614 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:52.743641 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:59:52.754658 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:52.755367 np0000001583 nova-compute[98241]: INFO os_vif [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:c5:3f,bridge_name='br-int',has_traffic_filtering=True,id=77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77a0d5b8-3f')
May 28 01:59:52.789512 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:59:52.789743 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:59:52.791089 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Object Instance<d4fad20b-d51e-47c9-8f55-3aa085a10891> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:59:52.800338 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/disk.config --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:52.897320 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/disk.config --force-share --output=json" returned: 0 in 0.097s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:59:52.897739 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Acquiring lock "/opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:52.898036 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "/opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:52.898740 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "/opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:52.899161 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:59:52.899545 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57', 'iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8ea99ade-a69e-46e2-9c9d-6251e4f69a57', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:59:52.899680 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:59:52.938594 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Object Instance<8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:59:52.940076 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] End _get_guest_xml xml=<domain type="qemu">
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:   <uuid>8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d</uuid>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:   <name>instance-00000025</name>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:       <nova:name>tempest-TestMinimumBasicScenario-server-1116550051</nova:name>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:59:48</nova:creationTime>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:       <nova:image uuid="2cc2ffd4-9757-447d-a451-53527f5bcc1f">
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:         <nova:user uuid="f52a7ae7fbc644deb82f3382de3a4edd">tempest-TestMinimumBasicScenario-1092247749-project-member</nova:user>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:         <nova:project uuid="1d5cfe906dd24a10819b92c144f7f06f">tempest-TestMinimumBasicScenario-1092247749</nova:project>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="2cc2ffd4-9757-447d-a451-53527f5bcc1f"/>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:         <nova:port uuid="1bce33b1-57be-4de9-9e81-1a05535ae317">
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:     <system>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:       <entry name="serial">8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d</entry>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:       <entry name="uuid">8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d</entry>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:     </system>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:   <os>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:   </os>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:   <features>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:   </features>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:   <devices>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d/disk"/>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:     </disk>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d/disk.config"/>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:     </disk>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:     <disk type="block" device="disk">
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:       <alias name="ua-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9"/>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:       <source dev="/dev/dm-5"/>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:       <target dev="vdb" bus="virtio"/>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:       <serial>fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9</serial>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:     </disk>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:ae:cc:0f"/>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:       <target dev="tap1bce33b1-57"/>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:     </interface>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d/console.log" append="off"/>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:     </serial>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:     <video>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:     </video>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:     </rng>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:   </devices>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]: </domain>
May 28 01:59:52.940076 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:59:52.942647 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:53.032757 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:59:53.033278 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:53.081613 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Attempting rescue
May 28 01:59:53.082456 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98241) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 28 01:59:53.091520 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Instance directory exists: not creating {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 01:59:53.091677 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Creating image(s)
May 28 01:59:53.092419 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquiring lock "/opt/stack/data/nova/instances/27c37404-4df0-4ded-bf5b-6002e26d4222/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:53.092649 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "/opt/stack/data/nova/instances/27c37404-4df0-4ded-bf5b-6002e26d4222/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:53.093243 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "/opt/stack/data/nova/instances/27c37404-4df0-4ded-bf5b-6002e26d4222/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:53.093448 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lazy-loading 'trusted_certs' on Instance uuid 27c37404-4df0-4ded-bf5b-6002e26d4222 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:59:53.151997 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:59:53.152394 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] skipping disk /dev/dm-5 (vdb) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:59:53.152853 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:59:53.188006 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:53.298942 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:59:53.596796 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Object Instance<27c37404-4df0-4ded-bf5b-6002e26d4222> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:59:53.598240 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:59:53.609506 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:59:53.612301 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:53.612708 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:53.613068 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:59:53.619775 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:59:53.620160 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:53.657390 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Object Instance<8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:59:53.660444 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a33b178235b2834843c883f14aa71de50d42329d --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:53.727806 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.106s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:59:53.727806 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/27c37404-4df0-4ded-bf5b-6002e26d4222/disk.rescue {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:53.766959 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a33b178235b2834843c883f14aa71de50d42329d --force-share --output=json" returned: 0 in 0.107s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:59:53.767651 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:59:53.772495 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:53.801317 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/27c37404-4df0-4ded-bf5b-6002e26d4222/disk.rescue" returned: 0 in 0.073s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:59:53.802460 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:53.802910 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lazy-loading 'migration_context' on Instance uuid 27c37404-4df0-4ded-bf5b-6002e26d4222 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:59:53.808009 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.275s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:53.809885 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:59:53.889857 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:59:53.890304 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Cannot resize image /opt/stack/data/nova/instances/8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:59:53.890528 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lazy-loading 'migration_context' on Instance uuid 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:59:54.295954 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:59:54.296317 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:59:54.296353 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] No VIF found with MAC fa:16:3e:76:c5:3f, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:59:54.297027 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Using config drive
May 28 01:59:54.322504 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Object Instance<27c37404-4df0-4ded-bf5b-6002e26d4222> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:59:54.325337 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:59:54.325721 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:59:54.326453 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Start _get_guest_xml network_info=[{"id": "967dfb76-814b-43ba-ba2b-c14f407ff45e", "address": "fa:16:3e:e8:00:1f", "network": {"id": "e1d5d073-f27b-4ff1-9ed3-99f57407c76f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.192", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "vif_mac": "fa:16:3e:e8:00:1f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f65617e71571457f8906997583100678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap967dfb76-81", "ovs_interfaceid": "967dfb76-814b-43ba-ba2b-c14f407ff45e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:59:54.328862 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lazy-loading 'resources' on Instance uuid 27c37404-4df0-4ded-bf5b-6002e26d4222 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:59:54.329882 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:59:54.330491 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:59:54.330948 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:59:54.392743 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Object Instance<8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:59:54.394195 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:58:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1116550051',display_name='tempest-TestMinimumBasicScenario-server-1116550051',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testminimumbasicscenario-server-1116550051',id=37,image_ref='2cc2ffd4-9757-447d-a451-53527f5bcc1f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMULG2kTEY+WhVbRzbS6xOD6CJCgxm22CYbbQxg0BTn9Kii/R8Mt6h4nIBTEe0X4SkZIt8ct5xyc3FmGuzZLRtxpNB61Zb7jVrz/BvdWxTdtIMJsifze5TU8LnUgQB0QDQ==',key_name='tempest-TestMinimumBasicScenario-2031915617',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:59:05Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='1d5cfe906dd24a10819b92c144f7f06f',ramdisk_id='',reservation_id='r-q03o3420',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2cc2ffd4-9757-447d-a451-53527f5bcc1f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1092247749',owner_user_name='tempest-TestMinimumBasicScenario-1092247749-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:59:45Z,user_data=None,user_id='f52a7ae7fbc644deb82f3382de3a4edd',uuid=8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1bce33b1-57be-4de9-9e81-1a05535ae317", "address": "fa:16:3e:ae:cc:0f", "network": {"id": "c18d43cf-482c-4814-96a1-09aab2287be4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2071326233-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d5cfe906dd24a10819b92c144f7f06f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bce33b1-57", "ovs_interfaceid": "1bce33b1-57be-4de9-9e81-1a05535ae317", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:59:54.394541 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Converting VIF {"id": "1bce33b1-57be-4de9-9e81-1a05535ae317", "address": "fa:16:3e:ae:cc:0f", "network": {"id": "c18d43cf-482c-4814-96a1-09aab2287be4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2071326233-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d5cfe906dd24a10819b92c144f7f06f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bce33b1-57", "ovs_interfaceid": "1bce33b1-57be-4de9-9e81-1a05535ae317", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:59:54.395584 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:cc:0f,bridge_name='br-int',has_traffic_filtering=True,id=1bce33b1-57be-4de9-9e81-1a05535ae317,network=Network(c18d43cf-482c-4814-96a1-09aab2287be4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bce33b1-57') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:59:54.396070 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:cc:0f,bridge_name='br-int',has_traffic_filtering=True,id=1bce33b1-57be-4de9-9e81-1a05535ae317,network=Network(c18d43cf-482c-4814-96a1-09aab2287be4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bce33b1-57') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:59:54.399551 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:54.399944 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:59:54.400279 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:59:54.401866 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:54.402280 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd1481867-2406-5c03-8d12-08621c5f18a9', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:59:54.403897 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:54.404237 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:59:54.418959 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6be314b4eed642c3b2c72fe115860220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432aa1094ced436494def17a875aa8e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:59:54.420403 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:54.426300 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:54.426531 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1bce33b1-57, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:59:54.426974 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1bce33b1-57, col_values=(('qos', UUID('2299d027-5c5f-42f2-bfe4-fb2bbb1dad38')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:59:54.427194 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1bce33b1-57, col_values=(('external_ids', {'iface-id': '1bce33b1-57be-4de9-9e81-1a05535ae317', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:cc:0f', 'vm-uuid': '8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:59:54.430012 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:59:54.444682 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:54.445712 np0000001583 nova-compute[98241]: INFO os_vif [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:cc:0f,bridge_name='br-int',has_traffic_filtering=True,id=1bce33b1-57be-4de9-9e81-1a05535ae317,network=Network(c18d43cf-482c-4814-96a1-09aab2287be4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bce33b1-57')
May 28 01:59:54.460616 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.561s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:59:54.460893 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57', 'iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8ea99ade-a69e-46e2-9c9d-6251e4f69a57', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:59:54.479130 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:59:54.479988 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:59:54.480810 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:59:54.482377 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:59:54.482543 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:59:54.482785 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:59:54.485537 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-dbcff074-2734-495c-9d8e-c361540ec6a1 req-df790174-1629-4399-93e5-ec0383522aeb service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Received event network-vif-unplugged-967dfb76-814b-43ba-ba2b-c14f407ff45e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:59:54.485798 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-dbcff074-2734-495c-9d8e-c361540ec6a1 req-df790174-1629-4399-93e5-ec0383522aeb service nova] Acquiring lock "27c37404-4df0-4ded-bf5b-6002e26d4222-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:54.485973 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-dbcff074-2734-495c-9d8e-c361540ec6a1 req-df790174-1629-4399-93e5-ec0383522aeb service nova] Lock "27c37404-4df0-4ded-bf5b-6002e26d4222-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:54.486610 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-dbcff074-2734-495c-9d8e-c361540ec6a1 req-df790174-1629-4399-93e5-ec0383522aeb service nova] Lock "27c37404-4df0-4ded-bf5b-6002e26d4222-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:54.486610 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-dbcff074-2734-495c-9d8e-c361540ec6a1 req-df790174-1629-4399-93e5-ec0383522aeb service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] No waiting events found dispatching network-vif-unplugged-967dfb76-814b-43ba-ba2b-c14f407ff45e {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:59:54.486861 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-dbcff074-2734-495c-9d8e-c361540ec6a1 req-df790174-1629-4399-93e5-ec0383522aeb service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Received unexpected event network-vif-unplugged-967dfb76-814b-43ba-ba2b-c14f407ff45e for instance with vm_state active and task_state rescuing.
May 28 01:59:54.496507 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:59:54.496507 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:54.502120 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:59:54.502120 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:54.512560 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57] added
May 28 01:59:54.512560 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:59:54.512560 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:59:54.512560 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:59:54.512560 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:59:54.512560 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:59:54.512560 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:54.512852 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:59:54.513024 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0312(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:59:54.513253 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:59:54.517951 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57] added
May 28 01:59:54.517951 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:59:54.517951 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:59:54.517951 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:59:54.517951 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:59:54.517951 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:59:54.517951 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:54.518252 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:59:54.518357 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0356(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:59:54.518496 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:59:54.804649 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:59:54.828764 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:59:54.837122 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Object Instance<27c37404-4df0-4ded-bf5b-6002e26d4222> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:59:54.843478 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:59:54.848603 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1984510406', uuid='27c37404-4df0-4ded-bf5b-6002e26d4222'), owner=OwnerMeta(userid='435dfce8f05e4e01b380797bd07bd4dc', username='tempest-ServerRescueNegativeTestJSON-1821941242-project-member', projectid='f65617e71571457f8906997583100678', projectname='tempest-ServerRescueNegativeTestJSON-1821941242'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "967dfb76-814b-43ba-ba2b-c14f407ff45e", "address": "fa:16:3e:e8:00:1f", "network": {"id": "e1d5d073-f27b-4ff1-9ed3-99f57407c76f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.192", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "vif_mac": "fa:16:3e:e8:00:1f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f65617e71571457f8906997583100678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap967dfb76-81", "ovs_interfaceid": "967dfb76-814b-43ba-ba2b-c14f407ff45e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933594.8446646) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:59:54.856320 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:59:54.857048 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:59:54.865236 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:59:54.865523 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:59:54.866871 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:59:54.867323 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:59:54.867518 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:59:54.867669 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:59:54.867848 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:59:54.867976 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:59:54.869570 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:59:54.869805 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:59:54.869963 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:59:54.870128 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:59:54.870270 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:59:54.870433 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:59:54.870642 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lazy-loading 'vcpu_model' on Instance uuid 27c37404-4df0-4ded-bf5b-6002e26d4222 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:59:54.947045 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Successfully created port: 062afddc-3d10-4dc2-a9d7-6024ed27c97a {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:59:54.981874 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:55.027277 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:55.037836 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Creating config drive at /opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/disk.config
May 28 01:59:55.043622 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmppphtvzm6 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:55.132575 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmppphtvzm6" returned: 0 in 0.088s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:59:55.142599 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:55.339402 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:59:55.376588 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Object Instance<27c37404-4df0-4ded-bf5b-6002e26d4222> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:59:55.401059 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:58:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1984510406',display_name='tempest-ServerRescueNegativeTestJSON-server-1984510406',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-serverrescuenegativetestjson-server-1984510406',id=35,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgRFt+zoylZH7ImyqBxzXxwawOcfJNh1kWIzkZgWDpOFw1or+RHRCJDV1CeY464D6GQlptlWjI1DBsvXTx+mpaMK5Xo0FMreDEmYX82LF0E6+YVrbbjZw424HLlD4pjew==',key_name='tempest-keypair-1186596023',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:59:00Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f65617e71571457f8906997583100678',ramdisk_id='',reservation_id='r-62oluqi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1821941242',owner_user_name='tempest-ServerRescueNegativeTestJSON-1821941242-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:59:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='435dfce8f05e4e01b380797bd07bd4dc',uuid=27c37404-4df0-4ded-bf5b-6002e26d4222,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "967dfb76-814b-43ba-ba2b-c14f407ff45e", "address": "fa:16:3e:e8:00:1f", "network": {"id": "e1d5d073-f27b-4ff1-9ed3-99f57407c76f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.192", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "vif_mac": "fa:16:3e:e8:00:1f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f65617e71571457f8906997583100678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap967dfb76-81", "ovs_interfaceid": "967dfb76-814b-43ba-ba2b-c14f407ff45e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:59:55.401272 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Converting VIF {"id": "967dfb76-814b-43ba-ba2b-c14f407ff45e", "address": "fa:16:3e:e8:00:1f", "network": {"id": "e1d5d073-f27b-4ff1-9ed3-99f57407c76f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.192", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "vif_mac": "fa:16:3e:e8:00:1f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f65617e71571457f8906997583100678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap967dfb76-81", "ovs_interfaceid": "967dfb76-814b-43ba-ba2b-c14f407ff45e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:59:55.401975 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:00:1f,bridge_name='br-int',has_traffic_filtering=True,id=967dfb76-814b-43ba-ba2b-c14f407ff45e,network=Network(e1d5d073-f27b-4ff1-9ed3-99f57407c76f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap967dfb76-81') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:59:55.402838 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lazy-loading 'pci_devices' on Instance uuid 27c37404-4df0-4ded-bf5b-6002e26d4222 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:59:55.455800 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:55.467902 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:55.503971 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:55.515119 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:59:55.522385 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:59:55.522385 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:59:55.537266 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:59:55.537266 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:59:55.546784 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:59:55.546784 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:55.556946 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:55.569239 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:55.580563 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:55.580563 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:55.580563 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:55.580563 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:55.580563 np0000001583 nova-compute[98241]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:55.580563 np0000001583 nova-compute[98241]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:55.580563 np0000001583 nova-compute[98241]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:55.580563 np0000001583 nova-compute[98241]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:55.580563 np0000001583 nova-compute[98241]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28fdb218-118a-4975-a70d-3ecafe7cfb12 (non-flash)
May 28 01:59:55.580563 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:59:55.580800 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:55.580800 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:55.580800 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:55.580800 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:55.580800 np0000001583 nova-compute[98241]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:55.580800 np0000001583 nova-compute[98241]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:55.580800 np0000001583 nova-compute[98241]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:55.580800 np0000001583 nova-compute[98241]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:55.580800 np0000001583 nova-compute[98241]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28fdb218-118a-4975-a70d-3ecafe7cfb12 (non-flash)
May 28 01:59:55.580800 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:59:55.599878 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:55.599878 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:55.599878 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:55.599878 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:55.599878 np0000001583 nova-compute[98241]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:55.599878 np0000001583 nova-compute[98241]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:55.599878 np0000001583 nova-compute[98241]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:55.599878 np0000001583 nova-compute[98241]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:55.599878 np0000001583 nova-compute[98241]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28fdb218-118a-4975-a70d-3ecafe7cfb12 (non-flash)
May 28 01:59:55.599878 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:59:55.600282 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:55.600282 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:55.600282 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:55.600282 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:55.600282 np0000001583 nova-compute[98241]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:55.600282 np0000001583 nova-compute[98241]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:55.600282 np0000001583 nova-compute[98241]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:55.600282 np0000001583 nova-compute[98241]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:55.600282 np0000001583 nova-compute[98241]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28fdb218-118a-4975-a70d-3ecafe7cfb12 (non-flash)
May 28 01:59:55.600282 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:59:55.643725 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57, portal: 192.168.40.100,3260]
May 28 01:59:55.643725 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57, portal: 192.168.40.100,3260] successful.
May 28 01:59:55.643725 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:55.656881 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57, portal: 192.168.50.100,3260]
May 28 01:59:55.656881 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57, portal: 192.168.50.100,3260] successful.
May 28 01:59:55.656881 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:55.664649 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:55.673300 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:55.696106 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:55.696106 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:55.696106 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:55.696106 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:55.696106 np0000001583 nova-compute[98241]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:55.696106 np0000001583 nova-compute[98241]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:55.696106 np0000001583 nova-compute[98241]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:55.696106 np0000001583 nova-compute[98241]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:55.696106 np0000001583 nova-compute[98241]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28fdb218-118a-4975-a70d-3ecafe7cfb12 (non-flash)
May 28 01:59:55.696106 np0000001583 nova-compute[98241]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:55.696106 np0000001583 nova-compute[98241]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:55.696106 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:59:55.696106 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:55.696106 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:55.696106 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:55.696106 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:55.696106 np0000001583 nova-compute[98241]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:55.696106 np0000001583 nova-compute[98241]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:55.696106 np0000001583 nova-compute[98241]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:55.696106 np0000001583 nova-compute[98241]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:55.696106 np0000001583 nova-compute[98241]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28fdb218-118a-4975-a70d-3ecafe7cfb12 (non-flash)
May 28 01:59:55.696106 np0000001583 nova-compute[98241]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:55.696106 np0000001583 nova-compute[98241]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:55.696106 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:59:55.696106 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.214s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:59:55.696980 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:59:55.697351 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:55.697351 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:55.697351 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:55.697351 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:55.697351 np0000001583 nova-compute[98241]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:55.697351 np0000001583 nova-compute[98241]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:55.697351 np0000001583 nova-compute[98241]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:55.697351 np0000001583 nova-compute[98241]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:55.697351 np0000001583 nova-compute[98241]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28fdb218-118a-4975-a70d-3ecafe7cfb12 (non-flash)
May 28 01:59:55.697351 np0000001583 nova-compute[98241]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:55.697351 np0000001583 nova-compute[98241]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:55.697351 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:59:55.697727 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:55.697727 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:55.697727 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:55.697727 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:55.697727 np0000001583 nova-compute[98241]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:55.697727 np0000001583 nova-compute[98241]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:55.697727 np0000001583 nova-compute[98241]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:55.697727 np0000001583 nova-compute[98241]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:55.697727 np0000001583 nova-compute[98241]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28fdb218-118a-4975-a70d-3ecafe7cfb12 (non-flash)
May 28 01:59:55.697727 np0000001583 nova-compute[98241]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:55.697727 np0000001583 nova-compute[98241]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:55.697727 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:59:55.699100 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.217s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:59:55.699100 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:59:55.702479 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] HCTL ('16', '-', '-', 0) found on session 85 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:59:55.702479 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:59:55.709815 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:55.718751 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] HCTL ('17', '-', '-', 0) found on session 86 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:59:55.718751 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:59:55.733677 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Searching for a device in session 85 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:59:55.733677 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8ea99ade-a69e-46e2-9c9d-6251e4f69a57', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:59:55.742680 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:55.748726 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:55.761569 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Searching for a device in session 86 and hctl ['17', '*', '*', 0] yield: None {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:59:55.835893 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Successfully updated port: 062afddc-3d10-4dc2-a9d7-6024ed27c97a {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:59:55.846176 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Booting with volume f12a45d8-1f6d-4068-927e-408a86ee7e6d at /dev/vda
May 28 01:59:55.862245 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:55.906257 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Object Instance<27c37404-4df0-4ded-bf5b-6002e26d4222> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:59:55.908941 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] End _get_guest_xml xml=<domain type="qemu">
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:   <uuid>27c37404-4df0-4ded-bf5b-6002e26d4222</uuid>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:   <name>instance-00000023</name>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1984510406</nova:name>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:59:54</nova:creationTime>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:         <nova:user uuid="435dfce8f05e4e01b380797bd07bd4dc">tempest-ServerRescueNegativeTestJSON-1821941242-project-member</nova:user>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:         <nova:project uuid="f65617e71571457f8906997583100678">tempest-ServerRescueNegativeTestJSON-1821941242</nova:project>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:         <nova:port uuid="967dfb76-814b-43ba-ba2b-c14f407ff45e">
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:     <system>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:       <entry name="serial">27c37404-4df0-4ded-bf5b-6002e26d4222</entry>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:       <entry name="uuid">27c37404-4df0-4ded-bf5b-6002e26d4222</entry>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:     </system>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:   <os>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:   </os>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:   <features>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:   </features>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:   <devices>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/27c37404-4df0-4ded-bf5b-6002e26d4222/disk.rescue"/>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:     </disk>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/27c37404-4df0-4ded-bf5b-6002e26d4222/disk"/>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:       <target dev="vdb" bus="virtio"/>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:     </disk>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/27c37404-4df0-4ded-bf5b-6002e26d4222/disk.config.rescue"/>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:     </disk>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:e8:00:1f"/>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:       <target dev="tap967dfb76-81"/>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:     </interface>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/27c37404-4df0-4ded-bf5b-6002e26d4222/console.log" append="off"/>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:     </serial>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:     <video>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:     </video>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:     </rng>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:   </devices>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]: </domain>
May 28 01:59:55.908941 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:59:55.922240 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Instance destroyed successfully.
May 28 01:59:55.927163 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-465e2707-55e1-4127-9c2a-538876d869a4 req-6da5bc44-ed35-41c9-b411-d58631328b92 service nova] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Received event network-changed-062afddc-3d10-4dc2-a9d7-6024ed27c97a {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:59:55.927163 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-465e2707-55e1-4127-9c2a-538876d869a4 req-6da5bc44-ed35-41c9-b411-d58631328b92 service nova] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Refreshing instance network info cache due to event network-changed-062afddc-3d10-4dc2-a9d7-6024ed27c97a. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:59:55.929382 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-465e2707-55e1-4127-9c2a-538876d869a4 req-6da5bc44-ed35-41c9-b411-d58631328b92 service nova] Acquiring lock "refresh_cache-a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:59:55.929382 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-465e2707-55e1-4127-9c2a-538876d869a4 req-6da5bc44-ed35-41c9-b411-d58631328b92 service nova] Acquired lock "refresh_cache-a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:59:55.930230 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-465e2707-55e1-4127-9c2a-538876d869a4 req-6da5bc44-ed35-41c9-b411-d58631328b92 service nova] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Refreshing network info cache for port 062afddc-3d10-4dc2-a9d7-6024ed27c97a {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:59:55.943204 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:59:55.950908 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:55.960396 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:55.969598 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:59:55.979938 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-37bb0c55-2d59-4cbd-8350-a566d9958153 req-3148eccd-ee34-4efd-b7b1-f1cc2ba6ea2d service nova] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Received event network-vif-plugged-77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:59:55.980507 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-37bb0c55-2d59-4cbd-8350-a566d9958153 req-3148eccd-ee34-4efd-b7b1-f1cc2ba6ea2d service nova] Acquiring lock "8b2a5f31-1b3d-447f-939e-94fd0be5eb85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:55.980852 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-37bb0c55-2d59-4cbd-8350-a566d9958153 req-3148eccd-ee34-4efd-b7b1-f1cc2ba6ea2d service nova] Lock "8b2a5f31-1b3d-447f-939e-94fd0be5eb85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:55.981039 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-37bb0c55-2d59-4cbd-8350-a566d9958153 req-3148eccd-ee34-4efd-b7b1-f1cc2ba6ea2d service nova] Lock "8b2a5f31-1b3d-447f-939e-94fd0be5eb85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:55.981261 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-37bb0c55-2d59-4cbd-8350-a566d9958153 req-3148eccd-ee34-4efd-b7b1-f1cc2ba6ea2d service nova] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Processing event network-vif-plugged-77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:59:56.005157 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:56.053223 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:59:56.054066 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:59:56.065671 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:59:56.067070 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::8832:afff:fe8a:cd4c', 'fe80::fc16:3eff:fe48:7d7b', 'fe80::d0cf:7bff:fef9:3cc3', 'fe80::fc16:3eff:feca:d649', 'fe80::fc16:3eff:fed3:cd06', 'fe80::fc16:3eff:feae:1e12', 'fe80::fc16:3eff:fe24:bbc4', 'fe80::b0dd:40ff:feb5:6704', 'fe80::fc16:3eff:fedf:4521', 'fe80::fc16:3eff:fef3:6803', 'fe80::ecb9:b7ff:fe00:dc63', 'fe80::fc16:3eff:feae:cc0f', 'fe80::9020:88ff:fe40:d02', 'fe80::fc16:3eff:fe76:c53f'] 
May 28 01:59:56.067247 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:59:56.067363 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:59:56.067618 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:59:56.067821 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Updating existing volume attachment record: fa45330d-d53b-4fa4-a54b-476db49d288a {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:59:56.341346 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "refresh_cache-a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:59:56.435587 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-465e2707-55e1-4127-9c2a-538876d869a4 req-6da5bc44-ed35-41c9-b411-d58631328b92 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:59:56.525011 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-465e2707-55e1-4127-9c2a-538876d869a4 req-6da5bc44-ed35-41c9-b411-d58631328b92 service nova] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:59:56.528191 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Instance event wait completed in 0 seconds for  {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:59:56.530467 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Removed pending STOPPED event for 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d due to new event <LifecycleEvent: 1779933596.5265896, 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d => Resumed> {{(pid=98241) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 01:59:56.530727 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933596.5265896, 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:59:56.531341 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] VM Resumed (Lifecycle Event)
May 28 01:59:56.538000 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Instance rebooted successfully.
May 28 01:59:56.564197 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9ed907f2-1841-457f-960b-9e15db8826de req-9b3a944f-c05b-482d-a544-b080c9ab0a3a service nova] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Received event network-vif-plugged-1bce33b1-57be-4de9-9e81-1a05535ae317 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:59:56.564424 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9ed907f2-1841-457f-960b-9e15db8826de req-9b3a944f-c05b-482d-a544-b080c9ab0a3a service nova] Acquiring lock "8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:56.566917 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9ed907f2-1841-457f-960b-9e15db8826de req-9b3a944f-c05b-482d-a544-b080c9ab0a3a service nova] Lock "8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:56.567256 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9ed907f2-1841-457f-960b-9e15db8826de req-9b3a944f-c05b-482d-a544-b080c9ab0a3a service nova] Lock "8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:56.567454 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9ed907f2-1841-457f-960b-9e15db8826de req-9b3a944f-c05b-482d-a544-b080c9ab0a3a service nova] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] No waiting events found dispatching network-vif-plugged-1bce33b1-57be-4de9-9e81-1a05535ae317 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:59:56.568322 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-9ed907f2-1841-457f-960b-9e15db8826de req-9b3a944f-c05b-482d-a544-b080c9ab0a3a service nova] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Received unexpected event network-vif-plugged-1bce33b1-57be-4de9-9e81-1a05535ae317 for instance with vm_state active and task_state reboot_started_hard.
May 28 01:59:56.568322 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9ed907f2-1841-457f-960b-9e15db8826de req-9b3a944f-c05b-482d-a544-b080c9ab0a3a service nova] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Received event network-vif-plugged-1bce33b1-57be-4de9-9e81-1a05535ae317 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:59:56.568798 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9ed907f2-1841-457f-960b-9e15db8826de req-9b3a944f-c05b-482d-a544-b080c9ab0a3a service nova] Acquiring lock "8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:56.569338 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9ed907f2-1841-457f-960b-9e15db8826de req-9b3a944f-c05b-482d-a544-b080c9ab0a3a service nova] Lock "8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:56.569557 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9ed907f2-1841-457f-960b-9e15db8826de req-9b3a944f-c05b-482d-a544-b080c9ab0a3a service nova] Lock "8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:56.569909 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9ed907f2-1841-457f-960b-9e15db8826de req-9b3a944f-c05b-482d-a544-b080c9ab0a3a service nova] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] No waiting events found dispatching network-vif-plugged-1bce33b1-57be-4de9-9e81-1a05535ae317 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:59:56.570345 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-9ed907f2-1841-457f-960b-9e15db8826de req-9b3a944f-c05b-482d-a544-b080c9ab0a3a service nova] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Received unexpected event network-vif-plugged-1bce33b1-57be-4de9-9e81-1a05535ae317 for instance with vm_state active and task_state reboot_started_hard.
May 28 01:59:56.732034 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-465e2707-55e1-4127-9c2a-538876d869a4 req-6da5bc44-ed35-41c9-b411-d58631328b92 service nova] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:59:56.753401 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Searching for a device in session 86 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:59:56.753678 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8ea99ade-a69e-46e2-9c9d-6251e4f69a57', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:59:56.784981 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:59:56.787565 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:59:56.791937 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Instance spawned successfully.
May 28 01:59:56.792403 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:59:57.033931 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:59:57.037399 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:59:57.234037 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-465e2707-55e1-4127-9c2a-538876d869a4 req-6da5bc44-ed35-41c9-b411-d58631328b92 service nova] Releasing lock "refresh_cache-a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:59:57.238547 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquired lock "refresh_cache-a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:59:57.238741 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:59:57.299987 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:59:57.300134 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:59:57.300396 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:59:57.300615 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:59:57.300859 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:59:57.301123 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:59:57.461803 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:59:57.461803 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:59:57.461803 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:59:57.462239 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] No VIF found with MAC fa:16:3e:e8:00:1f, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:59:57.462371 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Using config drive
May 28 01:59:57.499045 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Found WWN 330000000279bfb87 for multipath device dm-6 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:59:57.499209 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:59:57.499368 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] <== connect_volume: return (4599ms) {'type': 'block', 'scsi_wwn': '330000000279bfb87', 'path': '/dev/dm-6', 'multipath_id': '330000000279bfb87'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:59:57.499454 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000279bfb87', 'path': '/dev/dm-6', 'multipath_id': '330000000279bfb87'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:59:57.540358 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
May 28 01:59:57.540619 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933597.5404093, 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:59:57.540731 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] VM Started (Lifecycle Event)
May 28 01:59:57.806994 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Took 7.53 seconds to spawn the instance on the hypervisor.
May 28 01:59:57.807218 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:59:57.846684 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:59:57.965261 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lazy-loading 'ec2_ids' on Instance uuid 27c37404-4df0-4ded-bf5b-6002e26d4222 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:59:58.004276 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:58:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-522410549',display_name='tempest-AttachVolumeTestJSON-server-522410549',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-attachvolumetestjson-server-522410549',id=34,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/SX3aLhOteyGwrFqR0CEL4C04Fp6fWjwsBRpIz44V+NdHV7WRnAaFAuCSewkCiCwsHBAYVT3CCSkcBu9Z5deiFWGGYvkB/zQRpMDdHuyRrvPU5bkBQzk+aQ10B/g2ZJA==',key_name='tempest-keypair-487865295',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:58:49Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='04ce4063a6ac4afdb5ee359a5c1105d3',ramdisk_id='',reservation_id='r-q0lo3p0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1276932129',owner_user_name='tempest-AttachVolumeTestJSON-1276932129-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:59:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='164f3d08de954440bd716afe5eb1054a',uuid=d4fad20b-d51e-47c9-8f55-3aa085a10891,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "address": "fa:16:3e:ca:8c:e2", "network": {"id": "d4bf7f94-4ac7-4145-be11-d2aeeafb6c02", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-972487534-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "04ce4063a6ac4afdb5ee359a5c1105d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e39a69e-35", "ovs_interfaceid": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:59:58.004582 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Converting VIF {"id": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "address": "fa:16:3e:ca:8c:e2", "network": {"id": "d4bf7f94-4ac7-4145-be11-d2aeeafb6c02", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-972487534-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "04ce4063a6ac4afdb5ee359a5c1105d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e39a69e-35", "ovs_interfaceid": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:59:58.006126 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:8c:e2,bridge_name='br-int',has_traffic_filtering=True,id=0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b,network=Network(d4bf7f94-4ac7-4145-be11-d2aeeafb6c02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e39a69e-35') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:59:58.006126 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lazy-loading 'pci_devices' on Instance uuid d4fad20b-d51e-47c9-8f55-3aa085a10891 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:59:58.042923 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-66580842-7bbe-4877-9627-de8c1ded2b17 req-2692de23-c7c8-48e8-9b7b-c3b605c0f115 service nova] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Received event network-vif-plugged-77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:59:58.043112 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-66580842-7bbe-4877-9627-de8c1ded2b17 req-2692de23-c7c8-48e8-9b7b-c3b605c0f115 service nova] Acquiring lock "8b2a5f31-1b3d-447f-939e-94fd0be5eb85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:58.043577 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-66580842-7bbe-4877-9627-de8c1ded2b17 req-2692de23-c7c8-48e8-9b7b-c3b605c0f115 service nova] Lock "8b2a5f31-1b3d-447f-939e-94fd0be5eb85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:58.043726 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-66580842-7bbe-4877-9627-de8c1ded2b17 req-2692de23-c7c8-48e8-9b7b-c3b605c0f115 service nova] Lock "8b2a5f31-1b3d-447f-939e-94fd0be5eb85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:58.043959 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-66580842-7bbe-4877-9627-de8c1ded2b17 req-2692de23-c7c8-48e8-9b7b-c3b605c0f115 service nova] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] No waiting events found dispatching network-vif-plugged-77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:59:58.043959 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-66580842-7bbe-4877-9627-de8c1ded2b17 req-2692de23-c7c8-48e8-9b7b-c3b605c0f115 service nova] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Received unexpected event network-vif-plugged-77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0 for instance with vm_state active and task_state None.
May 28 01:59:58.046916 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:59:58.049953 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:59:58.052996 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:59:58.052996 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:59:58.052996 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:59:58.052996 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] No VIF found with MAC fa:16:3e:ae:cc:0f, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:59:58.053200 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:59:58.053378 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:59:58.190984 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:58.200228 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Updating instance_info_cache with network_info: [{"id": "062afddc-3d10-4dc2-a9d7-6024ed27c97a", "address": "fa:16:3e:ff:a6:88", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap062afddc-3d", "ovs_interfaceid": "062afddc-3d10-4dc2-a9d7-6024ed27c97a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:59:58.248856 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:59:58.249942 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:59:58.250244 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Creating image(s)
May 28 01:59:58.250668 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Did not create local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 01:59:58.250841 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Ensure instance console log exists: /opt/stack/data/nova/instances/a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:59:58.251162 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:58.251363 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:58.251632 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:58.332108 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Took 13.26 seconds to build instance.
May 28 01:59:58.470213 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Object Instance<27c37404-4df0-4ded-bf5b-6002e26d4222> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:59:58.470213 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lazy-loading 'keypairs' on Instance uuid 27c37404-4df0-4ded-bf5b-6002e26d4222 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:59:58.512216 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Object Instance<d4fad20b-d51e-47c9-8f55-3aa085a10891> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:59:58.513711 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] End _get_guest_xml xml=<domain type="qemu">
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:   <uuid>d4fad20b-d51e-47c9-8f55-3aa085a10891</uuid>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:   <name>instance-00000022</name>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:   <metadata>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:       <nova:name>tempest-AttachVolumeTestJSON-server-522410549</nova:name>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:59:52</nova:creationTime>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:       </nova:image>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:         <nova:user uuid="164f3d08de954440bd716afe5eb1054a">tempest-AttachVolumeTestJSON-1276932129-project-member</nova:user>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:         <nova:project uuid="04ce4063a6ac4afdb5ee359a5c1105d3">tempest-AttachVolumeTestJSON-1276932129</nova:project>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:         <nova:port uuid="0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b">
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:         </nova:port>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:   </metadata>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:     <system>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:       <entry name="serial">d4fad20b-d51e-47c9-8f55-3aa085a10891</entry>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:       <entry name="uuid">d4fad20b-d51e-47c9-8f55-3aa085a10891</entry>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:     </system>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:   <os>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:   </os>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:   <features>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:     <acpi/>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:     <tcg>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:     </tcg>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:   </features>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:   </cpu>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:   <devices>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/disk"/>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:     </disk>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/disk.config"/>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:     </disk>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:     <disk type="block" device="disk">
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:       <alias name="ua-8ea99ade-a69e-46e2-9c9d-6251e4f69a57"/>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:       <source dev="/dev/dm-6"/>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:       <target dev="vdb" bus="virtio"/>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:       <serial>8ea99ade-a69e-46e2-9c9d-6251e4f69a57</serial>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:     </disk>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:ca:8c:e2"/>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:       <target dev="tap0e39a69e-35"/>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:     </interface>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/console.log" append="off"/>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:     </serial>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:     <video>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:     </video>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:     </rng>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:     </memballoon>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:   </devices>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]: </domain>
May 28 01:59:58.513711 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:59:58.516841 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:58.559384 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
May 28 01:59:58.559384 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933598.558163, 8b2a5f31-1b3d-447f-939e-94fd0be5eb85 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:59:58.559384 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] VM Started (Lifecycle Event)
May 28 01:59:58.571151 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5b1bc12f-1a32-47ab-8f8e-5ab417ab01fe tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 16.676s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:58.628380 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:59:58.628380 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:58.702922 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Releasing lock "refresh_cache-a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:59:58.703562 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Instance network_info: |[{"id": "062afddc-3d10-4dc2-a9d7-6024ed27c97a", "address": "fa:16:3e:ff:a6:88", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap062afddc-3d", "ovs_interfaceid": "062afddc-3d10-4dc2-a9d7-6024ed27c97a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:59:58.704862 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Start _get_guest_xml network_info=[{"id": "062afddc-3d10-4dc2-a9d7-6024ed27c97a", "address": "fa:16:3e:ff:a6:88", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap062afddc-3d", "ovs_interfaceid": "062afddc-3d10-4dc2-a9d7-6024ed27c97a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d', 'iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f12a45d8-1f6d-4068-927e-408a86ee7e6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d', 'attached_at': '', 'detached_at': '', 'volume_id': 'f12a45d8-1f6d-4068-927e-408a86ee7e6d', 'serial': 'f12a45d8-1f6d-4068-927e-408a86ee7e6d'}, 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'fa45330d-d53b-4fa4-a54b-476db49d288a', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:59:58.708951 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:59:58.710676 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-122348002', uuid='a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d'), owner=OwnerMeta(userid='6be314b4eed642c3b2c72fe115860220', username='tempest-TestVolumeBootPattern-1031057169-project-member', projectid='432aa1094ced436494def17a875aa8e1', projectname='tempest-TestVolumeBootPattern-1031057169'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "062afddc-3d10-4dc2-a9d7-6024ed27c97a", "address": "fa:16:3e:ff:a6:88", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap062afddc-3d", "ovs_interfaceid": "062afddc-3d10-4dc2-a9d7-6024ed27c97a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933598.7102234) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:59:58.711830 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:59:58.712304 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:59:58.713317 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:59:58.713581 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:59:58.714839 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:59:58.715277 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:59:58.715570 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:59:58.715703 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:59:58.715868 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:59:58.715982 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:59:58.716228 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:59:58.716507 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:59:58.716676 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:59:58.716863 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:59:58.717041 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:59:58.717246 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:59:58.726585 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:59:58.727673 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] skipping disk /dev/dm-6 (vdb) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:59:58.730248 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lazy-loading 'trusted_certs' on Instance uuid d4fad20b-d51e-47c9-8f55-3aa085a10891 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:59:58.733299 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:59:58.733791 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d', 'iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f12a45d8-1f6d-4068-927e-408a86ee7e6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:59:58.734037 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:59:58.734504 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:59:58.734935 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d', 'iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f12a45d8-1f6d-4068-927e-408a86ee7e6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:59:58.750209 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:59:58.750801 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:59:58.751241 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:59:58.751515 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:59:58.752570 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:59:58.752570 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:59:58.770343 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:59:58.770343 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:58.774050 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:59:58.774050 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:58.784730 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d] added
May 28 01:59:58.784730 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:59:58.784730 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:59:58.784730 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:59:58.784730 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:59:58.784730 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:59:58.784730 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:58.784999 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:59:58.785042 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0336(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:59:58.785254 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:59:58.787325 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0017639019997659489 future=<Future at 0x7724f872f7d0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:59:58.787325 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:59:58.787325 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=2.16528087100005 future=<Future at 0x7724ec4b1520 state=cancelled>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:59:58.787479 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=2.1651354589998846 future=<Future at 0x7724ec4b1520 state=cancelled>) was cancelled while queued, skipping {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:59:58.787567 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:59:58.787614 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=8.770261647000098 future=<Future at 0x7724ec2d3350 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:59:58.787834 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=8.770190689999708 future=<Future at 0x7724ec2d3350 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:59:58.788260 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Emitting event <LifecycleEvent: 1779933583.7852798, d4fad20b-d51e-47c9-8f55-3aa085a10891 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:59:58.788601 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] VM Stopped (Lifecycle Event)
May 28 01:59:58.789723 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d] added
May 28 01:59:58.789723 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:59:58.789723 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:59:58.789723 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:59:58.789723 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 01:59:58.789723 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:59:58.789723 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:58.792117 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:59:58.792117 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0395(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:59:58.792117 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:59:58.834430 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "8b2a5f31-1b3d-447f-939e-94fd0be5eb85" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.775s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:58.976110 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Object Instance<27c37404-4df0-4ded-bf5b-6002e26d4222> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:59:58.976866 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:59:59.073405 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:59:59.077510 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:59:59.117287 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Creating config drive at /opt/stack/data/nova/instances/27c37404-4df0-4ded-bf5b-6002e26d4222/disk.config.rescue
May 28 01:59:59.122246 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/27c37404-4df0-4ded-bf5b-6002e26d4222/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmuqycumx {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:59.172925 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/27c37404-4df0-4ded-bf5b-6002e26d4222/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmuqycumx" returned: 0 in 0.050s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:59:59.236103 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Object Instance<d4fad20b-d51e-47c9-8f55-3aa085a10891> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:59:59.236103 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:59.294622 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-148ebd89-2b5b-4688-b4cf-80bf454990c9 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:59:59.323119 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.088s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:59:59.323262 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:59:59.323495 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:59:59.419809 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:59:59.420515 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Cannot resize image /opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:59:59.420894 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lazy-loading 'migration_context' on Instance uuid d4fad20b-d51e-47c9-8f55-3aa085a10891 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:59:59.428749 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:59.586829 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933599.586384, 8b2a5f31-1b3d-447f-939e-94fd0be5eb85 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:59:59.587580 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] VM Paused (Lifecycle Event)
May 28 01:59:59.664970 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:59.694327 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:59.695974 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:59.787255 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:59:59.793656 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:59:59.806847 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:59:59.806847 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: node.startup = manual
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.port = 0
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 01:59:59.815141 np0000001583 nova-compute[98241]: # END RECORD
May 28 01:59:59.815141 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:59.825447 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:59.837576 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:59.844408 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:59.854457 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:59.854457 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:59.854457 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:59.854457 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:59.854457 np0000001583 nova-compute[98241]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:59.854457 np0000001583 nova-compute[98241]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:59.854457 np0000001583 nova-compute[98241]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:59.854457 np0000001583 nova-compute[98241]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:59.854457 np0000001583 nova-compute[98241]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28fdb218-118a-4975-a70d-3ecafe7cfb12 (non-flash)
May 28 01:59:59.854457 np0000001583 nova-compute[98241]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:59.854457 np0000001583 nova-compute[98241]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:59.854457 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:59:59.854457 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:59.854457 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:59.854457 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:59.854457 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:59.854457 np0000001583 nova-compute[98241]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:59.854457 np0000001583 nova-compute[98241]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:59.854457 np0000001583 nova-compute[98241]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:59.854457 np0000001583 nova-compute[98241]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:59.854457 np0000001583 nova-compute[98241]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28fdb218-118a-4975-a70d-3ecafe7cfb12 (non-flash)
May 28 01:59:59.854457 np0000001583 nova-compute[98241]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:59.854457 np0000001583 nova-compute[98241]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:59.854457 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:59:59.864001 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-487f2726-3720-4cd1-abb0-9e563c47e052 req-f7201f04-87a9-4818-8ef3-626bfc5ee6a8 service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Received event network-vif-plugged-967dfb76-814b-43ba-ba2b-c14f407ff45e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:59:59.864541 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-487f2726-3720-4cd1-abb0-9e563c47e052 req-f7201f04-87a9-4818-8ef3-626bfc5ee6a8 service nova] Acquiring lock "27c37404-4df0-4ded-bf5b-6002e26d4222-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:59:59.866991 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-487f2726-3720-4cd1-abb0-9e563c47e052 req-f7201f04-87a9-4818-8ef3-626bfc5ee6a8 service nova] Lock "27c37404-4df0-4ded-bf5b-6002e26d4222-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:59:59.867135 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-487f2726-3720-4cd1-abb0-9e563c47e052 req-f7201f04-87a9-4818-8ef3-626bfc5ee6a8 service nova] Lock "27c37404-4df0-4ded-bf5b-6002e26d4222-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:59:59.867282 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-487f2726-3720-4cd1-abb0-9e563c47e052 req-f7201f04-87a9-4818-8ef3-626bfc5ee6a8 service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] No waiting events found dispatching network-vif-plugged-967dfb76-814b-43ba-ba2b-c14f407ff45e {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:59:59.867432 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-487f2726-3720-4cd1-abb0-9e563c47e052 req-f7201f04-87a9-4818-8ef3-626bfc5ee6a8 service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Received unexpected event network-vif-plugged-967dfb76-814b-43ba-ba2b-c14f407ff45e for instance with vm_state active and task_state rescuing.
May 28 01:59:59.872960 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:59.872960 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:59.872960 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:59.872960 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:59.872960 np0000001583 nova-compute[98241]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:59.872960 np0000001583 nova-compute[98241]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:59.872960 np0000001583 nova-compute[98241]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:59.872960 np0000001583 nova-compute[98241]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:59.872960 np0000001583 nova-compute[98241]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28fdb218-118a-4975-a70d-3ecafe7cfb12 (non-flash)
May 28 01:59:59.872960 np0000001583 nova-compute[98241]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:59.872960 np0000001583 nova-compute[98241]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:59.872960 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:59:59.873388 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:59.873388 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:59.873388 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:59.873388 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:59.873388 np0000001583 nova-compute[98241]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:59.873388 np0000001583 nova-compute[98241]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:59.873388 np0000001583 nova-compute[98241]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:59.873388 np0000001583 nova-compute[98241]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:59.873388 np0000001583 nova-compute[98241]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28fdb218-118a-4975-a70d-3ecafe7cfb12 (non-flash)
May 28 01:59:59.873388 np0000001583 nova-compute[98241]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:59.873388 np0000001583 nova-compute[98241]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:59.873388 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:59:59.874575 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:59.875723 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:59.911270 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d, portal: 192.168.40.100,3260]
May 28 01:59:59.911270 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d, portal: 192.168.40.100,3260] successful.
May 28 01:59:59.911270 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:59.925129 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Object Instance<d4fad20b-d51e-47c9-8f55-3aa085a10891> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:59:59.925462 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:58:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-522410549',display_name='tempest-AttachVolumeTestJSON-server-522410549',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-attachvolumetestjson-server-522410549',id=34,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/SX3aLhOteyGwrFqR0CEL4C04Fp6fWjwsBRpIz44V+NdHV7WRnAaFAuCSewkCiCwsHBAYVT3CCSkcBu9Z5deiFWGGYvkB/zQRpMDdHuyRrvPU5bkBQzk+aQ10B/g2ZJA==',key_name='tempest-keypair-487865295',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:58:49Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='04ce4063a6ac4afdb5ee359a5c1105d3',ramdisk_id='',reservation_id='r-q0lo3p0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1276932129',owner_user_name='tempest-AttachVolumeTestJSON-1276932129-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:59:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='164f3d08de954440bd716afe5eb1054a',uuid=d4fad20b-d51e-47c9-8f55-3aa085a10891,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "address": "fa:16:3e:ca:8c:e2", "network": {"id": "d4bf7f94-4ac7-4145-be11-d2aeeafb6c02", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-972487534-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "04ce4063a6ac4afdb5ee359a5c1105d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e39a69e-35", "ovs_interfaceid": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:59:59.925701 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Converting VIF {"id": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "address": "fa:16:3e:ca:8c:e2", "network": {"id": "d4bf7f94-4ac7-4145-be11-d2aeeafb6c02", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-972487534-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "04ce4063a6ac4afdb5ee359a5c1105d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e39a69e-35", "ovs_interfaceid": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:59:59.926729 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:8c:e2,bridge_name='br-int',has_traffic_filtering=True,id=0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b,network=Network(d4bf7f94-4ac7-4145-be11-d2aeeafb6c02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e39a69e-35') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:59:59.926994 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:8c:e2,bridge_name='br-int',has_traffic_filtering=True,id=0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b,network=Network(d4bf7f94-4ac7-4145-be11-d2aeeafb6c02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e39a69e-35') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:59:59.929187 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:59.929484 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:59:59.929631 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:59:59.932014 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:59.932771 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:59.933451 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d, portal: 192.168.50.100,3260]
May 28 01:59:59.933451 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d, portal: 192.168.50.100,3260] successful.
May 28 01:59:59.933451 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:59.933723 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ba3c78f9-de7a-55b7-bdb7-031dda98db4b', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:59:59.936044 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:59.938243 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:59:59.940553 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:59.940731 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0e39a69e-35, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:59:59.941140 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0e39a69e-35, col_values=(('qos', UUID('b6cfc7e3-9ed1-4b62-9cb0-0d0e9a0331a2')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:59:59.941399 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0e39a69e-35, col_values=(('external_ids', {'iface-id': '0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:8c:e2', 'vm-uuid': 'd4fad20b-d51e-47c9-8f55-3aa085a10891'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:59:59.942279 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:59.943822 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:59:59.949029 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:59:59.950369 np0000001583 nova-compute[98241]: INFO os_vif [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:8c:e2,bridge_name='br-int',has_traffic_filtering=True,id=0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b,network=Network(d4bf7f94-4ac7-4145-be11-d2aeeafb6c02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e39a69e-35')
May 28 01:59:59.954802 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:59:59.961882 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:59.961882 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:59.961882 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:59.961882 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:59.961882 np0000001583 nova-compute[98241]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:59.961882 np0000001583 nova-compute[98241]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:59.961882 np0000001583 nova-compute[98241]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:59.961882 np0000001583 nova-compute[98241]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:59.961882 np0000001583 nova-compute[98241]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28fdb218-118a-4975-a70d-3ecafe7cfb12 (non-flash)
May 28 01:59:59.961882 np0000001583 nova-compute[98241]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:59.961882 np0000001583 nova-compute[98241]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:59.961882 np0000001583 nova-compute[98241]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 01:59:59.961882 np0000001583 nova-compute[98241]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 01:59:59.961882 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:59:59.962242 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:59.962242 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 01:59:59.962242 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:59.962242 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 01:59:59.962242 np0000001583 nova-compute[98241]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:59.962242 np0000001583 nova-compute[98241]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 01:59:59.962242 np0000001583 nova-compute[98241]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:59.962242 np0000001583 nova-compute[98241]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 01:59:59.962242 np0000001583 nova-compute[98241]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28fdb218-118a-4975-a70d-3ecafe7cfb12 (non-flash)
May 28 01:59:59.962242 np0000001583 nova-compute[98241]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:59.962242 np0000001583 nova-compute[98241]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 01:59:59.962242 np0000001583 nova-compute[98241]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 01:59:59.962242 np0000001583 nova-compute[98241]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 01:59:59.962242 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:59:59.962613 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.211s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:59:59.962691 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:59:59.964140 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] HCTL ('18', '-', '-', 0) found on session 87 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:59:59.964303 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:59:59.988229 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Searching for a device in session 87 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:59:59.990537 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f12a45d8-1f6d-4068-927e-408a86ee7e6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:00:00.004352 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:00.004352 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:00.004352 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:00.004352 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:00.004352 np0000001583 nova-compute[98241]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 02:00:00.004352 np0000001583 nova-compute[98241]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 02:00:00.004352 np0000001583 nova-compute[98241]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:00.004352 np0000001583 nova-compute[98241]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:00.004352 np0000001583 nova-compute[98241]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28fdb218-118a-4975-a70d-3ecafe7cfb12 (non-flash)
May 28 02:00:00.004352 np0000001583 nova-compute[98241]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:00.004352 np0000001583 nova-compute[98241]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:00.004352 np0000001583 nova-compute[98241]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:00.004352 np0000001583 nova-compute[98241]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:00.004352 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:00:00.005774 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:00.005774 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:00.005774 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:00.005774 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:00.005774 np0000001583 nova-compute[98241]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 02:00:00.005774 np0000001583 nova-compute[98241]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 02:00:00.005774 np0000001583 nova-compute[98241]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:00.005774 np0000001583 nova-compute[98241]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:00.005774 np0000001583 nova-compute[98241]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28fdb218-118a-4975-a70d-3ecafe7cfb12 (non-flash)
May 28 02:00:00.005774 np0000001583 nova-compute[98241]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:00.005774 np0000001583 nova-compute[98241]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:00.005774 np0000001583 nova-compute[98241]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:00.005774 np0000001583 nova-compute[98241]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:00.005774 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:00:00.005774 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.253s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:00:00.006356 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:00:00.007669 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] HCTL ('19', '-', '-', 0) found on session 88 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:00:00.007669 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:00:00.041501 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Searching for a device in session 88 and hctl ['19', '*', '*', 0] yield: None {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:00:00.092301 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:00:00.108161 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933600.1070192, 8b2a5f31-1b3d-447f-939e-94fd0be5eb85 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:00:00.108161 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] VM Resumed (Lifecycle Event)
May 28 02:00:00.364339 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e9a0099d-0910-4c1e-86fa-b732f87b1d9d req-7ebcef2d-31e6-41e6-b7f7-b5609da4ea6a service nova] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Received event network-changed-aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:00:00.364742 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e9a0099d-0910-4c1e-86fa-b732f87b1d9d req-7ebcef2d-31e6-41e6-b7f7-b5609da4ea6a service nova] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Refreshing instance network info cache due to event network-changed-aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:00:00.364973 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e9a0099d-0910-4c1e-86fa-b732f87b1d9d req-7ebcef2d-31e6-41e6-b7f7-b5609da4ea6a service nova] Acquiring lock "refresh_cache-e3e9a0d0-72cd-459e-8bc4-cf080adb5267" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:00:00.365028 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e9a0099d-0910-4c1e-86fa-b732f87b1d9d req-7ebcef2d-31e6-41e6-b7f7-b5609da4ea6a service nova] Acquired lock "refresh_cache-e3e9a0d0-72cd-459e-8bc4-cf080adb5267" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:00:00.365209 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-e9a0099d-0910-4c1e-86fa-b732f87b1d9d req-7ebcef2d-31e6-41e6-b7f7-b5609da4ea6a service nova] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Refreshing network info cache for port aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:00:00.558517 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:00.587303 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:00.613037 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:00:00.616685 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:00:00.690890 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:00.786103 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-44ca58ce-7241-488c-bcb0-339cddadabe0 req-eb9f6560-cb84-4034-a07c-45bf4927ce48 service nova] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Received event network-vif-plugged-0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:00:00.786103 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-44ca58ce-7241-488c-bcb0-339cddadabe0 req-eb9f6560-cb84-4034-a07c-45bf4927ce48 service nova] Acquiring lock "d4fad20b-d51e-47c9-8f55-3aa085a10891-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:00.786103 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-44ca58ce-7241-488c-bcb0-339cddadabe0 req-eb9f6560-cb84-4034-a07c-45bf4927ce48 service nova] Lock "d4fad20b-d51e-47c9-8f55-3aa085a10891-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:00.786103 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-44ca58ce-7241-488c-bcb0-339cddadabe0 req-eb9f6560-cb84-4034-a07c-45bf4927ce48 service nova] Lock "d4fad20b-d51e-47c9-8f55-3aa085a10891-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:00.786103 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-44ca58ce-7241-488c-bcb0-339cddadabe0 req-eb9f6560-cb84-4034-a07c-45bf4927ce48 service nova] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] No waiting events found dispatching network-vif-plugged-0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:00:00.786103 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-44ca58ce-7241-488c-bcb0-339cddadabe0 req-eb9f6560-cb84-4034-a07c-45bf4927ce48 service nova] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Received unexpected event network-vif-plugged-0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b for instance with vm_state stopped and task_state powering-on.
May 28 02:00:00.876389 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-e9a0099d-0910-4c1e-86fa-b732f87b1d9d req-7ebcef2d-31e6-41e6-b7f7-b5609da4ea6a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:00:00.963256 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-b446e918-22b8-42d8-8f65-c0ed109e7cbb tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:00:01.023453 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:01.026754 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:01.032015 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:01.037284 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:01.049879 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Searching for a device in session 88 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:00:01.051022 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f12a45d8-1f6d-4068-927e-408a86ee7e6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:00:01.064598 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:01.119845 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Removed pending STOPPED event for 27c37404-4df0-4ded-bf5b-6002e26d4222 due to new event <LifecycleEvent: 1779933601.119335, 27c37404-4df0-4ded-bf5b-6002e26d4222 => Resumed> {{(pid=98241) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 02:00:01.119987 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933601.119335, 27c37404-4df0-4ded-bf5b-6002e26d4222 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:00:01.120134 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] VM Resumed (Lifecycle Event)
May 28 02:00:01.261760 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-e9a0099d-0910-4c1e-86fa-b732f87b1d9d req-7ebcef2d-31e6-41e6-b7f7-b5609da4ea6a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:00:01.481504 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-e9a0099d-0910-4c1e-86fa-b732f87b1d9d req-7ebcef2d-31e6-41e6-b7f7-b5609da4ea6a service nova] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Updated VIF entry in instance network info cache for port aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:00:01.482014 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-e9a0099d-0910-4c1e-86fa-b732f87b1d9d req-7ebcef2d-31e6-41e6-b7f7-b5609da4ea6a service nova] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Updating instance_info_cache with network_info: [{"id": "aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8", "address": "fa:16:3e:df:45:21", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaec0d58f-da", "ovs_interfaceid": "aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:00:01.623572 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:00:01.629727 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:00:01.780395 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Found WWN 330000000519e27f4 for multipath device dm-7 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 02:00:01.780615 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.046s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:00:01.780883 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] <== connect_volume: return (3047ms) {'type': 'block', 'scsi_wwn': '330000000519e27f4', 'path': '/dev/dm-7', 'multipath_id': '330000000519e27f4'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:00:01.781118 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000519e27f4', 'path': '/dev/dm-7', 'multipath_id': '330000000519e27f4'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 02:00:01.988587 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e9a0099d-0910-4c1e-86fa-b732f87b1d9d req-7ebcef2d-31e6-41e6-b7f7-b5609da4ea6a service nova] Releasing lock "refresh_cache-e3e9a0d0-72cd-459e-8bc4-cf080adb5267" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:00:02.065523 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-24398016-ca67-4dbb-8c13-982ffa66fbb9 req-3e9a2f4d-41e3-4e08-91ca-bdb3ec773670 service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Received event network-vif-plugged-967dfb76-814b-43ba-ba2b-c14f407ff45e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:00:02.065523 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-24398016-ca67-4dbb-8c13-982ffa66fbb9 req-3e9a2f4d-41e3-4e08-91ca-bdb3ec773670 service nova] Acquiring lock "27c37404-4df0-4ded-bf5b-6002e26d4222-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:02.065523 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-24398016-ca67-4dbb-8c13-982ffa66fbb9 req-3e9a2f4d-41e3-4e08-91ca-bdb3ec773670 service nova] Lock "27c37404-4df0-4ded-bf5b-6002e26d4222-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:02.065523 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-24398016-ca67-4dbb-8c13-982ffa66fbb9 req-3e9a2f4d-41e3-4e08-91ca-bdb3ec773670 service nova] Lock "27c37404-4df0-4ded-bf5b-6002e26d4222-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:02.065523 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-24398016-ca67-4dbb-8c13-982ffa66fbb9 req-3e9a2f4d-41e3-4e08-91ca-bdb3ec773670 service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] No waiting events found dispatching network-vif-plugged-967dfb76-814b-43ba-ba2b-c14f407ff45e {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:00:02.065523 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-24398016-ca67-4dbb-8c13-982ffa66fbb9 req-3e9a2f4d-41e3-4e08-91ca-bdb3ec773670 service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Received unexpected event network-vif-plugged-967dfb76-814b-43ba-ba2b-c14f407ff45e for instance with vm_state rescued and task_state None.
May 28 02:00:02.136360 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933602.1349835, 27c37404-4df0-4ded-bf5b-6002e26d4222 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:00:02.136360 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] VM Started (Lifecycle Event)
May 28 02:00:02.154720 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Instance event wait completed in 0 seconds for  {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 02:00:02.160837 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Instance rebooted successfully.
May 28 02:00:02.231007 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "21c4e225-440e-4103-adaf-cb470d172291" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:02.231478 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "21c4e225-440e-4103-adaf-cb470d172291" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:02.292233 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:59:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-122348002',display_name='tempest-TestVolumeBootPattern-server-122348002',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testvolumebootpattern-server-122348002',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAAXSwkEIXS5PPxf3LnhrDvV1d+6UfjHy8aXnhsA4kJJX2FmeQvb3lEjUETHta29JzRPDevvLGSBNv16sMuL0GFa7gRKeRQiBCOB74vGY7LOBq7vL4B/fsS34ce5RE5NuA==',key_name='tempest-keypair-125840429',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='432aa1094ced436494def17a875aa8e1',ramdisk_id='',reservation_id='r-3bd3wvda',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1031057169',owner_user_name='tempest-TestVolumeBootPattern-1031057169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:59:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6be314b4eed642c3b2c72fe115860220',uuid=a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "062afddc-3d10-4dc2-a9d7-6024ed27c97a", "address": "fa:16:3e:ff:a6:88", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap062afddc-3d", "ovs_interfaceid": "062afddc-3d10-4dc2-a9d7-6024ed27c97a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 02:00:02.292601 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converting VIF {"id": "062afddc-3d10-4dc2-a9d7-6024ed27c97a", "address": "fa:16:3e:ff:a6:88", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap062afddc-3d", "ovs_interfaceid": "062afddc-3d10-4dc2-a9d7-6024ed27c97a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:00:02.293069 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:a6:88,bridge_name='br-int',has_traffic_filtering=True,id=062afddc-3d10-4dc2-a9d7-6024ed27c97a,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap062afddc-3d') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:00:02.294308 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lazy-loading 'pci_devices' on Instance uuid a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:00:02.444822 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-358612d9-e2f4-4474-8a70-b3179fded3cd req-ec586b3a-079b-4da3-97e2-4e68eb2067a1 service nova] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Received event network-changed-77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:00:02.446295 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-358612d9-e2f4-4474-8a70-b3179fded3cd req-ec586b3a-079b-4da3-97e2-4e68eb2067a1 service nova] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Refreshing instance network info cache due to event network-changed-77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:00:02.446295 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-358612d9-e2f4-4474-8a70-b3179fded3cd req-ec586b3a-079b-4da3-97e2-4e68eb2067a1 service nova] Acquiring lock "refresh_cache-8b2a5f31-1b3d-447f-939e-94fd0be5eb85" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:00:02.446295 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-358612d9-e2f4-4474-8a70-b3179fded3cd req-ec586b3a-079b-4da3-97e2-4e68eb2067a1 service nova] Acquired lock "refresh_cache-8b2a5f31-1b3d-447f-939e-94fd0be5eb85" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:00:02.446295 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-358612d9-e2f4-4474-8a70-b3179fded3cd req-ec586b3a-079b-4da3-97e2-4e68eb2067a1 service nova] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Refreshing network info cache for port 77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:00:02.641199 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:00:02.645412 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:00:02.697627 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-0cf9e6b7-bdea-4041-8fba-4cffd51cc05f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Unrescuing
May 28 02:00:02.697627 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0cf9e6b7-bdea-4041-8fba-4cffd51cc05f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquiring lock "refresh_cache-27c37404-4df0-4ded-bf5b-6002e26d4222" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:00:02.697627 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0cf9e6b7-bdea-4041-8fba-4cffd51cc05f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquired lock "refresh_cache-27c37404-4df0-4ded-bf5b-6002e26d4222" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:00:02.697627 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-0cf9e6b7-bdea-4041-8fba-4cffd51cc05f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:00:02.735303 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 02:00:02.800742 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] End _get_guest_xml xml=<domain type="qemu">
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:   <uuid>a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d</uuid>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:   <name>instance-00000029</name>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:   <metadata>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:       <nova:name>tempest-TestVolumeBootPattern-server-122348002</nova:name>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 01:59:58</nova:creationTime>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:       <nova:image uuid="">
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:       </nova:image>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:         <nova:user uuid="6be314b4eed642c3b2c72fe115860220">tempest-TestVolumeBootPattern-1031057169-project-member</nova:user>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:         <nova:project uuid="432aa1094ced436494def17a875aa8e1">tempest-TestVolumeBootPattern-1031057169</nova:project>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:       <nova:root type="volume" uuid=""/>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:         <nova:port uuid="062afddc-3d10-4dc2-a9d7-6024ed27c97a">
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:         </nova:port>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:   </metadata>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:     <system>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:       <entry name="serial">a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d</entry>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:       <entry name="uuid">a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d</entry>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:     </system>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:   <os>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:   </os>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:   <features>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:     <acpi/>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:     <tcg>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:     </tcg>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:   </features>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:   </cpu>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:   <devices>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d/disk.config"/>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:     </disk>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:     <disk type="block" device="disk">
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:       <alias name="ua-f12a45d8-1f6d-4068-927e-408a86ee7e6d"/>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:       <source dev="/dev/dm-7"/>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:       <serial>f12a45d8-1f6d-4068-927e-408a86ee7e6d</serial>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:     </disk>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:ff:a6:88"/>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:       <target dev="tap062afddc-3d"/>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:     </interface>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d/console.log" append="off"/>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:     </serial>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:     <video>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:     </video>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:     </rng>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:     </memballoon>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:   </devices>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]: </domain>
May 28 02:00:02.800742 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 02:00:02.804903 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Preparing to wait for external event network-vif-plugged-062afddc-3d10-4dc2-a9d7-6024ed27c97a {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 02:00:02.804903 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:02.804903 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:02.804903 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:02.804903 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:59:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-122348002',display_name='tempest-TestVolumeBootPattern-server-122348002',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testvolumebootpattern-server-122348002',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAAXSwkEIXS5PPxf3LnhrDvV1d+6UfjHy8aXnhsA4kJJX2FmeQvb3lEjUETHta29JzRPDevvLGSBNv16sMuL0GFa7gRKeRQiBCOB74vGY7LOBq7vL4B/fsS34ce5RE5NuA==',key_name='tempest-keypair-125840429',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='432aa1094ced436494def17a875aa8e1',ramdisk_id='',reservation_id='r-3bd3wvda',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1031057169',owner_user_name='tempest-TestVolumeBootPattern-1031057169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:59:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6be314b4eed642c3b2c72fe115860220',uuid=a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "062afddc-3d10-4dc2-a9d7-6024ed27c97a", "address": "fa:16:3e:ff:a6:88", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap062afddc-3d", "ovs_interfaceid": "062afddc-3d10-4dc2-a9d7-6024ed27c97a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 02:00:02.805277 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converting VIF {"id": "062afddc-3d10-4dc2-a9d7-6024ed27c97a", "address": "fa:16:3e:ff:a6:88", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap062afddc-3d", "ovs_interfaceid": "062afddc-3d10-4dc2-a9d7-6024ed27c97a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:00:02.806701 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:a6:88,bridge_name='br-int',has_traffic_filtering=True,id=062afddc-3d10-4dc2-a9d7-6024ed27c97a,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap062afddc-3d') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:00:02.806701 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:a6:88,bridge_name='br-int',has_traffic_filtering=True,id=062afddc-3d10-4dc2-a9d7-6024ed27c97a,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap062afddc-3d') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 02:00:02.807586 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:02.807813 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:00:02.808036 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 02:00:02.809695 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:02.810454 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e2070baa-2430-5471-9673-2bef28d15dd1', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:00:02.811350 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:02.812145 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:00:02.813971 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:02.815780 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:02.815985 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap062afddc-3d, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:00:02.816421 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap062afddc-3d, col_values=(('qos', UUID('2b9bc627-ee3c-4ce6-a6b0-55990cdae927')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:00:02.816747 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap062afddc-3d, col_values=(('external_ids', {'iface-id': '062afddc-3d10-4dc2-a9d7-6024ed27c97a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:a6:88', 'vm-uuid': 'a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:00:02.818381 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:02.821112 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:00:02.826500 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:02.829288 np0000001583 nova-compute[98241]: INFO os_vif [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:a6:88,bridge_name='br-int',has_traffic_filtering=True,id=062afddc-3d10-4dc2-a9d7-6024ed27c97a,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap062afddc-3d')
May 28 02:00:02.882336 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-591afb0a-e877-43ca-be72-d87d772b03b1 req-b3421e9c-c278-49e5-8ad6-c4e1d5047123 service nova] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Received event network-vif-plugged-0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:00:02.882500 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-591afb0a-e877-43ca-be72-d87d772b03b1 req-b3421e9c-c278-49e5-8ad6-c4e1d5047123 service nova] Acquiring lock "d4fad20b-d51e-47c9-8f55-3aa085a10891-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:02.882636 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-591afb0a-e877-43ca-be72-d87d772b03b1 req-b3421e9c-c278-49e5-8ad6-c4e1d5047123 service nova] Lock "d4fad20b-d51e-47c9-8f55-3aa085a10891-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:02.882755 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-591afb0a-e877-43ca-be72-d87d772b03b1 req-b3421e9c-c278-49e5-8ad6-c4e1d5047123 service nova] Lock "d4fad20b-d51e-47c9-8f55-3aa085a10891-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:02.882927 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-591afb0a-e877-43ca-be72-d87d772b03b1 req-b3421e9c-c278-49e5-8ad6-c4e1d5047123 service nova] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] No waiting events found dispatching network-vif-plugged-0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:00:02.883259 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-591afb0a-e877-43ca-be72-d87d772b03b1 req-b3421e9c-c278-49e5-8ad6-c4e1d5047123 service nova] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Received unexpected event network-vif-plugged-0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b for instance with vm_state stopped and task_state powering-on.
May 28 02:00:02.951303 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-358612d9-e2f4-4474-8a70-b3179fded3cd req-ec586b3a-079b-4da3-97e2-4e68eb2067a1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:00:03.149720 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 28 02:00:03.150099 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933603.14981, d4fad20b-d51e-47c9-8f55-3aa085a10891 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:00:03.150358 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] VM Resumed (Lifecycle Event)
May 28 02:00:03.193452 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:03.201240 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-0cf9e6b7-bdea-4041-8fba-4cffd51cc05f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:00:03.335967 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:03.335967 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:03.339549 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 02:00:03.339742 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Claim successful on node np0000001583
May 28 02:00:03.449713 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-358612d9-e2f4-4474-8a70-b3179fded3cd req-ec586b3a-079b-4da3-97e2-4e68eb2067a1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:00:03.657111 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:00:03.657111 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-358612d9-e2f4-4474-8a70-b3179fded3cd req-ec586b3a-079b-4da3-97e2-4e68eb2067a1 service nova] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Updated VIF entry in instance network info cache for port 77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:00:03.657111 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-358612d9-e2f4-4474-8a70-b3179fded3cd req-ec586b3a-079b-4da3-97e2-4e68eb2067a1 service nova] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Updating instance_info_cache with network_info: [{"id": "77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0", "address": "fa:16:3e:76:c5:3f", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77a0d5b8-3f", "ovs_interfaceid": "77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:00:03.662638 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:00:03.678643 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:00:03.678836 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:00:03.678995 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:00:03.679184 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] No VIF found with MAC fa:16:3e:ca:8c:e2, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:00:03.682744 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-22008170-7fc6-4442-aa46-a467579c0c59 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:00:03.693061 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-0cf9e6b7-bdea-4041-8fba-4cffd51cc05f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:00:03.870908 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-0cf9e6b7-bdea-4041-8fba-4cffd51cc05f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Updating instance_info_cache with network_info: [{"id": "967dfb76-814b-43ba-ba2b-c14f407ff45e", "address": "fa:16:3e:e8:00:1f", "network": {"id": "e1d5d073-f27b-4ff1-9ed3-99f57407c76f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f65617e71571457f8906997583100678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap967dfb76-81", "ovs_interfaceid": "967dfb76-814b-43ba-ba2b-c14f407ff45e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:00:04.164960 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-358612d9-e2f4-4474-8a70-b3179fded3cd req-ec586b3a-079b-4da3-97e2-4e68eb2067a1 service nova] Releasing lock "refresh_cache-8b2a5f31-1b3d-447f-939e-94fd0be5eb85" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:00:04.165607 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] During sync_power_state the instance has a pending task (powering-on). Skip.
May 28 02:00:04.165893 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933604.1656783, d4fad20b-d51e-47c9-8f55-3aa085a10891 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:00:04.166029 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] VM Started (Lifecycle Event)
May 28 02:00:04.362113 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:00:04.362113 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:00:04.362491 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] No VIF found with MAC fa:16:3e:ff:a6:88, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:00:04.364095 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Using config drive
May 28 02:00:04.373602 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0cf9e6b7-bdea-4041-8fba-4cffd51cc05f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Releasing lock "refresh_cache-27c37404-4df0-4ded-bf5b-6002e26d4222" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:00:04.374327 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-0cf9e6b7-bdea-4041-8fba-4cffd51cc05f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lazy-loading 'flavor' on Instance uuid 27c37404-4df0-4ded-bf5b-6002e26d4222 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:00:04.669296 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:00:04.672484 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:00:04.871647 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:00:04.914731 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:04.937149 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:05.111242 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Creating config drive at /opt/stack/data/nova/instances/a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d/disk.config
May 28 02:00:05.119249 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpn4q7ujgo {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:00:05.149393 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:05.158751 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9411a639-a5c3-4314-80f8-1ad3ffcd13f5 req-780034e4-b50e-4680-8aa3-54a45a9afe3b service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Received event network-vif-unplugged-967dfb76-814b-43ba-ba2b-c14f407ff45e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:00:05.158751 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9411a639-a5c3-4314-80f8-1ad3ffcd13f5 req-780034e4-b50e-4680-8aa3-54a45a9afe3b service nova] Acquiring lock "27c37404-4df0-4ded-bf5b-6002e26d4222-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:05.158751 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9411a639-a5c3-4314-80f8-1ad3ffcd13f5 req-780034e4-b50e-4680-8aa3-54a45a9afe3b service nova] Lock "27c37404-4df0-4ded-bf5b-6002e26d4222-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:05.158876 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9411a639-a5c3-4314-80f8-1ad3ffcd13f5 req-780034e4-b50e-4680-8aa3-54a45a9afe3b service nova] Lock "27c37404-4df0-4ded-bf5b-6002e26d4222-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:05.159040 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9411a639-a5c3-4314-80f8-1ad3ffcd13f5 req-780034e4-b50e-4680-8aa3-54a45a9afe3b service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] No waiting events found dispatching network-vif-unplugged-967dfb76-814b-43ba-ba2b-c14f407ff45e {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:00:05.159314 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-9411a639-a5c3-4314-80f8-1ad3ffcd13f5 req-780034e4-b50e-4680-8aa3-54a45a9afe3b service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Received unexpected event network-vif-unplugged-967dfb76-814b-43ba-ba2b-c14f407ff45e for instance with vm_state rescued and task_state unrescuing.
May 28 02:00:05.160870 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:05.200197 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpn4q7ujgo" returned: 0 in 0.082s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:00:05.224557 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:05.237258 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:00:05.237526 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:00:05.263500 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:05.271258 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:05.291525 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:05.375969 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999585454000226 future=<Future at 0x7724ec48d040 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:00:05.382554 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Instance destroyed successfully.
May 28 02:00:05.383674 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-0cf9e6b7-bdea-4041-8fba-4cffd51cc05f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lazy-loading 'numa_topology' on Instance uuid 27c37404-4df0-4ded-bf5b-6002e26d4222 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:00:05.405195 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:05.419108 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:05.614287 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:05.624813 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:05.743610 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:00:05.789320 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:05.841433 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:05.886590 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-0cf9e6b7-bdea-4041-8fba-4cffd51cc05f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Object Instance<27c37404-4df0-4ded-bf5b-6002e26d4222> lazy-loaded attributes: flavor,numa_topology {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 02:00:05.939379 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:06.137823 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0d8fb268-8dc1-439f-a2ca-481338a9a661 req-6b94c4c8-08be-4f3b-9531-a47e12aeb511 service nova] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Received event network-vif-plugged-062afddc-3d10-4dc2-a9d7-6024ed27c97a {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:00:06.139744 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0d8fb268-8dc1-439f-a2ca-481338a9a661 req-6b94c4c8-08be-4f3b-9531-a47e12aeb511 service nova] Acquiring lock "a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:06.140043 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0d8fb268-8dc1-439f-a2ca-481338a9a661 req-6b94c4c8-08be-4f3b-9531-a47e12aeb511 service nova] Lock "a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:06.140324 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0d8fb268-8dc1-439f-a2ca-481338a9a661 req-6b94c4c8-08be-4f3b-9531-a47e12aeb511 service nova] Lock "a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:06.140542 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0d8fb268-8dc1-439f-a2ca-481338a9a661 req-6b94c4c8-08be-4f3b-9531-a47e12aeb511 service nova] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Processing event network-vif-plugged-062afddc-3d10-4dc2-a9d7-6024ed27c97a {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 02:00:06.250534 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.916s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:06.252157 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 02:00:06.260942 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:06.270716 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:06.298356 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:06.301887 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:06.506338 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:06.544059 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:06.547702 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:06.641227 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:06.713558 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:06.772635 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 02:00:06.772635 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 02:00:06.772635 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:00:06.772635 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:00:06.877845 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cadb612e41314b06914d5f5f47570e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0474090f4f2d4950b51bc317f4302266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 02:00:07.238204 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-bc8ce9f9-6b64-4f92-aec7-cb0723af450a req-5d317ee6-4a43-47ba-b98f-65e48a099a70 service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Received event network-vif-unplugged-967dfb76-814b-43ba-ba2b-c14f407ff45e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:00:07.239451 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bc8ce9f9-6b64-4f92-aec7-cb0723af450a req-5d317ee6-4a43-47ba-b98f-65e48a099a70 service nova] Acquiring lock "27c37404-4df0-4ded-bf5b-6002e26d4222-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:07.239681 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bc8ce9f9-6b64-4f92-aec7-cb0723af450a req-5d317ee6-4a43-47ba-b98f-65e48a099a70 service nova] Lock "27c37404-4df0-4ded-bf5b-6002e26d4222-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:07.239860 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bc8ce9f9-6b64-4f92-aec7-cb0723af450a req-5d317ee6-4a43-47ba-b98f-65e48a099a70 service nova] Lock "27c37404-4df0-4ded-bf5b-6002e26d4222-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:07.240018 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-bc8ce9f9-6b64-4f92-aec7-cb0723af450a req-5d317ee6-4a43-47ba-b98f-65e48a099a70 service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] No waiting events found dispatching network-vif-unplugged-967dfb76-814b-43ba-ba2b-c14f407ff45e {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:00:07.240201 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-bc8ce9f9-6b64-4f92-aec7-cb0723af450a req-5d317ee6-4a43-47ba-b98f-65e48a099a70 service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Received unexpected event network-vif-unplugged-967dfb76-814b-43ba-ba2b-c14f407ff45e for instance with vm_state rescued and task_state unrescuing.
May 28 02:00:07.240512 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-bc8ce9f9-6b64-4f92-aec7-cb0723af450a req-5d317ee6-4a43-47ba-b98f-65e48a099a70 service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Received event network-vif-plugged-967dfb76-814b-43ba-ba2b-c14f407ff45e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:00:07.241619 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bc8ce9f9-6b64-4f92-aec7-cb0723af450a req-5d317ee6-4a43-47ba-b98f-65e48a099a70 service nova] Acquiring lock "27c37404-4df0-4ded-bf5b-6002e26d4222-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:07.241844 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bc8ce9f9-6b64-4f92-aec7-cb0723af450a req-5d317ee6-4a43-47ba-b98f-65e48a099a70 service nova] Lock "27c37404-4df0-4ded-bf5b-6002e26d4222-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:07.242011 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bc8ce9f9-6b64-4f92-aec7-cb0723af450a req-5d317ee6-4a43-47ba-b98f-65e48a099a70 service nova] Lock "27c37404-4df0-4ded-bf5b-6002e26d4222-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:07.242180 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-bc8ce9f9-6b64-4f92-aec7-cb0723af450a req-5d317ee6-4a43-47ba-b98f-65e48a099a70 service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] No waiting events found dispatching network-vif-plugged-967dfb76-814b-43ba-ba2b-c14f407ff45e {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:00:07.242301 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-bc8ce9f9-6b64-4f92-aec7-cb0723af450a req-5d317ee6-4a43-47ba-b98f-65e48a099a70 service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Received unexpected event network-vif-plugged-967dfb76-814b-43ba-ba2b-c14f407ff45e for instance with vm_state rescued and task_state unrescuing.
May 28 02:00:07.242432 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-bc8ce9f9-6b64-4f92-aec7-cb0723af450a req-5d317ee6-4a43-47ba-b98f-65e48a099a70 service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Received event network-vif-plugged-967dfb76-814b-43ba-ba2b-c14f407ff45e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:00:07.242596 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bc8ce9f9-6b64-4f92-aec7-cb0723af450a req-5d317ee6-4a43-47ba-b98f-65e48a099a70 service nova] Acquiring lock "27c37404-4df0-4ded-bf5b-6002e26d4222-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:07.242732 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bc8ce9f9-6b64-4f92-aec7-cb0723af450a req-5d317ee6-4a43-47ba-b98f-65e48a099a70 service nova] Lock "27c37404-4df0-4ded-bf5b-6002e26d4222-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:07.242859 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bc8ce9f9-6b64-4f92-aec7-cb0723af450a req-5d317ee6-4a43-47ba-b98f-65e48a099a70 service nova] Lock "27c37404-4df0-4ded-bf5b-6002e26d4222-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:07.242974 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-bc8ce9f9-6b64-4f92-aec7-cb0723af450a req-5d317ee6-4a43-47ba-b98f-65e48a099a70 service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] No waiting events found dispatching network-vif-plugged-967dfb76-814b-43ba-ba2b-c14f407ff45e {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:00:07.243105 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-bc8ce9f9-6b64-4f92-aec7-cb0723af450a req-5d317ee6-4a43-47ba-b98f-65e48a099a70 service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Received unexpected event network-vif-plugged-967dfb76-814b-43ba-ba2b-c14f407ff45e for instance with vm_state rescued and task_state unrescuing.
May 28 02:00:07.243361 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-bc8ce9f9-6b64-4f92-aec7-cb0723af450a req-5d317ee6-4a43-47ba-b98f-65e48a099a70 service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Received event network-vif-unplugged-967dfb76-814b-43ba-ba2b-c14f407ff45e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:00:07.243407 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bc8ce9f9-6b64-4f92-aec7-cb0723af450a req-5d317ee6-4a43-47ba-b98f-65e48a099a70 service nova] Acquiring lock "27c37404-4df0-4ded-bf5b-6002e26d4222-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:07.243538 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bc8ce9f9-6b64-4f92-aec7-cb0723af450a req-5d317ee6-4a43-47ba-b98f-65e48a099a70 service nova] Lock "27c37404-4df0-4ded-bf5b-6002e26d4222-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:07.243654 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bc8ce9f9-6b64-4f92-aec7-cb0723af450a req-5d317ee6-4a43-47ba-b98f-65e48a099a70 service nova] Lock "27c37404-4df0-4ded-bf5b-6002e26d4222-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:07.243804 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-bc8ce9f9-6b64-4f92-aec7-cb0723af450a req-5d317ee6-4a43-47ba-b98f-65e48a099a70 service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] No waiting events found dispatching network-vif-unplugged-967dfb76-814b-43ba-ba2b-c14f407ff45e {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:00:07.243977 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-bc8ce9f9-6b64-4f92-aec7-cb0723af450a req-5d317ee6-4a43-47ba-b98f-65e48a099a70 service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Received unexpected event network-vif-unplugged-967dfb76-814b-43ba-ba2b-c14f407ff45e for instance with vm_state rescued and task_state unrescuing.
May 28 02:00:07.244025 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-bc8ce9f9-6b64-4f92-aec7-cb0723af450a req-5d317ee6-4a43-47ba-b98f-65e48a099a70 service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Received event network-vif-unplugged-967dfb76-814b-43ba-ba2b-c14f407ff45e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:00:07.244283 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bc8ce9f9-6b64-4f92-aec7-cb0723af450a req-5d317ee6-4a43-47ba-b98f-65e48a099a70 service nova] Acquiring lock "27c37404-4df0-4ded-bf5b-6002e26d4222-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:07.244283 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bc8ce9f9-6b64-4f92-aec7-cb0723af450a req-5d317ee6-4a43-47ba-b98f-65e48a099a70 service nova] Lock "27c37404-4df0-4ded-bf5b-6002e26d4222-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:07.244401 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bc8ce9f9-6b64-4f92-aec7-cb0723af450a req-5d317ee6-4a43-47ba-b98f-65e48a099a70 service nova] Lock "27c37404-4df0-4ded-bf5b-6002e26d4222-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:07.244574 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-bc8ce9f9-6b64-4f92-aec7-cb0723af450a req-5d317ee6-4a43-47ba-b98f-65e48a099a70 service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] No waiting events found dispatching network-vif-unplugged-967dfb76-814b-43ba-ba2b-c14f407ff45e {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:00:07.244640 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-bc8ce9f9-6b64-4f92-aec7-cb0723af450a req-5d317ee6-4a43-47ba-b98f-65e48a099a70 service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Received unexpected event network-vif-unplugged-967dfb76-814b-43ba-ba2b-c14f407ff45e for instance with vm_state rescued and task_state unrescuing.
May 28 02:00:07.244796 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-bc8ce9f9-6b64-4f92-aec7-cb0723af450a req-5d317ee6-4a43-47ba-b98f-65e48a099a70 service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Received event network-vif-plugged-967dfb76-814b-43ba-ba2b-c14f407ff45e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:00:07.244932 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bc8ce9f9-6b64-4f92-aec7-cb0723af450a req-5d317ee6-4a43-47ba-b98f-65e48a099a70 service nova] Acquiring lock "27c37404-4df0-4ded-bf5b-6002e26d4222-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:07.245060 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bc8ce9f9-6b64-4f92-aec7-cb0723af450a req-5d317ee6-4a43-47ba-b98f-65e48a099a70 service nova] Lock "27c37404-4df0-4ded-bf5b-6002e26d4222-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:07.249851 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bc8ce9f9-6b64-4f92-aec7-cb0723af450a req-5d317ee6-4a43-47ba-b98f-65e48a099a70 service nova] Lock "27c37404-4df0-4ded-bf5b-6002e26d4222-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:07.250040 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-bc8ce9f9-6b64-4f92-aec7-cb0723af450a req-5d317ee6-4a43-47ba-b98f-65e48a099a70 service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] No waiting events found dispatching network-vif-plugged-967dfb76-814b-43ba-ba2b-c14f407ff45e {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:00:07.252104 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-bc8ce9f9-6b64-4f92-aec7-cb0723af450a req-5d317ee6-4a43-47ba-b98f-65e48a099a70 service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Received unexpected event network-vif-plugged-967dfb76-814b-43ba-ba2b-c14f407ff45e for instance with vm_state rescued and task_state unrescuing.
May 28 02:00:07.252104 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-bc8ce9f9-6b64-4f92-aec7-cb0723af450a req-5d317ee6-4a43-47ba-b98f-65e48a099a70 service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Received event network-vif-plugged-967dfb76-814b-43ba-ba2b-c14f407ff45e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:00:07.252104 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bc8ce9f9-6b64-4f92-aec7-cb0723af450a req-5d317ee6-4a43-47ba-b98f-65e48a099a70 service nova] Acquiring lock "27c37404-4df0-4ded-bf5b-6002e26d4222-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:07.252104 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bc8ce9f9-6b64-4f92-aec7-cb0723af450a req-5d317ee6-4a43-47ba-b98f-65e48a099a70 service nova] Lock "27c37404-4df0-4ded-bf5b-6002e26d4222-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:07.252303 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bc8ce9f9-6b64-4f92-aec7-cb0723af450a req-5d317ee6-4a43-47ba-b98f-65e48a099a70 service nova] Lock "27c37404-4df0-4ded-bf5b-6002e26d4222-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:07.252373 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-bc8ce9f9-6b64-4f92-aec7-cb0723af450a req-5d317ee6-4a43-47ba-b98f-65e48a099a70 service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] No waiting events found dispatching network-vif-plugged-967dfb76-814b-43ba-ba2b-c14f407ff45e {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:00:07.255277 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-bc8ce9f9-6b64-4f92-aec7-cb0723af450a req-5d317ee6-4a43-47ba-b98f-65e48a099a70 service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Received unexpected event network-vif-plugged-967dfb76-814b-43ba-ba2b-c14f407ff45e for instance with vm_state rescued and task_state unrescuing.
May 28 02:00:07.276829 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 02:00:07.393572 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933607.3931038, a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:00:07.394847 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 02:00:07.395362 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] VM Started (Lifecycle Event)
May 28 02:00:07.404125 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 02:00:07.408188 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Instance spawned successfully.
May 28 02:00:07.409898 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 02:00:07.558515 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0005011520001971803 future=<Future at 0x7724ec2d3350 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:00:07.558692 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:00:07.558873 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=12.816617067000152 future=<Future at 0x7724ec48d040 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:00:07.558998 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=12.816480282000157 future=<Future at 0x7724ec48d040 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:00:07.596193 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-0cf9e6b7-bdea-4041-8fba-4cffd51cc05f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:00:07.691113 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Successfully created port: 5e52242f-77f4-41cc-ae8f-6a4772243727 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 02:00:07.787968 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 02:00:07.818487 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:07.908771 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:00:07.915008 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:00:07.933640 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:00:07.937179 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:00:07.937179 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:00:07.937179 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:00:07.937179 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:00:07.937179 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:00:08.198919 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:08.259752 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0dde9ded-1b8c-43db-ad3a-c0a3d10552ae req-0e04c36d-a462-4a41-ba07-7fff358924cf service nova] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Received event network-vif-plugged-062afddc-3d10-4dc2-a9d7-6024ed27c97a {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:00:08.259752 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0dde9ded-1b8c-43db-ad3a-c0a3d10552ae req-0e04c36d-a462-4a41-ba07-7fff358924cf service nova] Acquiring lock "a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:08.259752 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0dde9ded-1b8c-43db-ad3a-c0a3d10552ae req-0e04c36d-a462-4a41-ba07-7fff358924cf service nova] Lock "a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:08.260893 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0dde9ded-1b8c-43db-ad3a-c0a3d10552ae req-0e04c36d-a462-4a41-ba07-7fff358924cf service nova] Lock "a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:08.260893 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0dde9ded-1b8c-43db-ad3a-c0a3d10552ae req-0e04c36d-a462-4a41-ba07-7fff358924cf service nova] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] No waiting events found dispatching network-vif-plugged-062afddc-3d10-4dc2-a9d7-6024ed27c97a {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:00:08.260893 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-0dde9ded-1b8c-43db-ad3a-c0a3d10552ae req-0e04c36d-a462-4a41-ba07-7fff358924cf service nova] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Received unexpected event network-vif-plugged-062afddc-3d10-4dc2-a9d7-6024ed27c97a for instance with vm_state building and task_state spawning.
May 28 02:00:08.418611 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 02:00:08.420276 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933608.4198604, a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:00:08.420788 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] VM Paused (Lifecycle Event)
May 28 02:00:08.447415 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Took 10.20 seconds to spawn the instance on the hypervisor.
May 28 02:00:08.447969 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:00:08.512957 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Successfully updated port: 5e52242f-77f4-41cc-ae8f-6a4772243727 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 02:00:08.587003 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f93a738f-98ac-43c6-992f-c8f7a37f39df req-473d4134-d9d3-43ba-a28f-1dd1cedb7724 service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Received event network-changed-5e52242f-77f4-41cc-ae8f-6a4772243727 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:00:08.587180 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f93a738f-98ac-43c6-992f-c8f7a37f39df req-473d4134-d9d3-43ba-a28f-1dd1cedb7724 service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Refreshing instance network info cache due to event network-changed-5e52242f-77f4-41cc-ae8f-6a4772243727. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:00:08.587522 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f93a738f-98ac-43c6-992f-c8f7a37f39df req-473d4134-d9d3-43ba-a28f-1dd1cedb7724 service nova] Acquiring lock "refresh_cache-21c4e225-440e-4103-adaf-cb470d172291" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:00:08.587822 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f93a738f-98ac-43c6-992f-c8f7a37f39df req-473d4134-d9d3-43ba-a28f-1dd1cedb7724 service nova] Acquired lock "refresh_cache-21c4e225-440e-4103-adaf-cb470d172291" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:00:08.587822 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-f93a738f-98ac-43c6-992f-c8f7a37f39df req-473d4134-d9d3-43ba-a28f-1dd1cedb7724 service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Refreshing network info cache for port 5e52242f-77f4-41cc-ae8f-6a4772243727 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:00:08.813571 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 02:00:08.815373 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 02:00:08.815373 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Creating image(s)
May 28 02:00:08.816659 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "/opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:08.816659 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "/opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:08.816878 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "/opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:08.819116 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:00:08.822841 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:00:08.828806 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:00:08.926818 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:00:08.934733 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933608.9341335, a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:00:08.934987 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] VM Resumed (Lifecycle Event)
May 28 02:00:08.956488 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.128s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:00:08.957629 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:08.958136 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:08.958531 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:00:08.964958 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:00:08.969942 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:00:09.005035 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Took 17.54 seconds to build instance.
May 28 02:00:09.021367 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "refresh_cache-21c4e225-440e-4103-adaf-cb470d172291" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:00:09.093690 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-f93a738f-98ac-43c6-992f-c8f7a37f39df req-473d4134-d9d3-43ba-a28f-1dd1cedb7724 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:00:09.109132 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.138s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:00:09.109132 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:00:09.182384 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/disk 1073741824" returned: 0 in 0.073s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:00:09.182956 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:09.183751 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:00:09.259265 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-f93a738f-98ac-43c6-992f-c8f7a37f39df req-473d4134-d9d3-43ba-a28f-1dd1cedb7724 service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:00:09.296347 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.112s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:00:09.297287 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Checking if we can resize image /opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 02:00:09.297287 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:00:09.429107 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:00:09.431718 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Cannot resize image /opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 02:00:09.432117 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 02:00:09.432313 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Ensure instance console log exists: /opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 02:00:09.432885 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:09.433154 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:09.433302 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:09.440381 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:00:09.447038 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:00:09.499101 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-f93a738f-98ac-43c6-992f-c8f7a37f39df req-473d4134-d9d3-43ba-a28f-1dd1cedb7724 service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:00:09.510433 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.057s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:09.857346 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2122c3a0-e8b4-4cd9-94b7-332693f51ca4 req-a59ea8a9-6ad8-4ac2-bd32-e6b8d0f1dc12 service nova] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Received event network-changed-062afddc-3d10-4dc2-a9d7-6024ed27c97a {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:00:09.857891 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2122c3a0-e8b4-4cd9-94b7-332693f51ca4 req-a59ea8a9-6ad8-4ac2-bd32-e6b8d0f1dc12 service nova] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Refreshing instance network info cache due to event network-changed-062afddc-3d10-4dc2-a9d7-6024ed27c97a. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:00:09.858123 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2122c3a0-e8b4-4cd9-94b7-332693f51ca4 req-a59ea8a9-6ad8-4ac2-bd32-e6b8d0f1dc12 service nova] Acquiring lock "refresh_cache-a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:00:09.858206 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2122c3a0-e8b4-4cd9-94b7-332693f51ca4 req-a59ea8a9-6ad8-4ac2-bd32-e6b8d0f1dc12 service nova] Acquired lock "refresh_cache-a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:00:09.858569 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-2122c3a0-e8b4-4cd9-94b7-332693f51ca4 req-a59ea8a9-6ad8-4ac2-bd32-e6b8d0f1dc12 service nova] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Refreshing network info cache for port 062afddc-3d10-4dc2-a9d7-6024ed27c97a {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:00:09.951719 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Removed pending STOPPED event for 27c37404-4df0-4ded-bf5b-6002e26d4222 due to new event <LifecycleEvent: 1779933609.9511793, 27c37404-4df0-4ded-bf5b-6002e26d4222 => Resumed> {{(pid=98241) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 02:00:09.954856 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933609.9511793, 27c37404-4df0-4ded-bf5b-6002e26d4222 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:00:09.954856 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] VM Resumed (Lifecycle Event)
May 28 02:00:10.001361 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f93a738f-98ac-43c6-992f-c8f7a37f39df req-473d4134-d9d3-43ba-a28f-1dd1cedb7724 service nova] Releasing lock "refresh_cache-21c4e225-440e-4103-adaf-cb470d172291" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:00:10.002509 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquired lock "refresh_cache-21c4e225-440e-4103-adaf-cb470d172291" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:00:10.002744 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:00:10.318699 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0877ddd7-6a2e-4e4a-a0ad-acbd4ff5a24d req-d35cbe2b-44f5-44ff-953f-22f693d2765d service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Received event network-changed-967dfb76-814b-43ba-ba2b-c14f407ff45e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:00:10.318699 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0877ddd7-6a2e-4e4a-a0ad-acbd4ff5a24d req-d35cbe2b-44f5-44ff-953f-22f693d2765d service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Refreshing instance network info cache due to event network-changed-967dfb76-814b-43ba-ba2b-c14f407ff45e. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:00:10.318699 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0877ddd7-6a2e-4e4a-a0ad-acbd4ff5a24d req-d35cbe2b-44f5-44ff-953f-22f693d2765d service nova] Acquiring lock "refresh_cache-27c37404-4df0-4ded-bf5b-6002e26d4222" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:00:10.318699 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0877ddd7-6a2e-4e4a-a0ad-acbd4ff5a24d req-d35cbe2b-44f5-44ff-953f-22f693d2765d service nova] Acquired lock "refresh_cache-27c37404-4df0-4ded-bf5b-6002e26d4222" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:00:10.318699 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-0877ddd7-6a2e-4e4a-a0ad-acbd4ff5a24d req-d35cbe2b-44f5-44ff-953f-22f693d2765d service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Refreshing network info cache for port 967dfb76-814b-43ba-ba2b-c14f407ff45e {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:00:10.360766 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-2122c3a0-e8b4-4cd9-94b7-332693f51ca4 req-a59ea8a9-6ad8-4ac2-bd32-e6b8d0f1dc12 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:00:10.456272 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:00:10.462398 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:00:10.580021 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:00:10.736890 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-2122c3a0-e8b4-4cd9-94b7-332693f51ca4 req-a59ea8a9-6ad8-4ac2-bd32-e6b8d0f1dc12 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:00:10.800633 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:00:10.821433 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-0877ddd7-6a2e-4e4a-a0ad-acbd4ff5a24d req-d35cbe2b-44f5-44ff-953f-22f693d2765d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:00:10.933240 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-2122c3a0-e8b4-4cd9-94b7-332693f51ca4 req-a59ea8a9-6ad8-4ac2-bd32-e6b8d0f1dc12 service nova] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Updated VIF entry in instance network info cache for port 062afddc-3d10-4dc2-a9d7-6024ed27c97a. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:00:10.933766 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-2122c3a0-e8b4-4cd9-94b7-332693f51ca4 req-a59ea8a9-6ad8-4ac2-bd32-e6b8d0f1dc12 service nova] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Updating instance_info_cache with network_info: [{"id": "062afddc-3d10-4dc2-a9d7-6024ed27c97a", "address": "fa:16:3e:ff:a6:88", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap062afddc-3d", "ovs_interfaceid": "062afddc-3d10-4dc2-a9d7-6024ed27c97a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:00:10.965994 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933610.9656284, 27c37404-4df0-4ded-bf5b-6002e26d4222 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:00:10.968482 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] VM Started (Lifecycle Event)
May 28 02:00:11.029261 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Updating instance_info_cache with network_info: [{"id": "5e52242f-77f4-41cc-ae8f-6a4772243727", "address": "fa:16:3e:57:95:02", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e52242f-77", "ovs_interfaceid": "5e52242f-77f4-41cc-ae8f-6a4772243727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:00:11.293010 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-0877ddd7-6a2e-4e4a-a0ad-acbd4ff5a24d req-d35cbe2b-44f5-44ff-953f-22f693d2765d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:00:11.435522 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2122c3a0-e8b4-4cd9-94b7-332693f51ca4 req-a59ea8a9-6ad8-4ac2-bd32-e6b8d0f1dc12 service nova] Releasing lock "refresh_cache-a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:00:11.473026 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-0877ddd7-6a2e-4e4a-a0ad-acbd4ff5a24d req-d35cbe2b-44f5-44ff-953f-22f693d2765d service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Updated VIF entry in instance network info cache for port 967dfb76-814b-43ba-ba2b-c14f407ff45e. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:00:11.476557 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-0877ddd7-6a2e-4e4a-a0ad-acbd4ff5a24d req-d35cbe2b-44f5-44ff-953f-22f693d2765d service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Updating instance_info_cache with network_info: [{"id": "967dfb76-814b-43ba-ba2b-c14f407ff45e", "address": "fa:16:3e:e8:00:1f", "network": {"id": "e1d5d073-f27b-4ff1-9ed3-99f57407c76f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f65617e71571457f8906997583100678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap967dfb76-81", "ovs_interfaceid": "967dfb76-814b-43ba-ba2b-c14f407ff45e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:00:11.479980 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:00:11.488684 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:00:11.532016 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Releasing lock "refresh_cache-21c4e225-440e-4103-adaf-cb470d172291" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:00:11.532016 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Instance network_info: |[{"id": "5e52242f-77f4-41cc-ae8f-6a4772243727", "address": "fa:16:3e:57:95:02", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e52242f-77", "ovs_interfaceid": "5e52242f-77f4-41cc-ae8f-6a4772243727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 02:00:11.534538 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Start _get_guest_xml network_info=[{"id": "5e52242f-77f4-41cc-ae8f-6a4772243727", "address": "fa:16:3e:57:95:02", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e52242f-77", "ovs_interfaceid": "5e52242f-77f4-41cc-ae8f-6a4772243727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 02:00:11.537850 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:00:11.539215 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='21c4e225-440e-4103-adaf-cb470d172291'), owner=OwnerMeta(userid='cadb612e41314b06914d5f5f47570e98', username='tempest-AttachVolumeMultiAttachTest-857456921-project-member', projectid='0474090f4f2d4950b51bc317f4302266', projectname='tempest-AttachVolumeMultiAttachTest-857456921'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5e52242f-77f4-41cc-ae8f-6a4772243727", "address": "fa:16:3e:57:95:02", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e52242f-77", "ovs_interfaceid": "5e52242f-77f4-41cc-ae8f-6a4772243727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933611.5387902) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 02:00:11.540379 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 02:00:11.540800 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 02:00:11.541779 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 02:00:11.541977 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 02:00:11.543103 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 02:00:11.543409 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 02:00:11.543665 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 02:00:11.543665 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 02:00:11.543822 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 02:00:11.543859 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 02:00:11.543941 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 02:00:11.544092 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 02:00:11.544233 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 02:00:11.544289 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 02:00:11.544374 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 02:00:11.544545 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 02:00:11.556291 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:00:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='multiattach-server-1',id=42,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAP7CI9wuY8JR5OGc0CpqFzQg3rj7cqVgHC4sPYHH38XlmtTRa9WHg3S3WcIsSpd43tWEYYLHF1/yDpoSsozR5Hrjk+cgmLbTDwUHC3YheiC8VnlV/ymBtBFe0b8oxSz5w==',key_name='tempest-keypair-1713929294',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0474090f4f2d4950b51bc317f4302266',ramdisk_id='',reservation_id='r-wetp7mrk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-857456921',owner_user_name='tempest-AttachVolumeMultiAttachTest-857456921-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:00:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cadb612e41314b06914d5f5f47570e98',uuid=21c4e225-440e-4103-adaf-cb470d172291,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e52242f-77f4-41cc-ae8f-6a4772243727", "address": "fa:16:3e:57:95:02", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e52242f-77", "ovs_interfaceid": "5e52242f-77f4-41cc-ae8f-6a4772243727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 02:00:11.556291 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Converting VIF {"id": "5e52242f-77f4-41cc-ae8f-6a4772243727", "address": "fa:16:3e:57:95:02", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e52242f-77", "ovs_interfaceid": "5e52242f-77f4-41cc-ae8f-6a4772243727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:00:11.557162 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:95:02,bridge_name='br-int',has_traffic_filtering=True,id=5e52242f-77f4-41cc-ae8f-6a4772243727,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e52242f-77') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:00:11.557887 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lazy-loading 'pci_devices' on Instance uuid 21c4e225-440e-4103-adaf-cb470d172291 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:00:11.980408 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0877ddd7-6a2e-4e4a-a0ad-acbd4ff5a24d req-d35cbe2b-44f5-44ff-953f-22f693d2765d service nova] Releasing lock "refresh_cache-27c37404-4df0-4ded-bf5b-6002e26d4222" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:00:11.981012 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0877ddd7-6a2e-4e4a-a0ad-acbd4ff5a24d req-d35cbe2b-44f5-44ff-953f-22f693d2765d service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Received event network-changed-967dfb76-814b-43ba-ba2b-c14f407ff45e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:00:11.981012 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0877ddd7-6a2e-4e4a-a0ad-acbd4ff5a24d req-d35cbe2b-44f5-44ff-953f-22f693d2765d service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Refreshing instance network info cache due to event network-changed-967dfb76-814b-43ba-ba2b-c14f407ff45e. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:00:11.981012 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0877ddd7-6a2e-4e4a-a0ad-acbd4ff5a24d req-d35cbe2b-44f5-44ff-953f-22f693d2765d service nova] Acquiring lock "refresh_cache-27c37404-4df0-4ded-bf5b-6002e26d4222" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:00:11.981012 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0877ddd7-6a2e-4e4a-a0ad-acbd4ff5a24d req-d35cbe2b-44f5-44ff-953f-22f693d2765d service nova] Acquired lock "refresh_cache-27c37404-4df0-4ded-bf5b-6002e26d4222" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:00:11.981309 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-0877ddd7-6a2e-4e4a-a0ad-acbd4ff5a24d req-d35cbe2b-44f5-44ff-953f-22f693d2765d service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Refreshing network info cache for port 967dfb76-814b-43ba-ba2b-c14f407ff45e {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:00:12.061180 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] End _get_guest_xml xml=<domain type="qemu">
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:   <uuid>21c4e225-440e-4103-adaf-cb470d172291</uuid>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:   <name>instance-0000002a</name>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:   <metadata>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:       <nova:name>multiattach-server-1</nova:name>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 02:00:11</nova:creationTime>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:       </nova:image>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:         <nova:user uuid="cadb612e41314b06914d5f5f47570e98">tempest-AttachVolumeMultiAttachTest-857456921-project-member</nova:user>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:         <nova:project uuid="0474090f4f2d4950b51bc317f4302266">tempest-AttachVolumeMultiAttachTest-857456921</nova:project>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:         <nova:port uuid="5e52242f-77f4-41cc-ae8f-6a4772243727">
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:         </nova:port>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:   </metadata>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:     <system>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:       <entry name="serial">21c4e225-440e-4103-adaf-cb470d172291</entry>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:       <entry name="uuid">21c4e225-440e-4103-adaf-cb470d172291</entry>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:     </system>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:   <os>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:   </os>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:   <features>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:     <acpi/>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:     <tcg>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:     </tcg>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:   </features>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:   </cpu>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:   <devices>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/disk"/>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:     </disk>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/disk.config"/>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:     </disk>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:57:95:02"/>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:       <target dev="tap5e52242f-77"/>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:     </interface>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/console.log" append="off"/>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:     </serial>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:     <video>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:     </video>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:     </rng>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:     </memballoon>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:   </devices>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]: </domain>
May 28 02:00:12.061180 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 02:00:12.064089 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Preparing to wait for external event network-vif-plugged-5e52242f-77f4-41cc-ae8f-6a4772243727 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 02:00:12.064089 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "21c4e225-440e-4103-adaf-cb470d172291-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:12.064089 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "21c4e225-440e-4103-adaf-cb470d172291-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:12.064089 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "21c4e225-440e-4103-adaf-cb470d172291-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:12.064089 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:00:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='multiattach-server-1',id=42,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAP7CI9wuY8JR5OGc0CpqFzQg3rj7cqVgHC4sPYHH38XlmtTRa9WHg3S3WcIsSpd43tWEYYLHF1/yDpoSsozR5Hrjk+cgmLbTDwUHC3YheiC8VnlV/ymBtBFe0b8oxSz5w==',key_name='tempest-keypair-1713929294',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0474090f4f2d4950b51bc317f4302266',ramdisk_id='',reservation_id='r-wetp7mrk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-857456921',owner_user_name='tempest-AttachVolumeMultiAttachTest-857456921-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:00:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cadb612e41314b06914d5f5f47570e98',uuid=21c4e225-440e-4103-adaf-cb470d172291,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e52242f-77f4-41cc-ae8f-6a4772243727", "address": "fa:16:3e:57:95:02", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e52242f-77", "ovs_interfaceid": "5e52242f-77f4-41cc-ae8f-6a4772243727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 02:00:12.064089 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Converting VIF {"id": "5e52242f-77f4-41cc-ae8f-6a4772243727", "address": "fa:16:3e:57:95:02", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e52242f-77", "ovs_interfaceid": "5e52242f-77f4-41cc-ae8f-6a4772243727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:00:12.065110 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:95:02,bridge_name='br-int',has_traffic_filtering=True,id=5e52242f-77f4-41cc-ae8f-6a4772243727,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e52242f-77') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:00:12.065576 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:95:02,bridge_name='br-int',has_traffic_filtering=True,id=5e52242f-77f4-41cc-ae8f-6a4772243727,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e52242f-77') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 02:00:12.066133 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:12.066447 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:00:12.066804 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 02:00:12.068022 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:12.068223 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cc43ad20-0ae2-5f84-aeda-cacd8116967e', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:00:12.069167 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:12.072050 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:00:12.072050 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:12.075569 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:12.075820 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e52242f-77, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:00:12.076305 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5e52242f-77, col_values=(('qos', UUID('b7d6b383-a28e-49ca-83a3-3a1f48d705e6')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:00:12.076553 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5e52242f-77, col_values=(('external_ids', {'iface-id': '5e52242f-77f4-41cc-ae8f-6a4772243727', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:95:02', 'vm-uuid': '21c4e225-440e-4103-adaf-cb470d172291'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:00:12.079265 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:12.080945 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:00:12.087199 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:12.088505 np0000001583 nova-compute[98241]: INFO os_vif [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:95:02,bridge_name='br-int',has_traffic_filtering=True,id=5e52242f-77f4-41cc-ae8f-6a4772243727,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e52242f-77')
May 28 02:00:12.483270 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-0877ddd7-6a2e-4e4a-a0ad-acbd4ff5a24d req-d35cbe2b-44f5-44ff-953f-22f693d2765d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:00:12.843502 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-0877ddd7-6a2e-4e4a-a0ad-acbd4ff5a24d req-d35cbe2b-44f5-44ff-953f-22f693d2765d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:00:13.007251 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-0877ddd7-6a2e-4e4a-a0ad-acbd4ff5a24d req-d35cbe2b-44f5-44ff-953f-22f693d2765d service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Updated VIF entry in instance network info cache for port 967dfb76-814b-43ba-ba2b-c14f407ff45e. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:00:13.007251 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-0877ddd7-6a2e-4e4a-a0ad-acbd4ff5a24d req-d35cbe2b-44f5-44ff-953f-22f693d2765d service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Updating instance_info_cache with network_info: [{"id": "967dfb76-814b-43ba-ba2b-c14f407ff45e", "address": "fa:16:3e:e8:00:1f", "network": {"id": "e1d5d073-f27b-4ff1-9ed3-99f57407c76f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f65617e71571457f8906997583100678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap967dfb76-81", "ovs_interfaceid": "967dfb76-814b-43ba-ba2b-c14f407ff45e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:00:13.101135 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9572d2da-d653-4e69-bf10-16182474c41d tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Acquiring lock "63688346-f8e2-4fbe-987d-bf55df9fa3a4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:13.101135 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9572d2da-d653-4e69-bf10-16182474c41d tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "63688346-f8e2-4fbe-987d-bf55df9fa3a4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:13.199741 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:13.509560 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0877ddd7-6a2e-4e4a-a0ad-acbd4ff5a24d req-d35cbe2b-44f5-44ff-953f-22f693d2765d service nova] Releasing lock "refresh_cache-27c37404-4df0-4ded-bf5b-6002e26d4222" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:00:13.602004 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-9572d2da-d653-4e69-bf10-16182474c41d tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Detaching volume eb978e57-12a6-44b0-8770-f1a5a2411c21
May 28 02:00:13.609169 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:00:13.609674 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:00:13.609812 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] No VIF found with MAC fa:16:3e:57:95:02, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:00:13.610397 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Using config drive
May 28 02:00:13.655886 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-9572d2da-d653-4e69-bf10-16182474c41d tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Attempting to driver detach volume eb978e57-12a6-44b0-8770-f1a5a2411c21 from mountpoint /dev/vdb
May 28 02:00:13.666320 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9572d2da-d653-4e69-bf10-16182474c41d tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Found disk vdb by alias ua-eb978e57-12a6-44b0-8770-f1a5a2411c21 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:00:13.667947 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9572d2da-d653-4e69-bf10-16182474c41d tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Found disk vdb by alias ua-eb978e57-12a6-44b0-8770-f1a5a2411c21 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:00:13.667947 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9572d2da-d653-4e69-bf10-16182474c41d tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Attempting to detach device vdb from instance 63688346-f8e2-4fbe-987d-bf55df9fa3a4 from the persistent domain config. {{(pid=98241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 02:00:13.670187 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-9572d2da-d653-4e69-bf10-16182474c41d tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:00:13.670187 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:00:13.670187 np0000001583 nova-compute[98241]:   <alias name="ua-eb978e57-12a6-44b0-8770-f1a5a2411c21"/>
May 28 02:00:13.670187 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-4"/>
May 28 02:00:13.670187 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:00:13.670187 np0000001583 nova-compute[98241]:   <serial>eb978e57-12a6-44b0-8770-f1a5a2411c21</serial>
May 28 02:00:13.670187 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 02:00:13.670187 np0000001583 nova-compute[98241]: </disk>
May 28 02:00:13.670187 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:00:13.678226 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-9572d2da-d653-4e69-bf10-16182474c41d tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Successfully detached device vdb from instance 63688346-f8e2-4fbe-987d-bf55df9fa3a4 from the persistent domain config.
May 28 02:00:13.678461 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9572d2da-d653-4e69-bf10-16182474c41d tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] (1/8): Attempting to detach device vdb with device alias ua-eb978e57-12a6-44b0-8770-f1a5a2411c21 from instance 63688346-f8e2-4fbe-987d-bf55df9fa3a4 from the live domain config. {{(pid=98241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 02:00:13.678822 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-9572d2da-d653-4e69-bf10-16182474c41d tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:00:13.678822 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:00:13.678822 np0000001583 nova-compute[98241]:   <alias name="ua-eb978e57-12a6-44b0-8770-f1a5a2411c21"/>
May 28 02:00:13.678822 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-4"/>
May 28 02:00:13.678822 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:00:13.678822 np0000001583 nova-compute[98241]:   <serial>eb978e57-12a6-44b0-8770-f1a5a2411c21</serial>
May 28 02:00:13.678822 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 02:00:13.678822 np0000001583 nova-compute[98241]: </disk>
May 28 02:00:13.678822 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:00:14.118106 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:00:14.232594 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Received event <DeviceRemovedEvent: 1779933614.2321377, 63688346-f8e2-4fbe-987d-bf55df9fa3a4 => ua-eb978e57-12a6-44b0-8770-f1a5a2411c21> from libvirt while the driver is waiting for it; dispatched. {{(pid=98241) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 02:00:14.236634 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9572d2da-d653-4e69-bf10-16182474c41d tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-eb978e57-12a6-44b0-8770-f1a5a2411c21 for instance 63688346-f8e2-4fbe-987d-bf55df9fa3a4 {{(pid=98241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 02:00:14.240043 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-9572d2da-d653-4e69-bf10-16182474c41d tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Successfully detached device vdb from instance 63688346-f8e2-4fbe-987d-bf55df9fa3a4 from the live domain config.
May 28 02:00:14.241275 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9572d2da-d653-4e69-bf10-16182474c41d tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:00:14.241532 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9572d2da-d653-4e69-bf10-16182474c41d tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21', 'iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'eb978e57-12a6-44b0-8770-f1a5a2411c21', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:00:14.241675 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-9572d2da-d653-4e69-bf10-16182474c41d tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:00:14.242230 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-9572d2da-d653-4e69-bf10-16182474c41d tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:00:14.242547 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9572d2da-d653-4e69-bf10-16182474c41d tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21', 'iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'eb978e57-12a6-44b0-8770-f1a5a2411c21', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:00:14.242698 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9572d2da-d653-4e69-bf10-16182474c41d tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:00:14.284497 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Creating config drive at /opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/disk.config
May 28 02:00:14.284497 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9572d2da-d653-4e69-bf10-16182474c41d tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:14.284497 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:14.284497 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:14.284497 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:14.284497 np0000001583 nova-compute[98241]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 02:00:14.284497 np0000001583 nova-compute[98241]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 02:00:14.284497 np0000001583 nova-compute[98241]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:14.284497 np0000001583 nova-compute[98241]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:14.284497 np0000001583 nova-compute[98241]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:14.284497 np0000001583 nova-compute[98241]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:14.284497 np0000001583 nova-compute[98241]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:14.284497 np0000001583 nova-compute[98241]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:14.284497 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:00:14.284497 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9572d2da-d653-4e69-bf10-16182474c41d tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:14.284497 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:14.284497 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:14.284497 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:14.284497 np0000001583 nova-compute[98241]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 02:00:14.284497 np0000001583 nova-compute[98241]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21 (non-flash)
May 28 02:00:14.284497 np0000001583 nova-compute[98241]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:14.284497 np0000001583 nova-compute[98241]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:14.284497 np0000001583 nova-compute[98241]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:14.284497 np0000001583 nova-compute[98241]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:14.284497 np0000001583 nova-compute[98241]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:14.284497 np0000001583 nova-compute[98241]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:14.284497 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:00:14.285121 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9572d2da-d653-4e69-bf10-16182474c41d tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', '68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', '69'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376', '78'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376', '79'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21', '80'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21', '81'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', '82'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', '83'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57', '85'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57', '86'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d', '87'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d', '88')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:00:14.285121 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9572d2da-d653-4e69-bf10-16182474c41d tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21', '80')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:00:14.287236 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9572d2da-d653-4e69-bf10-16182474c41d tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21', '81')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:00:14.290040 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9572d2da-d653-4e69-bf10-16182474c41d tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f90b94e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21'): ({'sdi'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:00:14.290644 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-9572d2da-d653-4e69-bf10-16182474c41d tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Removing multipathed devices sdh, sdi {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:00:14.291014 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-9572d2da-d653-4e69-bf10-16182474c41d tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Flush multipath device 330000000317bc286 {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:00:14.293476 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpphvrrowl {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:00:14.328757 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-9572d2da-d653-4e69-bf10-16182474c41d tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:00:14.352031 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpphvrrowl" returned: 0 in 0.059s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:00:14.381401 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-9572d2da-d653-4e69-bf10-16182474c41d tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:00:14.427224 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-9572d2da-d653-4e69-bf10-16182474c41d tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:00:14.427224 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-9572d2da-d653-4e69-bf10-16182474c41d tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:00:14.428788 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-9572d2da-d653-4e69-bf10-16182474c41d tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:00:14.445836 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-9572d2da-d653-4e69-bf10-16182474c41d tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:00:14.446234 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9572d2da-d653-4e69-bf10-16182474c41d tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:00:14.461886 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9572d2da-d653-4e69-bf10-16182474c41d tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:14.501131 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9572d2da-d653-4e69-bf10-16182474c41d tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 80, target: iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21, portal: 192.168.40.100,3260]
May 28 02:00:14.501131 np0000001583 nova-compute[98241]: Logout of [sid: 80, target: iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21, portal: 192.168.40.100,3260] successful.
May 28 02:00:14.501131 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:14.527692 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9572d2da-d653-4e69-bf10-16182474c41d tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:14.547106 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9572d2da-d653-4e69-bf10-16182474c41d tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:14.588492 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9572d2da-d653-4e69-bf10-16182474c41d tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 81, target: iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21, portal: 192.168.50.100,3260]
May 28 02:00:14.588492 np0000001583 nova-compute[98241]: Logout of [sid: 81, target: iqn.2023-03.storpool.com:os--volume-eb978e57-12a6-44b0-8770-f1a5a2411c21, portal: 192.168.50.100,3260] successful.
May 28 02:00:14.588492 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:14.629112 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9572d2da-d653-4e69-bf10-16182474c41d tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:14.629112 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-9572d2da-d653-4e69-bf10-16182474c41d tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:00:14.629112 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9572d2da-d653-4e69-bf10-16182474c41d tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] <== disconnect_volume: return (385ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:00:14.629112 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9572d2da-d653-4e69-bf10-16182474c41d tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:00:14.916263 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:14.945215 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:14.950350 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:15.011681 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:00:15.011963 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:00:15.044336 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:15.129044 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:15.132804 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:15.198248 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-13faebf8-cbe1-4af0-88cd-18bc4d58001c req-8fb9ef08-7092-43a8-b535-d06a8ba0b6c2 service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Received event network-vif-plugged-5e52242f-77f4-41cc-ae8f-6a4772243727 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:00:15.198248 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-13faebf8-cbe1-4af0-88cd-18bc4d58001c req-8fb9ef08-7092-43a8-b535-d06a8ba0b6c2 service nova] Acquiring lock "21c4e225-440e-4103-adaf-cb470d172291-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:15.198248 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-13faebf8-cbe1-4af0-88cd-18bc4d58001c req-8fb9ef08-7092-43a8-b535-d06a8ba0b6c2 service nova] Lock "21c4e225-440e-4103-adaf-cb470d172291-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:15.198248 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-13faebf8-cbe1-4af0-88cd-18bc4d58001c req-8fb9ef08-7092-43a8-b535-d06a8ba0b6c2 service nova] Lock "21c4e225-440e-4103-adaf-cb470d172291-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:15.198572 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-13faebf8-cbe1-4af0-88cd-18bc4d58001c req-8fb9ef08-7092-43a8-b535-d06a8ba0b6c2 service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Processing event network-vif-plugged-5e52242f-77f4-41cc-ae8f-6a4772243727 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 02:00:15.202426 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-9572d2da-d653-4e69-bf10-16182474c41d tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lazy-loading 'flavor' on Instance uuid 63688346-f8e2-4fbe-987d-bf55df9fa3a4 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:00:15.522011 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Triggering sync for uuid 659c56a6-743a-45e2-aa21-7d45c672f094 {{(pid=98241) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 02:00:15.522820 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Triggering sync for uuid 0d87a47f-2eb6-4e25-b44a-848fe2225962 {{(pid=98241) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 02:00:15.524433 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "659c56a6-743a-45e2-aa21-7d45c672f094" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:15.524433 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "659c56a6-743a-45e2-aa21-7d45c672f094" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:15.524709 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Triggering sync for uuid e50227a8-b484-447b-abc6-3a3c1379e7ff {{(pid=98241) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 02:00:15.525125 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "0d87a47f-2eb6-4e25-b44a-848fe2225962" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:15.525454 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "0d87a47f-2eb6-4e25-b44a-848fe2225962" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:15.525910 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Triggering sync for uuid 22bbb8cf-c11d-4025-8551-4c1c3557264a {{(pid=98241) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 02:00:15.526838 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "e50227a8-b484-447b-abc6-3a3c1379e7ff" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:15.527014 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "e50227a8-b484-447b-abc6-3a3c1379e7ff" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:15.527327 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Triggering sync for uuid d4fad20b-d51e-47c9-8f55-3aa085a10891 {{(pid=98241) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 02:00:15.527847 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "22bbb8cf-c11d-4025-8551-4c1c3557264a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:15.530255 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Triggering sync for uuid 27c37404-4df0-4ded-bf5b-6002e26d4222 {{(pid=98241) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 02:00:15.532165 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "22bbb8cf-c11d-4025-8551-4c1c3557264a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:15.533146 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "d4fad20b-d51e-47c9-8f55-3aa085a10891" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:15.538863 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Triggering sync for uuid 63688346-f8e2-4fbe-987d-bf55df9fa3a4 {{(pid=98241) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 02:00:15.539595 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "d4fad20b-d51e-47c9-8f55-3aa085a10891" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.007s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:15.541814 np0000001583 nova-compute[98241]: WARNING nova.utils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] The unknown pool does not have free threads so the task <function ComputeManager._sync_power_states.<locals>._sync at 0x7724ec25eb60> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
May 28 02:00:15.541814 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Triggering sync for uuid 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d {{(pid=98241) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 02:00:15.541814 np0000001583 nova-compute[98241]: WARNING nova.utils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] The unknown pool does not have free threads so the task <function ComputeManager._sync_power_states.<locals>._sync at 0x7724ec25eb60> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
May 28 02:00:15.541814 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Triggering sync for uuid e3e9a0d0-72cd-459e-8bc4-cf080adb5267 {{(pid=98241) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 02:00:15.541814 np0000001583 nova-compute[98241]: WARNING nova.utils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] The unknown pool does not have free threads so the task <function ComputeManager._sync_power_states.<locals>._sync at 0x7724ec25eb60> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
May 28 02:00:15.541814 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Triggering sync for uuid d203e779-f827-4964-a8a9-368a89aab0e2 {{(pid=98241) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 02:00:15.541814 np0000001583 nova-compute[98241]: WARNING nova.utils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] The unknown pool does not have free threads so the task <function ComputeManager._sync_power_states.<locals>._sync at 0x7724ec25eb60> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
May 28 02:00:15.541814 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Triggering sync for uuid 8b2a5f31-1b3d-447f-939e-94fd0be5eb85 {{(pid=98241) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 02:00:15.541814 np0000001583 nova-compute[98241]: WARNING nova.utils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] The unknown pool does not have free threads so the task <function ComputeManager._sync_power_states.<locals>._sync at 0x7724ec25eb60> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
May 28 02:00:15.541814 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Triggering sync for uuid a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d {{(pid=98241) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 02:00:15.541814 np0000001583 nova-compute[98241]: WARNING nova.utils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] The unknown pool does not have free threads so the task <function ComputeManager._sync_power_states.<locals>._sync at 0x7724ec25eb60> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
May 28 02:00:15.541814 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Triggering sync for uuid 21c4e225-440e-4103-adaf-cb470d172291 {{(pid=98241) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 02:00:15.544397 np0000001583 nova-compute[98241]: WARNING nova.utils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] The unknown pool does not have free threads so the task <function ComputeManager._sync_power_states.<locals>._sync at 0x7724ec25eb60> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
May 28 02:00:15.546478 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.18 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:00:15.728374 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:00:15.728792 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.46 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:00:15.836293 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 02:00:15.836293 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933615.8352504, 21c4e225-440e-4103-adaf-cb470d172291 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:00:15.836293 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 21c4e225-440e-4103-adaf-cb470d172291] VM Started (Lifecycle Event)
May 28 02:00:15.840029 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 02:00:15.844288 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Instance spawned successfully.
May 28 02:00:15.844842 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 02:00:16.030613 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "659c56a6-743a-45e2-aa21-7d45c672f094" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.506s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:16.030877 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "27c37404-4df0-4ded-bf5b-6002e26d4222" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:16.031030 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "27c37404-4df0-4ded-bf5b-6002e26d4222" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:16.038157 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "0d87a47f-2eb6-4e25-b44a-848fe2225962" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.513s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:16.038524 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "63688346-f8e2-4fbe-987d-bf55df9fa3a4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:16.039890 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "e50227a8-b484-447b-abc6-3a3c1379e7ff" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.513s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:16.039890 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:16.040072 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:16.048338 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "22bbb8cf-c11d-4025-8551-4c1c3557264a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.518s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:16.048632 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "e3e9a0d0-72cd-459e-8bc4-cf080adb5267" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:16.048828 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "e3e9a0d0-72cd-459e-8bc4-cf080adb5267" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:16.050525 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "d4fad20b-d51e-47c9-8f55-3aa085a10891" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.513s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:16.052333 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "d203e779-f827-4964-a8a9-368a89aab0e2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:16.052333 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "d203e779-f827-4964-a8a9-368a89aab0e2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:16.209301 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9572d2da-d653-4e69-bf10-16182474c41d tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "63688346-f8e2-4fbe-987d-bf55df9fa3a4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.111s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:16.210219 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "63688346-f8e2-4fbe-987d-bf55df9fa3a4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.172s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:16.338505 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:00:16.341753 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:00:16.352758 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:00:16.354543 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:00:16.354543 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:00:16.354543 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:00:16.354543 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:00:16.354857 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:00:16.386339 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-47c1b77a-6bb9-4964-a56d-65a79259ee66 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Acquiring lock "63688346-f8e2-4fbe-987d-bf55df9fa3a4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:16.536798 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "27c37404-4df0-4ded-bf5b-6002e26d4222" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.505s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:16.538047 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "8b2a5f31-1b3d-447f-939e-94fd0be5eb85" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:16.538047 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "8b2a5f31-1b3d-447f-939e-94fd0be5eb85" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:16.544513 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.504s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:16.546572 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:16.546572 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:16.555679 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "e3e9a0d0-72cd-459e-8bc4-cf080adb5267" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.507s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:16.556316 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "21c4e225-440e-4103-adaf-cb470d172291" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:16.558742 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "d203e779-f827-4964-a8a9-368a89aab0e2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.506s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:16.717757 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] During sync_power_state the instance has a pending task (deleting). Skip.
May 28 02:00:16.717974 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "63688346-f8e2-4fbe-987d-bf55df9fa3a4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.508s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:16.718527 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-47c1b77a-6bb9-4964-a56d-65a79259ee66 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "63688346-f8e2-4fbe-987d-bf55df9fa3a4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.332s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:16.718910 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-47c1b77a-6bb9-4964-a56d-65a79259ee66 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Acquiring lock "63688346-f8e2-4fbe-987d-bf55df9fa3a4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:16.719205 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-47c1b77a-6bb9-4964-a56d-65a79259ee66 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "63688346-f8e2-4fbe-987d-bf55df9fa3a4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:16.719359 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-47c1b77a-6bb9-4964-a56d-65a79259ee66 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "63688346-f8e2-4fbe-987d-bf55df9fa3a4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:16.723824 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-47c1b77a-6bb9-4964-a56d-65a79259ee66 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Terminating instance
May 28 02:00:16.845026 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 21c4e225-440e-4103-adaf-cb470d172291] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 02:00:16.845304 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933616.8450978, 21c4e225-440e-4103-adaf-cb470d172291 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:00:16.845417 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 21c4e225-440e-4103-adaf-cb470d172291] VM Paused (Lifecycle Event)
May 28 02:00:16.864204 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Took 8.05 seconds to spawn the instance on the hypervisor.
May 28 02:00:16.865195 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:00:17.043697 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "8b2a5f31-1b3d-447f-939e-94fd0be5eb85" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.506s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:17.050545 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.505s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:17.079633 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:17.228918 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-47c1b77a-6bb9-4964-a56d-65a79259ee66 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 02:00:17.259438 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:17.276342 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:17.287509 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:17.305417 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a3fa7fbf-625b-4962-8f5a-1f9695cf91de req-a8b9abd6-e0d8-46d2-85cb-55aa5d8de100 service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Received event network-vif-plugged-5e52242f-77f4-41cc-ae8f-6a4772243727 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:00:17.306114 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a3fa7fbf-625b-4962-8f5a-1f9695cf91de req-a8b9abd6-e0d8-46d2-85cb-55aa5d8de100 service nova] Acquiring lock "21c4e225-440e-4103-adaf-cb470d172291-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:17.306114 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a3fa7fbf-625b-4962-8f5a-1f9695cf91de req-a8b9abd6-e0d8-46d2-85cb-55aa5d8de100 service nova] Lock "21c4e225-440e-4103-adaf-cb470d172291-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:17.306531 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a3fa7fbf-625b-4962-8f5a-1f9695cf91de req-a8b9abd6-e0d8-46d2-85cb-55aa5d8de100 service nova] Lock "21c4e225-440e-4103-adaf-cb470d172291-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:17.306531 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a3fa7fbf-625b-4962-8f5a-1f9695cf91de req-a8b9abd6-e0d8-46d2-85cb-55aa5d8de100 service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] No waiting events found dispatching network-vif-plugged-5e52242f-77f4-41cc-ae8f-6a4772243727 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:00:17.306531 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-a3fa7fbf-625b-4962-8f5a-1f9695cf91de req-a8b9abd6-e0d8-46d2-85cb-55aa5d8de100 service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Received unexpected event network-vif-plugged-5e52242f-77f4-41cc-ae8f-6a4772243727 for instance with vm_state active and task_state None.
May 28 02:00:17.317061 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:17.348068 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:00:17.355496 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933617.3550587, 21c4e225-440e-4103-adaf-cb470d172291 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:00:17.355722 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 21c4e225-440e-4103-adaf-cb470d172291] VM Resumed (Lifecycle Event)
May 28 02:00:17.378086 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Took 14.13 seconds to build instance.
May 28 02:00:17.559899 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-6052ef49-f4c5-4793-b8ff-352d91dab467 req-165f3bba-877e-445c-a478-3c6744af2627 service nova] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Received event network-vif-unplugged-def344c1-e586-48f0-ad54-d24138b95457 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:00:17.560147 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-6052ef49-f4c5-4793-b8ff-352d91dab467 req-165f3bba-877e-445c-a478-3c6744af2627 service nova] Acquiring lock "63688346-f8e2-4fbe-987d-bf55df9fa3a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:17.560498 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-6052ef49-f4c5-4793-b8ff-352d91dab467 req-165f3bba-877e-445c-a478-3c6744af2627 service nova] Lock "63688346-f8e2-4fbe-987d-bf55df9fa3a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:17.560498 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-6052ef49-f4c5-4793-b8ff-352d91dab467 req-165f3bba-877e-445c-a478-3c6744af2627 service nova] Lock "63688346-f8e2-4fbe-987d-bf55df9fa3a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:17.560498 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-6052ef49-f4c5-4793-b8ff-352d91dab467 req-165f3bba-877e-445c-a478-3c6744af2627 service nova] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] No waiting events found dispatching network-vif-unplugged-def344c1-e586-48f0-ad54-d24138b95457 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:00:17.560681 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-6052ef49-f4c5-4793-b8ff-352d91dab467 req-165f3bba-877e-445c-a478-3c6744af2627 service nova] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Received event network-vif-unplugged-def344c1-e586-48f0-ad54-d24138b95457 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:00:17.592036 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Instance destroyed successfully.
May 28 02:00:17.592036 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-47c1b77a-6bb9-4964-a56d-65a79259ee66 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lazy-loading 'resources' on Instance uuid 63688346-f8e2-4fbe-987d-bf55df9fa3a4 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:00:17.859589 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:00:17.863213 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:00:17.880251 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "21c4e225-440e-4103-adaf-cb470d172291" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.649s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:17.881295 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "21c4e225-440e-4103-adaf-cb470d172291" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.325s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:17.881510 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] [instance: 21c4e225-440e-4103-adaf-cb470d172291] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 02:00:17.881679 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "21c4e225-440e-4103-adaf-cb470d172291" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:18.093720 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-47c1b77a-6bb9-4964-a56d-65a79259ee66 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:58:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-1564007949',display_name='tempest-VolumesBackupsTest-instance-1564007949',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-volumesbackupstest-instance-1564007949',id=36,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjJ7j/eklYN41DgZ8gspcgJf6GlmggO5dAw1zVrzlzslErHgX8xTvKj/UHRW9SOcfUnDtJ+G8on/nS9Z1naHaKkmNif+4Sb1CcMANP9N37O0T/rJg6c0cJUTEFMGn4GiA==',key_name='tempest-keypair-550377710',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:59:02Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae04c11a3de34d419d69e1fdf4c7d311',ramdisk_id='',reservation_id='r-30min8hn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesBackupsTest-759555243',owner_user_name='tempest-VolumesBackupsTest-759555243-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:59:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1a32813f26c4bb28a681856ad1e9019',uuid=63688346-f8e2-4fbe-987d-bf55df9fa3a4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "def344c1-e586-48f0-ad54-d24138b95457", "address": "fa:16:3e:24:bb:c4", "network": {"id": "e8c2820e-c0c4-4756-9e11-38375b138d97", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-50364578-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ae04c11a3de34d419d69e1fdf4c7d311", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdef344c1-e5", "ovs_interfaceid": "def344c1-e586-48f0-ad54-d24138b95457", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:00:18.093962 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-47c1b77a-6bb9-4964-a56d-65a79259ee66 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Converting VIF {"id": "def344c1-e586-48f0-ad54-d24138b95457", "address": "fa:16:3e:24:bb:c4", "network": {"id": "e8c2820e-c0c4-4756-9e11-38375b138d97", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-50364578-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ae04c11a3de34d419d69e1fdf4c7d311", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdef344c1-e5", "ovs_interfaceid": "def344c1-e586-48f0-ad54-d24138b95457", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:00:18.094840 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-47c1b77a-6bb9-4964-a56d-65a79259ee66 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:bb:c4,bridge_name='br-int',has_traffic_filtering=True,id=def344c1-e586-48f0-ad54-d24138b95457,network=Network(e8c2820e-c0c4-4756-9e11-38375b138d97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdef344c1-e5') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:00:18.095227 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-47c1b77a-6bb9-4964-a56d-65a79259ee66 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:bb:c4,bridge_name='br-int',has_traffic_filtering=True,id=def344c1-e586-48f0-ad54-d24138b95457,network=Network(e8c2820e-c0c4-4756-9e11-38375b138d97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdef344c1-e5') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:00:18.098174 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:18.098511 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdef344c1-e5, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:00:18.102002 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:18.103910 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:18.104382 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=29fb942b-6ec6-410c-b7ee-575ca4361042) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:00:18.106329 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:00:18.108629 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:18.111918 np0000001583 nova-compute[98241]: INFO os_vif [None req-47c1b77a-6bb9-4964-a56d-65a79259ee66 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:bb:c4,bridge_name='br-int',has_traffic_filtering=True,id=def344c1-e586-48f0-ad54-d24138b95457,network=Network(e8c2820e-c0c4-4756-9e11-38375b138d97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdef344c1-e5')
May 28 02:00:18.113015 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-47c1b77a-6bb9-4964-a56d-65a79259ee66 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Deleting instance files /opt/stack/data/nova/instances/63688346-f8e2-4fbe-987d-bf55df9fa3a4_del
May 28 02:00:18.113015 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-47c1b77a-6bb9-4964-a56d-65a79259ee66 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Deletion of /opt/stack/data/nova/instances/63688346-f8e2-4fbe-987d-bf55df9fa3a4_del complete
May 28 02:00:18.189378 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:00:18.190755 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:00:18.193368 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:00:18.195400 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:00:18.195617 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:00:18.195737 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 02:00:18.196233 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:00:18.205048 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:18.247372 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "d203e779-f827-4964-a8a9-368a89aab0e2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:18.247775 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "d203e779-f827-4964-a8a9-368a89aab0e2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:18.369505 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.99968964100026 future=<Future at 0x7724ec4cffe0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:00:18.546275 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e2046ad4-0b92-4a33-81ea-d0baafd8ca89 req-bec251c9-f344-4bf8-9097-1cc245238110 service nova] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Received event network-changed-77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:00:18.546716 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e2046ad4-0b92-4a33-81ea-d0baafd8ca89 req-bec251c9-f344-4bf8-9097-1cc245238110 service nova] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Refreshing instance network info cache due to event network-changed-77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:00:18.546941 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e2046ad4-0b92-4a33-81ea-d0baafd8ca89 req-bec251c9-f344-4bf8-9097-1cc245238110 service nova] Acquiring lock "refresh_cache-8b2a5f31-1b3d-447f-939e-94fd0be5eb85" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:00:18.547104 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e2046ad4-0b92-4a33-81ea-d0baafd8ca89 req-bec251c9-f344-4bf8-9097-1cc245238110 service nova] Acquired lock "refresh_cache-8b2a5f31-1b3d-447f-939e-94fd0be5eb85" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:00:18.547433 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-e2046ad4-0b92-4a33-81ea-d0baafd8ca89 req-bec251c9-f344-4bf8-9097-1cc245238110 service nova] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Refreshing network info cache for port 77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:00:18.621658 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-47c1b77a-6bb9-4964-a56d-65a79259ee66 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Took 1.39 seconds to destroy the instance on the hypervisor.
May 28 02:00:18.622437 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-47c1b77a-6bb9-4964-a56d-65a79259ee66 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 02:00:18.622637 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 02:00:18.622764 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 02:00:18.623071 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:00:18.708641 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:18.709212 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:18.709212 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:18.709429 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Auditing locally available compute resources for np0000001583 (node: np0000001583) {{(pid=98241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 02:00:18.718228 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:00:18.751718 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lazy-loading 'flavor' on Instance uuid d203e779-f827-4964-a8a9-368a89aab0e2 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:00:19.050876 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-e2046ad4-0b92-4a33-81ea-d0baafd8ca89 req-bec251c9-f344-4bf8-9097-1cc245238110 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:00:19.433701 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-e2046ad4-0b92-4a33-81ea-d0baafd8ca89 req-bec251c9-f344-4bf8-9097-1cc245238110 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:00:19.579295 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-e2046ad4-0b92-4a33-81ea-d0baafd8ca89 req-bec251c9-f344-4bf8-9097-1cc245238110 service nova] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Updated VIF entry in instance network info cache for port 77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:00:19.579295 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-e2046ad4-0b92-4a33-81ea-d0baafd8ca89 req-bec251c9-f344-4bf8-9097-1cc245238110 service nova] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Updating instance_info_cache with network_info: [{"id": "77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0", "address": "fa:16:3e:76:c5:3f", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77a0d5b8-3f", "ovs_interfaceid": "77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:00:19.658264 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b5f0dee7-b8c7-47b8-842f-1680ad983755 req-9a41c83e-a66e-4301-923a-d58091a6ec60 service nova] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Received event network-vif-unplugged-def344c1-e586-48f0-ad54-d24138b95457 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:00:19.658864 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b5f0dee7-b8c7-47b8-842f-1680ad983755 req-9a41c83e-a66e-4301-923a-d58091a6ec60 service nova] Acquiring lock "63688346-f8e2-4fbe-987d-bf55df9fa3a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:19.659056 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b5f0dee7-b8c7-47b8-842f-1680ad983755 req-9a41c83e-a66e-4301-923a-d58091a6ec60 service nova] Lock "63688346-f8e2-4fbe-987d-bf55df9fa3a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:19.659213 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b5f0dee7-b8c7-47b8-842f-1680ad983755 req-9a41c83e-a66e-4301-923a-d58091a6ec60 service nova] Lock "63688346-f8e2-4fbe-987d-bf55df9fa3a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:19.659331 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b5f0dee7-b8c7-47b8-842f-1680ad983755 req-9a41c83e-a66e-4301-923a-d58091a6ec60 service nova] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] No waiting events found dispatching network-vif-unplugged-def344c1-e586-48f0-ad54-d24138b95457 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:00:19.659442 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b5f0dee7-b8c7-47b8-842f-1680ad983755 req-9a41c83e-a66e-4301-923a-d58091a6ec60 service nova] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Received event network-vif-unplugged-def344c1-e586-48f0-ad54-d24138b95457 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:00:19.761714 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "d203e779-f827-4964-a8a9-368a89aab0e2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.514s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:19.762210 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:00:19.776006 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:00:19.884548 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:00:19.885359 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:00:19.998770 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:00:20.004154 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e9a0d0-72cd-459e-8bc4-cf080adb5267/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:00:20.080277 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e2046ad4-0b92-4a33-81ea-d0baafd8ca89 req-bec251c9-f344-4bf8-9097-1cc245238110 service nova] Releasing lock "refresh_cache-8b2a5f31-1b3d-447f-939e-94fd0be5eb85" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:00:20.104363 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e9a0d0-72cd-459e-8bc4-cf080adb5267/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:00:20.104992 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e9a0d0-72cd-459e-8bc4-cf080adb5267/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:00:20.196545 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e9a0d0-72cd-459e-8bc4-cf080adb5267/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:00:20.200406 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bbb8cf-c11d-4025-8551-4c1c3557264a/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:00:20.268719 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Took 1.64 seconds to deallocate network for instance.
May 28 02:00:20.301571 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bbb8cf-c11d-4025-8551-4c1c3557264a/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:00:20.302088 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bbb8cf-c11d-4025-8551-4c1c3557264a/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:00:20.376100 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0005591699996330135 future=<Future at 0x7724ec48d040 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:00:20.376252 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:00:20.376425 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=12.992634325000381 future=<Future at 0x7724ec4cffe0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:00:20.376534 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=12.992516552000325 future=<Future at 0x7724ec4cffe0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:00:20.381891 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "8b2a5f31-1b3d-447f-939e-94fd0be5eb85" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:20.382170 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "8b2a5f31-1b3d-447f-939e-94fd0be5eb85" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:20.420032 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bbb8cf-c11d-4025-8551-4c1c3557264a/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:00:20.424609 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:00:20.522538 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:00:20.523811 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:00:20.619947 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:00:20.620453 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/dm-6 (vdb) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 02:00:20.626301 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-64b9d7d5-ebef-47aa-85ae-cfebd3eaf076 req-600b7618-244a-4e60-b5e3-b7b24a73bae4 service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Received event network-changed-5e52242f-77f4-41cc-ae8f-6a4772243727 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:00:20.627112 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-64b9d7d5-ebef-47aa-85ae-cfebd3eaf076 req-600b7618-244a-4e60-b5e3-b7b24a73bae4 service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Refreshing instance network info cache due to event network-changed-5e52242f-77f4-41cc-ae8f-6a4772243727. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:00:20.628537 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-64b9d7d5-ebef-47aa-85ae-cfebd3eaf076 req-600b7618-244a-4e60-b5e3-b7b24a73bae4 service nova] Acquiring lock "refresh_cache-21c4e225-440e-4103-adaf-cb470d172291" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:00:20.628939 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d203e779-f827-4964-a8a9-368a89aab0e2/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:00:20.629415 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-64b9d7d5-ebef-47aa-85ae-cfebd3eaf076 req-600b7618-244a-4e60-b5e3-b7b24a73bae4 service nova] Acquired lock "refresh_cache-21c4e225-440e-4103-adaf-cb470d172291" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:00:20.629644 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-64b9d7d5-ebef-47aa-85ae-cfebd3eaf076 req-600b7618-244a-4e60-b5e3-b7b24a73bae4 service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Refreshing network info cache for port 5e52242f-77f4-41cc-ae8f-6a4772243727 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:00:20.732563 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d203e779-f827-4964-a8a9-368a89aab0e2/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:00:20.733731 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d203e779-f827-4964-a8a9-368a89aab0e2/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:00:20.779049 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-47c1b77a-6bb9-4964-a56d-65a79259ee66 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:20.779445 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-47c1b77a-6bb9-4964-a56d-65a79259ee66 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:20.829968 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d203e779-f827-4964-a8a9-368a89aab0e2/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:00:20.835215 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27c37404-4df0-4ded-bf5b-6002e26d4222/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:00:20.859101 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "d203e779-f827-4964-a8a9-368a89aab0e2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:20.859101 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "d203e779-f827-4964-a8a9-368a89aab0e2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:20.859101 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Attaching volume 609a5488-17dc-40f8-a64f-5c1255836352 to /dev/vdb
May 28 02:00:20.888324 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lazy-loading 'flavor' on Instance uuid 8b2a5f31-1b3d-447f-939e-94fd0be5eb85 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:00:20.912559 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:00:20.929283 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 02:00:20.943469 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27c37404-4df0-4ded-bf5b-6002e26d4222/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:00:20.944275 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27c37404-4df0-4ded-bf5b-6002e26d4222/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:00:20.975313 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:00:21.031005 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 02:00:21.031992 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 02:00:21.044111 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 02:00:21.044111 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::8832:afff:fe8a:cd4c', 'fe80::fc16:3eff:fe48:7d7b', 'fe80::d0cf:7bff:fef9:3cc3', 'fe80::fc16:3eff:feca:d649', 'fe80::fc16:3eff:fed3:cd06', 'fe80::fc16:3eff:feae:1e12', 'fe80::fc16:3eff:fedf:4521', 'fe80::fc16:3eff:fef3:6803', 'fe80::ecb9:b7ff:fe00:dc63', 'fe80::fc16:3eff:feae:cc0f', 'fe80::9020:88ff:fe40:d02', 'fe80::fc16:3eff:fe76:c53f', 'fe80::fc16:3eff:feca:8ce2', 'fe80::5048:4dff:fe67:fb12', 'fe80::fc16:3eff:feff:a688', 'fe80::34e0:eeff:fee2:bede', 'fe80::fc16:3eff:fee8:1f', 'fe80::fc16:3eff:fe57:9502'] 
May 28 02:00:21.044111 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 02:00:21.044111 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 02:00:21.044111 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:00:21.044111 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Updating existing volume attachment record: 89d792ed-4034-4784-8019-de8db962079c {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 02:00:21.067429 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27c37404-4df0-4ded-bf5b-6002e26d4222/disk --force-share --output=json" returned: 0 in 0.123s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:00:21.068033 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/dm-3 (vdb) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 02:00:21.072183 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/dm-7 (vda) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 02:00:21.073919 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659c56a6-743a-45e2-aa21-7d45c672f094/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:00:21.152961 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-64b9d7d5-ebef-47aa-85ae-cfebd3eaf076 req-600b7618-244a-4e60-b5e3-b7b24a73bae4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:00:21.178675 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659c56a6-743a-45e2-aa21-7d45c672f094/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:00:21.180670 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659c56a6-743a-45e2-aa21-7d45c672f094/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:00:21.275870 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659c56a6-743a-45e2-aa21-7d45c672f094/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:00:21.283473 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:00:21.366340 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:00:21.366730 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:00:21.469104 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:00:21.472594 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 02:00:21.474333 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:00:21.571139 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:00:21.571626 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:00:21.613111 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 02:00:21.613111 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352', 'iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '609a5488-17dc-40f8-a64f-5c1255836352', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:00:21.613555 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:00:21.614757 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:00:21.615366 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352', 'iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '609a5488-17dc-40f8-a64f-5c1255836352', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 02:00:21.644462 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:00:21.645167 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:00:21.645457 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:00:21.649159 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:00:21.649159 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:00:21.649159 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:00:21.665480 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:00:21.665480 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:21.670321 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:00:21.670321 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/dm-5 (vdb) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 02:00:21.671844 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d87a47f-2eb6-4e25-b44a-848fe2225962/disk.rescue --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:00:21.673811 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:00:21.673811 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:21.702182 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-64b9d7d5-ebef-47aa-85ae-cfebd3eaf076 req-600b7618-244a-4e60-b5e3-b7b24a73bae4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:00:21.707458 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352] added
May 28 02:00:21.707458 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:00:21.707458 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:00:21.707458 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:00:21.707458 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:00:21.707458 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:00:21.707458 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:21.708315 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352] added
May 28 02:00:21.708315 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:00:21.708315 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:00:21.708315 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:00:21.708315 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:00:21.708315 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:00:21.708315 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:21.708572 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:00:21.709256 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:00:21.709527 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0611(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:00:21.709853 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.064(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:00:21.710059 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:00:21.710205 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:00:21.772161 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d87a47f-2eb6-4e25-b44a-848fe2225962/disk.rescue --force-share --output=json" returned: 0 in 0.100s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:00:21.772860 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d87a47f-2eb6-4e25-b44a-848fe2225962/disk.rescue --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:00:21.837764 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-47c1b77a-6bb9-4964-a56d-65a79259ee66 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:00:21.838488 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-47c1b77a-6bb9-4964-a56d-65a79259ee66 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:00:21.874788 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d87a47f-2eb6-4e25-b44a-848fe2225962/disk.rescue --force-share --output=json" returned: 0 in 0.102s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:00:21.875146 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d87a47f-2eb6-4e25-b44a-848fe2225962/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:00:21.904582 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-64b9d7d5-ebef-47aa-85ae-cfebd3eaf076 req-600b7618-244a-4e60-b5e3-b7b24a73bae4 service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Updated VIF entry in instance network info cache for port 5e52242f-77f4-41cc-ae8f-6a4772243727. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:00:21.906548 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "8b2a5f31-1b3d-447f-939e-94fd0be5eb85" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.524s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:21.907703 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-64b9d7d5-ebef-47aa-85ae-cfebd3eaf076 req-600b7618-244a-4e60-b5e3-b7b24a73bae4 service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Updating instance_info_cache with network_info: [{"id": "5e52242f-77f4-41cc-ae8f-6a4772243727", "address": "fa:16:3e:57:95:02", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e52242f-77", "ovs_interfaceid": "5e52242f-77f4-41cc-ae8f-6a4772243727", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:00:21.973608 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d87a47f-2eb6-4e25-b44a-848fe2225962/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:00:21.974209 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d87a47f-2eb6-4e25-b44a-848fe2225962/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:00:22.072775 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d87a47f-2eb6-4e25-b44a-848fe2225962/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:00:22.076913 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:00:22.078233 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:00:22.122887 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.044s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:00:22.123733 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Hypervisor/Node resource view: name=np0000001583 free_ram=10412MB free_disk=73.67595672607422GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 02:00:22.123733 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:22.343917 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-47c1b77a-6bb9-4964-a56d-65a79259ee66 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:00:22.412822 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-64b9d7d5-ebef-47aa-85ae-cfebd3eaf076 req-600b7618-244a-4e60-b5e3-b7b24a73bae4 service nova] Releasing lock "refresh_cache-21c4e225-440e-4103-adaf-cb470d172291" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:00:22.413211 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-64b9d7d5-ebef-47aa-85ae-cfebd3eaf076 req-600b7618-244a-4e60-b5e3-b7b24a73bae4 service nova] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Received event network-vif-deleted-def344c1-e586-48f0-ad54-d24138b95457 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:00:22.710976 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:00:22.711406 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:00:22.726590 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:00:22.726590 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:00:22.730502 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:00:22.730502 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:22.744909 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:22.756956 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:22.763256 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:22.763256 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:22.763256 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:22.763256 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:22.763256 np0000001583 nova-compute[98241]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:22.763256 np0000001583 nova-compute[98241]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:22.763256 np0000001583 nova-compute[98241]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:22.763256 np0000001583 nova-compute[98241]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:22.763256 np0000001583 nova-compute[98241]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:22.763256 np0000001583 nova-compute[98241]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:22.763256 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:00:22.763256 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:22.763256 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:22.763256 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:22.763256 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:22.763256 np0000001583 nova-compute[98241]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:22.763256 np0000001583 nova-compute[98241]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:22.763256 np0000001583 nova-compute[98241]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:22.763256 np0000001583 nova-compute[98241]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:22.763256 np0000001583 nova-compute[98241]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:22.763256 np0000001583 nova-compute[98241]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:22.763256 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:00:22.778550 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:22.778550 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:22.778550 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:22.778550 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:22.778550 np0000001583 nova-compute[98241]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:22.778550 np0000001583 nova-compute[98241]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:22.778550 np0000001583 nova-compute[98241]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:22.778550 np0000001583 nova-compute[98241]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:22.778550 np0000001583 nova-compute[98241]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:22.778550 np0000001583 nova-compute[98241]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:22.778550 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:00:22.778869 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:22.778869 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:22.778869 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:22.778869 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:22.778869 np0000001583 nova-compute[98241]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:22.778869 np0000001583 nova-compute[98241]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:22.778869 np0000001583 nova-compute[98241]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:22.778869 np0000001583 nova-compute[98241]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:22.778869 np0000001583 nova-compute[98241]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:22.778869 np0000001583 nova-compute[98241]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:22.778869 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:00:22.814169 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352, portal: 192.168.50.100,3260]
May 28 02:00:22.814169 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352, portal: 192.168.50.100,3260] successful.
May 28 02:00:22.814169 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:22.830505 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:22.835247 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352, portal: 192.168.40.100,3260]
May 28 02:00:22.835247 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352, portal: 192.168.40.100,3260] successful.
May 28 02:00:22.835247 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:22.848178 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:22.856956 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-47c1b77a-6bb9-4964-a56d-65a79259ee66 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.077s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:22.868831 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.733s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:22.874131 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:22.874131 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:22.874131 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:22.874131 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:22.874131 np0000001583 nova-compute[98241]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:22.874131 np0000001583 nova-compute[98241]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:22.874131 np0000001583 nova-compute[98241]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:22.874131 np0000001583 nova-compute[98241]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:22.874131 np0000001583 nova-compute[98241]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:22.874131 np0000001583 nova-compute[98241]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:22.874131 np0000001583 nova-compute[98241]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352 (non-flash)
May 28 02:00:22.874131 np0000001583 nova-compute[98241]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352 (non-flash)
May 28 02:00:22.874131 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:00:22.875905 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:22.875905 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:22.875905 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:22.875905 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:22.875905 np0000001583 nova-compute[98241]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:22.875905 np0000001583 nova-compute[98241]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:22.875905 np0000001583 nova-compute[98241]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:22.875905 np0000001583 nova-compute[98241]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:22.875905 np0000001583 nova-compute[98241]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:22.875905 np0000001583 nova-compute[98241]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:22.875905 np0000001583 nova-compute[98241]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352 (non-flash)
May 28 02:00:22.875905 np0000001583 nova-compute[98241]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352 (non-flash)
May 28 02:00:22.875905 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:00:22.876187 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:22.876187 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:22.876187 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:22.876187 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:22.876187 np0000001583 nova-compute[98241]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:22.876187 np0000001583 nova-compute[98241]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:22.876187 np0000001583 nova-compute[98241]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:22.876187 np0000001583 nova-compute[98241]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:22.876187 np0000001583 nova-compute[98241]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:22.876187 np0000001583 nova-compute[98241]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:22.876187 np0000001583 nova-compute[98241]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352 (non-flash)
May 28 02:00:22.876187 np0000001583 nova-compute[98241]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352 (non-flash)
May 28 02:00:22.876187 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:00:22.878497 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:22.878497 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:22.878497 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:22.878497 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:22.878497 np0000001583 nova-compute[98241]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:22.878497 np0000001583 nova-compute[98241]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:22.878497 np0000001583 nova-compute[98241]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:22.878497 np0000001583 nova-compute[98241]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:22.878497 np0000001583 nova-compute[98241]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:22.878497 np0000001583 nova-compute[98241]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:22.878497 np0000001583 nova-compute[98241]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352 (non-flash)
May 28 02:00:22.878497 np0000001583 nova-compute[98241]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352 (non-flash)
May 28 02:00:22.878497 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:00:22.879175 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.234s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:00:22.881379 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.232s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:00:22.881602 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:00:22.882171 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:00:22.884976 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] HCTL ('13', '-', '-', 0) found on session 89 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:00:22.885138 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:00:22.885647 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] HCTL ('14', '-', '-', 0) found on session 90 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:00:22.885815 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:00:22.906001 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Searching for a device in session 90 and hctl ['14', '*', '*', 0] yield: None {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:00:22.924018 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Searching for a device in session 89 and hctl ['13', '*', '*', 0] yield: sdi {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:00:22.924018 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '609a5488-17dc-40f8-a64f-5c1255836352', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:00:22.958418 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-47c1b77a-6bb9-4964-a56d-65a79259ee66 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Deleted allocations for instance 63688346-f8e2-4fbe-987d-bf55df9fa3a4
May 28 02:00:22.987849 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "8b2a5f31-1b3d-447f-939e-94fd0be5eb85" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:22.988003 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "8b2a5f31-1b3d-447f-939e-94fd0be5eb85" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:22.988212 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Attaching volume 2b9c7b2e-ce89-46a0-a020-361646147ba3 to /dev/vdb
May 28 02:00:23.048531 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:00:23.064016 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 02:00:23.091945 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:00:23.113140 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:23.146650 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 02:00:23.147344 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 02:00:23.157945 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 02:00:23.159888 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::8832:afff:fe8a:cd4c', 'fe80::fc16:3eff:fe48:7d7b', 'fe80::d0cf:7bff:fef9:3cc3', 'fe80::fc16:3eff:feca:d649', 'fe80::fc16:3eff:fed3:cd06', 'fe80::fc16:3eff:feae:1e12', 'fe80::fc16:3eff:fedf:4521', 'fe80::fc16:3eff:fef3:6803', 'fe80::ecb9:b7ff:fe00:dc63', 'fe80::fc16:3eff:feae:cc0f', 'fe80::9020:88ff:fe40:d02', 'fe80::fc16:3eff:fe76:c53f', 'fe80::fc16:3eff:feca:8ce2', 'fe80::5048:4dff:fe67:fb12', 'fe80::fc16:3eff:feff:a688', 'fe80::34e0:eeff:fee2:bede', 'fe80::fc16:3eff:fee8:1f', 'fe80::fc16:3eff:fe57:9502'] 
May 28 02:00:23.160060 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 02:00:23.160232 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 02:00:23.160473 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:00:23.160728 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Updating existing volume attachment record: a9fecbdb-ed57-423b-8a68-82ecb1dcc597 {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 02:00:23.207276 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:23.707972 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 02:00:23.708348 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2b9c7b2e-ce89-46a0-a020-361646147ba3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:00:23.708519 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:00:23.906674 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Searching for a device in session 90 and hctl ['14', '*', '*', 0] yield: sdh {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:00:23.907048 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '609a5488-17dc-40f8-a64f-5c1255836352', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:00:23.938182 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 659c56a6-743a-45e2-aa21-7d45c672f094 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:00:23.938334 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 0d87a47f-2eb6-4e25-b44a-848fe2225962 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:00:23.938473 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance e50227a8-b484-447b-abc6-3a3c1379e7ff actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:00:23.938611 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 22bbb8cf-c11d-4025-8551-4c1c3557264a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:00:23.938758 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance d4fad20b-d51e-47c9-8f55-3aa085a10891 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:00:23.938895 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 27c37404-4df0-4ded-bf5b-6002e26d4222 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:00:23.939021 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:00:23.939234 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance e3e9a0d0-72cd-459e-8bc4-cf080adb5267 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:00:23.939360 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance d203e779-f827-4964-a8a9-368a89aab0e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:00:23.939487 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 8b2a5f31-1b3d-447f-939e-94fd0be5eb85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:00:23.939611 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:00:23.939746 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 21c4e225-440e-4103-adaf-cb470d172291 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:00:23.940000 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 02:00:23.940192 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Final resource view: name=np0000001583 phys_ram=24030MB used_ram=2816MB phys_disk=95GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:00:22 up 36 min,  2 users,  load average: 9.15, 8.04, 4.56\n', 'num_instances': '12', 'num_vm_active': '11', 'num_task_None': '12', 'num_os_type_None': '12', 'num_proj_f65617e71571457f8906997583100678': '3', 'io_workload': '0', 'num_vm_rescued': '1', 'num_proj_0474090f4f2d4950b51bc317f4302266': '5', 'num_proj_04ce4063a6ac4afdb5ee359a5c1105d3': '1', 'num_proj_1d5cfe906dd24a10819b92c144f7f06f': '1', 'num_proj_837663bcfa40402aaf583729dfbb26cd': '1', 'num_proj_432aa1094ced436494def17a875aa8e1': '1'} {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 02:00:23.977262 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-47c1b77a-6bb9-4964-a56d-65a79259ee66 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "63688346-f8e2-4fbe-987d-bf55df9fa3a4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.259s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:24.600111 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:00:24.600387 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:00:24.665090 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Found WWN 330000000ce240a9d for multipath device dm-4 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 02:00:24.665541 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.051s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:00:24.665824 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] <== connect_volume: return (3053ms) {'type': 'block', 'scsi_wwn': '330000000ce240a9d', 'path': '/dev/dm-4', 'multipath_id': '330000000ce240a9d'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:00:24.666029 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ce240a9d', 'path': '/dev/dm-4', 'multipath_id': '330000000ce240a9d'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 02:00:24.666463 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.958s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:00:24.666739 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2b9c7b2e-ce89-46a0-a020-361646147ba3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 02:00:24.669494 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lazy-loading 'flavor' on Instance uuid d203e779-f827-4964-a8a9-368a89aab0e2 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:00:24.682041 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:00:24.682851 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:00:24.684198 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:00:24.684402 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:00:24.684801 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:00:24.685007 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:00:24.699307 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:00:24.699307 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:24.700539 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:00:24.700539 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:24.714785 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3] added
May 28 02:00:24.714785 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:00:24.714785 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:00:24.714785 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:00:24.714785 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:00:24.714785 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:00:24.714785 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:24.715003 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:00:24.715277 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0302(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:00:24.715488 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:00:24.716971 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3] added
May 28 02:00:24.716971 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:00:24.716971 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:00:24.716971 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:00:24.716971 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:00:24.716971 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:00:24.716971 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:24.716971 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:00:24.717163 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0327(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:00:24.717373 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:00:25.105446 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:00:25.173107 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Attempting to attach volume 609a5488-17dc-40f8-a64f-5c1255836352 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98241) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 02:00:25.174888 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] attach device xml: <disk type="block" device="disk">
May 28 02:00:25.174888 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:00:25.174888 np0000001583 nova-compute[98241]:   <alias name="ua-609a5488-17dc-40f8-a64f-5c1255836352"/>
May 28 02:00:25.174888 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-4"/>
May 28 02:00:25.174888 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:00:25.174888 np0000001583 nova-compute[98241]:   <serial>609a5488-17dc-40f8-a64f-5c1255836352</serial>
May 28 02:00:25.174888 np0000001583 nova-compute[98241]: </disk>
May 28 02:00:25.174888 np0000001583 nova-compute[98241]:  {{(pid=98241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 02:00:25.616281 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Compute_service record updated for np0000001583:np0000001583 {{(pid=98241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 02:00:25.616457 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.759s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:25.616796 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:00:25.715924 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:00:25.717814 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:00:25.729518 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:00:25.729518 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:00:25.739774 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:00:25.739774 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:25.748833 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:25.756196 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:25.772203 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:25.772203 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:25.772203 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:25.772203 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:25.772203 np0000001583 nova-compute[98241]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:25.772203 np0000001583 nova-compute[98241]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:25.772203 np0000001583 nova-compute[98241]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:25.772203 np0000001583 nova-compute[98241]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:25.772203 np0000001583 nova-compute[98241]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:25.772203 np0000001583 nova-compute[98241]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:25.772203 np0000001583 nova-compute[98241]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352 (non-flash)
May 28 02:00:25.772203 np0000001583 nova-compute[98241]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352 (non-flash)
May 28 02:00:25.772203 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:00:25.772723 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:25.772723 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:25.772723 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:25.772723 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:25.772723 np0000001583 nova-compute[98241]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:25.772723 np0000001583 nova-compute[98241]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:25.772723 np0000001583 nova-compute[98241]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:25.772723 np0000001583 nova-compute[98241]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:25.772723 np0000001583 nova-compute[98241]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:25.772723 np0000001583 nova-compute[98241]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:25.772723 np0000001583 nova-compute[98241]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352 (non-flash)
May 28 02:00:25.772723 np0000001583 nova-compute[98241]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352 (non-flash)
May 28 02:00:25.772723 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:00:25.781148 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:25.781148 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:25.781148 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:25.781148 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:25.781148 np0000001583 nova-compute[98241]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:25.781148 np0000001583 nova-compute[98241]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:25.781148 np0000001583 nova-compute[98241]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:25.781148 np0000001583 nova-compute[98241]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:25.781148 np0000001583 nova-compute[98241]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:25.781148 np0000001583 nova-compute[98241]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:25.781148 np0000001583 nova-compute[98241]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352 (non-flash)
May 28 02:00:25.781148 np0000001583 nova-compute[98241]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352 (non-flash)
May 28 02:00:25.781148 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:00:25.781663 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:25.781663 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:25.781663 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:25.781663 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:25.781663 np0000001583 nova-compute[98241]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:25.781663 np0000001583 nova-compute[98241]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:25.781663 np0000001583 nova-compute[98241]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:25.781663 np0000001583 nova-compute[98241]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:25.781663 np0000001583 nova-compute[98241]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:25.781663 np0000001583 nova-compute[98241]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:25.781663 np0000001583 nova-compute[98241]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352 (non-flash)
May 28 02:00:25.781663 np0000001583 nova-compute[98241]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352 (non-flash)
May 28 02:00:25.781663 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:00:25.837211 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3, portal: 192.168.50.100,3260]
May 28 02:00:25.837211 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3, portal: 192.168.50.100,3260] successful.
May 28 02:00:25.837211 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:25.850380 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3, portal: 192.168.40.100,3260]
May 28 02:00:25.850380 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3, portal: 192.168.40.100,3260] successful.
May 28 02:00:25.850380 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:25.859441 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:25.867651 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:25.887936 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:25.887936 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:25.887936 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:25.887936 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:25.887936 np0000001583 nova-compute[98241]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:25.887936 np0000001583 nova-compute[98241]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:25.887936 np0000001583 nova-compute[98241]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:25.887936 np0000001583 nova-compute[98241]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:25.887936 np0000001583 nova-compute[98241]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:25.887936 np0000001583 nova-compute[98241]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:25.887936 np0000001583 nova-compute[98241]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352 (non-flash)
May 28 02:00:25.887936 np0000001583 nova-compute[98241]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352 (non-flash)
May 28 02:00:25.887936 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:25.887936 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:25.887936 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:00:25.888535 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:25.888535 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:25.888535 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:25.888535 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:25.888535 np0000001583 nova-compute[98241]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:25.888535 np0000001583 nova-compute[98241]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:25.888535 np0000001583 nova-compute[98241]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:25.888535 np0000001583 nova-compute[98241]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:25.888535 np0000001583 nova-compute[98241]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:25.888535 np0000001583 nova-compute[98241]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:25.888535 np0000001583 nova-compute[98241]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352 (non-flash)
May 28 02:00:25.888535 np0000001583 nova-compute[98241]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352 (non-flash)
May 28 02:00:25.888535 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:25.888535 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:25.888535 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:00:25.889057 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.204s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:00:25.889057 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:00:25.890432 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:25.890432 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:25.890432 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:25.890432 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:25.890432 np0000001583 nova-compute[98241]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:25.890432 np0000001583 nova-compute[98241]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:25.890432 np0000001583 nova-compute[98241]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:25.890432 np0000001583 nova-compute[98241]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:25.890432 np0000001583 nova-compute[98241]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:25.890432 np0000001583 nova-compute[98241]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:25.890432 np0000001583 nova-compute[98241]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352 (non-flash)
May 28 02:00:25.890432 np0000001583 nova-compute[98241]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352 (non-flash)
May 28 02:00:25.890432 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:25.890432 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:25.890432 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:00:25.890874 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:25.890874 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:25.890874 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:25.890874 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:25.890874 np0000001583 nova-compute[98241]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:25.890874 np0000001583 nova-compute[98241]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:25.890874 np0000001583 nova-compute[98241]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:25.890874 np0000001583 nova-compute[98241]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:25.890874 np0000001583 nova-compute[98241]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:25.890874 np0000001583 nova-compute[98241]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:25.890874 np0000001583 nova-compute[98241]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352 (non-flash)
May 28 02:00:25.890874 np0000001583 nova-compute[98241]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352 (non-flash)
May 28 02:00:25.890874 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:25.890874 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:25.890874 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:00:25.891257 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.208s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:00:25.891516 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:00:25.891997 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] HCTL ('15', '-', '-', 0) found on session 91 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:00:25.892209 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:00:25.893663 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] HCTL ('20', '-', '-', 0) found on session 92 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:00:25.893785 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:00:25.914121 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Searching for a device in session 91 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:00:25.914606 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2b9c7b2e-ce89-46a0-a020-361646147ba3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:00:25.926688 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Searching for a device in session 92 and hctl ['20', '*', '*', 0] yield: None {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:00:26.614410 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:00:26.616352 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 48.58 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:00:26.858864 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:00:26.858962 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:00:26.859046 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:00:26.859210 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] No VIF found with MAC fa:16:3e:f3:68:03, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:00:26.926575 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Searching for a device in session 92 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:00:26.926575 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2b9c7b2e-ce89-46a0-a020-361646147ba3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:00:27.700245 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Found WWN 330000000e4a7908f for multipath device dm-10 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 02:00:27.700762 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:00:27.700762 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] <== connect_volume: return (3991ms) {'type': 'block', 'scsi_wwn': '330000000e4a7908f', 'path': '/dev/dm-10', 'multipath_id': '330000000e4a7908f'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:00:27.700762 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e4a7908f', 'path': '/dev/dm-10', 'multipath_id': '330000000e4a7908f'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 02:00:27.704097 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lazy-loading 'flavor' on Instance uuid 8b2a5f31-1b3d-447f-939e-94fd0be5eb85 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:00:28.115409 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:28.209725 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Attempting to attach volume 2b9c7b2e-ce89-46a0-a020-361646147ba3 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98241) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 02:00:28.209725 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:28.213145 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] attach device xml: <disk type="block" device="disk">
May 28 02:00:28.213145 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:00:28.213145 np0000001583 nova-compute[98241]:   <alias name="ua-2b9c7b2e-ce89-46a0-a020-361646147ba3"/>
May 28 02:00:28.213145 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-10"/>
May 28 02:00:28.213145 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:00:28.213145 np0000001583 nova-compute[98241]:   <serial>2b9c7b2e-ce89-46a0-a020-361646147ba3</serial>
May 28 02:00:28.213145 np0000001583 nova-compute[98241]:   <shareable/>
May 28 02:00:28.213145 np0000001583 nova-compute[98241]: </disk>
May 28 02:00:28.213145 np0000001583 nova-compute[98241]:  {{(pid=98241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 02:00:28.413751 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a11796c1-98a4-4b15-9169-96a2f1a72fa9 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "d203e779-f827-4964-a8a9-368a89aab0e2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.555s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:28.968003 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-eb71a038-d87f-40ec-a8b7-ee0a68d68359 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "d203e779-f827-4964-a8a9-368a89aab0e2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:28.968430 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-eb71a038-d87f-40ec-a8b7-ee0a68d68359 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "d203e779-f827-4964-a8a9-368a89aab0e2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:29.471968 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-eb71a038-d87f-40ec-a8b7-ee0a68d68359 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Detaching volume 609a5488-17dc-40f8-a64f-5c1255836352
May 28 02:00:29.525028 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-eb71a038-d87f-40ec-a8b7-ee0a68d68359 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Attempting to driver detach volume 609a5488-17dc-40f8-a64f-5c1255836352 from mountpoint /dev/vdb
May 28 02:00:29.529878 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-eb71a038-d87f-40ec-a8b7-ee0a68d68359 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Found disk vdb by alias ua-609a5488-17dc-40f8-a64f-5c1255836352 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:00:29.531360 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-eb71a038-d87f-40ec-a8b7-ee0a68d68359 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Found disk vdb by alias ua-609a5488-17dc-40f8-a64f-5c1255836352 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:00:29.531525 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-eb71a038-d87f-40ec-a8b7-ee0a68d68359 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Attempting to detach device vdb from instance d203e779-f827-4964-a8a9-368a89aab0e2 from the persistent domain config. {{(pid=98241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 02:00:29.531852 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-eb71a038-d87f-40ec-a8b7-ee0a68d68359 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:00:29.531852 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:00:29.531852 np0000001583 nova-compute[98241]:   <alias name="ua-609a5488-17dc-40f8-a64f-5c1255836352"/>
May 28 02:00:29.531852 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-4"/>
May 28 02:00:29.531852 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:00:29.531852 np0000001583 nova-compute[98241]:   <serial>609a5488-17dc-40f8-a64f-5c1255836352</serial>
May 28 02:00:29.531852 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 02:00:29.531852 np0000001583 nova-compute[98241]: </disk>
May 28 02:00:29.531852 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:00:29.541069 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-eb71a038-d87f-40ec-a8b7-ee0a68d68359 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Successfully detached device vdb from instance d203e779-f827-4964-a8a9-368a89aab0e2 from the persistent domain config.
May 28 02:00:29.541314 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-eb71a038-d87f-40ec-a8b7-ee0a68d68359 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] (1/8): Attempting to detach device vdb with device alias ua-609a5488-17dc-40f8-a64f-5c1255836352 from instance d203e779-f827-4964-a8a9-368a89aab0e2 from the live domain config. {{(pid=98241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 02:00:29.541736 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-eb71a038-d87f-40ec-a8b7-ee0a68d68359 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:00:29.541736 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:00:29.541736 np0000001583 nova-compute[98241]:   <alias name="ua-609a5488-17dc-40f8-a64f-5c1255836352"/>
May 28 02:00:29.541736 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-4"/>
May 28 02:00:29.541736 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:00:29.541736 np0000001583 nova-compute[98241]:   <serial>609a5488-17dc-40f8-a64f-5c1255836352</serial>
May 28 02:00:29.541736 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 02:00:29.541736 np0000001583 nova-compute[98241]: </disk>
May 28 02:00:29.541736 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:00:29.951931 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:00:29.951931 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:00:29.952190 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:00:29.952570 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] No VIF found with MAC fa:16:3e:76:c5:3f, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:00:30.097825 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Received event <DeviceRemovedEvent: 1779933630.0974202, d203e779-f827-4964-a8a9-368a89aab0e2 => ua-609a5488-17dc-40f8-a64f-5c1255836352> from libvirt while the driver is waiting for it; dispatched. {{(pid=98241) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 02:00:30.098921 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-eb71a038-d87f-40ec-a8b7-ee0a68d68359 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-609a5488-17dc-40f8-a64f-5c1255836352 for instance d203e779-f827-4964-a8a9-368a89aab0e2 {{(pid=98241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 02:00:30.101565 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-eb71a038-d87f-40ec-a8b7-ee0a68d68359 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Successfully detached device vdb from instance d203e779-f827-4964-a8a9-368a89aab0e2 from the live domain config.
May 28 02:00:30.103216 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb71a038-d87f-40ec-a8b7-ee0a68d68359 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:00:30.103577 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb71a038-d87f-40ec-a8b7-ee0a68d68359 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352', 'iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '609a5488-17dc-40f8-a64f-5c1255836352', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:00:30.103760 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-eb71a038-d87f-40ec-a8b7-ee0a68d68359 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:00:30.555764 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-eb71a038-d87f-40ec-a8b7-ee0a68d68359 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.452s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:00:30.556169 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb71a038-d87f-40ec-a8b7-ee0a68d68359 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352', 'iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '609a5488-17dc-40f8-a64f-5c1255836352', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:00:30.556330 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb71a038-d87f-40ec-a8b7-ee0a68d68359 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:00:30.594315 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb71a038-d87f-40ec-a8b7-ee0a68d68359 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:30.594315 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:30.594315 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:30.594315 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:30.594315 np0000001583 nova-compute[98241]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:30.594315 np0000001583 nova-compute[98241]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:30.594315 np0000001583 nova-compute[98241]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:30.594315 np0000001583 nova-compute[98241]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:30.594315 np0000001583 nova-compute[98241]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:30.594315 np0000001583 nova-compute[98241]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:30.594315 np0000001583 nova-compute[98241]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352 (non-flash)
May 28 02:00:30.594315 np0000001583 nova-compute[98241]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352 (non-flash)
May 28 02:00:30.594315 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:30.594315 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:30.594315 np0000001583 nova-compute[98241]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48c9ef55-3b01-491a-b589-2b61ee01b6f8 (non-flash)
May 28 02:00:30.594315 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:00:30.594927 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb71a038-d87f-40ec-a8b7-ee0a68d68359 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:30.594927 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:30.594927 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:30.594927 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:30.594927 np0000001583 nova-compute[98241]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:30.594927 np0000001583 nova-compute[98241]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:30.594927 np0000001583 nova-compute[98241]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:30.594927 np0000001583 nova-compute[98241]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:30.594927 np0000001583 nova-compute[98241]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:30.594927 np0000001583 nova-compute[98241]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:30.594927 np0000001583 nova-compute[98241]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352 (non-flash)
May 28 02:00:30.594927 np0000001583 nova-compute[98241]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352 (non-flash)
May 28 02:00:30.594927 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:30.594927 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:30.594927 np0000001583 nova-compute[98241]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48c9ef55-3b01-491a-b589-2b61ee01b6f8 (non-flash)
May 28 02:00:30.594927 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:00:30.594927 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb71a038-d87f-40ec-a8b7-ee0a68d68359 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', '68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', '69'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376', '78'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376', '79'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', '82'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', '83'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57', '85'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57', '86'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d', '87'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d', '88'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352', '89'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352', '90'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', '91'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', '92'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-48c9ef55-3b01-491a-b589-2b61ee01b6f8', '93')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:00:30.594927 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb71a038-d87f-40ec-a8b7-ee0a68d68359 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352', '90')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:00:30.595836 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb71a038-d87f-40ec-a8b7-ee0a68d68359 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352', '89')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:00:30.597023 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb71a038-d87f-40ec-a8b7-ee0a68d68359 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724ec1af100>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352'): ({'sdi'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:00:30.598033 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-eb71a038-d87f-40ec-a8b7-ee0a68d68359 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Removing multipathed devices sdh, sdi {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:00:30.598033 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-eb71a038-d87f-40ec-a8b7-ee0a68d68359 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Flush multipath device 330000000ce240a9d {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:00:30.633314 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-eb71a038-d87f-40ec-a8b7-ee0a68d68359 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:00:30.675849 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-eb71a038-d87f-40ec-a8b7-ee0a68d68359 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:00:30.719768 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-eb71a038-d87f-40ec-a8b7-ee0a68d68359 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:00:30.719957 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-eb71a038-d87f-40ec-a8b7-ee0a68d68359 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:00:30.721760 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-eb71a038-d87f-40ec-a8b7-ee0a68d68359 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:00:30.736414 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-eb71a038-d87f-40ec-a8b7-ee0a68d68359 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:00:30.736660 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb71a038-d87f-40ec-a8b7-ee0a68d68359 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:00:30.751165 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb71a038-d87f-40ec-a8b7-ee0a68d68359 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:30.788284 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb71a038-d87f-40ec-a8b7-ee0a68d68359 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 90, target: iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352, portal: 192.168.40.100,3260]
May 28 02:00:30.788284 np0000001583 nova-compute[98241]: Logout of [sid: 90, target: iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352, portal: 192.168.40.100,3260] successful.
May 28 02:00:30.788284 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:30.810895 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb71a038-d87f-40ec-a8b7-ee0a68d68359 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:30.822129 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb71a038-d87f-40ec-a8b7-ee0a68d68359 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:30.864627 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb71a038-d87f-40ec-a8b7-ee0a68d68359 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 89, target: iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352, portal: 192.168.50.100,3260]
May 28 02:00:30.864627 np0000001583 nova-compute[98241]: Logout of [sid: 89, target: iqn.2023-03.storpool.com:os--volume-609a5488-17dc-40f8-a64f-5c1255836352, portal: 192.168.50.100,3260] successful.
May 28 02:00:30.864627 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:30.887068 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb71a038-d87f-40ec-a8b7-ee0a68d68359 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:30.887293 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-eb71a038-d87f-40ec-a8b7-ee0a68d68359 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:00:30.887416 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb71a038-d87f-40ec-a8b7-ee0a68d68359 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] <== disconnect_volume: return (783ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:00:30.887525 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb71a038-d87f-40ec-a8b7-ee0a68d68359 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:00:31.380982 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "21c4e225-440e-4103-adaf-cb470d172291" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:31.382179 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "21c4e225-440e-4103-adaf-cb470d172291" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:31.435060 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-eb71a038-d87f-40ec-a8b7-ee0a68d68359 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lazy-loading 'flavor' on Instance uuid d203e779-f827-4964-a8a9-368a89aab0e2 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:00:31.593195 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-85553951-80e4-49b7-820c-def5d04519af tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "8b2a5f31-1b3d-447f-939e-94fd0be5eb85" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.605s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:31.885658 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lazy-loading 'flavor' on Instance uuid 21c4e225-440e-4103-adaf-cb470d172291 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:00:32.441327 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-eb71a038-d87f-40ec-a8b7-ee0a68d68359 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "d203e779-f827-4964-a8a9-368a89aab0e2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.472s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:32.891967 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "21c4e225-440e-4103-adaf-cb470d172291" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:33.116741 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:33.212880 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:33.369490 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.00037888199994995375 future=<Future at 0x7724ec4cffe0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:00:33.369821 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:00:33.371483 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Emitting event <LifecycleEvent: 1779933618.3689926, 63688346-f8e2-4fbe-987d-bf55df9fa3a4 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:00:33.371695 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] VM Stopped (Lifecycle Event)
May 28 02:00:33.383570 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-86395768-d00b-4796-bfa8-f406567d388a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "d203e779-f827-4964-a8a9-368a89aab0e2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:33.383721 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-86395768-d00b-4796-bfa8-f406567d388a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "d203e779-f827-4964-a8a9-368a89aab0e2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:33.384064 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-86395768-d00b-4796-bfa8-f406567d388a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "d203e779-f827-4964-a8a9-368a89aab0e2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:33.384198 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-86395768-d00b-4796-bfa8-f406567d388a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "d203e779-f827-4964-a8a9-368a89aab0e2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:33.384250 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-86395768-d00b-4796-bfa8-f406567d388a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "d203e779-f827-4964-a8a9-368a89aab0e2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:33.387151 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-86395768-d00b-4796-bfa8-f406567d388a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Terminating instance
May 28 02:00:33.876835 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 63688346-f8e2-4fbe-987d-bf55df9fa3a4] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:00:33.893316 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-86395768-d00b-4796-bfa8-f406567d388a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 02:00:33.915118 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:33.920876 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:33.944757 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:33.972519 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:33.973778 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:34.028059 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "21c4e225-440e-4103-adaf-cb470d172291" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:34.028420 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "21c4e225-440e-4103-adaf-cb470d172291" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:34.028725 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Attaching volume 2b9c7b2e-ce89-46a0-a020-361646147ba3 to /dev/vdb
May 28 02:00:34.100584 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:00:34.113670 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 02:00:34.154924 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:00:34.196931 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-13887a1a-f1db-4531-9304-9ec763ea4686 req-f4970107-3517-4529-98a2-c91a8dde38b2 service nova] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Received event network-vif-unplugged-64151141-350a-4b34-b2a6-316b8dbefd14 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:00:34.197501 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-13887a1a-f1db-4531-9304-9ec763ea4686 req-f4970107-3517-4529-98a2-c91a8dde38b2 service nova] Acquiring lock "d203e779-f827-4964-a8a9-368a89aab0e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:34.197851 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-13887a1a-f1db-4531-9304-9ec763ea4686 req-f4970107-3517-4529-98a2-c91a8dde38b2 service nova] Lock "d203e779-f827-4964-a8a9-368a89aab0e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:34.198169 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-13887a1a-f1db-4531-9304-9ec763ea4686 req-f4970107-3517-4529-98a2-c91a8dde38b2 service nova] Lock "d203e779-f827-4964-a8a9-368a89aab0e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:34.198328 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-13887a1a-f1db-4531-9304-9ec763ea4686 req-f4970107-3517-4529-98a2-c91a8dde38b2 service nova] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] No waiting events found dispatching network-vif-unplugged-64151141-350a-4b34-b2a6-316b8dbefd14 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:00:34.198484 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-13887a1a-f1db-4531-9304-9ec763ea4686 req-f4970107-3517-4529-98a2-c91a8dde38b2 service nova] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Received event network-vif-unplugged-64151141-350a-4b34-b2a6-316b8dbefd14 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:00:34.223788 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 02:00:34.224426 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 02:00:34.232622 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999650928999927 future=<Future at 0x7724ec4b1160 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:00:34.233165 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.99918635799986 future=<Future at 0x7724ec4b1160 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:00:34.233268 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999004139000135 future=<Future at 0x7724ec4b1160 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:00:34.236174 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Instance destroyed successfully.
May 28 02:00:34.237173 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 02:00:34.238649 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::8832:afff:fe8a:cd4c', 'fe80::fc16:3eff:fe48:7d7b', 'fe80::d0cf:7bff:fef9:3cc3', 'fe80::fc16:3eff:feca:d649', 'fe80::fc16:3eff:fed3:cd06', 'fe80::fc16:3eff:feae:1e12', 'fe80::fc16:3eff:fedf:4521', 'fe80::fc16:3eff:feae:cc0f', 'fe80::9020:88ff:fe40:d02', 'fe80::fc16:3eff:fe76:c53f', 'fe80::fc16:3eff:feca:8ce2', 'fe80::5048:4dff:fe67:fb12', 'fe80::fc16:3eff:feff:a688', 'fe80::34e0:eeff:fee2:bede', 'fe80::fc16:3eff:fee8:1f', 'fe80::fc16:3eff:fe57:9502'] 
May 28 02:00:34.238778 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 02:00:34.238993 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 02:00:34.239345 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:00:34.239592 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Updating existing volume attachment record: 9a5c6063-a379-4874-9bf1-b3fd80786447 {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 02:00:34.242785 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-86395768-d00b-4796-bfa8-f406567d388a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lazy-loading 'resources' on Instance uuid d203e779-f827-4964-a8a9-368a89aab0e2 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:00:34.376959 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:34.749104 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-86395768-d00b-4796-bfa8-f406567d388a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:59:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-218353403',display_name='tempest-AttachVolumeNegativeTest-server-218353403',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-attachvolumenegativetest-server-218353403',id=39,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAR6qm2SzAM5ZRji1PwP4aBBgg7bEEInlQx+Ub4Z75TCmWKgZhzsWZympeTvtcR03nPN6xXXb4c5Iods7GMRDClU886h3X/tIS57gWA/xe1JPrTHz9BC20e6/FeY5iKvTQ==',key_name='tempest-keypair-1570349597',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:59:38Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='837663bcfa40402aaf583729dfbb26cd',ramdisk_id='',reservation_id='r-v1g4jqdj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-169599115',owner_user_name='tempest-AttachVolumeNegativeTest-169599115-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:59:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='00cb6190618b45eb994dd16d3c657f01',uuid=d203e779-f827-4964-a8a9-368a89aab0e2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64151141-350a-4b34-b2a6-316b8dbefd14", "address": "fa:16:3e:f3:68:03", "network": {"id": "62e7cc38-1758-4b09-a352-4635adc9cfea", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587967507-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "837663bcfa40402aaf583729dfbb26cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap64151141-35", "ovs_interfaceid": "64151141-350a-4b34-b2a6-316b8dbefd14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:00:34.749104 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-86395768-d00b-4796-bfa8-f406567d388a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Converting VIF {"id": "64151141-350a-4b34-b2a6-316b8dbefd14", "address": "fa:16:3e:f3:68:03", "network": {"id": "62e7cc38-1758-4b09-a352-4635adc9cfea", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587967507-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "837663bcfa40402aaf583729dfbb26cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap64151141-35", "ovs_interfaceid": "64151141-350a-4b34-b2a6-316b8dbefd14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:00:34.749104 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-86395768-d00b-4796-bfa8-f406567d388a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:68:03,bridge_name='br-int',has_traffic_filtering=True,id=64151141-350a-4b34-b2a6-316b8dbefd14,network=Network(62e7cc38-1758-4b09-a352-4635adc9cfea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64151141-35') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:00:34.749104 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-86395768-d00b-4796-bfa8-f406567d388a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:68:03,bridge_name='br-int',has_traffic_filtering=True,id=64151141-350a-4b34-b2a6-316b8dbefd14,network=Network(62e7cc38-1758-4b09-a352-4635adc9cfea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64151141-35') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:00:34.750671 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:34.751006 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64151141-35, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:00:34.760820 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:34.760820 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:00:34.760820 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:34.762067 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:34.762416 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ab93d03b-928b-4a71-be09-bebf9db91307) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:00:34.764571 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:34.764571 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:00:34.764571 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:34.766356 np0000001583 nova-compute[98241]: INFO os_vif [None req-86395768-d00b-4796-bfa8-f406567d388a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:68:03,bridge_name='br-int',has_traffic_filtering=True,id=64151141-350a-4b34-b2a6-316b8dbefd14,network=Network(62e7cc38-1758-4b09-a352-4635adc9cfea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64151141-35')
May 28 02:00:34.766849 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-86395768-d00b-4796-bfa8-f406567d388a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Deleting instance files /opt/stack/data/nova/instances/d203e779-f827-4964-a8a9-368a89aab0e2_del
May 28 02:00:34.769151 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-86395768-d00b-4796-bfa8-f406567d388a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Deletion of /opt/stack/data/nova/instances/d203e779-f827-4964-a8a9-368a89aab0e2_del complete
May 28 02:00:34.809861 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 02:00:34.810313 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2b9c7b2e-ce89-46a0-a020-361646147ba3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:00:34.810481 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:00:34.810907 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:00:34.811152 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2b9c7b2e-ce89-46a0-a020-361646147ba3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 02:00:34.825574 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:00:34.826398 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:00:34.826868 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:00:34.827327 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:00:34.827567 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:00:34.827827 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: node.startup = automatic
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: node.session.scan = manual
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:00:34.842893 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:00:34.842893 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: node.startup = automatic
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: node.session.scan = manual
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:00:34.848916 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:00:34.848916 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:34.858369 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:34.866484 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:34.879607 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:34.879607 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:34.879607 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:34.879607 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:34.879607 np0000001583 nova-compute[98241]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:34.879607 np0000001583 nova-compute[98241]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:34.879607 np0000001583 nova-compute[98241]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:34.879607 np0000001583 nova-compute[98241]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:34.879607 np0000001583 nova-compute[98241]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:34.879607 np0000001583 nova-compute[98241]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:34.879607 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:34.879607 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:34.879607 np0000001583 nova-compute[98241]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48c9ef55-3b01-491a-b589-2b61ee01b6f8 (non-flash)
May 28 02:00:34.879607 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:00:34.879607 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:34.879607 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:34.879607 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:34.879607 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:34.879607 np0000001583 nova-compute[98241]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:34.879607 np0000001583 nova-compute[98241]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:34.879607 np0000001583 nova-compute[98241]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:34.879607 np0000001583 nova-compute[98241]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:34.879607 np0000001583 nova-compute[98241]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:34.879607 np0000001583 nova-compute[98241]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:34.879607 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:34.879607 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:34.879607 np0000001583 nova-compute[98241]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48c9ef55-3b01-491a-b589-2b61ee01b6f8 (non-flash)
May 28 02:00:34.879607 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:00:34.880440 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.053s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:00:34.880440 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:00:34.881584 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] HCTL ('15', '0', '0', 0) found on session 91 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:00:34.881797 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Scanning host 15 c: 0, t: 0, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:00:34.891209 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Searching for a device in session 91 and hctl ('15', '0', '0', 0) yield: sdj {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:00:34.891478 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2b9c7b2e-ce89-46a0-a020-361646147ba3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:00:34.893921 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:34.893921 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:34.893921 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:34.893921 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:34.893921 np0000001583 nova-compute[98241]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:34.893921 np0000001583 nova-compute[98241]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:34.893921 np0000001583 nova-compute[98241]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:34.893921 np0000001583 nova-compute[98241]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:34.893921 np0000001583 nova-compute[98241]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:34.893921 np0000001583 nova-compute[98241]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:34.893921 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:34.893921 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:34.893921 np0000001583 nova-compute[98241]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48c9ef55-3b01-491a-b589-2b61ee01b6f8 (non-flash)
May 28 02:00:34.893921 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:00:34.894383 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:34.894383 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:34.894383 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:34.894383 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:34.894383 np0000001583 nova-compute[98241]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:34.894383 np0000001583 nova-compute[98241]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:34.894383 np0000001583 nova-compute[98241]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:34.894383 np0000001583 nova-compute[98241]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:34.894383 np0000001583 nova-compute[98241]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:34.894383 np0000001583 nova-compute[98241]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:34.894383 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:34.894383 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:34.894383 np0000001583 nova-compute[98241]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48c9ef55-3b01-491a-b589-2b61ee01b6f8 (non-flash)
May 28 02:00:34.894383 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:00:34.894755 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.067s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:00:34.894755 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:00:34.895770 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] HCTL ('20', '0', '0', 0) found on session 92 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:00:34.895927 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Scanning host 20 c: 0, t: 0, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:00:34.908342 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Searching for a device in session 92 and hctl ('20', '0', '0', 0) yield: sdo {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:00:34.908500 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2b9c7b2e-ce89-46a0-a020-361646147ba3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:00:35.277787 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-86395768-d00b-4796-bfa8-f406567d388a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Took 1.38 seconds to destroy the instance on the hypervisor.
May 28 02:00:35.278335 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-86395768-d00b-4796-bfa8-f406567d388a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 02:00:35.280717 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 02:00:35.280717 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 02:00:35.280717 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:00:35.397521 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:00:35.830401 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 02:00:36.277273 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d7dda794-6b3a-4f08-a21b-b7ae14e6ec7e req-90d27249-f724-453a-8836-fa1445f73bf8 service nova] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Received event network-vif-unplugged-64151141-350a-4b34-b2a6-316b8dbefd14 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:00:36.277681 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d7dda794-6b3a-4f08-a21b-b7ae14e6ec7e req-90d27249-f724-453a-8836-fa1445f73bf8 service nova] Acquiring lock "d203e779-f827-4964-a8a9-368a89aab0e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:36.277681 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d7dda794-6b3a-4f08-a21b-b7ae14e6ec7e req-90d27249-f724-453a-8836-fa1445f73bf8 service nova] Lock "d203e779-f827-4964-a8a9-368a89aab0e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:36.277766 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d7dda794-6b3a-4f08-a21b-b7ae14e6ec7e req-90d27249-f724-453a-8836-fa1445f73bf8 service nova] Lock "d203e779-f827-4964-a8a9-368a89aab0e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:36.278005 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d7dda794-6b3a-4f08-a21b-b7ae14e6ec7e req-90d27249-f724-453a-8836-fa1445f73bf8 service nova] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] No waiting events found dispatching network-vif-unplugged-64151141-350a-4b34-b2a6-316b8dbefd14 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:00:36.278005 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d7dda794-6b3a-4f08-a21b-b7ae14e6ec7e req-90d27249-f724-453a-8836-fa1445f73bf8 service nova] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Received event network-vif-unplugged-64151141-350a-4b34-b2a6-316b8dbefd14 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:00:36.278441 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d7dda794-6b3a-4f08-a21b-b7ae14e6ec7e req-90d27249-f724-453a-8836-fa1445f73bf8 service nova] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Received event network-vif-deleted-64151141-350a-4b34-b2a6-316b8dbefd14 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:00:36.278773 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-d7dda794-6b3a-4f08-a21b-b7ae14e6ec7e req-90d27249-f724-453a-8836-fa1445f73bf8 service nova] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Neutron deleted interface 64151141-350a-4b34-b2a6-316b8dbefd14; detaching it from the instance and deleting it from the info cache
May 28 02:00:36.283573 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d7dda794-6b3a-4f08-a21b-b7ae14e6ec7e req-90d27249-f724-453a-8836-fa1445f73bf8 service nova] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Detach interface failed, port_id=64151141-350a-4b34-b2a6-316b8dbefd14, reason: Instance d203e779-f827-4964-a8a9-368a89aab0e2 could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 02:00:36.330556 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:00:36.835881 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Took 1.56 seconds to deallocate network for instance.
May 28 02:00:36.867610 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Found WWN 330000000e4a7908f for multipath device dm-10 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 02:00:36.867944 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.057s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:00:36.868203 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] <== connect_volume: return (2057ms) {'type': 'block', 'scsi_wwn': '330000000e4a7908f', 'path': '/dev/dm-10', 'multipath_id': '330000000e4a7908f'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:00:36.868368 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e4a7908f', 'path': '/dev/dm-10', 'multipath_id': '330000000e4a7908f'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 02:00:36.872474 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lazy-loading 'flavor' on Instance uuid 21c4e225-440e-4103-adaf-cb470d172291 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:00:37.342801 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-86395768-d00b-4796-bfa8-f406567d388a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:37.343866 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-86395768-d00b-4796-bfa8-f406567d388a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:37.376758 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Attempting to attach volume 2b9c7b2e-ce89-46a0-a020-361646147ba3 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98241) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 02:00:37.377777 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] attach device xml: <disk type="block" device="disk">
May 28 02:00:37.377777 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:00:37.377777 np0000001583 nova-compute[98241]:   <alias name="ua-2b9c7b2e-ce89-46a0-a020-361646147ba3"/>
May 28 02:00:37.377777 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-10"/>
May 28 02:00:37.377777 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:00:37.377777 np0000001583 nova-compute[98241]:   <serial>2b9c7b2e-ce89-46a0-a020-361646147ba3</serial>
May 28 02:00:37.377777 np0000001583 nova-compute[98241]:   <shareable/>
May 28 02:00:37.377777 np0000001583 nova-compute[98241]: </disk>
May 28 02:00:37.377777 np0000001583 nova-compute[98241]:  {{(pid=98241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 02:00:37.551251 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f1272e6d-f2b2-4dd6-9e88-1645c6589473 req-41b71bce-5fb9-4021-be82-ff2b9dd614d7 service nova] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Received event network-changed-1bce33b1-57be-4de9-9e81-1a05535ae317 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:00:37.554238 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f1272e6d-f2b2-4dd6-9e88-1645c6589473 req-41b71bce-5fb9-4021-be82-ff2b9dd614d7 service nova] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Refreshing instance network info cache due to event network-changed-1bce33b1-57be-4de9-9e81-1a05535ae317. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:00:37.554238 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f1272e6d-f2b2-4dd6-9e88-1645c6589473 req-41b71bce-5fb9-4021-be82-ff2b9dd614d7 service nova] Acquiring lock "refresh_cache-8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:00:37.554238 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f1272e6d-f2b2-4dd6-9e88-1645c6589473 req-41b71bce-5fb9-4021-be82-ff2b9dd614d7 service nova] Acquired lock "refresh_cache-8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:00:37.554238 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-f1272e6d-f2b2-4dd6-9e88-1645c6589473 req-41b71bce-5fb9-4021-be82-ff2b9dd614d7 service nova] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Refreshing network info cache for port 1bce33b1-57be-4de9-9e81-1a05535ae317 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:00:38.023903 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-86395768-d00b-4796-bfa8-f406567d388a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:00:38.024235 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-86395768-d00b-4796-bfa8-f406567d388a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:00:38.056987 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-f1272e6d-f2b2-4dd6-9e88-1645c6589473 req-41b71bce-5fb9-4021-be82-ff2b9dd614d7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:00:38.197389 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b00622b8-64cf-4577-86e1-7f33333bb414 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Acquiring lock "8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:38.197601 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b00622b8-64cf-4577-86e1-7f33333bb414 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:38.221459 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:38.348446 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-c2ad0731-cf92-4193-b5c4-1967c495c2f7 req-5ab3ab62-9002-47f5-8cbe-d5c08ca422a2 service nova] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Received event network-changed-1bce33b1-57be-4de9-9e81-1a05535ae317 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:00:38.349254 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-c2ad0731-cf92-4193-b5c4-1967c495c2f7 req-5ab3ab62-9002-47f5-8cbe-d5c08ca422a2 service nova] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Refreshing instance network info cache due to event network-changed-1bce33b1-57be-4de9-9e81-1a05535ae317. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:00:38.349471 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c2ad0731-cf92-4193-b5c4-1967c495c2f7 req-5ab3ab62-9002-47f5-8cbe-d5c08ca422a2 service nova] Acquiring lock "refresh_cache-8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:00:38.412641 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-f1272e6d-f2b2-4dd6-9e88-1645c6589473 req-41b71bce-5fb9-4021-be82-ff2b9dd614d7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:00:38.527448 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-86395768-d00b-4796-bfa8-f406567d388a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:00:38.567657 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-f1272e6d-f2b2-4dd6-9e88-1645c6589473 req-41b71bce-5fb9-4021-be82-ff2b9dd614d7 service nova] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Updated VIF entry in instance network info cache for port 1bce33b1-57be-4de9-9e81-1a05535ae317. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:00:38.567916 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-f1272e6d-f2b2-4dd6-9e88-1645c6589473 req-41b71bce-5fb9-4021-be82-ff2b9dd614d7 service nova] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Updating instance_info_cache with network_info: [{"id": "1bce33b1-57be-4de9-9e81-1a05535ae317", "address": "fa:16:3e:ae:cc:0f", "network": {"id": "c18d43cf-482c-4814-96a1-09aab2287be4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2071326233-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d5cfe906dd24a10819b92c144f7f06f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bce33b1-57", "ovs_interfaceid": "1bce33b1-57be-4de9-9e81-1a05535ae317", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:00:38.701315 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-b00622b8-64cf-4577-86e1-7f33333bb414 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Detaching volume fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9
May 28 02:00:38.759632 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-b00622b8-64cf-4577-86e1-7f33333bb414 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Attempting to driver detach volume fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 from mountpoint /dev/vdb
May 28 02:00:38.763189 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b00622b8-64cf-4577-86e1-7f33333bb414 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Found disk vdb by alias ua-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:00:38.764112 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b00622b8-64cf-4577-86e1-7f33333bb414 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Found disk vdb by alias ua-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:00:38.764231 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b00622b8-64cf-4577-86e1-7f33333bb414 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Attempting to detach device vdb from instance 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d from the persistent domain config. {{(pid=98241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 02:00:38.764546 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-b00622b8-64cf-4577-86e1-7f33333bb414 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:00:38.764546 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:00:38.764546 np0000001583 nova-compute[98241]:   <alias name="ua-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9"/>
May 28 02:00:38.764546 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-5"/>
May 28 02:00:38.764546 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:00:38.764546 np0000001583 nova-compute[98241]:   <serial>fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9</serial>
May 28 02:00:38.764546 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 02:00:38.764546 np0000001583 nova-compute[98241]: </disk>
May 28 02:00:38.764546 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:00:38.769921 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-b00622b8-64cf-4577-86e1-7f33333bb414 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Successfully detached device vdb from instance 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d from the persistent domain config.
May 28 02:00:38.770151 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b00622b8-64cf-4577-86e1-7f33333bb414 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] (1/8): Attempting to detach device vdb with device alias ua-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 from instance 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d from the live domain config. {{(pid=98241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 02:00:38.770614 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-b00622b8-64cf-4577-86e1-7f33333bb414 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:00:38.770614 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:00:38.770614 np0000001583 nova-compute[98241]:   <alias name="ua-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9"/>
May 28 02:00:38.770614 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-5"/>
May 28 02:00:38.770614 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:00:38.770614 np0000001583 nova-compute[98241]:   <serial>fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9</serial>
May 28 02:00:38.770614 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 02:00:38.770614 np0000001583 nova-compute[98241]: </disk>
May 28 02:00:38.770614 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:00:39.036305 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-86395768-d00b-4796-bfa8-f406567d388a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.692s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:39.059976 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:00:39.060194 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:00:39.060243 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:00:39.060390 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] No VIF found with MAC fa:16:3e:57:95:02, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:00:39.069697 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f1272e6d-f2b2-4dd6-9e88-1645c6589473 req-41b71bce-5fb9-4021-be82-ff2b9dd614d7 service nova] Releasing lock "refresh_cache-8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:00:39.070268 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c2ad0731-cf92-4193-b5c4-1967c495c2f7 req-5ab3ab62-9002-47f5-8cbe-d5c08ca422a2 service nova] Acquired lock "refresh_cache-8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:00:39.070445 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-c2ad0731-cf92-4193-b5c4-1967c495c2f7 req-5ab3ab62-9002-47f5-8cbe-d5c08ca422a2 service nova] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Refreshing network info cache for port 1bce33b1-57be-4de9-9e81-1a05535ae317 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:00:39.100190 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-86395768-d00b-4796-bfa8-f406567d388a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Deleted allocations for instance d203e779-f827-4964-a8a9-368a89aab0e2
May 28 02:00:39.421442 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Received event <DeviceRemovedEvent: 1779933639.4210532, 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d => ua-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9> from libvirt while the driver is waiting for it; dispatched. {{(pid=98241) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 02:00:39.422908 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b00622b8-64cf-4577-86e1-7f33333bb414 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 for instance 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d {{(pid=98241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 02:00:39.425359 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-b00622b8-64cf-4577-86e1-7f33333bb414 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Successfully detached device vdb from instance 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d from the live domain config.
May 28 02:00:39.429501 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b00622b8-64cf-4577-86e1-7f33333bb414 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:00:39.429844 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00622b8-64cf-4577-86e1-7f33333bb414 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', 'iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:00:39.430001 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-b00622b8-64cf-4577-86e1-7f33333bb414 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:00:39.430330 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-b00622b8-64cf-4577-86e1-7f33333bb414 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:00:39.430595 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00622b8-64cf-4577-86e1-7f33333bb414 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', 'iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:00:39.430747 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00622b8-64cf-4577-86e1-7f33333bb414 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:00:39.463270 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00622b8-64cf-4577-86e1-7f33333bb414 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:39.463270 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:39.463270 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:39.463270 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:39.463270 np0000001583 nova-compute[98241]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:39.463270 np0000001583 nova-compute[98241]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:39.463270 np0000001583 nova-compute[98241]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:39.463270 np0000001583 nova-compute[98241]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:39.463270 np0000001583 nova-compute[98241]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:39.463270 np0000001583 nova-compute[98241]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:39.463270 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:39.463270 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:39.463270 np0000001583 nova-compute[98241]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48c9ef55-3b01-491a-b589-2b61ee01b6f8 (non-flash)
May 28 02:00:39.463270 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:00:39.463912 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00622b8-64cf-4577-86e1-7f33333bb414 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:39.463912 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:39.463912 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:39.463912 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:39.463912 np0000001583 nova-compute[98241]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:39.463912 np0000001583 nova-compute[98241]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9 (non-flash)
May 28 02:00:39.463912 np0000001583 nova-compute[98241]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:39.463912 np0000001583 nova-compute[98241]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:39.463912 np0000001583 nova-compute[98241]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:39.463912 np0000001583 nova-compute[98241]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:39.463912 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:39.463912 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:39.463912 np0000001583 nova-compute[98241]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48c9ef55-3b01-491a-b589-2b61ee01b6f8 (non-flash)
May 28 02:00:39.463912 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:00:39.463912 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00622b8-64cf-4577-86e1-7f33333bb414 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', '68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', '69'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376', '78'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376', '79'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', '82'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', '83'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57', '85'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57', '86'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d', '87'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d', '88'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', '91'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', '92'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-48c9ef55-3b01-491a-b589-2b61ee01b6f8', '93')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:00:39.463912 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00622b8-64cf-4577-86e1-7f33333bb414 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', '83')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:00:39.464776 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00622b8-64cf-4577-86e1-7f33333bb414 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9', '82')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:00:39.465644 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00622b8-64cf-4577-86e1-7f33333bb414 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f83336a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9'): ({'sdf'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:00:39.465830 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-b00622b8-64cf-4577-86e1-7f33333bb414 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Removing multipathed devices sdf, sdg {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:00:39.466066 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-b00622b8-64cf-4577-86e1-7f33333bb414 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Flush multipath device 330000000f1131f9e {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:00:39.503103 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-b00622b8-64cf-4577-86e1-7f33333bb414 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:00:39.544660 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-b00622b8-64cf-4577-86e1-7f33333bb414 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:00:39.575115 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-c2ad0731-cf92-4193-b5c4-1967c495c2f7 req-5ab3ab62-9002-47f5-8cbe-d5c08ca422a2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:00:39.608262 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-b00622b8-64cf-4577-86e1-7f33333bb414 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:00:39.608605 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-b00622b8-64cf-4577-86e1-7f33333bb414 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:00:39.610592 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-b00622b8-64cf-4577-86e1-7f33333bb414 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:00:39.622620 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-b00622b8-64cf-4577-86e1-7f33333bb414 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:00:39.622820 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00622b8-64cf-4577-86e1-7f33333bb414 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:00:39.636813 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00622b8-64cf-4577-86e1-7f33333bb414 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:39.681415 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00622b8-64cf-4577-86e1-7f33333bb414 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 83, target: iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9, portal: 192.168.40.100,3260]
May 28 02:00:39.681415 np0000001583 nova-compute[98241]: Logout of [sid: 83, target: iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9, portal: 192.168.40.100,3260] successful.
May 28 02:00:39.681415 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:39.709899 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00622b8-64cf-4577-86e1-7f33333bb414 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:39.725298 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00622b8-64cf-4577-86e1-7f33333bb414 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:39.764709 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:39.766586 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00622b8-64cf-4577-86e1-7f33333bb414 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 82, target: iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9, portal: 192.168.50.100,3260]
May 28 02:00:39.766586 np0000001583 nova-compute[98241]: Logout of [sid: 82, target: iqn.2023-03.storpool.com:os--volume-fd78edb5-bc3b-44fd-a1b6-2bd76d90ecb9, portal: 192.168.50.100,3260] successful.
May 28 02:00:39.766586 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:39.797687 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00622b8-64cf-4577-86e1-7f33333bb414 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:39.797912 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-b00622b8-64cf-4577-86e1-7f33333bb414 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:00:39.798004 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00622b8-64cf-4577-86e1-7f33333bb414 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] <== disconnect_volume: return (368ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:00:39.798123 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b00622b8-64cf-4577-86e1-7f33333bb414 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:00:39.950349 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-c2ad0731-cf92-4193-b5c4-1967c495c2f7 req-5ab3ab62-9002-47f5-8cbe-d5c08ca422a2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:00:40.111647 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-86395768-d00b-4796-bfa8-f406567d388a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "d203e779-f827-4964-a8a9-368a89aab0e2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.728s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:40.138447 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-c2ad0731-cf92-4193-b5c4-1967c495c2f7 req-5ab3ab62-9002-47f5-8cbe-d5c08ca422a2 service nova] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Updated VIF entry in instance network info cache for port 1bce33b1-57be-4de9-9e81-1a05535ae317. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:00:40.138850 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-c2ad0731-cf92-4193-b5c4-1967c495c2f7 req-5ab3ab62-9002-47f5-8cbe-d5c08ca422a2 service nova] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Updating instance_info_cache with network_info: [{"id": "1bce33b1-57be-4de9-9e81-1a05535ae317", "address": "fa:16:3e:ae:cc:0f", "network": {"id": "c18d43cf-482c-4814-96a1-09aab2287be4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2071326233-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d5cfe906dd24a10819b92c144f7f06f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bce33b1-57", "ovs_interfaceid": "1bce33b1-57be-4de9-9e81-1a05535ae317", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:00:40.366451 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-b00622b8-64cf-4577-86e1-7f33333bb414 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lazy-loading 'flavor' on Instance uuid 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:00:40.643036 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c2ad0731-cf92-4193-b5c4-1967c495c2f7 req-5ab3ab62-9002-47f5-8cbe-d5c08ca422a2 service nova] Releasing lock "refresh_cache-8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:00:40.647728 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-108dea7e-8faa-49c2-86d3-e0dd56424c27 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "21c4e225-440e-4103-adaf-cb470d172291" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.619s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:40.673831 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3e9d7dfe-d938-402f-997a-1b9c84066f2b tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Acquiring lock "d4fad20b-d51e-47c9-8f55-3aa085a10891" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:40.673831 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3e9d7dfe-d938-402f-997a-1b9c84066f2b tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "d4fad20b-d51e-47c9-8f55-3aa085a10891" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:41.177530 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-3e9d7dfe-d938-402f-997a-1b9c84066f2b tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Detaching volume 8ea99ade-a69e-46e2-9c9d-6251e4f69a57
May 28 02:00:41.248010 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-3e9d7dfe-d938-402f-997a-1b9c84066f2b tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Attempting to driver detach volume 8ea99ade-a69e-46e2-9c9d-6251e4f69a57 from mountpoint /dev/vdb
May 28 02:00:41.257398 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3e9d7dfe-d938-402f-997a-1b9c84066f2b tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Found disk vdb by alias ua-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:00:41.259493 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3e9d7dfe-d938-402f-997a-1b9c84066f2b tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Found disk vdb by alias ua-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:00:41.259694 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3e9d7dfe-d938-402f-997a-1b9c84066f2b tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Attempting to detach device vdb from instance d4fad20b-d51e-47c9-8f55-3aa085a10891 from the persistent domain config. {{(pid=98241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 02:00:41.260027 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-3e9d7dfe-d938-402f-997a-1b9c84066f2b tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:00:41.260027 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:00:41.260027 np0000001583 nova-compute[98241]:   <alias name="ua-8ea99ade-a69e-46e2-9c9d-6251e4f69a57"/>
May 28 02:00:41.260027 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-6"/>
May 28 02:00:41.260027 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:00:41.260027 np0000001583 nova-compute[98241]:   <serial>8ea99ade-a69e-46e2-9c9d-6251e4f69a57</serial>
May 28 02:00:41.260027 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 02:00:41.260027 np0000001583 nova-compute[98241]: </disk>
May 28 02:00:41.260027 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:00:41.268370 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-3e9d7dfe-d938-402f-997a-1b9c84066f2b tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Successfully detached device vdb from instance d4fad20b-d51e-47c9-8f55-3aa085a10891 from the persistent domain config.
May 28 02:00:41.268655 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3e9d7dfe-d938-402f-997a-1b9c84066f2b tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] (1/8): Attempting to detach device vdb with device alias ua-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 from instance d4fad20b-d51e-47c9-8f55-3aa085a10891 from the live domain config. {{(pid=98241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 02:00:41.268961 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-3e9d7dfe-d938-402f-997a-1b9c84066f2b tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:00:41.268961 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:00:41.268961 np0000001583 nova-compute[98241]:   <alias name="ua-8ea99ade-a69e-46e2-9c9d-6251e4f69a57"/>
May 28 02:00:41.268961 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-6"/>
May 28 02:00:41.268961 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:00:41.268961 np0000001583 nova-compute[98241]:   <serial>8ea99ade-a69e-46e2-9c9d-6251e4f69a57</serial>
May 28 02:00:41.268961 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 02:00:41.268961 np0000001583 nova-compute[98241]: </disk>
May 28 02:00:41.268961 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:00:41.373463 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b00622b8-64cf-4577-86e1-7f33333bb414 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.175s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:41.952924 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Received event <DeviceRemovedEvent: 1779933641.952372, d4fad20b-d51e-47c9-8f55-3aa085a10891 => ua-8ea99ade-a69e-46e2-9c9d-6251e4f69a57> from libvirt while the driver is waiting for it; dispatched. {{(pid=98241) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 02:00:41.957031 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3e9d7dfe-d938-402f-997a-1b9c84066f2b tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 for instance d4fad20b-d51e-47c9-8f55-3aa085a10891 {{(pid=98241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 02:00:41.961303 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-3e9d7dfe-d938-402f-997a-1b9c84066f2b tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Successfully detached device vdb from instance d4fad20b-d51e-47c9-8f55-3aa085a10891 from the live domain config.
May 28 02:00:41.964221 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e9d7dfe-d938-402f-997a-1b9c84066f2b tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:00:41.964589 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9d7dfe-d938-402f-997a-1b9c84066f2b tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57', 'iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8ea99ade-a69e-46e2-9c9d-6251e4f69a57', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': False}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:00:41.964784 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-3e9d7dfe-d938-402f-997a-1b9c84066f2b tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:00:41.965226 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-3e9d7dfe-d938-402f-997a-1b9c84066f2b tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:00:41.965602 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9d7dfe-d938-402f-997a-1b9c84066f2b tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57', 'iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8ea99ade-a69e-46e2-9c9d-6251e4f69a57', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:00:41.965794 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9d7dfe-d938-402f-997a-1b9c84066f2b tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:00:42.010459 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9d7dfe-d938-402f-997a-1b9c84066f2b tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:42.010459 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:42.010459 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:42.010459 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:42.010459 np0000001583 nova-compute[98241]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:42.010459 np0000001583 nova-compute[98241]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:42.010459 np0000001583 nova-compute[98241]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:42.010459 np0000001583 nova-compute[98241]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:42.010459 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:42.010459 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:42.010459 np0000001583 nova-compute[98241]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48c9ef55-3b01-491a-b589-2b61ee01b6f8 (non-flash)
May 28 02:00:42.010459 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:00:42.010902 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9d7dfe-d938-402f-997a-1b9c84066f2b tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:42.010902 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:42.010902 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:42.010902 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:42.010902 np0000001583 nova-compute[98241]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:42.010902 np0000001583 nova-compute[98241]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57 (non-flash)
May 28 02:00:42.010902 np0000001583 nova-compute[98241]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:42.010902 np0000001583 nova-compute[98241]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:42.010902 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:42.010902 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:42.010902 np0000001583 nova-compute[98241]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48c9ef55-3b01-491a-b589-2b61ee01b6f8 (non-flash)
May 28 02:00:42.010902 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:00:42.010902 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9d7dfe-d938-402f-997a-1b9c84066f2b tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', '68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', '69'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376', '78'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376', '79'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57', '85'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57', '86'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d', '87'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d', '88'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', '91'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', '92'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-48c9ef55-3b01-491a-b589-2b61ee01b6f8', '93')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:00:42.010902 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9d7dfe-d938-402f-997a-1b9c84066f2b tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57', '85')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:00:42.012050 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9d7dfe-d938-402f-997a-1b9c84066f2b tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57', '86')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:00:42.013148 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9d7dfe-d938-402f-997a-1b9c84066f2b tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f90b9a80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57'): ({'sdl'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:00:42.013631 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3e9d7dfe-d938-402f-997a-1b9c84066f2b tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Removing multipathed devices sdk, sdl {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:00:42.013631 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3e9d7dfe-d938-402f-997a-1b9c84066f2b tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Flush multipath device 330000000279bfb87 {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:00:42.047940 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3e9d7dfe-d938-402f-997a-1b9c84066f2b tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:00:42.100227 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3e9d7dfe-d938-402f-997a-1b9c84066f2b tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:00:42.150953 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3e9d7dfe-d938-402f-997a-1b9c84066f2b tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Checking to see if SCSI volumes sdk, sdl have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:00:42.151236 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3e9d7dfe-d938-402f-997a-1b9c84066f2b tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] SCSI volumes sdk, sdl have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:00:42.153845 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3e9d7dfe-d938-402f-997a-1b9c84066f2b tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Checking to see if device paths {'sdk', 'sdl'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:00:42.167689 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3e9d7dfe-d938-402f-997a-1b9c84066f2b tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Device paths {'sdk', 'sdl'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:00:42.167944 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9d7dfe-d938-402f-997a-1b9c84066f2b tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:00:42.180348 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9d7dfe-d938-402f-997a-1b9c84066f2b tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:42.221974 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9d7dfe-d938-402f-997a-1b9c84066f2b tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 85, target: iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57, portal: 192.168.40.100,3260]
May 28 02:00:42.221974 np0000001583 nova-compute[98241]: Logout of [sid: 85, target: iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57, portal: 192.168.40.100,3260] successful.
May 28 02:00:42.221974 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:42.241192 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9d7dfe-d938-402f-997a-1b9c84066f2b tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:42.253764 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9d7dfe-d938-402f-997a-1b9c84066f2b tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:42.295137 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9d7dfe-d938-402f-997a-1b9c84066f2b tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 86, target: iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57, portal: 192.168.50.100,3260]
May 28 02:00:42.295137 np0000001583 nova-compute[98241]: Logout of [sid: 86, target: iqn.2023-03.storpool.com:os--volume-8ea99ade-a69e-46e2-9c9d-6251e4f69a57, portal: 192.168.50.100,3260] successful.
May 28 02:00:42.295137 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:42.326800 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9d7dfe-d938-402f-997a-1b9c84066f2b tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:42.326800 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-3e9d7dfe-d938-402f-997a-1b9c84066f2b tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:00:42.326800 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9d7dfe-d938-402f-997a-1b9c84066f2b tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] <== disconnect_volume: return (362ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:00:42.327192 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e9d7dfe-d938-402f-997a-1b9c84066f2b tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:00:42.614730 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Stashing vm_state: active {{(pid=98241) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 28 02:00:42.753166 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5b4ee1e1-3b35-4e7f-8e86-e033358c3622 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Acquiring lock "8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:42.753358 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5b4ee1e1-3b35-4e7f-8e86-e033358c3622 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:42.753555 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5b4ee1e1-3b35-4e7f-8e86-e033358c3622 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Acquiring lock "8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:42.754250 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5b4ee1e1-3b35-4e7f-8e86-e033358c3622 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:42.754359 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5b4ee1e1-3b35-4e7f-8e86-e033358c3622 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:42.757727 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-5b4ee1e1-3b35-4e7f-8e86-e033358c3622 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Terminating instance
May 28 02:00:42.876679 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-3e9d7dfe-d938-402f-997a-1b9c84066f2b tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lazy-loading 'flavor' on Instance uuid d4fad20b-d51e-47c9-8f55-3aa085a10891 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:00:43.186309 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:43.186309 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:43.225388 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:43.261030 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-5b4ee1e1-3b35-4e7f-8e86-e033358c3622 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 02:00:43.281433 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:43.285987 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:43.308159 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:43.312740 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:43.338757 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:43.339925 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:43.508232 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-00f7debc-1f8d-4f96-9cb6-7a35bcad1fcd req-0ed6d1af-2a53-4143-a0df-2fb6421c6b91 service nova] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Received event network-vif-unplugged-1bce33b1-57be-4de9-9e81-1a05535ae317 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:00:43.510721 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-00f7debc-1f8d-4f96-9cb6-7a35bcad1fcd req-0ed6d1af-2a53-4143-a0df-2fb6421c6b91 service nova] Acquiring lock "8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:43.512338 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-00f7debc-1f8d-4f96-9cb6-7a35bcad1fcd req-0ed6d1af-2a53-4143-a0df-2fb6421c6b91 service nova] Lock "8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:43.512921 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-00f7debc-1f8d-4f96-9cb6-7a35bcad1fcd req-0ed6d1af-2a53-4143-a0df-2fb6421c6b91 service nova] Lock "8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:43.513314 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-00f7debc-1f8d-4f96-9cb6-7a35bcad1fcd req-0ed6d1af-2a53-4143-a0df-2fb6421c6b91 service nova] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] No waiting events found dispatching network-vif-unplugged-1bce33b1-57be-4de9-9e81-1a05535ae317 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:00:43.513314 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-00f7debc-1f8d-4f96-9cb6-7a35bcad1fcd req-0ed6d1af-2a53-4143-a0df-2fb6421c6b91 service nova] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Received event network-vif-unplugged-1bce33b1-57be-4de9-9e81-1a05535ae317 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:00:43.629697 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999609372000123 future=<Future at 0x7724ec2f70e0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:00:43.631617 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Instance destroyed successfully.
May 28 02:00:43.633226 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-5b4ee1e1-3b35-4e7f-8e86-e033358c3622 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lazy-loading 'resources' on Instance uuid 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:00:43.666992 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "01d8de67-23ab-4430-8512-d2fece776ac2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:43.667167 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "01d8de67-23ab-4430-8512-d2fece776ac2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:43.694007 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 02:00:43.694239 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Claim successful on node np0000001583
May 28 02:00:43.883865 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3e9d7dfe-d938-402f-997a-1b9c84066f2b tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "d4fad20b-d51e-47c9-8f55-3aa085a10891" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.210s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:43.936353 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f1aa2169-89b1-4d75-b978-1a5470b721a5 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Acquiring lock "d4fad20b-d51e-47c9-8f55-3aa085a10891" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:43.936601 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f1aa2169-89b1-4d75-b978-1a5470b721a5 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "d4fad20b-d51e-47c9-8f55-3aa085a10891" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:43.936805 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f1aa2169-89b1-4d75-b978-1a5470b721a5 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:00:43.939887 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f1aa2169-89b1-4d75-b978-1a5470b721a5 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=98241) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 28 02:00:43.940428 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-f1aa2169-89b1-4d75-b978-1a5470b721a5 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lazy-loading 'flavor' on Instance uuid d4fad20b-d51e-47c9-8f55-3aa085a10891 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:00:44.135339 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-5b4ee1e1-3b35-4e7f-8e86-e033358c3622 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:58:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1116550051',display_name='tempest-TestMinimumBasicScenario-server-1116550051',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testminimumbasicscenario-server-1116550051',id=37,image_ref='2cc2ffd4-9757-447d-a451-53527f5bcc1f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMULG2kTEY+WhVbRzbS6xOD6CJCgxm22CYbbQxg0BTn9Kii/R8Mt6h4nIBTEe0X4SkZIt8ct5xyc3FmGuzZLRtxpNB61Zb7jVrz/BvdWxTdtIMJsifze5TU8LnUgQB0QDQ==',key_name='tempest-TestMinimumBasicScenario-2031915617',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:59:05Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d5cfe906dd24a10819b92c144f7f06f',ramdisk_id='',reservation_id='r-q03o3420',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2cc2ffd4-9757-447d-a451-53527f5bcc1f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1092247749',owner_user_name='tempest-TestMinimumBasicScenario-1092247749-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:59:58Z,user_data=None,user_id='f52a7ae7fbc644deb82f3382de3a4edd',uuid=8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1bce33b1-57be-4de9-9e81-1a05535ae317", "address": "fa:16:3e:ae:cc:0f", "network": {"id": "c18d43cf-482c-4814-96a1-09aab2287be4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2071326233-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d5cfe906dd24a10819b92c144f7f06f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bce33b1-57", "ovs_interfaceid": "1bce33b1-57be-4de9-9e81-1a05535ae317", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:00:44.135732 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-5b4ee1e1-3b35-4e7f-8e86-e033358c3622 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Converting VIF {"id": "1bce33b1-57be-4de9-9e81-1a05535ae317", "address": "fa:16:3e:ae:cc:0f", "network": {"id": "c18d43cf-482c-4814-96a1-09aab2287be4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2071326233-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d5cfe906dd24a10819b92c144f7f06f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bce33b1-57", "ovs_interfaceid": "1bce33b1-57be-4de9-9e81-1a05535ae317", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:00:44.136414 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-5b4ee1e1-3b35-4e7f-8e86-e033358c3622 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:cc:0f,bridge_name='br-int',has_traffic_filtering=True,id=1bce33b1-57be-4de9-9e81-1a05535ae317,network=Network(c18d43cf-482c-4814-96a1-09aab2287be4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bce33b1-57') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:00:44.136721 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-5b4ee1e1-3b35-4e7f-8e86-e033358c3622 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:cc:0f,bridge_name='br-int',has_traffic_filtering=True,id=1bce33b1-57be-4de9-9e81-1a05535ae317,network=Network(c18d43cf-482c-4814-96a1-09aab2287be4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bce33b1-57') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:00:44.138453 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:44.138757 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1bce33b1-57, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:00:44.149572 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:44.151678 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:44.154039 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:44.154257 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2299d027-5c5f-42f2-bfe4-fb2bbb1dad38) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:00:44.154797 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:44.156905 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:44.157366 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:00:44.159288 np0000001583 nova-compute[98241]: INFO os_vif [None req-5b4ee1e1-3b35-4e7f-8e86-e033358c3622 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:cc:0f,bridge_name='br-int',has_traffic_filtering=True,id=1bce33b1-57be-4de9-9e81-1a05535ae317,network=Network(c18d43cf-482c-4814-96a1-09aab2287be4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bce33b1-57')
May 28 02:00:44.159767 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-5b4ee1e1-3b35-4e7f-8e86-e033358c3622 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Deleting instance files /opt/stack/data/nova/instances/8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d_del
May 28 02:00:44.160784 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-5b4ee1e1-3b35-4e7f-8e86-e033358c3622 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Deletion of /opt/stack/data/nova/instances/8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d_del complete
May 28 02:00:44.174835 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 02:00:44.201680 np0000001583 nova-compute[98241]: INFO nova.compute.resource_tracker [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Updating resource usage from migration d0ff9952-fe90-4262-b973-fb57cac9eb40
May 28 02:00:44.666983 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-5b4ee1e1-3b35-4e7f-8e86-e033358c3622 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Took 1.41 seconds to destroy the instance on the hypervisor.
May 28 02:00:44.668312 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-5b4ee1e1-3b35-4e7f-8e86-e033358c3622 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 02:00:44.668715 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 02:00:44.668882 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 02:00:44.669021 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:00:44.771190 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:44.863765 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:00:44.939457 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:00:44.939713 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:00:44.971826 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:44.977224 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:44.996537 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:45.003220 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:45.021467 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:45.026866 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:45.183100 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-704fd731-9982-499b-b4e5-e477813869ea req-5481a807-bbba-4615-a9c3-ad1ca329ef0f service nova] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Received event network-vif-unplugged-0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:00:45.184420 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-704fd731-9982-499b-b4e5-e477813869ea req-5481a807-bbba-4615-a9c3-ad1ca329ef0f service nova] Acquiring lock "d4fad20b-d51e-47c9-8f55-3aa085a10891-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:45.184630 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-704fd731-9982-499b-b4e5-e477813869ea req-5481a807-bbba-4615-a9c3-ad1ca329ef0f service nova] Lock "d4fad20b-d51e-47c9-8f55-3aa085a10891-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:45.184769 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-704fd731-9982-499b-b4e5-e477813869ea req-5481a807-bbba-4615-a9c3-ad1ca329ef0f service nova] Lock "d4fad20b-d51e-47c9-8f55-3aa085a10891-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:45.184921 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-704fd731-9982-499b-b4e5-e477813869ea req-5481a807-bbba-4615-a9c3-ad1ca329ef0f service nova] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] No waiting events found dispatching network-vif-unplugged-0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:00:45.185102 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-704fd731-9982-499b-b4e5-e477813869ea req-5481a807-bbba-4615-a9c3-ad1ca329ef0f service nova] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Received unexpected event network-vif-unplugged-0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b for instance with vm_state active and task_state powering-off.
May 28 02:00:45.259882 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:45.268641 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:45.290692 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999636520999957 future=<Future at 0x7724f81856d0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:00:45.292620 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Instance destroyed successfully.
May 28 02:00:45.293034 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-f1aa2169-89b1-4d75-b978-1a5470b721a5 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lazy-loading 'numa_topology' on Instance uuid d4fad20b-d51e-47c9-8f55-3aa085a10891 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:00:45.445235 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:00:45.565358 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-825df7d5-c72a-4af8-98b7-f67bf2a2eebf req-5d8fdc1d-81ce-4fe1-b821-326e3930367b service nova] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Received event network-vif-unplugged-1bce33b1-57be-4de9-9e81-1a05535ae317 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:00:45.565688 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-825df7d5-c72a-4af8-98b7-f67bf2a2eebf req-5d8fdc1d-81ce-4fe1-b821-326e3930367b service nova] Acquiring lock "8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:45.565955 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-825df7d5-c72a-4af8-98b7-f67bf2a2eebf req-5d8fdc1d-81ce-4fe1-b821-326e3930367b service nova] Lock "8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:45.566147 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-825df7d5-c72a-4af8-98b7-f67bf2a2eebf req-5d8fdc1d-81ce-4fe1-b821-326e3930367b service nova] Lock "8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:45.566328 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-825df7d5-c72a-4af8-98b7-f67bf2a2eebf req-5d8fdc1d-81ce-4fe1-b821-326e3930367b service nova] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] No waiting events found dispatching network-vif-unplugged-1bce33b1-57be-4de9-9e81-1a05535ae317 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:00:45.566629 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-825df7d5-c72a-4af8-98b7-f67bf2a2eebf req-5d8fdc1d-81ce-4fe1-b821-326e3930367b service nova] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Received event network-vif-unplugged-1bce33b1-57be-4de9-9e81-1a05535ae317 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:00:45.566742 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-825df7d5-c72a-4af8-98b7-f67bf2a2eebf req-5d8fdc1d-81ce-4fe1-b821-326e3930367b service nova] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Received event network-vif-deleted-1bce33b1-57be-4de9-9e81-1a05535ae317 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:00:45.567001 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-825df7d5-c72a-4af8-98b7-f67bf2a2eebf req-5d8fdc1d-81ce-4fe1-b821-326e3930367b service nova] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Neutron deleted interface 1bce33b1-57be-4de9-9e81-1a05535ae317; detaching it from the instance and deleting it from the info cache
May 28 02:00:45.569413 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-825df7d5-c72a-4af8-98b7-f67bf2a2eebf req-5d8fdc1d-81ce-4fe1-b821-326e3930367b service nova] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Detach interface failed, port_id=1bce33b1-57be-4de9-9e81-1a05535ae317, reason: Instance 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 02:00:45.648325 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:00:45.795801 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-f1aa2169-89b1-4d75-b978-1a5470b721a5 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Object Instance<d4fad20b-d51e-47c9-8f55-3aa085a10891> lazy-loaded attributes: flavor,numa_topology {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 02:00:45.796018 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f1aa2169-89b1-4d75-b978-1a5470b721a5 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:00:45.953196 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.767s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:45.953573 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.183s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:45.953796 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Migrating
May 28 02:00:45.954041 np0000001583 nova-compute[98241]: DEBUG nova.compute.rpcapi [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98241) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 02:00:45.962005 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 02:00:45.962186 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Claim successful on node np0000001583
May 28 02:00:46.152812 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Took 1.48 seconds to deallocate network for instance.
May 28 02:00:46.305672 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f1aa2169-89b1-4d75-b978-1a5470b721a5 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "d4fad20b-d51e-47c9-8f55-3aa085a10891" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.369s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:46.476036 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "refresh_cache-8b2a5f31-1b3d-447f-939e-94fd0be5eb85" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:00:46.478357 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquired lock "refresh_cache-8b2a5f31-1b3d-447f-939e-94fd0be5eb85" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:00:46.478590 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:00:46.669699 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5b4ee1e1-3b35-4e7f-8e86-e033358c3622 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:46.723495 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-582bc34a-a170-4225-ae7c-7f12c9654f2f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquiring lock "27c37404-4df0-4ded-bf5b-6002e26d4222" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:46.723717 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-582bc34a-a170-4225-ae7c-7f12c9654f2f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "27c37404-4df0-4ded-bf5b-6002e26d4222" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:46.918786 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-bbdcf2d4-3c03-49b0-8af9-bd21f7dacdeb tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:46.918978 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-bbdcf2d4-3c03-49b0-8af9-bd21f7dacdeb tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:46.919141 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-bbdcf2d4-3c03-49b0-8af9-bd21f7dacdeb tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:00:46.922276 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-bbdcf2d4-3c03-49b0-8af9-bd21f7dacdeb tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=98241) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 28 02:00:46.922736 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-bbdcf2d4-3c03-49b0-8af9-bd21f7dacdeb tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lazy-loading 'flavor' on Instance uuid a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:00:46.984200 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:00:47.017624 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lazy-loading 'flavor' on Instance uuid d4fad20b-d51e-47c9-8f55-3aa085a10891 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:00:47.228110 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-582bc34a-a170-4225-ae7c-7f12c9654f2f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Detaching volume 427b9388-1867-4ed3-b48c-dde22e23e376
May 28 02:00:47.249686 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f27ebef0-db8c-41b1-8c22-172f5d2f22c1 req-da9afa80-0bb8-4328-8458-748b287b6337 service nova] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Received event network-vif-unplugged-0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:00:47.249905 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f27ebef0-db8c-41b1-8c22-172f5d2f22c1 req-da9afa80-0bb8-4328-8458-748b287b6337 service nova] Acquiring lock "d4fad20b-d51e-47c9-8f55-3aa085a10891-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:47.250102 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f27ebef0-db8c-41b1-8c22-172f5d2f22c1 req-da9afa80-0bb8-4328-8458-748b287b6337 service nova] Lock "d4fad20b-d51e-47c9-8f55-3aa085a10891-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:47.250291 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f27ebef0-db8c-41b1-8c22-172f5d2f22c1 req-da9afa80-0bb8-4328-8458-748b287b6337 service nova] Lock "d4fad20b-d51e-47c9-8f55-3aa085a10891-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:47.250550 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f27ebef0-db8c-41b1-8c22-172f5d2f22c1 req-da9afa80-0bb8-4328-8458-748b287b6337 service nova] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] No waiting events found dispatching network-vif-unplugged-0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:00:47.250550 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-f27ebef0-db8c-41b1-8c22-172f5d2f22c1 req-da9afa80-0bb8-4328-8458-748b287b6337 service nova] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Received unexpected event network-vif-unplugged-0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b for instance with vm_state stopped and task_state powering-on.
May 28 02:00:47.285620 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-582bc34a-a170-4225-ae7c-7f12c9654f2f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Attempting to driver detach volume 427b9388-1867-4ed3-b48c-dde22e23e376 from mountpoint /dev/vdb
May 28 02:00:47.291261 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-582bc34a-a170-4225-ae7c-7f12c9654f2f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Found disk vdb by alias ua-427b9388-1867-4ed3-b48c-dde22e23e376 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:00:47.292623 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-582bc34a-a170-4225-ae7c-7f12c9654f2f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Found disk vdb by alias ua-427b9388-1867-4ed3-b48c-dde22e23e376 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:00:47.292710 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-582bc34a-a170-4225-ae7c-7f12c9654f2f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Attempting to detach device vdb from instance 27c37404-4df0-4ded-bf5b-6002e26d4222 from the persistent domain config. {{(pid=98241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 02:00:47.293012 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-582bc34a-a170-4225-ae7c-7f12c9654f2f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:00:47.293012 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:00:47.293012 np0000001583 nova-compute[98241]:   <alias name="ua-427b9388-1867-4ed3-b48c-dde22e23e376"/>
May 28 02:00:47.293012 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-3"/>
May 28 02:00:47.293012 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:00:47.293012 np0000001583 nova-compute[98241]:   <serial>427b9388-1867-4ed3-b48c-dde22e23e376</serial>
May 28 02:00:47.293012 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 02:00:47.293012 np0000001583 nova-compute[98241]: </disk>
May 28 02:00:47.293012 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:00:47.298763 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-582bc34a-a170-4225-ae7c-7f12c9654f2f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Successfully detached device vdb from instance 27c37404-4df0-4ded-bf5b-6002e26d4222 from the persistent domain config.
May 28 02:00:47.298940 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-582bc34a-a170-4225-ae7c-7f12c9654f2f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] (1/8): Attempting to detach device vdb with device alias ua-427b9388-1867-4ed3-b48c-dde22e23e376 from instance 27c37404-4df0-4ded-bf5b-6002e26d4222 from the live domain config. {{(pid=98241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 02:00:47.299278 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-582bc34a-a170-4225-ae7c-7f12c9654f2f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:00:47.299278 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:00:47.299278 np0000001583 nova-compute[98241]:   <alias name="ua-427b9388-1867-4ed3-b48c-dde22e23e376"/>
May 28 02:00:47.299278 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-3"/>
May 28 02:00:47.299278 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:00:47.299278 np0000001583 nova-compute[98241]:   <serial>427b9388-1867-4ed3-b48c-dde22e23e376</serial>
May 28 02:00:47.299278 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 02:00:47.299278 np0000001583 nova-compute[98241]: </disk>
May 28 02:00:47.299278 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:00:47.391514 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:00:47.524810 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Acquiring lock "refresh_cache-d4fad20b-d51e-47c9-8f55-3aa085a10891" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:00:47.524976 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Acquired lock "refresh_cache-d4fad20b-d51e-47c9-8f55-3aa085a10891" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:00:47.525428 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:00:47.525664 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lazy-loading 'info_cache' on Instance uuid d4fad20b-d51e-47c9-8f55-3aa085a10891 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:00:47.581186 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Updating instance_info_cache with network_info: [{"id": "77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0", "address": "fa:16:3e:76:c5:3f", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77a0d5b8-3f", "ovs_interfaceid": "77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:00:47.792979 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:00:47.793280 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:00:47.843713 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Received event <DeviceRemovedEvent: 1779933647.8428776, 27c37404-4df0-4ded-bf5b-6002e26d4222 => ua-427b9388-1867-4ed3-b48c-dde22e23e376> from libvirt while the driver is waiting for it; dispatched. {{(pid=98241) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 02:00:47.844303 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-582bc34a-a170-4225-ae7c-7f12c9654f2f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-427b9388-1867-4ed3-b48c-dde22e23e376 for instance 27c37404-4df0-4ded-bf5b-6002e26d4222 {{(pid=98241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 02:00:47.849290 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-582bc34a-a170-4225-ae7c-7f12c9654f2f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Successfully detached device vdb from instance 27c37404-4df0-4ded-bf5b-6002e26d4222 from the live domain config.
May 28 02:00:47.850432 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-582bc34a-a170-4225-ae7c-7f12c9654f2f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:00:47.850791 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-582bc34a-a170-4225-ae7c-7f12c9654f2f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376', 'iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '427b9388-1867-4ed3-b48c-dde22e23e376', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:00:47.850956 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-582bc34a-a170-4225-ae7c-7f12c9654f2f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:00:47.851341 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-582bc34a-a170-4225-ae7c-7f12c9654f2f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:00:47.851633 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-582bc34a-a170-4225-ae7c-7f12c9654f2f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376', 'iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '427b9388-1867-4ed3-b48c-dde22e23e376', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:00:47.851753 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-582bc34a-a170-4225-ae7c-7f12c9654f2f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:00:47.881193 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-582bc34a-a170-4225-ae7c-7f12c9654f2f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:47.881193 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:47.881193 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:47.881193 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:47.881193 np0000001583 nova-compute[98241]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:47.881193 np0000001583 nova-compute[98241]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:47.881193 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:47.881193 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:47.881193 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:00:47.881614 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-582bc34a-a170-4225-ae7c-7f12c9654f2f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:47.881614 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:47.881614 np0000001583 nova-compute[98241]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:47.881614 np0000001583 nova-compute[98241]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376 (non-flash)
May 28 02:00:47.881614 np0000001583 nova-compute[98241]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:47.881614 np0000001583 nova-compute[98241]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:47.881614 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:47.881614 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:47.881614 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:00:47.881614 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-582bc34a-a170-4225-ae7c-7f12c9654f2f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', '68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', '69'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376', '78'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376', '79'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d', '87'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d', '88'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', '91'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', '92')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:00:47.881614 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-582bc34a-a170-4225-ae7c-7f12c9654f2f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376', '79')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:00:47.882488 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-582bc34a-a170-4225-ae7c-7f12c9654f2f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376', '78')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:00:47.883211 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-582bc34a-a170-4225-ae7c-7f12c9654f2f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724ec1ae8e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376'): ({'sdd'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:00:47.883378 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-582bc34a-a170-4225-ae7c-7f12c9654f2f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Removing multipathed devices sdd, sde {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:00:47.883582 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-582bc34a-a170-4225-ae7c-7f12c9654f2f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Flush multipath device 330000000f6df55ac {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:00:47.915876 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-582bc34a-a170-4225-ae7c-7f12c9654f2f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:00:47.957858 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:47.965565 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-582bc34a-a170-4225-ae7c-7f12c9654f2f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:00:47.988356 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:47.994768 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:48.024852 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-582bc34a-a170-4225-ae7c-7f12c9654f2f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:00:48.025123 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-582bc34a-a170-4225-ae7c-7f12c9654f2f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:00:48.026677 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-582bc34a-a170-4225-ae7c-7f12c9654f2f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:00:48.028877 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:48.028925 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:48.030793 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Object Instance<d4fad20b-d51e-47c9-8f55-3aa085a10891> lazy-loaded attributes: flavor,info_cache {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 02:00:48.042480 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-582bc34a-a170-4225-ae7c-7f12c9654f2f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:00:48.042851 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-582bc34a-a170-4225-ae7c-7f12c9654f2f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:00:48.059588 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-582bc34a-a170-4225-ae7c-7f12c9654f2f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:48.083374 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Releasing lock "refresh_cache-8b2a5f31-1b3d-447f-939e-94fd0be5eb85" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:00:48.100203 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-582bc34a-a170-4225-ae7c-7f12c9654f2f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 79, target: iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376, portal: 192.168.40.100,3260]
May 28 02:00:48.100203 np0000001583 nova-compute[98241]: Logout of [sid: 79, target: iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376, portal: 192.168.40.100,3260] successful.
May 28 02:00:48.100203 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:48.118914 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-582bc34a-a170-4225-ae7c-7f12c9654f2f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:48.132675 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-582bc34a-a170-4225-ae7c-7f12c9654f2f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:48.200475 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-582bc34a-a170-4225-ae7c-7f12c9654f2f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 78, target: iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376, portal: 192.168.50.100,3260]
May 28 02:00:48.200475 np0000001583 nova-compute[98241]: Logout of [sid: 78, target: iqn.2023-03.storpool.com:os--volume-427b9388-1867-4ed3-b48c-dde22e23e376, portal: 192.168.50.100,3260] successful.
May 28 02:00:48.200475 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:48.217270 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-582bc34a-a170-4225-ae7c-7f12c9654f2f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:48.217633 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-582bc34a-a170-4225-ae7c-7f12c9654f2f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:00:48.217844 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-582bc34a-a170-4225-ae7c-7f12c9654f2f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] <== disconnect_volume: return (367ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:00:48.217966 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-582bc34a-a170-4225-ae7c-7f12c9654f2f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:00:48.228804 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:48.285179 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.99968770400028 future=<Future at 0x7724ec18ef30 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:00:48.288383 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Instance destroyed successfully.
May 28 02:00:48.288879 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-bbdcf2d4-3c03-49b0-8af9-bd21f7dacdeb tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lazy-loading 'numa_topology' on Instance uuid a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:00:48.297225 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:00:48.534259 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:00:48.780616 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-582bc34a-a170-4225-ae7c-7f12c9654f2f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lazy-loading 'flavor' on Instance uuid 27c37404-4df0-4ded-bf5b-6002e26d4222 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:00:48.791566 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-bbdcf2d4-3c03-49b0-8af9-bd21f7dacdeb tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Object Instance<a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d> lazy-loaded attributes: flavor,numa_topology {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 02:00:48.791566 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-bbdcf2d4-3c03-49b0-8af9-bd21f7dacdeb tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:00:48.807377 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.854s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:48.808278 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5b4ee1e1-3b35-4e7f-8e86-e033358c3622 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.145s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:48.808278 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 02:00:48.890551 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:00:49.086367 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Updating instance_info_cache with network_info: [{"id": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "address": "fa:16:3e:ca:8c:e2", "network": {"id": "d4bf7f94-4ac7-4145-be11-d2aeeafb6c02", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-972487534-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "04ce4063a6ac4afdb5ee359a5c1105d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e39a69e-35", "ovs_interfaceid": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:00:49.159281 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:49.234475 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0022229880000850244 future=<Future at 0x7724ec4b1160 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:00:49.237322 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Emitting event <LifecycleEvent: 1779933634.2321234, d203e779-f827-4964-a8a9-368a89aab0e2 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:00:49.237676 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:00:49.237676 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] VM Stopped (Lifecycle Event)
May 28 02:00:49.239305 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=9.389937464000013 future=<Future at 0x7724ec2f70e0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:00:49.239947 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=9.389756245000171 future=<Future at 0x7724ec2f70e0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:00:49.300065 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-bbdcf2d4-3c03-49b0-8af9-bd21f7dacdeb tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.381s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:49.320943 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 02:00:49.321154 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 02:00:49.321432 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:00:49.321650 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:00:49.333540 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-08412971-37ca-41ec-af3a-13782e474f4c req-4c905e1e-ace4-41a0-a91d-dcf6e29bb889 service nova] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Received event network-vif-unplugged-062afddc-3d10-4dc2-a9d7-6024ed27c97a {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:00:49.333716 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-08412971-37ca-41ec-af3a-13782e474f4c req-4c905e1e-ace4-41a0-a91d-dcf6e29bb889 service nova] Acquiring lock "a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:49.333863 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-08412971-37ca-41ec-af3a-13782e474f4c req-4c905e1e-ace4-41a0-a91d-dcf6e29bb889 service nova] Lock "a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:49.333978 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-08412971-37ca-41ec-af3a-13782e474f4c req-4c905e1e-ace4-41a0-a91d-dcf6e29bb889 service nova] Lock "a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:49.334116 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-08412971-37ca-41ec-af3a-13782e474f4c req-4c905e1e-ace4-41a0-a91d-dcf6e29bb889 service nova] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] No waiting events found dispatching network-vif-unplugged-062afddc-3d10-4dc2-a9d7-6024ed27c97a {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:00:49.334284 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-08412971-37ca-41ec-af3a-13782e474f4c req-4c905e1e-ace4-41a0-a91d-dcf6e29bb889 service nova] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Received unexpected event network-vif-unplugged-062afddc-3d10-4dc2-a9d7-6024ed27c97a for instance with vm_state stopped and task_state None.
May 28 02:00:49.334674 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-08412971-37ca-41ec-af3a-13782e474f4c req-4c905e1e-ace4-41a0-a91d-dcf6e29bb889 service nova] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Received event network-vif-unplugged-062afddc-3d10-4dc2-a9d7-6024ed27c97a {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:00:49.335670 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-08412971-37ca-41ec-af3a-13782e474f4c req-4c905e1e-ace4-41a0-a91d-dcf6e29bb889 service nova] Acquiring lock "a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:49.335850 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-08412971-37ca-41ec-af3a-13782e474f4c req-4c905e1e-ace4-41a0-a91d-dcf6e29bb889 service nova] Lock "a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:49.336002 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-08412971-37ca-41ec-af3a-13782e474f4c req-4c905e1e-ace4-41a0-a91d-dcf6e29bb889 service nova] Lock "a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:49.336170 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-08412971-37ca-41ec-af3a-13782e474f4c req-4c905e1e-ace4-41a0-a91d-dcf6e29bb889 service nova] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] No waiting events found dispatching network-vif-unplugged-062afddc-3d10-4dc2-a9d7-6024ed27c97a {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:00:49.336284 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-08412971-37ca-41ec-af3a-13782e474f4c req-4c905e1e-ace4-41a0-a91d-dcf6e29bb889 service nova] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Received unexpected event network-vif-unplugged-062afddc-3d10-4dc2-a9d7-6024ed27c97a for instance with vm_state stopped and task_state None.
May 28 02:00:49.433298 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '00cb6190618b45eb994dd16d3c657f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837663bcfa40402aaf583729dfbb26cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 02:00:49.595050 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Releasing lock "refresh_cache-d4fad20b-d51e-47c9-8f55-3aa085a10891" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:00:49.609708 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Starting migrate_disk_and_power_off {{(pid=98241) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 28 02:00:49.647596 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:49.651013 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:49.674223 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:49.675866 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-5b4ee1e1-3b35-4e7f-8e86-e033358c3622 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:00:49.679386 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-5b4ee1e1-3b35-4e7f-8e86-e033358c3622 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:00:49.740609 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: d203e779-f827-4964-a8a9-368a89aab0e2] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:00:49.791824 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-582bc34a-a170-4225-ae7c-7f12c9654f2f tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "27c37404-4df0-4ded-bf5b-6002e26d4222" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.068s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:49.826073 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 02:00:49.857702 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:49.878747 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:49.960370 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:49.984221 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:49.995058 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.99964811100017 future=<Future at 0x7724f844db80 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:00:49.995670 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Instance destroyed successfully.
May 28 02:00:49.996797 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:59:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='multiattach-server-0',id=40,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAP7CI9wuY8JR5OGc0CpqFzQg3rj7cqVgHC4sPYHH38XlmtTRa9WHg3S3WcIsSpd43tWEYYLHF1/yDpoSsozR5Hrjk+cgmLbTDwUHC3YheiC8VnlV/ymBtBFe0b8oxSz5w==',key_name='tempest-keypair-1713929294',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:59:57Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0474090f4f2d4950b51bc317f4302266',ramdisk_id='',reservation_id='r-rozqlw8g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-857456921',owner_user_name='tempest-AttachVolumeMultiAttachTest-857456921-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:00:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cadb612e41314b06914d5f5f47570e98',uuid=8b2a5f31-1b3d-447f-939e-94fd0be5eb85,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0", "address": "fa:16:3e:76:c5:3f", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "vif_mac": "fa:16:3e:76:c5:3f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77a0d5b8-3f", "ovs_interfaceid": "77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:00:49.997011 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Converting VIF {"id": "77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0", "address": "fa:16:3e:76:c5:3f", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "vif_mac": "fa:16:3e:76:c5:3f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77a0d5b8-3f", "ovs_interfaceid": "77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:00:49.997789 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:c5:3f,bridge_name='br-int',has_traffic_filtering=True,id=77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77a0d5b8-3f') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:00:49.998026 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:c5:3f,bridge_name='br-int',has_traffic_filtering=True,id=77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77a0d5b8-3f') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:00:49.998974 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:50.000930 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap77a0d5b8-3f, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:00:50.005419 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:50.006851 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:00:50.018974 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:50.018974 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:50.018974 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3330fec2-002e-4daf-b366-07f35ab7b20d) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:00:50.018974 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:50.019369 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:00:50.029678 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:50.031631 np0000001583 nova-compute[98241]: INFO os_vif [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:c5:3f,bridge_name='br-int',has_traffic_filtering=True,id=77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77a0d5b8-3f')
May 28 02:00:50.085255 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3f2256cf-0d16-480b-830a-c3a4171943a7 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquiring lock "27c37404-4df0-4ded-bf5b-6002e26d4222" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:50.085460 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3f2256cf-0d16-480b-830a-c3a4171943a7 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "27c37404-4df0-4ded-bf5b-6002e26d4222" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:50.085608 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3f2256cf-0d16-480b-830a-c3a4171943a7 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquiring lock "27c37404-4df0-4ded-bf5b-6002e26d4222-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:50.085727 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3f2256cf-0d16-480b-830a-c3a4171943a7 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "27c37404-4df0-4ded-bf5b-6002e26d4222-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:50.085863 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3f2256cf-0d16-480b-830a-c3a4171943a7 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "27c37404-4df0-4ded-bf5b-6002e26d4222-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:50.087679 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-3f2256cf-0d16-480b-830a-c3a4171943a7 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Terminating instance
May 28 02:00:50.099238 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Successfully created port: d1e489a2-57fb-4508-9524-ad06f0b81235 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 02:00:50.182800 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-5b4ee1e1-3b35-4e7f-8e86-e033358c3622 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:00:50.329719 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 02:00:50.579330 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Detected multiple connections on this host for volume: 2b9c7b2e-ce89-46a0-a020-361646147ba3, skipping target disconnect.
May 28 02:00:50.584103 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:00:50.597919 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3f2256cf-0d16-480b-830a-c3a4171943a7 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 02:00:50.634287 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Instance destroyed successfully.
May 28 02:00:50.634807 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lazy-loading 'numa_topology' on Instance uuid d4fad20b-d51e-47c9-8f55-3aa085a10891 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:00:50.650193 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:50.671560 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:50.689909 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5b4ee1e1-3b35-4e7f-8e86-e033358c3622 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.882s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:50.693726 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:00:50.694481 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:00:50.758886 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Successfully updated port: d1e489a2-57fb-4508-9524-ad06f0b81235 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 02:00:50.802283 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:00:50.802283 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] skipping disk /dev/dm-10 (vdb) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 02:00:50.803392 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-5b4ee1e1-3b35-4e7f-8e86-e033358c3622 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Deleted allocations for instance 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d
May 28 02:00:50.807760 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85_resize/disk /opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/disk {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:00:50.868353 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lazy-loading 'flavor' on Instance uuid a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:00:50.890361 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:50.913565 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:50.929255 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-57f22066-751a-410d-a88f-2e2e1cb1dbf1 req-6a07dcc8-79b5-48b1-85a6-3eb8b0475a86 service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Received event network-vif-unplugged-967dfb76-814b-43ba-ba2b-c14f407ff45e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:00:50.929955 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-57f22066-751a-410d-a88f-2e2e1cb1dbf1 req-6a07dcc8-79b5-48b1-85a6-3eb8b0475a86 service nova] Acquiring lock "27c37404-4df0-4ded-bf5b-6002e26d4222-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:50.930956 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-57f22066-751a-410d-a88f-2e2e1cb1dbf1 req-6a07dcc8-79b5-48b1-85a6-3eb8b0475a86 service nova] Lock "27c37404-4df0-4ded-bf5b-6002e26d4222-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:50.930956 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-57f22066-751a-410d-a88f-2e2e1cb1dbf1 req-6a07dcc8-79b5-48b1-85a6-3eb8b0475a86 service nova] Lock "27c37404-4df0-4ded-bf5b-6002e26d4222-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:50.930956 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-57f22066-751a-410d-a88f-2e2e1cb1dbf1 req-6a07dcc8-79b5-48b1-85a6-3eb8b0475a86 service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] No waiting events found dispatching network-vif-unplugged-967dfb76-814b-43ba-ba2b-c14f407ff45e {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:00:50.930956 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-57f22066-751a-410d-a88f-2e2e1cb1dbf1 req-6a07dcc8-79b5-48b1-85a6-3eb8b0475a86 service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Received event network-vif-unplugged-967dfb76-814b-43ba-ba2b-c14f407ff45e for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:00:50.952242 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CMD "cp -r /opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85_resize/disk /opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/disk" returned: 0 in 0.144s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:00:50.952698 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85_resize/disk.config /opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/disk.config {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:00:50.977442 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999070543000016 future=<Future at 0x7724ec37fb30 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:00:50.980735 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Instance destroyed successfully.
May 28 02:00:50.981957 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-3f2256cf-0d16-480b-830a-c3a4171943a7 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lazy-loading 'resources' on Instance uuid 27c37404-4df0-4ded-bf5b-6002e26d4222 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:00:51.008148 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CMD "cp -r /opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85_resize/disk.config /opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/disk.config" returned: 0 in 0.054s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:00:51.008148 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85_resize/disk.info /opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/disk.info {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:00:51.055756 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CMD "cp -r /opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85_resize/disk.info /opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/disk.info" returned: 0 in 0.048s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:00:51.143095 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Object Instance<d4fad20b-d51e-47c9-8f55-3aa085a10891> lazy-loaded attributes: flavor,info_cache,numa_topology {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 02:00:51.143095 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lazy-loading 'resources' on Instance uuid d4fad20b-d51e-47c9-8f55-3aa085a10891 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:00:51.263597 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "refresh_cache-01d8de67-23ab-4430-8512-d2fece776ac2" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:00:51.263716 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquired lock "refresh_cache-01d8de67-23ab-4430-8512-d2fece776ac2" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:00:51.263867 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:00:51.359149 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 02:00:51.359149 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 02:00:51.359687 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Creating image(s)
May 28 02:00:51.360617 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "/opt/stack/data/nova/instances/01d8de67-23ab-4430-8512-d2fece776ac2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:51.361039 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "/opt/stack/data/nova/instances/01d8de67-23ab-4430-8512-d2fece776ac2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:51.361833 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "/opt/stack/data/nova/instances/01d8de67-23ab-4430-8512-d2fece776ac2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:51.363178 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:00:51.367660 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:00:51.369422 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:00:51.394576 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "refresh_cache-a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:00:51.394811 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquired lock "refresh_cache-a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:00:51.395310 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:00:51.396046 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lazy-loading 'info_cache' on Instance uuid a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:00:51.421010 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d04f56ec-9697-43e1-b09e-b431c2aeef5b req-72612520-ad1c-419e-ae17-8ec985d15df8 service nova] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Received event network-vif-unplugged-77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:00:51.421743 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d04f56ec-9697-43e1-b09e-b431c2aeef5b req-72612520-ad1c-419e-ae17-8ec985d15df8 service nova] Acquiring lock "8b2a5f31-1b3d-447f-939e-94fd0be5eb85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:51.422036 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d04f56ec-9697-43e1-b09e-b431c2aeef5b req-72612520-ad1c-419e-ae17-8ec985d15df8 service nova] Lock "8b2a5f31-1b3d-447f-939e-94fd0be5eb85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:51.422266 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d04f56ec-9697-43e1-b09e-b431c2aeef5b req-72612520-ad1c-419e-ae17-8ec985d15df8 service nova] Lock "8b2a5f31-1b3d-447f-939e-94fd0be5eb85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:51.422402 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d04f56ec-9697-43e1-b09e-b431c2aeef5b req-72612520-ad1c-419e-ae17-8ec985d15df8 service nova] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] No waiting events found dispatching network-vif-unplugged-77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:00:51.422579 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-d04f56ec-9697-43e1-b09e-b431c2aeef5b req-72612520-ad1c-419e-ae17-8ec985d15df8 service nova] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Received unexpected event network-vif-unplugged-77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0 for instance with vm_state active and task_state resize_migrating.
May 28 02:00:51.422684 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d04f56ec-9697-43e1-b09e-b431c2aeef5b req-72612520-ad1c-419e-ae17-8ec985d15df8 service nova] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Received event network-vif-unplugged-77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:00:51.422845 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d04f56ec-9697-43e1-b09e-b431c2aeef5b req-72612520-ad1c-419e-ae17-8ec985d15df8 service nova] Acquiring lock "8b2a5f31-1b3d-447f-939e-94fd0be5eb85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:51.423027 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d04f56ec-9697-43e1-b09e-b431c2aeef5b req-72612520-ad1c-419e-ae17-8ec985d15df8 service nova] Lock "8b2a5f31-1b3d-447f-939e-94fd0be5eb85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:51.423211 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d04f56ec-9697-43e1-b09e-b431c2aeef5b req-72612520-ad1c-419e-ae17-8ec985d15df8 service nova] Lock "8b2a5f31-1b3d-447f-939e-94fd0be5eb85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:51.423394 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d04f56ec-9697-43e1-b09e-b431c2aeef5b req-72612520-ad1c-419e-ae17-8ec985d15df8 service nova] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] No waiting events found dispatching network-vif-unplugged-77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:00:51.423539 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-d04f56ec-9697-43e1-b09e-b431c2aeef5b req-72612520-ad1c-419e-ae17-8ec985d15df8 service nova] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Received unexpected event network-vif-unplugged-77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0 for instance with vm_state active and task_state resize_migrating.
May 28 02:00:51.423712 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d04f56ec-9697-43e1-b09e-b431c2aeef5b req-72612520-ad1c-419e-ae17-8ec985d15df8 service nova] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Received event network-changed-d1e489a2-57fb-4508-9524-ad06f0b81235 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:00:51.424060 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d04f56ec-9697-43e1-b09e-b431c2aeef5b req-72612520-ad1c-419e-ae17-8ec985d15df8 service nova] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Refreshing instance network info cache due to event network-changed-d1e489a2-57fb-4508-9524-ad06f0b81235. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:00:51.424263 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d04f56ec-9697-43e1-b09e-b431c2aeef5b req-72612520-ad1c-419e-ae17-8ec985d15df8 service nova] Acquiring lock "refresh_cache-01d8de67-23ab-4430-8512-d2fece776ac2" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:00:51.478803 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.109s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:00:51.480513 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:51.480513 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:51.482553 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:00:51.486163 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-3f2256cf-0d16-480b-830a-c3a4171943a7 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:58:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1984510406',display_name='tempest-ServerRescueNegativeTestJSON-server-1984510406',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-serverrescuenegativetestjson-server-1984510406',id=35,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgRFt+zoylZH7ImyqBxzXxwawOcfJNh1kWIzkZgWDpOFw1or+RHRCJDV1CeY464D6GQlptlWjI1DBsvXTx+mpaMK5Xo0FMreDEmYX82LF0E6+YVrbbjZw424HLlD4pjew==',key_name='tempest-keypair-1186596023',keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:00:00Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f65617e71571457f8906997583100678',ramdisk_id='',reservation_id='r-62oluqi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1821941242',owner_user_name='tempest-ServerRescueNegativeTestJSON-1821941242-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T02:00:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='435dfce8f05e4e01b380797bd07bd4dc',uuid=27c37404-4df0-4ded-bf5b-6002e26d4222,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "967dfb76-814b-43ba-ba2b-c14f407ff45e", "address": "fa:16:3e:e8:00:1f", "network": {"id": "e1d5d073-f27b-4ff1-9ed3-99f57407c76f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f65617e71571457f8906997583100678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap967dfb76-81", "ovs_interfaceid": "967dfb76-814b-43ba-ba2b-c14f407ff45e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:00:51.488625 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-3f2256cf-0d16-480b-830a-c3a4171943a7 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Converting VIF {"id": "967dfb76-814b-43ba-ba2b-c14f407ff45e", "address": "fa:16:3e:e8:00:1f", "network": {"id": "e1d5d073-f27b-4ff1-9ed3-99f57407c76f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f65617e71571457f8906997583100678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap967dfb76-81", "ovs_interfaceid": "967dfb76-814b-43ba-ba2b-c14f407ff45e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:00:51.489319 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-3f2256cf-0d16-480b-830a-c3a4171943a7 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:00:1f,bridge_name='br-int',has_traffic_filtering=True,id=967dfb76-814b-43ba-ba2b-c14f407ff45e,network=Network(e1d5d073-f27b-4ff1-9ed3-99f57407c76f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap967dfb76-81') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:00:51.489590 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-3f2256cf-0d16-480b-830a-c3a4171943a7 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:00:1f,bridge_name='br-int',has_traffic_filtering=True,id=967dfb76-814b-43ba-ba2b-c14f407ff45e,network=Network(e1d5d073-f27b-4ff1-9ed3-99f57407c76f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap967dfb76-81') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:00:51.490383 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:00:51.492713 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:00:51.492947 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:51.493305 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap967dfb76-81, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:00:51.496669 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:51.496669 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:00:51.510561 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:51.513700 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:51.514038 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c9763554-26e7-4a8e-a6b4-bf563acea73d) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:00:51.515768 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:51.515768 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:00:51.527883 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:51.532430 np0000001583 nova-compute[98241]: INFO os_vif [None req-3f2256cf-0d16-480b-830a-c3a4171943a7 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:00:1f,bridge_name='br-int',has_traffic_filtering=True,id=967dfb76-814b-43ba-ba2b-c14f407ff45e,network=Network(e1d5d073-f27b-4ff1-9ed3-99f57407c76f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap967dfb76-81')
May 28 02:00:51.532901 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-3f2256cf-0d16-480b-830a-c3a4171943a7 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Deleting instance files /opt/stack/data/nova/instances/27c37404-4df0-4ded-bf5b-6002e26d4222_del
May 28 02:00:51.533999 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-3f2256cf-0d16-480b-830a-c3a4171943a7 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Deletion of /opt/stack/data/nova/instances/27c37404-4df0-4ded-bf5b-6002e26d4222_del complete
May 28 02:00:51.604128 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.111s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:00:51.608268 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/01d8de67-23ab-4430-8512-d2fece776ac2/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:00:51.645956 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Object Instance<d4fad20b-d51e-47c9-8f55-3aa085a10891> lazy-loaded attributes: flavor,info_cache,numa_topology,resources {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 02:00:51.647496 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:58:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-522410549',display_name='tempest-AttachVolumeTestJSON-server-522410549',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-attachvolumetestjson-server-522410549',id=34,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/SX3aLhOteyGwrFqR0CEL4C04Fp6fWjwsBRpIz44V+NdHV7WRnAaFAuCSewkCiCwsHBAYVT3CCSkcBu9Z5deiFWGGYvkB/zQRpMDdHuyRrvPU5bkBQzk+aQ10B/g2ZJA==',key_name='tempest-keypair-487865295',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:58:49Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='04ce4063a6ac4afdb5ee359a5c1105d3',ramdisk_id='',reservation_id='r-q0lo3p0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1276932129',owner_user_name='tempest-AttachVolumeTestJSON-1276932129-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T02:00:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='164f3d08de954440bd716afe5eb1054a',uuid=d4fad20b-d51e-47c9-8f55-3aa085a10891,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "address": "fa:16:3e:ca:8c:e2", "network": {"id": "d4bf7f94-4ac7-4145-be11-d2aeeafb6c02", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-972487534-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "04ce4063a6ac4afdb5ee359a5c1105d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e39a69e-35", "ovs_interfaceid": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:00:51.647746 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Converting VIF {"id": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "address": "fa:16:3e:ca:8c:e2", "network": {"id": "d4bf7f94-4ac7-4145-be11-d2aeeafb6c02", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-972487534-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "04ce4063a6ac4afdb5ee359a5c1105d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e39a69e-35", "ovs_interfaceid": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:00:51.648782 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:8c:e2,bridge_name='br-int',has_traffic_filtering=True,id=0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b,network=Network(d4bf7f94-4ac7-4145-be11-d2aeeafb6c02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e39a69e-35') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:00:51.649112 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:8c:e2,bridge_name='br-int',has_traffic_filtering=True,id=0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b,network=Network(d4bf7f94-4ac7-4145-be11-d2aeeafb6c02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e39a69e-35') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:00:51.652121 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:51.652538 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0e39a69e-35, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:00:51.659649 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:51.660711 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:00:51.666198 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:51.671103 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:51.671878 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b6cfc7e3-9ed1-4b62-9cb0-0d0e9a0331a2) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:00:51.673789 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:00:51.674316 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/01d8de67-23ab-4430-8512-d2fece776ac2/disk 1073741824" returned: 0 in 0.069s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:00:51.676319 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:51.676319 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:00:51.688759 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:51.695432 np0000001583 nova-compute[98241]: INFO os_vif [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:8c:e2,bridge_name='br-int',has_traffic_filtering=True,id=0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b,network=Network(d4bf7f94-4ac7-4145-be11-d2aeeafb6c02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e39a69e-35')
May 28 02:00:51.712340 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Start _get_guest_xml network_info=[{"id": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "address": "fa:16:3e:ca:8c:e2", "network": {"id": "d4bf7f94-4ac7-4145-be11-d2aeeafb6c02", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-972487534-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "04ce4063a6ac4afdb5ee359a5c1105d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e39a69e-35", "ovs_interfaceid": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 02:00:51.716535 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:00:51.719835 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-522410549', uuid='d4fad20b-d51e-47c9-8f55-3aa085a10891'), owner=OwnerMeta(userid='164f3d08de954440bd716afe5eb1054a', username='tempest-AttachVolumeTestJSON-1276932129-project-member', projectid='04ce4063a6ac4afdb5ee359a5c1105d3', projectname='tempest-AttachVolumeTestJSON-1276932129'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "address": "fa:16:3e:ca:8c:e2", "network": {"id": "d4bf7f94-4ac7-4145-be11-d2aeeafb6c02", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-972487534-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "04ce4063a6ac4afdb5ee359a5c1105d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e39a69e-35", "ovs_interfaceid": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933651.7177052) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 02:00:51.721295 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 02:00:51.721809 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 02:00:51.726365 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 02:00:51.743852 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 02:00:51.747571 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 02:00:51.747921 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 02:00:51.748208 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 02:00:51.748410 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 02:00:51.748410 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 02:00:51.748525 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 02:00:51.748723 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 02:00:51.749166 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 02:00:51.749166 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 02:00:51.749166 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 02:00:51.749366 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 02:00:51.749451 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 02:00:51.749710 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lazy-loading 'vcpu_model' on Instance uuid d4fad20b-d51e-47c9-8f55-3aa085a10891 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:00:51.790343 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.115s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:00:51.790980 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Checking if we can resize image /opt/stack/data/nova/instances/01d8de67-23ab-4430-8512-d2fece776ac2/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 02:00:51.791601 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d8de67-23ab-4430-8512-d2fece776ac2/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:00:51.845579 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5b4ee1e1-3b35-4e7f-8e86-e033358c3622 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.092s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:51.900902 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Object Instance<a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d> lazy-loaded attributes: flavor,info_cache {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 02:00:51.907041 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:00:51.918043 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d8de67-23ab-4430-8512-d2fece776ac2/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:00:51.920525 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Cannot resize image /opt/stack/data/nova/instances/01d8de67-23ab-4430-8512-d2fece776ac2/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 02:00:51.920920 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 02:00:51.921165 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Ensure instance console log exists: /opt/stack/data/nova/instances/01d8de67-23ab-4430-8512-d2fece776ac2/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 02:00:51.921507 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:51.921783 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:51.921941 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:52.048235 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-3f2256cf-0d16-480b-830a-c3a4171943a7 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Took 1.45 seconds to destroy the instance on the hypervisor.
May 28 02:00:52.048235 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-3f2256cf-0d16-480b-830a-c3a4171943a7 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 02:00:52.049694 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 02:00:52.049964 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 02:00:52.050284 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:00:52.122257 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:00:52.199678 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:00:52.252320 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:00:52.252672 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:00:52.254736 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Object Instance<d4fad20b-d51e-47c9-8f55-3aa085a10891> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 02:00:52.275573 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:58:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-522410549',display_name='tempest-AttachVolumeTestJSON-server-522410549',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-attachvolumetestjson-server-522410549',id=34,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/SX3aLhOteyGwrFqR0CEL4C04Fp6fWjwsBRpIz44V+NdHV7WRnAaFAuCSewkCiCwsHBAYVT3CCSkcBu9Z5deiFWGGYvkB/zQRpMDdHuyRrvPU5bkBQzk+aQ10B/g2ZJA==',key_name='tempest-keypair-487865295',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:58:49Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='04ce4063a6ac4afdb5ee359a5c1105d3',ramdisk_id='',reservation_id='r-q0lo3p0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1276932129',owner_user_name='tempest-AttachVolumeTestJSON-1276932129-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T02:00:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='164f3d08de954440bd716afe5eb1054a',uuid=d4fad20b-d51e-47c9-8f55-3aa085a10891,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "address": "fa:16:3e:ca:8c:e2", "network": {"id": "d4bf7f94-4ac7-4145-be11-d2aeeafb6c02", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-972487534-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "04ce4063a6ac4afdb5ee359a5c1105d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e39a69e-35", "ovs_interfaceid": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 02:00:52.275874 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Converting VIF {"id": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "address": "fa:16:3e:ca:8c:e2", "network": {"id": "d4bf7f94-4ac7-4145-be11-d2aeeafb6c02", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-972487534-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "04ce4063a6ac4afdb5ee359a5c1105d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e39a69e-35", "ovs_interfaceid": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:00:52.277188 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:8c:e2,bridge_name='br-int',has_traffic_filtering=True,id=0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b,network=Network(d4bf7f94-4ac7-4145-be11-d2aeeafb6c02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e39a69e-35') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:00:52.278060 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lazy-loading 'pci_devices' on Instance uuid d4fad20b-d51e-47c9-8f55-3aa085a10891 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:00:52.325288 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Updating instance_info_cache with network_info: [{"id": "d1e489a2-57fb-4508-9524-ad06f0b81235", "address": "fa:16:3e:de:ac:a2", "network": {"id": "62e7cc38-1758-4b09-a352-4635adc9cfea", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587967507-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "837663bcfa40402aaf583729dfbb26cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1e489a2-57", "ovs_interfaceid": "d1e489a2-57fb-4508-9524-ad06f0b81235", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:00:52.373413 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Port 77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0 binding to destination host np0000001583 is already ACTIVE {{(pid=98241) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 28 02:00:52.407271 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:00:52.783594 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Object Instance<d4fad20b-d51e-47c9-8f55-3aa085a10891> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 02:00:52.787377 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] End _get_guest_xml xml=<domain type="qemu">
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:   <uuid>d4fad20b-d51e-47c9-8f55-3aa085a10891</uuid>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:   <name>instance-00000022</name>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:   <metadata>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:       <nova:name>tempest-AttachVolumeTestJSON-server-522410549</nova:name>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 02:00:51</nova:creationTime>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:       </nova:image>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:         <nova:user uuid="164f3d08de954440bd716afe5eb1054a">tempest-AttachVolumeTestJSON-1276932129-project-member</nova:user>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:         <nova:project uuid="04ce4063a6ac4afdb5ee359a5c1105d3">tempest-AttachVolumeTestJSON-1276932129</nova:project>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:         <nova:port uuid="0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b">
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:         </nova:port>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:   </metadata>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:     <system>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:       <entry name="serial">d4fad20b-d51e-47c9-8f55-3aa085a10891</entry>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:       <entry name="uuid">d4fad20b-d51e-47c9-8f55-3aa085a10891</entry>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:     </system>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:   <os>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:   </os>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:   <features>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:     <acpi/>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:     <tcg>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:     </tcg>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:   </features>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:   </cpu>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:   <devices>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/disk"/>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:     </disk>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/disk.config"/>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:     </disk>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:ca:8c:e2"/>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:       <target dev="tap0e39a69e-35"/>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:     </interface>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/console.log" append="off"/>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:     </serial>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:     <video>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:     </video>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:     </rng>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:     </memballoon>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:   </devices>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]: </domain>
May 28 02:00:52.787377 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 02:00:52.787377 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:00:52.831202 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:00:52.833811 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Releasing lock "refresh_cache-01d8de67-23ab-4430-8512-d2fece776ac2" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:00:52.834511 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Instance network_info: |[{"id": "d1e489a2-57fb-4508-9524-ad06f0b81235", "address": "fa:16:3e:de:ac:a2", "network": {"id": "62e7cc38-1758-4b09-a352-4635adc9cfea", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587967507-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "837663bcfa40402aaf583729dfbb26cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1e489a2-57", "ovs_interfaceid": "d1e489a2-57fb-4508-9524-ad06f0b81235", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 02:00:52.838179 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d04f56ec-9697-43e1-b09e-b431c2aeef5b req-72612520-ad1c-419e-ae17-8ec985d15df8 service nova] Acquired lock "refresh_cache-01d8de67-23ab-4430-8512-d2fece776ac2" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:00:52.842033 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Start _get_guest_xml network_info=[{"id": "d1e489a2-57fb-4508-9524-ad06f0b81235", "address": "fa:16:3e:de:ac:a2", "network": {"id": "62e7cc38-1758-4b09-a352-4635adc9cfea", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587967507-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "837663bcfa40402aaf583729dfbb26cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1e489a2-57", "ovs_interfaceid": "d1e489a2-57fb-4508-9524-ad06f0b81235", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 02:00:52.842553 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-d04f56ec-9697-43e1-b09e-b431c2aeef5b req-72612520-ad1c-419e-ae17-8ec985d15df8 service nova] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Refreshing network info cache for port d1e489a2-57fb-4508-9524-ad06f0b81235 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:00:52.851550 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:00:52.853432 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-1880176888', uuid='01d8de67-23ab-4430-8512-d2fece776ac2'), owner=OwnerMeta(userid='00cb6190618b45eb994dd16d3c657f01', username='tempest-AttachVolumeNegativeTest-169599115-project-member', projectid='837663bcfa40402aaf583729dfbb26cd', projectname='tempest-AttachVolumeNegativeTest-169599115'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d1e489a2-57fb-4508-9524-ad06f0b81235", "address": "fa:16:3e:de:ac:a2", "network": {"id": "62e7cc38-1758-4b09-a352-4635adc9cfea", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587967507-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "837663bcfa40402aaf583729dfbb26cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1e489a2-57", "ovs_interfaceid": "d1e489a2-57fb-4508-9524-ad06f0b81235", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933652.8528183) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 02:00:52.856147 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 02:00:52.856773 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 02:00:52.858915 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 02:00:52.858915 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 02:00:52.859977 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 02:00:52.862485 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 02:00:52.862718 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 02:00:52.863066 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 02:00:52.863310 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 02:00:52.863472 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 02:00:52.863626 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 02:00:52.863882 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 02:00:52.864052 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 02:00:52.864273 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 02:00:52.864453 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 02:00:52.867102 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 02:00:52.872317 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-cc86094f-56d6-4ada-abd5-312627b045a1 req-ef4f3c9e-2e31-4063-b1de-039cd7ee604a service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Received event network-vif-deleted-967dfb76-814b-43ba-ba2b-c14f407ff45e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:00:52.872511 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-cc86094f-56d6-4ada-abd5-312627b045a1 req-ef4f3c9e-2e31-4063-b1de-039cd7ee604a service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Neutron deleted interface 967dfb76-814b-43ba-ba2b-c14f407ff45e; detaching it from the instance and deleting it from the info cache
May 28 02:00:52.886688 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-cc86094f-56d6-4ada-abd5-312627b045a1 req-ef4f3c9e-2e31-4063-b1de-039cd7ee604a service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Detach interface failed, port_id=967dfb76-814b-43ba-ba2b-c14f407ff45e, reason: Instance 27c37404-4df0-4ded-bf5b-6002e26d4222 could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 02:00:52.901895 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:00:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1880176888',display_name='tempest-AttachVolumeNegativeTest-server-1880176888',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-attachvolumenegativetest-server-1880176888',id=43,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbWhtUZxp49C8PrIko4aR2U+3ihHHccw06V8Yz9ozm8GmdMYEUXlyx3pItVb8mor6VlJo3yFx3LIbj4UIge19ucWylEUcf7mQAxX2QIGNGtl9SpxjGDPvZAEO1bWMEkhg==',key_name='tempest-keypair-933730014',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='837663bcfa40402aaf583729dfbb26cd',ramdisk_id='',reservation_id='r-qu2btn5b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-169599115',owner_user_name='tempest-AttachVolumeNegativeTest-169599115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:00:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='00cb6190618b45eb994dd16d3c657f01',uuid=01d8de67-23ab-4430-8512-d2fece776ac2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1e489a2-57fb-4508-9524-ad06f0b81235", "address": "fa:16:3e:de:ac:a2", "network": {"id": "62e7cc38-1758-4b09-a352-4635adc9cfea", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587967507-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "837663bcfa40402aaf583729dfbb26cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1e489a2-57", "ovs_interfaceid": "d1e489a2-57fb-4508-9524-ad06f0b81235", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 02:00:52.902112 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Converting VIF {"id": "d1e489a2-57fb-4508-9524-ad06f0b81235", "address": "fa:16:3e:de:ac:a2", "network": {"id": "62e7cc38-1758-4b09-a352-4635adc9cfea", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587967507-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "837663bcfa40402aaf583729dfbb26cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1e489a2-57", "ovs_interfaceid": "d1e489a2-57fb-4508-9524-ad06f0b81235", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:00:52.902794 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:ac:a2,bridge_name='br-int',has_traffic_filtering=True,id=d1e489a2-57fb-4508-9524-ad06f0b81235,network=Network(62e7cc38-1758-4b09-a352-4635adc9cfea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1e489a2-57') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:00:52.903923 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lazy-loading 'pci_devices' on Instance uuid 01d8de67-23ab-4430-8512-d2fece776ac2 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:00:52.908065 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/disk --force-share --output=json" returned: 0 in 0.122s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:00:52.908525 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:00:53.023292 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-755766ee-f4ce-45a4-845e-c26926d1253a req-9558585f-5f5f-42b0-ba4b-bfaaece7747a service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Received event network-vif-unplugged-967dfb76-814b-43ba-ba2b-c14f407ff45e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:00:53.023590 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-755766ee-f4ce-45a4-845e-c26926d1253a req-9558585f-5f5f-42b0-ba4b-bfaaece7747a service nova] Acquiring lock "27c37404-4df0-4ded-bf5b-6002e26d4222-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:53.023794 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-755766ee-f4ce-45a4-845e-c26926d1253a req-9558585f-5f5f-42b0-ba4b-bfaaece7747a service nova] Lock "27c37404-4df0-4ded-bf5b-6002e26d4222-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:53.023958 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-755766ee-f4ce-45a4-845e-c26926d1253a req-9558585f-5f5f-42b0-ba4b-bfaaece7747a service nova] Lock "27c37404-4df0-4ded-bf5b-6002e26d4222-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:53.024141 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-755766ee-f4ce-45a4-845e-c26926d1253a req-9558585f-5f5f-42b0-ba4b-bfaaece7747a service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] No waiting events found dispatching network-vif-unplugged-967dfb76-814b-43ba-ba2b-c14f407ff45e {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:00:53.024315 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-755766ee-f4ce-45a4-845e-c26926d1253a req-9558585f-5f5f-42b0-ba4b-bfaaece7747a service nova] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Received event network-vif-unplugged-967dfb76-814b-43ba-ba2b-c14f407ff45e for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:00:53.034331 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:00:53.036664 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lazy-loading 'trusted_certs' on Instance uuid d4fad20b-d51e-47c9-8f55-3aa085a10891 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:00:53.077897 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Updating instance_info_cache with network_info: [{"id": "062afddc-3d10-4dc2-a9d7-6024ed27c97a", "address": "fa:16:3e:ff:a6:88", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap062afddc-3d", "ovs_interfaceid": "062afddc-3d10-4dc2-a9d7-6024ed27c97a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:00:53.228274 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:53.342444 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:00:53.349213 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-d04f56ec-9697-43e1-b09e-b431c2aeef5b req-72612520-ad1c-419e-ae17-8ec985d15df8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:00:53.404474 np0000001583 nova-compute[98241]: DEBUG nova.compute.rpcapi [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98241) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 02:00:53.424011 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] End _get_guest_xml xml=<domain type="qemu">
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:   <uuid>01d8de67-23ab-4430-8512-d2fece776ac2</uuid>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:   <name>instance-0000002b</name>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:   <metadata>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1880176888</nova:name>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 02:00:52</nova:creationTime>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:       </nova:image>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:         <nova:user uuid="00cb6190618b45eb994dd16d3c657f01">tempest-AttachVolumeNegativeTest-169599115-project-member</nova:user>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:         <nova:project uuid="837663bcfa40402aaf583729dfbb26cd">tempest-AttachVolumeNegativeTest-169599115</nova:project>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:         <nova:port uuid="d1e489a2-57fb-4508-9524-ad06f0b81235">
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:         </nova:port>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:   </metadata>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:     <system>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:       <entry name="serial">01d8de67-23ab-4430-8512-d2fece776ac2</entry>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:       <entry name="uuid">01d8de67-23ab-4430-8512-d2fece776ac2</entry>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:     </system>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:   <os>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:   </os>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:   <features>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:     <acpi/>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:     <tcg>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:     </tcg>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:   </features>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:   </cpu>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:   <devices>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/01d8de67-23ab-4430-8512-d2fece776ac2/disk"/>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:     </disk>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/01d8de67-23ab-4430-8512-d2fece776ac2/disk.config"/>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:     </disk>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:de:ac:a2"/>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:       <target dev="tapd1e489a2-57"/>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:     </interface>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/01d8de67-23ab-4430-8512-d2fece776ac2/console.log" append="off"/>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:     </serial>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:     <video>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:     </video>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:     </rng>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:     </memballoon>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:   </devices>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]: </domain>
May 28 02:00:53.424011 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 02:00:53.427584 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Preparing to wait for external event network-vif-plugged-d1e489a2-57fb-4508-9524-ad06f0b81235 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 02:00:53.427584 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "01d8de67-23ab-4430-8512-d2fece776ac2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:53.427584 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "01d8de67-23ab-4430-8512-d2fece776ac2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:53.427584 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "01d8de67-23ab-4430-8512-d2fece776ac2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:53.427584 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:00:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1880176888',display_name='tempest-AttachVolumeNegativeTest-server-1880176888',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-attachvolumenegativetest-server-1880176888',id=43,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbWhtUZxp49C8PrIko4aR2U+3ihHHccw06V8Yz9ozm8GmdMYEUXlyx3pItVb8mor6VlJo3yFx3LIbj4UIge19ucWylEUcf7mQAxX2QIGNGtl9SpxjGDPvZAEO1bWMEkhg==',key_name='tempest-keypair-933730014',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='837663bcfa40402aaf583729dfbb26cd',ramdisk_id='',reservation_id='r-qu2btn5b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-169599115',owner_user_name='tempest-AttachVolumeNegativeTest-169599115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:00:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='00cb6190618b45eb994dd16d3c657f01',uuid=01d8de67-23ab-4430-8512-d2fece776ac2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1e489a2-57fb-4508-9524-ad06f0b81235", "address": "fa:16:3e:de:ac:a2", "network": {"id": "62e7cc38-1758-4b09-a352-4635adc9cfea", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587967507-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "837663bcfa40402aaf583729dfbb26cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1e489a2-57", "ovs_interfaceid": "d1e489a2-57fb-4508-9524-ad06f0b81235", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 02:00:53.428657 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Converting VIF {"id": "d1e489a2-57fb-4508-9524-ad06f0b81235", "address": "fa:16:3e:de:ac:a2", "network": {"id": "62e7cc38-1758-4b09-a352-4635adc9cfea", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587967507-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "837663bcfa40402aaf583729dfbb26cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1e489a2-57", "ovs_interfaceid": "d1e489a2-57fb-4508-9524-ad06f0b81235", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:00:53.429647 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:ac:a2,bridge_name='br-int',has_traffic_filtering=True,id=d1e489a2-57fb-4508-9524-ad06f0b81235,network=Network(62e7cc38-1758-4b09-a352-4635adc9cfea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1e489a2-57') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:00:53.430017 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:ac:a2,bridge_name='br-int',has_traffic_filtering=True,id=d1e489a2-57fb-4508-9524-ad06f0b81235,network=Network(62e7cc38-1758-4b09-a352-4635adc9cfea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1e489a2-57') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 02:00:53.433046 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:53.435352 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:00:53.435548 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 02:00:53.440978 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "8b2a5f31-1b3d-447f-939e-94fd0be5eb85-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:53.441155 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "8b2a5f31-1b3d-447f-939e-94fd0be5eb85-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:53.443535 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "8b2a5f31-1b3d-447f-939e-94fd0be5eb85-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:53.444350 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:53.444535 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bfb9f7b9-2b2f-584a-b85d-d369ed400046', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:00:53.445364 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:53.446323 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:00:53.464877 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:53.470881 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:53.471197 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd1e489a2-57, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:00:53.471830 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd1e489a2-57, col_values=(('qos', UUID('9e13baeb-237c-4bca-bac8-be56fcaa841e')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:00:53.471830 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd1e489a2-57, col_values=(('external_ids', {'iface-id': 'd1e489a2-57fb-4508-9524-ad06f0b81235', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:ac:a2', 'vm-uuid': '01d8de67-23ab-4430-8512-d2fece776ac2'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:00:53.472861 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:53.475091 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:00:53.486594 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:53.488688 np0000001583 nova-compute[98241]: INFO os_vif [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:ac:a2,bridge_name='br-int',has_traffic_filtering=True,id=d1e489a2-57fb-4508-9524-ad06f0b81235,network=Network(62e7cc38-1758-4b09-a352-4635adc9cfea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1e489a2-57')
May 28 02:00:53.538233 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Object Instance<d4fad20b-d51e-47c9-8f55-3aa085a10891> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 02:00:53.538616 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:00:53.580483 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Releasing lock "refresh_cache-a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:00:53.651703 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.113s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:00:53.652179 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 02:00:53.652942 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:00:53.752713 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:00:53.753147 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Cannot resize image /opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 02:00:53.753387 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lazy-loading 'migration_context' on Instance uuid d4fad20b-d51e-47c9-8f55-3aa085a10891 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:00:53.802724 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-d04f56ec-9697-43e1-b09e-b431c2aeef5b req-72612520-ad1c-419e-ae17-8ec985d15df8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:00:53.846216 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Took 1.80 seconds to deallocate network for instance.
May 28 02:00:53.971871 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-d04f56ec-9697-43e1-b09e-b431c2aeef5b req-72612520-ad1c-419e-ae17-8ec985d15df8 service nova] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Updated VIF entry in instance network info cache for port d1e489a2-57fb-4508-9524-ad06f0b81235. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:00:53.971871 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-d04f56ec-9697-43e1-b09e-b431c2aeef5b req-72612520-ad1c-419e-ae17-8ec985d15df8 service nova] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Updating instance_info_cache with network_info: [{"id": "d1e489a2-57fb-4508-9524-ad06f0b81235", "address": "fa:16:3e:de:ac:a2", "network": {"id": "62e7cc38-1758-4b09-a352-4635adc9cfea", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587967507-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "837663bcfa40402aaf583729dfbb26cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1e489a2-57", "ovs_interfaceid": "d1e489a2-57fb-4508-9524-ad06f0b81235", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:00:54.256428 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Object Instance<d4fad20b-d51e-47c9-8f55-3aa085a10891> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 02:00:54.260106 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:58:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-522410549',display_name='tempest-AttachVolumeTestJSON-server-522410549',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-attachvolumetestjson-server-522410549',id=34,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/SX3aLhOteyGwrFqR0CEL4C04Fp6fWjwsBRpIz44V+NdHV7WRnAaFAuCSewkCiCwsHBAYVT3CCSkcBu9Z5deiFWGGYvkB/zQRpMDdHuyRrvPU5bkBQzk+aQ10B/g2ZJA==',key_name='tempest-keypair-487865295',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:58:49Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='04ce4063a6ac4afdb5ee359a5c1105d3',ramdisk_id='',reservation_id='r-q0lo3p0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1276932129',owner_user_name='tempest-AttachVolumeTestJSON-1276932129-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:00:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='164f3d08de954440bd716afe5eb1054a',uuid=d4fad20b-d51e-47c9-8f55-3aa085a10891,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "address": "fa:16:3e:ca:8c:e2", "network": {"id": "d4bf7f94-4ac7-4145-be11-d2aeeafb6c02", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-972487534-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "04ce4063a6ac4afdb5ee359a5c1105d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e39a69e-35", "ovs_interfaceid": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 02:00:54.260106 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Converting VIF {"id": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "address": "fa:16:3e:ca:8c:e2", "network": {"id": "d4bf7f94-4ac7-4145-be11-d2aeeafb6c02", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-972487534-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "04ce4063a6ac4afdb5ee359a5c1105d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e39a69e-35", "ovs_interfaceid": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:00:54.260106 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:8c:e2,bridge_name='br-int',has_traffic_filtering=True,id=0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b,network=Network(d4bf7f94-4ac7-4145-be11-d2aeeafb6c02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e39a69e-35') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:00:54.260106 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:8c:e2,bridge_name='br-int',has_traffic_filtering=True,id=0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b,network=Network(d4bf7f94-4ac7-4145-be11-d2aeeafb6c02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e39a69e-35') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 02:00:54.262638 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:54.263126 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:00:54.263542 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 02:00:54.264459 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:54.264684 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ba3c78f9-de7a-55b7-bdb7-031dda98db4b', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:00:54.265777 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:54.266683 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:00:54.280183 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:54.286380 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:54.286671 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0e39a69e-35, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:00:54.289258 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0e39a69e-35, col_values=(('qos', UUID('1bd209ef-9a83-4a64-a71b-3bd8f36c9a89')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:00:54.289258 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0e39a69e-35, col_values=(('external_ids', {'iface-id': '0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:8c:e2', 'vm-uuid': 'd4fad20b-d51e-47c9-8f55-3aa085a10891'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:00:54.289710 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:54.291520 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:00:54.306033 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:54.307904 np0000001583 nova-compute[98241]: INFO os_vif [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:8c:e2,bridge_name='br-int',has_traffic_filtering=True,id=0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b,network=Network(d4bf7f94-4ac7-4145-be11-d2aeeafb6c02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e39a69e-35')
May 28 02:00:54.354460 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3f2256cf-0d16-480b-830a-c3a4171943a7 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:54.354796 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3f2256cf-0d16-480b-830a-c3a4171943a7 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:54.471772 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:00:54.474944 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d04f56ec-9697-43e1-b09e-b431c2aeef5b req-72612520-ad1c-419e-ae17-8ec985d15df8 service nova] Releasing lock "refresh_cache-01d8de67-23ab-4430-8512-d2fece776ac2" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:00:54.574203 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "refresh_cache-8b2a5f31-1b3d-447f-939e-94fd0be5eb85" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:00:54.574481 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquired lock "refresh_cache-8b2a5f31-1b3d-447f-939e-94fd0be5eb85" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:00:54.574669 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:00:54.620803 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Instance destroyed successfully.
May 28 02:00:54.621392 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lazy-loading 'numa_topology' on Instance uuid a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:00:54.884431 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:54.931257 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:54.932493 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:55.019265 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:00:55.019474 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:00:55.019632 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] No VIF found with MAC fa:16:3e:de:ac:a2, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:00:55.020323 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Using config drive
May 28 02:00:55.029202 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:55.077264 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:00:55.126897 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Object Instance<a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d> lazy-loaded attributes: flavor,info_cache,numa_topology {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 02:00:55.127433 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lazy-loading 'resources' on Instance uuid a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:00:55.161759 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0c739d3e-6aee-40cd-98ee-3023f04f9c38 req-c26691b5-76e3-4ce4-82ff-a88ec9e3cb15 service nova] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Received event network-vif-plugged-0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:00:55.163045 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0c739d3e-6aee-40cd-98ee-3023f04f9c38 req-c26691b5-76e3-4ce4-82ff-a88ec9e3cb15 service nova] Acquiring lock "d4fad20b-d51e-47c9-8f55-3aa085a10891-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:55.163723 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0c739d3e-6aee-40cd-98ee-3023f04f9c38 req-c26691b5-76e3-4ce4-82ff-a88ec9e3cb15 service nova] Lock "d4fad20b-d51e-47c9-8f55-3aa085a10891-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:55.164566 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0c739d3e-6aee-40cd-98ee-3023f04f9c38 req-c26691b5-76e3-4ce4-82ff-a88ec9e3cb15 service nova] Lock "d4fad20b-d51e-47c9-8f55-3aa085a10891-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:55.164566 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0c739d3e-6aee-40cd-98ee-3023f04f9c38 req-c26691b5-76e3-4ce4-82ff-a88ec9e3cb15 service nova] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] No waiting events found dispatching network-vif-plugged-0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:00:55.165532 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-0c739d3e-6aee-40cd-98ee-3023f04f9c38 req-c26691b5-76e3-4ce4-82ff-a88ec9e3cb15 service nova] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Received unexpected event network-vif-plugged-0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b for instance with vm_state stopped and task_state powering-on.
May 28 02:00:55.284871 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3f2256cf-0d16-480b-830a-c3a4171943a7 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:00:55.285177 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-3f2256cf-0d16-480b-830a-c3a4171943a7 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:00:55.322472 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:55.339110 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:55.339695 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:55.376000 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:55.392523 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:55.527308 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:00:55.550836 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:00:55.630297 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Object Instance<a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d> lazy-loaded attributes: flavor,info_cache,numa_topology,resources {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 02:00:55.631220 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:59:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-122348002',display_name='tempest-TestVolumeBootPattern-server-122348002',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testvolumebootpattern-server-122348002',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAAXSwkEIXS5PPxf3LnhrDvV1d+6UfjHy8aXnhsA4kJJX2FmeQvb3lEjUETHta29JzRPDevvLGSBNv16sMuL0GFa7gRKeRQiBCOB74vGY7LOBq7vL4B/fsS34ce5RE5NuA==',key_name='tempest-keypair-125840429',keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:00:08Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='432aa1094ced436494def17a875aa8e1',ramdisk_id='',reservation_id='r-3bd3wvda',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1031057169',owner_user_name='tempest-TestVolumeBootPattern-1031057169-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T02:00:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6be314b4eed642c3b2c72fe115860220',uuid=a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "062afddc-3d10-4dc2-a9d7-6024ed27c97a", "address": "fa:16:3e:ff:a6:88", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap062afddc-3d", "ovs_interfaceid": "062afddc-3d10-4dc2-a9d7-6024ed27c97a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:00:55.631476 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converting VIF {"id": "062afddc-3d10-4dc2-a9d7-6024ed27c97a", "address": "fa:16:3e:ff:a6:88", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap062afddc-3d", "ovs_interfaceid": "062afddc-3d10-4dc2-a9d7-6024ed27c97a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:00:55.632202 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:a6:88,bridge_name='br-int',has_traffic_filtering=True,id=062afddc-3d10-4dc2-a9d7-6024ed27c97a,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap062afddc-3d') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:00:55.632509 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:a6:88,bridge_name='br-int',has_traffic_filtering=True,id=062afddc-3d10-4dc2-a9d7-6024ed27c97a,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap062afddc-3d') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:00:55.635088 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:55.635495 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap062afddc-3d, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:00:55.641483 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:55.642747 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:00:55.644478 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:55.645854 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:55.646162 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2b9bc627-ee3c-4ce6-a6b0-55990cdae927) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:00:55.647026 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:55.648011 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:00:55.654008 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:55.656673 np0000001583 nova-compute[98241]: INFO os_vif [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:a6:88,bridge_name='br-int',has_traffic_filtering=True,id=062afddc-3d10-4dc2-a9d7-6024ed27c97a,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap062afddc-3d')
May 28 02:00:55.659224 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:00:55.659632 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d', 'iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f12a45d8-1f6d-4068-927e-408a86ee7e6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:00:55.660111 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:00:55.661124 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:00:55.661124 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d', 'iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f12a45d8-1f6d-4068-927e-408a86ee7e6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:00:55.661357 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:00:55.700399 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:55.700399 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:55.700399 np0000001583 nova-compute[98241]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:55.700399 np0000001583 nova-compute[98241]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:55.700399 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:55.700399 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:55.700399 np0000001583 nova-compute[98241]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eade3490-1ca9-4c11-bc60-106ab5d033dc (non-flash)
May 28 02:00:55.700399 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:00:55.700633 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:55.700633 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:55.700633 np0000001583 nova-compute[98241]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:55.700633 np0000001583 nova-compute[98241]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:55.700633 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:55.700633 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:55.700633 np0000001583 nova-compute[98241]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eade3490-1ca9-4c11-bc60-106ab5d033dc (non-flash)
May 28 02:00:55.700633 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:00:55.700838 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', '68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', '69'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d', '87'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d', '88'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', '91'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', '92'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eade3490-1ca9-4c11-bc60-106ab5d033dc', '94')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:00:55.701127 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d', '87')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:00:55.704727 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d', '88')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:00:55.707824 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f829f380>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d'): ({'sdm'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d'): ({'sdn'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:00:55.708126 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Removing multipathed devices sdm, sdn {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:00:55.710600 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Flush multipath device 330000000519e27f4 {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:00:55.714652 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Creating config drive at /opt/stack/data/nova/instances/01d8de67-23ab-4430-8512-d2fece776ac2/disk.config
May 28 02:00:55.719747 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/01d8de67-23ab-4430-8512-d2fece776ac2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpl_g2vrv0 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:00:55.756587 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Updating instance_info_cache with network_info: [{"id": "77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0", "address": "fa:16:3e:76:c5:3f", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77a0d5b8-3f", "ovs_interfaceid": "77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:00:55.782308 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:00:55.790945 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-3f2256cf-0d16-480b-830a-c3a4171943a7 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:00:55.800025 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/01d8de67-23ab-4430-8512-d2fece776ac2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpl_g2vrv0" returned: 0 in 0.081s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:00:55.849892 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:00:55.869313 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Acquiring lock "c6e87c0e-02e1-4941-8f2f-b969b93ebf9f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:55.869527 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "c6e87c0e-02e1-4941-8f2f-b969b93ebf9f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:55.911120 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Checking to see if SCSI volumes sdm, sdn have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:00:55.911583 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] SCSI volumes sdm, sdn have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:00:55.913289 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Checking to see if device paths {'sdm', 'sdn'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:00:55.935104 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Device paths {'sdm', 'sdn'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:00:55.935104 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:00:55.950973 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:55.995332 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 87, target: iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d, portal: 192.168.40.100,3260]
May 28 02:00:55.995332 np0000001583 nova-compute[98241]: Logout of [sid: 87, target: iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d, portal: 192.168.40.100,3260] successful.
May 28 02:00:55.995332 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:56.018501 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:56.035508 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:56.077703 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 88, target: iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d, portal: 192.168.50.100,3260]
May 28 02:00:56.077703 np0000001583 nova-compute[98241]: Logout of [sid: 88, target: iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d, portal: 192.168.50.100,3260] successful.
May 28 02:00:56.077703 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:56.095858 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:56.096593 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.436s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:00:56.096804 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] <== disconnect_volume: return (437ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:00:56.096865 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:00:56.099981 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Removed pending STOPPED event for d4fad20b-d51e-47c9-8f55-3aa085a10891 due to new event <LifecycleEvent: 1779933656.0989819, d4fad20b-d51e-47c9-8f55-3aa085a10891 => Resumed> {{(pid=98241) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 02:00:56.100362 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Instance event wait completed in 0 seconds for  {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 02:00:56.101180 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933656.0989819, d4fad20b-d51e-47c9-8f55-3aa085a10891 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:00:56.101798 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] VM Resumed (Lifecycle Event)
May 28 02:00:56.107133 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Start _get_guest_xml network_info=[{"id": "062afddc-3d10-4dc2-a9d7-6024ed27c97a", "address": "fa:16:3e:ff:a6:88", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap062afddc-3d", "ovs_interfaceid": "062afddc-3d10-4dc2-a9d7-6024ed27c97a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d', 'iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f12a45d8-1f6d-4068-927e-408a86ee7e6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, 'status': 'reserved', 'instance': 'a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d', 'attached_at': '', 'detached_at': '', 'volume_id': 'f12a45d8-1f6d-4068-927e-408a86ee7e6d', 'serial': 'f12a45d8-1f6d-4068-927e-408a86ee7e6d'}, 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'fa45330d-d53b-4fa4-a54b-476db49d288a', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 02:00:56.111652 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Instance rebooted successfully.
May 28 02:00:56.113527 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:00:56.116176 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-122348002', uuid='a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d'), owner=OwnerMeta(userid='6be314b4eed642c3b2c72fe115860220', username='tempest-TestVolumeBootPattern-1031057169-project-member', projectid='432aa1094ced436494def17a875aa8e1', projectname='tempest-TestVolumeBootPattern-1031057169'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "062afddc-3d10-4dc2-a9d7-6024ed27c97a", "address": "fa:16:3e:ff:a6:88", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap062afddc-3d", "ovs_interfaceid": "062afddc-3d10-4dc2-a9d7-6024ed27c97a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933656.1152606) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 02:00:56.118996 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 02:00:56.119446 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 02:00:56.121606 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 02:00:56.122231 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 02:00:56.123268 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 02:00:56.123809 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 02:00:56.123958 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 02:00:56.124073 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 02:00:56.124233 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 02:00:56.124315 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 02:00:56.124413 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 02:00:56.124564 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 02:00:56.124702 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 02:00:56.124846 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 02:00:56.124952 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 02:00:56.125186 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 02:00:56.125459 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lazy-loading 'vcpu_model' on Instance uuid a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:00:56.261607 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Releasing lock "refresh_cache-8b2a5f31-1b3d-447f-939e-94fd0be5eb85" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:00:56.306161 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3f2256cf-0d16-480b-830a-c3a4171943a7 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.950s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:56.357325 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:56.377164 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 02:00:56.387677 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:56.390520 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:56.405846 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-3f2256cf-0d16-480b-830a-c3a4171943a7 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Deleted allocations for instance 27c37404-4df0-4ded-bf5b-6002e26d4222
May 28 02:00:56.485201 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:56.612251 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:00:56.620147 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:00:56.627708 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Object Instance<a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 02:00:56.657314 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d/disk.config --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:00:56.779889 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:00:56.783888 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d/disk.config --force-share --output=json" returned: 0 in 0.127s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:00:56.784471 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "/opt/stack/data/nova/instances/a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:56.784796 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "/opt/stack/data/nova/instances/a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:56.786024 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "/opt/stack/data/nova/instances/a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:56.786024 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 02:00:56.788291 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d', 'iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f12a45d8-1f6d-4068-927e-408a86ee7e6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:00:56.788291 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:00:56.788291 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:00:56.788291 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d', 'iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f12a45d8-1f6d-4068-927e-408a86ee7e6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 02:00:56.806573 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 02:00:56.808326 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:00:56.809733 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:00:56.810361 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:00:56.810609 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:00:56.810950 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:00:56.811781 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:00:56.832434 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:00:56.832434 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:56.840183 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:56.844371 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:56.849789 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:00:56.849789 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:56.857222 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:00:56.883888 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d] added
May 28 02:00:56.883888 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:00:56.883888 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:00:56.883888 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:00:56.883888 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:00:56.883888 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:00:56.883888 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:56.884315 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:00:56.898321 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d] added
May 28 02:00:56.898321 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:00:56.898321 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:00:56.898321 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:00:56.898321 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:00:56.898321 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:00:56.898321 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:56.898781 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0839(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:00:56.900148 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:56.910028 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:00:56.910998 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:00:56.917745 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0989(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:00:56.921597 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:00:56.928509 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 02:00:56.928509 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 02:00:56.940771 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 02:00:56.942381 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::8832:afff:fe8a:cd4c', 'fe80::fc16:3eff:fe48:7d7b', 'fe80::d0cf:7bff:fef9:3cc3', 'fe80::fc16:3eff:feca:d649', 'fe80::fc16:3eff:fed3:cd06', 'fe80::fc16:3eff:feae:1e12', 'fe80::fc16:3eff:fedf:4521', 'fe80::fc16:3eff:fe57:9502', 'fe80::fc16:3eff:feca:8ce2', 'fe80::5048:4dff:fe67:fb12', 'fe80::fc16:3eff:fede:aca2', 'fe80::ecb9:b7ff:fe00:dc63'] 
May 28 02:00:56.942801 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 02:00:56.942801 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 02:00:56.942900 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:00:56.991705 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:56.993202 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:57.010413 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 02:00:57.010739 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Claim successful on node np0000001583
May 28 02:00:57.128913 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] During sync_power_state the instance has a pending task (powering-on). Skip.
May 28 02:00:57.129832 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933657.129548, d4fad20b-d51e-47c9-8f55-3aa085a10891 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:00:57.130496 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] VM Started (Lifecycle Event)
May 28 02:00:57.245933 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-647f5ead-0a84-49df-aaa4-7455c24c0e83 req-8857249f-aa3d-4190-9b1b-ea2b09697511 service nova] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Received event network-vif-plugged-0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:00:57.246318 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-647f5ead-0a84-49df-aaa4-7455c24c0e83 req-8857249f-aa3d-4190-9b1b-ea2b09697511 service nova] Acquiring lock "d4fad20b-d51e-47c9-8f55-3aa085a10891-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:57.246481 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-647f5ead-0a84-49df-aaa4-7455c24c0e83 req-8857249f-aa3d-4190-9b1b-ea2b09697511 service nova] Lock "d4fad20b-d51e-47c9-8f55-3aa085a10891-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:57.246631 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-647f5ead-0a84-49df-aaa4-7455c24c0e83 req-8857249f-aa3d-4190-9b1b-ea2b09697511 service nova] Lock "d4fad20b-d51e-47c9-8f55-3aa085a10891-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:57.246760 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-647f5ead-0a84-49df-aaa4-7455c24c0e83 req-8857249f-aa3d-4190-9b1b-ea2b09697511 service nova] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] No waiting events found dispatching network-vif-plugged-0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:00:57.246897 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-647f5ead-0a84-49df-aaa4-7455c24c0e83 req-8857249f-aa3d-4190-9b1b-ea2b09697511 service nova] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Received unexpected event network-vif-plugged-0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b for instance with vm_state stopped and task_state powering-on.
May 28 02:00:57.247029 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-647f5ead-0a84-49df-aaa4-7455c24c0e83 req-8857249f-aa3d-4190-9b1b-ea2b09697511 service nova] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Received event network-vif-plugged-d1e489a2-57fb-4508-9524-ad06f0b81235 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:00:57.247186 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-647f5ead-0a84-49df-aaa4-7455c24c0e83 req-8857249f-aa3d-4190-9b1b-ea2b09697511 service nova] Acquiring lock "01d8de67-23ab-4430-8512-d2fece776ac2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:57.247327 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-647f5ead-0a84-49df-aaa4-7455c24c0e83 req-8857249f-aa3d-4190-9b1b-ea2b09697511 service nova] Lock "01d8de67-23ab-4430-8512-d2fece776ac2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:57.247446 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-647f5ead-0a84-49df-aaa4-7455c24c0e83 req-8857249f-aa3d-4190-9b1b-ea2b09697511 service nova] Lock "01d8de67-23ab-4430-8512-d2fece776ac2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:57.247559 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-647f5ead-0a84-49df-aaa4-7455c24c0e83 req-8857249f-aa3d-4190-9b1b-ea2b09697511 service nova] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Processing event network-vif-plugged-d1e489a2-57fb-4508-9524-ad06f0b81235 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 02:00:57.247905 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-647f5ead-0a84-49df-aaa4-7455c24c0e83 req-8857249f-aa3d-4190-9b1b-ea2b09697511 service nova] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Received event network-vif-plugged-d1e489a2-57fb-4508-9524-ad06f0b81235 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:00:57.247905 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-647f5ead-0a84-49df-aaa4-7455c24c0e83 req-8857249f-aa3d-4190-9b1b-ea2b09697511 service nova] Acquiring lock "01d8de67-23ab-4430-8512-d2fece776ac2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:57.248052 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-647f5ead-0a84-49df-aaa4-7455c24c0e83 req-8857249f-aa3d-4190-9b1b-ea2b09697511 service nova] Lock "01d8de67-23ab-4430-8512-d2fece776ac2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:57.248052 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-647f5ead-0a84-49df-aaa4-7455c24c0e83 req-8857249f-aa3d-4190-9b1b-ea2b09697511 service nova] Lock "01d8de67-23ab-4430-8512-d2fece776ac2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:57.248169 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-647f5ead-0a84-49df-aaa4-7455c24c0e83 req-8857249f-aa3d-4190-9b1b-ea2b09697511 service nova] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] No waiting events found dispatching network-vif-plugged-d1e489a2-57fb-4508-9524-ad06f0b81235 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:00:57.249519 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-647f5ead-0a84-49df-aaa4-7455c24c0e83 req-8857249f-aa3d-4190-9b1b-ea2b09697511 service nova] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Received unexpected event network-vif-plugged-d1e489a2-57fb-4508-9524-ad06f0b81235 for instance with vm_state building and task_state spawning.
May 28 02:00:57.423481 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3f2256cf-0d16-480b-830a-c3a4171943a7 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "27c37404-4df0-4ded-bf5b-6002e26d4222" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.337s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:57.504141 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 02:00:57.512071 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 02:00:57.520251 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Instance spawned successfully.
May 28 02:00:57.521141 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 02:00:57.633702 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:00:57.634247 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:00:57.634385 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:00:57.634489 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] No VIF found with MAC fa:16:3e:ca:8c:e2, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:00:57.635048 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-379bc7ee-480e-47bf-b2dc-b63cf3365333 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:00:57.636851 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:00:57.911431 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:00:57.922067 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:00:57.929512 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:00:57.929512 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:00:57.938852 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:00:57.938852 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:57.948762 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:57.957177 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:57.966211 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:57.966211 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:57.966211 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:57.966211 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:57.966211 np0000001583 nova-compute[98241]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eade3490-1ca9-4c11-bc60-106ab5d033dc (non-flash)
May 28 02:00:57.966211 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:00:57.966535 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:57.966535 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:57.966535 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:57.966535 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:57.966535 np0000001583 nova-compute[98241]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eade3490-1ca9-4c11-bc60-106ab5d033dc (non-flash)
May 28 02:00:57.966535 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:00:57.979232 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:57.979232 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:57.979232 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:57.979232 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:57.979232 np0000001583 nova-compute[98241]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eade3490-1ca9-4c11-bc60-106ab5d033dc (non-flash)
May 28 02:00:57.979232 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:00:57.979507 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:57.979507 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:57.979507 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:57.979507 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:57.979507 np0000001583 nova-compute[98241]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eade3490-1ca9-4c11-bc60-106ab5d033dc (non-flash)
May 28 02:00:57.979507 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:00:58.020762 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d, portal: 192.168.50.100,3260]
May 28 02:00:58.020762 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d, portal: 192.168.50.100,3260] successful.
May 28 02:00:58.020762 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:58.027413 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d, portal: 192.168.40.100,3260]
May 28 02:00:58.027413 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d, portal: 192.168.40.100,3260] successful.
May 28 02:00:58.027413 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:58.033282 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:00:58.033416 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:00:58.033852 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:00:58.034258 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:00:58.034588 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:00:58.035389 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:00:58.039994 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:58.048194 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:58.059515 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:58.059515 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:58.059515 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:58.059515 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:58.059515 np0000001583 nova-compute[98241]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eade3490-1ca9-4c11-bc60-106ab5d033dc (non-flash)
May 28 02:00:58.059515 np0000001583 nova-compute[98241]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:58.059515 np0000001583 nova-compute[98241]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:58.059515 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:00:58.059761 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:58.059761 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:58.059761 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:58.059761 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:58.059761 np0000001583 nova-compute[98241]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eade3490-1ca9-4c11-bc60-106ab5d033dc (non-flash)
May 28 02:00:58.059761 np0000001583 nova-compute[98241]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:58.059761 np0000001583 nova-compute[98241]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:58.059761 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:00:58.060125 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.250s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:00:58.060287 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:00:58.061551 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] HCTL ('10', '-', '-', 0) found on session 95 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:00:58.062917 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:00:58.075830 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:58.075830 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:58.075830 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:58.075830 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:58.075830 np0000001583 nova-compute[98241]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eade3490-1ca9-4c11-bc60-106ab5d033dc (non-flash)
May 28 02:00:58.075830 np0000001583 nova-compute[98241]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:58.075830 np0000001583 nova-compute[98241]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:58.075830 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:00:58.075830 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:58.075830 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:58.075830 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:58.075830 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:58.075830 np0000001583 nova-compute[98241]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eade3490-1ca9-4c11-bc60-106ab5d033dc (non-flash)
May 28 02:00:58.075830 np0000001583 nova-compute[98241]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:58.075830 np0000001583 nova-compute[98241]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:58.075830 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:00:58.076403 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.265s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:00:58.076403 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:00:58.077261 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] HCTL ('11', '-', '-', 0) found on session 96 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:00:58.077411 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:00:58.088162 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Searching for a device in session 95 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:00:58.088467 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f12a45d8-1f6d-4068-927e-408a86ee7e6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:00:58.105131 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Searching for a device in session 96 and hctl ['11', '*', '*', 0] yield: None {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:00:58.140380 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] During sync_power_state the instance has a pending task (powering-on). Skip.
May 28 02:00:58.141108 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933658.1404886, 01d8de67-23ab-4430-8512-d2fece776ac2 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:00:58.141108 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] VM Started (Lifecycle Event)
May 28 02:00:58.157185 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Starting finish_migration {{(pid=98241) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 28 02:00:58.159016 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Instance directory exists: not creating {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 02:00:58.159162 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Creating image(s)
May 28 02:00:58.162679 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:00:58.232687 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:00:58.280291 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.117s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:00:58.281448 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 02:00:58.281572 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:00:58.406253 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/disk --force-share --output=json" returned: 0 in 0.124s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:00:58.408279 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Cannot resize image /opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 02:00:58.543420 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Took 7.19 seconds to spawn the instance on the hypervisor.
May 28 02:00:58.543689 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:00:58.630484 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0006793480001761054 future=<Future at 0x7724ec2f70e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:00:58.630484 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:00:58.630484 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=1.659925789999761 future=<Future at 0x7724f81856d0 state=cancelled>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:00:58.630484 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=1.6597790840000926 future=<Future at 0x7724f81856d0 state=cancelled>) was cancelled while queued, skipping {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:00:58.630727 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:00:58.630727 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=4.654111953000211 future=<Future at 0x7724ec18ef30 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:00:58.630851 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=4.653997535000144 future=<Future at 0x7724ec18ef30 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:00:58.631781 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Emitting event <LifecycleEvent: 1779933643.6291642, 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:00:58.633627 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] VM Stopped (Lifecycle Event)
May 28 02:00:58.643965 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:00:58.649826 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:00:58.840373 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:00:58.840730 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:00:58.911186 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Did not create local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 02:00:58.911536 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Ensure instance console log exists: /opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 02:00:58.912620 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:58.912871 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:58.913068 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:58.916532 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Start _get_guest_xml network_info=[{"id": "77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0", "address": "fa:16:3e:76:c5:3f", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "vif_mac": "fa:16:3e:76:c5:3f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77a0d5b8-3f", "ovs_interfaceid": "77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2b9c7b2e-ce89-46a0-a020-361646147ba3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '8b2a5f31-1b3d-447f-939e-94fd0be5eb85', 'attached_at': '2026-05-28T02:00:57.000000', 'detached_at': '', 'volume_id': '2b9c7b2e-ce89-46a0-a020-361646147ba3', 'multiattach': True, 'serial': '2b9c7b2e-ce89-46a0-a020-361646147ba3'}, 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'attachment_id': 'e2b54f7c-0129-4520-bd16-9ba6f410a5b5', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 02:00:58.921881 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:00:58.923490 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='8b2a5f31-1b3d-447f-939e-94fd0be5eb85'), owner=OwnerMeta(userid='cadb612e41314b06914d5f5f47570e98', username='tempest-AttachVolumeMultiAttachTest-857456921-project-member', projectid='0474090f4f2d4950b51bc317f4302266', projectname='tempest-AttachVolumeMultiAttachTest-857456921'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0", "address": "fa:16:3e:76:c5:3f", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "vif_mac": "fa:16:3e:76:c5:3f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77a0d5b8-3f", "ovs_interfaceid": "77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933658.9230464) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 02:00:58.926139 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 02:00:58.926632 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 02:00:58.928058 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 02:00:58.928343 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 02:00:58.929584 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 02:00:58.930121 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 02:00:58.930378 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 02:00:58.930801 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 02:00:58.930801 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 02:00:58.930972 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 02:00:58.931193 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 02:00:58.931455 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 02:00:58.931653 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 02:00:58.931842 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 02:00:58.932001 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 02:00:58.932172 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 02:00:58.943930 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/disk.config --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:00:59.045445 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/disk.config --force-share --output=json" returned: 0 in 0.101s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:00:59.047815 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "/opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:00:59.047815 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "/opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:00:59.047815 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "/opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:59.048605 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 02:00:59.049326 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2b9c7b2e-ce89-46a0-a020-361646147ba3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:00:59.049680 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:00:59.059201 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Took 14.38 seconds to build instance.
May 28 02:00:59.103096 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Searching for a device in session 96 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:00:59.103373 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f12a45d8-1f6d-4068-927e-408a86ee7e6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:00:59.136119 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: 8adaf5e3-c7bf-403a-adc5-88e0fbc4ce6d] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:00:59.153132 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933659.1526208, 01d8de67-23ab-4430-8512-d2fece776ac2 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:00:59.153299 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] VM Paused (Lifecycle Event)
May 28 02:00:59.344016 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:00:59.561125 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-31be364c-5bd3-4fe2-9c0e-eeccefa77b6c tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "01d8de67-23ab-4430-8512-d2fece776ac2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.894s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:59.593828 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-8e82de85-791d-461a-a228-c0fa7212820e req-b991cf63-7354-4b73-a03e-33dcfc78a3d1 service nova] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Received event network-changed-d1e489a2-57fb-4508-9524-ad06f0b81235 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:00:59.594010 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-8e82de85-791d-461a-a228-c0fa7212820e req-b991cf63-7354-4b73-a03e-33dcfc78a3d1 service nova] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Refreshing instance network info cache due to event network-changed-d1e489a2-57fb-4508-9524-ad06f0b81235. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:00:59.594214 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-8e82de85-791d-461a-a228-c0fa7212820e req-b991cf63-7354-4b73-a03e-33dcfc78a3d1 service nova] Acquiring lock "refresh_cache-01d8de67-23ab-4430-8512-d2fece776ac2" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:00:59.594337 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-8e82de85-791d-461a-a228-c0fa7212820e req-b991cf63-7354-4b73-a03e-33dcfc78a3d1 service nova] Acquired lock "refresh_cache-01d8de67-23ab-4430-8512-d2fece776ac2" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:00:59.594508 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-8e82de85-791d-461a-a228-c0fa7212820e req-b991cf63-7354-4b73-a03e-33dcfc78a3d1 service nova] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Refreshing network info cache for port d1e489a2-57fb-4508-9524-ad06f0b81235 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:00:59.656479 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:00:59.659073 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933659.6579216, 01d8de67-23ab-4430-8512-d2fece776ac2 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:00:59.659073 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] VM Resumed (Lifecycle Event)
May 28 02:00:59.834414 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Found WWN 330000000519e27f4 for multipath device dm-3 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 02:00:59.835124 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.048s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:00:59.835328 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] <== connect_volume: return (3048ms) {'type': 'block', 'scsi_wwn': '330000000519e27f4', 'path': '/dev/dm-3', 'multipath_id': '330000000519e27f4'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:00:59.835468 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000519e27f4', 'path': '/dev/dm-3', 'multipath_id': '330000000519e27f4'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 02:00:59.836223 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.786s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:00:59.836626 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2b9c7b2e-ce89-46a0-a020-361646147ba3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 02:00:59.851353 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.859s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:00:59.851875 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 02:00:59.859667 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:00:59.864124 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:00:59.865366 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:00:59.866264 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:00:59.866264 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:00:59.866497 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: node.startup = automatic
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: node.session.scan = manual
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:00:59.885150 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:00:59.885150 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: node.startup = automatic
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: node.session.scan = manual
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:00:59.896142 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:00:59.896142 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:59.912173 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:59.912928 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:00:59.935729 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:59.935729 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:59.935729 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:59.935729 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:59.935729 np0000001583 nova-compute[98241]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eade3490-1ca9-4c11-bc60-106ab5d033dc (non-flash)
May 28 02:00:59.935729 np0000001583 nova-compute[98241]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:59.935729 np0000001583 nova-compute[98241]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:59.935729 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:00:59.936551 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:59.936551 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:59.936551 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:59.936551 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:59.936551 np0000001583 nova-compute[98241]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eade3490-1ca9-4c11-bc60-106ab5d033dc (non-flash)
May 28 02:00:59.936551 np0000001583 nova-compute[98241]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:59.936551 np0000001583 nova-compute[98241]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:59.936551 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:00:59.936551 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.072s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:00:59.936551 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:00:59.936935 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] HCTL ('20', '0', '0', 0) found on session 92 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:00:59.936935 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Scanning host 20 c: 0, t: 0, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:00:59.940317 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:59.940317 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:59.940317 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:59.940317 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:59.940317 np0000001583 nova-compute[98241]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eade3490-1ca9-4c11-bc60-106ab5d033dc (non-flash)
May 28 02:00:59.940317 np0000001583 nova-compute[98241]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:59.940317 np0000001583 nova-compute[98241]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:59.940317 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:00:59.940631 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:59.940631 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:00:59.940631 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:59.940631 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:00:59.940631 np0000001583 nova-compute[98241]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eade3490-1ca9-4c11-bc60-106ab5d033dc (non-flash)
May 28 02:00:59.940631 np0000001583 nova-compute[98241]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:59.940631 np0000001583 nova-compute[98241]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:00:59.940631 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:00:59.940947 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.075s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:00:59.941304 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:00:59.941560 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] HCTL ('15', '0', '0', 0) found on session 91 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:00:59.941684 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Scanning host 15 c: 0, t: 0, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:00:59.950040 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Searching for a device in session 92 and hctl ('20', '0', '0', 0) yield: sdo {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:00:59.950266 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2b9c7b2e-ce89-46a0-a020-361646147ba3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:00:59.955571 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Searching for a device in session 91 and hctl ('15', '0', '0', 0) yield: sdj {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:00:59.955750 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2b9c7b2e-ce89-46a0-a020-361646147ba3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:01:00.096750 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-8e82de85-791d-461a-a228-c0fa7212820e req-b991cf63-7354-4b73-a03e-33dcfc78a3d1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:00.161368 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:01:00.163828 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:01:00.344776 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:59:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-122348002',display_name='tempest-TestVolumeBootPattern-server-122348002',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testvolumebootpattern-server-122348002',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAAXSwkEIXS5PPxf3LnhrDvV1d+6UfjHy8aXnhsA4kJJX2FmeQvb3lEjUETHta29JzRPDevvLGSBNv16sMuL0GFa7gRKeRQiBCOB74vGY7LOBq7vL4B/fsS34ce5RE5NuA==',key_name='tempest-keypair-125840429',keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:00:08Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='432aa1094ced436494def17a875aa8e1',ramdisk_id='',reservation_id='r-3bd3wvda',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1031057169',owner_user_name='tempest-TestVolumeBootPattern-1031057169-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T02:00:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6be314b4eed642c3b2c72fe115860220',uuid=a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "062afddc-3d10-4dc2-a9d7-6024ed27c97a", "address": "fa:16:3e:ff:a6:88", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap062afddc-3d", "ovs_interfaceid": "062afddc-3d10-4dc2-a9d7-6024ed27c97a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 02:01:00.344983 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converting VIF {"id": "062afddc-3d10-4dc2-a9d7-6024ed27c97a", "address": "fa:16:3e:ff:a6:88", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap062afddc-3d", "ovs_interfaceid": "062afddc-3d10-4dc2-a9d7-6024ed27c97a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:01:00.345784 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:a6:88,bridge_name='br-int',has_traffic_filtering=True,id=062afddc-3d10-4dc2-a9d7-6024ed27c97a,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap062afddc-3d') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:01:00.346682 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lazy-loading 'pci_devices' on Instance uuid a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:01:00.363376 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 02:01:00.363657 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 02:01:00.364306 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:00.367802 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:00.458945 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f52a7ae7fbc644deb82f3382de3a4edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cfe906dd24a10819b92c144f7f06f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 02:01:00.473742 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d06f136a-35c5-4396-916b-0b9c104abbf5 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquiring lock "0d87a47f-2eb6-4e25-b44a-848fe2225962" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:00.474195 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d06f136a-35c5-4396-916b-0b9c104abbf5 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "0d87a47f-2eb6-4e25-b44a-848fe2225962" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:00.474195 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d06f136a-35c5-4396-916b-0b9c104abbf5 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquiring lock "0d87a47f-2eb6-4e25-b44a-848fe2225962-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:00.474303 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d06f136a-35c5-4396-916b-0b9c104abbf5 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "0d87a47f-2eb6-4e25-b44a-848fe2225962-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:00.474379 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d06f136a-35c5-4396-916b-0b9c104abbf5 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "0d87a47f-2eb6-4e25-b44a-848fe2225962-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:00.477510 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-8e82de85-791d-461a-a228-c0fa7212820e req-b991cf63-7354-4b73-a03e-33dcfc78a3d1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:00.479552 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-d06f136a-35c5-4396-916b-0b9c104abbf5 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Terminating instance
May 28 02:01:00.609355 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-8e82de85-791d-461a-a228-c0fa7212820e req-b991cf63-7354-4b73-a03e-33dcfc78a3d1 service nova] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Updated VIF entry in instance network info cache for port d1e489a2-57fb-4508-9524-ad06f0b81235. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:01:00.609649 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-8e82de85-791d-461a-a228-c0fa7212820e req-b991cf63-7354-4b73-a03e-33dcfc78a3d1 service nova] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Updating instance_info_cache with network_info: [{"id": "d1e489a2-57fb-4508-9524-ad06f0b81235", "address": "fa:16:3e:de:ac:a2", "network": {"id": "62e7cc38-1758-4b09-a352-4635adc9cfea", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587967507-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "837663bcfa40402aaf583729dfbb26cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1e489a2-57", "ovs_interfaceid": "d1e489a2-57fb-4508-9524-ad06f0b81235", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:01:00.648406 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:00.848649 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Object Instance<a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 02:01:00.850125 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] End _get_guest_xml xml=<domain type="qemu">
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:   <uuid>a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d</uuid>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:   <name>instance-00000029</name>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:   <metadata>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:       <nova:name>tempest-TestVolumeBootPattern-server-122348002</nova:name>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 02:00:56</nova:creationTime>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:       <nova:image uuid="">
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:       </nova:image>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:         <nova:user uuid="6be314b4eed642c3b2c72fe115860220">tempest-TestVolumeBootPattern-1031057169-project-member</nova:user>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:         <nova:project uuid="432aa1094ced436494def17a875aa8e1">tempest-TestVolumeBootPattern-1031057169</nova:project>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:       <nova:root type="volume" uuid=""/>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:         <nova:port uuid="062afddc-3d10-4dc2-a9d7-6024ed27c97a">
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:         </nova:port>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:   </metadata>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:     <system>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:       <entry name="serial">a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d</entry>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:       <entry name="uuid">a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d</entry>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:     </system>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:   <os>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:   </os>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:   <features>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:     <acpi/>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:     <tcg>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:     </tcg>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:   </features>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:   </cpu>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:   <devices>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d/disk.config"/>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:     </disk>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:     <disk type="block" device="disk">
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:       <alias name="ua-f12a45d8-1f6d-4068-927e-408a86ee7e6d"/>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:       <source dev="/dev/dm-3"/>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:       <serial>f12a45d8-1f6d-4068-927e-408a86ee7e6d</serial>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:     </disk>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:ff:a6:88"/>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:       <target dev="tap062afddc-3d"/>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:     </interface>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d/console.log" append="off"/>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:     </serial>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:     <video>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:     </video>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:     </rng>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:     </memballoon>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:   </devices>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]: </domain>
May 28 02:01:00.850125 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 02:01:00.851931 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 02:01:00.851931 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:59:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-122348002',display_name='tempest-TestVolumeBootPattern-server-122348002',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testvolumebootpattern-server-122348002',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAAXSwkEIXS5PPxf3LnhrDvV1d+6UfjHy8aXnhsA4kJJX2FmeQvb3lEjUETHta29JzRPDevvLGSBNv16sMuL0GFa7gRKeRQiBCOB74vGY7LOBq7vL4B/fsS34ce5RE5NuA==',key_name='tempest-keypair-125840429',keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:00:08Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='432aa1094ced436494def17a875aa8e1',ramdisk_id='',reservation_id='r-3bd3wvda',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1031057169',owner_user_name='tempest-TestVolumeBootPattern-1031057169-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T02:00:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6be314b4eed642c3b2c72fe115860220',uuid=a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "062afddc-3d10-4dc2-a9d7-6024ed27c97a", "address": "fa:16:3e:ff:a6:88", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap062afddc-3d", "ovs_interfaceid": "062afddc-3d10-4dc2-a9d7-6024ed27c97a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 02:01:00.851931 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converting VIF {"id": "062afddc-3d10-4dc2-a9d7-6024ed27c97a", "address": "fa:16:3e:ff:a6:88", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap062afddc-3d", "ovs_interfaceid": "062afddc-3d10-4dc2-a9d7-6024ed27c97a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:01:00.852672 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:a6:88,bridge_name='br-int',has_traffic_filtering=True,id=062afddc-3d10-4dc2-a9d7-6024ed27c97a,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap062afddc-3d') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:01:00.852672 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:a6:88,bridge_name='br-int',has_traffic_filtering=True,id=062afddc-3d10-4dc2-a9d7-6024ed27c97a,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap062afddc-3d') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 02:01:00.852947 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:00.853219 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:01:00.853509 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 02:01:00.854529 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:00.854653 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e2070baa-2430-5471-9673-2bef28d15dd1', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:01:00.856389 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:00.857244 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:01:00.857578 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:00.860035 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:00.860279 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap062afddc-3d, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:01:00.860669 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap062afddc-3d, col_values=(('qos', UUID('8fbbff7f-187e-4875-9021-18c74abed9b7')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:01:00.860920 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap062afddc-3d, col_values=(('external_ids', {'iface-id': '062afddc-3d10-4dc2-a9d7-6024ed27c97a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:a6:88', 'vm-uuid': 'a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:01:00.861979 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:00.863304 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:01:00.866690 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 02:01:00.867855 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 02:01:00.871040 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:00.872318 np0000001583 nova-compute[98241]: INFO os_vif [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:a6:88,bridge_name='br-int',has_traffic_filtering=True,id=062afddc-3d10-4dc2-a9d7-6024ed27c97a,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap062afddc-3d')
May 28 02:01:00.891319 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Successfully created port: 18842969-e82f-4389-a30f-f5054a50d115 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 02:01:00.983513 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-d06f136a-35c5-4396-916b-0b9c104abbf5 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 02:01:01.012185 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:01.019627 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:01.040300 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:01.111588 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-8e82de85-791d-461a-a228-c0fa7212820e req-b991cf63-7354-4b73-a03e-33dcfc78a3d1 service nova] Releasing lock "refresh_cache-01d8de67-23ab-4430-8512-d2fece776ac2" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:01:01.236413 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:01.246541 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:01.274119 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-1edeecb7-e7a4-42fc-9dd9-fdccc0ff7759 req-63d760a8-48a2-40ce-849a-ab08b3bdfd37 service nova] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Received event network-vif-unplugged-f23d344d-9e4c-41b4-a61f-b324ba3c9794 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:01:01.275527 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-1edeecb7-e7a4-42fc-9dd9-fdccc0ff7759 req-63d760a8-48a2-40ce-849a-ab08b3bdfd37 service nova] Acquiring lock "0d87a47f-2eb6-4e25-b44a-848fe2225962-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:01.275830 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-1edeecb7-e7a4-42fc-9dd9-fdccc0ff7759 req-63d760a8-48a2-40ce-849a-ab08b3bdfd37 service nova] Lock "0d87a47f-2eb6-4e25-b44a-848fe2225962-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:01.276018 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-1edeecb7-e7a4-42fc-9dd9-fdccc0ff7759 req-63d760a8-48a2-40ce-849a-ab08b3bdfd37 service nova] Lock "0d87a47f-2eb6-4e25-b44a-848fe2225962-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:01.276237 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-1edeecb7-e7a4-42fc-9dd9-fdccc0ff7759 req-63d760a8-48a2-40ce-849a-ab08b3bdfd37 service nova] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] No waiting events found dispatching network-vif-unplugged-f23d344d-9e4c-41b4-a61f-b324ba3c9794 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:01:01.276419 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-1edeecb7-e7a4-42fc-9dd9-fdccc0ff7759 req-63d760a8-48a2-40ce-849a-ab08b3bdfd37 service nova] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Received event network-vif-unplugged-f23d344d-9e4c-41b4-a61f-b324ba3c9794 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:01:01.373810 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 02:01:01.540854 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:01.573889 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:01.575368 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:01.626366 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Successfully updated port: 18842969-e82f-4389-a30f-f5054a50d115 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 02:01:01.706031 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999084865999976 future=<Future at 0x7724ec2634a0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:01:01.714462 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Instance destroyed successfully.
May 28 02:01:01.714751 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-d06f136a-35c5-4396-916b-0b9c104abbf5 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lazy-loading 'resources' on Instance uuid 0d87a47f-2eb6-4e25-b44a-848fe2225962 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:01:01.716141 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:01.725198 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-027f2bb7-1634-44db-a2aa-708908a4045d req-e2c22470-7845-42e2-9a50-0fa501efe21c service nova] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Received event network-changed-18842969-e82f-4389-a30f-f5054a50d115 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:01:01.725198 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-027f2bb7-1634-44db-a2aa-708908a4045d req-e2c22470-7845-42e2-9a50-0fa501efe21c service nova] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Refreshing instance network info cache due to event network-changed-18842969-e82f-4389-a30f-f5054a50d115. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:01:01.725198 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-027f2bb7-1634-44db-a2aa-708908a4045d req-e2c22470-7845-42e2-9a50-0fa501efe21c service nova] Acquiring lock "refresh_cache-c6e87c0e-02e1-4941-8f2f-b969b93ebf9f" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:01:01.725198 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-027f2bb7-1634-44db-a2aa-708908a4045d req-e2c22470-7845-42e2-9a50-0fa501efe21c service nova] Acquired lock "refresh_cache-c6e87c0e-02e1-4941-8f2f-b969b93ebf9f" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:01:01.725198 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-027f2bb7-1634-44db-a2aa-708908a4045d req-e2c22470-7845-42e2-9a50-0fa501efe21c service nova] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Refreshing network info cache for port 18842969-e82f-4389-a30f-f5054a50d115 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:01:01.890894 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Found WWN 330000000e4a7908f for multipath device dm-10 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 02:01:01.891294 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.055s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:01:01.892349 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] <== connect_volume: return (2842ms) {'type': 'block', 'scsi_wwn': '330000000e4a7908f', 'path': '/dev/dm-10', 'multipath_id': '330000000e4a7908f'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:01:01.892548 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e4a7908f', 'path': '/dev/dm-10', 'multipath_id': '330000000e4a7908f'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 02:01:01.938745 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:01.944963 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:01.949421 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:01.974632 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:01.980781 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:02.129773 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Acquiring lock "refresh_cache-c6e87c0e-02e1-4941-8f2f-b969b93ebf9f" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:01:02.218804 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-d06f136a-35c5-4396-916b-0b9c104abbf5 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:57:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-823002783',display_name='tempest-ServerRescueNegativeTestJSON-server-823002783',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-serverrescuenegativetestjson-server-823002783',id=29,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:58:17Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f65617e71571457f8906997583100678',ramdisk_id='',reservation_id='r-9b82bcpk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1821941242',owner_user_name='tempest-ServerRescueNegativeTestJSON-1821941242-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:58:18Z,user_data=None,user_id='435dfce8f05e4e01b380797bd07bd4dc',uuid=0d87a47f-2eb6-4e25-b44a-848fe2225962,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "f23d344d-9e4c-41b4-a61f-b324ba3c9794", "address": "fa:16:3e:ca:d6:49", "network": {"id": "e1d5d073-f27b-4ff1-9ed3-99f57407c76f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f65617e71571457f8906997583100678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf23d344d-9e", "ovs_interfaceid": "f23d344d-9e4c-41b4-a61f-b324ba3c9794", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:01:02.219016 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-d06f136a-35c5-4396-916b-0b9c104abbf5 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Converting VIF {"id": "f23d344d-9e4c-41b4-a61f-b324ba3c9794", "address": "fa:16:3e:ca:d6:49", "network": {"id": "e1d5d073-f27b-4ff1-9ed3-99f57407c76f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f65617e71571457f8906997583100678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf23d344d-9e", "ovs_interfaceid": "f23d344d-9e4c-41b4-a61f-b324ba3c9794", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:01:02.219627 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-d06f136a-35c5-4396-916b-0b9c104abbf5 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:d6:49,bridge_name='br-int',has_traffic_filtering=True,id=f23d344d-9e4c-41b4-a61f-b324ba3c9794,network=Network(e1d5d073-f27b-4ff1-9ed3-99f57407c76f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf23d344d-9e') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:01:02.219876 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-d06f136a-35c5-4396-916b-0b9c104abbf5 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:d6:49,bridge_name='br-int',has_traffic_filtering=True,id=f23d344d-9e4c-41b4-a61f-b324ba3c9794,network=Network(e1d5d073-f27b-4ff1-9ed3-99f57407c76f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf23d344d-9e') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:01:02.221372 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:02.221546 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf23d344d-9e, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:01:02.222497 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:02.223316 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:01:02.223958 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:02.224737 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:02.224909 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2b7143a9-e801-4451-9819-b72319314ccd) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:01:02.225377 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:02.225880 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:01:02.226721 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:02.228726 np0000001583 nova-compute[98241]: INFO os_vif [None req-d06f136a-35c5-4396-916b-0b9c104abbf5 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:d6:49,bridge_name='br-int',has_traffic_filtering=True,id=f23d344d-9e4c-41b4-a61f-b324ba3c9794,network=Network(e1d5d073-f27b-4ff1-9ed3-99f57407c76f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf23d344d-9e')
May 28 02:01:02.229140 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-d06f136a-35c5-4396-916b-0b9c104abbf5 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Deleting instance files /opt/stack/data/nova/instances/0d87a47f-2eb6-4e25-b44a-848fe2225962_del
May 28 02:01:02.229546 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-027f2bb7-1634-44db-a2aa-708908a4045d req-e2c22470-7845-42e2-9a50-0fa501efe21c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:02.232360 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-d06f136a-35c5-4396-916b-0b9c104abbf5 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Deletion of /opt/stack/data/nova/instances/0d87a47f-2eb6-4e25-b44a-848fe2225962_del complete
May 28 02:01:02.297292 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-027f2bb7-1634-44db-a2aa-708908a4045d req-e2c22470-7845-42e2-9a50-0fa501efe21c service nova] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:01:02.392930 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 02:01:02.393763 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 02:01:02.394008 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Creating image(s)
May 28 02:01:02.394416 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Acquiring lock "/opt/stack/data/nova/instances/c6e87c0e-02e1-4941-8f2f-b969b93ebf9f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:02.394605 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "/opt/stack/data/nova/instances/c6e87c0e-02e1-4941-8f2f-b969b93ebf9f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:02.395049 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "/opt/stack/data/nova/instances/c6e87c0e-02e1-4941-8f2f-b969b93ebf9f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:02.400780 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:59:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001583',hostname='multiattach-server-0',id=40,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAP7CI9wuY8JR5OGc0CpqFzQg3rj7cqVgHC4sPYHH38XlmtTRa9WHg3S3WcIsSpd43tWEYYLHF1/yDpoSsozR5Hrjk+cgmLbTDwUHC3YheiC8VnlV/ymBtBFe0b8oxSz5w==',key_name='tempest-keypair-1713929294',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:59:57Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001583',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0474090f4f2d4950b51bc317f4302266',ramdisk_id='',reservation_id='r-rozqlw8g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-857456921',owner_user_name='tempest-AttachVolumeMultiAttachTest-857456921-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:00:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cadb612e41314b06914d5f5f47570e98',uuid=8b2a5f31-1b3d-447f-939e-94fd0be5eb85,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0", "address": "fa:16:3e:76:c5:3f", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "vif_mac": "fa:16:3e:76:c5:3f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77a0d5b8-3f", "ovs_interfaceid": "77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 02:01:02.401025 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Converting VIF {"id": "77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0", "address": "fa:16:3e:76:c5:3f", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "vif_mac": "fa:16:3e:76:c5:3f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77a0d5b8-3f", "ovs_interfaceid": "77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:01:02.401673 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:c5:3f,bridge_name='br-int',has_traffic_filtering=True,id=77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77a0d5b8-3f') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:01:02.402250 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Acquiring lock "217de507a86b423465a151d274036e35e7d64e07" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:02.402646 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "217de507a86b423465a151d274036e35e7d64e07" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:02.406170 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] End _get_guest_xml xml=<domain type="qemu">
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:   <uuid>8b2a5f31-1b3d-447f-939e-94fd0be5eb85</uuid>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:   <name>instance-00000028</name>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:   <memory>262144</memory>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:   <metadata>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:       <nova:name>multiattach-server-0</nova:name>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 02:00:58</nova:creationTime>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.micro" id="84">
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:         <nova:memory>256</nova:memory>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:       </nova:image>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:         <nova:user uuid="cadb612e41314b06914d5f5f47570e98">tempest-AttachVolumeMultiAttachTest-857456921-project-member</nova:user>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:         <nova:project uuid="0474090f4f2d4950b51bc317f4302266">tempest-AttachVolumeMultiAttachTest-857456921</nova:project>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:         <nova:port uuid="77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0">
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:         </nova:port>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:   </metadata>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:     <system>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:       <entry name="serial">8b2a5f31-1b3d-447f-939e-94fd0be5eb85</entry>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:       <entry name="uuid">8b2a5f31-1b3d-447f-939e-94fd0be5eb85</entry>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:     </system>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:   <os>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:   </os>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:   <features>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:     <acpi/>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:     <tcg>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:     </tcg>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:   </features>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:   </cpu>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:   <devices>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/disk"/>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:     </disk>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/disk.config"/>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:     </disk>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:     <disk type="block" device="disk">
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:       <alias name="ua-2b9c7b2e-ce89-46a0-a020-361646147ba3"/>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:       <source dev="/dev/dm-10"/>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:       <target dev="vdb" bus="virtio"/>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:       <serial>2b9c7b2e-ce89-46a0-a020-361646147ba3</serial>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:       <shareable/>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:     </disk>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:76:c5:3f"/>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:       <target dev="tap77a0d5b8-3f"/>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:     </interface>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/console.log" append="off"/>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:     </serial>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:     <video>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:     </video>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:     </rng>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:     </memballoon>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:   </devices>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]: </domain>
May 28 02:01:02.406170 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 02:01:02.409955 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:59:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001583',hostname='multiattach-server-0',id=40,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAP7CI9wuY8JR5OGc0CpqFzQg3rj7cqVgHC4sPYHH38XlmtTRa9WHg3S3WcIsSpd43tWEYYLHF1/yDpoSsozR5Hrjk+cgmLbTDwUHC3YheiC8VnlV/ymBtBFe0b8oxSz5w==',key_name='tempest-keypair-1713929294',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:59:57Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001583',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0474090f4f2d4950b51bc317f4302266',ramdisk_id='',reservation_id='r-rozqlw8g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-857456921',owner_user_name='tempest-AttachVolumeMultiAttachTest-857456921-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:00:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cadb612e41314b06914d5f5f47570e98',uuid=8b2a5f31-1b3d-447f-939e-94fd0be5eb85,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0", "address": "fa:16:3e:76:c5:3f", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "vif_mac": "fa:16:3e:76:c5:3f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77a0d5b8-3f", "ovs_interfaceid": "77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 02:01:02.409955 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Converting VIF {"id": "77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0", "address": "fa:16:3e:76:c5:3f", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "vif_mac": "fa:16:3e:76:c5:3f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77a0d5b8-3f", "ovs_interfaceid": "77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:01:02.409955 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:c5:3f,bridge_name='br-int',has_traffic_filtering=True,id=77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77a0d5b8-3f') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:01:02.409955 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:c5:3f,bridge_name='br-int',has_traffic_filtering=True,id=77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77a0d5b8-3f') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 02:01:02.411840 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:02.412934 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:01:02.415005 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 02:01:02.416846 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:02.417001 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7918c768-a20b-5e62-8050-bb7660c1e9f7', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:01:02.417919 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:02.418494 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:01:02.418905 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:02.422062 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:02.422227 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap77a0d5b8-3f, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:01:02.422522 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap77a0d5b8-3f, col_values=(('qos', UUID('e42db62b-e1d0-42aa-bad5-f9d081167754')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:01:02.422681 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap77a0d5b8-3f, col_values=(('external_ids', {'iface-id': '77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:c5:3f', 'vm-uuid': '8b2a5f31-1b3d-447f-939e-94fd0be5eb85'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:01:02.423490 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:02.426091 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:01:02.429371 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:02.430301 np0000001583 nova-compute[98241]: INFO os_vif [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:c5:3f,bridge_name='br-int',has_traffic_filtering=True,id=77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77a0d5b8-3f')
May 28 02:01:02.470474 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-027f2bb7-1634-44db-a2aa-708908a4045d req-e2c22470-7845-42e2-9a50-0fa501efe21c service nova] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:01:02.559718 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Removed pending STOPPED event for a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d due to new event <LifecycleEvent: 1779933662.5592866, a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d => Resumed> {{(pid=98241) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 02:01:02.561460 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933662.5592866, a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:01:02.561460 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] VM Resumed (Lifecycle Event)
May 28 02:01:02.562694 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Instance event wait completed in 0 seconds for  {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 02:01:02.565350 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Instance rebooted successfully.
May 28 02:01:02.754946 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-d06f136a-35c5-4396-916b-0b9c104abbf5 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Took 1.77 seconds to destroy the instance on the hypervisor.
May 28 02:01:02.756397 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-d06f136a-35c5-4396-916b-0b9c104abbf5 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 02:01:02.758490 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 02:01:02.758490 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 02:01:02.758490 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:02.849352 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:02.951271 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:01:02.955718 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:01:02.955718 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/217de507a86b423465a151d274036e35e7d64e07.part --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:01:02.974203 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-027f2bb7-1634-44db-a2aa-708908a4045d req-e2c22470-7845-42e2-9a50-0fa501efe21c service nova] Releasing lock "refresh_cache-c6e87c0e-02e1-4941-8f2f-b969b93ebf9f" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:01:02.979490 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Acquired lock "refresh_cache-c6e87c0e-02e1-4941-8f2f-b969b93ebf9f" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:01:02.979490 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:01:03.063605 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:01:03.071238 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:01:03.074813 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/217de507a86b423465a151d274036e35e7d64e07.part --force-share --output=json" returned: 0 in 0.120s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:01:03.075171 np0000001583 nova-compute[98241]: DEBUG nova.virt.images [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] 52c8a1d7-9a61-46ed-80ca-e9ab30606f97 was qcow2, converting to raw {{(pid=98241) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 02:01:03.075801 np0000001583 nova-compute[98241]: DEBUG nova.privsep.utils [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98241) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 02:01:03.076166 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/217de507a86b423465a151d274036e35e7d64e07.part /opt/stack/data/nova/instances/_base/217de507a86b423465a151d274036e35e7d64e07.converted {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:01:03.235144 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:03.253399 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b3242801-e8e5-4d2f-a2b3-8fffec257123 req-b2117b61-1410-4934-8c53-0a8eaf4fa219 service nova] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Received event network-vif-deleted-f23d344d-9e4c-41b4-a61f-b324ba3c9794 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:01:03.253515 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-b3242801-e8e5-4d2f-a2b3-8fffec257123 req-b2117b61-1410-4934-8c53-0a8eaf4fa219 service nova] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Neutron deleted interface f23d344d-9e4c-41b4-a61f-b324ba3c9794; detaching it from the instance and deleting it from the info cache
May 28 02:01:03.257619 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b3242801-e8e5-4d2f-a2b3-8fffec257123 req-b2117b61-1410-4934-8c53-0a8eaf4fa219 service nova] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Detach interface failed, port_id=f23d344d-9e4c-41b4-a61f-b324ba3c9794, reason: Instance 0d87a47f-2eb6-4e25-b44a-848fe2225962 could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 02:01:03.285302 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0004101009999430971 future=<Future at 0x7724ec18ef30 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:01:03.285381 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:01:03.285581 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=1.709138221000103 future=<Future at 0x7724f844db80 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:01:03.285581 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=1.7090492090001135 future=<Future at 0x7724f844db80 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:01:03.298307 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/217de507a86b423465a151d274036e35e7d64e07.part /opt/stack/data/nova/instances/_base/217de507a86b423465a151d274036e35e7d64e07.converted" returned: 0 in 0.222s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:01:03.305645 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/217de507a86b423465a151d274036e35e7d64e07.converted --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:01:03.357499 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-617b8fd7-b6c7-455d-bedd-f891ca8b3ee7 req-8cf39230-20e6-41df-a8aa-b04354ebeb6b service nova] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Received event network-vif-unplugged-f23d344d-9e4c-41b4-a61f-b324ba3c9794 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:01:03.358417 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-617b8fd7-b6c7-455d-bedd-f891ca8b3ee7 req-8cf39230-20e6-41df-a8aa-b04354ebeb6b service nova] Acquiring lock "0d87a47f-2eb6-4e25-b44a-848fe2225962-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:03.358691 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-617b8fd7-b6c7-455d-bedd-f891ca8b3ee7 req-8cf39230-20e6-41df-a8aa-b04354ebeb6b service nova] Lock "0d87a47f-2eb6-4e25-b44a-848fe2225962-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:03.358893 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-617b8fd7-b6c7-455d-bedd-f891ca8b3ee7 req-8cf39230-20e6-41df-a8aa-b04354ebeb6b service nova] Lock "0d87a47f-2eb6-4e25-b44a-848fe2225962-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:03.359040 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-617b8fd7-b6c7-455d-bedd-f891ca8b3ee7 req-8cf39230-20e6-41df-a8aa-b04354ebeb6b service nova] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] No waiting events found dispatching network-vif-unplugged-f23d344d-9e4c-41b4-a61f-b324ba3c9794 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:01:03.359348 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-617b8fd7-b6c7-455d-bedd-f891ca8b3ee7 req-8cf39230-20e6-41df-a8aa-b04354ebeb6b service nova] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Received event network-vif-unplugged-f23d344d-9e4c-41b4-a61f-b324ba3c9794 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:01:03.410857 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/217de507a86b423465a151d274036e35e7d64e07.converted --force-share --output=json" returned: 0 in 0.105s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:01:03.411599 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "217de507a86b423465a151d274036e35e7d64e07" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.009s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:03.412349 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:01:03.415804 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:01:03.418241 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/217de507a86b423465a151d274036e35e7d64e07 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:01:03.509907 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/217de507a86b423465a151d274036e35e7d64e07 --force-share --output=json" returned: 0 in 0.091s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:01:03.510388 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Acquiring lock "217de507a86b423465a151d274036e35e7d64e07" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:03.510912 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "217de507a86b423465a151d274036e35e7d64e07" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:03.511536 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:01:03.515570 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:01:03.515936 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/217de507a86b423465a151d274036e35e7d64e07 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:01:03.577608 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] During sync_power_state the instance has a pending task (powering-on). Skip.
May 28 02:01:03.577608 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933663.5758915, a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:01:03.577608 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] VM Started (Lifecycle Event)
May 28 02:01:03.599376 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:01:03.637530 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/217de507a86b423465a151d274036e35e7d64e07 --force-share --output=json" returned: 0 in 0.121s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:01:03.637947 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/217de507a86b423465a151d274036e35e7d64e07,backing_fmt=raw /opt/stack/data/nova/instances/c6e87c0e-02e1-4941-8f2f-b969b93ebf9f/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:01:03.692401 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:01:03.715739 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/217de507a86b423465a151d274036e35e7d64e07,backing_fmt=raw /opt/stack/data/nova/instances/c6e87c0e-02e1-4941-8f2f-b969b93ebf9f/disk 1073741824" returned: 0 in 0.078s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:01:03.716263 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "217de507a86b423465a151d274036e35e7d64e07" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:03.716718 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/217de507a86b423465a151d274036e35e7d64e07 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:01:03.802920 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-262b89ed-6669-4817-9294-5706f5260df8 req-a21d1a96-0bd0-4293-ac60-ff50d9bb0262 service nova] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Received event network-vif-plugged-062afddc-3d10-4dc2-a9d7-6024ed27c97a {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:01:03.803252 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-262b89ed-6669-4817-9294-5706f5260df8 req-a21d1a96-0bd0-4293-ac60-ff50d9bb0262 service nova] Acquiring lock "a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:03.803518 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-262b89ed-6669-4817-9294-5706f5260df8 req-a21d1a96-0bd0-4293-ac60-ff50d9bb0262 service nova] Lock "a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:03.803668 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-262b89ed-6669-4817-9294-5706f5260df8 req-a21d1a96-0bd0-4293-ac60-ff50d9bb0262 service nova] Lock "a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:03.803845 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-262b89ed-6669-4817-9294-5706f5260df8 req-a21d1a96-0bd0-4293-ac60-ff50d9bb0262 service nova] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] No waiting events found dispatching network-vif-plugged-062afddc-3d10-4dc2-a9d7-6024ed27c97a {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:01:03.803997 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-262b89ed-6669-4817-9294-5706f5260df8 req-a21d1a96-0bd0-4293-ac60-ff50d9bb0262 service nova] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Received unexpected event network-vif-plugged-062afddc-3d10-4dc2-a9d7-6024ed27c97a for instance with vm_state stopped and task_state powering-on.
May 28 02:01:03.804502 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-262b89ed-6669-4817-9294-5706f5260df8 req-a21d1a96-0bd0-4293-ac60-ff50d9bb0262 service nova] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Received event network-vif-plugged-062afddc-3d10-4dc2-a9d7-6024ed27c97a {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:01:03.804991 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-262b89ed-6669-4817-9294-5706f5260df8 req-a21d1a96-0bd0-4293-ac60-ff50d9bb0262 service nova] Acquiring lock "a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:03.805187 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-262b89ed-6669-4817-9294-5706f5260df8 req-a21d1a96-0bd0-4293-ac60-ff50d9bb0262 service nova] Lock "a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:03.805326 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-262b89ed-6669-4817-9294-5706f5260df8 req-a21d1a96-0bd0-4293-ac60-ff50d9bb0262 service nova] Lock "a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:03.805464 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-262b89ed-6669-4817-9294-5706f5260df8 req-a21d1a96-0bd0-4293-ac60-ff50d9bb0262 service nova] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] No waiting events found dispatching network-vif-plugged-062afddc-3d10-4dc2-a9d7-6024ed27c97a {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:01:03.805597 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-262b89ed-6669-4817-9294-5706f5260df8 req-a21d1a96-0bd0-4293-ac60-ff50d9bb0262 service nova] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Received unexpected event network-vif-plugged-062afddc-3d10-4dc2-a9d7-6024ed27c97a for instance with vm_state stopped and task_state powering-on.
May 28 02:01:03.814681 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/217de507a86b423465a151d274036e35e7d64e07 --force-share --output=json" returned: 0 in 0.098s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:01:03.815149 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c6e87c0e-02e1-4941-8f2f-b969b93ebf9f/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 02:01:03.815419 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6e87c0e-02e1-4941-8f2f-b969b93ebf9f/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:01:03.862247 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:03.935518 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6e87c0e-02e1-4941-8f2f-b969b93ebf9f/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:01:03.935964 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Cannot resize image /opt/stack/data/nova/instances/c6e87c0e-02e1-4941-8f2f-b969b93ebf9f/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 02:01:03.936403 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 02:01:03.936554 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Ensure instance console log exists: /opt/stack/data/nova/instances/c6e87c0e-02e1-4941-8f2f-b969b93ebf9f/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 02:01:03.936909 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:03.937220 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:03.937374 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:03.964508 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:01:03.964694 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:01:03.964800 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:01:03.964953 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] No VIF found with MAC fa:16:3e:76:c5:3f, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:01:03.965728 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Using config drive
May 28 02:01:04.041004 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Updating instance_info_cache with network_info: [{"id": "18842969-e82f-4389-a30f-f5054a50d115", "address": "fa:16:3e:1e:c3:73", "network": {"id": "c18d43cf-482c-4814-96a1-09aab2287be4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2071326233-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d5cfe906dd24a10819b92c144f7f06f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap18842969-e8", "ovs_interfaceid": "18842969-e82f-4389-a30f-f5054a50d115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:01:04.082681 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:01:04.084885 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:01:04.085311 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:01:04.085931 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] No VIF found with MAC fa:16:3e:ff:a6:88, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:01:04.087986 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:01:04.088259 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-58ca768e-c1ad-44d8-9ab8-709547c175b0 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:01:04.194609 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Took 1.44 seconds to deallocate network for instance.
May 28 02:01:04.430730 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:04.461221 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:04.544000 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Releasing lock "refresh_cache-c6e87c0e-02e1-4941-8f2f-b969b93ebf9f" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:01:04.546385 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Instance network_info: |[{"id": "18842969-e82f-4389-a30f-f5054a50d115", "address": "fa:16:3e:1e:c3:73", "network": {"id": "c18d43cf-482c-4814-96a1-09aab2287be4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2071326233-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d5cfe906dd24a10819b92c144f7f06f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap18842969-e8", "ovs_interfaceid": "18842969-e82f-4389-a30f-f5054a50d115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 02:01:04.548035 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Start _get_guest_xml network_info=[{"id": "18842969-e82f-4389-a30f-f5054a50d115", "address": "fa:16:3e:1e:c3:73", "network": {"id": "c18d43cf-482c-4814-96a1-09aab2287be4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2071326233-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d5cfe906dd24a10819b92c144f7f06f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap18842969-e8", "ovs_interfaceid": "18842969-e82f-4389-a30f-f5054a50d115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:00:53Z,direct_url=<?>,disk_format='qcow2',id=52c8a1d7-9a61-46ed-80ca-e9ab30606f97,min_disk=0,min_ram=0,name='tempest-scenario-img--1381870757',owner='1d5cfe906dd24a10819b92c144f7f06f',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:00:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '52c8a1d7-9a61-46ed-80ca-e9ab30606f97'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 02:01:04.551920 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:04.569810 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:01:04.575899 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='52c8a1d7-9a61-46ed-80ca-e9ab30606f97', instance_meta=NovaInstanceMeta(name='tempest-TestMinimumBasicScenario-server-963915173', uuid='c6e87c0e-02e1-4941-8f2f-b969b93ebf9f'), owner=OwnerMeta(userid='f52a7ae7fbc644deb82f3382de3a4edd', username='tempest-TestMinimumBasicScenario-1092247749-project-member', projectid='1d5cfe906dd24a10819b92c144f7f06f', projectname='tempest-TestMinimumBasicScenario-1092247749'), image=ImageMeta(id='52c8a1d7-9a61-46ed-80ca-e9ab30606f97', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "18842969-e82f-4389-a30f-f5054a50d115", "address": "fa:16:3e:1e:c3:73", "network": {"id": "c18d43cf-482c-4814-96a1-09aab2287be4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2071326233-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d5cfe906dd24a10819b92c144f7f06f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap18842969-e8", "ovs_interfaceid": "18842969-e82f-4389-a30f-f5054a50d115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933664.5753758) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 02:01:04.579162 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 02:01:04.579541 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 02:01:04.586975 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 02:01:04.587335 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 02:01:04.588108 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 02:01:04.588445 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:00:53Z,direct_url=<?>,disk_format='qcow2',id=52c8a1d7-9a61-46ed-80ca-e9ab30606f97,min_disk=0,min_ram=0,name='tempest-scenario-img--1381870757',owner='1d5cfe906dd24a10819b92c144f7f06f',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:00:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 02:01:04.588665 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 02:01:04.588811 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 02:01:04.588943 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 02:01:04.589025 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 02:01:04.589784 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 02:01:04.590030 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 02:01:04.590191 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 02:01:04.590342 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 02:01:04.590483 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 02:01:04.590768 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 02:01:04.597322 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] During sync_power_state the instance has a pending task (powering-on). Skip.
May 28 02:01:04.621377 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:00:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-963915173',display_name='tempest-TestMinimumBasicScenario-server-963915173',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testminimumbasicscenario-server-963915173',id=44,image_ref='52c8a1d7-9a61-46ed-80ca-e9ab30606f97',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBX0IgGiUsTD2sbPHQaOGIfTfUbzPIJM0pCdM2CrpTh+uVYyzZv+jtp5vni8ulad0BKs4L0HTJ7Br9x7RNqV5Y+saqNffp7fh5EWlTPgK+7nhIEovo/Z1K9eQTWwE3rz5g==',key_name='tempest-TestMinimumBasicScenario-1551144269',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d5cfe906dd24a10819b92c144f7f06f',ramdisk_id='',reservation_id='r-cvn34ea7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52c8a1d7-9a61-46ed-80ca-e9ab30606f97',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1092247749',owner_user_name='tempest-TestMinimumBasicScenario-1092247749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:01:01Z,user_data=None,user_id='f52a7ae7fbc644deb82f3382de3a4edd',uuid=c6e87c0e-02e1-4941-8f2f-b969b93ebf9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18842969-e82f-4389-a30f-f5054a50d115", "address": "fa:16:3e:1e:c3:73", "network": {"id": "c18d43cf-482c-4814-96a1-09aab2287be4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2071326233-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d5cfe906dd24a10819b92c144f7f06f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap18842969-e8", "ovs_interfaceid": "18842969-e82f-4389-a30f-f5054a50d115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 02:01:04.621377 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Converting VIF {"id": "18842969-e82f-4389-a30f-f5054a50d115", "address": "fa:16:3e:1e:c3:73", "network": {"id": "c18d43cf-482c-4814-96a1-09aab2287be4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2071326233-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d5cfe906dd24a10819b92c144f7f06f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap18842969-e8", "ovs_interfaceid": "18842969-e82f-4389-a30f-f5054a50d115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:01:04.621377 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:c3:73,bridge_name='br-int',has_traffic_filtering=True,id=18842969-e82f-4389-a30f-f5054a50d115,network=Network(c18d43cf-482c-4814-96a1-09aab2287be4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18842969-e8') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:01:04.622629 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lazy-loading 'pci_devices' on Instance uuid c6e87c0e-02e1-4941-8f2f-b969b93ebf9f {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:01:04.629663 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:04.630460 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:04.703019 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d06f136a-35c5-4396-916b-0b9c104abbf5 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:04.703347 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d06f136a-35c5-4396-916b-0b9c104abbf5 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:04.937703 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-9b6873e1-5058-45b1-a5a7-9440c0fc9273 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Get console output
May 28 02:01:04.948105 np0000001583 nova-compute[98241]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
May 28 02:01:04.995556 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0008311169999615231 future=<Future at 0x7724f844db80 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:01:04.995725 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:01:04.995725 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=0.9806957729997521 future=<Future at 0x7724ec37fb30 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:01:04.995896 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=0.9805547569999362 future=<Future at 0x7724ec37fb30 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:01:04.997706 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Emitting event <LifecycleEvent: 1779933649.994568, 8b2a5f31-1b3d-447f-939e-94fd0be5eb85 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:01:04.997827 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] VM Stopped (Lifecycle Event)
May 28 02:01:05.124941 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] End _get_guest_xml xml=<domain type="qemu">
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:   <uuid>c6e87c0e-02e1-4941-8f2f-b969b93ebf9f</uuid>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:   <name>instance-0000002c</name>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:   <metadata>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:       <nova:name>tempest-TestMinimumBasicScenario-server-963915173</nova:name>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 02:01:04</nova:creationTime>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:       <nova:image uuid="52c8a1d7-9a61-46ed-80ca-e9ab30606f97">
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:         <nova:properties/>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:       </nova:image>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:         <nova:user uuid="f52a7ae7fbc644deb82f3382de3a4edd">tempest-TestMinimumBasicScenario-1092247749-project-member</nova:user>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:         <nova:project uuid="1d5cfe906dd24a10819b92c144f7f06f">tempest-TestMinimumBasicScenario-1092247749</nova:project>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="52c8a1d7-9a61-46ed-80ca-e9ab30606f97"/>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:         <nova:port uuid="18842969-e82f-4389-a30f-f5054a50d115">
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:         </nova:port>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:   </metadata>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:     <system>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:       <entry name="serial">c6e87c0e-02e1-4941-8f2f-b969b93ebf9f</entry>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:       <entry name="uuid">c6e87c0e-02e1-4941-8f2f-b969b93ebf9f</entry>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:     </system>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:   <os>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:   </os>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:   <features>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:     <acpi/>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:     <tcg>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:     </tcg>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:   </features>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:   </cpu>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:   <devices>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/c6e87c0e-02e1-4941-8f2f-b969b93ebf9f/disk"/>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:     </disk>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/c6e87c0e-02e1-4941-8f2f-b969b93ebf9f/disk.config"/>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:     </disk>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:1e:c3:73"/>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:       <target dev="tap18842969-e8"/>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:     </interface>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/c6e87c0e-02e1-4941-8f2f-b969b93ebf9f/console.log" append="off"/>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:     </serial>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:     <video>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:     </video>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:     </rng>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:     </memballoon>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:   </devices>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]: </domain>
May 28 02:01:05.124941 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 02:01:05.127738 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Preparing to wait for external event network-vif-plugged-18842969-e82f-4389-a30f-f5054a50d115 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 02:01:05.127738 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Acquiring lock "c6e87c0e-02e1-4941-8f2f-b969b93ebf9f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:05.127738 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "c6e87c0e-02e1-4941-8f2f-b969b93ebf9f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:05.127738 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "c6e87c0e-02e1-4941-8f2f-b969b93ebf9f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:05.127738 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:00:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-963915173',display_name='tempest-TestMinimumBasicScenario-server-963915173',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testminimumbasicscenario-server-963915173',id=44,image_ref='52c8a1d7-9a61-46ed-80ca-e9ab30606f97',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBX0IgGiUsTD2sbPHQaOGIfTfUbzPIJM0pCdM2CrpTh+uVYyzZv+jtp5vni8ulad0BKs4L0HTJ7Br9x7RNqV5Y+saqNffp7fh5EWlTPgK+7nhIEovo/Z1K9eQTWwE3rz5g==',key_name='tempest-TestMinimumBasicScenario-1551144269',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d5cfe906dd24a10819b92c144f7f06f',ramdisk_id='',reservation_id='r-cvn34ea7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52c8a1d7-9a61-46ed-80ca-e9ab30606f97',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1092247749',owner_user_name='tempest-TestMinimumBasicScenario-1092247749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:01:01Z,user_data=None,user_id='f52a7ae7fbc644deb82f3382de3a4edd',uuid=c6e87c0e-02e1-4941-8f2f-b969b93ebf9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18842969-e82f-4389-a30f-f5054a50d115", "address": "fa:16:3e:1e:c3:73", "network": {"id": "c18d43cf-482c-4814-96a1-09aab2287be4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2071326233-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d5cfe906dd24a10819b92c144f7f06f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap18842969-e8", "ovs_interfaceid": "18842969-e82f-4389-a30f-f5054a50d115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 02:01:05.127738 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Converting VIF {"id": "18842969-e82f-4389-a30f-f5054a50d115", "address": "fa:16:3e:1e:c3:73", "network": {"id": "c18d43cf-482c-4814-96a1-09aab2287be4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2071326233-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d5cfe906dd24a10819b92c144f7f06f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap18842969-e8", "ovs_interfaceid": "18842969-e82f-4389-a30f-f5054a50d115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:01:05.127738 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:c3:73,bridge_name='br-int',has_traffic_filtering=True,id=18842969-e82f-4389-a30f-f5054a50d115,network=Network(c18d43cf-482c-4814-96a1-09aab2287be4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18842969-e8') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:01:05.127738 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:c3:73,bridge_name='br-int',has_traffic_filtering=True,id=18842969-e82f-4389-a30f-f5054a50d115,network=Network(c18d43cf-482c-4814-96a1-09aab2287be4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18842969-e8') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 02:01:05.130744 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:05.130744 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:01:05.130744 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 02:01:05.131060 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:05.131983 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '390f2c85-0369-5a55-99e0-b2701db86155', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:01:05.132414 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:05.133352 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:01:05.139578 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:05.139893 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18842969-e8, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:01:05.140918 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap18842969-e8, col_values=(('qos', UUID('0c6c023b-1447-4ed7-b761-728034d8226b')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:01:05.141784 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap18842969-e8, col_values=(('external_ids', {'iface-id': '18842969-e82f-4389-a30f-f5054a50d115', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:c3:73', 'vm-uuid': 'c6e87c0e-02e1-4941-8f2f-b969b93ebf9f'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:01:05.142316 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:05.144091 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:01:05.151934 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:05.152968 np0000001583 nova-compute[98241]: INFO os_vif [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:c3:73,bridge_name='br-int',has_traffic_filtering=True,id=18842969-e82f-4389-a30f-f5054a50d115,network=Network(c18d43cf-482c-4814-96a1-09aab2287be4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18842969-e8')
May 28 02:01:05.501105 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:01:05.514831 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-d06f136a-35c5-4396-916b-0b9c104abbf5 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:01:05.515121 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-d06f136a-35c5-4396-916b-0b9c104abbf5 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:01:05.523962 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933665.5236526, 8b2a5f31-1b3d-447f-939e-94fd0be5eb85 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:01:05.524195 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] VM Resumed (Lifecycle Event)
May 28 02:01:05.525466 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Instance event wait completed in 0 seconds for  {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 02:01:05.529117 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Instance running successfully.
May 28 02:01:05.531565 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Failed to set time: agent not configured {{(pid=98241) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 28 02:01:05.531773 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-574dacb4-484d-4c74-8dec-e0bf5889f5a9 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] finish_migration finished successfully. {{(pid=98241) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 28 02:01:05.896432 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e582e032-3b36-48c6-87d6-1159f7f50790 req-2d912ba3-2190-4bf7-b5af-fbdb4bb58c9d service nova] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Received event network-vif-plugged-77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:01:05.896658 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e582e032-3b36-48c6-87d6-1159f7f50790 req-2d912ba3-2190-4bf7-b5af-fbdb4bb58c9d service nova] Acquiring lock "8b2a5f31-1b3d-447f-939e-94fd0be5eb85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:05.896783 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e582e032-3b36-48c6-87d6-1159f7f50790 req-2d912ba3-2190-4bf7-b5af-fbdb4bb58c9d service nova] Lock "8b2a5f31-1b3d-447f-939e-94fd0be5eb85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:05.896988 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e582e032-3b36-48c6-87d6-1159f7f50790 req-2d912ba3-2190-4bf7-b5af-fbdb4bb58c9d service nova] Lock "8b2a5f31-1b3d-447f-939e-94fd0be5eb85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:05.897157 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e582e032-3b36-48c6-87d6-1159f7f50790 req-2d912ba3-2190-4bf7-b5af-fbdb4bb58c9d service nova] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] No waiting events found dispatching network-vif-plugged-77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:01:05.897291 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-e582e032-3b36-48c6-87d6-1159f7f50790 req-2d912ba3-2190-4bf7-b5af-fbdb4bb58c9d service nova] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Received unexpected event network-vif-plugged-77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0 for instance with vm_state active and task_state resize_finish.
May 28 02:01:05.897291 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e582e032-3b36-48c6-87d6-1159f7f50790 req-2d912ba3-2190-4bf7-b5af-fbdb4bb58c9d service nova] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Received event network-vif-plugged-77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:01:05.897550 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e582e032-3b36-48c6-87d6-1159f7f50790 req-2d912ba3-2190-4bf7-b5af-fbdb4bb58c9d service nova] Acquiring lock "8b2a5f31-1b3d-447f-939e-94fd0be5eb85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:05.897550 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e582e032-3b36-48c6-87d6-1159f7f50790 req-2d912ba3-2190-4bf7-b5af-fbdb4bb58c9d service nova] Lock "8b2a5f31-1b3d-447f-939e-94fd0be5eb85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:05.897646 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e582e032-3b36-48c6-87d6-1159f7f50790 req-2d912ba3-2190-4bf7-b5af-fbdb4bb58c9d service nova] Lock "8b2a5f31-1b3d-447f-939e-94fd0be5eb85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:05.897777 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e582e032-3b36-48c6-87d6-1159f7f50790 req-2d912ba3-2190-4bf7-b5af-fbdb4bb58c9d service nova] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] No waiting events found dispatching network-vif-plugged-77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:01:05.897870 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-e582e032-3b36-48c6-87d6-1159f7f50790 req-2d912ba3-2190-4bf7-b5af-fbdb4bb58c9d service nova] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Received unexpected event network-vif-plugged-77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0 for instance with vm_state active and task_state resize_finish.
May 28 02:01:05.977571 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0004917599999316735 future=<Future at 0x7724ec37fb30 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:01:05.977571 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Emitting event <LifecycleEvent: 1779933650.9763205, 27c37404-4df0-4ded-bf5b-6002e26d4222 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:01:05.977571 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:01:05.977779 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] VM Stopped (Lifecycle Event)
May 28 02:01:05.978665 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=10.727187775999937 future=<Future at 0x7724ec2634a0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:01:05.978665 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=10.72705522499973 future=<Future at 0x7724ec2634a0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:01:06.020329 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-d06f136a-35c5-4396-916b-0b9c104abbf5 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:01:06.028171 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:01:06.032034 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:01:06.482839 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-80ab61c4-8d37-4d1c-aa80-2b45f3dd03e7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 27c37404-4df0-4ded-bf5b-6002e26d4222] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:01:06.527751 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d06f136a-35c5-4396-916b-0b9c104abbf5 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.824s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:06.534750 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 28 02:01:06.535197 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933666.5348642, 8b2a5f31-1b3d-447f-939e-94fd0be5eb85 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:01:06.535373 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] VM Started (Lifecycle Event)
May 28 02:01:06.593515 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-d06f136a-35c5-4396-916b-0b9c104abbf5 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Deleted allocations for instance 0d87a47f-2eb6-4e25-b44a-848fe2225962
May 28 02:01:06.685923 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:01:06.686152 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:01:06.686327 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] No VIF found with MAC fa:16:3e:1e:c3:73, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:01:06.686899 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Using config drive
May 28 02:01:07.040204 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:01:07.042687 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:01:07.132331 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:07.132819 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:07.132960 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:07.133125 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:07.133290 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:07.135882 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Terminating instance
May 28 02:01:07.193727 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:07.333758 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Creating config drive at /opt/stack/data/nova/instances/c6e87c0e-02e1-4941-8f2f-b969b93ebf9f/disk.config
May 28 02:01:07.337875 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c6e87c0e-02e1-4941-8f2f-b969b93ebf9f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpi6p4snx4 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:01:07.413881 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c6e87c0e-02e1-4941-8f2f-b969b93ebf9f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpi6p4snx4" returned: 0 in 0.076s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:01:07.605560 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d06f136a-35c5-4396-916b-0b9c104abbf5 tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "0d87a47f-2eb6-4e25-b44a-848fe2225962" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.130s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:07.643111 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 02:01:07.677971 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:07.685033 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:07.716569 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:07.729239 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:07.766647 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:07.885123 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3ba8de32-5a96-4dfa-a562-9f9882d4987b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquiring lock "659c56a6-743a-45e2-aa21-7d45c672f094" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:07.885123 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3ba8de32-5a96-4dfa-a562-9f9882d4987b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "659c56a6-743a-45e2-aa21-7d45c672f094" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:07.885123 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3ba8de32-5a96-4dfa-a562-9f9882d4987b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquiring lock "659c56a6-743a-45e2-aa21-7d45c672f094-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:07.885123 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3ba8de32-5a96-4dfa-a562-9f9882d4987b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "659c56a6-743a-45e2-aa21-7d45c672f094-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:07.885123 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3ba8de32-5a96-4dfa-a562-9f9882d4987b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "659c56a6-743a-45e2-aa21-7d45c672f094-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:07.890948 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-3ba8de32-5a96-4dfa-a562-9f9882d4987b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Terminating instance
May 28 02:01:07.996487 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-fd1fb162-a1b1-4a22-b232-ba56d0f512f1 req-ccc16eb7-2cd8-4226-bd1a-4c18c3a50f72 service nova] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Received event network-vif-unplugged-062afddc-3d10-4dc2-a9d7-6024ed27c97a {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:01:07.997948 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-fd1fb162-a1b1-4a22-b232-ba56d0f512f1 req-ccc16eb7-2cd8-4226-bd1a-4c18c3a50f72 service nova] Acquiring lock "a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:08.000977 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-fd1fb162-a1b1-4a22-b232-ba56d0f512f1 req-ccc16eb7-2cd8-4226-bd1a-4c18c3a50f72 service nova] Lock "a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:08.000977 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-fd1fb162-a1b1-4a22-b232-ba56d0f512f1 req-ccc16eb7-2cd8-4226-bd1a-4c18c3a50f72 service nova] Lock "a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:08.000977 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-fd1fb162-a1b1-4a22-b232-ba56d0f512f1 req-ccc16eb7-2cd8-4226-bd1a-4c18c3a50f72 service nova] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] No waiting events found dispatching network-vif-unplugged-062afddc-3d10-4dc2-a9d7-6024ed27c97a {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:01:08.000977 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-fd1fb162-a1b1-4a22-b232-ba56d0f512f1 req-ccc16eb7-2cd8-4226-bd1a-4c18c3a50f72 service nova] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Received event network-vif-unplugged-062afddc-3d10-4dc2-a9d7-6024ed27c97a for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:01:08.037258 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:08.068515 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:08.071128 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:08.240120 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:08.262640 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999651254999662 future=<Future at 0x7724ec4a7200 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:01:08.262640 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:08.265419 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f0e752e3-1ee1-4cbe-94df-edb5efd1fceb tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "8b2a5f31-1b3d-447f-939e-94fd0be5eb85" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:08.265800 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f0e752e3-1ee1-4cbe-94df-edb5efd1fceb tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "8b2a5f31-1b3d-447f-939e-94fd0be5eb85" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:08.269387 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f0e752e3-1ee1-4cbe-94df-edb5efd1fceb tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Going to confirm migration 3 {{(pid=98241) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}}
May 28 02:01:08.270705 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Instance destroyed successfully.
May 28 02:01:08.275032 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lazy-loading 'resources' on Instance uuid a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:01:08.352743 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-40cdd31f-1add-400e-bf88-bcd33db79070 req-fc7b8360-6ecc-4c8a-b51d-a9d76abe502f service nova] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Received event network-vif-plugged-18842969-e82f-4389-a30f-f5054a50d115 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:01:08.353737 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-40cdd31f-1add-400e-bf88-bcd33db79070 req-fc7b8360-6ecc-4c8a-b51d-a9d76abe502f service nova] Acquiring lock "c6e87c0e-02e1-4941-8f2f-b969b93ebf9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:08.354433 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-40cdd31f-1add-400e-bf88-bcd33db79070 req-fc7b8360-6ecc-4c8a-b51d-a9d76abe502f service nova] Lock "c6e87c0e-02e1-4941-8f2f-b969b93ebf9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:08.354433 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-40cdd31f-1add-400e-bf88-bcd33db79070 req-fc7b8360-6ecc-4c8a-b51d-a9d76abe502f service nova] Lock "c6e87c0e-02e1-4941-8f2f-b969b93ebf9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:08.354433 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-40cdd31f-1add-400e-bf88-bcd33db79070 req-fc7b8360-6ecc-4c8a-b51d-a9d76abe502f service nova] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Processing event network-vif-plugged-18842969-e82f-4389-a30f-f5054a50d115 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 02:01:08.399534 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3ba8de32-5a96-4dfa-a562-9f9882d4987b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 02:01:08.428553 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:08.433209 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:08.457097 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:08.494380 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:08.508307 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:08.511371 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:08.545952 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:08.559782 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:08.685353 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:08.721361 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:08.756663 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999711123999987 future=<Future at 0x7724ec17a540 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:01:08.765220 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Instance destroyed successfully.
May 28 02:01:08.765220 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-3ba8de32-5a96-4dfa-a562-9f9882d4987b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lazy-loading 'resources' on Instance uuid 659c56a6-743a-45e2-aa21-7d45c672f094 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:01:08.787342 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:59:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-122348002',display_name='tempest-TestVolumeBootPattern-server-122348002',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testvolumebootpattern-server-122348002',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAAXSwkEIXS5PPxf3LnhrDvV1d+6UfjHy8aXnhsA4kJJX2FmeQvb3lEjUETHta29JzRPDevvLGSBNv16sMuL0GFa7gRKeRQiBCOB74vGY7LOBq7vL4B/fsS34ce5RE5NuA==',key_name='tempest-keypair-125840429',keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:00:08Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='432aa1094ced436494def17a875aa8e1',ramdisk_id='',reservation_id='r-3bd3wvda',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1031057169',owner_user_name='tempest-TestVolumeBootPattern-1031057169-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T02:01:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6be314b4eed642c3b2c72fe115860220',uuid=a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "062afddc-3d10-4dc2-a9d7-6024ed27c97a", "address": "fa:16:3e:ff:a6:88", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap062afddc-3d", "ovs_interfaceid": "062afddc-3d10-4dc2-a9d7-6024ed27c97a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:01:08.787342 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converting VIF {"id": "062afddc-3d10-4dc2-a9d7-6024ed27c97a", "address": "fa:16:3e:ff:a6:88", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap062afddc-3d", "ovs_interfaceid": "062afddc-3d10-4dc2-a9d7-6024ed27c97a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:01:08.787342 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:a6:88,bridge_name='br-int',has_traffic_filtering=True,id=062afddc-3d10-4dc2-a9d7-6024ed27c97a,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap062afddc-3d') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:01:08.787636 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:a6:88,bridge_name='br-int',has_traffic_filtering=True,id=062afddc-3d10-4dc2-a9d7-6024ed27c97a,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap062afddc-3d') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:01:08.789825 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-f0e752e3-1ee1-4cbe-94df-edb5efd1fceb tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:08.792030 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:08.793306 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap062afddc-3d, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:01:08.796098 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:08.796691 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:01:08.801937 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:08.806108 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:08.806108 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8fbbff7f-187e-4875-9021-18c74abed9b7) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:01:08.806108 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:08.806108 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:01:08.810610 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:08.812975 np0000001583 nova-compute[98241]: INFO os_vif [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:a6:88,bridge_name='br-int',has_traffic_filtering=True,id=062afddc-3d10-4dc2-a9d7-6024ed27c97a,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap062afddc-3d')
May 28 02:01:08.814825 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:01:08.815244 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d', 'iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f12a45d8-1f6d-4068-927e-408a86ee7e6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:01:08.815436 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:01:08.815858 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:01:08.816556 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d', 'iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f12a45d8-1f6d-4068-927e-408a86ee7e6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:01:08.816556 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:01:08.859693 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:08.859693 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:08.859693 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:08.859693 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:08.859693 np0000001583 nova-compute[98241]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:01:08.859693 np0000001583 nova-compute[98241]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:01:08.859693 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:01:08.860015 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:08.860015 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:08.860015 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:08.860015 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:08.860015 np0000001583 nova-compute[98241]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:01:08.860015 np0000001583 nova-compute[98241]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d (non-flash)
May 28 02:01:08.860015 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:01:08.860277 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', '68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', '69'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', '91'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', '92'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d', '95'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d', '96')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:01:08.860376 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d', '96')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:01:08.861179 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d', '95')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:01:08.861918 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724ec1aec00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d'): ({'sde'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:01:08.862589 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Removing multipathed devices sdf, sde {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:01:08.862887 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Flush multipath device 330000000519e27f4 {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:01:08.919360 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-f0e752e3-1ee1-4cbe-94df-edb5efd1fceb tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:08.920206 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f0e752e3-1ee1-4cbe-94df-edb5efd1fceb tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "refresh_cache-8b2a5f31-1b3d-447f-939e-94fd0be5eb85" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:01:08.920510 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f0e752e3-1ee1-4cbe-94df-edb5efd1fceb tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquired lock "refresh_cache-8b2a5f31-1b3d-447f-939e-94fd0be5eb85" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:01:08.920765 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-f0e752e3-1ee1-4cbe-94df-edb5efd1fceb tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:01:08.921346 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-f0e752e3-1ee1-4cbe-94df-edb5efd1fceb tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lazy-loading 'info_cache' on Instance uuid 8b2a5f31-1b3d-447f-939e-94fd0be5eb85 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:01:08.927246 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:01:08.974819 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:01:09.026714 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Checking to see if SCSI volumes sdf, sde have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:01:09.026904 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] SCSI volumes sdf, sde have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:01:09.028157 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Checking to see if device paths {'sdf', 'sde'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:01:09.042016 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Device paths {'sdf', 'sde'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:01:09.042277 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:01:09.058884 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:09.093043 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 96, target: iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d, portal: 192.168.40.100,3260]
May 28 02:01:09.093043 np0000001583 nova-compute[98241]: Logout of [sid: 96, target: iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d, portal: 192.168.40.100,3260] successful.
May 28 02:01:09.093043 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:09.109986 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:09.121898 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:09.151716 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 95, target: iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d, portal: 192.168.50.100,3260]
May 28 02:01:09.151716 np0000001583 nova-compute[98241]: Logout of [sid: 95, target: iqn.2023-03.storpool.com:os--volume-f12a45d8-1f6d-4068-927e-408a86ee7e6d, portal: 192.168.50.100,3260] successful.
May 28 02:01:09.151716 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:09.168013 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:09.168292 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:01:09.168382 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] <== disconnect_volume: return (352ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:01:09.168832 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:01:09.169222 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Deleting instance files /opt/stack/data/nova/instances/a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d_del
May 28 02:01:09.169762 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Deletion of /opt/stack/data/nova/instances/a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d_del complete
May 28 02:01:09.245512 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 02:01:09.246111 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933669.245684, c6e87c0e-02e1-4941-8f2f-b969b93ebf9f => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:01:09.246288 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] VM Started (Lifecycle Event)
May 28 02:01:09.249229 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 02:01:09.254867 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Instance spawned successfully.
May 28 02:01:09.257535 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 02:01:09.268537 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-3ba8de32-5a96-4dfa-a562-9f9882d4987b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:57:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1830325230',display_name='tempest-ServerRescueNegativeTestJSON-server-1830325230',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-serverrescuenegativetestjson-server-1830325230',id=28,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:58:33Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f65617e71571457f8906997583100678',ramdisk_id='',reservation_id='r-0bu7sx5m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1821941242',owner_user_name='tempest-ServerRescueNegativeTestJSON-1821941242-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:58:40Z,user_data=None,user_id='435dfce8f05e4e01b380797bd07bd4dc',uuid=659c56a6-743a-45e2-aa21-7d45c672f094,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51ab6198-7fa5-4b12-8d53-effcff16e287", "address": "fa:16:3e:ae:1e:12", "network": {"id": "e1d5d073-f27b-4ff1-9ed3-99f57407c76f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f65617e71571457f8906997583100678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ab6198-7f", "ovs_interfaceid": "51ab6198-7fa5-4b12-8d53-effcff16e287", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:01:09.269145 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-3ba8de32-5a96-4dfa-a562-9f9882d4987b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Converting VIF {"id": "51ab6198-7fa5-4b12-8d53-effcff16e287", "address": "fa:16:3e:ae:1e:12", "network": {"id": "e1d5d073-f27b-4ff1-9ed3-99f57407c76f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-237087337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f65617e71571457f8906997583100678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ab6198-7f", "ovs_interfaceid": "51ab6198-7fa5-4b12-8d53-effcff16e287", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:01:09.269838 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-3ba8de32-5a96-4dfa-a562-9f9882d4987b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:1e:12,bridge_name='br-int',has_traffic_filtering=True,id=51ab6198-7fa5-4b12-8d53-effcff16e287,network=Network(e1d5d073-f27b-4ff1-9ed3-99f57407c76f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ab6198-7f') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:01:09.270152 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-3ba8de32-5a96-4dfa-a562-9f9882d4987b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:1e:12,bridge_name='br-int',has_traffic_filtering=True,id=51ab6198-7fa5-4b12-8d53-effcff16e287,network=Network(e1d5d073-f27b-4ff1-9ed3-99f57407c76f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ab6198-7f') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:01:09.272790 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:09.273053 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51ab6198-7f, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:01:09.275661 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:09.279116 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:01:09.279116 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:09.279116 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:09.279116 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d9637722-32ee-435a-b430-cc2965d9dae7) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:01:09.279694 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:09.280257 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:01:09.281781 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:09.284248 np0000001583 nova-compute[98241]: INFO os_vif [None req-3ba8de32-5a96-4dfa-a562-9f9882d4987b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:1e:12,bridge_name='br-int',has_traffic_filtering=True,id=51ab6198-7fa5-4b12-8d53-effcff16e287,network=Network(e1d5d073-f27b-4ff1-9ed3-99f57407c76f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ab6198-7f')
May 28 02:01:09.284608 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-3ba8de32-5a96-4dfa-a562-9f9882d4987b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Deleting instance files /opt/stack/data/nova/instances/659c56a6-743a-45e2-aa21-7d45c672f094_del
May 28 02:01:09.285943 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-3ba8de32-5a96-4dfa-a562-9f9882d4987b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Deletion of /opt/stack/data/nova/instances/659c56a6-743a-45e2-aa21-7d45c672f094_del complete
May 28 02:01:09.675714 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Took 2.04 seconds to destroy the instance on the hypervisor.
May 28 02:01:09.676197 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 02:01:09.676343 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 02:01:09.676421 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 02:01:09.676610 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:09.752537 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:01:09.757105 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:01:09.767765 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:01:09.767987 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:01:09.768475 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:01:09.768775 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:01:09.770140 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:01:09.772520 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:01:09.783105 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:09.799902 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-3ba8de32-5a96-4dfa-a562-9f9882d4987b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Took 1.40 seconds to destroy the instance on the hypervisor.
May 28 02:01:09.801311 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-3ba8de32-5a96-4dfa-a562-9f9882d4987b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 02:01:09.801649 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 02:01:09.801730 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 02:01:09.801935 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:09.885194 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:09.927093 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-f0e752e3-1ee1-4cbe-94df-edb5efd1fceb tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:10.086875 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2bbbae58-8cf9-4aef-99b1-a0558a88ba0e req-bdf1f6eb-a6e3-48aa-bf15-80a043498d1f service nova] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Received event network-vif-unplugged-062afddc-3d10-4dc2-a9d7-6024ed27c97a {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:01:10.087016 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2bbbae58-8cf9-4aef-99b1-a0558a88ba0e req-bdf1f6eb-a6e3-48aa-bf15-80a043498d1f service nova] Acquiring lock "a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:10.087236 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2bbbae58-8cf9-4aef-99b1-a0558a88ba0e req-bdf1f6eb-a6e3-48aa-bf15-80a043498d1f service nova] Lock "a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:10.087292 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2bbbae58-8cf9-4aef-99b1-a0558a88ba0e req-bdf1f6eb-a6e3-48aa-bf15-80a043498d1f service nova] Lock "a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:10.087824 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2bbbae58-8cf9-4aef-99b1-a0558a88ba0e req-bdf1f6eb-a6e3-48aa-bf15-80a043498d1f service nova] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] No waiting events found dispatching network-vif-unplugged-062afddc-3d10-4dc2-a9d7-6024ed27c97a {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:01:10.087824 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2bbbae58-8cf9-4aef-99b1-a0558a88ba0e req-bdf1f6eb-a6e3-48aa-bf15-80a043498d1f service nova] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Received event network-vif-unplugged-062afddc-3d10-4dc2-a9d7-6024ed27c97a for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:01:10.261595 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 02:01:10.261815 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933670.2616577, c6e87c0e-02e1-4941-8f2f-b969b93ebf9f => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:01:10.261918 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] VM Paused (Lifecycle Event)
May 28 02:01:10.281846 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Took 7.89 seconds to spawn the instance on the hypervisor.
May 28 02:01:10.282119 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:01:10.320011 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-f0e752e3-1ee1-4cbe-94df-edb5efd1fceb tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:10.455878 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-4a16ae45-3118-4317-b3e0-a09b54a8a12a req-56f36241-d5f6-4d86-85df-e7209e994078 service nova] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Received event network-vif-plugged-18842969-e82f-4389-a30f-f5054a50d115 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:01:10.456185 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-4a16ae45-3118-4317-b3e0-a09b54a8a12a req-56f36241-d5f6-4d86-85df-e7209e994078 service nova] Acquiring lock "c6e87c0e-02e1-4941-8f2f-b969b93ebf9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:10.456263 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-4a16ae45-3118-4317-b3e0-a09b54a8a12a req-56f36241-d5f6-4d86-85df-e7209e994078 service nova] Lock "c6e87c0e-02e1-4941-8f2f-b969b93ebf9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:10.456391 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-4a16ae45-3118-4317-b3e0-a09b54a8a12a req-56f36241-d5f6-4d86-85df-e7209e994078 service nova] Lock "c6e87c0e-02e1-4941-8f2f-b969b93ebf9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:10.456619 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-4a16ae45-3118-4317-b3e0-a09b54a8a12a req-56f36241-d5f6-4d86-85df-e7209e994078 service nova] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] No waiting events found dispatching network-vif-plugged-18842969-e82f-4389-a30f-f5054a50d115 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:01:10.457000 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-4a16ae45-3118-4317-b3e0-a09b54a8a12a req-56f36241-d5f6-4d86-85df-e7209e994078 service nova] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Received unexpected event network-vif-plugged-18842969-e82f-4389-a30f-f5054a50d115 for instance with vm_state active and task_state None.
May 28 02:01:10.457814 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-4a16ae45-3118-4317-b3e0-a09b54a8a12a req-56f36241-d5f6-4d86-85df-e7209e994078 service nova] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Received event network-vif-unplugged-51ab6198-7fa5-4b12-8d53-effcff16e287 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:01:10.457814 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-4a16ae45-3118-4317-b3e0-a09b54a8a12a req-56f36241-d5f6-4d86-85df-e7209e994078 service nova] Acquiring lock "659c56a6-743a-45e2-aa21-7d45c672f094-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:10.457814 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-4a16ae45-3118-4317-b3e0-a09b54a8a12a req-56f36241-d5f6-4d86-85df-e7209e994078 service nova] Lock "659c56a6-743a-45e2-aa21-7d45c672f094-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:10.457983 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-4a16ae45-3118-4317-b3e0-a09b54a8a12a req-56f36241-d5f6-4d86-85df-e7209e994078 service nova] Lock "659c56a6-743a-45e2-aa21-7d45c672f094-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:10.458068 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-4a16ae45-3118-4317-b3e0-a09b54a8a12a req-56f36241-d5f6-4d86-85df-e7209e994078 service nova] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] No waiting events found dispatching network-vif-unplugged-51ab6198-7fa5-4b12-8d53-effcff16e287 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:01:10.458947 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-4a16ae45-3118-4317-b3e0-a09b54a8a12a req-56f36241-d5f6-4d86-85df-e7209e994078 service nova] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Received event network-vif-unplugged-51ab6198-7fa5-4b12-8d53-effcff16e287 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:01:10.458947 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-4a16ae45-3118-4317-b3e0-a09b54a8a12a req-56f36241-d5f6-4d86-85df-e7209e994078 service nova] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Received event network-vif-unplugged-51ab6198-7fa5-4b12-8d53-effcff16e287 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:01:10.459163 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-4a16ae45-3118-4317-b3e0-a09b54a8a12a req-56f36241-d5f6-4d86-85df-e7209e994078 service nova] Acquiring lock "659c56a6-743a-45e2-aa21-7d45c672f094-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:10.459382 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-4a16ae45-3118-4317-b3e0-a09b54a8a12a req-56f36241-d5f6-4d86-85df-e7209e994078 service nova] Lock "659c56a6-743a-45e2-aa21-7d45c672f094-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:10.459873 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-4a16ae45-3118-4317-b3e0-a09b54a8a12a req-56f36241-d5f6-4d86-85df-e7209e994078 service nova] Lock "659c56a6-743a-45e2-aa21-7d45c672f094-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:10.459873 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-4a16ae45-3118-4317-b3e0-a09b54a8a12a req-56f36241-d5f6-4d86-85df-e7209e994078 service nova] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] No waiting events found dispatching network-vif-unplugged-51ab6198-7fa5-4b12-8d53-effcff16e287 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:01:10.459873 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-4a16ae45-3118-4317-b3e0-a09b54a8a12a req-56f36241-d5f6-4d86-85df-e7209e994078 service nova] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Received event network-vif-unplugged-51ab6198-7fa5-4b12-8d53-effcff16e287 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:01:10.459984 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-4a16ae45-3118-4317-b3e0-a09b54a8a12a req-56f36241-d5f6-4d86-85df-e7209e994078 service nova] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Received event network-vif-deleted-51ab6198-7fa5-4b12-8d53-effcff16e287 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:01:10.460608 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-4a16ae45-3118-4317-b3e0-a09b54a8a12a req-56f36241-d5f6-4d86-85df-e7209e994078 service nova] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Neutron deleted interface 51ab6198-7fa5-4b12-8d53-effcff16e287; detaching it from the instance and deleting it from the info cache
May 28 02:01:10.462767 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-4a16ae45-3118-4317-b3e0-a09b54a8a12a req-56f36241-d5f6-4d86-85df-e7209e994078 service nova] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Detach interface failed, port_id=51ab6198-7fa5-4b12-8d53-effcff16e287, reason: Instance 659c56a6-743a-45e2-aa21-7d45c672f094 could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 02:01:10.521874 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-f0e752e3-1ee1-4cbe-94df-edb5efd1fceb tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Updating instance_info_cache with network_info: [{"id": "77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0", "address": "fa:16:3e:76:c5:3f", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77a0d5b8-3f", "ovs_interfaceid": "77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:01:10.688163 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:01:10.764780 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:01:10.767480 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933670.767176, c6e87c0e-02e1-4941-8f2f-b969b93ebf9f => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:01:10.767651 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] VM Resumed (Lifecycle Event)
May 28 02:01:10.799760 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Took 13.91 seconds to build instance.
May 28 02:01:10.937950 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:01:11.024238 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f0e752e3-1ee1-4cbe-94df-edb5efd1fceb tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Releasing lock "refresh_cache-8b2a5f31-1b3d-447f-939e-94fd0be5eb85" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:01:11.024494 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-f0e752e3-1ee1-4cbe-94df-edb5efd1fceb tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lazy-loading 'migration_context' on Instance uuid 8b2a5f31-1b3d-447f-939e-94fd0be5eb85 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:01:11.191724 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Took 1.39 seconds to deallocate network for instance.
May 28 02:01:11.270262 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:01:11.275588 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:01:11.300838 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "c6e87c0e-02e1-4941-8f2f-b969b93ebf9f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.431s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:11.439959 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Took 1.76 seconds to deallocate network for instance.
May 28 02:01:11.527169 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-f0e752e3-1ee1-4cbe-94df-edb5efd1fceb tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Object Instance<8b2a5f31-1b3d-447f-939e-94fd0be5eb85> lazy-loaded attributes: info_cache,migration_context {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 02:01:11.535893 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f0e752e3-1ee1-4cbe-94df-edb5efd1fceb tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:11.536180 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f0e752e3-1ee1-4cbe-94df-edb5efd1fceb tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:11.705059 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3ba8de32-5a96-4dfa-a562-9f9882d4987b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:12.005240 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Took 0.56 seconds to detach 1 volumes for instance.
May 28 02:01:12.171039 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-1bc76452-1043-4e90-8f6b-f39105588c29 req-ef829036-f5c9-4e78-ad23-d7aee007703e service nova] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Received event network-vif-deleted-062afddc-3d10-4dc2-a9d7-6024ed27c97a {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:01:12.511570 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:12.755393 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f0e752e3-1ee1-4cbe-94df-edb5efd1fceb tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:01:12.755633 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-f0e752e3-1ee1-4cbe-94df-edb5efd1fceb tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:01:13.242780 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:13.258954 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-f0e752e3-1ee1-4cbe-94df-edb5efd1fceb tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:01:13.891454 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Acquiring lock "c6e87c0e-02e1-4941-8f2f-b969b93ebf9f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:13.891667 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "c6e87c0e-02e1-4941-8f2f-b969b93ebf9f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:14.274098 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f0e752e3-1ee1-4cbe-94df-edb5efd1fceb tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 2.737s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:14.277901 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3ba8de32-5a96-4dfa-a562-9f9882d4987b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.578s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:14.281019 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:14.400351 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lazy-loading 'flavor' on Instance uuid c6e87c0e-02e1-4941-8f2f-b969b93ebf9f {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:01:14.985694 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-f0e752e3-1ee1-4cbe-94df-edb5efd1fceb tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Deleted allocation for migration d0ff9952-fe90-4262-b973-fb57cac9eb40
May 28 02:01:15.090810 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3ba8de32-5a96-4dfa-a562-9f9882d4987b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:01:15.091849 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-3ba8de32-5a96-4dfa-a562-9f9882d4987b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:01:15.195108 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:01:15.195108 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:01:15.408503 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "c6e87c0e-02e1-4941-8f2f-b969b93ebf9f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.517s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:15.496588 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f0e752e3-1ee1-4cbe-94df-edb5efd1fceb tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "8b2a5f31-1b3d-447f-939e-94fd0be5eb85" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 7.231s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:15.596269 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-3ba8de32-5a96-4dfa-a562-9f9882d4987b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:01:16.104313 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3ba8de32-5a96-4dfa-a562-9f9882d4987b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.826s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:16.106404 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 3.595s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:16.193529 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:01:16.194017 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:01:16.206009 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-3ba8de32-5a96-4dfa-a562-9f9882d4987b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Deleted allocations for instance 659c56a6-743a-45e2-aa21-7d45c672f094
May 28 02:01:16.485018 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Acquiring lock "c6e87c0e-02e1-4941-8f2f-b969b93ebf9f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:16.485595 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "c6e87c0e-02e1-4941-8f2f-b969b93ebf9f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:16.485670 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Attaching volume f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be to /dev/vdb
May 28 02:01:16.548901 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:01:16.568695 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 02:01:16.603857 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:01:16.658794 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 02:01:16.659160 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 02:01:16.677719 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 02:01:16.679339 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe48:7d7b', 'fe80::d0cf:7bff:fef9:3cc3', 'fe80::fc16:3eff:fed3:cd06', 'fe80::fc16:3eff:fedf:4521', 'fe80::fc16:3eff:fe57:9502', 'fe80::fc16:3eff:feca:8ce2', 'fe80::5048:4dff:fe67:fb12', 'fe80::fc16:3eff:fede:aca2', 'fe80::ecb9:b7ff:fe00:dc63', 'fe80::fc16:3eff:fe76:c53f', 'fe80::fc16:3eff:fe1e:c373', 'fe80::9020:88ff:fe40:d02'] 
May 28 02:01:16.679516 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 02:01:16.679650 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 02:01:16.679892 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:01:16.682055 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Updating existing volume attachment record: 2bdd21f8-968a-4358-9ede-d286c4a0ac45 {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 02:01:16.706306 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0006581170000572456 future=<Future at 0x7724ec2634a0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:01:16.706306 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:01:16.706306 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=6.554617422999854 future=<Future at 0x7724ec4a7200 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:01:16.706306 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=6.554440070000055 future=<Future at 0x7724ec4a7200 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:01:16.710328 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Emitting event <LifecycleEvent: 1779933661.7049963, 0d87a47f-2eb6-4e25-b44a-848fe2225962 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:01:16.710328 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] VM Stopped (Lifecycle Event)
May 28 02:01:16.875169 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:01:16.875470 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:01:17.089874 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-cb3a1709-dbac-42bc-9fc1-f465cd9d7c84 req-67107ca6-3c8e-4d1d-8373-427d046d3819 service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Received event network-changed-5e52242f-77f4-41cc-ae8f-6a4772243727 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:01:17.090105 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-cb3a1709-dbac-42bc-9fc1-f465cd9d7c84 req-67107ca6-3c8e-4d1d-8373-427d046d3819 service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Refreshing instance network info cache due to event network-changed-5e52242f-77f4-41cc-ae8f-6a4772243727. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:01:17.090357 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-cb3a1709-dbac-42bc-9fc1-f465cd9d7c84 req-67107ca6-3c8e-4d1d-8373-427d046d3819 service nova] Acquiring lock "refresh_cache-21c4e225-440e-4103-adaf-cb470d172291" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:01:17.090481 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-cb3a1709-dbac-42bc-9fc1-f465cd9d7c84 req-67107ca6-3c8e-4d1d-8373-427d046d3819 service nova] Acquired lock "refresh_cache-21c4e225-440e-4103-adaf-cb470d172291" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:01:17.090643 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-cb3a1709-dbac-42bc-9fc1-f465cd9d7c84 req-67107ca6-3c8e-4d1d-8373-427d046d3819 service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Refreshing network info cache for port 5e52242f-77f4-41cc-ae8f-6a4772243727 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:01:17.215861 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f8e6963c-78c6-484a-9f63-0183a0d36b46 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 0d87a47f-2eb6-4e25-b44a-848fe2225962] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:01:17.221285 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3ba8de32-5a96-4dfa-a562-9f9882d4987b tempest-ServerRescueNegativeTestJSON-1821941242 tempest-ServerRescueNegativeTestJSON-1821941242-project-member] Lock "659c56a6-743a-45e2-aa21-7d45c672f094" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.338s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:17.273134 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 02:01:17.273628 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be', 'iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:01:17.273828 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:01:17.274339 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:01:17.274615 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be', 'iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 02:01:17.289261 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:01:17.290205 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:01:17.290815 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:01:17.291059 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:01:17.291675 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:01:17.291675 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:01:17.304815 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:01:17.304815 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:17.310624 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:01:17.310624 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:17.318542 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be] added
May 28 02:01:17.318542 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:01:17.318542 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:01:17.318542 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:01:17.318542 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:01:17.318542 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:01:17.318542 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:17.319006 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:01:17.319305 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0282(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:01:17.319473 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:01:17.326882 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be] added
May 28 02:01:17.326882 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:01:17.326882 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:01:17.326882 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:01:17.326882 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:01:17.326882 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:01:17.326882 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:17.326882 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:01:17.327432 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0328(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:01:17.327800 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:01:17.378974 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:01:17.594058 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-cb3a1709-dbac-42bc-9fc1-f465cd9d7c84 req-67107ca6-3c8e-4d1d-8373-427d046d3819 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:17.888965 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.783s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:17.958044 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-cb3a1709-dbac-42bc-9fc1-f465cd9d7c84 req-67107ca6-3c8e-4d1d-8373-427d046d3819 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:17.968582 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Deleted allocations for instance a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d
May 28 02:01:18.161342 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-cb3a1709-dbac-42bc-9fc1-f465cd9d7c84 req-67107ca6-3c8e-4d1d-8373-427d046d3819 service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Updated VIF entry in instance network info cache for port 5e52242f-77f4-41cc-ae8f-6a4772243727. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:01:18.161342 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-cb3a1709-dbac-42bc-9fc1-f465cd9d7c84 req-67107ca6-3c8e-4d1d-8373-427d046d3819 service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Updating instance_info_cache with network_info: [{"id": "5e52242f-77f4-41cc-ae8f-6a4772243727", "address": "fa:16:3e:57:95:02", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e52242f-77", "ovs_interfaceid": "5e52242f-77f4-41cc-ae8f-6a4772243727", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:01:18.245332 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:18.320129 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:01:18.328360 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:01:18.336162 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:01:18.336162 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:01:18.348264 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:01:18.348264 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:18.354779 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:18.364299 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:18.373933 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:18.373933 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:18.373933 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:18.373933 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:18.373933 np0000001583 nova-compute[98241]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14e3a7da-d910-4c11-90aa-4fa380f47ebf (non-flash)
May 28 02:01:18.373933 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:01:18.374221 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:18.374221 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:18.374221 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:18.374221 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:18.374221 np0000001583 nova-compute[98241]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14e3a7da-d910-4c11-90aa-4fa380f47ebf (non-flash)
May 28 02:01:18.374221 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:01:18.383159 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:18.383159 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:18.383159 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:18.383159 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:18.383159 np0000001583 nova-compute[98241]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14e3a7da-d910-4c11-90aa-4fa380f47ebf (non-flash)
May 28 02:01:18.383159 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:01:18.383159 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:18.383159 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:18.383159 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:18.383159 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:18.383159 np0000001583 nova-compute[98241]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14e3a7da-d910-4c11-90aa-4fa380f47ebf (non-flash)
May 28 02:01:18.383159 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:01:18.414887 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be, portal: 192.168.50.100,3260]
May 28 02:01:18.414887 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be, portal: 192.168.50.100,3260] successful.
May 28 02:01:18.414887 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:18.432356 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:18.444894 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be, portal: 192.168.40.100,3260]
May 28 02:01:18.444894 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be, portal: 192.168.40.100,3260] successful.
May 28 02:01:18.444894 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:18.453183 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:18.453183 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:18.453183 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:18.453183 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:18.453183 np0000001583 nova-compute[98241]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14e3a7da-d910-4c11-90aa-4fa380f47ebf (non-flash)
May 28 02:01:18.453183 np0000001583 nova-compute[98241]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:18.453183 np0000001583 nova-compute[98241]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:18.453183 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:01:18.453183 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:18.453183 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:18.453183 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:18.453183 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:18.453183 np0000001583 nova-compute[98241]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14e3a7da-d910-4c11-90aa-4fa380f47ebf (non-flash)
May 28 02:01:18.453183 np0000001583 nova-compute[98241]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:18.453183 np0000001583 nova-compute[98241]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:18.453183 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:01:18.453183 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.161s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:01:18.453183 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:01:18.453183 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] HCTL ('10', '-', '-', 0) found on session 98 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:01:18.453183 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:01:18.464061 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:18.476160 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Searching for a device in session 98 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:01:18.476160 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:01:18.492136 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:18.492136 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:18.492136 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:18.492136 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:18.492136 np0000001583 nova-compute[98241]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14e3a7da-d910-4c11-90aa-4fa380f47ebf (non-flash)
May 28 02:01:18.492136 np0000001583 nova-compute[98241]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:18.492136 np0000001583 nova-compute[98241]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:18.492136 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:01:18.492136 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:18.492136 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:18.492136 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:18.492136 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:18.492136 np0000001583 nova-compute[98241]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14e3a7da-d910-4c11-90aa-4fa380f47ebf (non-flash)
May 28 02:01:18.492136 np0000001583 nova-compute[98241]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:18.492136 np0000001583 nova-compute[98241]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:18.492136 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:01:18.492136 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.198s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:01:18.492136 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:01:18.492136 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] HCTL ('11', '-', '-', 0) found on session 99 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:01:18.492136 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:01:18.528560 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Searching for a device in session 99 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:01:18.528560 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:01:18.666475 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-cb3a1709-dbac-42bc-9fc1-f465cd9d7c84 req-67107ca6-3c8e-4d1d-8373-427d046d3819 service nova] Releasing lock "refresh_cache-21c4e225-440e-4103-adaf-cb470d172291" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:01:18.979202 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-224e40bb-4f04-4a47-8f4c-e27d186e979d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.846s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:19.070065 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:19.171895 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-13cc99f5-1fb0-437d-b62b-c4f6ac48ccfd req-69d51a36-5c4e-4103-8480-f255130b369c service nova] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Received event network-changed-77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:01:19.172604 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-13cc99f5-1fb0-437d-b62b-c4f6ac48ccfd req-69d51a36-5c4e-4103-8480-f255130b369c service nova] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Refreshing instance network info cache due to event network-changed-77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:01:19.172736 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-13cc99f5-1fb0-437d-b62b-c4f6ac48ccfd req-69d51a36-5c4e-4103-8480-f255130b369c service nova] Acquiring lock "refresh_cache-8b2a5f31-1b3d-447f-939e-94fd0be5eb85" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:01:19.172872 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-13cc99f5-1fb0-437d-b62b-c4f6ac48ccfd req-69d51a36-5c4e-4103-8480-f255130b369c service nova] Acquired lock "refresh_cache-8b2a5f31-1b3d-447f-939e-94fd0be5eb85" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:01:19.173009 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-13cc99f5-1fb0-437d-b62b-c4f6ac48ccfd req-69d51a36-5c4e-4103-8480-f255130b369c service nova] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Refreshing network info cache for port 77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:01:19.193653 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:01:19.196450 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:01:19.196450 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 02:01:19.196450 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:01:19.283157 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:19.292582 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 02:01:19.675420 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-13cc99f5-1fb0-437d-b62b-c4f6ac48ccfd req-69d51a36-5c4e-4103-8480-f255130b369c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:19.700497 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:19.700642 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:19.700797 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:19.700961 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Auditing locally available compute resources for np0000001583 (node: np0000001583) {{(pid=98241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 02:01:20.089998 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-13cc99f5-1fb0-437d-b62b-c4f6ac48ccfd req-69d51a36-5c4e-4103-8480-f255130b369c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:20.275824 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-13cc99f5-1fb0-437d-b62b-c4f6ac48ccfd req-69d51a36-5c4e-4103-8480-f255130b369c service nova] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Updated VIF entry in instance network info cache for port 77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:01:20.276758 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-13cc99f5-1fb0-437d-b62b-c4f6ac48ccfd req-69d51a36-5c4e-4103-8480-f255130b369c service nova] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Updating instance_info_cache with network_info: [{"id": "77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0", "address": "fa:16:3e:76:c5:3f", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77a0d5b8-3f", "ovs_interfaceid": "77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:01:20.312284 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Found WWN 330000000542d83d5 for multipath device dm-3 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 02:01:20.312718 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:01:20.313061 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '330000000542d83d5', 'path': '/dev/dm-3', 'multipath_id': '330000000542d83d5'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:01:20.313264 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000542d83d5', 'path': '/dev/dm-3', 'multipath_id': '330000000542d83d5'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 02:01:20.316650 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lazy-loading 'flavor' on Instance uuid c6e87c0e-02e1-4941-8f2f-b969b93ebf9f {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:01:20.767895 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:01:20.786722 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-13cc99f5-1fb0-437d-b62b-c4f6ac48ccfd req-69d51a36-5c4e-4103-8480-f255130b369c service nova] Releasing lock "refresh_cache-8b2a5f31-1b3d-447f-939e-94fd0be5eb85" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:01:20.824587 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Attempting to attach volume f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98241) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 02:01:20.828586 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] attach device xml: <disk type="block" device="disk">
May 28 02:01:20.828586 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:01:20.828586 np0000001583 nova-compute[98241]:   <alias name="ua-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be"/>
May 28 02:01:20.828586 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-3"/>
May 28 02:01:20.828586 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:01:20.828586 np0000001583 nova-compute[98241]:   <serial>f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be</serial>
May 28 02:01:20.828586 np0000001583 nova-compute[98241]: </disk>
May 28 02:01:20.828586 np0000001583 nova-compute[98241]:  {{(pid=98241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 02:01:20.879300 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:01:20.880346 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:01:21.010650 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:01:21.011310 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/dm-10 (vdb) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 02:01:21.016659 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e9a0d0-72cd-459e-8bc4-cf080adb5267/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:01:21.120605 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e9a0d0-72cd-459e-8bc4-cf080adb5267/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:01:21.121166 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e9a0d0-72cd-459e-8bc4-cf080adb5267/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:01:21.213969 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e9a0d0-72cd-459e-8bc4-cf080adb5267/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:01:21.220054 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bbb8cf-c11d-4025-8551-4c1c3557264a/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:01:21.345100 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bbb8cf-c11d-4025-8551-4c1c3557264a/disk --force-share --output=json" returned: 0 in 0.125s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:01:21.345689 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bbb8cf-c11d-4025-8551-4c1c3557264a/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:01:21.569672 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bbb8cf-c11d-4025-8551-4c1c3557264a/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:01:21.573717 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:01:21.682090 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:01:21.682603 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:01:21.781200 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:01:21.789141 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6e87c0e-02e1-4941-8f2f-b969b93ebf9f/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:01:21.879432 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6e87c0e-02e1-4941-8f2f-b969b93ebf9f/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:01:21.879944 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6e87c0e-02e1-4941-8f2f-b969b93ebf9f/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:01:21.972384 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6e87c0e-02e1-4941-8f2f-b969b93ebf9f/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:01:21.973518 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/dm-3 (vdb) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 02:01:21.981827 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:01:22.121428 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:01:22.121428 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:01:22.230289 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:01:22.230796 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/dm-10 (vdb) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 02:01:22.235507 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 02:01:22.239420 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d8de67-23ab-4430-8512-d2fece776ac2/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:01:22.341175 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d8de67-23ab-4430-8512-d2fece776ac2/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:01:22.341843 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d8de67-23ab-4430-8512-d2fece776ac2/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:01:22.452184 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d8de67-23ab-4430-8512-d2fece776ac2/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:01:22.456708 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:01:22.458413 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:01:22.512816 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.053s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:01:22.515217 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Hypervisor/Node resource view: name=np0000001583 free_ram=11310MB free_disk=73.71929931640625GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 02:01:22.515442 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:22.517058 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:22.568715 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:01:22.568870 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:01:22.569009 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:01:22.569143 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] No VIF found with MAC fa:16:3e:1e:c3:73, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:01:23.247467 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:23.261392 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0005407490002653503 future=<Future at 0x7724ec4a7200 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:01:23.262750 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Emitting event <LifecycleEvent: 1779933668.260651, a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:01:23.263068 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:01:23.263286 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=0.4930731740000738 future=<Future at 0x7724ec17a540 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:01:23.263399 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=0.4929503910002495 future=<Future at 0x7724ec17a540 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:01:23.265433 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] VM Stopped (Lifecycle Event)
May 28 02:01:23.623258 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance e50227a8-b484-447b-abc6-3a3c1379e7ff actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:01:23.623258 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 22bbb8cf-c11d-4025-8551-4c1c3557264a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:01:23.623258 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance d4fad20b-d51e-47c9-8f55-3aa085a10891 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:01:23.623258 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance e3e9a0d0-72cd-459e-8bc4-cf080adb5267 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:01:23.623258 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 21c4e225-440e-4103-adaf-cb470d172291 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:01:23.623258 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 8b2a5f31-1b3d-447f-939e-94fd0be5eb85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:01:23.623258 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 01d8de67-23ab-4430-8512-d2fece776ac2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:01:23.623258 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance c6e87c0e-02e1-4941-8f2f-b969b93ebf9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:01:23.623258 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 02:01:23.623258 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Final resource view: name=np0000001583 phys_ram=24030MB used_ram=2112MB phys_disk=95GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:01:22 up 37 min,  2 users,  load average: 7.91, 7.86, 4.71\n', 'num_instances': '8', 'num_vm_active': '8', 'num_task_None': '8', 'num_os_type_None': '8', 'num_proj_0474090f4f2d4950b51bc317f4302266': '5', 'io_workload': '0', 'num_proj_04ce4063a6ac4afdb5ee359a5c1105d3': '1', 'num_proj_837663bcfa40402aaf583729dfbb26cd': '1', 'num_proj_1d5cfe906dd24a10819b92c144f7f06f': '1'} {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 02:01:23.756744 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.00034138000000893953 future=<Future at 0x7724ec17a540 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:01:23.757952 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Emitting event <LifecycleEvent: 1779933668.756299, 659c56a6-743a-45e2-aa21-7d45c672f094 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:01:23.758198 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:01:23.758388 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] VM Stopped (Lifecycle Event)
May 28 02:01:23.769931 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: a0dbb1c7-f5a8-4fb4-af18-f02bf614b14d] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:01:24.152454 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5c263b9c-4846-419d-854a-0f81f9e57940 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "c6e87c0e-02e1-4941-8f2f-b969b93ebf9f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.667s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:24.234251 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:01:24.234251 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:01:24.261170 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3f8bdfde-ba7a-49bb-b02b-4a2b54d93aec tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 659c56a6-743a-45e2-aa21-7d45c672f094] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:01:24.284319 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:24.737121 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:01:24.817181 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "294538ef-cf08-4184-8bc2-96598456d113" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:24.817494 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "294538ef-cf08-4184-8bc2-96598456d113" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:25.248384 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Compute_service record updated for np0000001583:np0000001583 {{(pid=98241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 02:01:25.248384 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.733s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:25.248940 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:01:25.320254 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 02:01:25.756669 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-4da71c9e-4817-4e61-a51b-46805de66cee req-2ef5efb8-be32-44d6-9814-63e87e7c7084 service nova] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Received event network-changed-18842969-e82f-4389-a30f-f5054a50d115 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:01:25.756872 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-4da71c9e-4817-4e61-a51b-46805de66cee req-2ef5efb8-be32-44d6-9814-63e87e7c7084 service nova] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Refreshing instance network info cache due to event network-changed-18842969-e82f-4389-a30f-f5054a50d115. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:01:25.757103 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-4da71c9e-4817-4e61-a51b-46805de66cee req-2ef5efb8-be32-44d6-9814-63e87e7c7084 service nova] Acquiring lock "refresh_cache-c6e87c0e-02e1-4941-8f2f-b969b93ebf9f" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:01:25.757310 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-4da71c9e-4817-4e61-a51b-46805de66cee req-2ef5efb8-be32-44d6-9814-63e87e7c7084 service nova] Acquired lock "refresh_cache-c6e87c0e-02e1-4941-8f2f-b969b93ebf9f" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:01:25.757358 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-4da71c9e-4817-4e61-a51b-46805de66cee req-2ef5efb8-be32-44d6-9814-63e87e7c7084 service nova] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Refreshing network info cache for port 18842969-e82f-4389-a30f-f5054a50d115 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:01:25.902196 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:25.902475 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:25.907913 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 02:01:25.908094 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Claim successful on node np0000001583
May 28 02:01:26.244471 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:01:26.244932 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:01:26.245372 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:01:26.245641 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:01:26.245946 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 50.95 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:01:26.260718 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-4da71c9e-4817-4e61-a51b-46805de66cee req-2ef5efb8-be32-44d6-9814-63e87e7c7084 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:26.648911 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-4da71c9e-4817-4e61-a51b-46805de66cee req-2ef5efb8-be32-44d6-9814-63e87e7c7084 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:26.838496 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-4da71c9e-4817-4e61-a51b-46805de66cee req-2ef5efb8-be32-44d6-9814-63e87e7c7084 service nova] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Updated VIF entry in instance network info cache for port 18842969-e82f-4389-a30f-f5054a50d115. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:01:26.838849 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-4da71c9e-4817-4e61-a51b-46805de66cee req-2ef5efb8-be32-44d6-9814-63e87e7c7084 service nova] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Updating instance_info_cache with network_info: [{"id": "18842969-e82f-4389-a30f-f5054a50d115", "address": "fa:16:3e:1e:c3:73", "network": {"id": "c18d43cf-482c-4814-96a1-09aab2287be4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2071326233-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d5cfe906dd24a10819b92c144f7f06f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap18842969-e8", "ovs_interfaceid": "18842969-e82f-4389-a30f-f5054a50d115", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:01:27.341174 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-4da71c9e-4817-4e61-a51b-46805de66cee req-2ef5efb8-be32-44d6-9814-63e87e7c7084 service nova] Releasing lock "refresh_cache-c6e87c0e-02e1-4941-8f2f-b969b93ebf9f" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:01:27.416629 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:01:27.416918 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:01:27.593669 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-c4e104b9-4449-4a54-8434-99c74d5a64ea req-91ddafad-3181-4769-b562-b2b94915643e service nova] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Received event network-changed-18842969-e82f-4389-a30f-f5054a50d115 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:01:27.594188 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-c4e104b9-4449-4a54-8434-99c74d5a64ea req-91ddafad-3181-4769-b562-b2b94915643e service nova] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Refreshing instance network info cache due to event network-changed-18842969-e82f-4389-a30f-f5054a50d115. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:01:27.594465 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c4e104b9-4449-4a54-8434-99c74d5a64ea req-91ddafad-3181-4769-b562-b2b94915643e service nova] Acquiring lock "refresh_cache-c6e87c0e-02e1-4941-8f2f-b969b93ebf9f" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:01:27.594617 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c4e104b9-4449-4a54-8434-99c74d5a64ea req-91ddafad-3181-4769-b562-b2b94915643e service nova] Acquired lock "refresh_cache-c6e87c0e-02e1-4941-8f2f-b969b93ebf9f" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:01:27.594699 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-c4e104b9-4449-4a54-8434-99c74d5a64ea req-91ddafad-3181-4769-b562-b2b94915643e service nova] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Refreshing network info cache for port 18842969-e82f-4389-a30f-f5054a50d115 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:01:27.920074 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:01:28.097491 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-c4e104b9-4449-4a54-8434-99c74d5a64ea req-91ddafad-3181-4769-b562-b2b94915643e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:28.249159 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:28.429835 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.527s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:28.430276 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 02:01:28.491271 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-c4e104b9-4449-4a54-8434-99c74d5a64ea req-91ddafad-3181-4769-b562-b2b94915643e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:28.677538 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-c4e104b9-4449-4a54-8434-99c74d5a64ea req-91ddafad-3181-4769-b562-b2b94915643e service nova] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Updated VIF entry in instance network info cache for port 18842969-e82f-4389-a30f-f5054a50d115. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:01:28.677911 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-c4e104b9-4449-4a54-8434-99c74d5a64ea req-91ddafad-3181-4769-b562-b2b94915643e service nova] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Updating instance_info_cache with network_info: [{"id": "18842969-e82f-4389-a30f-f5054a50d115", "address": "fa:16:3e:1e:c3:73", "network": {"id": "c18d43cf-482c-4814-96a1-09aab2287be4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2071326233-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d5cfe906dd24a10819b92c144f7f06f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap18842969-e8", "ovs_interfaceid": "18842969-e82f-4389-a30f-f5054a50d115", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:01:28.936987 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 02:01:28.937509 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 294538ef-cf08-4184-8bc2-96598456d113] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 02:01:28.937556 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:28.937880 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:29.033556 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6be314b4eed642c3b2c72fe115860220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432aa1094ced436494def17a875aa8e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 02:01:29.180024 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c4e104b9-4449-4a54-8434-99c74d5a64ea req-91ddafad-3181-4769-b562-b2b94915643e service nova] Releasing lock "refresh_cache-c6e87c0e-02e1-4941-8f2f-b969b93ebf9f" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:01:29.288791 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:29.440638 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 02:01:29.519780 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Successfully created port: 8a37c53c-4096-4379-9e19-72530018c97b {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 02:01:29.943434 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 02:01:30.094074 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Successfully updated port: 8a37c53c-4096-4379-9e19-72530018c97b {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 02:01:30.162328 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d2a9ca41-a3be-41f5-b2b3-7b8eb3c73281 req-8775c75e-88a6-4e93-9e58-59a15b3eb6f2 service nova] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Received event network-changed-8a37c53c-4096-4379-9e19-72530018c97b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:01:30.162550 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d2a9ca41-a3be-41f5-b2b3-7b8eb3c73281 req-8775c75e-88a6-4e93-9e58-59a15b3eb6f2 service nova] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Refreshing instance network info cache due to event network-changed-8a37c53c-4096-4379-9e19-72530018c97b. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:01:30.162962 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d2a9ca41-a3be-41f5-b2b3-7b8eb3c73281 req-8775c75e-88a6-4e93-9e58-59a15b3eb6f2 service nova] Acquiring lock "refresh_cache-294538ef-cf08-4184-8bc2-96598456d113" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:01:30.163052 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d2a9ca41-a3be-41f5-b2b3-7b8eb3c73281 req-8775c75e-88a6-4e93-9e58-59a15b3eb6f2 service nova] Acquired lock "refresh_cache-294538ef-cf08-4184-8bc2-96598456d113" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:01:30.163184 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-d2a9ca41-a3be-41f5-b2b3-7b8eb3c73281 req-8775c75e-88a6-4e93-9e58-59a15b3eb6f2 service nova] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Refreshing network info cache for port 8a37c53c-4096-4379-9e19-72530018c97b {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:01:30.449847 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Booting with volume snapshot 0040c2e2-86ce-402a-8222-57342cbf3549 at /dev/vda
May 28 02:01:30.596090 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "refresh_cache-294538ef-cf08-4184-8bc2-96598456d113" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:01:30.665829 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-d2a9ca41-a3be-41f5-b2b3-7b8eb3c73281 req-8775c75e-88a6-4e93-9e58-59a15b3eb6f2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:30.753258 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-d2a9ca41-a3be-41f5-b2b3-7b8eb3c73281 req-8775c75e-88a6-4e93-9e58-59a15b3eb6f2 service nova] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:01:30.949464 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-d2a9ca41-a3be-41f5-b2b3-7b8eb3c73281 req-8775c75e-88a6-4e93-9e58-59a15b3eb6f2 service nova] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:01:31.451276 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d2a9ca41-a3be-41f5-b2b3-7b8eb3c73281 req-8775c75e-88a6-4e93-9e58-59a15b3eb6f2 service nova] Releasing lock "refresh_cache-294538ef-cf08-4184-8bc2-96598456d113" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:01:31.451513 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquired lock "refresh_cache-294538ef-cf08-4184-8bc2-96598456d113" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:01:31.451674 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:01:32.040629 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:01:32.198372 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:32.333124 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Updating instance_info_cache with network_info: [{"id": "8a37c53c-4096-4379-9e19-72530018c97b", "address": "fa:16:3e:73:91:0b", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a37c53c-40", "ovs_interfaceid": "8a37c53c-4096-4379-9e19-72530018c97b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:01:32.835343 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Releasing lock "refresh_cache-294538ef-cf08-4184-8bc2-96598456d113" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:01:32.835638 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Instance network_info: |[{"id": "8a37c53c-4096-4379-9e19-72530018c97b", "address": "fa:16:3e:73:91:0b", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a37c53c-40", "ovs_interfaceid": "8a37c53c-4096-4379-9e19-72530018c97b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 02:01:33.252338 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:33.936455 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:01:33.949487 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 02:01:33.972583 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:01:34.024926 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 02:01:34.025252 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 02:01:34.041583 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 02:01:34.043276 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe48:7d7b', 'fe80::d0cf:7bff:fef9:3cc3', 'fe80::fc16:3eff:fed3:cd06', 'fe80::fc16:3eff:fedf:4521', 'fe80::fc16:3eff:fe57:9502', 'fe80::fc16:3eff:feca:8ce2', 'fe80::5048:4dff:fe67:fb12', 'fe80::fc16:3eff:fede:aca2', 'fe80::ecb9:b7ff:fe00:dc63', 'fe80::fc16:3eff:fe76:c53f', 'fe80::fc16:3eff:fe1e:c373', 'fe80::9020:88ff:fe40:d02'] 
May 28 02:01:34.043433 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 02:01:34.043577 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 02:01:34.043806 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:01:34.044036 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Updating existing volume attachment record: 0b0bf1e5-fd3e-4a13-a12e-4d773c51d4b0 {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 02:01:34.248365 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Acquiring lock "c165c9a8-be28-4efe-b671-4dcf9bedfbe4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:34.248666 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Lock "c165c9a8-be28-4efe-b671-4dcf9bedfbe4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:34.290439 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:34.318017 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:01:34.751240 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 02:01:35.021696 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f8b456cf-62fc-44eb-aef1-5473f84f5f11 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Acquiring lock "d4fad20b-d51e-47c9-8f55-3aa085a10891" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:35.021897 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f8b456cf-62fc-44eb-aef1-5473f84f5f11 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "d4fad20b-d51e-47c9-8f55-3aa085a10891" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:35.022089 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f8b456cf-62fc-44eb-aef1-5473f84f5f11 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Acquiring lock "d4fad20b-d51e-47c9-8f55-3aa085a10891-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:35.022239 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f8b456cf-62fc-44eb-aef1-5473f84f5f11 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "d4fad20b-d51e-47c9-8f55-3aa085a10891-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:35.022359 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f8b456cf-62fc-44eb-aef1-5473f84f5f11 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "d4fad20b-d51e-47c9-8f55-3aa085a10891-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:35.030638 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-f8b456cf-62fc-44eb-aef1-5473f84f5f11 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Terminating instance
May 28 02:01:35.307931 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:35.308495 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:35.313062 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 02:01:35.313062 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Claim successful on node np0000001583
May 28 02:01:35.533731 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f8b456cf-62fc-44eb-aef1-5473f84f5f11 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 02:01:35.555878 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:35.559122 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:35.579437 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:35.584566 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:35.610949 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:35.737731 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-41d4ec53-6ef3-4737-a243-77d22b5fc09f req-53ffe73a-9158-45b2-96f3-30fc7eac60a8 service nova] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Received event network-vif-unplugged-0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:01:35.738508 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-41d4ec53-6ef3-4737-a243-77d22b5fc09f req-53ffe73a-9158-45b2-96f3-30fc7eac60a8 service nova] Acquiring lock "d4fad20b-d51e-47c9-8f55-3aa085a10891-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:35.738508 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-41d4ec53-6ef3-4737-a243-77d22b5fc09f req-53ffe73a-9158-45b2-96f3-30fc7eac60a8 service nova] Lock "d4fad20b-d51e-47c9-8f55-3aa085a10891-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:35.738508 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-41d4ec53-6ef3-4737-a243-77d22b5fc09f req-53ffe73a-9158-45b2-96f3-30fc7eac60a8 service nova] Lock "d4fad20b-d51e-47c9-8f55-3aa085a10891-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:35.738508 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-41d4ec53-6ef3-4737-a243-77d22b5fc09f req-53ffe73a-9158-45b2-96f3-30fc7eac60a8 service nova] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] No waiting events found dispatching network-vif-unplugged-0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:01:35.738508 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-41d4ec53-6ef3-4737-a243-77d22b5fc09f req-53ffe73a-9158-45b2-96f3-30fc7eac60a8 service nova] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Received event network-vif-unplugged-0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:01:35.912796 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999565975999758 future=<Future at 0x7724f82ef230 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:01:35.913443 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.998936426 future=<Future at 0x7724f82ef230 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:01:35.913649 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.998704983000152 future=<Future at 0x7724f82ef230 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:01:35.917526 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Instance destroyed successfully.
May 28 02:01:35.919306 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-f8b456cf-62fc-44eb-aef1-5473f84f5f11 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lazy-loading 'resources' on Instance uuid d4fad20b-d51e-47c9-8f55-3aa085a10891 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:01:36.161259 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 02:01:36.162990 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 02:01:36.163616 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Creating image(s)
May 28 02:01:36.163799 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Did not create local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 02:01:36.163882 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Ensure instance console log exists: /opt/stack/data/nova/instances/294538ef-cf08-4184-8bc2-96598456d113/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 02:01:36.165260 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:36.166602 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:36.167189 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:36.167904 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Start _get_guest_xml network_info=[{"id": "8a37c53c-4096-4379-9e19-72530018c97b", "address": "fa:16:3e:73:91:0b", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a37c53c-40", "ovs_interfaceid": "8a37c53c-4096-4379-9e19-72530018c97b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451', 'iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e30ed0b1-bfc4-4e94-bbf6-9acb83638451', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '294538ef-cf08-4184-8bc2-96598456d113', 'attached_at': '', 'detached_at': '', 'volume_id': 'e30ed0b1-bfc4-4e94-bbf6-9acb83638451', 'serial': 'e30ed0b1-bfc4-4e94-bbf6-9acb83638451'}, 'delete_on_termination': True, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '0b0bf1e5-fd3e-4a13-a12e-4d773c51d4b0', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 02:01:36.170997 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:01:36.172606 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-510246973', uuid='294538ef-cf08-4184-8bc2-96598456d113'), owner=OwnerMeta(userid='6be314b4eed642c3b2c72fe115860220', username='tempest-TestVolumeBootPattern-1031057169-project-member', projectid='432aa1094ced436494def17a875aa8e1', projectname='tempest-TestVolumeBootPattern-1031057169'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "8a37c53c-4096-4379-9e19-72530018c97b", "address": "fa:16:3e:73:91:0b", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a37c53c-40", "ovs_interfaceid": "8a37c53c-4096-4379-9e19-72530018c97b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933696.1722395) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 02:01:36.173828 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 02:01:36.174353 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 02:01:36.175414 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 02:01:36.175761 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 02:01:36.179233 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 02:01:36.179233 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 02:01:36.179233 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 02:01:36.179233 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 02:01:36.179233 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 02:01:36.179233 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 02:01:36.179233 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 02:01:36.179233 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 02:01:36.179233 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 02:01:36.179233 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 02:01:36.179233 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 02:01:36.179233 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 02:01:36.189652 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 02:01:36.190522 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451', 'iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e30ed0b1-bfc4-4e94-bbf6-9acb83638451', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:01:36.190522 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:01:36.190786 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:01:36.190987 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451', 'iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e30ed0b1-bfc4-4e94-bbf6-9acb83638451', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 02:01:36.207659 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:01:36.208268 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:01:36.208978 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:01:36.209211 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:01:36.209627 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:01:36.209840 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:01:36.225397 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:01:36.225397 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:36.232546 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:01:36.232546 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:36.241113 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451] added
May 28 02:01:36.241113 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:01:36.241113 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:01:36.241113 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:01:36.241113 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:01:36.241113 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:01:36.241113 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:36.241439 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:01:36.241640 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0324(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:01:36.241882 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:01:36.247363 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451] added
May 28 02:01:36.247363 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:01:36.247363 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:01:36.247363 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:01:36.247363 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:01:36.247363 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:01:36.247363 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:36.247621 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:01:36.247698 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0379(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:01:36.247855 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:01:36.423506 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-f8b456cf-62fc-44eb-aef1-5473f84f5f11 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:58:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-522410549',display_name='tempest-AttachVolumeTestJSON-server-522410549',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-attachvolumetestjson-server-522410549',id=34,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/SX3aLhOteyGwrFqR0CEL4C04Fp6fWjwsBRpIz44V+NdHV7WRnAaFAuCSewkCiCwsHBAYVT3CCSkcBu9Z5deiFWGGYvkB/zQRpMDdHuyRrvPU5bkBQzk+aQ10B/g2ZJA==',key_name='tempest-keypair-487865295',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:58:49Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='04ce4063a6ac4afdb5ee359a5c1105d3',ramdisk_id='',reservation_id='r-q0lo3p0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1276932129',owner_user_name='tempest-AttachVolumeTestJSON-1276932129-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T02:00:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='164f3d08de954440bd716afe5eb1054a',uuid=d4fad20b-d51e-47c9-8f55-3aa085a10891,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "address": "fa:16:3e:ca:8c:e2", "network": {"id": "d4bf7f94-4ac7-4145-be11-d2aeeafb6c02", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-972487534-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "04ce4063a6ac4afdb5ee359a5c1105d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e39a69e-35", "ovs_interfaceid": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:01:36.428716 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-f8b456cf-62fc-44eb-aef1-5473f84f5f11 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Converting VIF {"id": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "address": "fa:16:3e:ca:8c:e2", "network": {"id": "d4bf7f94-4ac7-4145-be11-d2aeeafb6c02", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-972487534-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "04ce4063a6ac4afdb5ee359a5c1105d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e39a69e-35", "ovs_interfaceid": "0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:01:36.429648 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-f8b456cf-62fc-44eb-aef1-5473f84f5f11 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:8c:e2,bridge_name='br-int',has_traffic_filtering=True,id=0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b,network=Network(d4bf7f94-4ac7-4145-be11-d2aeeafb6c02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e39a69e-35') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:01:36.430162 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-f8b456cf-62fc-44eb-aef1-5473f84f5f11 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:8c:e2,bridge_name='br-int',has_traffic_filtering=True,id=0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b,network=Network(d4bf7f94-4ac7-4145-be11-d2aeeafb6c02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e39a69e-35') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:01:36.434929 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:36.435170 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0e39a69e-35, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:01:36.436322 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:36.437064 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:01:36.437623 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:36.440096 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:36.440264 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1bd209ef-9a83-4a64-a71b-3bd8f36c9a89) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:01:36.440955 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:36.441423 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:01:36.441922 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:36.445550 np0000001583 nova-compute[98241]: INFO os_vif [None req-f8b456cf-62fc-44eb-aef1-5473f84f5f11 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:8c:e2,bridge_name='br-int',has_traffic_filtering=True,id=0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b,network=Network(d4bf7f94-4ac7-4145-be11-d2aeeafb6c02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e39a69e-35')
May 28 02:01:36.445940 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-f8b456cf-62fc-44eb-aef1-5473f84f5f11 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Deleting instance files /opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891_del
May 28 02:01:36.447010 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-f8b456cf-62fc-44eb-aef1-5473f84f5f11 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Deletion of /opt/stack/data/nova/instances/d4fad20b-d51e-47c9-8f55-3aa085a10891_del complete
May 28 02:01:36.895752 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:01:36.896032 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:01:36.956260 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-f8b456cf-62fc-44eb-aef1-5473f84f5f11 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Took 1.42 seconds to destroy the instance on the hypervisor.
May 28 02:01:36.960405 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-f8b456cf-62fc-44eb-aef1-5473f84f5f11 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 02:01:36.960804 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 02:01:36.960964 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 02:01:36.961282 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:37.042103 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:37.228507 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "01d8de67-23ab-4430-8512-d2fece776ac2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:37.229289 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "01d8de67-23ab-4430-8512-d2fece776ac2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:37.243649 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:01:37.249039 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:01:37.259808 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:01:37.259808 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:01:37.266482 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:01:37.266482 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:37.281295 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:37.289645 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:37.305102 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfc05152-7d36-4b7b-85e9-f875c4c30efa (non-flash)
May 28 02:01:37.305102 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:37.305102 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:37.305102 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:37.305102 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:37.305102 np0000001583 nova-compute[98241]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:37.305102 np0000001583 nova-compute[98241]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:37.305102 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:01:37.305102 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfc05152-7d36-4b7b-85e9-f875c4c30efa (non-flash)
May 28 02:01:37.305102 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:37.305102 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:37.305102 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:37.305102 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:37.305102 np0000001583 nova-compute[98241]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:37.305102 np0000001583 nova-compute[98241]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:37.305102 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:01:37.310420 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfc05152-7d36-4b7b-85e9-f875c4c30efa (non-flash)
May 28 02:01:37.310420 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:37.310420 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:37.310420 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:37.310420 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:37.310420 np0000001583 nova-compute[98241]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:37.310420 np0000001583 nova-compute[98241]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:37.310420 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:01:37.310895 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfc05152-7d36-4b7b-85e9-f875c4c30efa (non-flash)
May 28 02:01:37.310895 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:37.310895 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:37.310895 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:37.310895 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:37.310895 np0000001583 nova-compute[98241]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:37.310895 np0000001583 nova-compute[98241]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:37.310895 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:01:37.355863 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451, portal: 192.168.40.100,3260]
May 28 02:01:37.355863 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451, portal: 192.168.40.100,3260] successful.
May 28 02:01:37.355863 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:37.368366 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451, portal: 192.168.50.100,3260]
May 28 02:01:37.368366 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451, portal: 192.168.50.100,3260] successful.
May 28 02:01:37.368366 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:37.375534 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:37.383924 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:37.396772 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfc05152-7d36-4b7b-85e9-f875c4c30efa (non-flash)
May 28 02:01:37.396772 np0000001583 nova-compute[98241]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451 (non-flash)
May 28 02:01:37.396772 np0000001583 nova-compute[98241]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451 (non-flash)
May 28 02:01:37.396772 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:37.396772 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:37.396772 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:37.396772 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:37.396772 np0000001583 nova-compute[98241]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:37.396772 np0000001583 nova-compute[98241]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:37.396772 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:01:37.397137 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfc05152-7d36-4b7b-85e9-f875c4c30efa (non-flash)
May 28 02:01:37.397137 np0000001583 nova-compute[98241]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451 (non-flash)
May 28 02:01:37.397137 np0000001583 nova-compute[98241]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451 (non-flash)
May 28 02:01:37.397137 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:37.397137 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:37.397137 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:37.397137 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:37.397137 np0000001583 nova-compute[98241]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:37.397137 np0000001583 nova-compute[98241]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:37.397137 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:01:37.397668 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.188s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:01:37.397668 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:01:37.399297 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:01:37.406619 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] HCTL ('12', '-', '-', 0) found on session 103 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:01:37.406815 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:01:37.412668 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfc05152-7d36-4b7b-85e9-f875c4c30efa (non-flash)
May 28 02:01:37.412668 np0000001583 nova-compute[98241]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451 (non-flash)
May 28 02:01:37.412668 np0000001583 nova-compute[98241]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451 (non-flash)
May 28 02:01:37.412668 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:37.412668 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:37.412668 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:37.412668 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:37.412668 np0000001583 nova-compute[98241]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:37.412668 np0000001583 nova-compute[98241]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:37.412668 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:01:37.413214 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfc05152-7d36-4b7b-85e9-f875c4c30efa (non-flash)
May 28 02:01:37.413214 np0000001583 nova-compute[98241]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451 (non-flash)
May 28 02:01:37.413214 np0000001583 nova-compute[98241]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451 (non-flash)
May 28 02:01:37.413214 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:37.413214 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:37.413214 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:37.413214 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:37.413214 np0000001583 nova-compute[98241]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:37.413214 np0000001583 nova-compute[98241]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:37.413214 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:01:37.416096 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.205s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:01:37.416096 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:01:37.416096 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] HCTL ('13', '-', '-', 0) found on session 104 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:01:37.416962 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:01:37.429563 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Searching for a device in session 103 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:01:37.429563 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e30ed0b1-bfc4-4e94-bbf6-9acb83638451', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:01:37.450857 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Searching for a device in session 104 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:01:37.451591 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e30ed0b1-bfc4-4e94-bbf6-9acb83638451', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:01:37.638263 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-4e4deea4-4b16-4711-95e8-56c45612cacb req-31625f7f-5a86-43cb-b138-069bb5166317 service nova] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Received event network-vif-deleted-0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:01:37.646439 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-4e4deea4-4b16-4711-95e8-56c45612cacb req-31625f7f-5a86-43cb-b138-069bb5166317 service nova] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Neutron deleted interface 0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b; detaching it from the instance and deleting it from the info cache
May 28 02:01:37.649304 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-4e4deea4-4b16-4711-95e8-56c45612cacb req-31625f7f-5a86-43cb-b138-069bb5166317 service nova] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Detach interface failed, port_id=0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b, reason: Instance d4fad20b-d51e-47c9-8f55-3aa085a10891 could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 02:01:37.732632 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lazy-loading 'flavor' on Instance uuid 01d8de67-23ab-4430-8512-d2fece776ac2 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:01:37.818400 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-cf15b2c5-a795-45e2-9980-0669a384a629 req-a8f417d0-7b6f-4874-af74-450137244482 service nova] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Received event network-vif-unplugged-0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:01:37.818599 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-cf15b2c5-a795-45e2-9980-0669a384a629 req-a8f417d0-7b6f-4874-af74-450137244482 service nova] Acquiring lock "d4fad20b-d51e-47c9-8f55-3aa085a10891-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:37.819263 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-cf15b2c5-a795-45e2-9980-0669a384a629 req-a8f417d0-7b6f-4874-af74-450137244482 service nova] Lock "d4fad20b-d51e-47c9-8f55-3aa085a10891-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:37.819409 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-cf15b2c5-a795-45e2-9980-0669a384a629 req-a8f417d0-7b6f-4874-af74-450137244482 service nova] Lock "d4fad20b-d51e-47c9-8f55-3aa085a10891-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:37.819566 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-cf15b2c5-a795-45e2-9980-0669a384a629 req-a8f417d0-7b6f-4874-af74-450137244482 service nova] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] No waiting events found dispatching network-vif-unplugged-0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:01:37.819710 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-cf15b2c5-a795-45e2-9980-0669a384a629 req-a8f417d0-7b6f-4874-af74-450137244482 service nova] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Received event network-vif-unplugged-0e39a69e-35c9-49f1-8c2b-9cf1603d1a3b for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:01:37.910330 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.602s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:37.910929 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 02:01:38.074985 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:01:38.209625 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 02:01:38.256111 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:38.407637 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Stashing vm_state: active {{(pid=98241) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 28 02:01:38.422164 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 02:01:38.422332 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 02:01:38.422601 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:38.422801 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:38.564844 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '816ff3d1a9244ea8b0c6430e232410e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528113b81f2f406da984d1a1fcf5962e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 02:01:38.576540 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Took 1.62 seconds to deallocate network for instance.
May 28 02:01:38.740451 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "01d8de67-23ab-4430-8512-d2fece776ac2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:38.828159 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:38.927026 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 02:01:38.963289 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:38.963825 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:39.082637 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f8b456cf-62fc-44eb-aef1-5473f84f5f11 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:39.191404 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Successfully created port: a33bea84-56b3-4c8c-8f1c-2c6481551f97 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 02:01:39.233709 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Found WWN 330000000fb78376c for multipath device dm-4 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 02:01:39.233963 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.043s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:01:39.234131 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] <== connect_volume: return (3043ms) {'type': 'block', 'scsi_wwn': '330000000fb78376c', 'path': '/dev/dm-4', 'multipath_id': '330000000fb78376c'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:01:39.234241 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000fb78376c', 'path': '/dev/dm-4', 'multipath_id': '330000000fb78376c'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 02:01:39.430784 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 02:01:39.473906 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 02:01:39.477147 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Claim successful on node np0000001583
May 28 02:01:39.719996 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Successfully updated port: a33bea84-56b3-4c8c-8f1c-2c6481551f97 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 02:01:39.740506 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:01:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-510246973',display_name='tempest-TestVolumeBootPattern-server-510246973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testvolumebootpattern-server-510246973',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='432aa1094ced436494def17a875aa8e1',ramdisk_id='',reservation_id='r-h0w63ohx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1031057169',owner_user_name='tempest-TestVolumeBootPattern-1031057169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:01:30Z,user_data=None,user_id='6be314b4eed642c3b2c72fe115860220',uuid=294538ef-cf08-4184-8bc2-96598456d113,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a37c53c-4096-4379-9e19-72530018c97b", "address": "fa:16:3e:73:91:0b", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a37c53c-40", "ovs_interfaceid": "8a37c53c-4096-4379-9e19-72530018c97b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 02:01:39.741040 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converting VIF {"id": "8a37c53c-4096-4379-9e19-72530018c97b", "address": "fa:16:3e:73:91:0b", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a37c53c-40", "ovs_interfaceid": "8a37c53c-4096-4379-9e19-72530018c97b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:01:39.741724 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:91:0b,bridge_name='br-int',has_traffic_filtering=True,id=8a37c53c-4096-4379-9e19-72530018c97b,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a37c53c-40') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:01:39.742225 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lazy-loading 'pci_devices' on Instance uuid 294538ef-cf08-4184-8bc2-96598456d113 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:01:39.833305 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "01d8de67-23ab-4430-8512-d2fece776ac2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:39.833507 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "01d8de67-23ab-4430-8512-d2fece776ac2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:39.833686 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Attaching volume c2a9b112-3d12-4e10-a315-8a8fb5ab92e3 to /dev/vdb
May 28 02:01:39.870451 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:01:39.883531 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 02:01:39.900317 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a52d91f3-e108-4d11-8ada-3371ca634f1d req-689c388f-6b8a-4724-8a1c-4c5186b43887 service nova] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Received event network-changed-a33bea84-56b3-4c8c-8f1c-2c6481551f97 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:01:39.900458 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a52d91f3-e108-4d11-8ada-3371ca634f1d req-689c388f-6b8a-4724-8a1c-4c5186b43887 service nova] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Refreshing instance network info cache due to event network-changed-a33bea84-56b3-4c8c-8f1c-2c6481551f97. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:01:39.900630 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a52d91f3-e108-4d11-8ada-3371ca634f1d req-689c388f-6b8a-4724-8a1c-4c5186b43887 service nova] Acquiring lock "refresh_cache-c165c9a8-be28-4efe-b671-4dcf9bedfbe4" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:01:39.900739 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a52d91f3-e108-4d11-8ada-3371ca634f1d req-689c388f-6b8a-4724-8a1c-4c5186b43887 service nova] Acquired lock "refresh_cache-c165c9a8-be28-4efe-b671-4dcf9bedfbe4" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:01:39.900885 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-a52d91f3-e108-4d11-8ada-3371ca634f1d req-689c388f-6b8a-4724-8a1c-4c5186b43887 service nova] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Refreshing network info cache for port a33bea84-56b3-4c8c-8f1c-2c6481551f97 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:01:39.909941 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:01:39.938303 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Booting with volume 57c666b1-2380-41ea-bf52-6ab6b2d10c75 at /dev/vda
May 28 02:01:39.956636 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 02:01:39.956920 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 02:01:39.972496 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 02:01:39.974202 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe48:7d7b', 'fe80::d0cf:7bff:fef9:3cc3', 'fe80::fc16:3eff:fed3:cd06', 'fe80::fc16:3eff:fedf:4521', 'fe80::fc16:3eff:fe57:9502', 'fe80::fc16:3eff:fede:aca2', 'fe80::ecb9:b7ff:fe00:dc63', 'fe80::fc16:3eff:fe76:c53f', 'fe80::fc16:3eff:fe1e:c373', 'fe80::9020:88ff:fe40:d02'] 
May 28 02:01:39.974380 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 02:01:39.974524 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 02:01:39.974816 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] <== get_connector_properties: return (104ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:01:39.975020 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Updating existing volume attachment record: 4149b62d-fbe4-49bd-92fe-ef83c6c92b70 {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 02:01:39.983420 np0000001583 nova-compute[98241]: INFO nova.compute.resource_tracker [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Updating resource usage from migration 7e6245d5-e475-47d6-abb2-2a3c1ecf39bf
May 28 02:01:40.016622 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:01:40.032569 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 02:01:40.063996 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:01:40.107975 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 02:01:40.109212 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 02:01:40.121905 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 02:01:40.123111 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe48:7d7b', 'fe80::d0cf:7bff:fef9:3cc3', 'fe80::fc16:3eff:fed3:cd06', 'fe80::fc16:3eff:fedf:4521', 'fe80::fc16:3eff:fe57:9502', 'fe80::fc16:3eff:fede:aca2', 'fe80::ecb9:b7ff:fe00:dc63', 'fe80::fc16:3eff:fe76:c53f', 'fe80::fc16:3eff:fe1e:c373', 'fe80::9020:88ff:fe40:d02'] 
May 28 02:01:40.123252 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 02:01:40.123372 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 02:01:40.123596 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] <== get_connector_properties: return (106ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:01:40.123792 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Updating existing volume attachment record: 31708fbc-91e9-41b7-ad62-37226b54b89a {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 02:01:40.224577 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Acquiring lock "refresh_cache-c165c9a8-be28-4efe-b671-4dcf9bedfbe4" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:01:40.245798 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 294538ef-cf08-4184-8bc2-96598456d113] End _get_guest_xml xml=<domain type="qemu">
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:   <uuid>294538ef-cf08-4184-8bc2-96598456d113</uuid>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:   <name>instance-0000002d</name>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:   <metadata>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:       <nova:name>tempest-TestVolumeBootPattern-server-510246973</nova:name>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 02:01:36</nova:creationTime>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:       <nova:image uuid="">
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:       </nova:image>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:         <nova:user uuid="6be314b4eed642c3b2c72fe115860220">tempest-TestVolumeBootPattern-1031057169-project-member</nova:user>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:         <nova:project uuid="432aa1094ced436494def17a875aa8e1">tempest-TestVolumeBootPattern-1031057169</nova:project>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:       <nova:root type="volume" uuid=""/>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:         <nova:port uuid="8a37c53c-4096-4379-9e19-72530018c97b">
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:         </nova:port>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:   </metadata>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:     <system>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:       <entry name="serial">294538ef-cf08-4184-8bc2-96598456d113</entry>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:       <entry name="uuid">294538ef-cf08-4184-8bc2-96598456d113</entry>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:     </system>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:   <os>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:   </os>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:   <features>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:     <acpi/>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:     <tcg>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:     </tcg>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:   </features>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:   </cpu>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:   <devices>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/294538ef-cf08-4184-8bc2-96598456d113/disk.config"/>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:     </disk>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:     <disk type="block" device="disk">
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:       <alias name="ua-e30ed0b1-bfc4-4e94-bbf6-9acb83638451"/>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:       <source dev="/dev/dm-4"/>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:       <serial>e30ed0b1-bfc4-4e94-bbf6-9acb83638451</serial>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:     </disk>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:73:91:0b"/>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:       <target dev="tap8a37c53c-40"/>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:     </interface>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/294538ef-cf08-4184-8bc2-96598456d113/console.log" append="off"/>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:     </serial>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:     <video>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:     </video>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:     </rng>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:     </memballoon>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:   </devices>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]: </domain>
May 28 02:01:40.245798 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 02:01:40.247785 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Preparing to wait for external event network-vif-plugged-8a37c53c-4096-4379-9e19-72530018c97b {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 02:01:40.247785 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "294538ef-cf08-4184-8bc2-96598456d113-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:40.247785 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "294538ef-cf08-4184-8bc2-96598456d113-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:40.247785 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "294538ef-cf08-4184-8bc2-96598456d113-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:40.248239 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:01:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-510246973',display_name='tempest-TestVolumeBootPattern-server-510246973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testvolumebootpattern-server-510246973',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='432aa1094ced436494def17a875aa8e1',ramdisk_id='',reservation_id='r-h0w63ohx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1031057169',owner_user_name='tempest-TestVolumeBootPattern-1031057169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:01:30Z,user_data=None,user_id='6be314b4eed642c3b2c72fe115860220',uuid=294538ef-cf08-4184-8bc2-96598456d113,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a37c53c-4096-4379-9e19-72530018c97b", "address": "fa:16:3e:73:91:0b", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a37c53c-40", "ovs_interfaceid": "8a37c53c-4096-4379-9e19-72530018c97b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 02:01:40.248515 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converting VIF {"id": "8a37c53c-4096-4379-9e19-72530018c97b", "address": "fa:16:3e:73:91:0b", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a37c53c-40", "ovs_interfaceid": "8a37c53c-4096-4379-9e19-72530018c97b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:01:40.249407 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:91:0b,bridge_name='br-int',has_traffic_filtering=True,id=8a37c53c-4096-4379-9e19-72530018c97b,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a37c53c-40') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:01:40.249678 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:91:0b,bridge_name='br-int',has_traffic_filtering=True,id=8a37c53c-4096-4379-9e19-72530018c97b,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a37c53c-40') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 02:01:40.250093 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:40.250442 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:01:40.250722 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 02:01:40.251595 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:40.251757 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fe67640f-061d-5ade-a0b1-0522067f98ab', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:01:40.252843 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:40.253921 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:01:40.260245 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:40.260426 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a37c53c-40, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:01:40.260787 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8a37c53c-40, col_values=(('qos', UUID('65075866-54ff-466b-adf9-089fb185cc4e')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:01:40.264349 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8a37c53c-40, col_values=(('external_ids', {'iface-id': '8a37c53c-4096-4379-9e19-72530018c97b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:91:0b', 'vm-uuid': '294538ef-cf08-4184-8bc2-96598456d113'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:01:40.265902 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:40.266905 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:01:40.272459 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:40.273402 np0000001583 nova-compute[98241]: INFO os_vif [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:91:0b,bridge_name='br-int',has_traffic_filtering=True,id=8a37c53c-4096-4379-9e19-72530018c97b,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a37c53c-40')
May 28 02:01:40.403492 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-a52d91f3-e108-4d11-8ada-3371ca634f1d req-689c388f-6b8a-4724-8a1c-4c5186b43887 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:40.477161 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-a52d91f3-e108-4d11-8ada-3371ca634f1d req-689c388f-6b8a-4724-8a1c-4c5186b43887 service nova] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:01:40.571350 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 02:01:40.571761 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3', 'iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c2a9b112-3d12-4e10-a315-8a8fb5ab92e3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:01:40.571929 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:01:40.572407 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:01:40.572645 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3', 'iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c2a9b112-3d12-4e10-a315-8a8fb5ab92e3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 02:01:40.592151 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:01:40.592559 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:01:40.592753 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:01:40.593562 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:01:40.594941 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:01:40.594941 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:01:40.610386 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:01:40.610386 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:40.618386 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:01:40.618386 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:40.629313 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3] added
May 28 02:01:40.629313 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:01:40.629313 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:01:40.629313 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:01:40.629313 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:01:40.629313 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:01:40.629313 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:40.629588 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:01:40.629890 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.037(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:01:40.630158 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:01:40.633446 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3] added
May 28 02:01:40.633446 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:01:40.633446 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:01:40.633446 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:01:40.633446 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:01:40.633446 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:01:40.633446 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:40.633446 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:01:40.633446 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0384(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:01:40.633446 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:01:40.669042 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-a52d91f3-e108-4d11-8ada-3371ca634f1d req-689c388f-6b8a-4724-8a1c-4c5186b43887 service nova] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:01:40.740711 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:01:40.741172 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:01:41.171479 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a52d91f3-e108-4d11-8ada-3371ca634f1d req-689c388f-6b8a-4724-8a1c-4c5186b43887 service nova] Releasing lock "refresh_cache-c165c9a8-be28-4efe-b671-4dcf9bedfbe4" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:01:41.171877 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Acquired lock "refresh_cache-c165c9a8-be28-4efe-b671-4dcf9bedfbe4" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:01:41.172033 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:01:41.244199 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:01:41.630747 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:01:41.633947 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:01:41.647892 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:01:41.647892 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:01:41.652588 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:01:41.652588 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:41.668637 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:41.673724 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:41.686349 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfc05152-7d36-4b7b-85e9-f875c4c30efa (non-flash)
May 28 02:01:41.686349 np0000001583 nova-compute[98241]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451 (non-flash)
May 28 02:01:41.686349 np0000001583 nova-compute[98241]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451 (non-flash)
May 28 02:01:41.686349 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:41.686349 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:41.686349 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:41.686349 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:41.686349 np0000001583 nova-compute[98241]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:41.686349 np0000001583 nova-compute[98241]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:41.686349 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:01:41.686632 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfc05152-7d36-4b7b-85e9-f875c4c30efa (non-flash)
May 28 02:01:41.686632 np0000001583 nova-compute[98241]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451 (non-flash)
May 28 02:01:41.686632 np0000001583 nova-compute[98241]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451 (non-flash)
May 28 02:01:41.686632 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:41.686632 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:41.686632 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:41.686632 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:41.686632 np0000001583 nova-compute[98241]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:41.686632 np0000001583 nova-compute[98241]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:41.686632 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:01:41.696835 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfc05152-7d36-4b7b-85e9-f875c4c30efa (non-flash)
May 28 02:01:41.696835 np0000001583 nova-compute[98241]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451 (non-flash)
May 28 02:01:41.696835 np0000001583 nova-compute[98241]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451 (non-flash)
May 28 02:01:41.696835 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:41.696835 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:41.696835 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:41.696835 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:41.696835 np0000001583 nova-compute[98241]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:41.696835 np0000001583 nova-compute[98241]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:41.696835 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:01:41.696835 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfc05152-7d36-4b7b-85e9-f875c4c30efa (non-flash)
May 28 02:01:41.696835 np0000001583 nova-compute[98241]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451 (non-flash)
May 28 02:01:41.696835 np0000001583 nova-compute[98241]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451 (non-flash)
May 28 02:01:41.696835 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:41.696835 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:41.696835 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:41.696835 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:41.696835 np0000001583 nova-compute[98241]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:41.696835 np0000001583 nova-compute[98241]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:41.696835 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:01:41.725635 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3, portal: 192.168.40.100,3260]
May 28 02:01:41.725635 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3, portal: 192.168.40.100,3260] successful.
May 28 02:01:41.725635 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:41.743838 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:41.751535 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.788s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:41.751774 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Migrating
May 28 02:01:41.752051 np0000001583 nova-compute[98241]: DEBUG nova.compute.rpcapi [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98241) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 02:01:41.759087 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f8b456cf-62fc-44eb-aef1-5473f84f5f11 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.676s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:41.760113 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3, portal: 192.168.50.100,3260]
May 28 02:01:41.760113 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3, portal: 192.168.50.100,3260] successful.
May 28 02:01:41.760113 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:41.781161 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:01:41.789009 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfc05152-7d36-4b7b-85e9-f875c4c30efa (non-flash)
May 28 02:01:41.789009 np0000001583 nova-compute[98241]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451 (non-flash)
May 28 02:01:41.789009 np0000001583 nova-compute[98241]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451 (non-flash)
May 28 02:01:41.789009 np0000001583 nova-compute[98241]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3 (non-flash)
May 28 02:01:41.789009 np0000001583 nova-compute[98241]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3 (non-flash)
May 28 02:01:41.789009 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:41.789009 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:41.789009 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:41.789009 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:41.789009 np0000001583 nova-compute[98241]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:41.789009 np0000001583 nova-compute[98241]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:41.789009 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:01:41.789295 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfc05152-7d36-4b7b-85e9-f875c4c30efa (non-flash)
May 28 02:01:41.789295 np0000001583 nova-compute[98241]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451 (non-flash)
May 28 02:01:41.789295 np0000001583 nova-compute[98241]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451 (non-flash)
May 28 02:01:41.789295 np0000001583 nova-compute[98241]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3 (non-flash)
May 28 02:01:41.789295 np0000001583 nova-compute[98241]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3 (non-flash)
May 28 02:01:41.789295 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:41.789295 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:41.789295 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:41.789295 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:41.789295 np0000001583 nova-compute[98241]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:41.789295 np0000001583 nova-compute[98241]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:41.789295 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:01:41.789594 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.197s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:01:41.789709 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:01:41.793396 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:41.810913 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:01:41.811257 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:01:41.811424 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] No VIF found with MAC fa:16:3e:73:91:0b, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:01:41.813057 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Using config drive
May 28 02:01:41.818137 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfc05152-7d36-4b7b-85e9-f875c4c30efa (non-flash)
May 28 02:01:41.818137 np0000001583 nova-compute[98241]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451 (non-flash)
May 28 02:01:41.818137 np0000001583 nova-compute[98241]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451 (non-flash)
May 28 02:01:41.818137 np0000001583 nova-compute[98241]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3 (non-flash)
May 28 02:01:41.818137 np0000001583 nova-compute[98241]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3 (non-flash)
May 28 02:01:41.818137 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:41.818137 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:41.818137 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:41.818137 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:41.818137 np0000001583 nova-compute[98241]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:41.818137 np0000001583 nova-compute[98241]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:41.818137 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:01:41.818510 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfc05152-7d36-4b7b-85e9-f875c4c30efa (non-flash)
May 28 02:01:41.818510 np0000001583 nova-compute[98241]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451 (non-flash)
May 28 02:01:41.818510 np0000001583 nova-compute[98241]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451 (non-flash)
May 28 02:01:41.818510 np0000001583 nova-compute[98241]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3 (non-flash)
May 28 02:01:41.818510 np0000001583 nova-compute[98241]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3 (non-flash)
May 28 02:01:41.818510 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:41.818510 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:41.818510 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:41.818510 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:41.818510 np0000001583 nova-compute[98241]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:41.818510 np0000001583 nova-compute[98241]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:41.818510 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:01:41.819025 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.225s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:01:41.819250 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:01:41.821355 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] HCTL ('14', '-', '-', 0) found on session 105 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:01:41.821896 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:01:41.824471 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] HCTL ('16', '-', '-', 0) found on session 106 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:01:41.824614 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:01:41.849484 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Searching for a device in session 105 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:01:41.849484 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c2a9b112-3d12-4e10-a315-8a8fb5ab92e3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:01:41.857324 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Searching for a device in session 106 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:01:41.857605 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c2a9b112-3d12-4e10-a315-8a8fb5ab92e3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:01:42.056968 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:42.243878 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 02:01:42.244832 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 02:01:42.245109 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Creating image(s)
May 28 02:01:42.245379 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Did not create local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 02:01:42.245496 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Ensure instance console log exists: /opt/stack/data/nova/instances/c165c9a8-be28-4efe-b671-4dcf9bedfbe4/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 02:01:42.245765 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:42.245956 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:42.246075 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:42.261022 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Updating instance_info_cache with network_info: [{"id": "a33bea84-56b3-4c8c-8f1c-2c6481551f97", "address": "fa:16:3e:84:ce:c4", "network": {"id": "c60710fd-eeb6-4948-8a84-8b95cae31191", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6b98ce7597d45a6b839c720f99fa1e9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa33bea84-56", "ovs_interfaceid": "a33bea84-56b3-4c8c-8f1c-2c6481551f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:01:42.316696 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "refresh_cache-21c4e225-440e-4103-adaf-cb470d172291" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:01:42.316984 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquired lock "refresh_cache-21c4e225-440e-4103-adaf-cb470d172291" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:01:42.317143 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:01:42.324666 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:42.385008 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-77d48865-5418-4d2b-a23b-dfab68811a6f tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Acquiring lock "c6e87c0e-02e1-4941-8f2f-b969b93ebf9f" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:42.385008 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-77d48865-5418-4d2b-a23b-dfab68811a6f tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "c6e87c0e-02e1-4941-8f2f-b969b93ebf9f" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:42.385008 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-77d48865-5418-4d2b-a23b-dfab68811a6f tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Rebooting instance
May 28 02:01:42.484756 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Creating config drive at /opt/stack/data/nova/instances/294538ef-cf08-4184-8bc2-96598456d113/disk.config
May 28 02:01:42.489110 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/294538ef-cf08-4184-8bc2-96598456d113/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpr_nm2i8t {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:01:42.565598 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/294538ef-cf08-4184-8bc2-96598456d113/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpr_nm2i8t" returned: 0 in 0.076s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:01:42.595787 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f8b456cf-62fc-44eb-aef1-5473f84f5f11 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:01:42.596365 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 02:01:42.596598 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-f8b456cf-62fc-44eb-aef1-5473f84f5f11 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:01:42.763588 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Releasing lock "refresh_cache-c165c9a8-be28-4efe-b671-4dcf9bedfbe4" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:01:42.764167 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Instance network_info: |[{"id": "a33bea84-56b3-4c8c-8f1c-2c6481551f97", "address": "fa:16:3e:84:ce:c4", "network": {"id": "c60710fd-eeb6-4948-8a84-8b95cae31191", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6b98ce7597d45a6b839c720f99fa1e9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa33bea84-56", "ovs_interfaceid": "a33bea84-56b3-4c8c-8f1c-2c6481551f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 02:01:42.765068 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Start _get_guest_xml network_info=[{"id": "a33bea84-56b3-4c8c-8f1c-2c6481551f97", "address": "fa:16:3e:84:ce:c4", "network": {"id": "c60710fd-eeb6-4948-8a84-8b95cae31191", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6b98ce7597d45a6b839c720f99fa1e9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa33bea84-56", "ovs_interfaceid": "a33bea84-56b3-4c8c-8f1c-2c6481551f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75', 'iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '57c666b1-2380-41ea-bf52-6ab6b2d10c75', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'c165c9a8-be28-4efe-b671-4dcf9bedfbe4', 'attached_at': '', 'detached_at': '', 'volume_id': '57c666b1-2380-41ea-bf52-6ab6b2d10c75', 'serial': '57c666b1-2380-41ea-bf52-6ab6b2d10c75'}, 'delete_on_termination': True, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '31708fbc-91e9-41b7-ad62-37226b54b89a', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 02:01:42.770116 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:01:42.771402 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='instance-depend-image', uuid='c165c9a8-be28-4efe-b671-4dcf9bedfbe4'), owner=OwnerMeta(userid='816ff3d1a9244ea8b0c6430e232410e9', username='tempest-ImageDependencyTests-349245414-project-member', projectid='528113b81f2f406da984d1a1fcf5962e', projectname='tempest-ImageDependencyTests-349245414'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a33bea84-56b3-4c8c-8f1c-2c6481551f97", "address": "fa:16:3e:84:ce:c4", "network": {"id": "c60710fd-eeb6-4948-8a84-8b95cae31191", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6b98ce7597d45a6b839c720f99fa1e9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa33bea84-56", "ovs_interfaceid": "a33bea84-56b3-4c8c-8f1c-2c6481551f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933702.770918) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 02:01:42.774579 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 02:01:42.774900 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 02:01:42.776102 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 02:01:42.776349 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 02:01:42.777352 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 02:01:42.777643 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 02:01:42.777812 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 02:01:42.777901 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 02:01:42.778035 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 02:01:42.778139 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 02:01:42.778249 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 02:01:42.778404 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 02:01:42.778503 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 02:01:42.778613 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 02:01:42.778760 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 02:01:42.778996 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 02:01:42.789768 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 02:01:42.790164 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75', 'iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '57c666b1-2380-41ea-bf52-6ab6b2d10c75', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:01:42.790404 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:01:42.819619 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:42.960190 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-77d48865-5418-4d2b-a23b-dfab68811a6f tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Acquiring lock "refresh_cache-c6e87c0e-02e1-4941-8f2f-b969b93ebf9f" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:01:42.960190 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-77d48865-5418-4d2b-a23b-dfab68811a6f tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Acquired lock "refresh_cache-c6e87c0e-02e1-4941-8f2f-b969b93ebf9f" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:01:42.960190 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-77d48865-5418-4d2b-a23b-dfab68811a6f tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:01:42.998106 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:43.031853 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:43.033292 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:43.100018 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-f8b456cf-62fc-44eb-aef1-5473f84f5f11 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:01:43.135825 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:43.237465 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:43.259460 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:43.309370 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-86a3dad1-81a9-440b-aa60-640ad17ffd74 req-83a5f6a9-aa22-4384-8504-ade9f9434675 service nova] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Received event network-vif-plugged-8a37c53c-4096-4379-9e19-72530018c97b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:01:43.309501 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-86a3dad1-81a9-440b-aa60-640ad17ffd74 req-83a5f6a9-aa22-4384-8504-ade9f9434675 service nova] Acquiring lock "294538ef-cf08-4184-8bc2-96598456d113-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:43.309660 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-86a3dad1-81a9-440b-aa60-640ad17ffd74 req-83a5f6a9-aa22-4384-8504-ade9f9434675 service nova] Lock "294538ef-cf08-4184-8bc2-96598456d113-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:43.309801 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-86a3dad1-81a9-440b-aa60-640ad17ffd74 req-83a5f6a9-aa22-4384-8504-ade9f9434675 service nova] Lock "294538ef-cf08-4184-8bc2-96598456d113-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:43.309919 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-86a3dad1-81a9-440b-aa60-640ad17ffd74 req-83a5f6a9-aa22-4384-8504-ade9f9434675 service nova] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Processing event network-vif-plugged-8a37c53c-4096-4379-9e19-72530018c97b {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 02:01:43.422241 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:43.428028 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:43.429859 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:43.455870 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:43.469339 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-77d48865-5418-4d2b-a23b-dfab68811a6f tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:43.505674 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Updating instance_info_cache with network_info: [{"id": "5e52242f-77f4-41cc-ae8f-6a4772243727", "address": "fa:16:3e:57:95:02", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e52242f-77", "ovs_interfaceid": "5e52242f-77f4-41cc-ae8f-6a4772243727", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:01:43.612365 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f8b456cf-62fc-44eb-aef1-5473f84f5f11 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.852s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:43.621310 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Found WWN 33000000073e895c6 for multipath device dm-7 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 02:01:43.621633 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.049s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:01:43.621783 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] <== connect_volume: return (3050ms) {'type': 'block', 'scsi_wwn': '33000000073e895c6', 'path': '/dev/dm-7', 'multipath_id': '33000000073e895c6'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:01:43.622044 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000073e895c6', 'path': '/dev/dm-7', 'multipath_id': '33000000073e895c6'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 02:01:43.622303 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.832s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:01:43.622583 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75', 'iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '57c666b1-2380-41ea-bf52-6ab6b2d10c75', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 02:01:43.629638 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lazy-loading 'flavor' on Instance uuid 01d8de67-23ab-4430-8512-d2fece776ac2 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:01:43.638370 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:01:43.638370 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:01:43.638899 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:01:43.639242 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:01:43.643106 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:01:43.644486 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:01:43.652661 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:01:43.652661 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:43.662609 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:01:43.662609 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:43.673571 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75] added
May 28 02:01:43.673571 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:01:43.673571 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:01:43.673571 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:01:43.673571 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:01:43.673571 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:01:43.673571 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:43.673571 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:01:43.673571 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0338(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:01:43.673571 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:01:43.674361 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75] added
May 28 02:01:43.674361 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:01:43.674361 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:01:43.674361 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:01:43.674361 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:01:43.674361 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:01:43.674361 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:43.674361 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:01:43.674594 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.03(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:01:43.674594 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:01:43.697095 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-f8b456cf-62fc-44eb-aef1-5473f84f5f11 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Deleted allocations for instance d4fad20b-d51e-47c9-8f55-3aa085a10891
May 28 02:01:43.894688 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-77d48865-5418-4d2b-a23b-dfab68811a6f tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:44.008055 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Releasing lock "refresh_cache-21c4e225-440e-4103-adaf-cb470d172291" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:01:44.018457 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 02:01:44.019708 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933704.0186758, 294538ef-cf08-4184-8bc2-96598456d113 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:01:44.022070 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 294538ef-cf08-4184-8bc2-96598456d113] VM Started (Lifecycle Event)
May 28 02:01:44.025032 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 02:01:44.030488 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Instance spawned successfully.
May 28 02:01:44.030868 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 02:01:44.073447 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-77d48865-5418-4d2b-a23b-dfab68811a6f tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Updating instance_info_cache with network_info: [{"id": "18842969-e82f-4389-a30f-f5054a50d115", "address": "fa:16:3e:1e:c3:73", "network": {"id": "c18d43cf-482c-4814-96a1-09aab2287be4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2071326233-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d5cfe906dd24a10819b92c144f7f06f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap18842969-e8", "ovs_interfaceid": "18842969-e82f-4389-a30f-f5054a50d115", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:01:44.133036 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Attempting to attach volume c2a9b112-3d12-4e10-a315-8a8fb5ab92e3 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98241) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 02:01:44.134589 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] attach device xml: <disk type="block" device="disk">
May 28 02:01:44.134589 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:01:44.134589 np0000001583 nova-compute[98241]:   <alias name="ua-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3"/>
May 28 02:01:44.134589 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-7"/>
May 28 02:01:44.134589 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:01:44.134589 np0000001583 nova-compute[98241]:   <serial>c2a9b112-3d12-4e10-a315-8a8fb5ab92e3</serial>
May 28 02:01:44.134589 np0000001583 nova-compute[98241]: </disk>
May 28 02:01:44.134589 np0000001583 nova-compute[98241]:  {{(pid=98241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 02:01:44.525641 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:01:44.531821 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:01:44.543913 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:01:44.544198 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:01:44.544968 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:01:44.545379 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:01:44.545704 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:01:44.546233 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:01:44.576181 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-77d48865-5418-4d2b-a23b-dfab68811a6f tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Releasing lock "refresh_cache-c6e87c0e-02e1-4941-8f2f-b969b93ebf9f" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:01:44.673744 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:01:44.674980 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:01:44.694053 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:01:44.694053 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:01:44.710301 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:01:44.710301 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:44.713051 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f8b456cf-62fc-44eb-aef1-5473f84f5f11 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "d4fad20b-d51e-47c9-8f55-3aa085a10891" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.689s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:44.713456 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:44.738560 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:44.739546 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfc05152-7d36-4b7b-85e9-f875c4c30efa (non-flash)
May 28 02:01:44.739546 np0000001583 nova-compute[98241]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451 (non-flash)
May 28 02:01:44.739546 np0000001583 nova-compute[98241]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451 (non-flash)
May 28 02:01:44.739546 np0000001583 nova-compute[98241]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3 (non-flash)
May 28 02:01:44.739546 np0000001583 nova-compute[98241]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3 (non-flash)
May 28 02:01:44.739546 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:44.739546 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:44.739546 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:44.739546 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:44.739546 np0000001583 nova-compute[98241]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:44.739546 np0000001583 nova-compute[98241]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:44.739546 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:01:44.739945 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfc05152-7d36-4b7b-85e9-f875c4c30efa (non-flash)
May 28 02:01:44.739945 np0000001583 nova-compute[98241]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451 (non-flash)
May 28 02:01:44.739945 np0000001583 nova-compute[98241]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451 (non-flash)
May 28 02:01:44.739945 np0000001583 nova-compute[98241]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3 (non-flash)
May 28 02:01:44.739945 np0000001583 nova-compute[98241]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3 (non-flash)
May 28 02:01:44.739945 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:44.739945 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:44.739945 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:44.739945 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:44.739945 np0000001583 nova-compute[98241]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:44.739945 np0000001583 nova-compute[98241]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:44.739945 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:01:44.758440 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfc05152-7d36-4b7b-85e9-f875c4c30efa (non-flash)
May 28 02:01:44.758440 np0000001583 nova-compute[98241]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451 (non-flash)
May 28 02:01:44.758440 np0000001583 nova-compute[98241]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451 (non-flash)
May 28 02:01:44.758440 np0000001583 nova-compute[98241]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3 (non-flash)
May 28 02:01:44.758440 np0000001583 nova-compute[98241]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3 (non-flash)
May 28 02:01:44.758440 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:44.758440 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:44.758440 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:44.758440 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:44.758440 np0000001583 nova-compute[98241]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:44.758440 np0000001583 nova-compute[98241]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:44.758440 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:01:44.758755 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfc05152-7d36-4b7b-85e9-f875c4c30efa (non-flash)
May 28 02:01:44.758755 np0000001583 nova-compute[98241]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451 (non-flash)
May 28 02:01:44.758755 np0000001583 nova-compute[98241]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451 (non-flash)
May 28 02:01:44.758755 np0000001583 nova-compute[98241]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3 (non-flash)
May 28 02:01:44.758755 np0000001583 nova-compute[98241]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3 (non-flash)
May 28 02:01:44.758755 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:44.758755 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:44.758755 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:44.758755 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:44.758755 np0000001583 nova-compute[98241]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:44.758755 np0000001583 nova-compute[98241]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:44.758755 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:01:44.808927 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75, portal: 192.168.40.100,3260]
May 28 02:01:44.808927 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75, portal: 192.168.40.100,3260] successful.
May 28 02:01:44.808927 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:44.822989 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:44.823767 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75, portal: 192.168.50.100,3260]
May 28 02:01:44.823767 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75, portal: 192.168.50.100,3260] successful.
May 28 02:01:44.823767 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:44.840979 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:44.851192 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfc05152-7d36-4b7b-85e9-f875c4c30efa (non-flash)
May 28 02:01:44.851192 np0000001583 nova-compute[98241]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451 (non-flash)
May 28 02:01:44.851192 np0000001583 nova-compute[98241]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451 (non-flash)
May 28 02:01:44.851192 np0000001583 nova-compute[98241]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3 (non-flash)
May 28 02:01:44.851192 np0000001583 nova-compute[98241]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3 (non-flash)
May 28 02:01:44.851192 np0000001583 nova-compute[98241]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75 (non-flash)
May 28 02:01:44.851192 np0000001583 nova-compute[98241]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75 (non-flash)
May 28 02:01:44.851192 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:44.851192 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:44.851192 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:44.851192 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:44.851192 np0000001583 nova-compute[98241]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:44.851192 np0000001583 nova-compute[98241]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:44.851192 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:01:44.851607 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfc05152-7d36-4b7b-85e9-f875c4c30efa (non-flash)
May 28 02:01:44.851607 np0000001583 nova-compute[98241]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451 (non-flash)
May 28 02:01:44.851607 np0000001583 nova-compute[98241]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451 (non-flash)
May 28 02:01:44.851607 np0000001583 nova-compute[98241]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3 (non-flash)
May 28 02:01:44.851607 np0000001583 nova-compute[98241]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3 (non-flash)
May 28 02:01:44.851607 np0000001583 nova-compute[98241]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75 (non-flash)
May 28 02:01:44.851607 np0000001583 nova-compute[98241]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75 (non-flash)
May 28 02:01:44.851607 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:44.851607 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:44.851607 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:44.851607 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:44.851607 np0000001583 nova-compute[98241]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:44.851607 np0000001583 nova-compute[98241]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:44.851607 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:01:44.851933 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.213s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:01:44.851933 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:01:44.853228 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] HCTL ('17', '-', '-', 0) found on session 107 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:01:44.853390 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:01:44.861204 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfc05152-7d36-4b7b-85e9-f875c4c30efa (non-flash)
May 28 02:01:44.861204 np0000001583 nova-compute[98241]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451 (non-flash)
May 28 02:01:44.861204 np0000001583 nova-compute[98241]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451 (non-flash)
May 28 02:01:44.861204 np0000001583 nova-compute[98241]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3 (non-flash)
May 28 02:01:44.861204 np0000001583 nova-compute[98241]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3 (non-flash)
May 28 02:01:44.861204 np0000001583 nova-compute[98241]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75 (non-flash)
May 28 02:01:44.861204 np0000001583 nova-compute[98241]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75 (non-flash)
May 28 02:01:44.861204 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:44.861204 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:44.861204 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:44.861204 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:44.861204 np0000001583 nova-compute[98241]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:44.861204 np0000001583 nova-compute[98241]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:44.861204 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:01:44.861701 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfc05152-7d36-4b7b-85e9-f875c4c30efa (non-flash)
May 28 02:01:44.861701 np0000001583 nova-compute[98241]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451 (non-flash)
May 28 02:01:44.861701 np0000001583 nova-compute[98241]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451 (non-flash)
May 28 02:01:44.861701 np0000001583 nova-compute[98241]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3 (non-flash)
May 28 02:01:44.861701 np0000001583 nova-compute[98241]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3 (non-flash)
May 28 02:01:44.861701 np0000001583 nova-compute[98241]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75 (non-flash)
May 28 02:01:44.861701 np0000001583 nova-compute[98241]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75 (non-flash)
May 28 02:01:44.861701 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:44.861701 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:44.861701 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:44.861701 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:44.861701 np0000001583 nova-compute[98241]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:44.861701 np0000001583 nova-compute[98241]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:44.861701 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:01:44.861701 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.221s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:01:44.862287 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:01:44.862939 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] HCTL ('18', '-', '-', 0) found on session 108 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:01:44.863039 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:01:44.871367 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Searching for a device in session 107 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:01:44.871367 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '57c666b1-2380-41ea-bf52-6ab6b2d10c75', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:01:44.881797 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Searching for a device in session 108 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:01:44.881797 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '57c666b1-2380-41ea-bf52-6ab6b2d10c75', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:01:45.037710 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 294538ef-cf08-4184-8bc2-96598456d113] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 02:01:45.038257 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933705.037781, 294538ef-cf08-4184-8bc2-96598456d113 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:01:45.038257 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 294538ef-cf08-4184-8bc2-96598456d113] VM Paused (Lifecycle Event)
May 28 02:01:45.055510 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Took 8.89 seconds to spawn the instance on the hypervisor.
May 28 02:01:45.057037 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:01:45.080186 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-77d48865-5418-4d2b-a23b-dfab68811a6f tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:01:45.265314 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:45.381807 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a69a9c1d-0e19-4eb7-a0a5-2bb50fa971dc req-f013299b-1659-451e-8c87-2013381d4e26 service nova] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Received event network-vif-plugged-8a37c53c-4096-4379-9e19-72530018c97b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:01:45.381995 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a69a9c1d-0e19-4eb7-a0a5-2bb50fa971dc req-f013299b-1659-451e-8c87-2013381d4e26 service nova] Acquiring lock "294538ef-cf08-4184-8bc2-96598456d113-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:45.382241 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a69a9c1d-0e19-4eb7-a0a5-2bb50fa971dc req-f013299b-1659-451e-8c87-2013381d4e26 service nova] Lock "294538ef-cf08-4184-8bc2-96598456d113-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:45.382398 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a69a9c1d-0e19-4eb7-a0a5-2bb50fa971dc req-f013299b-1659-451e-8c87-2013381d4e26 service nova] Lock "294538ef-cf08-4184-8bc2-96598456d113-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:45.382546 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a69a9c1d-0e19-4eb7-a0a5-2bb50fa971dc req-f013299b-1659-451e-8c87-2013381d4e26 service nova] [instance: 294538ef-cf08-4184-8bc2-96598456d113] No waiting events found dispatching network-vif-plugged-8a37c53c-4096-4379-9e19-72530018c97b {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:01:45.382710 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-a69a9c1d-0e19-4eb7-a0a5-2bb50fa971dc req-f013299b-1659-451e-8c87-2013381d4e26 service nova] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Received unexpected event network-vif-plugged-8a37c53c-4096-4379-9e19-72530018c97b for instance with vm_state active and task_state None.
May 28 02:01:45.523194 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Starting migrate_disk_and_power_off {{(pid=98241) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 28 02:01:45.541202 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:01:45.544054 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933705.5437214, 294538ef-cf08-4184-8bc2-96598456d113 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:01:45.544343 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 294538ef-cf08-4184-8bc2-96598456d113] VM Resumed (Lifecycle Event)
May 28 02:01:45.546042 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:45.556552 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:45.572171 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Took 19.74 seconds to build instance.
May 28 02:01:45.575662 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:45.639961 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 02:01:45.752531 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:45.758925 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:45.809475 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:01:45.809701 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:01:45.809870 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:01:45.810031 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] No VIF found with MAC fa:16:3e:de:ac:a2, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:01:45.833058 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:45.868217 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:45.876093 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:45.892168 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Instance destroyed successfully.
May 28 02:01:45.892168 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T02:00:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='multiattach-server-1',id=42,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAP7CI9wuY8JR5OGc0CpqFzQg3rj7cqVgHC4sPYHH38XlmtTRa9WHg3S3WcIsSpd43tWEYYLHF1/yDpoSsozR5Hrjk+cgmLbTDwUHC3YheiC8VnlV/ymBtBFe0b8oxSz5w==',key_name='tempest-keypair-1713929294',keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:00:16Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0474090f4f2d4950b51bc317f4302266',ramdisk_id='',reservation_id='r-wetp7mrk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-857456921',owner_user_name='tempest-AttachVolumeMultiAttachTest-857456921-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:01:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cadb612e41314b06914d5f5f47570e98',uuid=21c4e225-440e-4103-adaf-cb470d172291,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e52242f-77f4-41cc-ae8f-6a4772243727", "address": "fa:16:3e:57:95:02", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "vif_mac": "fa:16:3e:57:95:02"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e52242f-77", "ovs_interfaceid": "5e52242f-77f4-41cc-ae8f-6a4772243727", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:01:45.892168 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Converting VIF {"id": "5e52242f-77f4-41cc-ae8f-6a4772243727", "address": "fa:16:3e:57:95:02", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "vif_mac": "fa:16:3e:57:95:02"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e52242f-77", "ovs_interfaceid": "5e52242f-77f4-41cc-ae8f-6a4772243727", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:01:45.892168 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:95:02,bridge_name='br-int',has_traffic_filtering=True,id=5e52242f-77f4-41cc-ae8f-6a4772243727,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e52242f-77') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:01:45.892777 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:95:02,bridge_name='br-int',has_traffic_filtering=True,id=5e52242f-77f4-41cc-ae8f-6a4772243727,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e52242f-77') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:01:45.895305 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:45.895694 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e52242f-77, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:01:45.897691 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:01:45.900367 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:45.900367 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b7d6b383-a28e-49ca-83a3-3a1f48d705e6) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:01:45.900819 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:45.901477 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:01:45.901986 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:45.904984 np0000001583 nova-compute[98241]: INFO os_vif [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:95:02,bridge_name='br-int',has_traffic_filtering=True,id=5e52242f-77f4-41cc-ae8f-6a4772243727,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e52242f-77')
May 28 02:01:46.048913 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:01:46.059877 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:46.060843 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:01:46.063318 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:46.073829 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "294538ef-cf08-4184-8bc2-96598456d113" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.256s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:46.244721 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:46.245973 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:46.482721 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Detected multiple connections on this host for volume: 2b9c7b2e-ce89-46a0-a020-361646147ba3, skipping target disconnect.
May 28 02:01:46.486491 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:01:46.566483 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999269982999976 future=<Future at 0x7724f8130e30 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:01:46.594307 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:01:46.597743 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:01:46.662180 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Found WWN 3300000005bda7df5 for multipath device dm-8 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 02:01:46.663163 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:01:46.663462 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] <== connect_volume: return (3872ms) {'type': 'block', 'scsi_wwn': '3300000005bda7df5', 'path': '/dev/dm-8', 'multipath_id': '3300000005bda7df5'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:01:46.663709 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000005bda7df5', 'path': '/dev/dm-8', 'multipath_id': '3300000005bda7df5'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 02:01:46.708251 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:01:46.709544 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] skipping disk /dev/dm-10 (vdb) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 02:01:46.709658 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291_resize/disk /opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/disk {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:01:46.817139 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CMD "cp -r /opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291_resize/disk /opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/disk" returned: 0 in 0.107s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:01:46.818744 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291_resize/disk.config /opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/disk.config {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:01:46.866889 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CMD "cp -r /opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291_resize/disk.config /opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/disk.config" returned: 0 in 0.049s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:01:46.867350 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291_resize/disk.info /opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/disk.info {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:01:46.925439 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CMD "cp -r /opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291_resize/disk.info /opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/disk.info" returned: 0 in 0.058s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:01:47.173874 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:01:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='instance-depend-image',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='528113b81f2f406da984d1a1fcf5962e',ramdisk_id='',reservation_id='r-310aobtx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ImageDependencyTests-349245414',owner_user_name='tempest-ImageDependencyTests-349245414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:01:39Z,user_data=None,user_id='816ff3d1a9244ea8b0c6430e232410e9',uuid=c165c9a8-be28-4efe-b671-4dcf9bedfbe4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a33bea84-56b3-4c8c-8f1c-2c6481551f97", "address": "fa:16:3e:84:ce:c4", "network": {"id": "c60710fd-eeb6-4948-8a84-8b95cae31191", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6b98ce7597d45a6b839c720f99fa1e9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa33bea84-56", "ovs_interfaceid": "a33bea84-56b3-4c8c-8f1c-2c6481551f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 02:01:47.174428 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Converting VIF {"id": "a33bea84-56b3-4c8c-8f1c-2c6481551f97", "address": "fa:16:3e:84:ce:c4", "network": {"id": "c60710fd-eeb6-4948-8a84-8b95cae31191", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6b98ce7597d45a6b839c720f99fa1e9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa33bea84-56", "ovs_interfaceid": "a33bea84-56b3-4c8c-8f1c-2c6481551f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:01:47.174893 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:ce:c4,bridge_name='br-int',has_traffic_filtering=True,id=a33bea84-56b3-4c8c-8f1c-2c6481551f97,network=Network(c60710fd-eeb6-4948-8a84-8b95cae31191),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa33bea84-56') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:01:47.175809 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Lazy-loading 'pci_devices' on Instance uuid c165c9a8-be28-4efe-b671-4dcf9bedfbe4 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:01:47.409553 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-fdc1cf03-9901-41bd-8278-b86fca30262a tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "01d8de67-23ab-4430-8512-d2fece776ac2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.576s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:47.452374 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-bd20b450-baf8-47af-81a5-087692307578 req-14dff572-27c7-402b-86ce-819547caf887 service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Received event network-vif-unplugged-5e52242f-77f4-41cc-ae8f-6a4772243727 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:01:47.452374 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bd20b450-baf8-47af-81a5-087692307578 req-14dff572-27c7-402b-86ce-819547caf887 service nova] Acquiring lock "21c4e225-440e-4103-adaf-cb470d172291-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:47.452374 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bd20b450-baf8-47af-81a5-087692307578 req-14dff572-27c7-402b-86ce-819547caf887 service nova] Lock "21c4e225-440e-4103-adaf-cb470d172291-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:47.452374 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bd20b450-baf8-47af-81a5-087692307578 req-14dff572-27c7-402b-86ce-819547caf887 service nova] Lock "21c4e225-440e-4103-adaf-cb470d172291-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:47.452533 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-bd20b450-baf8-47af-81a5-087692307578 req-14dff572-27c7-402b-86ce-819547caf887 service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] No waiting events found dispatching network-vif-unplugged-5e52242f-77f4-41cc-ae8f-6a4772243727 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:01:47.452533 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-bd20b450-baf8-47af-81a5-087692307578 req-14dff572-27c7-402b-86ce-819547caf887 service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Received unexpected event network-vif-unplugged-5e52242f-77f4-41cc-ae8f-6a4772243727 for instance with vm_state active and task_state resize_migrating.
May 28 02:01:47.452743 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-bd20b450-baf8-47af-81a5-087692307578 req-14dff572-27c7-402b-86ce-819547caf887 service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Received event network-vif-unplugged-5e52242f-77f4-41cc-ae8f-6a4772243727 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:01:47.452743 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bd20b450-baf8-47af-81a5-087692307578 req-14dff572-27c7-402b-86ce-819547caf887 service nova] Acquiring lock "21c4e225-440e-4103-adaf-cb470d172291-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:47.453407 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bd20b450-baf8-47af-81a5-087692307578 req-14dff572-27c7-402b-86ce-819547caf887 service nova] Lock "21c4e225-440e-4103-adaf-cb470d172291-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:47.453407 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bd20b450-baf8-47af-81a5-087692307578 req-14dff572-27c7-402b-86ce-819547caf887 service nova] Lock "21c4e225-440e-4103-adaf-cb470d172291-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:47.453407 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-bd20b450-baf8-47af-81a5-087692307578 req-14dff572-27c7-402b-86ce-819547caf887 service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] No waiting events found dispatching network-vif-unplugged-5e52242f-77f4-41cc-ae8f-6a4772243727 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:01:47.453407 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-bd20b450-baf8-47af-81a5-087692307578 req-14dff572-27c7-402b-86ce-819547caf887 service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Received unexpected event network-vif-unplugged-5e52242f-77f4-41cc-ae8f-6a4772243727 for instance with vm_state active and task_state resize_migrating.
May 28 02:01:47.453407 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-bd20b450-baf8-47af-81a5-087692307578 req-14dff572-27c7-402b-86ce-819547caf887 service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Received event network-vif-plugged-5e52242f-77f4-41cc-ae8f-6a4772243727 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:01:47.453407 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bd20b450-baf8-47af-81a5-087692307578 req-14dff572-27c7-402b-86ce-819547caf887 service nova] Acquiring lock "21c4e225-440e-4103-adaf-cb470d172291-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:47.453972 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bd20b450-baf8-47af-81a5-087692307578 req-14dff572-27c7-402b-86ce-819547caf887 service nova] Lock "21c4e225-440e-4103-adaf-cb470d172291-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:47.453972 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bd20b450-baf8-47af-81a5-087692307578 req-14dff572-27c7-402b-86ce-819547caf887 service nova] Lock "21c4e225-440e-4103-adaf-cb470d172291-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:47.453972 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-bd20b450-baf8-47af-81a5-087692307578 req-14dff572-27c7-402b-86ce-819547caf887 service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] No waiting events found dispatching network-vif-plugged-5e52242f-77f4-41cc-ae8f-6a4772243727 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:01:47.453972 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-bd20b450-baf8-47af-81a5-087692307578 req-14dff572-27c7-402b-86ce-819547caf887 service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Received unexpected event network-vif-plugged-5e52242f-77f4-41cc-ae8f-6a4772243727 for instance with vm_state active and task_state resize_migrating.
May 28 02:01:47.453972 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-bd20b450-baf8-47af-81a5-087692307578 req-14dff572-27c7-402b-86ce-819547caf887 service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Received event network-vif-plugged-5e52242f-77f4-41cc-ae8f-6a4772243727 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:01:47.453972 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bd20b450-baf8-47af-81a5-087692307578 req-14dff572-27c7-402b-86ce-819547caf887 service nova] Acquiring lock "21c4e225-440e-4103-adaf-cb470d172291-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:47.454182 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bd20b450-baf8-47af-81a5-087692307578 req-14dff572-27c7-402b-86ce-819547caf887 service nova] Lock "21c4e225-440e-4103-adaf-cb470d172291-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:47.455777 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bd20b450-baf8-47af-81a5-087692307578 req-14dff572-27c7-402b-86ce-819547caf887 service nova] Lock "21c4e225-440e-4103-adaf-cb470d172291-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:47.456293 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-bd20b450-baf8-47af-81a5-087692307578 req-14dff572-27c7-402b-86ce-819547caf887 service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] No waiting events found dispatching network-vif-plugged-5e52242f-77f4-41cc-ae8f-6a4772243727 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:01:47.456414 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-bd20b450-baf8-47af-81a5-087692307578 req-14dff572-27c7-402b-86ce-819547caf887 service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Received unexpected event network-vif-plugged-5e52242f-77f4-41cc-ae8f-6a4772243727 for instance with vm_state active and task_state resize_migrating.
May 28 02:01:47.456555 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-bd20b450-baf8-47af-81a5-087692307578 req-14dff572-27c7-402b-86ce-819547caf887 service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Received event network-vif-unplugged-5e52242f-77f4-41cc-ae8f-6a4772243727 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:01:47.457188 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bd20b450-baf8-47af-81a5-087692307578 req-14dff572-27c7-402b-86ce-819547caf887 service nova] Acquiring lock "21c4e225-440e-4103-adaf-cb470d172291-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:47.457399 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bd20b450-baf8-47af-81a5-087692307578 req-14dff572-27c7-402b-86ce-819547caf887 service nova] Lock "21c4e225-440e-4103-adaf-cb470d172291-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:47.457544 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bd20b450-baf8-47af-81a5-087692307578 req-14dff572-27c7-402b-86ce-819547caf887 service nova] Lock "21c4e225-440e-4103-adaf-cb470d172291-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:47.457721 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-bd20b450-baf8-47af-81a5-087692307578 req-14dff572-27c7-402b-86ce-819547caf887 service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] No waiting events found dispatching network-vif-unplugged-5e52242f-77f4-41cc-ae8f-6a4772243727 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:01:47.457895 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-bd20b450-baf8-47af-81a5-087692307578 req-14dff572-27c7-402b-86ce-819547caf887 service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Received unexpected event network-vif-unplugged-5e52242f-77f4-41cc-ae8f-6a4772243727 for instance with vm_state active and task_state resize_migrating.
May 28 02:01:47.458013 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-bd20b450-baf8-47af-81a5-087692307578 req-14dff572-27c7-402b-86ce-819547caf887 service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Received event network-vif-unplugged-5e52242f-77f4-41cc-ae8f-6a4772243727 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:01:47.458177 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bd20b450-baf8-47af-81a5-087692307578 req-14dff572-27c7-402b-86ce-819547caf887 service nova] Acquiring lock "21c4e225-440e-4103-adaf-cb470d172291-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:47.458310 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bd20b450-baf8-47af-81a5-087692307578 req-14dff572-27c7-402b-86ce-819547caf887 service nova] Lock "21c4e225-440e-4103-adaf-cb470d172291-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:47.458402 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bd20b450-baf8-47af-81a5-087692307578 req-14dff572-27c7-402b-86ce-819547caf887 service nova] Lock "21c4e225-440e-4103-adaf-cb470d172291-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:47.458497 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-bd20b450-baf8-47af-81a5-087692307578 req-14dff572-27c7-402b-86ce-819547caf887 service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] No waiting events found dispatching network-vif-unplugged-5e52242f-77f4-41cc-ae8f-6a4772243727 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:01:47.458592 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-bd20b450-baf8-47af-81a5-087692307578 req-14dff572-27c7-402b-86ce-819547caf887 service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Received unexpected event network-vif-unplugged-5e52242f-77f4-41cc-ae8f-6a4772243727 for instance with vm_state active and task_state resize_migrating.
May 28 02:01:47.532310 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "294538ef-cf08-4184-8bc2-96598456d113" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:47.532310 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "294538ef-cf08-4184-8bc2-96598456d113" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:47.532310 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "294538ef-cf08-4184-8bc2-96598456d113-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:47.532310 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "294538ef-cf08-4184-8bc2-96598456d113-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:47.532310 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "294538ef-cf08-4184-8bc2-96598456d113-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:47.534774 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Terminating instance
May 28 02:01:47.683623 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] End _get_guest_xml xml=<domain type="qemu">
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:   <uuid>c165c9a8-be28-4efe-b671-4dcf9bedfbe4</uuid>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:   <name>instance-0000002e</name>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:   <metadata>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:       <nova:name>instance-depend-image</nova:name>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 02:01:42</nova:creationTime>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:       <nova:image uuid="">
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:         <nova:properties/>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:       </nova:image>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:         <nova:user uuid="816ff3d1a9244ea8b0c6430e232410e9">tempest-ImageDependencyTests-349245414-project-member</nova:user>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:         <nova:project uuid="528113b81f2f406da984d1a1fcf5962e">tempest-ImageDependencyTests-349245414</nova:project>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:       <nova:root type="volume" uuid=""/>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:         <nova:port uuid="a33bea84-56b3-4c8c-8f1c-2c6481551f97">
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="192.168.233.116" ipVersion="4"/>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:         </nova:port>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:   </metadata>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:     <system>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:       <entry name="serial">c165c9a8-be28-4efe-b671-4dcf9bedfbe4</entry>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:       <entry name="uuid">c165c9a8-be28-4efe-b671-4dcf9bedfbe4</entry>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:     </system>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:   <os>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:   </os>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:   <features>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:     <acpi/>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:     <tcg>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:     </tcg>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:   </features>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:   </cpu>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:   <devices>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/c165c9a8-be28-4efe-b671-4dcf9bedfbe4/disk.config"/>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:     </disk>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:     <disk type="block" device="disk">
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:       <alias name="ua-57c666b1-2380-41ea-bf52-6ab6b2d10c75"/>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:       <source dev="/dev/dm-8"/>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:       <serial>57c666b1-2380-41ea-bf52-6ab6b2d10c75</serial>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:     </disk>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:84:ce:c4"/>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:       <target dev="tapa33bea84-56"/>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:     </interface>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/c165c9a8-be28-4efe-b671-4dcf9bedfbe4/console.log" append="off"/>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:     </serial>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:     <video>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:     </video>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:     </rng>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:     </memballoon>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:   </devices>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]: </domain>
May 28 02:01:47.683623 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 02:01:47.685408 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Preparing to wait for external event network-vif-plugged-a33bea84-56b3-4c8c-8f1c-2c6481551f97 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 02:01:47.685408 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Acquiring lock "c165c9a8-be28-4efe-b671-4dcf9bedfbe4-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:47.685408 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Lock "c165c9a8-be28-4efe-b671-4dcf9bedfbe4-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:47.685408 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Lock "c165c9a8-be28-4efe-b671-4dcf9bedfbe4-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:47.685408 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:01:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='instance-depend-image',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='528113b81f2f406da984d1a1fcf5962e',ramdisk_id='',reservation_id='r-310aobtx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ImageDependencyTests-349245414',owner_user_name='tempest-ImageDependencyTests-349245414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:01:39Z,user_data=None,user_id='816ff3d1a9244ea8b0c6430e232410e9',uuid=c165c9a8-be28-4efe-b671-4dcf9bedfbe4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a33bea84-56b3-4c8c-8f1c-2c6481551f97", "address": "fa:16:3e:84:ce:c4", "network": {"id": "c60710fd-eeb6-4948-8a84-8b95cae31191", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6b98ce7597d45a6b839c720f99fa1e9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa33bea84-56", "ovs_interfaceid": "a33bea84-56b3-4c8c-8f1c-2c6481551f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 02:01:47.685571 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Converting VIF {"id": "a33bea84-56b3-4c8c-8f1c-2c6481551f97", "address": "fa:16:3e:84:ce:c4", "network": {"id": "c60710fd-eeb6-4948-8a84-8b95cae31191", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6b98ce7597d45a6b839c720f99fa1e9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa33bea84-56", "ovs_interfaceid": "a33bea84-56b3-4c8c-8f1c-2c6481551f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:01:47.686585 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:ce:c4,bridge_name='br-int',has_traffic_filtering=True,id=a33bea84-56b3-4c8c-8f1c-2c6481551f97,network=Network(c60710fd-eeb6-4948-8a84-8b95cae31191),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa33bea84-56') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:01:47.686585 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:ce:c4,bridge_name='br-int',has_traffic_filtering=True,id=a33bea84-56b3-4c8c-8f1c-2c6481551f97,network=Network(c60710fd-eeb6-4948-8a84-8b95cae31191),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa33bea84-56') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 02:01:47.687019 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:47.687495 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:01:47.687992 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 02:01:47.689256 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:47.689483 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dcfa3862-4c6a-5e08-afbf-5bd2b5eb7ca2', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:01:47.692696 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:47.692696 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:01:47.692696 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:47.695989 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:47.696542 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa33bea84-56, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:01:47.696800 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa33bea84-56, col_values=(('qos', UUID('411a6e84-3d6d-4248-a896-e4a2f7f36cbf')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:01:47.697013 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa33bea84-56, col_values=(('external_ids', {'iface-id': 'a33bea84-56b3-4c8c-8f1c-2c6481551f97', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:ce:c4', 'vm-uuid': 'c165c9a8-be28-4efe-b671-4dcf9bedfbe4'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:01:47.698871 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:47.699844 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:01:47.705718 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:47.706577 np0000001583 nova-compute[98241]: INFO os_vif [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:ce:c4,bridge_name='br-int',has_traffic_filtering=True,id=a33bea84-56b3-4c8c-8f1c-2c6481551f97,network=Network(c60710fd-eeb6-4948-8a84-8b95cae31191),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa33bea84-56')
May 28 02:01:47.868597 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b805013b-a5a5-482c-9b8a-ff34ee11ada2 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "01d8de67-23ab-4430-8512-d2fece776ac2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:47.868846 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b805013b-a5a5-482c-9b8a-ff34ee11ada2 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "01d8de67-23ab-4430-8512-d2fece776ac2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:48.037631 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 02:01:48.064164 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:48.066415 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:48.066758 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:48.072031 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:48.085700 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:48.087673 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:48.110743 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:48.121651 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:48.187144 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Port 5e52242f-77f4-41cc-ae8f-6a4772243727 binding to destination host np0000001583 is already ACTIVE {{(pid=98241) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 28 02:01:48.258762 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:48.371460 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-b805013b-a5a5-482c-9b8a-ff34ee11ada2 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Detaching volume c2a9b112-3d12-4e10-a315-8a8fb5ab92e3
May 28 02:01:48.379220 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999693388000196 future=<Future at 0x7724ec2ada00 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:01:48.381765 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Instance destroyed successfully.
May 28 02:01:48.382341 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lazy-loading 'resources' on Instance uuid 294538ef-cf08-4184-8bc2-96598456d113 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:01:48.428775 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-b805013b-a5a5-482c-9b8a-ff34ee11ada2 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Attempting to driver detach volume c2a9b112-3d12-4e10-a315-8a8fb5ab92e3 from mountpoint /dev/vdb
May 28 02:01:48.435656 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b805013b-a5a5-482c-9b8a-ff34ee11ada2 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Found disk vdb by alias ua-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:01:48.437306 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b805013b-a5a5-482c-9b8a-ff34ee11ada2 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Found disk vdb by alias ua-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:01:48.437491 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b805013b-a5a5-482c-9b8a-ff34ee11ada2 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Attempting to detach device vdb from instance 01d8de67-23ab-4430-8512-d2fece776ac2 from the persistent domain config. {{(pid=98241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 02:01:48.437834 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-b805013b-a5a5-482c-9b8a-ff34ee11ada2 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:01:48.437834 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:01:48.437834 np0000001583 nova-compute[98241]:   <alias name="ua-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3"/>
May 28 02:01:48.437834 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-7"/>
May 28 02:01:48.437834 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:01:48.437834 np0000001583 nova-compute[98241]:   <serial>c2a9b112-3d12-4e10-a315-8a8fb5ab92e3</serial>
May 28 02:01:48.437834 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 02:01:48.437834 np0000001583 nova-compute[98241]: </disk>
May 28 02:01:48.437834 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:01:48.452167 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-b805013b-a5a5-482c-9b8a-ff34ee11ada2 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Successfully detached device vdb from instance 01d8de67-23ab-4430-8512-d2fece776ac2 from the persistent domain config.
May 28 02:01:48.452344 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b805013b-a5a5-482c-9b8a-ff34ee11ada2 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] (1/8): Attempting to detach device vdb with device alias ua-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3 from instance 01d8de67-23ab-4430-8512-d2fece776ac2 from the live domain config. {{(pid=98241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 02:01:48.452703 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-b805013b-a5a5-482c-9b8a-ff34ee11ada2 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:01:48.452703 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:01:48.452703 np0000001583 nova-compute[98241]:   <alias name="ua-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3"/>
May 28 02:01:48.452703 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-7"/>
May 28 02:01:48.452703 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:01:48.452703 np0000001583 nova-compute[98241]:   <serial>c2a9b112-3d12-4e10-a315-8a8fb5ab92e3</serial>
May 28 02:01:48.452703 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 02:01:48.452703 np0000001583 nova-compute[98241]: </disk>
May 28 02:01:48.452703 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:01:48.549312 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:48.554436 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:48.576708 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:48.585253 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:48.606333 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:48.619144 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:48.728624 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Acquiring lock "e00f21c6-ce7c-4e23-94e2-7f415ae7a9be" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:48.728624 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "e00f21c6-ce7c-4e23-94e2-7f415ae7a9be" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:48.741358 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-69b2dd46-de0b-4174-a9a7-84bacb72bef2 req-f90f894c-81ff-47d5-a893-9a343c0daed1 service nova] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Received event network-vif-unplugged-18842969-e82f-4389-a30f-f5054a50d115 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:01:48.744153 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-69b2dd46-de0b-4174-a9a7-84bacb72bef2 req-f90f894c-81ff-47d5-a893-9a343c0daed1 service nova] Acquiring lock "c6e87c0e-02e1-4941-8f2f-b969b93ebf9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:48.744657 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-69b2dd46-de0b-4174-a9a7-84bacb72bef2 req-f90f894c-81ff-47d5-a893-9a343c0daed1 service nova] Lock "c6e87c0e-02e1-4941-8f2f-b969b93ebf9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:48.744859 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-69b2dd46-de0b-4174-a9a7-84bacb72bef2 req-f90f894c-81ff-47d5-a893-9a343c0daed1 service nova] Lock "c6e87c0e-02e1-4941-8f2f-b969b93ebf9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:48.745109 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-69b2dd46-de0b-4174-a9a7-84bacb72bef2 req-f90f894c-81ff-47d5-a893-9a343c0daed1 service nova] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] No waiting events found dispatching network-vif-unplugged-18842969-e82f-4389-a30f-f5054a50d115 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:01:48.745247 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-69b2dd46-de0b-4174-a9a7-84bacb72bef2 req-f90f894c-81ff-47d5-a893-9a343c0daed1 service nova] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Received unexpected event network-vif-unplugged-18842969-e82f-4389-a30f-f5054a50d115 for instance with vm_state active and task_state reboot_started.
May 28 02:01:48.853352 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:48.869721 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:48.885400 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T02:01:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-510246973',display_name='tempest-TestVolumeBootPattern-server-510246973',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testvolumebootpattern-server-510246973',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:01:45Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='432aa1094ced436494def17a875aa8e1',ramdisk_id='',reservation_id='r-h0w63ohx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1031057169',owner_user_name='tempest-TestVolumeBootPattern-1031057169-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T02:01:45Z,user_data=None,user_id='6be314b4eed642c3b2c72fe115860220',uuid=294538ef-cf08-4184-8bc2-96598456d113,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a37c53c-4096-4379-9e19-72530018c97b", "address": "fa:16:3e:73:91:0b", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a37c53c-40", "ovs_interfaceid": "8a37c53c-4096-4379-9e19-72530018c97b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:01:48.885400 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converting VIF {"id": "8a37c53c-4096-4379-9e19-72530018c97b", "address": "fa:16:3e:73:91:0b", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a37c53c-40", "ovs_interfaceid": "8a37c53c-4096-4379-9e19-72530018c97b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:01:48.886188 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:91:0b,bridge_name='br-int',has_traffic_filtering=True,id=8a37c53c-4096-4379-9e19-72530018c97b,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a37c53c-40') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:01:48.886346 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:91:0b,bridge_name='br-int',has_traffic_filtering=True,id=8a37c53c-4096-4379-9e19-72530018c97b,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a37c53c-40') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:01:48.887537 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:48.887708 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a37c53c-40, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:01:48.889144 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:48.889809 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:01:48.900468 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:48.901644 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:48.901835 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=65075866-54ff-466b-adf9-089fb185cc4e) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:01:48.902480 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:48.903152 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:01:48.912866 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:48.914885 np0000001583 nova-compute[98241]: INFO os_vif [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:91:0b,bridge_name='br-int',has_traffic_filtering=True,id=8a37c53c-4096-4379-9e19-72530018c97b,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a37c53c-40')
May 28 02:01:48.916972 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 294538ef-cf08-4184-8bc2-96598456d113] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:01:48.917394 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451', 'iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e30ed0b1-bfc4-4e94-bbf6-9acb83638451', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:01:48.917519 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:01:48.918066 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:01:48.918437 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451', 'iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e30ed0b1-bfc4-4e94-bbf6-9acb83638451', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:01:48.918578 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:01:48.950485 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451 (non-flash)
May 28 02:01:48.950485 np0000001583 nova-compute[98241]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451 (non-flash)
May 28 02:01:48.950485 np0000001583 nova-compute[98241]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3 (non-flash)
May 28 02:01:48.950485 np0000001583 nova-compute[98241]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3 (non-flash)
May 28 02:01:48.950485 np0000001583 nova-compute[98241]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75 (non-flash)
May 28 02:01:48.950485 np0000001583 nova-compute[98241]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75 (non-flash)
May 28 02:01:48.950485 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:48.950485 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:48.950485 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:48.950485 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:48.950485 np0000001583 nova-compute[98241]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:48.950485 np0000001583 nova-compute[98241]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:48.950485 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:01:48.950845 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451 (non-flash)
May 28 02:01:48.950845 np0000001583 nova-compute[98241]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451 (non-flash)
May 28 02:01:48.950845 np0000001583 nova-compute[98241]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3 (non-flash)
May 28 02:01:48.950845 np0000001583 nova-compute[98241]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3 (non-flash)
May 28 02:01:48.950845 np0000001583 nova-compute[98241]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75 (non-flash)
May 28 02:01:48.950845 np0000001583 nova-compute[98241]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75 (non-flash)
May 28 02:01:48.950845 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:48.950845 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:48.950845 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:48.950845 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:48.950845 np0000001583 nova-compute[98241]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:48.950845 np0000001583 nova-compute[98241]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:48.950845 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:01:48.950845 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451', '103'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451', '104'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3', '105'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3', '106'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75', '107'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75', '108'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', '68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', '69'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', '91'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', '92'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be', '98'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be', '99')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:01:48.951186 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451', '103')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:01:48.952483 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451', '104')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:01:48.954451 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f90b8360>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451'): ({'sdh'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:01:48.954703 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Removing multipathed devices sdh, sdg {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:01:48.954942 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Flush multipath device 330000000fb78376c {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:01:48.958747 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Received event <DeviceRemovedEvent: 1779933708.958309, 01d8de67-23ab-4430-8512-d2fece776ac2 => ua-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3> from libvirt while the driver is waiting for it; dispatched. {{(pid=98241) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 02:01:48.960200 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b805013b-a5a5-482c-9b8a-ff34ee11ada2 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3 for instance 01d8de67-23ab-4430-8512-d2fece776ac2 {{(pid=98241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 02:01:48.964157 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-b805013b-a5a5-482c-9b8a-ff34ee11ada2 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Successfully detached device vdb from instance 01d8de67-23ab-4430-8512-d2fece776ac2 from the live domain config.
May 28 02:01:48.966937 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b805013b-a5a5-482c-9b8a-ff34ee11ada2 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:01:48.967242 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b805013b-a5a5-482c-9b8a-ff34ee11ada2 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3', 'iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c2a9b112-3d12-4e10-a315-8a8fb5ab92e3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': False}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:01:48.967373 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-b805013b-a5a5-482c-9b8a-ff34ee11ada2 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:01:48.975292 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999595238999973 future=<Future at 0x7724ec2302c0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:01:49.020964 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:01:49.059815 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:01:49.109671 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Checking to see if SCSI volumes sdh, sdg have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:01:49.109906 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] SCSI volumes sdh, sdg have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:01:49.111485 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Checking to see if device paths {'sdh', 'sdg'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:01:49.123573 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Device paths {'sdh', 'sdg'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:01:49.123755 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:01:49.126684 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-77d48865-5418-4d2b-a23b-dfab68811a6f tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Instance shutdown successfully.
May 28 02:01:49.138067 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:49.174485 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 103, target: iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451, portal: 192.168.40.100,3260]
May 28 02:01:49.174485 np0000001583 nova-compute[98241]: Logout of [sid: 103, target: iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451, portal: 192.168.40.100,3260] successful.
May 28 02:01:49.174485 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:49.198098 np0000001583 nova-compute[98241]: DEBUG nova.compute.rpcapi [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98241) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 02:01:49.206785 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:49.207434 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "21c4e225-440e-4103-adaf-cb470d172291-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:49.207762 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "21c4e225-440e-4103-adaf-cb470d172291-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:49.207928 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "21c4e225-440e-4103-adaf-cb470d172291-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:49.222609 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:49.227874 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:01:49.227874 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:01:49.227874 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] No VIF found with MAC fa:16:3e:84:ce:c4, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:01:49.228229 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Using config drive
May 28 02:01:49.231382 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 02:01:49.262484 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 104, target: iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451, portal: 192.168.50.100,3260]
May 28 02:01:49.262484 np0000001583 nova-compute[98241]: Logout of [sid: 104, target: iqn.2023-03.storpool.com:os--volume-e30ed0b1-bfc4-4e94-bbf6-9acb83638451, portal: 192.168.50.100,3260] successful.
May 28 02:01:49.262484 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:49.287562 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:49.287879 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:01:49.288071 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] <== disconnect_volume: return (370ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:01:49.288294 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:01:49.288961 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Deleting instance files /opt/stack/data/nova/instances/294538ef-cf08-4184-8bc2-96598456d113_del
May 28 02:01:49.289700 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-b805013b-a5a5-482c-9b8a-ff34ee11ada2 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.322s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:01:49.289867 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b805013b-a5a5-482c-9b8a-ff34ee11ada2 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3', 'iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c2a9b112-3d12-4e10-a315-8a8fb5ab92e3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:01:49.290168 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b805013b-a5a5-482c-9b8a-ff34ee11ada2 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:01:49.290531 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Deletion of /opt/stack/data/nova/instances/294538ef-cf08-4184-8bc2-96598456d113_del complete
May 28 02:01:49.327242 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b805013b-a5a5-482c-9b8a-ff34ee11ada2 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3 (non-flash)
May 28 02:01:49.327242 np0000001583 nova-compute[98241]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3 (non-flash)
May 28 02:01:49.327242 np0000001583 nova-compute[98241]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75 (non-flash)
May 28 02:01:49.327242 np0000001583 nova-compute[98241]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75 (non-flash)
May 28 02:01:49.327242 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:49.327242 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:49.327242 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:49.327242 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:49.327242 np0000001583 nova-compute[98241]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:49.327242 np0000001583 nova-compute[98241]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:49.327242 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:01:49.327242 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b805013b-a5a5-482c-9b8a-ff34ee11ada2 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsi session list stdout=tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3 (non-flash)
May 28 02:01:49.327242 np0000001583 nova-compute[98241]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3 (non-flash)
May 28 02:01:49.327242 np0000001583 nova-compute[98241]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75 (non-flash)
May 28 02:01:49.327242 np0000001583 nova-compute[98241]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75 (non-flash)
May 28 02:01:49.327242 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:49.327242 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:49.327242 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:49.327242 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:49.327242 np0000001583 nova-compute[98241]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:49.327242 np0000001583 nova-compute[98241]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:49.327242 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:01:49.327242 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b805013b-a5a5-482c-9b8a-ff34ee11ada2 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3', '105'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3', '106'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75', '107'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75', '108'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', '68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', '69'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', '91'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', '92'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be', '98'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be', '99')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:01:49.327242 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b805013b-a5a5-482c-9b8a-ff34ee11ada2 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3', '105')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:01:49.327996 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b805013b-a5a5-482c-9b8a-ff34ee11ada2 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3', '106')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:01:49.329190 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b805013b-a5a5-482c-9b8a-ff34ee11ada2 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f8155120>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3'): ({'sdk'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:01:49.329424 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-b805013b-a5a5-482c-9b8a-ff34ee11ada2 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Removing multipathed devices sdk, sdi {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:01:49.329719 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-b805013b-a5a5-482c-9b8a-ff34ee11ada2 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Flush multipath device 33000000073e895c6 {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:01:49.367822 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-b805013b-a5a5-482c-9b8a-ff34ee11ada2 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:01:49.412768 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-b805013b-a5a5-482c-9b8a-ff34ee11ada2 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:01:49.461721 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-b805013b-a5a5-482c-9b8a-ff34ee11ada2 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Checking to see if SCSI volumes sdk, sdi have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:01:49.461933 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-b805013b-a5a5-482c-9b8a-ff34ee11ada2 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] SCSI volumes sdk, sdi have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:01:49.462987 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-b805013b-a5a5-482c-9b8a-ff34ee11ada2 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Checking to see if device paths {'sdk', 'sdi'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:01:49.476811 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-b805013b-a5a5-482c-9b8a-ff34ee11ada2 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Device paths {'sdk', 'sdi'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:01:49.477057 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b805013b-a5a5-482c-9b8a-ff34ee11ada2 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:01:49.489759 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b805013b-a5a5-482c-9b8a-ff34ee11ada2 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:49.511311 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-6d3918bb-f697-44f2-9c0c-af4848eec22b req-f3e7f8ec-664d-4203-83d8-f00f3d4b5cd0 service nova] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Received event network-vif-unplugged-8a37c53c-4096-4379-9e19-72530018c97b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:01:49.511543 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-6d3918bb-f697-44f2-9c0c-af4848eec22b req-f3e7f8ec-664d-4203-83d8-f00f3d4b5cd0 service nova] Acquiring lock "294538ef-cf08-4184-8bc2-96598456d113-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:49.511803 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-6d3918bb-f697-44f2-9c0c-af4848eec22b req-f3e7f8ec-664d-4203-83d8-f00f3d4b5cd0 service nova] Lock "294538ef-cf08-4184-8bc2-96598456d113-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:49.512028 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-6d3918bb-f697-44f2-9c0c-af4848eec22b req-f3e7f8ec-664d-4203-83d8-f00f3d4b5cd0 service nova] Lock "294538ef-cf08-4184-8bc2-96598456d113-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:49.512612 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-6d3918bb-f697-44f2-9c0c-af4848eec22b req-f3e7f8ec-664d-4203-83d8-f00f3d4b5cd0 service nova] [instance: 294538ef-cf08-4184-8bc2-96598456d113] No waiting events found dispatching network-vif-unplugged-8a37c53c-4096-4379-9e19-72530018c97b {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:01:49.512771 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-6d3918bb-f697-44f2-9c0c-af4848eec22b req-f3e7f8ec-664d-4203-83d8-f00f3d4b5cd0 service nova] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Received event network-vif-unplugged-8a37c53c-4096-4379-9e19-72530018c97b for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:01:49.512892 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-6d3918bb-f697-44f2-9c0c-af4848eec22b req-f3e7f8ec-664d-4203-83d8-f00f3d4b5cd0 service nova] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Received event network-vif-unplugged-8a37c53c-4096-4379-9e19-72530018c97b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:01:49.513065 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-6d3918bb-f697-44f2-9c0c-af4848eec22b req-f3e7f8ec-664d-4203-83d8-f00f3d4b5cd0 service nova] Acquiring lock "294538ef-cf08-4184-8bc2-96598456d113-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:49.513301 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-6d3918bb-f697-44f2-9c0c-af4848eec22b req-f3e7f8ec-664d-4203-83d8-f00f3d4b5cd0 service nova] Lock "294538ef-cf08-4184-8bc2-96598456d113-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:49.513380 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-6d3918bb-f697-44f2-9c0c-af4848eec22b req-f3e7f8ec-664d-4203-83d8-f00f3d4b5cd0 service nova] Lock "294538ef-cf08-4184-8bc2-96598456d113-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:49.513620 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-6d3918bb-f697-44f2-9c0c-af4848eec22b req-f3e7f8ec-664d-4203-83d8-f00f3d4b5cd0 service nova] [instance: 294538ef-cf08-4184-8bc2-96598456d113] No waiting events found dispatching network-vif-unplugged-8a37c53c-4096-4379-9e19-72530018c97b {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:01:49.513699 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-6d3918bb-f697-44f2-9c0c-af4848eec22b req-f3e7f8ec-664d-4203-83d8-f00f3d4b5cd0 service nova] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Received event network-vif-unplugged-8a37c53c-4096-4379-9e19-72530018c97b for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:01:49.529440 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b805013b-a5a5-482c-9b8a-ff34ee11ada2 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 105, target: iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3, portal: 192.168.40.100,3260]
May 28 02:01:49.529440 np0000001583 nova-compute[98241]: Logout of [sid: 105, target: iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3, portal: 192.168.40.100,3260] successful.
May 28 02:01:49.529440 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:49.551498 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b805013b-a5a5-482c-9b8a-ff34ee11ada2 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:49.563918 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b805013b-a5a5-482c-9b8a-ff34ee11ada2 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:49.598584 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:49.613299 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b805013b-a5a5-482c-9b8a-ff34ee11ada2 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 106, target: iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3, portal: 192.168.50.100,3260]
May 28 02:01:49.613299 np0000001583 nova-compute[98241]: Logout of [sid: 106, target: iqn.2023-03.storpool.com:os--volume-c2a9b112-3d12-4e10-a315-8a8fb5ab92e3, portal: 192.168.50.100,3260] successful.
May 28 02:01:49.613299 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:49.633708 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:49.634478 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:49.638922 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b805013b-a5a5-482c-9b8a-ff34ee11ada2 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:49.638922 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-b805013b-a5a5-482c-9b8a-ff34ee11ada2 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:01:49.639202 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b805013b-a5a5-482c-9b8a-ff34ee11ada2 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] <== disconnect_volume: return (671ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:01:49.639202 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b805013b-a5a5-482c-9b8a-ff34ee11ada2 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:01:49.737354 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:49.745529 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:49.805595 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:49.805595 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:49.809598 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 02:01:49.809740 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Claim successful on node np0000001583
May 28 02:01:49.814122 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Took 1.78 seconds to destroy the instance on the hypervisor.
May 28 02:01:49.816740 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 02:01:49.816740 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 02:01:49.816740 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 294538ef-cf08-4184-8bc2-96598456d113] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 02:01:49.816740 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:49.896144 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:49.934105 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Creating config drive at /opt/stack/data/nova/instances/c165c9a8-be28-4efe-b671-4dcf9bedfbe4/disk.config
May 28 02:01:49.939131 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c165c9a8-be28-4efe-b671-4dcf9bedfbe4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4fy2n2y1 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:01:50.006912 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:50.015408 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:50.018000 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c165c9a8-be28-4efe-b671-4dcf9bedfbe4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4fy2n2y1" returned: 0 in 0.079s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:01:50.019236 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:50.049743 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:50.058888 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:50.209776 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-b805013b-a5a5-482c-9b8a-ff34ee11ada2 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lazy-loading 'flavor' on Instance uuid 01d8de67-23ab-4430-8512-d2fece776ac2 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:01:50.219649 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:50.234402 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-4a38f3f0-66e2-4f8e-bf66-97e70582568f req-c2c19623-8af6-4496-8368-874b78f8e1f2 service nova] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Received event network-vif-deleted-8a37c53c-4096-4379-9e19-72530018c97b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:01:50.234823 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-4a38f3f0-66e2-4f8e-bf66-97e70582568f req-c2c19623-8af6-4496-8368-874b78f8e1f2 service nova] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Neutron deleted interface 8a37c53c-4096-4379-9e19-72530018c97b; detaching it from the instance and deleting it from the info cache
May 28 02:01:50.236984 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-4a38f3f0-66e2-4f8e-bf66-97e70582568f req-c2c19623-8af6-4496-8368-874b78f8e1f2 service nova] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Detach interface failed, port_id=8a37c53c-4096-4379-9e19-72530018c97b, reason: Instance 294538ef-cf08-4184-8bc2-96598456d113 could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 02:01:50.289223 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "refresh_cache-21c4e225-440e-4103-adaf-cb470d172291" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:01:50.289377 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquired lock "refresh_cache-21c4e225-440e-4103-adaf-cb470d172291" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:01:50.289566 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:01:50.490901 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:50.495693 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:50.538590 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Removed pending STOPPED event for c6e87c0e-02e1-4941-8f2f-b969b93ebf9f due to new event <LifecycleEvent: 1779933710.5381517, c6e87c0e-02e1-4941-8f2f-b969b93ebf9f => Resumed> {{(pid=98241) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 02:01:50.538840 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933710.5381517, c6e87c0e-02e1-4941-8f2f-b969b93ebf9f => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:01:50.539122 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] VM Resumed (Lifecycle Event)
May 28 02:01:50.544384 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Instance running successfully.
May 28 02:01:50.544770 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-77d48865-5418-4d2b-a23b-dfab68811a6f tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Instance soft rebooted successfully.
May 28 02:01:50.544923 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-77d48865-5418-4d2b-a23b-dfab68811a6f tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:01:50.565098 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:50.604649 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:50.684019 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:01:50.792330 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:50.821280 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e55ae3ab-06dd-4b6d-b4ac-9a6c3d086cfb req-7b177beb-d49c-4524-b4c4-d263174d0d19 service nova] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Received event network-vif-unplugged-18842969-e82f-4389-a30f-f5054a50d115 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:01:50.822029 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e55ae3ab-06dd-4b6d-b4ac-9a6c3d086cfb req-7b177beb-d49c-4524-b4c4-d263174d0d19 service nova] Acquiring lock "c6e87c0e-02e1-4941-8f2f-b969b93ebf9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:50.822816 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e55ae3ab-06dd-4b6d-b4ac-9a6c3d086cfb req-7b177beb-d49c-4524-b4c4-d263174d0d19 service nova] Lock "c6e87c0e-02e1-4941-8f2f-b969b93ebf9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:50.822816 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e55ae3ab-06dd-4b6d-b4ac-9a6c3d086cfb req-7b177beb-d49c-4524-b4c4-d263174d0d19 service nova] Lock "c6e87c0e-02e1-4941-8f2f-b969b93ebf9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:50.822816 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e55ae3ab-06dd-4b6d-b4ac-9a6c3d086cfb req-7b177beb-d49c-4524-b4c4-d263174d0d19 service nova] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] No waiting events found dispatching network-vif-unplugged-18842969-e82f-4389-a30f-f5054a50d115 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:01:50.822816 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-e55ae3ab-06dd-4b6d-b4ac-9a6c3d086cfb req-7b177beb-d49c-4524-b4c4-d263174d0d19 service nova] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Received unexpected event network-vif-unplugged-18842969-e82f-4389-a30f-f5054a50d115 for instance with vm_state active and task_state None.
May 28 02:01:50.823428 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e55ae3ab-06dd-4b6d-b4ac-9a6c3d086cfb req-7b177beb-d49c-4524-b4c4-d263174d0d19 service nova] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Received event network-vif-plugged-18842969-e82f-4389-a30f-f5054a50d115 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:01:50.823986 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e55ae3ab-06dd-4b6d-b4ac-9a6c3d086cfb req-7b177beb-d49c-4524-b4c4-d263174d0d19 service nova] Acquiring lock "c6e87c0e-02e1-4941-8f2f-b969b93ebf9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:50.823986 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e55ae3ab-06dd-4b6d-b4ac-9a6c3d086cfb req-7b177beb-d49c-4524-b4c4-d263174d0d19 service nova] Lock "c6e87c0e-02e1-4941-8f2f-b969b93ebf9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:50.823986 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e55ae3ab-06dd-4b6d-b4ac-9a6c3d086cfb req-7b177beb-d49c-4524-b4c4-d263174d0d19 service nova] Lock "c6e87c0e-02e1-4941-8f2f-b969b93ebf9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:50.823986 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e55ae3ab-06dd-4b6d-b4ac-9a6c3d086cfb req-7b177beb-d49c-4524-b4c4-d263174d0d19 service nova] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] No waiting events found dispatching network-vif-plugged-18842969-e82f-4389-a30f-f5054a50d115 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:01:50.827946 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-e55ae3ab-06dd-4b6d-b4ac-9a6c3d086cfb req-7b177beb-d49c-4524-b4c4-d263174d0d19 service nova] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Received unexpected event network-vif-plugged-18842969-e82f-4389-a30f-f5054a50d115 for instance with vm_state active and task_state None.
May 28 02:01:50.827946 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e55ae3ab-06dd-4b6d-b4ac-9a6c3d086cfb req-7b177beb-d49c-4524-b4c4-d263174d0d19 service nova] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Received event network-vif-plugged-18842969-e82f-4389-a30f-f5054a50d115 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:01:50.827946 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e55ae3ab-06dd-4b6d-b4ac-9a6c3d086cfb req-7b177beb-d49c-4524-b4c4-d263174d0d19 service nova] Acquiring lock "c6e87c0e-02e1-4941-8f2f-b969b93ebf9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:50.827946 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e55ae3ab-06dd-4b6d-b4ac-9a6c3d086cfb req-7b177beb-d49c-4524-b4c4-d263174d0d19 service nova] Lock "c6e87c0e-02e1-4941-8f2f-b969b93ebf9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:50.827946 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e55ae3ab-06dd-4b6d-b4ac-9a6c3d086cfb req-7b177beb-d49c-4524-b4c4-d263174d0d19 service nova] Lock "c6e87c0e-02e1-4941-8f2f-b969b93ebf9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:50.827946 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e55ae3ab-06dd-4b6d-b4ac-9a6c3d086cfb req-7b177beb-d49c-4524-b4c4-d263174d0d19 service nova] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] No waiting events found dispatching network-vif-plugged-18842969-e82f-4389-a30f-f5054a50d115 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:01:50.827946 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-e55ae3ab-06dd-4b6d-b4ac-9a6c3d086cfb req-7b177beb-d49c-4524-b4c4-d263174d0d19 service nova] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Received unexpected event network-vif-plugged-18842969-e82f-4389-a30f-f5054a50d115 for instance with vm_state active and task_state None.
May 28 02:01:50.908788 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:50.910528 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:50.921987 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.009267265999824303 future=<Future at 0x7724f82ef230 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:01:50.921987 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:01:50.921987 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=10.643863705000058 future=<Future at 0x7724f8130e30 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:01:50.921987 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=10.643787806000091 future=<Future at 0x7724f8130e30 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:01:50.924733 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Emitting event <LifecycleEvent: 1779933695.9122427, d4fad20b-d51e-47c9-8f55-3aa085a10891 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:01:50.926811 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] VM Stopped (Lifecycle Event)
May 28 02:01:50.942828 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:51.045992 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:01:51.061131 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:01:51.064016 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-77d48865-5418-4d2b-a23b-dfab68811a6f tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "c6e87c0e-02e1-4941-8f2f-b969b93ebf9f" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.679s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:51.187870 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Took 1.37 seconds to deallocate network for instance.
May 28 02:01:51.219408 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b805013b-a5a5-482c-9b8a-ff34ee11ada2 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "01d8de67-23ab-4430-8512-d2fece776ac2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.350s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:51.255043 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:51.435794 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: d4fad20b-d51e-47c9-8f55-3aa085a10891] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:01:51.467436 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Updating instance_info_cache with network_info: [{"id": "5e52242f-77f4-41cc-ae8f-6a4772243727", "address": "fa:16:3e:57:95:02", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e52242f-77", "ovs_interfaceid": "5e52242f-77f4-41cc-ae8f-6a4772243727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:01:51.564808 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933711.5644913, c6e87c0e-02e1-4941-8f2f-b969b93ebf9f => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:01:51.565168 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] VM Started (Lifecycle Event)
May 28 02:01:51.576732 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:01:51.578476 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:01:51.751127 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Took 0.56 seconds to detach 1 volumes for instance.
May 28 02:01:51.755482 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Deleting volume: e30ed0b1-bfc4-4e94-bbf6-9acb83638451 {{(pid=98241) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 28 02:01:51.971748 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Releasing lock "refresh_cache-21c4e225-440e-4103-adaf-cb470d172291" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:01:52.069848 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:01:52.072283 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:01:52.080457 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:01:52.315137 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-72f4c4f4-c431-4d04-bd03-855f9e744159 req-2e6a6c3d-9cf9-4bf3-a581-270e4583482f service nova] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Received event network-vif-plugged-a33bea84-56b3-4c8c-8f1c-2c6481551f97 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:01:52.318437 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-72f4c4f4-c431-4d04-bd03-855f9e744159 req-2e6a6c3d-9cf9-4bf3-a581-270e4583482f service nova] Acquiring lock "c165c9a8-be28-4efe-b671-4dcf9bedfbe4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:52.318707 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-72f4c4f4-c431-4d04-bd03-855f9e744159 req-2e6a6c3d-9cf9-4bf3-a581-270e4583482f service nova] Lock "c165c9a8-be28-4efe-b671-4dcf9bedfbe4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:52.318874 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-72f4c4f4-c431-4d04-bd03-855f9e744159 req-2e6a6c3d-9cf9-4bf3-a581-270e4583482f service nova] Lock "c165c9a8-be28-4efe-b671-4dcf9bedfbe4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:52.319026 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-72f4c4f4-c431-4d04-bd03-855f9e744159 req-2e6a6c3d-9cf9-4bf3-a581-270e4583482f service nova] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Processing event network-vif-plugged-a33bea84-56b3-4c8c-8f1c-2c6481551f97 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 02:01:52.319264 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-72f4c4f4-c431-4d04-bd03-855f9e744159 req-2e6a6c3d-9cf9-4bf3-a581-270e4583482f service nova] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Received event network-vif-plugged-a33bea84-56b3-4c8c-8f1c-2c6481551f97 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:01:52.319521 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-72f4c4f4-c431-4d04-bd03-855f9e744159 req-2e6a6c3d-9cf9-4bf3-a581-270e4583482f service nova] Acquiring lock "c165c9a8-be28-4efe-b671-4dcf9bedfbe4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:52.319668 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-72f4c4f4-c431-4d04-bd03-855f9e744159 req-2e6a6c3d-9cf9-4bf3-a581-270e4583482f service nova] Lock "c165c9a8-be28-4efe-b671-4dcf9bedfbe4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:52.319856 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-72f4c4f4-c431-4d04-bd03-855f9e744159 req-2e6a6c3d-9cf9-4bf3-a581-270e4583482f service nova] Lock "c165c9a8-be28-4efe-b671-4dcf9bedfbe4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:52.320290 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-72f4c4f4-c431-4d04-bd03-855f9e744159 req-2e6a6c3d-9cf9-4bf3-a581-270e4583482f service nova] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] No waiting events found dispatching network-vif-plugged-a33bea84-56b3-4c8c-8f1c-2c6481551f97 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:01:52.320438 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 02:01:52.320629 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-72f4c4f4-c431-4d04-bd03-855f9e744159 req-2e6a6c3d-9cf9-4bf3-a581-270e4583482f service nova] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Received unexpected event network-vif-plugged-a33bea84-56b3-4c8c-8f1c-2c6481551f97 for instance with vm_state building and task_state spawning.
May 28 02:01:52.327368 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 02:01:52.329432 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:52.331140 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Instance spawned successfully.
May 28 02:01:52.333959 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 02:01:52.382521 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-267f6e3c-c2ae-4962-80ee-b7e9a27727ae tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "01d8de67-23ab-4430-8512-d2fece776ac2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:52.382845 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-267f6e3c-c2ae-4962-80ee-b7e9a27727ae tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "01d8de67-23ab-4430-8512-d2fece776ac2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:52.383059 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-267f6e3c-c2ae-4962-80ee-b7e9a27727ae tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "01d8de67-23ab-4430-8512-d2fece776ac2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:52.383224 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-267f6e3c-c2ae-4962-80ee-b7e9a27727ae tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "01d8de67-23ab-4430-8512-d2fece776ac2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:52.383325 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-267f6e3c-c2ae-4962-80ee-b7e9a27727ae tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "01d8de67-23ab-4430-8512-d2fece776ac2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:52.387396 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-267f6e3c-c2ae-4962-80ee-b7e9a27727ae tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Terminating instance
May 28 02:01:52.491419 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:01:52.503303 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 02:01:52.529274 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:01:52.575627 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933712.5749784, c165c9a8-be28-4efe-b671-4dcf9bedfbe4 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:01:52.575868 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] VM Started (Lifecycle Event)
May 28 02:01:52.578861 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 02:01:52.578861 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 02:01:52.589644 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 02:01:52.591147 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe48:7d7b', 'fe80::d0cf:7bff:fef9:3cc3', 'fe80::fc16:3eff:fed3:cd06', 'fe80::fc16:3eff:fedf:4521', 'fe80::fc16:3eff:fede:aca2', 'fe80::ecb9:b7ff:fe00:dc63', 'fe80::fc16:3eff:fe76:c53f', 'fe80::fc16:3eff:fe1e:c373', 'fe80::9020:88ff:fe40:d02', 'fe80::fc16:3eff:fe84:cec4', 'fe80::f41d:58ff:feb1:7cd2'] 
May 28 02:01:52.591292 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 02:01:52.591430 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 02:01:52.591665 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] <== get_connector_properties: return (99ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:01:52.596935 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.791s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:52.597630 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 02:01:52.602326 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.269s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:52.846554 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:01:52.846838 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:01:52.847272 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:01:52.847477 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:01:52.847744 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:01:52.848047 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:01:52.895638 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-267f6e3c-c2ae-4962-80ee-b7e9a27727ae tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 02:01:52.918314 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:52.923653 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:52.947024 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:52.948794 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:52.981960 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:53.080282 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:01:53.086140 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:01:53.115977 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 02:01:53.116466 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 02:01:53.116847 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:53.117186 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:53.207792 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:01:53.207792 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:01:53.218285 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7001ed16-5c5b-4f3d-9cfd-24c124af2979 req-95d64fc6-e136-4d3d-b938-1b472f67c578 service nova] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Received event network-vif-unplugged-d1e489a2-57fb-4508-9524-ad06f0b81235 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:01:53.218392 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7001ed16-5c5b-4f3d-9cfd-24c124af2979 req-95d64fc6-e136-4d3d-b938-1b472f67c578 service nova] Acquiring lock "01d8de67-23ab-4430-8512-d2fece776ac2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:53.218820 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7001ed16-5c5b-4f3d-9cfd-24c124af2979 req-95d64fc6-e136-4d3d-b938-1b472f67c578 service nova] Lock "01d8de67-23ab-4430-8512-d2fece776ac2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:53.219290 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7001ed16-5c5b-4f3d-9cfd-24c124af2979 req-95d64fc6-e136-4d3d-b938-1b472f67c578 service nova] Lock "01d8de67-23ab-4430-8512-d2fece776ac2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:53.219468 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7001ed16-5c5b-4f3d-9cfd-24c124af2979 req-95d64fc6-e136-4d3d-b938-1b472f67c578 service nova] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] No waiting events found dispatching network-vif-unplugged-d1e489a2-57fb-4508-9524-ad06f0b81235 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:01:53.219613 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7001ed16-5c5b-4f3d-9cfd-24c124af2979 req-95d64fc6-e136-4d3d-b938-1b472f67c578 service nova] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Received event network-vif-unplugged-d1e489a2-57fb-4508-9524-ad06f0b81235 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:01:53.224987 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:53.232135 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:53.260177 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Instance destroyed successfully.
May 28 02:01:53.261720 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-267f6e3c-c2ae-4962-80ee-b7e9a27727ae tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lazy-loading 'resources' on Instance uuid 01d8de67-23ab-4430-8512-d2fece776ac2 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:01:53.261863 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:53.280284 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '164f3d08de954440bd716afe5eb1054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ce4063a6ac4afdb5ee359a5c1105d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 02:01:53.352670 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Took 11.11 seconds to spawn the instance on the hypervisor.
May 28 02:01:53.353415 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:01:53.592056 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 02:01:53.592627 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933713.592186, c165c9a8-be28-4efe-b671-4dcf9bedfbe4 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:01:53.592627 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] VM Paused (Lifecycle Event)
May 28 02:01:53.615121 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 02:01:53.710140 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:01:53.770024 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-267f6e3c-c2ae-4962-80ee-b7e9a27727ae tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T02:00:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1880176888',display_name='tempest-AttachVolumeNegativeTest-server-1880176888',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-attachvolumenegativetest-server-1880176888',id=43,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbWhtUZxp49C8PrIko4aR2U+3ihHHccw06V8Yz9ozm8GmdMYEUXlyx3pItVb8mor6VlJo3yFx3LIbj4UIge19ucWylEUcf7mQAxX2QIGNGtl9SpxjGDPvZAEO1bWMEkhg==',key_name='tempest-keypair-933730014',keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:00:58Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='837663bcfa40402aaf583729dfbb26cd',ramdisk_id='',reservation_id='r-qu2btn5b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-169599115',owner_user_name='tempest-AttachVolumeNegativeTest-169599115-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T02:00:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='00cb6190618b45eb994dd16d3c657f01',uuid=01d8de67-23ab-4430-8512-d2fece776ac2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1e489a2-57fb-4508-9524-ad06f0b81235", "address": "fa:16:3e:de:ac:a2", "network": {"id": "62e7cc38-1758-4b09-a352-4635adc9cfea", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587967507-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "837663bcfa40402aaf583729dfbb26cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1e489a2-57", "ovs_interfaceid": "d1e489a2-57fb-4508-9524-ad06f0b81235", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:01:53.770253 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-267f6e3c-c2ae-4962-80ee-b7e9a27727ae tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Converting VIF {"id": "d1e489a2-57fb-4508-9524-ad06f0b81235", "address": "fa:16:3e:de:ac:a2", "network": {"id": "62e7cc38-1758-4b09-a352-4635adc9cfea", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587967507-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "837663bcfa40402aaf583729dfbb26cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1e489a2-57", "ovs_interfaceid": "d1e489a2-57fb-4508-9524-ad06f0b81235", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:01:53.770774 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-267f6e3c-c2ae-4962-80ee-b7e9a27727ae tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:ac:a2,bridge_name='br-int',has_traffic_filtering=True,id=d1e489a2-57fb-4508-9524-ad06f0b81235,network=Network(62e7cc38-1758-4b09-a352-4635adc9cfea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1e489a2-57') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:01:53.771046 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-267f6e3c-c2ae-4962-80ee-b7e9a27727ae tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:ac:a2,bridge_name='br-int',has_traffic_filtering=True,id=d1e489a2-57fb-4508-9524-ad06f0b81235,network=Network(62e7cc38-1758-4b09-a352-4635adc9cfea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1e489a2-57') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:01:53.775331 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:53.775537 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd1e489a2-57, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:01:53.778017 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:53.778740 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:01:53.781665 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:53.785124 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:53.787326 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9e13baeb-237c-4bca-bac8-be56fcaa841e) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:01:53.787753 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:53.788890 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Starting finish_migration {{(pid=98241) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 28 02:01:53.790115 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Instance directory exists: not creating {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 02:01:53.791007 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:01:53.791768 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Creating image(s)
May 28 02:01:53.793157 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:01:53.811787 np0000001583 nova-compute[98241]: INFO os_vif [None req-267f6e3c-c2ae-4962-80ee-b7e9a27727ae tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:ac:a2,bridge_name='br-int',has_traffic_filtering=True,id=d1e489a2-57fb-4508-9524-ad06f0b81235,network=Network(62e7cc38-1758-4b09-a352-4635adc9cfea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1e489a2-57')
May 28 02:01:53.812319 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-267f6e3c-c2ae-4962-80ee-b7e9a27727ae tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Deleting instance files /opt/stack/data/nova/instances/01d8de67-23ab-4430-8512-d2fece776ac2_del
May 28 02:01:53.813519 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-267f6e3c-c2ae-4962-80ee-b7e9a27727ae tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Deletion of /opt/stack/data/nova/instances/01d8de67-23ab-4430-8512-d2fece776ac2_del complete
May 28 02:01:53.866827 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Took 18.61 seconds to build instance.
May 28 02:01:53.891921 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.099s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:01:53.892427 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Checking if we can resize image /opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 02:01:53.892666 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:01:53.955793 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Successfully created port: 716e50f8-c111-4e71-92f4-953489d27e91 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 02:01:53.990116 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:01:53.990567 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Cannot resize image /opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 02:01:54.096098 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:01:54.099975 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933714.099711, c165c9a8-be28-4efe-b671-4dcf9bedfbe4 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:01:54.100115 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] VM Resumed (Lifecycle Event)
May 28 02:01:54.122879 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 02:01:54.224997 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.627s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:54.302160 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Deleted allocations for instance 294538ef-cf08-4184-8bc2-96598456d113
May 28 02:01:54.325056 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-267f6e3c-c2ae-4962-80ee-b7e9a27727ae tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Took 1.43 seconds to destroy the instance on the hypervisor.
May 28 02:01:54.325739 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-267f6e3c-c2ae-4962-80ee-b7e9a27727ae tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 02:01:54.326366 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 02:01:54.326546 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 02:01:54.327040 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:54.373724 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f4be471c-09c7-474f-9aa5-b4abc8f077d6 tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Lock "c165c9a8-be28-4efe-b671-4dcf9bedfbe4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.125s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:54.401139 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:54.493941 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Did not create local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 02:01:54.494199 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Ensure instance console log exists: /opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 02:01:54.494578 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:54.494825 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:54.495021 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:54.498955 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Start _get_guest_xml network_info=[{"id": "5e52242f-77f4-41cc-ae8f-6a4772243727", "address": "fa:16:3e:57:95:02", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "vif_mac": "fa:16:3e:57:95:02"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e52242f-77", "ovs_interfaceid": "5e52242f-77f4-41cc-ae8f-6a4772243727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2b9c7b2e-ce89-46a0-a020-361646147ba3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '21c4e225-440e-4103-adaf-cb470d172291', 'attached_at': '2026-05-28T02:01:53.000000', 'detached_at': '', 'volume_id': '2b9c7b2e-ce89-46a0-a020-361646147ba3', 'multiattach': True, 'serial': '2b9c7b2e-ce89-46a0-a020-361646147ba3'}, 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'attachment_id': 'f998b135-0106-4bbf-b153-7a68f40f7cde', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 02:01:54.503578 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:01:54.504894 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='21c4e225-440e-4103-adaf-cb470d172291'), owner=OwnerMeta(userid='cadb612e41314b06914d5f5f47570e98', username='tempest-AttachVolumeMultiAttachTest-857456921-project-member', projectid='0474090f4f2d4950b51bc317f4302266', projectname='tempest-AttachVolumeMultiAttachTest-857456921'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5e52242f-77f4-41cc-ae8f-6a4772243727", "address": "fa:16:3e:57:95:02", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "vif_mac": "fa:16:3e:57:95:02"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e52242f-77", "ovs_interfaceid": "5e52242f-77f4-41cc-ae8f-6a4772243727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933714.504529) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 02:01:54.506209 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 02:01:54.506613 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 02:01:54.507805 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 02:01:54.508033 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 02:01:54.509152 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 02:01:54.509880 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 02:01:54.510303 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 02:01:54.510426 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 02:01:54.510569 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 02:01:54.510653 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 02:01:54.510749 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 02:01:54.510969 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 02:01:54.511723 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 02:01:54.512022 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 02:01:54.512179 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 02:01:54.512341 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 02:01:54.527345 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/disk.config --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:01:54.589854 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Successfully updated port: 716e50f8-c111-4e71-92f4-953489d27e91 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 02:01:54.604376 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:01:54.608052 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:01:54.620582 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/disk.config --force-share --output=json" returned: 0 in 0.093s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:01:54.621434 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "/opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:54.621782 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "/opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:54.622770 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "/opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:54.623225 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 02:01:54.623756 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2b9c7b2e-ce89-46a0-a020-361646147ba3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:01:54.624020 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:01:54.624755 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:01:54.625094 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2b9c7b2e-ce89-46a0-a020-361646147ba3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 02:01:54.640595 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:01:54.641494 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:01:54.642017 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:01:54.642299 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:01:54.642874 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:01:54.644490 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: node.startup = automatic
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: node.session.scan = manual
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:01:54.656741 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:01:54.656741 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: node.startup = automatic
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: node.session.scan = manual
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:01:54.666389 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:01:54.666389 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:54.669443 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:54.682944 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:01:54.692631 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75 (non-flash)
May 28 02:01:54.692631 np0000001583 nova-compute[98241]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75 (non-flash)
May 28 02:01:54.692631 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:54.692631 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:54.692631 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:54.692631 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:54.692631 np0000001583 nova-compute[98241]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:54.692631 np0000001583 nova-compute[98241]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:54.692631 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:01:54.692631 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsi session list stdout=tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75 (non-flash)
May 28 02:01:54.692631 np0000001583 nova-compute[98241]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75 (non-flash)
May 28 02:01:54.692631 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:54.692631 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:54.692631 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:54.692631 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:54.692631 np0000001583 nova-compute[98241]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:54.692631 np0000001583 nova-compute[98241]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:54.692631 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:01:54.693277 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.051s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:01:54.693277 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:01:54.693761 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] HCTL ('20', '0', '0', 0) found on session 92 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:01:54.693885 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Scanning host 20 c: 0, t: 0, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:01:54.704461 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75 (non-flash)
May 28 02:01:54.704461 np0000001583 nova-compute[98241]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75 (non-flash)
May 28 02:01:54.704461 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:54.704461 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:54.704461 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:54.704461 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:54.704461 np0000001583 nova-compute[98241]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:54.704461 np0000001583 nova-compute[98241]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:54.704461 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:01:54.705168 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsi session list stdout=tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75 (non-flash)
May 28 02:01:54.705168 np0000001583 nova-compute[98241]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75 (non-flash)
May 28 02:01:54.705168 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:54.705168 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:01:54.705168 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:54.705168 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:01:54.705168 np0000001583 nova-compute[98241]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:54.705168 np0000001583 nova-compute[98241]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:01:54.705168 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:01:54.705168 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.062s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:01:54.705168 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:01:54.705955 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] HCTL ('15', '0', '0', 0) found on session 91 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:01:54.705955 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Scanning host 15 c: 0, t: 0, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:01:54.715855 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Searching for a device in session 92 and hctl ('20', '0', '0', 0) yield: sdo {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:01:54.716010 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2b9c7b2e-ce89-46a0-a020-361646147ba3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:01:54.717253 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Searching for a device in session 91 and hctl ('15', '0', '0', 0) yield: sdj {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:01:54.717595 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2b9c7b2e-ce89-46a0-a020-361646147ba3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:01:55.095895 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Acquiring lock "refresh_cache-e00f21c6-ce7c-4e23-94e2-7f415ae7a9be" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:01:55.096025 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Acquired lock "refresh_cache-e00f21c6-ce7c-4e23-94e2-7f415ae7a9be" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:01:55.096182 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:01:55.111633 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999714826999934 future=<Future at 0x7724ec36f140 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:01:55.132960 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 02:01:55.136474 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 02:01:55.136764 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Creating image(s)
May 28 02:01:55.137324 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Acquiring lock "/opt/stack/data/nova/instances/e00f21c6-ce7c-4e23-94e2-7f415ae7a9be/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:55.137499 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "/opt/stack/data/nova/instances/e00f21c6-ce7c-4e23-94e2-7f415ae7a9be/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:55.138002 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "/opt/stack/data/nova/instances/e00f21c6-ce7c-4e23-94e2-7f415ae7a9be/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:55.138535 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:01:55.142682 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:01:55.143627 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:01:55.216245 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-31649cb3-3dc5-4abd-b6b0-8887a5ccec4c req-57330783-3815-48a2-abd1-c7f0cccac2e6 service nova] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Received event network-changed-716e50f8-c111-4e71-92f4-953489d27e91 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:01:55.216944 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-31649cb3-3dc5-4abd-b6b0-8887a5ccec4c req-57330783-3815-48a2-abd1-c7f0cccac2e6 service nova] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Refreshing instance network info cache due to event network-changed-716e50f8-c111-4e71-92f4-953489d27e91. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:01:55.217207 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-31649cb3-3dc5-4abd-b6b0-8887a5ccec4c req-57330783-3815-48a2-abd1-c7f0cccac2e6 service nova] Acquiring lock "refresh_cache-e00f21c6-ce7c-4e23-94e2-7f415ae7a9be" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:01:55.258028 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.114s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:01:55.258457 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:55.258995 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:55.259487 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:01:55.262242 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:01:55.262594 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:01:55.317599 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-dcc77299-d387-4955-b521-e254a6ddaff7 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "294538ef-cf08-4184-8bc2-96598456d113" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.787s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:55.333346 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-979261ea-40e0-4754-8e6a-73df61061712 req-0c7302b8-f242-43ef-8677-c8daa938af40 service nova] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Received event network-vif-unplugged-d1e489a2-57fb-4508-9524-ad06f0b81235 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:01:55.333547 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-979261ea-40e0-4754-8e6a-73df61061712 req-0c7302b8-f242-43ef-8677-c8daa938af40 service nova] Acquiring lock "01d8de67-23ab-4430-8512-d2fece776ac2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:55.333711 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-979261ea-40e0-4754-8e6a-73df61061712 req-0c7302b8-f242-43ef-8677-c8daa938af40 service nova] Lock "01d8de67-23ab-4430-8512-d2fece776ac2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:55.333837 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-979261ea-40e0-4754-8e6a-73df61061712 req-0c7302b8-f242-43ef-8677-c8daa938af40 service nova] Lock "01d8de67-23ab-4430-8512-d2fece776ac2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:55.333969 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-979261ea-40e0-4754-8e6a-73df61061712 req-0c7302b8-f242-43ef-8677-c8daa938af40 service nova] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] No waiting events found dispatching network-vif-unplugged-d1e489a2-57fb-4508-9524-ad06f0b81235 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:01:55.334151 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-979261ea-40e0-4754-8e6a-73df61061712 req-0c7302b8-f242-43ef-8677-c8daa938af40 service nova] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Received event network-vif-unplugged-d1e489a2-57fb-4508-9524-ad06f0b81235 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:01:55.334263 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-979261ea-40e0-4754-8e6a-73df61061712 req-0c7302b8-f242-43ef-8677-c8daa938af40 service nova] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Received event network-vif-deleted-d1e489a2-57fb-4508-9524-ad06f0b81235 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:01:55.334373 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-979261ea-40e0-4754-8e6a-73df61061712 req-0c7302b8-f242-43ef-8677-c8daa938af40 service nova] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Neutron deleted interface d1e489a2-57fb-4508-9524-ad06f0b81235; detaching it from the instance and deleting it from the info cache
May 28 02:01:55.342490 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-979261ea-40e0-4754-8e6a-73df61061712 req-0c7302b8-f242-43ef-8677-c8daa938af40 service nova] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Detach interface failed, port_id=d1e489a2-57fb-4508-9524-ad06f0b81235, reason: Instance 01d8de67-23ab-4430-8512-d2fece776ac2 could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 02:01:55.379409 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.116s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:01:55.379409 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/e00f21c6-ce7c-4e23-94e2-7f415ae7a9be/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:01:55.447458 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/e00f21c6-ce7c-4e23-94e2-7f415ae7a9be/disk 1073741824" returned: 0 in 0.068s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:01:55.447969 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:55.448259 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:01:55.522571 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:01:55.544014 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.096s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:01:55.544396 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e00f21c6-ce7c-4e23-94e2-7f415ae7a9be/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 02:01:55.544614 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00f21c6-ce7c-4e23-94e2-7f415ae7a9be/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:01:55.643548 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00f21c6-ce7c-4e23-94e2-7f415ae7a9be/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:01:55.643724 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Cannot resize image /opt/stack/data/nova/instances/e00f21c6-ce7c-4e23-94e2-7f415ae7a9be/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 02:01:55.644130 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 02:01:55.644388 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Ensure instance console log exists: /opt/stack/data/nova/instances/e00f21c6-ce7c-4e23-94e2-7f415ae7a9be/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 02:01:55.644743 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 02:01:55.645154 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:55.646415 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:55.646415 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:55.658918 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:01:55.807552 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:55.837869 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Acquiring lock "1f15126e-6636-4765-8650-bb717f186efe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:55.838250 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "1f15126e-6636-4765-8650-bb717f186efe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:55.961548 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Updating instance_info_cache with network_info: [{"id": "716e50f8-c111-4e71-92f4-953489d27e91", "address": "fa:16:3e:47:cf:5e", "network": {"id": "d4bf7f94-4ac7-4145-be11-d2aeeafb6c02", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-972487534-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "04ce4063a6ac4afdb5ee359a5c1105d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap716e50f8-c1", "ovs_interfaceid": "716e50f8-c111-4e71-92f4-953489d27e91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:01:56.025310 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Took 1.70 seconds to deallocate network for instance.
May 28 02:01:56.340767 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 02:01:56.463331 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Releasing lock "refresh_cache-e00f21c6-ce7c-4e23-94e2-7f415ae7a9be" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:01:56.463775 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Instance network_info: |[{"id": "716e50f8-c111-4e71-92f4-953489d27e91", "address": "fa:16:3e:47:cf:5e", "network": {"id": "d4bf7f94-4ac7-4145-be11-d2aeeafb6c02", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-972487534-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "04ce4063a6ac4afdb5ee359a5c1105d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap716e50f8-c1", "ovs_interfaceid": "716e50f8-c111-4e71-92f4-953489d27e91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 02:01:56.464776 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-31649cb3-3dc5-4abd-b6b0-8887a5ccec4c req-57330783-3815-48a2-abd1-c7f0cccac2e6 service nova] Acquired lock "refresh_cache-e00f21c6-ce7c-4e23-94e2-7f415ae7a9be" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:01:56.465170 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-31649cb3-3dc5-4abd-b6b0-8887a5ccec4c req-57330783-3815-48a2-abd1-c7f0cccac2e6 service nova] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Refreshing network info cache for port 716e50f8-c111-4e71-92f4-953489d27e91 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:01:56.470892 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Start _get_guest_xml network_info=[{"id": "716e50f8-c111-4e71-92f4-953489d27e91", "address": "fa:16:3e:47:cf:5e", "network": {"id": "d4bf7f94-4ac7-4145-be11-d2aeeafb6c02", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-972487534-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "04ce4063a6ac4afdb5ee359a5c1105d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap716e50f8-c1", "ovs_interfaceid": "716e50f8-c111-4e71-92f4-953489d27e91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 02:01:56.479415 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:01:56.480992 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-1763737570', uuid='e00f21c6-ce7c-4e23-94e2-7f415ae7a9be'), owner=OwnerMeta(userid='164f3d08de954440bd716afe5eb1054a', username='tempest-AttachVolumeTestJSON-1276932129-project-member', projectid='04ce4063a6ac4afdb5ee359a5c1105d3', projectname='tempest-AttachVolumeTestJSON-1276932129'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "716e50f8-c111-4e71-92f4-953489d27e91", "address": "fa:16:3e:47:cf:5e", "network": {"id": "d4bf7f94-4ac7-4145-be11-d2aeeafb6c02", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-972487534-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "04ce4063a6ac4afdb5ee359a5c1105d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap716e50f8-c1", "ovs_interfaceid": "716e50f8-c111-4e71-92f4-953489d27e91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933716.4805214) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 02:01:56.482804 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 02:01:56.483247 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 02:01:56.484660 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 02:01:56.484909 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 02:01:56.486157 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 02:01:56.486550 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 02:01:56.486742 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 02:01:56.486889 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 02:01:56.487067 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 02:01:56.487294 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 02:01:56.487631 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 02:01:56.487918 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 02:01:56.488611 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 02:01:56.488611 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 02:01:56.489313 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 02:01:56.489651 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 02:01:56.507501 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:01:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1763737570',display_name='tempest-AttachVolumeTestJSON-server-1763737570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-attachvolumetestjson-server-1763737570',id=47,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+oroVq9PObpGX6vhXqHL9PdfqupauFjSmVH9pl6f3ucexstLDQMlshQYswaolt8AzzgMZsugJONkBsIevMQ+uyfaLxfkDnerfPRc09vpJibuIvVolMY45WXkOcX0kd4g==',key_name='tempest-keypair-838001831',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04ce4063a6ac4afdb5ee359a5c1105d3',ramdisk_id='',reservation_id='r-2b0v9i5q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1276932129',owner_user_name='tempest-AttachVolumeTestJSON-1276932129-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:01:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='164f3d08de954440bd716afe5eb1054a',uuid=e00f21c6-ce7c-4e23-94e2-7f415ae7a9be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "716e50f8-c111-4e71-92f4-953489d27e91", "address": "fa:16:3e:47:cf:5e", "network": {"id": "d4bf7f94-4ac7-4145-be11-d2aeeafb6c02", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-972487534-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "04ce4063a6ac4afdb5ee359a5c1105d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap716e50f8-c1", "ovs_interfaceid": "716e50f8-c111-4e71-92f4-953489d27e91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 02:01:56.507785 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Converting VIF {"id": "716e50f8-c111-4e71-92f4-953489d27e91", "address": "fa:16:3e:47:cf:5e", "network": {"id": "d4bf7f94-4ac7-4145-be11-d2aeeafb6c02", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-972487534-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "04ce4063a6ac4afdb5ee359a5c1105d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap716e50f8-c1", "ovs_interfaceid": "716e50f8-c111-4e71-92f4-953489d27e91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:01:56.508610 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:cf:5e,bridge_name='br-int',has_traffic_filtering=True,id=716e50f8-c111-4e71-92f4-953489d27e91,network=Network(d4bf7f94-4ac7-4145-be11-d2aeeafb6c02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap716e50f8-c1') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:01:56.509573 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lazy-loading 'pci_devices' on Instance uuid e00f21c6-ce7c-4e23-94e2-7f415ae7a9be {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:01:56.532201 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-267f6e3c-c2ae-4962-80ee-b7e9a27727ae tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:56.532414 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-267f6e3c-c2ae-4962-80ee-b7e9a27727ae tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:56.666900 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Found WWN 330000000e4a7908f for multipath device dm-10 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 02:01:56.667337 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.043s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:01:56.667557 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] <== connect_volume: return (2043ms) {'type': 'block', 'scsi_wwn': '330000000e4a7908f', 'path': '/dev/dm-10', 'multipath_id': '330000000e4a7908f'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:01:56.667714 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e4a7908f', 'path': '/dev/dm-10', 'multipath_id': '330000000e4a7908f'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 02:01:56.902155 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:56.973459 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-31649cb3-3dc5-4abd-b6b0-8887a5ccec4c req-57330783-3815-48a2-abd1-c7f0cccac2e6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:57.013145 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] End _get_guest_xml xml=<domain type="qemu">
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:   <uuid>e00f21c6-ce7c-4e23-94e2-7f415ae7a9be</uuid>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:   <name>instance-0000002f</name>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:   <metadata>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:       <nova:name>tempest-AttachVolumeTestJSON-server-1763737570</nova:name>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 02:01:56</nova:creationTime>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:       </nova:image>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:         <nova:user uuid="164f3d08de954440bd716afe5eb1054a">tempest-AttachVolumeTestJSON-1276932129-project-member</nova:user>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:         <nova:project uuid="04ce4063a6ac4afdb5ee359a5c1105d3">tempest-AttachVolumeTestJSON-1276932129</nova:project>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:         <nova:port uuid="716e50f8-c111-4e71-92f4-953489d27e91">
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:         </nova:port>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:   </metadata>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:     <system>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:       <entry name="serial">e00f21c6-ce7c-4e23-94e2-7f415ae7a9be</entry>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:       <entry name="uuid">e00f21c6-ce7c-4e23-94e2-7f415ae7a9be</entry>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:     </system>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:   <os>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:   </os>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:   <features>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:     <acpi/>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:     <tcg>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:     </tcg>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:   </features>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:   </cpu>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:   <devices>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/e00f21c6-ce7c-4e23-94e2-7f415ae7a9be/disk"/>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:     </disk>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/e00f21c6-ce7c-4e23-94e2-7f415ae7a9be/disk.config"/>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:     </disk>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:47:cf:5e"/>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:       <target dev="tap716e50f8-c1"/>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:     </interface>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/e00f21c6-ce7c-4e23-94e2-7f415ae7a9be/console.log" append="off"/>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:     </serial>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:     <video>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:     </video>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:     </rng>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:     </memballoon>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:   </devices>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]: </domain>
May 28 02:01:57.013145 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 02:01:57.015538 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Preparing to wait for external event network-vif-plugged-716e50f8-c111-4e71-92f4-953489d27e91 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 02:01:57.015538 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Acquiring lock "e00f21c6-ce7c-4e23-94e2-7f415ae7a9be-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:57.015538 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "e00f21c6-ce7c-4e23-94e2-7f415ae7a9be-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:57.015538 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "e00f21c6-ce7c-4e23-94e2-7f415ae7a9be-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:57.015538 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:01:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1763737570',display_name='tempest-AttachVolumeTestJSON-server-1763737570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-attachvolumetestjson-server-1763737570',id=47,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+oroVq9PObpGX6vhXqHL9PdfqupauFjSmVH9pl6f3ucexstLDQMlshQYswaolt8AzzgMZsugJONkBsIevMQ+uyfaLxfkDnerfPRc09vpJibuIvVolMY45WXkOcX0kd4g==',key_name='tempest-keypair-838001831',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04ce4063a6ac4afdb5ee359a5c1105d3',ramdisk_id='',reservation_id='r-2b0v9i5q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1276932129',owner_user_name='tempest-AttachVolumeTestJSON-1276932129-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:01:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='164f3d08de954440bd716afe5eb1054a',uuid=e00f21c6-ce7c-4e23-94e2-7f415ae7a9be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "716e50f8-c111-4e71-92f4-953489d27e91", "address": "fa:16:3e:47:cf:5e", "network": {"id": "d4bf7f94-4ac7-4145-be11-d2aeeafb6c02", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-972487534-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "04ce4063a6ac4afdb5ee359a5c1105d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap716e50f8-c1", "ovs_interfaceid": "716e50f8-c111-4e71-92f4-953489d27e91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 02:01:57.015538 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Converting VIF {"id": "716e50f8-c111-4e71-92f4-953489d27e91", "address": "fa:16:3e:47:cf:5e", "network": {"id": "d4bf7f94-4ac7-4145-be11-d2aeeafb6c02", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-972487534-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "04ce4063a6ac4afdb5ee359a5c1105d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap716e50f8-c1", "ovs_interfaceid": "716e50f8-c111-4e71-92f4-953489d27e91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:01:57.015994 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:cf:5e,bridge_name='br-int',has_traffic_filtering=True,id=716e50f8-c111-4e71-92f4-953489d27e91,network=Network(d4bf7f94-4ac7-4145-be11-d2aeeafb6c02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap716e50f8-c1') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:01:57.016377 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:cf:5e,bridge_name='br-int',has_traffic_filtering=True,id=716e50f8-c111-4e71-92f4-953489d27e91,network=Network(d4bf7f94-4ac7-4145-be11-d2aeeafb6c02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap716e50f8-c1') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 02:01:57.017043 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:57.017462 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:01:57.017902 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 02:01:57.018897 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:57.019036 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'da75670b-2b2b-5839-8d0b-a01f10982b9a', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:01:57.027293 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:57.028063 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:01:57.030557 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:57.030810 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap716e50f8-c1, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:01:57.031042 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap716e50f8-c1, col_values=(('qos', UUID('4e9a9772-9568-47b8-af32-bd61b1b0ee74')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:01:57.031225 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap716e50f8-c1, col_values=(('external_ids', {'iface-id': '716e50f8-c111-4e71-92f4-953489d27e91', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:cf:5e', 'vm-uuid': 'e00f21c6-ce7c-4e23-94e2-7f415ae7a9be'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:01:57.032033 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:57.033253 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:01:57.039032 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:57.040880 np0000001583 nova-compute[98241]: INFO os_vif [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:cf:5e,bridge_name='br-int',has_traffic_filtering=True,id=716e50f8-c111-4e71-92f4-953489d27e91,network=Network(d4bf7f94-4ac7-4145-be11-d2aeeafb6c02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap716e50f8-c1')
May 28 02:01:57.158126 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-267f6e3c-c2ae-4962-80ee-b7e9a27727ae tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:01:57.158126 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-267f6e3c-c2ae-4962-80ee-b7e9a27727ae tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:01:57.178015 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T02:00:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001583',hostname='multiattach-server-1',id=42,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAP7CI9wuY8JR5OGc0CpqFzQg3rj7cqVgHC4sPYHH38XlmtTRa9WHg3S3WcIsSpd43tWEYYLHF1/yDpoSsozR5Hrjk+cgmLbTDwUHC3YheiC8VnlV/ymBtBFe0b8oxSz5w==',key_name='tempest-keypair-1713929294',keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:00:16Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001583',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0474090f4f2d4950b51bc317f4302266',ramdisk_id='',reservation_id='r-wetp7mrk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-857456921',owner_user_name='tempest-AttachVolumeMultiAttachTest-857456921-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:01:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cadb612e41314b06914d5f5f47570e98',uuid=21c4e225-440e-4103-adaf-cb470d172291,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e52242f-77f4-41cc-ae8f-6a4772243727", "address": "fa:16:3e:57:95:02", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "vif_mac": "fa:16:3e:57:95:02"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e52242f-77", "ovs_interfaceid": "5e52242f-77f4-41cc-ae8f-6a4772243727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 02:01:57.178321 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Converting VIF {"id": "5e52242f-77f4-41cc-ae8f-6a4772243727", "address": "fa:16:3e:57:95:02", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "vif_mac": "fa:16:3e:57:95:02"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e52242f-77", "ovs_interfaceid": "5e52242f-77f4-41cc-ae8f-6a4772243727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:01:57.178906 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:95:02,bridge_name='br-int',has_traffic_filtering=True,id=5e52242f-77f4-41cc-ae8f-6a4772243727,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e52242f-77') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:01:57.180111 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] End _get_guest_xml xml=<domain type="qemu">
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:   <uuid>21c4e225-440e-4103-adaf-cb470d172291</uuid>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:   <name>instance-0000002a</name>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:   <memory>262144</memory>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:   <metadata>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:       <nova:name>multiattach-server-1</nova:name>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 02:01:54</nova:creationTime>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.micro" id="84">
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:         <nova:memory>256</nova:memory>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:       </nova:image>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:         <nova:user uuid="cadb612e41314b06914d5f5f47570e98">tempest-AttachVolumeMultiAttachTest-857456921-project-member</nova:user>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:         <nova:project uuid="0474090f4f2d4950b51bc317f4302266">tempest-AttachVolumeMultiAttachTest-857456921</nova:project>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:         <nova:port uuid="5e52242f-77f4-41cc-ae8f-6a4772243727">
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:         </nova:port>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:   </metadata>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:     <system>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:       <entry name="serial">21c4e225-440e-4103-adaf-cb470d172291</entry>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:       <entry name="uuid">21c4e225-440e-4103-adaf-cb470d172291</entry>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:     </system>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:   <os>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:   </os>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:   <features>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:     <acpi/>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:     <tcg>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:     </tcg>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:   </features>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:   </cpu>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:   <devices>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/disk"/>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:     </disk>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/disk.config"/>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:     </disk>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:     <disk type="block" device="disk">
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:       <alias name="ua-2b9c7b2e-ce89-46a0-a020-361646147ba3"/>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:       <source dev="/dev/dm-10"/>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:       <target dev="vdb" bus="virtio"/>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:       <serial>2b9c7b2e-ce89-46a0-a020-361646147ba3</serial>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:       <shareable/>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:     </disk>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:57:95:02"/>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:       <target dev="tap5e52242f-77"/>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:     </interface>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/console.log" append="off"/>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:     </serial>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:     <video>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:     </video>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:     </rng>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:     </memballoon>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:   </devices>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]: </domain>
May 28 02:01:57.180111 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 02:01:57.182574 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T02:00:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001583',hostname='multiattach-server-1',id=42,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAP7CI9wuY8JR5OGc0CpqFzQg3rj7cqVgHC4sPYHH38XlmtTRa9WHg3S3WcIsSpd43tWEYYLHF1/yDpoSsozR5Hrjk+cgmLbTDwUHC3YheiC8VnlV/ymBtBFe0b8oxSz5w==',key_name='tempest-keypair-1713929294',keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:00:16Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001583',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0474090f4f2d4950b51bc317f4302266',ramdisk_id='',reservation_id='r-wetp7mrk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-857456921',owner_user_name='tempest-AttachVolumeMultiAttachTest-857456921-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:01:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cadb612e41314b06914d5f5f47570e98',uuid=21c4e225-440e-4103-adaf-cb470d172291,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e52242f-77f4-41cc-ae8f-6a4772243727", "address": "fa:16:3e:57:95:02", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "vif_mac": "fa:16:3e:57:95:02"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e52242f-77", "ovs_interfaceid": "5e52242f-77f4-41cc-ae8f-6a4772243727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 02:01:57.182574 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Converting VIF {"id": "5e52242f-77f4-41cc-ae8f-6a4772243727", "address": "fa:16:3e:57:95:02", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "vif_mac": "fa:16:3e:57:95:02"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e52242f-77", "ovs_interfaceid": "5e52242f-77f4-41cc-ae8f-6a4772243727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:01:57.182574 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:95:02,bridge_name='br-int',has_traffic_filtering=True,id=5e52242f-77f4-41cc-ae8f-6a4772243727,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e52242f-77') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:01:57.182574 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:95:02,bridge_name='br-int',has_traffic_filtering=True,id=5e52242f-77f4-41cc-ae8f-6a4772243727,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e52242f-77') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 02:01:57.182574 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:57.182574 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:01:57.182574 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 02:01:57.183131 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:57.183288 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cc43ad20-0ae2-5f84-aeda-cacd8116967e', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:01:57.184049 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:57.184695 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:01:57.190245 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:57.192852 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:57.193033 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e52242f-77, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:01:57.193373 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5e52242f-77, col_values=(('qos', UUID('1f271f25-29a1-48ee-a452-a70be9504532')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:01:57.193525 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5e52242f-77, col_values=(('external_ids', {'iface-id': '5e52242f-77f4-41cc-ae8f-6a4772243727', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:95:02', 'vm-uuid': '21c4e225-440e-4103-adaf-cb470d172291'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:01:57.194487 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:57.195767 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:01:57.207020 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:57.208205 np0000001583 nova-compute[98241]: INFO os_vif [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:95:02,bridge_name='br-int',has_traffic_filtering=True,id=5e52242f-77f4-41cc-ae8f-6a4772243727,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e52242f-77')
May 28 02:01:57.322452 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-31649cb3-3dc5-4abd-b6b0-8887a5ccec4c req-57330783-3815-48a2-abd1-c7f0cccac2e6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:57.460310 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-31649cb3-3dc5-4abd-b6b0-8887a5ccec4c req-57330783-3815-48a2-abd1-c7f0cccac2e6 service nova] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Updated VIF entry in instance network info cache for port 716e50f8-c111-4e71-92f4-953489d27e91. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:01:57.460594 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-31649cb3-3dc5-4abd-b6b0-8887a5ccec4c req-57330783-3815-48a2-abd1-c7f0cccac2e6 service nova] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Updating instance_info_cache with network_info: [{"id": "716e50f8-c111-4e71-92f4-953489d27e91", "address": "fa:16:3e:47:cf:5e", "network": {"id": "d4bf7f94-4ac7-4145-be11-d2aeeafb6c02", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-972487534-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "04ce4063a6ac4afdb5ee359a5c1105d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap716e50f8-c1", "ovs_interfaceid": "716e50f8-c111-4e71-92f4-953489d27e91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:01:57.660928 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-267f6e3c-c2ae-4962-80ee-b7e9a27727ae tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:01:57.962612 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-31649cb3-3dc5-4abd-b6b0-8887a5ccec4c req-57330783-3815-48a2-abd1-c7f0cccac2e6 service nova] Releasing lock "refresh_cache-e00f21c6-ce7c-4e23-94e2-7f415ae7a9be" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:01:58.170302 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-267f6e3c-c2ae-4962-80ee-b7e9a27727ae tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.637s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:58.171499 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.268s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:58.176131 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 02:01:58.176292 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Claim successful on node np0000001583
May 28 02:01:58.248649 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-267f6e3c-c2ae-4962-80ee-b7e9a27727ae tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Deleted allocations for instance 01d8de67-23ab-4430-8512-d2fece776ac2
May 28 02:01:58.263562 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:58.563468 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:01:58.563603 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:01:58.563743 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] No VIF found with MAC fa:16:3e:47:cf:5e, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:01:58.564266 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Using config drive
May 28 02:01:58.731833 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:01:58.732287 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:01:58.732287 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:01:58.732287 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] No VIF found with MAC fa:16:3e:57:95:02, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:01:58.732698 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Using config drive
May 28 02:01:59.069385 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:01:59.193118 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Creating config drive at /opt/stack/data/nova/instances/e00f21c6-ce7c-4e23-94e2-7f415ae7a9be/disk.config
May 28 02:01:59.198320 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:59.209285 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e00f21c6-ce7c-4e23-94e2-7f415ae7a9be/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpi6ots_br {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:01:59.234355 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:59.262433 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-267f6e3c-c2ae-4962-80ee-b7e9a27727ae tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Lock "01d8de67-23ab-4430-8512-d2fece776ac2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.879s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:59.273037 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e00f21c6-ce7c-4e23-94e2-7f415ae7a9be/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpi6ots_br" returned: 0 in 0.064s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:01:59.318457 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:59.396290 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:59.403700 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:59.513030 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-60aa1024-fbbf-4782-8b35-ef077e45ad18 req-8895f3ba-ce71-4495-8356-f8d269da8b79 service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Received event network-vif-plugged-5e52242f-77f4-41cc-ae8f-6a4772243727 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:01:59.513866 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-60aa1024-fbbf-4782-8b35-ef077e45ad18 req-8895f3ba-ce71-4495-8356-f8d269da8b79 service nova] Acquiring lock "21c4e225-440e-4103-adaf-cb470d172291-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:01:59.514400 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-60aa1024-fbbf-4782-8b35-ef077e45ad18 req-8895f3ba-ce71-4495-8356-f8d269da8b79 service nova] Lock "21c4e225-440e-4103-adaf-cb470d172291-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:01:59.514581 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-60aa1024-fbbf-4782-8b35-ef077e45ad18 req-8895f3ba-ce71-4495-8356-f8d269da8b79 service nova] Lock "21c4e225-440e-4103-adaf-cb470d172291-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:01:59.514807 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-60aa1024-fbbf-4782-8b35-ef077e45ad18 req-8895f3ba-ce71-4495-8356-f8d269da8b79 service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] No waiting events found dispatching network-vif-plugged-5e52242f-77f4-41cc-ae8f-6a4772243727 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:01:59.514993 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-60aa1024-fbbf-4782-8b35-ef077e45ad18 req-8895f3ba-ce71-4495-8356-f8d269da8b79 service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Received unexpected event network-vif-plugged-5e52242f-77f4-41cc-ae8f-6a4772243727 for instance with vm_state active and task_state resize_finish.
May 28 02:01:59.857120 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:59.888881 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:59.895315 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:01:59.924232 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:01:59.924620 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:02:00.008909 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:00.213309 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Acquiring lock "c165c9a8-be28-4efe-b671-4dcf9bedfbe4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:00.213869 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Lock "c165c9a8-be28-4efe-b671-4dcf9bedfbe4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:00.213869 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Acquiring lock "c165c9a8-be28-4efe-b671-4dcf9bedfbe4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:00.213869 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Lock "c165c9a8-be28-4efe-b671-4dcf9bedfbe4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:00.213869 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Lock "c165c9a8-be28-4efe-b671-4dcf9bedfbe4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:02:00.217063 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Terminating instance
May 28 02:02:00.308987 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:00.312391 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:00.314998 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:00.341045 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:00.430094 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:02:00.686105 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Removed pending STOPPED event for 21c4e225-440e-4103-adaf-cb470d172291 due to new event <LifecycleEvent: 1779933720.6829562, 21c4e225-440e-4103-adaf-cb470d172291 => Resumed> {{(pid=98241) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 02:02:00.686105 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933720.6829562, 21c4e225-440e-4103-adaf-cb470d172291 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:02:00.686105 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 21c4e225-440e-4103-adaf-cb470d172291] VM Resumed (Lifecycle Event)
May 28 02:02:00.687406 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Instance event wait completed in 0 seconds for  {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 02:02:00.690398 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Instance running successfully.
May 28 02:02:00.691308 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Failed to set time: agent not configured {{(pid=98241) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 28 02:02:00.691466 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-207347e4-b040-4937-9afc-9fa21ff65d68 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] finish_migration finished successfully. {{(pid=98241) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 28 02:02:00.721431 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 02:02:00.755560 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:00.779116 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:00.781407 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:00.809390 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:00.937149 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.767s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:02:00.938457 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 02:02:00.992274 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-22d49c2c-c0c4-4b6b-889a-2bec0d03aad4 req-92fdc767-93f5-4a99-a623-50de740f4b61 service nova] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Received event network-vif-unplugged-a33bea84-56b3-4c8c-8f1c-2c6481551f97 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:02:00.992736 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-22d49c2c-c0c4-4b6b-889a-2bec0d03aad4 req-92fdc767-93f5-4a99-a623-50de740f4b61 service nova] Acquiring lock "c165c9a8-be28-4efe-b671-4dcf9bedfbe4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:00.992884 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-22d49c2c-c0c4-4b6b-889a-2bec0d03aad4 req-92fdc767-93f5-4a99-a623-50de740f4b61 service nova] Lock "c165c9a8-be28-4efe-b671-4dcf9bedfbe4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:00.993017 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-22d49c2c-c0c4-4b6b-889a-2bec0d03aad4 req-92fdc767-93f5-4a99-a623-50de740f4b61 service nova] Lock "c165c9a8-be28-4efe-b671-4dcf9bedfbe4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:02:00.993176 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-22d49c2c-c0c4-4b6b-889a-2bec0d03aad4 req-92fdc767-93f5-4a99-a623-50de740f4b61 service nova] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] No waiting events found dispatching network-vif-unplugged-a33bea84-56b3-4c8c-8f1c-2c6481551f97 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:02:00.993374 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-22d49c2c-c0c4-4b6b-889a-2bec0d03aad4 req-92fdc767-93f5-4a99-a623-50de740f4b61 service nova] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Received event network-vif-unplugged-a33bea84-56b3-4c8c-8f1c-2c6481551f97 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:02:01.064045 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:01.075403 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:01.101530 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Instance destroyed successfully.
May 28 02:02:01.101941 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Lazy-loading 'resources' on Instance uuid c165c9a8-be28-4efe-b671-4dcf9bedfbe4 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:02:01.189711 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:02:01.192782 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:02:01.449243 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 02:02:01.450451 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 1f15126e-6636-4765-8650-bb717f186efe] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 02:02:01.452162 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:02:01.452606 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:02:01.557784 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e1a32813f26c4bb28a681856ad1e9019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae04c11a3de34d419d69e1fdf4c7d311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 02:02:01.566177 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.00043276699989291956 future=<Future at 0x7724f8130e30 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:02:01.566299 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:02:01.566484 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=1.8121625260000656 future=<Future at 0x7724ec2ada00 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:02:01.566676 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=1.8120411730001251 future=<Future at 0x7724ec2ada00 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:02:01.605090 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T02:01:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='instance-depend-image',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:01:53Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='528113b81f2f406da984d1a1fcf5962e',ramdisk_id='',reservation_id='r-310aobtx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_signature_verified='False',owner_project_name='tempest-ImageDependencyTests-349245414',owner_user_name='tempest-ImageDependencyTests-349245414-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T02:01:53Z,user_data=None,user_id='816ff3d1a9244ea8b0c6430e232410e9',uuid=c165c9a8-be28-4efe-b671-4dcf9bedfbe4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a33bea84-56b3-4c8c-8f1c-2c6481551f97", "address": "fa:16:3e:84:ce:c4", "network": {"id": "c60710fd-eeb6-4948-8a84-8b95cae31191", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6b98ce7597d45a6b839c720f99fa1e9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa33bea84-56", "ovs_interfaceid": "a33bea84-56b3-4c8c-8f1c-2c6481551f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:02:01.605278 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Converting VIF {"id": "a33bea84-56b3-4c8c-8f1c-2c6481551f97", "address": "fa:16:3e:84:ce:c4", "network": {"id": "c60710fd-eeb6-4948-8a84-8b95cae31191", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6b98ce7597d45a6b839c720f99fa1e9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa33bea84-56", "ovs_interfaceid": "a33bea84-56b3-4c8c-8f1c-2c6481551f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:02:01.606001 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:ce:c4,bridge_name='br-int',has_traffic_filtering=True,id=a33bea84-56b3-4c8c-8f1c-2c6481551f97,network=Network(c60710fd-eeb6-4948-8a84-8b95cae31191),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa33bea84-56') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:02:01.606336 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:ce:c4,bridge_name='br-int',has_traffic_filtering=True,id=a33bea84-56b3-4c8c-8f1c-2c6481551f97,network=Network(c60710fd-eeb6-4948-8a84-8b95cae31191),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa33bea84-56') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:02:01.608729 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:01.609120 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa33bea84-56, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:02:01.613540 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-24b6f42a-611f-4cf7-ac57-899f0559079a req-64881162-903f-41b6-aff1-9be1f320ad0e service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Received event network-vif-plugged-5e52242f-77f4-41cc-ae8f-6a4772243727 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:02:01.614300 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-24b6f42a-611f-4cf7-ac57-899f0559079a req-64881162-903f-41b6-aff1-9be1f320ad0e service nova] Acquiring lock "21c4e225-440e-4103-adaf-cb470d172291-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:01.614581 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-24b6f42a-611f-4cf7-ac57-899f0559079a req-64881162-903f-41b6-aff1-9be1f320ad0e service nova] Lock "21c4e225-440e-4103-adaf-cb470d172291-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:01.614668 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-24b6f42a-611f-4cf7-ac57-899f0559079a req-64881162-903f-41b6-aff1-9be1f320ad0e service nova] Lock "21c4e225-440e-4103-adaf-cb470d172291-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:02:01.618105 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-24b6f42a-611f-4cf7-ac57-899f0559079a req-64881162-903f-41b6-aff1-9be1f320ad0e service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] No waiting events found dispatching network-vif-plugged-5e52242f-77f4-41cc-ae8f-6a4772243727 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:02:01.618105 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:01.618105 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-24b6f42a-611f-4cf7-ac57-899f0559079a req-64881162-903f-41b6-aff1-9be1f320ad0e service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Received unexpected event network-vif-plugged-5e52242f-77f4-41cc-ae8f-6a4772243727 for instance with vm_state resized and task_state None.
May 28 02:02:01.618105 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-24b6f42a-611f-4cf7-ac57-899f0559079a req-64881162-903f-41b6-aff1-9be1f320ad0e service nova] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Received event network-vif-plugged-716e50f8-c111-4e71-92f4-953489d27e91 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:02:01.618105 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-24b6f42a-611f-4cf7-ac57-899f0559079a req-64881162-903f-41b6-aff1-9be1f320ad0e service nova] Acquiring lock "e00f21c6-ce7c-4e23-94e2-7f415ae7a9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:01.618105 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-24b6f42a-611f-4cf7-ac57-899f0559079a req-64881162-903f-41b6-aff1-9be1f320ad0e service nova] Lock "e00f21c6-ce7c-4e23-94e2-7f415ae7a9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:01.618105 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-24b6f42a-611f-4cf7-ac57-899f0559079a req-64881162-903f-41b6-aff1-9be1f320ad0e service nova] Lock "e00f21c6-ce7c-4e23-94e2-7f415ae7a9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:02:01.618105 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-24b6f42a-611f-4cf7-ac57-899f0559079a req-64881162-903f-41b6-aff1-9be1f320ad0e service nova] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Processing event network-vif-plugged-716e50f8-c111-4e71-92f4-953489d27e91 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 02:02:01.618105 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-24b6f42a-611f-4cf7-ac57-899f0559079a req-64881162-903f-41b6-aff1-9be1f320ad0e service nova] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Received event network-vif-plugged-716e50f8-c111-4e71-92f4-953489d27e91 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:02:01.618105 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-24b6f42a-611f-4cf7-ac57-899f0559079a req-64881162-903f-41b6-aff1-9be1f320ad0e service nova] Acquiring lock "e00f21c6-ce7c-4e23-94e2-7f415ae7a9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:01.618105 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-24b6f42a-611f-4cf7-ac57-899f0559079a req-64881162-903f-41b6-aff1-9be1f320ad0e service nova] Lock "e00f21c6-ce7c-4e23-94e2-7f415ae7a9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:01.618105 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-24b6f42a-611f-4cf7-ac57-899f0559079a req-64881162-903f-41b6-aff1-9be1f320ad0e service nova] Lock "e00f21c6-ce7c-4e23-94e2-7f415ae7a9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:02:01.618105 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-24b6f42a-611f-4cf7-ac57-899f0559079a req-64881162-903f-41b6-aff1-9be1f320ad0e service nova] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] No waiting events found dispatching network-vif-plugged-716e50f8-c111-4e71-92f4-953489d27e91 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:02:01.618105 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-24b6f42a-611f-4cf7-ac57-899f0559079a req-64881162-903f-41b6-aff1-9be1f320ad0e service nova] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Received unexpected event network-vif-plugged-716e50f8-c111-4e71-92f4-953489d27e91 for instance with vm_state building and task_state spawning.
May 28 02:02:01.618915 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 02:02:01.619954 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:02:01.625409 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 02:02:01.627786 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:01.628401 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=411a6e84-3d6d-4248-a896-e4a2f7f36cbf) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:02:01.629269 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:01.630176 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:02:01.632112 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Instance spawned successfully.
May 28 02:02:01.632406 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 02:02:01.638463 np0000001583 nova-compute[98241]: INFO os_vif [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:ce:c4,bridge_name='br-int',has_traffic_filtering=True,id=a33bea84-56b3-4c8c-8f1c-2c6481551f97,network=Network(c60710fd-eeb6-4948-8a84-8b95cae31191),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa33bea84-56')
May 28 02:02:01.643655 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:02:01.644169 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75', 'iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '57c666b1-2380-41ea-bf52-6ab6b2d10c75', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:02:01.644763 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:02:01.645805 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:02:01.646269 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75', 'iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '57c666b1-2380-41ea-bf52-6ab6b2d10c75', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:02:01.646478 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:02:01.687407 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75 (non-flash)
May 28 02:02:01.687407 np0000001583 nova-compute[98241]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75 (non-flash)
May 28 02:02:01.687407 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:01.687407 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:01.687407 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:02:01.687407 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:02:01.687407 np0000001583 nova-compute[98241]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:02:01.687407 np0000001583 nova-compute[98241]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:02:01.687407 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:02:01.687612 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] iscsi session list stdout=tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75 (non-flash)
May 28 02:02:01.687612 np0000001583 nova-compute[98241]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75 (non-flash)
May 28 02:02:01.687612 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:01.687612 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:01.687612 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:02:01.687612 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:02:01.687612 np0000001583 nova-compute[98241]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:02:01.687612 np0000001583 nova-compute[98241]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:02:01.687612 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:02:01.687794 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75', '107'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75', '108'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', '68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', '69'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', '91'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', '92'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be', '98'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be', '99')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:02:01.687895 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75', '107')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:02:01.689023 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75', '108')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:02:01.690037 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f81562a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75'): ({'sdm'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:02:01.690915 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Removing multipathed devices sdl, sdm {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:02:01.691401 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Flush multipath device 3300000005bda7df5 {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:02:01.696424 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 21c4e225-440e-4103-adaf-cb470d172291] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 28 02:02:01.696995 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933721.6967824, 21c4e225-440e-4103-adaf-cb470d172291 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:02:01.697158 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 21c4e225-440e-4103-adaf-cb470d172291] VM Started (Lifecycle Event)
May 28 02:02:01.738550 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:02:01.796780 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:02:01.846962 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Checking to see if SCSI volumes sdl, sdm have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:02:01.847180 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] SCSI volumes sdl, sdm have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:02:01.848594 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Checking to see if device paths {'sdl', 'sdm'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:02:01.867059 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Device paths {'sdl', 'sdm'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:02:01.867059 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:02:01.878139 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:01.922372 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 107, target: iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75, portal: 192.168.40.100,3260]
May 28 02:02:01.922372 np0000001583 nova-compute[98241]: Logout of [sid: 107, target: iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75, portal: 192.168.40.100,3260] successful.
May 28 02:02:01.922372 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:01.941394 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:01.952015 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 02:02:01.957462 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:02.009140 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 108, target: iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75, portal: 192.168.50.100,3260]
May 28 02:02:02.009140 np0000001583 nova-compute[98241]: Logout of [sid: 108, target: iqn.2023-03.storpool.com:os--volume-57c666b1-2380-41ea-bf52-6ab6b2d10c75, portal: 192.168.50.100,3260] successful.
May 28 02:02:02.009140 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:02.040607 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:02.040850 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.395s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:02:02.041064 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] <== disconnect_volume: return (396ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:02:02.041270 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:02:02.041645 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Deleting instance files /opt/stack/data/nova/instances/c165c9a8-be28-4efe-b671-4dcf9bedfbe4_del
May 28 02:02:02.042179 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Deletion of /opt/stack/data/nova/instances/c165c9a8-be28-4efe-b671-4dcf9bedfbe4_del complete
May 28 02:02:02.141642 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:02:02.141797 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:02:02.142125 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:02:02.142944 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:02:02.144278 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Successfully created port: 22bcfb63-43d8-411b-814d-d824a342e51f {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 02:02:02.145629 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:02:02.145902 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:02:02.201262 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:02:02.206295 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:02:02.305438 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "52013bcc-3652-4009-871a-ae37e6ed1c69" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:02.305438 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "52013bcc-3652-4009-871a-ae37e6ed1c69" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:02.457601 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 02:02:02.551202 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Took 1.83 seconds to destroy the instance on the hypervisor.
May 28 02:02:02.552024 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 02:02:02.552639 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 02:02:02.552902 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 02:02:02.553278 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:02:02.635972 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:02:02.657697 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Took 7.52 seconds to spawn the instance on the hypervisor.
May 28 02:02:02.657862 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:02:02.708660 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933722.70828, e00f21c6-ce7c-4e23-94e2-7f415ae7a9be => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:02:02.709838 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] VM Started (Lifecycle Event)
May 28 02:02:02.773369 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Successfully updated port: 22bcfb63-43d8-411b-814d-d824a342e51f {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 02:02:02.807534 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 02:02:02.904828 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-27e1ac5c-47d5-404b-8d81-60539ea5c6b7 req-c342b847-f821-4ebc-95ff-4a813f2a3e20 service nova] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Received event network-changed-22bcfb63-43d8-411b-814d-d824a342e51f {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:02:02.907271 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-27e1ac5c-47d5-404b-8d81-60539ea5c6b7 req-c342b847-f821-4ebc-95ff-4a813f2a3e20 service nova] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Refreshing instance network info cache due to event network-changed-22bcfb63-43d8-411b-814d-d824a342e51f. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:02:02.907390 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-27e1ac5c-47d5-404b-8d81-60539ea5c6b7 req-c342b847-f821-4ebc-95ff-4a813f2a3e20 service nova] Acquiring lock "refresh_cache-1f15126e-6636-4765-8650-bb717f186efe" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:02:02.907536 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-27e1ac5c-47d5-404b-8d81-60539ea5c6b7 req-c342b847-f821-4ebc-95ff-4a813f2a3e20 service nova] Acquired lock "refresh_cache-1f15126e-6636-4765-8650-bb717f186efe" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:02:02.907715 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-27e1ac5c-47d5-404b-8d81-60539ea5c6b7 req-c342b847-f821-4ebc-95ff-4a813f2a3e20 service nova] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Refreshing network info cache for port 22bcfb63-43d8-411b-814d-d824a342e51f {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:02:03.075941 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2b095c40-4f38-4c79-b4e3-e8d7817d933b req-3e6d6669-954b-476c-aafa-53587af7019b service nova] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Received event network-vif-unplugged-a33bea84-56b3-4c8c-8f1c-2c6481551f97 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:02:03.076442 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2b095c40-4f38-4c79-b4e3-e8d7817d933b req-3e6d6669-954b-476c-aafa-53587af7019b service nova] Acquiring lock "c165c9a8-be28-4efe-b671-4dcf9bedfbe4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:03.076442 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2b095c40-4f38-4c79-b4e3-e8d7817d933b req-3e6d6669-954b-476c-aafa-53587af7019b service nova] Lock "c165c9a8-be28-4efe-b671-4dcf9bedfbe4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:03.076528 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2b095c40-4f38-4c79-b4e3-e8d7817d933b req-3e6d6669-954b-476c-aafa-53587af7019b service nova] Lock "c165c9a8-be28-4efe-b671-4dcf9bedfbe4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:02:03.076672 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2b095c40-4f38-4c79-b4e3-e8d7817d933b req-3e6d6669-954b-476c-aafa-53587af7019b service nova] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] No waiting events found dispatching network-vif-unplugged-a33bea84-56b3-4c8c-8f1c-2c6481551f97 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:02:03.076813 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2b095c40-4f38-4c79-b4e3-e8d7817d933b req-3e6d6669-954b-476c-aafa-53587af7019b service nova] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Received event network-vif-unplugged-a33bea84-56b3-4c8c-8f1c-2c6481551f97 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:02:03.077024 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2b095c40-4f38-4c79-b4e3-e8d7817d933b req-3e6d6669-954b-476c-aafa-53587af7019b service nova] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Received event network-vif-deleted-a33bea84-56b3-4c8c-8f1c-2c6481551f97 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:02:03.077144 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-2b095c40-4f38-4c79-b4e3-e8d7817d933b req-3e6d6669-954b-476c-aafa-53587af7019b service nova] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Neutron deleted interface a33bea84-56b3-4c8c-8f1c-2c6481551f97; detaching it from the instance and deleting it from the info cache
May 28 02:02:03.081252 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2b095c40-4f38-4c79-b4e3-e8d7817d933b req-3e6d6669-954b-476c-aafa-53587af7019b service nova] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Detach interface failed, port_id=a33bea84-56b3-4c8c-8f1c-2c6481551f97, reason: Instance c165c9a8-be28-4efe-b671-4dcf9bedfbe4 could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 02:02:03.169421 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Took 13.43 seconds to build instance.
May 28 02:02:03.211805 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:02:03.214768 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:02:03.273545 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:03.275971 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Acquiring lock "refresh_cache-1f15126e-6636-4765-8650-bb717f186efe" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:02:03.342783 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-47f16fc6-6fca-4fc8-81d9-33680d9db401 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "21c4e225-440e-4103-adaf-cb470d172291" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:03.343012 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-47f16fc6-6fca-4fc8-81d9-33680d9db401 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "21c4e225-440e-4103-adaf-cb470d172291" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:03.343252 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-47f16fc6-6fca-4fc8-81d9-33680d9db401 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Going to confirm migration 4 {{(pid=98241) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}}
May 28 02:02:03.379419 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0007652559997950448 future=<Future at 0x7724ec2ada00 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:02:03.379508 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:02:03.379640 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=0.5952008760000354 future=<Future at 0x7724ec2302c0 state=cancelled>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:02:03.379725 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=0.595104818999971 future=<Future at 0x7724ec2302c0 state=cancelled>) was cancelled while queued, skipping {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:02:03.379843 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:02:03.381235 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Emitting event <LifecycleEvent: 1779933708.378566, 294538ef-cf08-4184-8bc2-96598456d113 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:02:03.383442 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=6.727907549000065 future=<Future at 0x7724ec36f140 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:02:03.384241 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:03.384507 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:03.384671 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=6.72664333900002 future=<Future at 0x7724ec36f140 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:02:03.389158 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 294538ef-cf08-4184-8bc2-96598456d113] VM Stopped (Lifecycle Event)
May 28 02:02:03.390940 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 02:02:03.391127 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Claim successful on node np0000001583
May 28 02:02:03.410660 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-27e1ac5c-47d5-404b-8d81-60539ea5c6b7 req-c342b847-f821-4ebc-95ff-4a813f2a3e20 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:02:03.467752 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 02:02:03.469306 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 02:02:03.469601 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Creating image(s)
May 28 02:02:03.470234 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Acquiring lock "/opt/stack/data/nova/instances/1f15126e-6636-4765-8650-bb717f186efe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:03.470367 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "/opt/stack/data/nova/instances/1f15126e-6636-4765-8650-bb717f186efe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:03.470937 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "/opt/stack/data/nova/instances/1f15126e-6636-4765-8650-bb717f186efe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:02:03.471569 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:02:03.479265 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:02:03.484551 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-27e1ac5c-47d5-404b-8d81-60539ea5c6b7 req-c342b847-f821-4ebc-95ff-4a813f2a3e20 service nova] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:02:03.487171 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:02:03.504646 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:02:03.593112 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.105s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:02:03.593112 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:03.593112 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:03.593539 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:02:03.596779 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:02:03.597476 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:02:03.672027 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a7025ea1-2ed9-4ac3-9c01-cb7a2cde3911 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "e00f21c6-ce7c-4e23-94e2-7f415ae7a9be" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.943s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:02:03.675606 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-27e1ac5c-47d5-404b-8d81-60539ea5c6b7 req-c342b847-f821-4ebc-95ff-4a813f2a3e20 service nova] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:02:03.712746 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.115s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:02:03.716185 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/1f15126e-6636-4765-8650-bb717f186efe/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:02:03.734634 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933723.7335649, e00f21c6-ce7c-4e23-94e2-7f415ae7a9be => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:02:03.734863 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] VM Paused (Lifecycle Event)
May 28 02:02:03.784910 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/1f15126e-6636-4765-8650-bb717f186efe/disk 1073741824" returned: 0 in 0.071s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:02:03.788286 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:02:03.788286 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:02:03.850968 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-47f16fc6-6fca-4fc8-81d9-33680d9db401 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:02:03.886230 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.100s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:02:03.889157 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1f15126e-6636-4765-8650-bb717f186efe/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 02:02:03.889157 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f15126e-6636-4765-8650-bb717f186efe/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:02:03.913333 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-4f242062-c782-4e97-b355-4f33775d69ce tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 294538ef-cf08-4184-8bc2-96598456d113] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:02:04.012713 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Took 1.46 seconds to deallocate network for instance.
May 28 02:02:04.019049 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f15126e-6636-4765-8650-bb717f186efe/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:02:04.020508 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Cannot resize image /opt/stack/data/nova/instances/1f15126e-6636-4765-8650-bb717f186efe/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 02:02:04.020508 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 02:02:04.020508 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Ensure instance console log exists: /opt/stack/data/nova/instances/1f15126e-6636-4765-8650-bb717f186efe/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 02:02:04.021197 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:04.021960 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:04.021960 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:02:04.077586 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-47f16fc6-6fca-4fc8-81d9-33680d9db401 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:02:04.078159 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-47f16fc6-6fca-4fc8-81d9-33680d9db401 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "refresh_cache-21c4e225-440e-4103-adaf-cb470d172291" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:02:04.078159 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-47f16fc6-6fca-4fc8-81d9-33680d9db401 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquired lock "refresh_cache-21c4e225-440e-4103-adaf-cb470d172291" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:02:04.078298 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-47f16fc6-6fca-4fc8-81d9-33680d9db401 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:02:04.078493 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-47f16fc6-6fca-4fc8-81d9-33680d9db401 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lazy-loading 'info_cache' on Instance uuid 21c4e225-440e-4103-adaf-cb470d172291 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:02:04.178754 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-27e1ac5c-47d5-404b-8d81-60539ea5c6b7 req-c342b847-f821-4ebc-95ff-4a813f2a3e20 service nova] Releasing lock "refresh_cache-1f15126e-6636-4765-8650-bb717f186efe" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:02:04.179421 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Acquired lock "refresh_cache-1f15126e-6636-4765-8650-bb717f186efe" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:02:04.179634 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:02:04.240532 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:02:04.243520 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999692345000312 future=<Future at 0x7724f82d85f0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:02:04.244146 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933724.243685, e00f21c6-ce7c-4e23-94e2-7f415ae7a9be => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:02:04.245394 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] VM Resumed (Lifecycle Event)
May 28 02:02:04.578893 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Took 0.56 seconds to detach 1 volumes for instance.
May 28 02:02:04.585412 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Deleting volume: 57c666b1-2380-41ea-bf52-6ab6b2d10c75 {{(pid=98241) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 28 02:02:04.749875 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:02:04.755962 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:02:04.785403 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:02:05.054299 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:02:05.083648 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-47f16fc6-6fca-4fc8-81d9-33680d9db401 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:02:05.153344 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:05.205372 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2bdca0c2-5b29-4aa4-b59f-e436d13fc5f7 req-feb014f6-0daf-4757-9293-959e1b930b29 service nova] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Received event network-changed-716e50f8-c111-4e71-92f4-953489d27e91 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:02:05.205544 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2bdca0c2-5b29-4aa4-b59f-e436d13fc5f7 req-feb014f6-0daf-4757-9293-959e1b930b29 service nova] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Refreshing instance network info cache due to event network-changed-716e50f8-c111-4e71-92f4-953489d27e91. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:02:05.207303 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2bdca0c2-5b29-4aa4-b59f-e436d13fc5f7 req-feb014f6-0daf-4757-9293-959e1b930b29 service nova] Acquiring lock "refresh_cache-e00f21c6-ce7c-4e23-94e2-7f415ae7a9be" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:02:05.207303 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2bdca0c2-5b29-4aa4-b59f-e436d13fc5f7 req-feb014f6-0daf-4757-9293-959e1b930b29 service nova] Acquired lock "refresh_cache-e00f21c6-ce7c-4e23-94e2-7f415ae7a9be" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:02:05.207303 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-2bdca0c2-5b29-4aa4-b59f-e436d13fc5f7 req-feb014f6-0daf-4757-9293-959e1b930b29 service nova] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Refreshing network info cache for port 716e50f8-c111-4e71-92f4-953489d27e91 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:02:05.216913 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:02:05.217196 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:02:05.242101 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Updating instance_info_cache with network_info: [{"id": "22bcfb63-43d8-411b-814d-d824a342e51f", "address": "fa:16:3e:c0:11:b8", "network": {"id": "e8c2820e-c0c4-4756-9e11-38375b138d97", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-50364578-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ae04c11a3de34d419d69e1fdf4c7d311", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bcfb63-43", "ovs_interfaceid": "22bcfb63-43d8-411b-814d-d824a342e51f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:02:05.497434 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-47f16fc6-6fca-4fc8-81d9-33680d9db401 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:02:05.697942 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-47f16fc6-6fca-4fc8-81d9-33680d9db401 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Updating instance_info_cache with network_info: [{"id": "5e52242f-77f4-41cc-ae8f-6a4772243727", "address": "fa:16:3e:57:95:02", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e52242f-77", "ovs_interfaceid": "5e52242f-77f4-41cc-ae8f-6a4772243727", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:02:05.712391 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-2bdca0c2-5b29-4aa4-b59f-e436d13fc5f7 req-feb014f6-0daf-4757-9293-959e1b930b29 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:02:05.721597 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:02:05.744778 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Releasing lock "refresh_cache-1f15126e-6636-4765-8650-bb717f186efe" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:02:05.745046 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Instance network_info: |[{"id": "22bcfb63-43d8-411b-814d-d824a342e51f", "address": "fa:16:3e:c0:11:b8", "network": {"id": "e8c2820e-c0c4-4756-9e11-38375b138d97", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-50364578-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ae04c11a3de34d419d69e1fdf4c7d311", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bcfb63-43", "ovs_interfaceid": "22bcfb63-43d8-411b-814d-d824a342e51f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 02:02:05.747558 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Start _get_guest_xml network_info=[{"id": "22bcfb63-43d8-411b-814d-d824a342e51f", "address": "fa:16:3e:c0:11:b8", "network": {"id": "e8c2820e-c0c4-4756-9e11-38375b138d97", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-50364578-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ae04c11a3de34d419d69e1fdf4c7d311", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bcfb63-43", "ovs_interfaceid": "22bcfb63-43d8-411b-814d-d824a342e51f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 02:02:05.751195 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:02:05.752843 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-VolumesBackupsTest-instance-666750424', uuid='1f15126e-6636-4765-8650-bb717f186efe'), owner=OwnerMeta(userid='e1a32813f26c4bb28a681856ad1e9019', username='tempest-VolumesBackupsTest-759555243-project-member', projectid='ae04c11a3de34d419d69e1fdf4c7d311', projectname='tempest-VolumesBackupsTest-759555243'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "22bcfb63-43d8-411b-814d-d824a342e51f", "address": "fa:16:3e:c0:11:b8", "network": {"id": "e8c2820e-c0c4-4756-9e11-38375b138d97", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-50364578-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ae04c11a3de34d419d69e1fdf4c7d311", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bcfb63-43", "ovs_interfaceid": "22bcfb63-43d8-411b-814d-d824a342e51f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933725.7523644) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 02:02:05.754603 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 02:02:05.755028 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 02:02:05.756216 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 02:02:05.756437 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 02:02:05.757920 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 02:02:05.758350 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 02:02:05.758563 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 02:02:05.758730 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 02:02:05.758895 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 02:02:05.759005 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 02:02:05.759199 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 02:02:05.759406 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 02:02:05.759571 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 02:02:05.759730 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 02:02:05.760188 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 02:02:05.760374 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 02:02:05.775844 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:01:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-666750424',display_name='tempest-VolumesBackupsTest-instance-666750424',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-volumesbackupstest-instance-666750424',id=48,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMMeu+rXQ5QXq7ZZqzeBmbPDzr5SyNIppxdAW38M1ouRfyjV+Pzt1aMhSXIRkZ21uVLVx6pazULqJj+PUGCQcNcC2GpJkQJ0/DLNHEnZNHUd6x15IT9Hq/XwOKPm66Yyjg==',key_name='tempest-keypair-1605555645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae04c11a3de34d419d69e1fdf4c7d311',ramdisk_id='',reservation_id='r-hqyn6c94',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-759555243',owner_user_name='tempest-VolumesBackupsTest-759555243-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:02:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1a32813f26c4bb28a681856ad1e9019',uuid=1f15126e-6636-4765-8650-bb717f186efe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22bcfb63-43d8-411b-814d-d824a342e51f", "address": "fa:16:3e:c0:11:b8", "network": {"id": "e8c2820e-c0c4-4756-9e11-38375b138d97", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-50364578-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ae04c11a3de34d419d69e1fdf4c7d311", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bcfb63-43", "ovs_interfaceid": "22bcfb63-43d8-411b-814d-d824a342e51f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 02:02:05.776743 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Converting VIF {"id": "22bcfb63-43d8-411b-814d-d824a342e51f", "address": "fa:16:3e:c0:11:b8", "network": {"id": "e8c2820e-c0c4-4756-9e11-38375b138d97", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-50364578-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ae04c11a3de34d419d69e1fdf4c7d311", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bcfb63-43", "ovs_interfaceid": "22bcfb63-43d8-411b-814d-d824a342e51f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:02:05.777432 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:11:b8,bridge_name='br-int',has_traffic_filtering=True,id=22bcfb63-43d8-411b-814d-d824a342e51f,network=Network(e8c2820e-c0c4-4756-9e11-38375b138d97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22bcfb63-43') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:02:05.778118 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lazy-loading 'pci_devices' on Instance uuid 1f15126e-6636-4765-8650-bb717f186efe {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:02:06.025995 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:06.200296 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-47f16fc6-6fca-4fc8-81d9-33680d9db401 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Releasing lock "refresh_cache-21c4e225-440e-4103-adaf-cb470d172291" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:02:06.200876 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-47f16fc6-6fca-4fc8-81d9-33680d9db401 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lazy-loading 'migration_context' on Instance uuid 21c4e225-440e-4103-adaf-cb470d172291 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:02:06.207761 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-2bdca0c2-5b29-4aa4-b59f-e436d13fc5f7 req-feb014f6-0daf-4757-9293-959e1b930b29 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:02:06.230301 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.846s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:02:06.230716 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 02:02:06.234039 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.080s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:06.280854 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 1f15126e-6636-4765-8650-bb717f186efe] End _get_guest_xml xml=<domain type="qemu">
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:   <uuid>1f15126e-6636-4765-8650-bb717f186efe</uuid>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:   <name>instance-00000030</name>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:   <metadata>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:       <nova:name>tempest-VolumesBackupsTest-instance-666750424</nova:name>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 02:02:05</nova:creationTime>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:       </nova:image>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:         <nova:user uuid="e1a32813f26c4bb28a681856ad1e9019">tempest-VolumesBackupsTest-759555243-project-member</nova:user>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:         <nova:project uuid="ae04c11a3de34d419d69e1fdf4c7d311">tempest-VolumesBackupsTest-759555243</nova:project>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:         <nova:port uuid="22bcfb63-43d8-411b-814d-d824a342e51f">
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:         </nova:port>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:   </metadata>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:     <system>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:       <entry name="serial">1f15126e-6636-4765-8650-bb717f186efe</entry>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:       <entry name="uuid">1f15126e-6636-4765-8650-bb717f186efe</entry>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:     </system>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:   <os>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:   </os>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:   <features>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:     <acpi/>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:     <tcg>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:     </tcg>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:   </features>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:   </cpu>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:   <devices>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/1f15126e-6636-4765-8650-bb717f186efe/disk"/>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:     </disk>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/1f15126e-6636-4765-8650-bb717f186efe/disk.config"/>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:     </disk>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:c0:11:b8"/>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:       <target dev="tap22bcfb63-43"/>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:     </interface>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/1f15126e-6636-4765-8650-bb717f186efe/console.log" append="off"/>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:     </serial>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:     <video>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:     </video>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:     </rng>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:     </memballoon>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:   </devices>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]: </domain>
May 28 02:02:06.280854 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 02:02:06.283796 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Preparing to wait for external event network-vif-plugged-22bcfb63-43d8-411b-814d-d824a342e51f {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 02:02:06.283796 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Acquiring lock "1f15126e-6636-4765-8650-bb717f186efe-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:06.283796 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "1f15126e-6636-4765-8650-bb717f186efe-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:06.283796 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "1f15126e-6636-4765-8650-bb717f186efe-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:02:06.283796 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:01:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-666750424',display_name='tempest-VolumesBackupsTest-instance-666750424',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-volumesbackupstest-instance-666750424',id=48,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMMeu+rXQ5QXq7ZZqzeBmbPDzr5SyNIppxdAW38M1ouRfyjV+Pzt1aMhSXIRkZ21uVLVx6pazULqJj+PUGCQcNcC2GpJkQJ0/DLNHEnZNHUd6x15IT9Hq/XwOKPm66Yyjg==',key_name='tempest-keypair-1605555645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae04c11a3de34d419d69e1fdf4c7d311',ramdisk_id='',reservation_id='r-hqyn6c94',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-759555243',owner_user_name='tempest-VolumesBackupsTest-759555243-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:02:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1a32813f26c4bb28a681856ad1e9019',uuid=1f15126e-6636-4765-8650-bb717f186efe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22bcfb63-43d8-411b-814d-d824a342e51f", "address": "fa:16:3e:c0:11:b8", "network": {"id": "e8c2820e-c0c4-4756-9e11-38375b138d97", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-50364578-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ae04c11a3de34d419d69e1fdf4c7d311", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bcfb63-43", "ovs_interfaceid": "22bcfb63-43d8-411b-814d-d824a342e51f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 02:02:06.283796 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Converting VIF {"id": "22bcfb63-43d8-411b-814d-d824a342e51f", "address": "fa:16:3e:c0:11:b8", "network": {"id": "e8c2820e-c0c4-4756-9e11-38375b138d97", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-50364578-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ae04c11a3de34d419d69e1fdf4c7d311", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bcfb63-43", "ovs_interfaceid": "22bcfb63-43d8-411b-814d-d824a342e51f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:02:06.283796 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:11:b8,bridge_name='br-int',has_traffic_filtering=True,id=22bcfb63-43d8-411b-814d-d824a342e51f,network=Network(e8c2820e-c0c4-4756-9e11-38375b138d97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22bcfb63-43') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:02:06.283796 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:11:b8,bridge_name='br-int',has_traffic_filtering=True,id=22bcfb63-43d8-411b-814d-d824a342e51f,network=Network(e8c2820e-c0c4-4756-9e11-38375b138d97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22bcfb63-43') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 02:02:06.285548 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:06.285548 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:02:06.285548 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 02:02:06.288909 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:06.289147 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '37044414-4b63-5222-a117-b93b44259838', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:02:06.289968 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:06.290825 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:02:06.291944 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:06.301980 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:06.301980 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22bcfb63-43, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:02:06.301980 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap22bcfb63-43, col_values=(('qos', UUID('d6ee9aff-6652-49b9-83de-dd0308d4439f')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:02:06.301980 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap22bcfb63-43, col_values=(('external_ids', {'iface-id': '22bcfb63-43d8-411b-814d-d824a342e51f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:11:b8', 'vm-uuid': '1f15126e-6636-4765-8650-bb717f186efe'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:02:06.302657 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:06.304727 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:02:06.309356 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:06.310372 np0000001583 nova-compute[98241]: INFO os_vif [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:11:b8,bridge_name='br-int',has_traffic_filtering=True,id=22bcfb63-43d8-411b-814d-d824a342e51f,network=Network(e8c2820e-c0c4-4756-9e11-38375b138d97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22bcfb63-43')
May 28 02:02:06.431113 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-2bdca0c2-5b29-4aa4-b59f-e436d13fc5f7 req-feb014f6-0daf-4757-9293-959e1b930b29 service nova] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Updated VIF entry in instance network info cache for port 716e50f8-c111-4e71-92f4-953489d27e91. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:02:06.431416 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-2bdca0c2-5b29-4aa4-b59f-e436d13fc5f7 req-feb014f6-0daf-4757-9293-959e1b930b29 service nova] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Updating instance_info_cache with network_info: [{"id": "716e50f8-c111-4e71-92f4-953489d27e91", "address": "fa:16:3e:47:cf:5e", "network": {"id": "d4bf7f94-4ac7-4145-be11-d2aeeafb6c02", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-972487534-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "04ce4063a6ac4afdb5ee359a5c1105d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap716e50f8-c1", "ovs_interfaceid": "716e50f8-c111-4e71-92f4-953489d27e91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:02:06.703777 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-47f16fc6-6fca-4fc8-81d9-33680d9db401 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Object Instance<21c4e225-440e-4103-adaf-cb470d172291> lazy-loaded attributes: info_cache,migration_context {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 02:02:06.710569 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-47f16fc6-6fca-4fc8-81d9-33680d9db401 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:06.748134 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 02:02:06.748421 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 02:02:06.748803 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:02:06.749182 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:02:06.874353 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6be314b4eed642c3b2c72fe115860220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432aa1094ced436494def17a875aa8e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 02:02:06.933849 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2bdca0c2-5b29-4aa4-b59f-e436d13fc5f7 req-feb014f6-0daf-4757-9293-959e1b930b29 service nova] Releasing lock "refresh_cache-e00f21c6-ce7c-4e23-94e2-7f415ae7a9be" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:02:06.951752 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:02:06.952159 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:02:07.254767 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 02:02:07.455732 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:02:07.554800 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Successfully created port: fcd776c5-1b40-47c2-9fb8-71d523362404 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 02:02:07.760177 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 02:02:07.834604 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:02:07.834771 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:02:07.834905 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] No VIF found with MAC fa:16:3e:c0:11:b8, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:02:07.835488 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Using config drive
May 28 02:02:07.965507 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.732s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:02:07.967784 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-47f16fc6-6fca-4fc8-81d9-33680d9db401 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 1.256s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:08.028357 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Deleted allocations for instance c165c9a8-be28-4efe-b671-4dcf9bedfbe4
May 28 02:02:08.200288 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Successfully updated port: fcd776c5-1b40-47c2-9fb8-71d523362404 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 02:02:08.265161 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Booting with volume 3cbdb2bf-538c-469a-bef3-675c0c55ac86 at /dev/vda
May 28 02:02:08.279964 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-77419b62-b713-46fa-a825-c258f2e7de2c req-bc87786f-2cbc-4141-b40a-248c33de48c4 service nova] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Received event network-changed-fcd776c5-1b40-47c2-9fb8-71d523362404 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:02:08.280757 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:08.280981 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-77419b62-b713-46fa-a825-c258f2e7de2c req-bc87786f-2cbc-4141-b40a-248c33de48c4 service nova] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Refreshing instance network info cache due to event network-changed-fcd776c5-1b40-47c2-9fb8-71d523362404. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:02:08.283522 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-77419b62-b713-46fa-a825-c258f2e7de2c req-bc87786f-2cbc-4141-b40a-248c33de48c4 service nova] Acquiring lock "refresh_cache-52013bcc-3652-4009-871a-ae37e6ed1c69" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:02:08.283522 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-77419b62-b713-46fa-a825-c258f2e7de2c req-bc87786f-2cbc-4141-b40a-248c33de48c4 service nova] Acquired lock "refresh_cache-52013bcc-3652-4009-871a-ae37e6ed1c69" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:02:08.283598 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-77419b62-b713-46fa-a825-c258f2e7de2c req-bc87786f-2cbc-4141-b40a-248c33de48c4 service nova] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Refreshing network info cache for port fcd776c5-1b40-47c2-9fb8-71d523362404 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:02:08.344668 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:02:08.353381 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:02:08.374213 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 02:02:08.408304 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:02:08.479353 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 02:02:08.479759 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 02:02:08.492717 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 02:02:08.495871 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe48:7d7b', 'fe80::d0cf:7bff:fef9:3cc3', 'fe80::fc16:3eff:fed3:cd06', 'fe80::fc16:3eff:fedf:4521', 'fe80::fc16:3eff:fe76:c53f', 'fe80::fc16:3eff:fe1e:c373', 'fe80::9020:88ff:fe40:d02', 'fe80::fc16:3eff:fe57:9502', 'fe80::fc16:3eff:fe47:cf5e', 'fe80::5048:4dff:fe67:fb12'] 
May 28 02:02:08.495871 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 02:02:08.495871 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 02:02:08.496158 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:02:08.496158 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Updating existing volume attachment record: 4e1da3f6-887a-443d-8cfb-c56ce0178059 {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 02:02:08.581530 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Creating config drive at /opt/stack/data/nova/instances/1f15126e-6636-4765-8650-bb717f186efe/disk.config
May 28 02:02:08.591046 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1f15126e-6636-4765-8650-bb717f186efe/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpvpawy7_1 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:02:08.665029 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1f15126e-6636-4765-8650-bb717f186efe/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpvpawy7_1" returned: 0 in 0.073s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:02:08.705103 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "refresh_cache-52013bcc-3652-4009-871a-ae37e6ed1c69" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:02:08.788612 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-77419b62-b713-46fa-a825-c258f2e7de2c req-bc87786f-2cbc-4141-b40a-248c33de48c4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:02:08.873720 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-77419b62-b713-46fa-a825-c258f2e7de2c req-bc87786f-2cbc-4141-b40a-248c33de48c4 service nova] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:02:09.053631 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1fcb4f64-1870-4942-97ba-cc0eb054911a tempest-ImageDependencyTests-349245414 tempest-ImageDependencyTests-349245414-project-member] Lock "c165c9a8-be28-4efe-b671-4dcf9bedfbe4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.840s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:02:09.105977 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-77419b62-b713-46fa-a825-c258f2e7de2c req-bc87786f-2cbc-4141-b40a-248c33de48c4 service nova] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:02:09.193341 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:09.198980 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-47f16fc6-6fca-4fc8-81d9-33680d9db401 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:02:09.199328 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-47f16fc6-6fca-4fc8-81d9-33680d9db401 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:02:09.217856 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:09.223205 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:09.347457 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:09.536217 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-4db6bdb5-0dc4-4fb8-8e6d-55214d291856 req-ea705a36-d7ae-448d-8a90-6ec8f47961bd service nova] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Received event network-vif-plugged-22bcfb63-43d8-411b-814d-d824a342e51f {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:02:09.536946 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-4db6bdb5-0dc4-4fb8-8e6d-55214d291856 req-ea705a36-d7ae-448d-8a90-6ec8f47961bd service nova] Acquiring lock "1f15126e-6636-4765-8650-bb717f186efe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:09.537899 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-4db6bdb5-0dc4-4fb8-8e6d-55214d291856 req-ea705a36-d7ae-448d-8a90-6ec8f47961bd service nova] Lock "1f15126e-6636-4765-8650-bb717f186efe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:09.537899 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-4db6bdb5-0dc4-4fb8-8e6d-55214d291856 req-ea705a36-d7ae-448d-8a90-6ec8f47961bd service nova] Lock "1f15126e-6636-4765-8650-bb717f186efe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:02:09.537899 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-4db6bdb5-0dc4-4fb8-8e6d-55214d291856 req-ea705a36-d7ae-448d-8a90-6ec8f47961bd service nova] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Processing event network-vif-plugged-22bcfb63-43d8-411b-814d-d824a342e51f {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 02:02:09.608233 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-77419b62-b713-46fa-a825-c258f2e7de2c req-bc87786f-2cbc-4141-b40a-248c33de48c4 service nova] Releasing lock "refresh_cache-52013bcc-3652-4009-871a-ae37e6ed1c69" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:02:09.608919 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquired lock "refresh_cache-52013bcc-3652-4009-871a-ae37e6ed1c69" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:02:09.609161 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:02:09.626322 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:09.630214 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:09.637148 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:09.665705 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:09.703172 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-47f16fc6-6fca-4fc8-81d9-33680d9db401 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:02:10.118390 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.00700824100022146 future=<Future at 0x7724ec36f140 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:02:10.118530 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:02:10.118641 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=9.124540957000136 future=<Future at 0x7724f82d85f0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:02:10.118743 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=9.124432076000176 future=<Future at 0x7724f82d85f0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:02:10.120819 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Emitting event <LifecycleEvent: 1779933715.111239, 01d8de67-23ab-4430-8512-d2fece776ac2 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:02:10.120964 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] VM Stopped (Lifecycle Event)
May 28 02:02:10.194773 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:02:10.345621 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 02:02:10.346206 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933730.3458145, 1f15126e-6636-4765-8650-bb717f186efe => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:02:10.346405 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 1f15126e-6636-4765-8650-bb717f186efe] VM Started (Lifecycle Event)
May 28 02:02:10.348873 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 02:02:10.353734 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Instance spawned successfully.
May 28 02:02:10.353734 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 02:02:10.400806 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:02:10.574214 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Updating instance_info_cache with network_info: [{"id": "fcd776c5-1b40-47c2-9fb8-71d523362404", "address": "fa:16:3e:9e:36:ca", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd776c5-1b", "ovs_interfaceid": "fcd776c5-1b40-47c2-9fb8-71d523362404", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:02:10.624817 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-291cd946-6b13-4c3e-aac3-e11a4b685beb tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 01d8de67-23ab-4430-8512-d2fece776ac2] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:02:10.654111 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 02:02:10.655841 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 02:02:10.656277 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Creating image(s)
May 28 02:02:10.658619 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Did not create local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 02:02:10.658619 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Ensure instance console log exists: /opt/stack/data/nova/instances/52013bcc-3652-4009-871a-ae37e6ed1c69/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 02:02:10.658619 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:10.658619 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:10.658619 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:02:10.720974 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-47f16fc6-6fca-4fc8-81d9-33680d9db401 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 2.754s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:02:10.852282 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:02:10.854380 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:02:10.862369 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:02:10.862538 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:02:10.863533 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:02:10.863933 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:02:10.864875 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:02:10.865287 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:02:11.076347 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Releasing lock "refresh_cache-52013bcc-3652-4009-871a-ae37e6ed1c69" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:02:11.076743 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Instance network_info: |[{"id": "fcd776c5-1b40-47c2-9fb8-71d523362404", "address": "fa:16:3e:9e:36:ca", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd776c5-1b", "ovs_interfaceid": "fcd776c5-1b40-47c2-9fb8-71d523362404", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 02:02:11.078013 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Start _get_guest_xml network_info=[{"id": "fcd776c5-1b40-47c2-9fb8-71d523362404", "address": "fa:16:3e:9e:36:ca", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd776c5-1b", "ovs_interfaceid": "fcd776c5-1b40-47c2-9fb8-71d523362404", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86', 'iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3cbdb2bf-538c-469a-bef3-675c0c55ac86', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '52013bcc-3652-4009-871a-ae37e6ed1c69', 'attached_at': '', 'detached_at': '', 'volume_id': '3cbdb2bf-538c-469a-bef3-675c0c55ac86', 'serial': '3cbdb2bf-538c-469a-bef3-675c0c55ac86'}, 'delete_on_termination': True, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '4e1da3f6-887a-443d-8cfb-c56ce0178059', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 02:02:11.082823 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:02:11.084760 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-volume-backed-server-1488296031', uuid='52013bcc-3652-4009-871a-ae37e6ed1c69'), owner=OwnerMeta(userid='6be314b4eed642c3b2c72fe115860220', username='tempest-TestVolumeBootPattern-1031057169-project-member', projectid='432aa1094ced436494def17a875aa8e1', projectname='tempest-TestVolumeBootPattern-1031057169'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "fcd776c5-1b40-47c2-9fb8-71d523362404", "address": "fa:16:3e:9e:36:ca", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd776c5-1b", "ovs_interfaceid": "fcd776c5-1b40-47c2-9fb8-71d523362404", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933731.0842016) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 02:02:11.086832 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 02:02:11.087384 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 02:02:11.090149 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 02:02:11.090149 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 02:02:11.091817 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 02:02:11.092334 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 02:02:11.092642 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 02:02:11.092842 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 02:02:11.093069 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 02:02:11.093271 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 02:02:11.093491 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 02:02:11.094107 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 02:02:11.094170 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 02:02:11.094441 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 02:02:11.094642 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 02:02:11.094907 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 02:02:11.110140 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 02:02:11.110779 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86', 'iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3cbdb2bf-538c-469a-bef3-675c0c55ac86', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:02:11.111003 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:02:11.111476 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:02:11.112221 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86', 'iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3cbdb2bf-538c-469a-bef3-675c0c55ac86', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 02:02:11.129382 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:02:11.130884 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:02:11.130884 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:02:11.130884 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:02:11.131216 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:02:11.131508 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:02:11.151370 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:02:11.151370 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:11.157513 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:02:11.157513 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:11.168996 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86] added
May 28 02:02:11.168996 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:02:11.168996 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:02:11.168996 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:02:11.168996 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:02:11.168996 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:02:11.168996 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:11.169376 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:02:11.169601 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0387(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:02:11.170709 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:02:11.176128 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86] added
May 28 02:02:11.176128 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:02:11.176128 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:02:11.176128 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:02:11.176128 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:02:11.176128 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:02:11.176128 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:11.176128 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:02:11.176128 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0444(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:02:11.176128 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:02:11.316843 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:11.359861 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 1f15126e-6636-4765-8650-bb717f186efe] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 02:02:11.360442 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933731.3599262, 1f15126e-6636-4765-8650-bb717f186efe => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:02:11.360442 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 1f15126e-6636-4765-8650-bb717f186efe] VM Paused (Lifecycle Event)
May 28 02:02:11.373145 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Took 7.90 seconds to spawn the instance on the hypervisor.
May 28 02:02:11.373408 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:02:11.419182 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-47f16fc6-6fca-4fc8-81d9-33680d9db401 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Deleted allocation for migration 7e6245d5-e475-47d6-abb2-2a3c1ecf39bf
May 28 02:02:11.612204 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-72223e11-572e-4a6d-8044-83aa28c78699 req-bc8ee04c-5344-46a1-b526-d48ba4de1a97 service nova] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Received event network-vif-plugged-22bcfb63-43d8-411b-814d-d824a342e51f {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:02:11.612947 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-72223e11-572e-4a6d-8044-83aa28c78699 req-bc8ee04c-5344-46a1-b526-d48ba4de1a97 service nova] Acquiring lock "1f15126e-6636-4765-8650-bb717f186efe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:11.612947 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-72223e11-572e-4a6d-8044-83aa28c78699 req-bc8ee04c-5344-46a1-b526-d48ba4de1a97 service nova] Lock "1f15126e-6636-4765-8650-bb717f186efe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:11.613051 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-72223e11-572e-4a6d-8044-83aa28c78699 req-bc8ee04c-5344-46a1-b526-d48ba4de1a97 service nova] Lock "1f15126e-6636-4765-8650-bb717f186efe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:02:11.613161 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-72223e11-572e-4a6d-8044-83aa28c78699 req-bc8ee04c-5344-46a1-b526-d48ba4de1a97 service nova] [instance: 1f15126e-6636-4765-8650-bb717f186efe] No waiting events found dispatching network-vif-plugged-22bcfb63-43d8-411b-814d-d824a342e51f {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:02:11.613278 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-72223e11-572e-4a6d-8044-83aa28c78699 req-bc8ee04c-5344-46a1-b526-d48ba4de1a97 service nova] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Received unexpected event network-vif-plugged-22bcfb63-43d8-411b-814d-d824a342e51f for instance with vm_state active and task_state None.
May 28 02:02:11.862752 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:02:11.865265 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933731.8649366, 1f15126e-6636-4765-8650-bb717f186efe => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:02:11.865462 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 1f15126e-6636-4765-8650-bb717f186efe] VM Resumed (Lifecycle Event)
May 28 02:02:11.886672 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Took 15.04 seconds to build instance.
May 28 02:02:11.925107 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-47f16fc6-6fca-4fc8-81d9-33680d9db401 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "21c4e225-440e-4103-adaf-cb470d172291" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 8.580s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:02:12.170411 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:02:12.176398 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:02:12.186998 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:02:12.186998 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:02:12.191121 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:02:12.191121 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:12.205840 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:12.211701 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:12.224723 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:12.224723 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:12.224723 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:02:12.224723 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:02:12.224723 np0000001583 nova-compute[98241]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:02:12.224723 np0000001583 nova-compute[98241]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:02:12.224723 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:02:12.224992 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:12.224992 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:12.224992 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:02:12.224992 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:02:12.224992 np0000001583 nova-compute[98241]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:02:12.224992 np0000001583 nova-compute[98241]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:02:12.224992 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:02:12.242295 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:12.242295 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:12.242295 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:02:12.242295 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:02:12.242295 np0000001583 nova-compute[98241]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:02:12.242295 np0000001583 nova-compute[98241]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:02:12.242295 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:02:12.242295 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:12.242295 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:12.242295 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:02:12.242295 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:02:12.242295 np0000001583 nova-compute[98241]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:02:12.242295 np0000001583 nova-compute[98241]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:02:12.242295 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:02:12.271261 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86, portal: 192.168.40.100,3260]
May 28 02:02:12.271261 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86, portal: 192.168.40.100,3260] successful.
May 28 02:02:12.271261 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:12.293608 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:12.295370 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86, portal: 192.168.50.100,3260]
May 28 02:02:12.295370 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86, portal: 192.168.50.100,3260] successful.
May 28 02:02:12.295370 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:12.313182 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:12.313182 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:12.313182 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:12.313182 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:12.313182 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:02:12.313182 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:02:12.313182 np0000001583 nova-compute[98241]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:02:12.313182 np0000001583 nova-compute[98241]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:02:12.313182 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:02:12.313554 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:12.313554 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:12.313554 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:12.313554 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:12.313554 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:02:12.313554 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:02:12.313554 np0000001583 nova-compute[98241]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:02:12.313554 np0000001583 nova-compute[98241]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:02:12.313554 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:02:12.314909 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.184s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:02:12.315120 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:02:12.316582 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:12.317951 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] HCTL ('9', '-', '-', 0) found on session 109 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:02:12.318228 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:02:12.344467 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:12.344467 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:12.344467 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:12.344467 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:12.344467 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:02:12.344467 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:02:12.344467 np0000001583 nova-compute[98241]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:02:12.344467 np0000001583 nova-compute[98241]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:02:12.344467 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:02:12.344467 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:12.344467 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:12.344467 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:12.344467 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:12.344467 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:02:12.344467 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:02:12.344467 np0000001583 nova-compute[98241]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:02:12.344467 np0000001583 nova-compute[98241]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:02:12.344467 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:02:12.344467 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.212s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:02:12.344467 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:02:12.344467 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] HCTL ('12', '-', '-', 0) found on session 110 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:02:12.344467 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:02:12.356994 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Searching for a device in session 109 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:02:12.358482 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3cbdb2bf-538c-469a-bef3-675c0c55ac86', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:02:12.374754 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:02:12.374754 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:02:12.377368 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Searching for a device in session 110 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:02:12.377368 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3cbdb2bf-538c-469a-bef3-675c0c55ac86', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:02:12.389869 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e7298938-e3d2-4b62-9a6d-6c20196ab3a7 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "1f15126e-6636-4765-8650-bb717f186efe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.551s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:02:13.131576 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 02:02:13.277663 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:13.656029 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f7de4eac-6329-41b1-b57a-4ccee82de980 req-e78c5af5-0450-44f3-a906-511406080741 service nova] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Received event network-changed-22bcfb63-43d8-411b-814d-d824a342e51f {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:02:13.656469 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f7de4eac-6329-41b1-b57a-4ccee82de980 req-e78c5af5-0450-44f3-a906-511406080741 service nova] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Refreshing instance network info cache due to event network-changed-22bcfb63-43d8-411b-814d-d824a342e51f. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:02:13.656677 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f7de4eac-6329-41b1-b57a-4ccee82de980 req-e78c5af5-0450-44f3-a906-511406080741 service nova] Acquiring lock "refresh_cache-1f15126e-6636-4765-8650-bb717f186efe" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:02:13.656840 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f7de4eac-6329-41b1-b57a-4ccee82de980 req-e78c5af5-0450-44f3-a906-511406080741 service nova] Acquired lock "refresh_cache-1f15126e-6636-4765-8650-bb717f186efe" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:02:13.657061 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-f7de4eac-6329-41b1-b57a-4ccee82de980 req-e78c5af5-0450-44f3-a906-511406080741 service nova] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Refreshing network info cache for port 22bcfb63-43d8-411b-814d-d824a342e51f {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:02:13.702030 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2f9e1425-581a-4c91-800f-d067e144907b req-4597fa20-441c-4fff-804f-1c49616385ad service nova] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Received event network-changed-77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:02:13.702448 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2f9e1425-581a-4c91-800f-d067e144907b req-4597fa20-441c-4fff-804f-1c49616385ad service nova] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Refreshing instance network info cache due to event network-changed-77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:02:13.702692 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2f9e1425-581a-4c91-800f-d067e144907b req-4597fa20-441c-4fff-804f-1c49616385ad service nova] Acquiring lock "refresh_cache-8b2a5f31-1b3d-447f-939e-94fd0be5eb85" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:02:13.703092 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2f9e1425-581a-4c91-800f-d067e144907b req-4597fa20-441c-4fff-804f-1c49616385ad service nova] Acquired lock "refresh_cache-8b2a5f31-1b3d-447f-939e-94fd0be5eb85" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:02:13.703092 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-2f9e1425-581a-4c91-800f-d067e144907b req-4597fa20-441c-4fff-804f-1c49616385ad service nova] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Refreshing network info cache for port 77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:02:14.149665 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Found WWN 330000000a2c0b59b for multipath device dm-4 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 02:02:14.149908 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:02:14.150060 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '330000000a2c0b59b', 'path': '/dev/dm-4', 'multipath_id': '330000000a2c0b59b'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:02:14.150324 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a2c0b59b', 'path': '/dev/dm-4', 'multipath_id': '330000000a2c0b59b'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 02:02:14.165413 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-f7de4eac-6329-41b1-b57a-4ccee82de980 req-e78c5af5-0450-44f3-a906-511406080741 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:02:14.208099 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-2f9e1425-581a-4c91-800f-d067e144907b req-4597fa20-441c-4fff-804f-1c49616385ad service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:02:14.575401 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-f7de4eac-6329-41b1-b57a-4ccee82de980 req-e78c5af5-0450-44f3-a906-511406080741 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:02:14.632259 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-2f9e1425-581a-4c91-800f-d067e144907b req-4597fa20-441c-4fff-804f-1c49616385ad service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:02:14.660892 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:02:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1488296031',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1488296031',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testvolumebootpattern-volume-backed-server-1488296031',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIw+Ze1rkggC7xQeXQuOA1lohwYh9c3tEWdnm04uSqmAuJm+YnW437cgGsA97PJoCju0t5wWsAAFhCPQ46MQsLgCx3FLqk8KzbNg3l90OkEY54OQO0Xz/B0dbHkEuwAFIw==',key_name='tempest-keypair-2048497990',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='432aa1094ced436494def17a875aa8e1',ramdisk_id='',reservation_id='r-2ypah9tm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1031057169',owner_user_name='tempest-TestVolumeBootPattern-1031057169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:02:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6be314b4eed642c3b2c72fe115860220',uuid=52013bcc-3652-4009-871a-ae37e6ed1c69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fcd776c5-1b40-47c2-9fb8-71d523362404", "address": "fa:16:3e:9e:36:ca", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd776c5-1b", "ovs_interfaceid": "fcd776c5-1b40-47c2-9fb8-71d523362404", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 02:02:14.660892 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converting VIF {"id": "fcd776c5-1b40-47c2-9fb8-71d523362404", "address": "fa:16:3e:9e:36:ca", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd776c5-1b", "ovs_interfaceid": "fcd776c5-1b40-47c2-9fb8-71d523362404", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:02:14.661735 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:36:ca,bridge_name='br-int',has_traffic_filtering=True,id=fcd776c5-1b40-47c2-9fb8-71d523362404,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcd776c5-1b') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:02:14.666474 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lazy-loading 'pci_devices' on Instance uuid 52013bcc-3652-4009-871a-ae37e6ed1c69 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:02:14.741486 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-f7de4eac-6329-41b1-b57a-4ccee82de980 req-e78c5af5-0450-44f3-a906-511406080741 service nova] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Updated VIF entry in instance network info cache for port 22bcfb63-43d8-411b-814d-d824a342e51f. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:02:14.741810 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-f7de4eac-6329-41b1-b57a-4ccee82de980 req-e78c5af5-0450-44f3-a906-511406080741 service nova] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Updating instance_info_cache with network_info: [{"id": "22bcfb63-43d8-411b-814d-d824a342e51f", "address": "fa:16:3e:c0:11:b8", "network": {"id": "e8c2820e-c0c4-4756-9e11-38375b138d97", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-50364578-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ae04c11a3de34d419d69e1fdf4c7d311", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bcfb63-43", "ovs_interfaceid": "22bcfb63-43d8-411b-814d-d824a342e51f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:02:14.802726 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-2f9e1425-581a-4c91-800f-d067e144907b req-4597fa20-441c-4fff-804f-1c49616385ad service nova] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Updated VIF entry in instance network info cache for port 77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:02:14.803012 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-2f9e1425-581a-4c91-800f-d067e144907b req-4597fa20-441c-4fff-804f-1c49616385ad service nova] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Updating instance_info_cache with network_info: [{"id": "77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0", "address": "fa:16:3e:76:c5:3f", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77a0d5b8-3f", "ovs_interfaceid": "77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:02:15.173223 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] End _get_guest_xml xml=<domain type="qemu">
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:   <uuid>52013bcc-3652-4009-871a-ae37e6ed1c69</uuid>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:   <name>instance-00000031</name>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:   <metadata>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1488296031</nova:name>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 02:02:11</nova:creationTime>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:       <nova:image uuid="">
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:       </nova:image>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:         <nova:user uuid="6be314b4eed642c3b2c72fe115860220">tempest-TestVolumeBootPattern-1031057169-project-member</nova:user>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:         <nova:project uuid="432aa1094ced436494def17a875aa8e1">tempest-TestVolumeBootPattern-1031057169</nova:project>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:       <nova:root type="volume" uuid=""/>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:         <nova:port uuid="fcd776c5-1b40-47c2-9fb8-71d523362404">
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:         </nova:port>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:   </metadata>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:     <system>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:       <entry name="serial">52013bcc-3652-4009-871a-ae37e6ed1c69</entry>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:       <entry name="uuid">52013bcc-3652-4009-871a-ae37e6ed1c69</entry>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:     </system>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:   <os>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:   </os>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:   <features>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:     <acpi/>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:     <tcg>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:     </tcg>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:   </features>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:   </cpu>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:   <devices>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/52013bcc-3652-4009-871a-ae37e6ed1c69/disk.config"/>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:     </disk>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:     <disk type="block" device="disk">
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:       <alias name="ua-3cbdb2bf-538c-469a-bef3-675c0c55ac86"/>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:       <source dev="/dev/dm-4"/>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:       <serial>3cbdb2bf-538c-469a-bef3-675c0c55ac86</serial>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:     </disk>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:9e:36:ca"/>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:       <target dev="tapfcd776c5-1b"/>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:     </interface>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/52013bcc-3652-4009-871a-ae37e6ed1c69/console.log" append="off"/>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:     </serial>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:     <video>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:     </video>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:     </rng>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:     </memballoon>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:   </devices>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]: </domain>
May 28 02:02:15.173223 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 02:02:15.173223 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Preparing to wait for external event network-vif-plugged-fcd776c5-1b40-47c2-9fb8-71d523362404 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 02:02:15.173223 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "52013bcc-3652-4009-871a-ae37e6ed1c69-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:15.173223 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "52013bcc-3652-4009-871a-ae37e6ed1c69-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:15.173223 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "52013bcc-3652-4009-871a-ae37e6ed1c69-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:02:15.173223 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:02:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1488296031',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1488296031',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testvolumebootpattern-volume-backed-server-1488296031',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIw+Ze1rkggC7xQeXQuOA1lohwYh9c3tEWdnm04uSqmAuJm+YnW437cgGsA97PJoCju0t5wWsAAFhCPQ46MQsLgCx3FLqk8KzbNg3l90OkEY54OQO0Xz/B0dbHkEuwAFIw==',key_name='tempest-keypair-2048497990',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='432aa1094ced436494def17a875aa8e1',ramdisk_id='',reservation_id='r-2ypah9tm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1031057169',owner_user_name='tempest-TestVolumeBootPattern-1031057169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:02:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6be314b4eed642c3b2c72fe115860220',uuid=52013bcc-3652-4009-871a-ae37e6ed1c69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fcd776c5-1b40-47c2-9fb8-71d523362404", "address": "fa:16:3e:9e:36:ca", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd776c5-1b", "ovs_interfaceid": "fcd776c5-1b40-47c2-9fb8-71d523362404", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 02:02:15.173223 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converting VIF {"id": "fcd776c5-1b40-47c2-9fb8-71d523362404", "address": "fa:16:3e:9e:36:ca", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd776c5-1b", "ovs_interfaceid": "fcd776c5-1b40-47c2-9fb8-71d523362404", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:02:15.176679 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:36:ca,bridge_name='br-int',has_traffic_filtering=True,id=fcd776c5-1b40-47c2-9fb8-71d523362404,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcd776c5-1b') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:02:15.176679 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:36:ca,bridge_name='br-int',has_traffic_filtering=True,id=fcd776c5-1b40-47c2-9fb8-71d523362404,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcd776c5-1b') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 02:02:15.176959 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:15.177299 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:02:15.177627 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 02:02:15.180497 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:15.180497 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3a035740-2113-5e88-9166-15001a467123', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:02:15.181603 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:15.181603 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:02:15.182415 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:15.184790 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:15.185107 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfcd776c5-1b, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:02:15.185503 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfcd776c5-1b, col_values=(('qos', UUID('4caa4be3-bf2b-4c79-b375-0b105cd0c426')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:02:15.186136 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfcd776c5-1b, col_values=(('external_ids', {'iface-id': 'fcd776c5-1b40-47c2-9fb8-71d523362404', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:36:ca', 'vm-uuid': '52013bcc-3652-4009-871a-ae37e6ed1c69'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:02:15.188105 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:15.188873 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:02:15.194691 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:15.195945 np0000001583 nova-compute[98241]: INFO os_vif [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:36:ca,bridge_name='br-int',has_traffic_filtering=True,id=fcd776c5-1b40-47c2-9fb8-71d523362404,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcd776c5-1b')
May 28 02:02:15.244238 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f7de4eac-6329-41b1-b57a-4ccee82de980 req-e78c5af5-0450-44f3-a906-511406080741 service nova] Releasing lock "refresh_cache-1f15126e-6636-4765-8650-bb717f186efe" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:02:15.305226 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2f9e1425-581a-4c91-800f-d067e144907b req-4597fa20-441c-4fff-804f-1c49616385ad service nova] Releasing lock "refresh_cache-8b2a5f31-1b3d-447f-939e-94fd0be5eb85" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:02:15.777884 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-c20f824f-af6b-4480-9d01-3dcba94ec9c0 req-dc51ebb8-8039-4bbc-bc9d-cf7d49b725d8 service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Received event network-changed-5e52242f-77f4-41cc-ae8f-6a4772243727 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:02:15.778462 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-c20f824f-af6b-4480-9d01-3dcba94ec9c0 req-dc51ebb8-8039-4bbc-bc9d-cf7d49b725d8 service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Refreshing instance network info cache due to event network-changed-5e52242f-77f4-41cc-ae8f-6a4772243727. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:02:15.778462 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c20f824f-af6b-4480-9d01-3dcba94ec9c0 req-dc51ebb8-8039-4bbc-bc9d-cf7d49b725d8 service nova] Acquiring lock "refresh_cache-21c4e225-440e-4103-adaf-cb470d172291" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:02:15.778660 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c20f824f-af6b-4480-9d01-3dcba94ec9c0 req-dc51ebb8-8039-4bbc-bc9d-cf7d49b725d8 service nova] Acquired lock "refresh_cache-21c4e225-440e-4103-adaf-cb470d172291" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:02:15.778660 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-c20f824f-af6b-4480-9d01-3dcba94ec9c0 req-dc51ebb8-8039-4bbc-bc9d-cf7d49b725d8 service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Refreshing network info cache for port 5e52242f-77f4-41cc-ae8f-6a4772243727 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:02:16.280697 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-c20f824f-af6b-4480-9d01-3dcba94ec9c0 req-dc51ebb8-8039-4bbc-bc9d-cf7d49b725d8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:02:16.700778 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-c20f824f-af6b-4480-9d01-3dcba94ec9c0 req-dc51ebb8-8039-4bbc-bc9d-cf7d49b725d8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:02:16.715042 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:02:16.715321 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:02:16.715462 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] No VIF found with MAC fa:16:3e:9e:36:ca, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:02:16.715930 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Using config drive
May 28 02:02:16.873240 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-c20f824f-af6b-4480-9d01-3dcba94ec9c0 req-dc51ebb8-8039-4bbc-bc9d-cf7d49b725d8 service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Updated VIF entry in instance network info cache for port 5e52242f-77f4-41cc-ae8f-6a4772243727. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:02:16.873240 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-c20f824f-af6b-4480-9d01-3dcba94ec9c0 req-dc51ebb8-8039-4bbc-bc9d-cf7d49b725d8 service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Updating instance_info_cache with network_info: [{"id": "5e52242f-77f4-41cc-ae8f-6a4772243727", "address": "fa:16:3e:57:95:02", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e52242f-77", "ovs_interfaceid": "5e52242f-77f4-41cc-ae8f-6a4772243727", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:02:17.193594 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:02:17.194428 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:02:17.222213 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:02:17.377032 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Creating config drive at /opt/stack/data/nova/instances/52013bcc-3652-4009-871a-ae37e6ed1c69/disk.config
May 28 02:02:17.377804 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c20f824f-af6b-4480-9d01-3dcba94ec9c0 req-dc51ebb8-8039-4bbc-bc9d-cf7d49b725d8 service nova] Releasing lock "refresh_cache-21c4e225-440e-4103-adaf-cb470d172291" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:02:17.384073 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/52013bcc-3652-4009-871a-ae37e6ed1c69/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgxul8zrg {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:02:17.450463 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/52013bcc-3652-4009-871a-ae37e6ed1c69/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgxul8zrg" returned: 0 in 0.067s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:02:17.958272 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:17.988001 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:17.989503 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:18.106318 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:18.194166 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:02:18.194976 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:02:18.206620 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-3e0f9026-1020-40ae-865e-1857842878be req-87aee5ed-dfb6-4348-9be7-d4183c503afd service nova] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Received event network-vif-plugged-fcd776c5-1b40-47c2-9fb8-71d523362404 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:02:18.207012 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-3e0f9026-1020-40ae-865e-1857842878be req-87aee5ed-dfb6-4348-9be7-d4183c503afd service nova] Acquiring lock "52013bcc-3652-4009-871a-ae37e6ed1c69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:18.207437 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-3e0f9026-1020-40ae-865e-1857842878be req-87aee5ed-dfb6-4348-9be7-d4183c503afd service nova] Lock "52013bcc-3652-4009-871a-ae37e6ed1c69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:18.207487 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-3e0f9026-1020-40ae-865e-1857842878be req-87aee5ed-dfb6-4348-9be7-d4183c503afd service nova] Lock "52013bcc-3652-4009-871a-ae37e6ed1c69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:02:18.207649 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-3e0f9026-1020-40ae-865e-1857842878be req-87aee5ed-dfb6-4348-9be7-d4183c503afd service nova] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Processing event network-vif-plugged-fcd776c5-1b40-47c2-9fb8-71d523362404 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 02:02:18.283295 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:18.406276 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:18.408819 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:18.439845 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:19.058615 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933739.0580401, 52013bcc-3652-4009-871a-ae37e6ed1c69 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:02:19.059476 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] VM Started (Lifecycle Event)
May 28 02:02:19.059476 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 02:02:19.066844 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 02:02:19.072970 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Instance spawned successfully.
May 28 02:02:19.073617 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 02:02:19.193377 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:02:19.193733 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 02:02:19.194223 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:02:19.243646 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.00039222399982463685 future=<Future at 0x7724f82d85f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:02:19.244018 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Emitting event <LifecycleEvent: 1779933724.2431052, c165c9a8-be28-4efe-b671-4dcf9bedfbe4 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:02:19.244195 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] VM Stopped (Lifecycle Event)
May 28 02:02:19.245133 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:02:19.562617 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:02:19.564811 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:02:19.592299 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:02:19.592652 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:02:19.596206 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:02:19.596623 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:02:19.596987 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:02:19.597350 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:02:19.748800 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-514b01c0-24df-476d-845b-f1f1809845a0 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: c165c9a8-be28-4efe-b671-4dcf9bedfbe4] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:02:20.067823 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 02:02:20.068403 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933740.0679085, 52013bcc-3652-4009-871a-ae37e6ed1c69 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:02:20.068403 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] VM Paused (Lifecycle Event)
May 28 02:02:20.105687 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Took 9.45 seconds to spawn the instance on the hypervisor.
May 28 02:02:20.105687 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:02:20.189938 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:02:20.191171 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:20.193858 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:02:20.194328 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:02:20.475417 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ad82c1f1-9166-4f22-ba77-77238aa3ce56 req-eb3eadd2-91a4-4587-97d4-a8247d78c433 service nova] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Received event network-vif-plugged-fcd776c5-1b40-47c2-9fb8-71d523362404 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:02:20.476122 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ad82c1f1-9166-4f22-ba77-77238aa3ce56 req-eb3eadd2-91a4-4587-97d4-a8247d78c433 service nova] Acquiring lock "52013bcc-3652-4009-871a-ae37e6ed1c69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:20.476647 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ad82c1f1-9166-4f22-ba77-77238aa3ce56 req-eb3eadd2-91a4-4587-97d4-a8247d78c433 service nova] Lock "52013bcc-3652-4009-871a-ae37e6ed1c69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:20.477201 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ad82c1f1-9166-4f22-ba77-77238aa3ce56 req-eb3eadd2-91a4-4587-97d4-a8247d78c433 service nova] Lock "52013bcc-3652-4009-871a-ae37e6ed1c69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:02:20.477201 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ad82c1f1-9166-4f22-ba77-77238aa3ce56 req-eb3eadd2-91a4-4587-97d4-a8247d78c433 service nova] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] No waiting events found dispatching network-vif-plugged-fcd776c5-1b40-47c2-9fb8-71d523362404 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:02:20.480103 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-ad82c1f1-9166-4f22-ba77-77238aa3ce56 req-eb3eadd2-91a4-4587-97d4-a8247d78c433 service nova] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Received unexpected event network-vif-plugged-fcd776c5-1b40-47c2-9fb8-71d523362404 for instance with vm_state active and task_state None.
May 28 02:02:20.571160 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:02:20.577560 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933740.5772324, 52013bcc-3652-4009-871a-ae37e6ed1c69 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:02:20.577807 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] VM Resumed (Lifecycle Event)
May 28 02:02:20.623370 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Took 17.31 seconds to build instance.
May 28 02:02:20.706300 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:20.706512 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:20.706682 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:02:20.706844 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Auditing locally available compute resources for np0000001583 (node: np0000001583) {{(pid=98241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 02:02:21.082022 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:02:21.091385 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:02:21.126133 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3a6eb4ab-43ee-45fe-9e2f-e28a5aaaa2ea tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "52013bcc-3652-4009-871a-ae37e6ed1c69" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.820s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:02:21.767656 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:02:21.878192 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:02:21.882259 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:02:21.997972 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:02:21.998493 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/dm-10 (vdb) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 02:02:22.003941 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e9a0d0-72cd-459e-8bc4-cf080adb5267/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:02:22.096439 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e9a0d0-72cd-459e-8bc4-cf080adb5267/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:02:22.097773 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e9a0d0-72cd-459e-8bc4-cf080adb5267/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:02:22.210415 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e9a0d0-72cd-459e-8bc4-cf080adb5267/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:02:22.215678 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bbb8cf-c11d-4025-8551-4c1c3557264a/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:02:22.328199 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bbb8cf-c11d-4025-8551-4c1c3557264a/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:02:22.328705 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bbb8cf-c11d-4025-8551-4c1c3557264a/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:02:22.435252 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bbb8cf-c11d-4025-8551-4c1c3557264a/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:02:22.441264 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00f21c6-ce7c-4e23-94e2-7f415ae7a9be/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:02:22.553951 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00f21c6-ce7c-4e23-94e2-7f415ae7a9be/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:02:22.554547 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00f21c6-ce7c-4e23-94e2-7f415ae7a9be/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:02:22.650430 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00f21c6-ce7c-4e23-94e2-7f415ae7a9be/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:02:22.656148 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f15126e-6636-4765-8650-bb717f186efe/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:02:22.772198 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-8046cf2b-978a-426a-9e9d-a0ac7dce51c3 req-aee21cb7-141a-4671-8f17-a588c3722e1d service nova] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Received event network-changed-fcd776c5-1b40-47c2-9fb8-71d523362404 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:02:22.772198 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-8046cf2b-978a-426a-9e9d-a0ac7dce51c3 req-aee21cb7-141a-4671-8f17-a588c3722e1d service nova] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Refreshing instance network info cache due to event network-changed-fcd776c5-1b40-47c2-9fb8-71d523362404. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:02:22.772198 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-8046cf2b-978a-426a-9e9d-a0ac7dce51c3 req-aee21cb7-141a-4671-8f17-a588c3722e1d service nova] Acquiring lock "refresh_cache-52013bcc-3652-4009-871a-ae37e6ed1c69" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:02:22.772582 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-8046cf2b-978a-426a-9e9d-a0ac7dce51c3 req-aee21cb7-141a-4671-8f17-a588c3722e1d service nova] Acquired lock "refresh_cache-52013bcc-3652-4009-871a-ae37e6ed1c69" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:02:22.773206 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f15126e-6636-4765-8650-bb717f186efe/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:02:22.773955 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-8046cf2b-978a-426a-9e9d-a0ac7dce51c3 req-aee21cb7-141a-4671-8f17-a588c3722e1d service nova] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Refreshing network info cache for port fcd776c5-1b40-47c2-9fb8-71d523362404 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:02:22.775639 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f15126e-6636-4765-8650-bb717f186efe/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:02:22.895328 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f15126e-6636-4765-8650-bb717f186efe/disk --force-share --output=json" returned: 0 in 0.121s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:02:22.902324 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6e87c0e-02e1-4941-8f2f-b969b93ebf9f/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:02:22.997713 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6e87c0e-02e1-4941-8f2f-b969b93ebf9f/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:02:22.998140 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6e87c0e-02e1-4941-8f2f-b969b93ebf9f/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:02:23.102249 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6e87c0e-02e1-4941-8f2f-b969b93ebf9f/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:02:23.102798 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/dm-3 (vdb) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 02:02:23.106972 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:02:23.215489 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:02:23.216030 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:02:23.284676 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:23.304566 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-8046cf2b-978a-426a-9e9d-a0ac7dce51c3 req-aee21cb7-141a-4671-8f17-a588c3722e1d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:02:23.349765 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:02:23.352503 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/dm-10 (vdb) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 02:02:23.355111 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 02:02:23.357222 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/dm-4 (vda) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 02:02:23.359516 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:02:23.360967 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:02:23.417214 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.056s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:02:23.419712 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Hypervisor/Node resource view: name=np0000001583 free_ram=11307MB free_disk=73.6828384399414GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 02:02:23.419712 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:23.419712 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:23.684893 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-8046cf2b-978a-426a-9e9d-a0ac7dce51c3 req-aee21cb7-141a-4671-8f17-a588c3722e1d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:02:23.833039 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-8046cf2b-978a-426a-9e9d-a0ac7dce51c3 req-aee21cb7-141a-4671-8f17-a588c3722e1d service nova] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Updated VIF entry in instance network info cache for port fcd776c5-1b40-47c2-9fb8-71d523362404. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:02:23.833516 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-8046cf2b-978a-426a-9e9d-a0ac7dce51c3 req-aee21cb7-141a-4671-8f17-a588c3722e1d service nova] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Updating instance_info_cache with network_info: [{"id": "fcd776c5-1b40-47c2-9fb8-71d523362404", "address": "fa:16:3e:9e:36:ca", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd776c5-1b", "ovs_interfaceid": "fcd776c5-1b40-47c2-9fb8-71d523362404", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:02:24.337017 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-8046cf2b-978a-426a-9e9d-a0ac7dce51c3 req-aee21cb7-141a-4671-8f17-a588c3722e1d service nova] Releasing lock "refresh_cache-52013bcc-3652-4009-871a-ae37e6ed1c69" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:02:24.502116 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance e50227a8-b484-447b-abc6-3a3c1379e7ff actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:02:24.502116 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 22bbb8cf-c11d-4025-8551-4c1c3557264a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:02:24.502116 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance e3e9a0d0-72cd-459e-8bc4-cf080adb5267 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:02:24.502116 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 8b2a5f31-1b3d-447f-939e-94fd0be5eb85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:02:24.502116 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance c6e87c0e-02e1-4941-8f2f-b969b93ebf9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:02:24.502116 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 21c4e225-440e-4103-adaf-cb470d172291 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:02:24.502116 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance e00f21c6-ce7c-4e23-94e2-7f415ae7a9be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:02:24.502116 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 1f15126e-6636-4765-8650-bb717f186efe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:02:24.502608 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 52013bcc-3652-4009-871a-ae37e6ed1c69 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:02:24.502900 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 02:02:24.503185 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Final resource view: name=np0000001583 phys_ram=24030MB used_ram=2368MB phys_disk=95GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:02:23 up 38 min,  2 users,  load average: 7.84, 7.78, 4.88\n', 'num_instances': '9', 'num_vm_active': '9', 'num_task_None': '9', 'num_os_type_None': '9', 'num_proj_0474090f4f2d4950b51bc317f4302266': '5', 'io_workload': '0', 'num_proj_1d5cfe906dd24a10819b92c144f7f06f': '1', 'num_proj_04ce4063a6ac4afdb5ee359a5c1105d3': '1', 'num_proj_ae04c11a3de34d419d69e1fdf4c7d311': '1', 'num_proj_432aa1094ced436494def17a875aa8e1': '1'} {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 02:02:25.094791 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:25.135614 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:02:25.136313 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:02:25.195524 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:25.640569 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:02:26.149841 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Compute_service record updated for np0000001583:np0000001583 {{(pid=98241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 02:02:26.150402 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.732s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:02:26.150638 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:02:27.149751 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:02:27.150421 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:02:27.150421 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 50.04 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:02:28.037158 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:28.287222 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:28.615372 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7cf60158-c1d6-4672-85d4-406780ae022a req-010f088b-0dd8-4d3a-9260-03aa1dfe35e8 service nova] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Received event network-changed-18842969-e82f-4389-a30f-f5054a50d115 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:02:28.615674 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7cf60158-c1d6-4672-85d4-406780ae022a req-010f088b-0dd8-4d3a-9260-03aa1dfe35e8 service nova] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Refreshing instance network info cache due to event network-changed-18842969-e82f-4389-a30f-f5054a50d115. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:02:28.615753 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7cf60158-c1d6-4672-85d4-406780ae022a req-010f088b-0dd8-4d3a-9260-03aa1dfe35e8 service nova] Acquiring lock "refresh_cache-c6e87c0e-02e1-4941-8f2f-b969b93ebf9f" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:02:28.615891 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7cf60158-c1d6-4672-85d4-406780ae022a req-010f088b-0dd8-4d3a-9260-03aa1dfe35e8 service nova] Acquired lock "refresh_cache-c6e87c0e-02e1-4941-8f2f-b969b93ebf9f" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:02:28.616288 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-7cf60158-c1d6-4672-85d4-406780ae022a req-010f088b-0dd8-4d3a-9260-03aa1dfe35e8 service nova] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Refreshing network info cache for port 18842969-e82f-4389-a30f-f5054a50d115 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:02:29.122866 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-7cf60158-c1d6-4672-85d4-406780ae022a req-010f088b-0dd8-4d3a-9260-03aa1dfe35e8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:02:29.521704 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-7cf60158-c1d6-4672-85d4-406780ae022a req-010f088b-0dd8-4d3a-9260-03aa1dfe35e8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:02:29.698233 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-7cf60158-c1d6-4672-85d4-406780ae022a req-010f088b-0dd8-4d3a-9260-03aa1dfe35e8 service nova] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Updated VIF entry in instance network info cache for port 18842969-e82f-4389-a30f-f5054a50d115. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:02:29.698484 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-7cf60158-c1d6-4672-85d4-406780ae022a req-010f088b-0dd8-4d3a-9260-03aa1dfe35e8 service nova] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Updating instance_info_cache with network_info: [{"id": "18842969-e82f-4389-a30f-f5054a50d115", "address": "fa:16:3e:1e:c3:73", "network": {"id": "c18d43cf-482c-4814-96a1-09aab2287be4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2071326233-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d5cfe906dd24a10819b92c144f7f06f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap18842969-e8", "ovs_interfaceid": "18842969-e82f-4389-a30f-f5054a50d115", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:02:29.836296 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-179f7639-6c0a-4fa4-9ddb-ff2865d6d312 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Acquiring lock "c6e87c0e-02e1-4941-8f2f-b969b93ebf9f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:29.836296 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-179f7639-6c0a-4fa4-9ddb-ff2865d6d312 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "c6e87c0e-02e1-4941-8f2f-b969b93ebf9f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:30.196958 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:30.200499 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7cf60158-c1d6-4672-85d4-406780ae022a req-010f088b-0dd8-4d3a-9260-03aa1dfe35e8 service nova] Releasing lock "refresh_cache-c6e87c0e-02e1-4941-8f2f-b969b93ebf9f" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:02:30.339936 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-179f7639-6c0a-4fa4-9ddb-ff2865d6d312 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Detaching volume f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be
May 28 02:02:30.386416 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-179f7639-6c0a-4fa4-9ddb-ff2865d6d312 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Attempting to driver detach volume f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be from mountpoint /dev/vdb
May 28 02:02:30.390858 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-179f7639-6c0a-4fa4-9ddb-ff2865d6d312 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Found disk vdb by alias ua-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:02:30.394949 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-179f7639-6c0a-4fa4-9ddb-ff2865d6d312 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Found disk vdb by alias ua-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:02:30.394949 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-179f7639-6c0a-4fa4-9ddb-ff2865d6d312 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Attempting to detach device vdb from instance c6e87c0e-02e1-4941-8f2f-b969b93ebf9f from the persistent domain config. {{(pid=98241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 02:02:30.394949 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-179f7639-6c0a-4fa4-9ddb-ff2865d6d312 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:02:30.394949 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:02:30.394949 np0000001583 nova-compute[98241]:   <alias name="ua-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be"/>
May 28 02:02:30.394949 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-3"/>
May 28 02:02:30.394949 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:02:30.394949 np0000001583 nova-compute[98241]:   <serial>f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be</serial>
May 28 02:02:30.394949 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 02:02:30.394949 np0000001583 nova-compute[98241]: </disk>
May 28 02:02:30.394949 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:02:30.415162 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-179f7639-6c0a-4fa4-9ddb-ff2865d6d312 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Successfully detached device vdb from instance c6e87c0e-02e1-4941-8f2f-b969b93ebf9f from the persistent domain config.
May 28 02:02:30.415346 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-179f7639-6c0a-4fa4-9ddb-ff2865d6d312 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] (1/8): Attempting to detach device vdb with device alias ua-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be from instance c6e87c0e-02e1-4941-8f2f-b969b93ebf9f from the live domain config. {{(pid=98241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 02:02:30.415675 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-179f7639-6c0a-4fa4-9ddb-ff2865d6d312 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:02:30.415675 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:02:30.415675 np0000001583 nova-compute[98241]:   <alias name="ua-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be"/>
May 28 02:02:30.415675 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-3"/>
May 28 02:02:30.415675 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:02:30.415675 np0000001583 nova-compute[98241]:   <serial>f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be</serial>
May 28 02:02:30.415675 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 02:02:30.415675 np0000001583 nova-compute[98241]: </disk>
May 28 02:02:30.415675 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:02:30.702928 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-3140ddf2-eee1-4d1b-a8f9-d912c6341d2b req-6e2dd95a-0f1e-4ae7-baee-9b602a1beb70 service nova] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Received event network-changed-18842969-e82f-4389-a30f-f5054a50d115 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:02:30.704881 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-3140ddf2-eee1-4d1b-a8f9-d912c6341d2b req-6e2dd95a-0f1e-4ae7-baee-9b602a1beb70 service nova] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Refreshing instance network info cache due to event network-changed-18842969-e82f-4389-a30f-f5054a50d115. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:02:30.704881 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-3140ddf2-eee1-4d1b-a8f9-d912c6341d2b req-6e2dd95a-0f1e-4ae7-baee-9b602a1beb70 service nova] Acquiring lock "refresh_cache-c6e87c0e-02e1-4941-8f2f-b969b93ebf9f" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:02:30.704881 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-3140ddf2-eee1-4d1b-a8f9-d912c6341d2b req-6e2dd95a-0f1e-4ae7-baee-9b602a1beb70 service nova] Acquired lock "refresh_cache-c6e87c0e-02e1-4941-8f2f-b969b93ebf9f" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:02:30.704881 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-3140ddf2-eee1-4d1b-a8f9-d912c6341d2b req-6e2dd95a-0f1e-4ae7-baee-9b602a1beb70 service nova] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Refreshing network info cache for port 18842969-e82f-4389-a30f-f5054a50d115 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:02:31.060676 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Received event <DeviceRemovedEvent: 1779933751.0603328, c6e87c0e-02e1-4941-8f2f-b969b93ebf9f => ua-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be> from libvirt while the driver is waiting for it; dispatched. {{(pid=98241) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 02:02:31.063313 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-179f7639-6c0a-4fa4-9ddb-ff2865d6d312 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be for instance c6e87c0e-02e1-4941-8f2f-b969b93ebf9f {{(pid=98241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 02:02:31.065653 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-179f7639-6c0a-4fa4-9ddb-ff2865d6d312 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Successfully detached device vdb from instance c6e87c0e-02e1-4941-8f2f-b969b93ebf9f from the live domain config.
May 28 02:02:31.066982 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-179f7639-6c0a-4fa4-9ddb-ff2865d6d312 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:02:31.067315 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-179f7639-6c0a-4fa4-9ddb-ff2865d6d312 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be', 'iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:02:31.067450 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-179f7639-6c0a-4fa4-9ddb-ff2865d6d312 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:02:31.067866 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-179f7639-6c0a-4fa4-9ddb-ff2865d6d312 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:02:31.068196 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-179f7639-6c0a-4fa4-9ddb-ff2865d6d312 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be', 'iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:02:31.068360 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-179f7639-6c0a-4fa4-9ddb-ff2865d6d312 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:02:31.097360 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-179f7639-6c0a-4fa4-9ddb-ff2865d6d312 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:31.097360 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:31.097360 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:31.097360 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:31.097360 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:02:31.097360 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:02:31.097360 np0000001583 nova-compute[98241]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:02:31.097360 np0000001583 nova-compute[98241]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:02:31.097360 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:02:31.097720 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-179f7639-6c0a-4fa4-9ddb-ff2865d6d312 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsi session list stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:31.097720 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:31.097720 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:31.097720 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:31.097720 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:02:31.097720 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:02:31.097720 np0000001583 nova-compute[98241]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:02:31.097720 np0000001583 nova-compute[98241]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be (non-flash)
May 28 02:02:31.097720 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:02:31.097720 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-179f7639-6c0a-4fa4-9ddb-ff2865d6d312 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86', '109'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86', '110'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', '68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', '69'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', '91'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', '92'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be', '98'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be', '99')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:02:31.098017 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-179f7639-6c0a-4fa4-9ddb-ff2865d6d312 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be', '99')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:02:31.099180 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-179f7639-6c0a-4fa4-9ddb-ff2865d6d312 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be', '98')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:02:31.100372 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-179f7639-6c0a-4fa4-9ddb-ff2865d6d312 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f82ab6a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be'): ({'sde'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:02:31.100637 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-179f7639-6c0a-4fa4-9ddb-ff2865d6d312 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Removing multipathed devices sdf, sde {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:02:31.100969 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-179f7639-6c0a-4fa4-9ddb-ff2865d6d312 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Flush multipath device 330000000542d83d5 {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:02:31.137779 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-179f7639-6c0a-4fa4-9ddb-ff2865d6d312 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:02:31.194473 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:31.208532 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-3140ddf2-eee1-4d1b-a8f9-d912c6341d2b req-6e2dd95a-0f1e-4ae7-baee-9b602a1beb70 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:02:31.210830 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-179f7639-6c0a-4fa4-9ddb-ff2865d6d312 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:02:31.266063 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-179f7639-6c0a-4fa4-9ddb-ff2865d6d312 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Checking to see if SCSI volumes sdf, sde have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:02:31.266338 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-179f7639-6c0a-4fa4-9ddb-ff2865d6d312 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] SCSI volumes sdf, sde have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:02:31.267923 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-179f7639-6c0a-4fa4-9ddb-ff2865d6d312 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Checking to see if device paths {'sdf', 'sde'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:02:31.283555 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-179f7639-6c0a-4fa4-9ddb-ff2865d6d312 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Device paths {'sdf', 'sde'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:02:31.283781 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-179f7639-6c0a-4fa4-9ddb-ff2865d6d312 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:02:31.296411 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-179f7639-6c0a-4fa4-9ddb-ff2865d6d312 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:31.335531 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-179f7639-6c0a-4fa4-9ddb-ff2865d6d312 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 99, target: iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be, portal: 192.168.40.100,3260]
May 28 02:02:31.335531 np0000001583 nova-compute[98241]: Logout of [sid: 99, target: iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be, portal: 192.168.40.100,3260] successful.
May 28 02:02:31.335531 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:31.359653 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-179f7639-6c0a-4fa4-9ddb-ff2865d6d312 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:31.374864 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-179f7639-6c0a-4fa4-9ddb-ff2865d6d312 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:31.415935 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-179f7639-6c0a-4fa4-9ddb-ff2865d6d312 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 98, target: iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be, portal: 192.168.50.100,3260]
May 28 02:02:31.415935 np0000001583 nova-compute[98241]: Logout of [sid: 98, target: iqn.2023-03.storpool.com:os--volume-f0bc4eb2-5330-47ad-be6f-2bcb0d5bf7be, portal: 192.168.50.100,3260] successful.
May 28 02:02:31.415935 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:31.438419 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-179f7639-6c0a-4fa4-9ddb-ff2865d6d312 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:31.438733 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-179f7639-6c0a-4fa4-9ddb-ff2865d6d312 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:02:31.439232 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-179f7639-6c0a-4fa4-9ddb-ff2865d6d312 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] <== disconnect_volume: return (371ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:02:31.439976 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-179f7639-6c0a-4fa4-9ddb-ff2865d6d312 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:02:31.633157 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-3140ddf2-eee1-4d1b-a8f9-d912c6341d2b req-6e2dd95a-0f1e-4ae7-baee-9b602a1beb70 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:02:31.826281 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-3140ddf2-eee1-4d1b-a8f9-d912c6341d2b req-6e2dd95a-0f1e-4ae7-baee-9b602a1beb70 service nova] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Updated VIF entry in instance network info cache for port 18842969-e82f-4389-a30f-f5054a50d115. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:02:31.826681 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-3140ddf2-eee1-4d1b-a8f9-d912c6341d2b req-6e2dd95a-0f1e-4ae7-baee-9b602a1beb70 service nova] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Updating instance_info_cache with network_info: [{"id": "18842969-e82f-4389-a30f-f5054a50d115", "address": "fa:16:3e:1e:c3:73", "network": {"id": "c18d43cf-482c-4814-96a1-09aab2287be4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2071326233-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d5cfe906dd24a10819b92c144f7f06f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap18842969-e8", "ovs_interfaceid": "18842969-e82f-4389-a30f-f5054a50d115", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:02:32.008670 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-179f7639-6c0a-4fa4-9ddb-ff2865d6d312 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lazy-loading 'flavor' on Instance uuid c6e87c0e-02e1-4941-8f2f-b969b93ebf9f {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:02:32.328326 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-3140ddf2-eee1-4d1b-a8f9-d912c6341d2b req-6e2dd95a-0f1e-4ae7-baee-9b602a1beb70 service nova] Releasing lock "refresh_cache-c6e87c0e-02e1-4941-8f2f-b969b93ebf9f" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:02:32.985812 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:33.023884 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-179f7639-6c0a-4fa4-9ddb-ff2865d6d312 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "c6e87c0e-02e1-4941-8f2f-b969b93ebf9f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.190s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:02:33.297051 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:34.291769 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2784f908-a099-4047-a9fc-fda2bf622c9e tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "8b2a5f31-1b3d-447f-939e-94fd0be5eb85" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:34.292339 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2784f908-a099-4047-a9fc-fda2bf622c9e tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "8b2a5f31-1b3d-447f-939e-94fd0be5eb85" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:34.351889 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0d65e2e2-dbde-4d6e-9464-c82d5424351c tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Acquiring lock "c6e87c0e-02e1-4941-8f2f-b969b93ebf9f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:34.351889 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0d65e2e2-dbde-4d6e-9464-c82d5424351c tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "c6e87c0e-02e1-4941-8f2f-b969b93ebf9f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:34.351889 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0d65e2e2-dbde-4d6e-9464-c82d5424351c tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Acquiring lock "c6e87c0e-02e1-4941-8f2f-b969b93ebf9f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:34.351889 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0d65e2e2-dbde-4d6e-9464-c82d5424351c tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "c6e87c0e-02e1-4941-8f2f-b969b93ebf9f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:34.351889 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0d65e2e2-dbde-4d6e-9464-c82d5424351c tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "c6e87c0e-02e1-4941-8f2f-b969b93ebf9f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:02:34.356541 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-0d65e2e2-dbde-4d6e-9464-c82d5424351c tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Terminating instance
May 28 02:02:34.734773 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Acquiring lock "3dd5aa3c-dade-42d8-8de7-f34574a0fc31" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:34.735020 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Lock "3dd5aa3c-dade-42d8-8de7-f34574a0fc31" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:34.794335 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-2784f908-a099-4047-a9fc-fda2bf622c9e tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Detaching volume 2b9c7b2e-ce89-46a0-a020-361646147ba3
May 28 02:02:34.860995 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-0d65e2e2-dbde-4d6e-9464-c82d5424351c tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 02:02:34.865962 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-2784f908-a099-4047-a9fc-fda2bf622c9e tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Attempting to driver detach volume 2b9c7b2e-ce89-46a0-a020-361646147ba3 from mountpoint /dev/vdb
May 28 02:02:34.882465 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2784f908-a099-4047-a9fc-fda2bf622c9e tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Found disk vdb by alias ua-2b9c7b2e-ce89-46a0-a020-361646147ba3 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:02:34.885359 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:34.888020 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2784f908-a099-4047-a9fc-fda2bf622c9e tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Found disk vdb by alias ua-2b9c7b2e-ce89-46a0-a020-361646147ba3 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:02:34.888206 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2784f908-a099-4047-a9fc-fda2bf622c9e tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Attempting to detach device vdb from instance 8b2a5f31-1b3d-447f-939e-94fd0be5eb85 from the persistent domain config. {{(pid=98241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 02:02:34.888511 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-2784f908-a099-4047-a9fc-fda2bf622c9e tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:02:34.888511 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:02:34.888511 np0000001583 nova-compute[98241]:   <alias name="ua-2b9c7b2e-ce89-46a0-a020-361646147ba3"/>
May 28 02:02:34.888511 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-10"/>
May 28 02:02:34.888511 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:02:34.888511 np0000001583 nova-compute[98241]:   <serial>2b9c7b2e-ce89-46a0-a020-361646147ba3</serial>
May 28 02:02:34.888511 np0000001583 nova-compute[98241]:   <shareable/>
May 28 02:02:34.888511 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 02:02:34.888511 np0000001583 nova-compute[98241]: </disk>
May 28 02:02:34.888511 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:02:34.889852 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:34.906536 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-2784f908-a099-4047-a9fc-fda2bf622c9e tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Successfully detached device vdb from instance 8b2a5f31-1b3d-447f-939e-94fd0be5eb85 from the persistent domain config.
May 28 02:02:34.906825 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2784f908-a099-4047-a9fc-fda2bf622c9e tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] (1/8): Attempting to detach device vdb with device alias ua-2b9c7b2e-ce89-46a0-a020-361646147ba3 from instance 8b2a5f31-1b3d-447f-939e-94fd0be5eb85 from the live domain config. {{(pid=98241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 02:02:34.910584 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-2784f908-a099-4047-a9fc-fda2bf622c9e tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:02:34.910584 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:02:34.910584 np0000001583 nova-compute[98241]:   <alias name="ua-2b9c7b2e-ce89-46a0-a020-361646147ba3"/>
May 28 02:02:34.910584 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-10"/>
May 28 02:02:34.910584 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:02:34.910584 np0000001583 nova-compute[98241]:   <serial>2b9c7b2e-ce89-46a0-a020-361646147ba3</serial>
May 28 02:02:34.910584 np0000001583 nova-compute[98241]:   <shareable/>
May 28 02:02:34.910584 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 02:02:34.910584 np0000001583 nova-compute[98241]: </disk>
May 28 02:02:34.910584 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:02:34.913420 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:34.920258 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:34.950669 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:35.120769 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-65a93dc3-a097-436d-9a80-c57898dc8bfb req-409e6d03-03bc-49b7-a545-f3e07d254031 service nova] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Received event network-vif-unplugged-18842969-e82f-4389-a30f-f5054a50d115 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:02:35.120769 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-65a93dc3-a097-436d-9a80-c57898dc8bfb req-409e6d03-03bc-49b7-a545-f3e07d254031 service nova] Acquiring lock "c6e87c0e-02e1-4941-8f2f-b969b93ebf9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:35.120769 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-65a93dc3-a097-436d-9a80-c57898dc8bfb req-409e6d03-03bc-49b7-a545-f3e07d254031 service nova] Lock "c6e87c0e-02e1-4941-8f2f-b969b93ebf9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:35.120769 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-65a93dc3-a097-436d-9a80-c57898dc8bfb req-409e6d03-03bc-49b7-a545-f3e07d254031 service nova] Lock "c6e87c0e-02e1-4941-8f2f-b969b93ebf9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:02:35.120952 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-65a93dc3-a097-436d-9a80-c57898dc8bfb req-409e6d03-03bc-49b7-a545-f3e07d254031 service nova] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] No waiting events found dispatching network-vif-unplugged-18842969-e82f-4389-a30f-f5054a50d115 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:02:35.121325 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-65a93dc3-a097-436d-9a80-c57898dc8bfb req-409e6d03-03bc-49b7-a545-f3e07d254031 service nova] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Received event network-vif-unplugged-18842969-e82f-4389-a30f-f5054a50d115 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:02:35.199173 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:35.218583 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999683104999804 future=<Future at 0x7724ec1ce300 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:02:35.220381 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.997875964999821 future=<Future at 0x7724ec1ce300 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:02:35.220983 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.99762973099996 future=<Future at 0x7724ec1ce300 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:02:35.220983 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Instance destroyed successfully.
May 28 02:02:35.221376 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-0d65e2e2-dbde-4d6e-9464-c82d5424351c tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lazy-loading 'resources' on Instance uuid c6e87c0e-02e1-4941-8f2f-b969b93ebf9f {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:02:35.239376 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 02:02:35.591765 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Received event <DeviceRemovedEvent: 1779933755.591309, 8b2a5f31-1b3d-447f-939e-94fd0be5eb85 => ua-2b9c7b2e-ce89-46a0-a020-361646147ba3> from libvirt while the driver is waiting for it; dispatched. {{(pid=98241) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 02:02:35.593229 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2784f908-a099-4047-a9fc-fda2bf622c9e tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-2b9c7b2e-ce89-46a0-a020-361646147ba3 for instance 8b2a5f31-1b3d-447f-939e-94fd0be5eb85 {{(pid=98241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 02:02:35.596717 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-2784f908-a099-4047-a9fc-fda2bf622c9e tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Successfully detached device vdb from instance 8b2a5f31-1b3d-447f-939e-94fd0be5eb85 from the live domain config.
May 28 02:02:35.723753 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-0d65e2e2-dbde-4d6e-9464-c82d5424351c tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T02:00:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-963915173',display_name='tempest-TestMinimumBasicScenario-server-963915173',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testminimumbasicscenario-server-963915173',id=44,image_ref='52c8a1d7-9a61-46ed-80ca-e9ab30606f97',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBX0IgGiUsTD2sbPHQaOGIfTfUbzPIJM0pCdM2CrpTh+uVYyzZv+jtp5vni8ulad0BKs4L0HTJ7Br9x7RNqV5Y+saqNffp7fh5EWlTPgK+7nhIEovo/Z1K9eQTWwE3rz5g==',key_name='tempest-TestMinimumBasicScenario-1551144269',keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:01:10Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d5cfe906dd24a10819b92c144f7f06f',ramdisk_id='',reservation_id='r-cvn34ea7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52c8a1d7-9a61-46ed-80ca-e9ab30606f97',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1092247749',owner_user_name='tempest-TestMinimumBasicScenario-1092247749-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T02:01:51Z,user_data=None,user_id='f52a7ae7fbc644deb82f3382de3a4edd',uuid=c6e87c0e-02e1-4941-8f2f-b969b93ebf9f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18842969-e82f-4389-a30f-f5054a50d115", "address": "fa:16:3e:1e:c3:73", "network": {"id": "c18d43cf-482c-4814-96a1-09aab2287be4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2071326233-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d5cfe906dd24a10819b92c144f7f06f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap18842969-e8", "ovs_interfaceid": "18842969-e82f-4389-a30f-f5054a50d115", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:02:35.724016 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-0d65e2e2-dbde-4d6e-9464-c82d5424351c tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Converting VIF {"id": "18842969-e82f-4389-a30f-f5054a50d115", "address": "fa:16:3e:1e:c3:73", "network": {"id": "c18d43cf-482c-4814-96a1-09aab2287be4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2071326233-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d5cfe906dd24a10819b92c144f7f06f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap18842969-e8", "ovs_interfaceid": "18842969-e82f-4389-a30f-f5054a50d115", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:02:35.724549 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-0d65e2e2-dbde-4d6e-9464-c82d5424351c tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:c3:73,bridge_name='br-int',has_traffic_filtering=True,id=18842969-e82f-4389-a30f-f5054a50d115,network=Network(c18d43cf-482c-4814-96a1-09aab2287be4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18842969-e8') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:02:35.725061 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-0d65e2e2-dbde-4d6e-9464-c82d5424351c tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:c3:73,bridge_name='br-int',has_traffic_filtering=True,id=18842969-e82f-4389-a30f-f5054a50d115,network=Network(c18d43cf-482c-4814-96a1-09aab2287be4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18842969-e8') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:02:35.730100 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:35.730100 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18842969-e8, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:02:35.731041 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:35.731703 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:02:35.732517 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:35.733283 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:35.733422 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0c6c023b-1447-4ed7-b761-728034d8226b) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:02:35.733844 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:35.734420 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:02:35.736576 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:35.739164 np0000001583 nova-compute[98241]: INFO os_vif [None req-0d65e2e2-dbde-4d6e-9464-c82d5424351c tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:c3:73,bridge_name='br-int',has_traffic_filtering=True,id=18842969-e82f-4389-a30f-f5054a50d115,network=Network(c18d43cf-482c-4814-96a1-09aab2287be4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18842969-e8')
May 28 02:02:35.739522 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-0d65e2e2-dbde-4d6e-9464-c82d5424351c tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Deleting instance files /opt/stack/data/nova/instances/c6e87c0e-02e1-4941-8f2f-b969b93ebf9f_del
May 28 02:02:35.740496 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-0d65e2e2-dbde-4d6e-9464-c82d5424351c tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Deletion of /opt/stack/data/nova/instances/c6e87c0e-02e1-4941-8f2f-b969b93ebf9f_del complete
May 28 02:02:35.802418 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:35.802651 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:35.805729 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 02:02:35.805922 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Claim successful on node np0000001583
May 28 02:02:36.143420 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-2784f908-a099-4047-a9fc-fda2bf622c9e tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Detected multiple connections on this host for volume: 2b9c7b2e-ce89-46a0-a020-361646147ba3, skipping target disconnect.
May 28 02:02:36.247754 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-0d65e2e2-dbde-4d6e-9464-c82d5424351c tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Took 1.39 seconds to destroy the instance on the hypervisor.
May 28 02:02:36.248330 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-0d65e2e2-dbde-4d6e-9464-c82d5424351c tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 02:02:36.248642 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 02:02:36.248800 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 02:02:36.249023 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:02:36.319237 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:02:36.664457 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ec879901-f9a0-4263-978e-09efdcbbfa29 req-d9860bbb-2d45-4f48-bdbb-c5c8b623e92c service nova] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Received event network-vif-deleted-18842969-e82f-4389-a30f-f5054a50d115 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:02:36.667320 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-ec879901-f9a0-4263-978e-09efdcbbfa29 req-d9860bbb-2d45-4f48-bdbb-c5c8b623e92c service nova] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Neutron deleted interface 18842969-e82f-4389-a30f-f5054a50d115; detaching it from the instance and deleting it from the info cache
May 28 02:02:36.671811 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ec879901-f9a0-4263-978e-09efdcbbfa29 req-d9860bbb-2d45-4f48-bdbb-c5c8b623e92c service nova] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Detach interface failed, port_id=18842969-e82f-4389-a30f-f5054a50d115, reason: Instance c6e87c0e-02e1-4941-8f2f-b969b93ebf9f could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 02:02:36.699194 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-2784f908-a099-4047-a9fc-fda2bf622c9e tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lazy-loading 'flavor' on Instance uuid 8b2a5f31-1b3d-447f-939e-94fd0be5eb85 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:02:37.117503 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:02:37.201773 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5e75260d-5bd3-472a-8247-eefdde72519e req-a02ab3ec-26d6-4ae4-8e03-2af41b45bff0 service nova] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Received event network-vif-unplugged-18842969-e82f-4389-a30f-f5054a50d115 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:02:37.201949 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5e75260d-5bd3-472a-8247-eefdde72519e req-a02ab3ec-26d6-4ae4-8e03-2af41b45bff0 service nova] Acquiring lock "c6e87c0e-02e1-4941-8f2f-b969b93ebf9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:37.203969 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5e75260d-5bd3-472a-8247-eefdde72519e req-a02ab3ec-26d6-4ae4-8e03-2af41b45bff0 service nova] Lock "c6e87c0e-02e1-4941-8f2f-b969b93ebf9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:37.204203 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5e75260d-5bd3-472a-8247-eefdde72519e req-a02ab3ec-26d6-4ae4-8e03-2af41b45bff0 service nova] Lock "c6e87c0e-02e1-4941-8f2f-b969b93ebf9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:02:37.204769 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5e75260d-5bd3-472a-8247-eefdde72519e req-a02ab3ec-26d6-4ae4-8e03-2af41b45bff0 service nova] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] No waiting events found dispatching network-vif-unplugged-18842969-e82f-4389-a30f-f5054a50d115 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:02:37.204769 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5e75260d-5bd3-472a-8247-eefdde72519e req-a02ab3ec-26d6-4ae4-8e03-2af41b45bff0 service nova] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Received event network-vif-unplugged-18842969-e82f-4389-a30f-f5054a50d115 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:02:37.450682 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:02:37.450890 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:02:37.619656 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Took 1.37 seconds to deallocate network for instance.
May 28 02:02:37.694025 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-da833c80-40b4-4b01-9319-ccb10c0dfec3 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "21c4e225-440e-4103-adaf-cb470d172291" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:37.694573 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-da833c80-40b4-4b01-9319-ccb10c0dfec3 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "21c4e225-440e-4103-adaf-cb470d172291" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:37.711822 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2784f908-a099-4047-a9fc-fda2bf622c9e tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "8b2a5f31-1b3d-447f-939e-94fd0be5eb85" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.419s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:02:37.953514 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:02:38.127721 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0d65e2e2-dbde-4d6e-9464-c82d5424351c tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:38.196915 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-da833c80-40b4-4b01-9319-ccb10c0dfec3 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Detaching volume 2b9c7b2e-ce89-46a0-a020-361646147ba3
May 28 02:02:38.246927 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-da833c80-40b4-4b01-9319-ccb10c0dfec3 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Attempting to driver detach volume 2b9c7b2e-ce89-46a0-a020-361646147ba3 from mountpoint /dev/vdb
May 28 02:02:38.252305 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-da833c80-40b4-4b01-9319-ccb10c0dfec3 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Found disk vdb by alias ua-2b9c7b2e-ce89-46a0-a020-361646147ba3 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:02:38.253829 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-da833c80-40b4-4b01-9319-ccb10c0dfec3 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Found disk vdb by alias ua-2b9c7b2e-ce89-46a0-a020-361646147ba3 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:02:38.253988 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-da833c80-40b4-4b01-9319-ccb10c0dfec3 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Attempting to detach device vdb from instance 21c4e225-440e-4103-adaf-cb470d172291 from the persistent domain config. {{(pid=98241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 02:02:38.254315 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-da833c80-40b4-4b01-9319-ccb10c0dfec3 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:02:38.254315 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:02:38.254315 np0000001583 nova-compute[98241]:   <alias name="ua-2b9c7b2e-ce89-46a0-a020-361646147ba3"/>
May 28 02:02:38.254315 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-10"/>
May 28 02:02:38.254315 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:02:38.254315 np0000001583 nova-compute[98241]:   <serial>2b9c7b2e-ce89-46a0-a020-361646147ba3</serial>
May 28 02:02:38.254315 np0000001583 nova-compute[98241]:   <shareable/>
May 28 02:02:38.254315 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 02:02:38.254315 np0000001583 nova-compute[98241]: </disk>
May 28 02:02:38.254315 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:02:38.261850 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-da833c80-40b4-4b01-9319-ccb10c0dfec3 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Successfully detached device vdb from instance 21c4e225-440e-4103-adaf-cb470d172291 from the persistent domain config.
May 28 02:02:38.262023 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-da833c80-40b4-4b01-9319-ccb10c0dfec3 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] (1/8): Attempting to detach device vdb with device alias ua-2b9c7b2e-ce89-46a0-a020-361646147ba3 from instance 21c4e225-440e-4103-adaf-cb470d172291 from the live domain config. {{(pid=98241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 02:02:38.262349 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-da833c80-40b4-4b01-9319-ccb10c0dfec3 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:02:38.262349 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:02:38.262349 np0000001583 nova-compute[98241]:   <alias name="ua-2b9c7b2e-ce89-46a0-a020-361646147ba3"/>
May 28 02:02:38.262349 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-10"/>
May 28 02:02:38.262349 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:02:38.262349 np0000001583 nova-compute[98241]:   <serial>2b9c7b2e-ce89-46a0-a020-361646147ba3</serial>
May 28 02:02:38.262349 np0000001583 nova-compute[98241]:   <shareable/>
May 28 02:02:38.262349 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 02:02:38.262349 np0000001583 nova-compute[98241]: </disk>
May 28 02:02:38.262349 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:02:38.300146 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:38.460409 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.658s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:02:38.460832 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 02:02:38.464654 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0d65e2e2-dbde-4d6e-9464-c82d5424351c tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.333s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:38.958222 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0d65e2e2-dbde-4d6e-9464-c82d5424351c tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:02:38.958652 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-0d65e2e2-dbde-4d6e-9464-c82d5424351c tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:02:38.969539 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 02:02:38.969908 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 02:02:38.970362 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:02:38.970675 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:02:39.053468 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8ac9af6b9d48466dbe94216d353c62af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0da6508a7a44427bd6bc6170a36b453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 02:02:39.461784 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-0d65e2e2-dbde-4d6e-9464-c82d5424351c tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:02:39.471736 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Successfully created port: 125ae4a6-f619-4ec9-8001-4bec23db9cca {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 02:02:39.474591 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 02:02:39.700746 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:39.976573 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0d65e2e2-dbde-4d6e-9464-c82d5424351c tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.515s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:02:39.980305 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 02:02:39.985474 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Successfully updated port: 125ae4a6-f619-4ec9-8001-4bec23db9cca {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 02:02:40.041237 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f1b1a8dd-28b5-4c5c-a429-47eeff6f8dd1 req-625d73c4-198b-4661-97bb-ebe671d5da55 service nova] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Received event network-changed-125ae4a6-f619-4ec9-8001-4bec23db9cca {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:02:40.041817 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f1b1a8dd-28b5-4c5c-a429-47eeff6f8dd1 req-625d73c4-198b-4661-97bb-ebe671d5da55 service nova] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Refreshing instance network info cache due to event network-changed-125ae4a6-f619-4ec9-8001-4bec23db9cca. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:02:40.041817 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f1b1a8dd-28b5-4c5c-a429-47eeff6f8dd1 req-625d73c4-198b-4661-97bb-ebe671d5da55 service nova] Acquiring lock "refresh_cache-3dd5aa3c-dade-42d8-8de7-f34574a0fc31" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:02:40.041817 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f1b1a8dd-28b5-4c5c-a429-47eeff6f8dd1 req-625d73c4-198b-4661-97bb-ebe671d5da55 service nova] Acquired lock "refresh_cache-3dd5aa3c-dade-42d8-8de7-f34574a0fc31" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:02:40.041817 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-f1b1a8dd-28b5-4c5c-a429-47eeff6f8dd1 req-625d73c4-198b-4661-97bb-ebe671d5da55 service nova] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Refreshing network info cache for port 125ae4a6-f619-4ec9-8001-4bec23db9cca {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:02:40.048033 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-0d65e2e2-dbde-4d6e-9464-c82d5424351c tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Deleted allocations for instance c6e87c0e-02e1-4941-8f2f-b969b93ebf9f
May 28 02:02:40.490800 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Acquiring lock "refresh_cache-3dd5aa3c-dade-42d8-8de7-f34574a0fc31" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:02:40.548266 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-f1b1a8dd-28b5-4c5c-a429-47eeff6f8dd1 req-625d73c4-198b-4661-97bb-ebe671d5da55 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:02:40.663590 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-f1b1a8dd-28b5-4c5c-a429-47eeff6f8dd1 req-625d73c4-198b-4661-97bb-ebe671d5da55 service nova] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:02:40.735020 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:40.823222 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-f1b1a8dd-28b5-4c5c-a429-47eeff6f8dd1 req-625d73c4-198b-4661-97bb-ebe671d5da55 service nova] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:02:40.998106 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 02:02:40.998106 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 02:02:40.998106 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Creating image(s)
May 28 02:02:40.998106 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Acquiring lock "/opt/stack/data/nova/instances/3dd5aa3c-dade-42d8-8de7-f34574a0fc31/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:40.998106 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Lock "/opt/stack/data/nova/instances/3dd5aa3c-dade-42d8-8de7-f34574a0fc31/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:40.999062 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Lock "/opt/stack/data/nova/instances/3dd5aa3c-dade-42d8-8de7-f34574a0fc31/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:02:40.999693 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:02:41.002762 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:02:41.003830 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:02:41.065051 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0d65e2e2-dbde-4d6e-9464-c82d5424351c tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Lock "c6e87c0e-02e1-4941-8f2f-b969b93ebf9f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.714s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:02:41.105530 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.102s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:02:41.106439 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:41.106439 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:41.106868 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:02:41.109893 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:02:41.110227 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:02:41.211071 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.100s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:02:41.212525 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/3dd5aa3c-dade-42d8-8de7-f34574a0fc31/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:02:41.264530 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/3dd5aa3c-dade-42d8-8de7-f34574a0fc31/disk 1073741824" returned: 0 in 0.052s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:02:41.265033 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.159s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:02:41.265369 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:02:41.326030 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f1b1a8dd-28b5-4c5c-a429-47eeff6f8dd1 req-625d73c4-198b-4661-97bb-ebe671d5da55 service nova] Releasing lock "refresh_cache-3dd5aa3c-dade-42d8-8de7-f34574a0fc31" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:02:41.327179 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Acquired lock "refresh_cache-3dd5aa3c-dade-42d8-8de7-f34574a0fc31" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:02:41.327179 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:02:41.376439 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.111s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:02:41.376825 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3dd5aa3c-dade-42d8-8de7-f34574a0fc31/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 02:02:41.377088 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dd5aa3c-dade-42d8-8de7-f34574a0fc31/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:02:41.469955 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dd5aa3c-dade-42d8-8de7-f34574a0fc31/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:02:41.470471 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Cannot resize image /opt/stack/data/nova/instances/3dd5aa3c-dade-42d8-8de7-f34574a0fc31/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 02:02:41.471014 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 02:02:41.471271 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Ensure instance console log exists: /opt/stack/data/nova/instances/3dd5aa3c-dade-42d8-8de7-f34574a0fc31/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 02:02:41.474968 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:41.474968 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:41.474968 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:02:41.557299 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Acquiring lock "e00f21c6-ce7c-4e23-94e2-7f415ae7a9be" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:41.557474 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "e00f21c6-ce7c-4e23-94e2-7f415ae7a9be" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:41.717313 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Received event <DeviceRemovedEvent: 1779933761.7169306, 21c4e225-440e-4103-adaf-cb470d172291 => ua-2b9c7b2e-ce89-46a0-a020-361646147ba3> from libvirt while the driver is waiting for it; dispatched. {{(pid=98241) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 02:02:41.718585 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-da833c80-40b4-4b01-9319-ccb10c0dfec3 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-2b9c7b2e-ce89-46a0-a020-361646147ba3 for instance 21c4e225-440e-4103-adaf-cb470d172291 {{(pid=98241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 02:02:41.722400 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-da833c80-40b4-4b01-9319-ccb10c0dfec3 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Successfully detached device vdb from instance 21c4e225-440e-4103-adaf-cb470d172291 from the live domain config.
May 28 02:02:41.759477 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da833c80-40b4-4b01-9319-ccb10c0dfec3 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:02:41.759875 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-da833c80-40b4-4b01-9319-ccb10c0dfec3 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2b9c7b2e-ce89-46a0-a020-361646147ba3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': False}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:02:41.760016 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-da833c80-40b4-4b01-9319-ccb10c0dfec3 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:02:41.760452 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-da833c80-40b4-4b01-9319-ccb10c0dfec3 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:02:41.760796 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-da833c80-40b4-4b01-9319-ccb10c0dfec3 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2b9c7b2e-ce89-46a0-a020-361646147ba3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:02:41.760943 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-da833c80-40b4-4b01-9319-ccb10c0dfec3 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:02:41.789619 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-da833c80-40b4-4b01-9319-ccb10c0dfec3 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:41.789619 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:41.789619 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:41.789619 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:41.789619 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:02:41.789619 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:02:41.789619 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:02:41.789980 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-da833c80-40b4-4b01-9319-ccb10c0dfec3 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsi session list stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:41.789980 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:41.789980 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:41.789980 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:41.789980 np0000001583 nova-compute[98241]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:02:41.789980 np0000001583 nova-compute[98241]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3 (non-flash)
May 28 02:02:41.789980 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:02:41.789980 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-da833c80-40b4-4b01-9319-ccb10c0dfec3 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86', '109'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86', '110'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', '68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', '69'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', '91'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', '92')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:02:41.790290 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-da833c80-40b4-4b01-9319-ccb10c0dfec3 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', '92')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:02:41.791162 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-da833c80-40b4-4b01-9319-ccb10c0dfec3 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3', '91')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:02:41.791933 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-da833c80-40b4-4b01-9319-ccb10c0dfec3 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f8157920>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3'): ({'sdo'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3'): ({'sdj'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:02:41.792360 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-da833c80-40b4-4b01-9319-ccb10c0dfec3 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Removing multipathed devices sdj, sdo {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:02:41.792630 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-da833c80-40b4-4b01-9319-ccb10c0dfec3 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Flush multipath device 330000000e4a7908f {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:02:41.832848 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-da833c80-40b4-4b01-9319-ccb10c0dfec3 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:02:41.882759 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-da833c80-40b4-4b01-9319-ccb10c0dfec3 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:02:41.931322 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:02:41.933699 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-da833c80-40b4-4b01-9319-ccb10c0dfec3 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Checking to see if SCSI volumes sdj, sdo have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:02:41.933952 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-da833c80-40b4-4b01-9319-ccb10c0dfec3 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] SCSI volumes sdj, sdo have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:02:41.940693 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-da833c80-40b4-4b01-9319-ccb10c0dfec3 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Checking to see if device paths {'sdj', 'sdo'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:02:41.948731 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-da833c80-40b4-4b01-9319-ccb10c0dfec3 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Device paths {'sdj', 'sdo'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:02:41.948952 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-da833c80-40b4-4b01-9319-ccb10c0dfec3 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:02:41.965052 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-da833c80-40b4-4b01-9319-ccb10c0dfec3 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:42.003114 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-da833c80-40b4-4b01-9319-ccb10c0dfec3 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 92, target: iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3, portal: 192.168.40.100,3260]
May 28 02:02:42.003114 np0000001583 nova-compute[98241]: Logout of [sid: 92, target: iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3, portal: 192.168.40.100,3260] successful.
May 28 02:02:42.003114 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:42.019574 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-da833c80-40b4-4b01-9319-ccb10c0dfec3 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:42.032502 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-da833c80-40b4-4b01-9319-ccb10c0dfec3 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:42.064010 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lazy-loading 'flavor' on Instance uuid e00f21c6-ce7c-4e23-94e2-7f415ae7a9be {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:02:42.069637 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-da833c80-40b4-4b01-9319-ccb10c0dfec3 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 91, target: iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3, portal: 192.168.50.100,3260]
May 28 02:02:42.069637 np0000001583 nova-compute[98241]: Logout of [sid: 91, target: iqn.2023-03.storpool.com:os--volume-2b9c7b2e-ce89-46a0-a020-361646147ba3, portal: 192.168.50.100,3260] successful.
May 28 02:02:42.069637 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:42.092696 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-da833c80-40b4-4b01-9319-ccb10c0dfec3 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:42.092894 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-da833c80-40b4-4b01-9319-ccb10c0dfec3 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:02:42.093005 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-da833c80-40b4-4b01-9319-ccb10c0dfec3 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] <== disconnect_volume: return (333ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:02:42.093152 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da833c80-40b4-4b01-9319-ccb10c0dfec3 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:02:42.157877 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:02:42.340554 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Updating instance_info_cache with network_info: [{"id": "125ae4a6-f619-4ec9-8001-4bec23db9cca", "address": "fa:16:3e:b7:25:80", "network": {"id": "e06ff8b0-4192-49df-b6dd-3887e1c2d179", "bridge": "br-int", "label": "tempest-VolumesActionsTest-410441992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f0da6508a7a44427bd6bc6170a36b453", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap125ae4a6-f6", "ovs_interfaceid": "125ae4a6-f619-4ec9-8001-4bec23db9cca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:02:42.660496 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-da833c80-40b4-4b01-9319-ccb10c0dfec3 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lazy-loading 'flavor' on Instance uuid 21c4e225-440e-4103-adaf-cb470d172291 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:02:42.843364 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Releasing lock "refresh_cache-3dd5aa3c-dade-42d8-8de7-f34574a0fc31" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:02:42.843674 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Instance network_info: |[{"id": "125ae4a6-f619-4ec9-8001-4bec23db9cca", "address": "fa:16:3e:b7:25:80", "network": {"id": "e06ff8b0-4192-49df-b6dd-3887e1c2d179", "bridge": "br-int", "label": "tempest-VolumesActionsTest-410441992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f0da6508a7a44427bd6bc6170a36b453", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap125ae4a6-f6", "ovs_interfaceid": "125ae4a6-f619-4ec9-8001-4bec23db9cca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 02:02:42.846047 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Start _get_guest_xml network_info=[{"id": "125ae4a6-f619-4ec9-8001-4bec23db9cca", "address": "fa:16:3e:b7:25:80", "network": {"id": "e06ff8b0-4192-49df-b6dd-3887e1c2d179", "bridge": "br-int", "label": "tempest-VolumesActionsTest-410441992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f0da6508a7a44427bd6bc6170a36b453", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap125ae4a6-f6", "ovs_interfaceid": "125ae4a6-f619-4ec9-8001-4bec23db9cca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 02:02:42.848935 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:02:42.850568 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-1806083704', uuid='3dd5aa3c-dade-42d8-8de7-f34574a0fc31'), owner=OwnerMeta(userid='8ac9af6b9d48466dbe94216d353c62af', username='tempest-VolumesActionsTest-110721277-project-member', projectid='f0da6508a7a44427bd6bc6170a36b453', projectname='tempest-VolumesActionsTest-110721277'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "125ae4a6-f619-4ec9-8001-4bec23db9cca", "address": "fa:16:3e:b7:25:80", "network": {"id": "e06ff8b0-4192-49df-b6dd-3887e1c2d179", "bridge": "br-int", "label": "tempest-VolumesActionsTest-410441992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f0da6508a7a44427bd6bc6170a36b453", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap125ae4a6-f6", "ovs_interfaceid": "125ae4a6-f619-4ec9-8001-4bec23db9cca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933762.8500922) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 02:02:42.852059 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 02:02:42.852477 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 02:02:42.853572 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 02:02:42.853780 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 02:02:42.854989 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 02:02:42.855457 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 02:02:42.855638 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 02:02:42.855799 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 02:02:42.855997 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 02:02:42.856213 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 02:02:42.856344 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 02:02:42.856569 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 02:02:42.856759 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 02:02:42.856931 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 02:02:42.857110 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 02:02:42.857380 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 02:02:42.873851 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:02:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1806083704',display_name='tempest-VolumesActionsTest-instance-1806083704',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-volumesactionstest-instance-1806083704',id=50,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0da6508a7a44427bd6bc6170a36b453',ramdisk_id='',reservation_id='r-v70oo41g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-110721277',owner_user_name='tempest-VolumesActionsTest-110721277-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:02:40Z,user_data=None,user_id='8ac9af6b9d48466dbe94216d353c62af',uuid=3dd5aa3c-dade-42d8-8de7-f34574a0fc31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "125ae4a6-f619-4ec9-8001-4bec23db9cca", "address": "fa:16:3e:b7:25:80", "network": {"id": "e06ff8b0-4192-49df-b6dd-3887e1c2d179", "bridge": "br-int", "label": "tempest-VolumesActionsTest-410441992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f0da6508a7a44427bd6bc6170a36b453", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap125ae4a6-f6", "ovs_interfaceid": "125ae4a6-f619-4ec9-8001-4bec23db9cca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 02:02:42.874052 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Converting VIF {"id": "125ae4a6-f619-4ec9-8001-4bec23db9cca", "address": "fa:16:3e:b7:25:80", "network": {"id": "e06ff8b0-4192-49df-b6dd-3887e1c2d179", "bridge": "br-int", "label": "tempest-VolumesActionsTest-410441992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f0da6508a7a44427bd6bc6170a36b453", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap125ae4a6-f6", "ovs_interfaceid": "125ae4a6-f619-4ec9-8001-4bec23db9cca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:02:42.874829 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:25:80,bridge_name='br-int',has_traffic_filtering=True,id=125ae4a6-f619-4ec9-8001-4bec23db9cca,network=Network(e06ff8b0-4192-49df-b6dd-3887e1c2d179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap125ae4a6-f6') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:02:42.875559 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Lazy-loading 'pci_devices' on Instance uuid 3dd5aa3c-dade-42d8-8de7-f34574a0fc31 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:02:43.073630 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "e00f21c6-ce7c-4e23-94e2-7f415ae7a9be" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.516s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:02:43.160147 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:43.302946 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:43.378706 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] End _get_guest_xml xml=<domain type="qemu">
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:   <uuid>3dd5aa3c-dade-42d8-8de7-f34574a0fc31</uuid>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:   <name>instance-00000032</name>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:   <metadata>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:       <nova:name>tempest-VolumesActionsTest-instance-1806083704</nova:name>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 02:02:42</nova:creationTime>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:       </nova:image>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:         <nova:user uuid="8ac9af6b9d48466dbe94216d353c62af">tempest-VolumesActionsTest-110721277-project-member</nova:user>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:         <nova:project uuid="f0da6508a7a44427bd6bc6170a36b453">tempest-VolumesActionsTest-110721277</nova:project>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:         <nova:port uuid="125ae4a6-f619-4ec9-8001-4bec23db9cca">
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:         </nova:port>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:   </metadata>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:     <system>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:       <entry name="serial">3dd5aa3c-dade-42d8-8de7-f34574a0fc31</entry>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:       <entry name="uuid">3dd5aa3c-dade-42d8-8de7-f34574a0fc31</entry>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:     </system>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:   <os>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:   </os>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:   <features>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:     <acpi/>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:     <tcg>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:     </tcg>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:   </features>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:   </cpu>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:   <devices>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/3dd5aa3c-dade-42d8-8de7-f34574a0fc31/disk"/>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:     </disk>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/3dd5aa3c-dade-42d8-8de7-f34574a0fc31/disk.config"/>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:     </disk>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:b7:25:80"/>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:       <target dev="tap125ae4a6-f6"/>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:     </interface>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/3dd5aa3c-dade-42d8-8de7-f34574a0fc31/console.log" append="off"/>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:     </serial>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:     <video>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:     </video>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:     </rng>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:     </memballoon>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:   </devices>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]: </domain>
May 28 02:02:43.378706 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 02:02:43.380600 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Preparing to wait for external event network-vif-plugged-125ae4a6-f619-4ec9-8001-4bec23db9cca {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 02:02:43.380600 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Acquiring lock "3dd5aa3c-dade-42d8-8de7-f34574a0fc31-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:43.380600 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Lock "3dd5aa3c-dade-42d8-8de7-f34574a0fc31-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:43.380600 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Lock "3dd5aa3c-dade-42d8-8de7-f34574a0fc31-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:02:43.380600 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:02:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1806083704',display_name='tempest-VolumesActionsTest-instance-1806083704',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-volumesactionstest-instance-1806083704',id=50,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0da6508a7a44427bd6bc6170a36b453',ramdisk_id='',reservation_id='r-v70oo41g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-110721277',owner_user_name='tempest-VolumesActionsTest-110721277-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:02:40Z,user_data=None,user_id='8ac9af6b9d48466dbe94216d353c62af',uuid=3dd5aa3c-dade-42d8-8de7-f34574a0fc31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "125ae4a6-f619-4ec9-8001-4bec23db9cca", "address": "fa:16:3e:b7:25:80", "network": {"id": "e06ff8b0-4192-49df-b6dd-3887e1c2d179", "bridge": "br-int", "label": "tempest-VolumesActionsTest-410441992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f0da6508a7a44427bd6bc6170a36b453", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap125ae4a6-f6", "ovs_interfaceid": "125ae4a6-f619-4ec9-8001-4bec23db9cca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 02:02:43.380783 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Converting VIF {"id": "125ae4a6-f619-4ec9-8001-4bec23db9cca", "address": "fa:16:3e:b7:25:80", "network": {"id": "e06ff8b0-4192-49df-b6dd-3887e1c2d179", "bridge": "br-int", "label": "tempest-VolumesActionsTest-410441992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f0da6508a7a44427bd6bc6170a36b453", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap125ae4a6-f6", "ovs_interfaceid": "125ae4a6-f619-4ec9-8001-4bec23db9cca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:02:43.381198 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:25:80,bridge_name='br-int',has_traffic_filtering=True,id=125ae4a6-f619-4ec9-8001-4bec23db9cca,network=Network(e06ff8b0-4192-49df-b6dd-3887e1c2d179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap125ae4a6-f6') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:02:43.381512 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:25:80,bridge_name='br-int',has_traffic_filtering=True,id=125ae4a6-f619-4ec9-8001-4bec23db9cca,network=Network(e06ff8b0-4192-49df-b6dd-3887e1c2d179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap125ae4a6-f6') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 02:02:43.381890 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:43.382224 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:02:43.382535 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 02:02:43.383712 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:43.383996 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8b8ca944-98cd-50aa-9201-11b23e707b92', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:02:43.384950 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:43.388012 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:43.388655 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:02:43.390582 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:43.390782 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap125ae4a6-f6, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:02:43.391238 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap125ae4a6-f6, col_values=(('qos', UUID('391029b9-89b3-472f-9add-aa9c3f6008c9')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:02:43.391469 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap125ae4a6-f6, col_values=(('external_ids', {'iface-id': '125ae4a6-f619-4ec9-8001-4bec23db9cca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:25:80', 'vm-uuid': '3dd5aa3c-dade-42d8-8de7-f34574a0fc31'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:02:43.395110 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:02:43.400196 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:43.403826 np0000001583 nova-compute[98241]: INFO os_vif [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:25:80,bridge_name='br-int',has_traffic_filtering=True,id=125ae4a6-f619-4ec9-8001-4bec23db9cca,network=Network(e06ff8b0-4192-49df-b6dd-3887e1c2d179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap125ae4a6-f6')
May 28 02:02:43.667222 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-da833c80-40b4-4b01-9319-ccb10c0dfec3 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "21c4e225-440e-4103-adaf-cb470d172291" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.973s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:02:44.200549 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Acquiring lock "e00f21c6-ce7c-4e23-94e2-7f415ae7a9be" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:44.200950 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "e00f21c6-ce7c-4e23-94e2-7f415ae7a9be" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:44.200990 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Attaching volume 69c89952-ecdf-4907-af49-d3937eb47dec to /dev/vdb
May 28 02:02:44.245072 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:02:44.258519 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 02:02:44.280697 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:02:44.322793 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 02:02:44.323097 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 02:02:44.331219 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 02:02:44.332538 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe48:7d7b', 'fe80::d0cf:7bff:fef9:3cc3', 'fe80::fc16:3eff:fed3:cd06', 'fe80::fc16:3eff:fedf:4521', 'fe80::fc16:3eff:fe76:c53f', 'fe80::fc16:3eff:fe57:9502', 'fe80::fc16:3eff:fe47:cf5e', 'fe80::5048:4dff:fe67:fb12', 'fe80::fc16:3eff:fec0:11b8', 'fe80::b0dd:40ff:feb5:6704', 'fe80::fc16:3eff:fe9e:36ca', 'fe80::34e0:eeff:fee2:bede'] 
May 28 02:02:44.332655 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 02:02:44.332749 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 02:02:44.332971 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] <== get_connector_properties: return (87ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:02:44.333225 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Updating existing volume attachment record: 040c575c-7775-41f3-bc05-19c5fa09edcd {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 02:02:44.884108 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 02:02:44.884487 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec', 'iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '69c89952-ecdf-4907-af49-d3937eb47dec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:02:44.884667 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:02:44.885146 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:02:44.885347 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec', 'iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '69c89952-ecdf-4907-af49-d3937eb47dec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 02:02:44.898018 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:02:44.898651 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:02:44.899132 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:02:44.899323 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:02:44.899706 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:02:44.899897 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:02:44.912194 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:02:44.912194 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:44.918809 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:02:44.918809 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:44.928548 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:02:44.928663 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:02:44.928790 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] No VIF found with MAC fa:16:3e:b7:25:80, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:02:44.929487 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Using config drive
May 28 02:02:44.930806 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec] added
May 28 02:02:44.930806 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:02:44.930806 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:02:44.930806 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:02:44.930806 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:02:44.930806 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:02:44.930806 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:44.930991 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:02:44.931270 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0318(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:02:44.931436 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:02:44.935796 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec] added
May 28 02:02:44.935796 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:02:44.935796 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:02:44.935796 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:02:44.935796 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:02:44.935796 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:02:44.935796 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:44.935796 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:02:44.936036 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0359(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:02:44.936114 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:02:45.098793 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:45.437880 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:02:45.569656 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Creating config drive at /opt/stack/data/nova/instances/3dd5aa3c-dade-42d8-8de7-f34574a0fc31/disk.config
May 28 02:02:45.572997 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3dd5aa3c-dade-42d8-8de7-f34574a0fc31/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5b9xly7d {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:02:45.625309 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3dd5aa3c-dade-42d8-8de7-f34574a0fc31/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5b9xly7d" returned: 0 in 0.052s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:02:45.932528 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:02:45.936541 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:02:45.950700 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:02:45.950700 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:02:45.959326 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:02:45.959326 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:45.970146 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:45.975737 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:45.986120 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:45.986120 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:45.986120 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:45.986120 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:45.986120 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:02:45.986387 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsi session list stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:45.986387 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:45.986387 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:45.986387 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:45.986387 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:02:45.997132 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:45.997132 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:45.997132 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:45.997132 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:45.997132 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:02:45.997409 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsi session list stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:45.997409 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:45.997409 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:45.997409 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:45.997409 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:02:46.031590 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec, portal: 192.168.40.100,3260]
May 28 02:02:46.031590 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec, portal: 192.168.40.100,3260] successful.
May 28 02:02:46.031590 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:46.047750 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:46.062648 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec, portal: 192.168.50.100,3260]
May 28 02:02:46.062648 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec, portal: 192.168.50.100,3260] successful.
May 28 02:02:46.062648 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:46.068598 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:46.068598 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:46.068598 np0000001583 nova-compute[98241]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:02:46.068598 np0000001583 nova-compute[98241]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:02:46.068598 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:46.068598 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:46.068598 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:02:46.068869 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsi session list stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:46.068869 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:46.068869 np0000001583 nova-compute[98241]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:02:46.068869 np0000001583 nova-compute[98241]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:02:46.068869 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:46.068869 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:46.068869 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:02:46.069174 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.170s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:02:46.069337 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:02:46.070037 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] HCTL ('10', '-', '-', 0) found on session 111 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:02:46.070539 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:02:46.077448 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:46.105764 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:46.105764 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Searching for a device in session 111 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:02:46.105764 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '69c89952-ecdf-4907-af49-d3937eb47dec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:02:46.125685 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:46.125685 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:46.125685 np0000001583 nova-compute[98241]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:02:46.125685 np0000001583 nova-compute[98241]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:02:46.125685 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:46.125685 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:46.125685 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:02:46.125685 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsi session list stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:46.125685 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:46.125685 np0000001583 nova-compute[98241]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:02:46.125685 np0000001583 nova-compute[98241]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:02:46.125685 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:46.125685 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:46.125685 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:02:46.125685 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.224s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:02:46.125685 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:02:46.125685 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] HCTL ('11', '-', '-', 0) found on session 112 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:02:46.125685 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:02:46.125685 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:46.153124 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Searching for a device in session 112 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:02:46.153266 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '69c89952-ecdf-4907-af49-d3937eb47dec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:02:46.243925 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:46.362269 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5afd211a-476f-4da0-b689-a6861084ac76 req-bf8aaf7c-da89-4f43-baaa-497e45d94378 service nova] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Received event network-vif-plugged-125ae4a6-f619-4ec9-8001-4bec23db9cca {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:02:46.362619 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5afd211a-476f-4da0-b689-a6861084ac76 req-bf8aaf7c-da89-4f43-baaa-497e45d94378 service nova] Acquiring lock "3dd5aa3c-dade-42d8-8de7-f34574a0fc31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:46.362865 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5afd211a-476f-4da0-b689-a6861084ac76 req-bf8aaf7c-da89-4f43-baaa-497e45d94378 service nova] Lock "3dd5aa3c-dade-42d8-8de7-f34574a0fc31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:46.363094 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5afd211a-476f-4da0-b689-a6861084ac76 req-bf8aaf7c-da89-4f43-baaa-497e45d94378 service nova] Lock "3dd5aa3c-dade-42d8-8de7-f34574a0fc31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:02:46.363470 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5afd211a-476f-4da0-b689-a6861084ac76 req-bf8aaf7c-da89-4f43-baaa-497e45d94378 service nova] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Processing event network-vif-plugged-125ae4a6-f619-4ec9-8001-4bec23db9cca {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 02:02:46.545554 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:46.548122 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:46.550814 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:46.575854 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:46.607396 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "ef2472b3-00d4-4d9d-8ebc-266857e4b91d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:46.607666 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "ef2472b3-00d4-4d9d-8ebc-266857e4b91d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:46.899987 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 02:02:47.026995 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 02:02:47.027873 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933767.02732, 3dd5aa3c-dade-42d8-8de7-f34574a0fc31 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:02:47.028265 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] VM Started (Lifecycle Event)
May 28 02:02:47.029867 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 02:02:47.036818 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Instance spawned successfully.
May 28 02:02:47.036818 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 02:02:47.111520 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 02:02:47.532354 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:02:47.535980 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:02:47.543398 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:02:47.543623 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:02:47.543842 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:02:47.544049 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:02:47.544367 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:02:47.544637 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:02:47.679654 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:47.682200 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:47.682918 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 02:02:47.683039 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Claim successful on node np0000001583
May 28 02:02:47.919896 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Found WWN 3300000002d200271 for multipath device dm-3 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 02:02:47.921773 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:02:47.921773 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '3300000002d200271', 'path': '/dev/dm-3', 'multipath_id': '3300000002d200271'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:02:47.921773 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002d200271', 'path': '/dev/dm-3', 'multipath_id': '3300000002d200271'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 02:02:47.924971 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lazy-loading 'flavor' on Instance uuid e00f21c6-ce7c-4e23-94e2-7f415ae7a9be {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:02:48.038722 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 02:02:48.038963 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933768.0387795, 3dd5aa3c-dade-42d8-8de7-f34574a0fc31 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:02:48.039071 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] VM Paused (Lifecycle Event)
May 28 02:02:48.049969 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Took 7.05 seconds to spawn the instance on the hypervisor.
May 28 02:02:48.050195 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:02:48.305105 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:48.393329 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:48.427787 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Attempting to attach volume 69c89952-ecdf-4907-af49-d3937eb47dec with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98241) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 02:02:48.431320 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-dd91bfbd-d005-43d1-9934-59e1dc94cde8 req-6e5d087b-5d07-4be3-bc31-9c7412a7cfb8 service nova] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Received event network-vif-plugged-125ae4a6-f619-4ec9-8001-4bec23db9cca {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:02:48.431775 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-dd91bfbd-d005-43d1-9934-59e1dc94cde8 req-6e5d087b-5d07-4be3-bc31-9c7412a7cfb8 service nova] Acquiring lock "3dd5aa3c-dade-42d8-8de7-f34574a0fc31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:48.432506 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] attach device xml: <disk type="block" device="disk">
May 28 02:02:48.432506 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:02:48.432506 np0000001583 nova-compute[98241]:   <alias name="ua-69c89952-ecdf-4907-af49-d3937eb47dec"/>
May 28 02:02:48.432506 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-3"/>
May 28 02:02:48.432506 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:02:48.432506 np0000001583 nova-compute[98241]:   <serial>69c89952-ecdf-4907-af49-d3937eb47dec</serial>
May 28 02:02:48.432506 np0000001583 nova-compute[98241]: </disk>
May 28 02:02:48.432506 np0000001583 nova-compute[98241]:  {{(pid=98241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 02:02:48.433357 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-dd91bfbd-d005-43d1-9934-59e1dc94cde8 req-6e5d087b-5d07-4be3-bc31-9c7412a7cfb8 service nova] Lock "3dd5aa3c-dade-42d8-8de7-f34574a0fc31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:48.433357 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-dd91bfbd-d005-43d1-9934-59e1dc94cde8 req-6e5d087b-5d07-4be3-bc31-9c7412a7cfb8 service nova] Lock "3dd5aa3c-dade-42d8-8de7-f34574a0fc31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:02:48.433357 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-dd91bfbd-d005-43d1-9934-59e1dc94cde8 req-6e5d087b-5d07-4be3-bc31-9c7412a7cfb8 service nova] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] No waiting events found dispatching network-vif-plugged-125ae4a6-f619-4ec9-8001-4bec23db9cca {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:02:48.434204 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-dd91bfbd-d005-43d1-9934-59e1dc94cde8 req-6e5d087b-5d07-4be3-bc31-9c7412a7cfb8 service nova] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Received unexpected event network-vif-plugged-125ae4a6-f619-4ec9-8001-4bec23db9cca for instance with vm_state active and task_state None.
May 28 02:02:48.541939 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:02:48.545146 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933768.5448487, 3dd5aa3c-dade-42d8-8de7-f34574a0fc31 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:02:48.545297 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] VM Resumed (Lifecycle Event)
May 28 02:02:48.563027 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Took 12.82 seconds to build instance.
May 28 02:02:49.047781 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:02:49.054354 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:02:49.064698 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Lock "3dd5aa3c-dade-42d8-8de7-f34574a0fc31" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.330s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:02:49.253298 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:02:49.253559 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:02:49.756183 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:02:50.052823 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Acquiring lock "1f15126e-6636-4765-8650-bb717f186efe" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:50.053310 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "1f15126e-6636-4765-8650-bb717f186efe" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:50.116550 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:02:50.116754 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:02:50.116918 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:02:50.117320 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] No VIF found with MAC fa:16:3e:47:cf:5e, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:02:50.194877 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:50.219722 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0011246980002397322 future=<Future at 0x7724ec1ce300 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:02:50.219722 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:02:50.220340 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Emitting event <LifecycleEvent: 1779933755.2175555, c6e87c0e-02e1-4941-8f2f-b969b93ebf9f => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:02:50.220340 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] VM Stopped (Lifecycle Event)
May 28 02:02:50.264192 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.584s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:02:50.264512 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 02:02:50.556576 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lazy-loading 'flavor' on Instance uuid 1f15126e-6636-4765-8650-bb717f186efe {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:02:50.723894 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: c6e87c0e-02e1-4941-8f2f-b969b93ebf9f] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:02:50.769585 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 02:02:50.771117 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 02:02:50.772160 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:02:50.772448 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:02:50.937321 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cadb612e41314b06914d5f5f47570e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0474090f4f2d4950b51bc317f4302266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 02:02:51.060017 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Ignoring supplied device name: /dev/vdb
May 28 02:02:51.272598 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 02:02:51.564876 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "1f15126e-6636-4765-8650-bb717f186efe" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:02:51.655025 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Successfully created port: 276d5af7-b597-4686-a307-b9b7c26cb661 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 02:02:51.692353 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-01cab389-1844-4e52-898e-c06380f86f8c tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "e00f21c6-ce7c-4e23-94e2-7f415ae7a9be" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.491s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:02:51.775767 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 02:02:52.261253 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:52.275932 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Successfully updated port: 276d5af7-b597-4686-a307-b9b7c26cb661 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 02:02:52.280410 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Booting with volume 130e87d8-0de4-480b-962d-0534472cd0aa at /dev/vda
May 28 02:02:52.334447 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:02:52.338028 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-566adf8d-c651-4992-b549-882f5aa4c0f9 req-44393d09-7d53-4173-aab6-5ebeac58baee service nova] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Received event network-changed-276d5af7-b597-4686-a307-b9b7c26cb661 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:02:52.338028 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-566adf8d-c651-4992-b549-882f5aa4c0f9 req-44393d09-7d53-4173-aab6-5ebeac58baee service nova] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Refreshing instance network info cache due to event network-changed-276d5af7-b597-4686-a307-b9b7c26cb661. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:02:52.338028 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-566adf8d-c651-4992-b549-882f5aa4c0f9 req-44393d09-7d53-4173-aab6-5ebeac58baee service nova] Acquiring lock "refresh_cache-ef2472b3-00d4-4d9d-8ebc-266857e4b91d" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:02:52.338028 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-566adf8d-c651-4992-b549-882f5aa4c0f9 req-44393d09-7d53-4173-aab6-5ebeac58baee service nova] Acquired lock "refresh_cache-ef2472b3-00d4-4d9d-8ebc-266857e4b91d" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:02:52.338028 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-566adf8d-c651-4992-b549-882f5aa4c0f9 req-44393d09-7d53-4173-aab6-5ebeac58baee service nova] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Refreshing network info cache for port 276d5af7-b597-4686-a307-b9b7c26cb661 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:02:52.350031 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 02:02:52.373452 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:02:52.425059 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 02:02:52.425401 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 02:02:52.437471 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 02:02:52.439374 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe48:7d7b', 'fe80::d0cf:7bff:fef9:3cc3', 'fe80::fc16:3eff:fed3:cd06', 'fe80::fc16:3eff:fedf:4521', 'fe80::fc16:3eff:fe76:c53f', 'fe80::fc16:3eff:fe57:9502', 'fe80::fc16:3eff:fe47:cf5e', 'fe80::5048:4dff:fe67:fb12', 'fe80::fc16:3eff:fec0:11b8', 'fe80::b0dd:40ff:feb5:6704', 'fe80::fc16:3eff:fe9e:36ca', 'fe80::34e0:eeff:fee2:bede', 'fe80::fc16:3eff:feb7:2580', 'fe80::88c5:37ff:fe3c:15a8'] 
May 28 02:02:52.439533 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 02:02:52.439703 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 02:02:52.440069 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] <== get_connector_properties: return (105ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:02:52.440405 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Updating existing volume attachment record: 081f5b17-2b1f-4b21-93c1-5bba53463992 {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 02:02:52.659887 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Acquiring lock "1f15126e-6636-4765-8650-bb717f186efe" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:52.660221 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "1f15126e-6636-4765-8650-bb717f186efe" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:52.660493 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Attaching volume 093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 to /dev/vdb
May 28 02:02:52.722122 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:02:52.730253 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-3f0bc688-2755-4e53-b24d-4b6d18a7298d req-d7d243fd-18ec-4cc6-8746-a57d2f738661 service nova] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Received event network-vif-unplugged-276d5af7-b597-4686-a307-b9b7c26cb661 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:02:52.730253 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-3f0bc688-2755-4e53-b24d-4b6d18a7298d req-d7d243fd-18ec-4cc6-8746-a57d2f738661 service nova] Acquiring lock "ef2472b3-00d4-4d9d-8ebc-266857e4b91d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:52.730253 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-3f0bc688-2755-4e53-b24d-4b6d18a7298d req-d7d243fd-18ec-4cc6-8746-a57d2f738661 service nova] Lock "ef2472b3-00d4-4d9d-8ebc-266857e4b91d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:52.730253 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-3f0bc688-2755-4e53-b24d-4b6d18a7298d req-d7d243fd-18ec-4cc6-8746-a57d2f738661 service nova] Lock "ef2472b3-00d4-4d9d-8ebc-266857e4b91d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:02:52.730754 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-3f0bc688-2755-4e53-b24d-4b6d18a7298d req-d7d243fd-18ec-4cc6-8746-a57d2f738661 service nova] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] No waiting events found dispatching network-vif-unplugged-276d5af7-b597-4686-a307-b9b7c26cb661 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:02:52.730754 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-3f0bc688-2755-4e53-b24d-4b6d18a7298d req-d7d243fd-18ec-4cc6-8746-a57d2f738661 service nova] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Received unexpected event network-vif-unplugged-276d5af7-b597-4686-a307-b9b7c26cb661 for instance with vm_state building and task_state block_device_mapping.
May 28 02:02:52.739523 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 02:02:52.772527 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:02:52.801543 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "refresh_cache-ef2472b3-00d4-4d9d-8ebc-266857e4b91d" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:02:52.834126 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 02:02:52.834578 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 02:02:52.840826 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-566adf8d-c651-4992-b549-882f5aa4c0f9 req-44393d09-7d53-4173-aab6-5ebeac58baee service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:02:52.849960 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 02:02:52.851667 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe48:7d7b', 'fe80::d0cf:7bff:fef9:3cc3', 'fe80::fc16:3eff:fed3:cd06', 'fe80::fc16:3eff:fedf:4521', 'fe80::fc16:3eff:fe76:c53f', 'fe80::fc16:3eff:fe57:9502', 'fe80::fc16:3eff:fe47:cf5e', 'fe80::5048:4dff:fe67:fb12', 'fe80::fc16:3eff:fec0:11b8', 'fe80::b0dd:40ff:feb5:6704', 'fe80::fc16:3eff:fe9e:36ca', 'fe80::34e0:eeff:fee2:bede', 'fe80::fc16:3eff:feb7:2580', 'fe80::88c5:37ff:fe3c:15a8'] 
May 28 02:02:52.851869 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 02:02:52.855830 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 02:02:52.856111 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:02:52.856764 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Updating existing volume attachment record: e5b59743-0f0d-4e14-866f-03f4b29e2a0c {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 02:02:52.955492 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-566adf8d-c651-4992-b549-882f5aa4c0f9 req-44393d09-7d53-4173-aab6-5ebeac58baee service nova] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:02:52.995706 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Acquiring lock "e00f21c6-ce7c-4e23-94e2-7f415ae7a9be" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:52.997153 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "e00f21c6-ce7c-4e23-94e2-7f415ae7a9be" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:53.180315 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-566adf8d-c651-4992-b549-882f5aa4c0f9 req-44393d09-7d53-4173-aab6-5ebeac58baee service nova] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:02:53.308050 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:53.394532 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:53.429960 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 02:02:53.430430 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19', 'iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '093ceec4-8090-44f9-a9d3-1a5fe5fe9b19', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:02:53.430622 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:02:53.430964 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:02:53.431188 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19', 'iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '093ceec4-8090-44f9-a9d3-1a5fe5fe9b19', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 02:02:53.446502 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:02:53.447209 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:02:53.447933 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:02:53.448255 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:02:53.448664 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:02:53.449226 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:02:53.463093 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:02:53.463093 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:53.468397 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:02:53.468397 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:53.479414 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19] added
May 28 02:02:53.479414 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:02:53.479414 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:02:53.479414 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:02:53.479414 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:02:53.479414 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:02:53.479414 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:53.479749 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:02:53.479749 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0316(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:02:53.479866 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:02:53.482201 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19] added
May 28 02:02:53.482201 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:02:53.482201 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:02:53.482201 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:02:53.482201 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:02:53.482201 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:02:53.482201 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:53.482553 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:02:53.482553 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0333(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:02:53.482635 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:02:53.502173 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lazy-loading 'flavor' on Instance uuid e00f21c6-ce7c-4e23-94e2-7f415ae7a9be {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:02:53.682805 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-566adf8d-c651-4992-b549-882f5aa4c0f9 req-44393d09-7d53-4173-aab6-5ebeac58baee service nova] Releasing lock "refresh_cache-ef2472b3-00d4-4d9d-8ebc-266857e4b91d" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:02:53.683370 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquired lock "refresh_cache-ef2472b3-00d4-4d9d-8ebc-266857e4b91d" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:02:53.683651 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:02:54.300716 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:02:54.446723 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d43cacf1-4a4f-438d-934b-7eef65af0ff3 tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Acquiring lock "3dd5aa3c-dade-42d8-8de7-f34574a0fc31" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:54.447104 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d43cacf1-4a4f-438d-934b-7eef65af0ff3 tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Lock "3dd5aa3c-dade-42d8-8de7-f34574a0fc31" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:54.447173 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d43cacf1-4a4f-438d-934b-7eef65af0ff3 tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Acquiring lock "3dd5aa3c-dade-42d8-8de7-f34574a0fc31-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:54.447357 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d43cacf1-4a4f-438d-934b-7eef65af0ff3 tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Lock "3dd5aa3c-dade-42d8-8de7-f34574a0fc31-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:54.447465 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d43cacf1-4a4f-438d-934b-7eef65af0ff3 tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Lock "3dd5aa3c-dade-42d8-8de7-f34574a0fc31-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:02:54.449915 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-d43cacf1-4a4f-438d-934b-7eef65af0ff3 tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Terminating instance
May 28 02:02:54.479897 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:02:54.482680 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:02:54.483341 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:02:54.501260 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:02:54.501260 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:02:54.508103 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:02:54.508103 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:54.510806 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "e00f21c6-ce7c-4e23-94e2-7f415ae7a9be" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:02:54.521224 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:54.527809 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:54.539720 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:54.539720 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:54.539720 np0000001583 nova-compute[98241]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:02:54.539720 np0000001583 nova-compute[98241]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:02:54.539720 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:54.539720 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:54.539720 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:02:54.540116 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsi session list stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:54.540116 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:54.540116 np0000001583 nova-compute[98241]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:02:54.540116 np0000001583 nova-compute[98241]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:02:54.540116 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:54.540116 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:54.540116 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:02:54.550752 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:54.550752 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:54.550752 np0000001583 nova-compute[98241]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:02:54.550752 np0000001583 nova-compute[98241]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:02:54.550752 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:54.550752 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:54.550752 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:02:54.551068 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsi session list stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:54.551068 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:54.551068 np0000001583 nova-compute[98241]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:02:54.551068 np0000001583 nova-compute[98241]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:02:54.551068 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:54.551068 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:54.551068 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:02:54.587737 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 02:02:54.591355 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19, portal: 192.168.50.100,3260]
May 28 02:02:54.591355 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19, portal: 192.168.50.100,3260] successful.
May 28 02:02:54.591355 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:54.591972 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 02:02:54.592397 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Creating image(s)
May 28 02:02:54.592841 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Did not create local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 02:02:54.593031 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Ensure instance console log exists: /opt/stack/data/nova/instances/ef2472b3-00d4-4d9d-8ebc-266857e4b91d/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 02:02:54.593378 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:54.593586 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:54.593782 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:02:54.607020 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:54.613550 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19, portal: 192.168.40.100,3260]
May 28 02:02:54.613550 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19, portal: 192.168.40.100,3260] successful.
May 28 02:02:54.613550 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:54.626575 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:54.626575 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:54.626575 np0000001583 nova-compute[98241]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:02:54.626575 np0000001583 nova-compute[98241]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:02:54.626575 np0000001583 nova-compute[98241]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:02:54.626575 np0000001583 nova-compute[98241]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:02:54.626575 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:54.626575 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:54.626575 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:02:54.628432 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsi session list stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:54.628432 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:54.628432 np0000001583 nova-compute[98241]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:02:54.628432 np0000001583 nova-compute[98241]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:02:54.628432 np0000001583 nova-compute[98241]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:02:54.628432 np0000001583 nova-compute[98241]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:02:54.628432 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:54.628432 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:54.628432 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:02:54.628728 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.181s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:02:54.628852 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:02:54.629799 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:54.630286 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] HCTL ('13', '-', '-', 0) found on session 113 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:02:54.630434 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:02:54.654832 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:54.654832 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:54.654832 np0000001583 nova-compute[98241]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:02:54.654832 np0000001583 nova-compute[98241]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:02:54.654832 np0000001583 nova-compute[98241]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:02:54.654832 np0000001583 nova-compute[98241]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:02:54.654832 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:54.654832 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:54.654832 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:02:54.655116 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsi session list stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:54.655116 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:54.655116 np0000001583 nova-compute[98241]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:02:54.655116 np0000001583 nova-compute[98241]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:02:54.655116 np0000001583 nova-compute[98241]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:02:54.655116 np0000001583 nova-compute[98241]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:02:54.655116 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:54.655116 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:54.655116 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:02:54.658737 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.207s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:02:54.658737 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:02:54.658737 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Searching for a device in session 113 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:02:54.658737 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '093ceec4-8090-44f9-a9d3-1a5fe5fe9b19', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:02:54.660133 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] HCTL ('14', '-', '-', 0) found on session 114 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:02:54.660269 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:02:54.677857 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Updating instance_info_cache with network_info: [{"id": "276d5af7-b597-4686-a307-b9b7c26cb661", "address": "fa:16:3e:2b:6a:bd", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap276d5af7-b5", "ovs_interfaceid": "276d5af7-b597-4686-a307-b9b7c26cb661", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:02:54.679577 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Searching for a device in session 114 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:02:54.679577 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '093ceec4-8090-44f9-a9d3-1a5fe5fe9b19', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:02:54.953639 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-d43cacf1-4a4f-438d-934b-7eef65af0ff3 tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 02:02:54.978302 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:55.003287 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:55.033677 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:55.179944 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Releasing lock "refresh_cache-ef2472b3-00d4-4d9d-8ebc-266857e4b91d" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:02:55.180175 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Instance network_info: |[{"id": "276d5af7-b597-4686-a307-b9b7c26cb661", "address": "fa:16:3e:2b:6a:bd", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap276d5af7-b5", "ovs_interfaceid": "276d5af7-b597-4686-a307-b9b7c26cb661", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 02:02:55.181537 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Start _get_guest_xml network_info=[{"id": "276d5af7-b597-4686-a307-b9b7c26cb661", "address": "fa:16:3e:2b:6a:bd", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap276d5af7-b5", "ovs_interfaceid": "276d5af7-b597-4686-a307-b9b7c26cb661", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa', 'iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '130e87d8-0de4-480b-962d-0534472cd0aa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'ef2472b3-00d4-4d9d-8ebc-266857e4b91d', 'attached_at': '', 'detached_at': '', 'volume_id': '130e87d8-0de4-480b-962d-0534472cd0aa', 'serial': '130e87d8-0de4-480b-962d-0534472cd0aa', 'multiattach': True}, 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '081f5b17-2b1f-4b21-93c1-5bba53463992', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 02:02:55.186262 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:02:55.186724 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeMultiAttachTest-server-871699587', uuid='ef2472b3-00d4-4d9d-8ebc-266857e4b91d'), owner=OwnerMeta(userid='cadb612e41314b06914d5f5f47570e98', username='tempest-AttachVolumeMultiAttachTest-857456921-project-member', projectid='0474090f4f2d4950b51bc317f4302266', projectname='tempest-AttachVolumeMultiAttachTest-857456921'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "276d5af7-b597-4686-a307-b9b7c26cb661", "address": "fa:16:3e:2b:6a:bd", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap276d5af7-b5", "ovs_interfaceid": "276d5af7-b597-4686-a307-b9b7c26cb661", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933775.1860368) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 02:02:55.188431 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 02:02:55.188770 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 02:02:55.190005 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 02:02:55.190239 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 02:02:55.191139 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 02:02:55.191533 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 02:02:55.191702 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 02:02:55.191795 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 02:02:55.192383 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 02:02:55.192383 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 02:02:55.192542 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 02:02:55.192822 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 02:02:55.192934 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 02:02:55.193439 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 02:02:55.193714 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 02:02:55.193893 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 02:02:55.210055 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 02:02:55.210514 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa', 'iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '130e87d8-0de4-480b-962d-0534472cd0aa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:02:55.211111 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:02:55.243777 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2be7f4d7-f317-4c1c-b2e1-eb815b7912e9 req-ef2eb755-5497-4f80-b2e0-5c8d5eb1ed12 service nova] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Received event network-vif-unplugged-125ae4a6-f619-4ec9-8001-4bec23db9cca {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:02:55.244009 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2be7f4d7-f317-4c1c-b2e1-eb815b7912e9 req-ef2eb755-5497-4f80-b2e0-5c8d5eb1ed12 service nova] Acquiring lock "3dd5aa3c-dade-42d8-8de7-f34574a0fc31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:55.244092 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2be7f4d7-f317-4c1c-b2e1-eb815b7912e9 req-ef2eb755-5497-4f80-b2e0-5c8d5eb1ed12 service nova] Lock "3dd5aa3c-dade-42d8-8de7-f34574a0fc31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:55.244222 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2be7f4d7-f317-4c1c-b2e1-eb815b7912e9 req-ef2eb755-5497-4f80-b2e0-5c8d5eb1ed12 service nova] Lock "3dd5aa3c-dade-42d8-8de7-f34574a0fc31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:02:55.244551 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2be7f4d7-f317-4c1c-b2e1-eb815b7912e9 req-ef2eb755-5497-4f80-b2e0-5c8d5eb1ed12 service nova] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] No waiting events found dispatching network-vif-unplugged-125ae4a6-f619-4ec9-8001-4bec23db9cca {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:02:55.245158 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2be7f4d7-f317-4c1c-b2e1-eb815b7912e9 req-ef2eb755-5497-4f80-b2e0-5c8d5eb1ed12 service nova] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Received event network-vif-unplugged-125ae4a6-f619-4ec9-8001-4bec23db9cca for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:02:55.316743 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999666384000193 future=<Future at 0x7724ec1991f0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:02:55.316888 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.99947469100016 future=<Future at 0x7724ec1991f0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:02:55.317011 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999362232999829 future=<Future at 0x7724ec1991f0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:02:55.319301 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Instance destroyed successfully.
May 28 02:02:55.320237 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-d43cacf1-4a4f-438d-934b-7eef65af0ff3 tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Lazy-loading 'resources' on Instance uuid 3dd5aa3c-dade-42d8-8de7-f34574a0fc31 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:02:55.449856 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 02:02:55.618399 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Acquiring lock "e00f21c6-ce7c-4e23-94e2-7f415ae7a9be" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:55.618566 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "e00f21c6-ce7c-4e23-94e2-7f415ae7a9be" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:55.618788 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Attaching volume 776608d6-bb99-44d4-af54-73e3c444e7f1 to /dev/vdc
May 28 02:02:55.680382 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:02:55.696387 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 02:02:55.729856 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:02:55.776766 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 02:02:55.777109 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 02:02:55.786719 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 02:02:55.788385 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe48:7d7b', 'fe80::d0cf:7bff:fef9:3cc3', 'fe80::fc16:3eff:fed3:cd06', 'fe80::fc16:3eff:fedf:4521', 'fe80::fc16:3eff:fe76:c53f', 'fe80::fc16:3eff:fe57:9502', 'fe80::fc16:3eff:fe47:cf5e', 'fe80::5048:4dff:fe67:fb12', 'fe80::fc16:3eff:fec0:11b8', 'fe80::b0dd:40ff:feb5:6704', 'fe80::fc16:3eff:fe9e:36ca', 'fe80::34e0:eeff:fee2:bede'] 
May 28 02:02:55.788547 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 02:02:55.788724 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 02:02:55.789061 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:02:55.789458 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Updating existing volume attachment record: 6876a0fc-b6bb-4a8c-854b-0de62a8f13d0 {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 02:02:55.822927 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-d43cacf1-4a4f-438d-934b-7eef65af0ff3 tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T02:02:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1806083704',display_name='tempest-VolumesActionsTest-instance-1806083704',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-volumesactionstest-instance-1806083704',id=50,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:02:48Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f0da6508a7a44427bd6bc6170a36b453',ramdisk_id='',reservation_id='r-v70oo41g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-110721277',owner_user_name='tempest-VolumesActionsTest-110721277-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T02:02:48Z,user_data=None,user_id='8ac9af6b9d48466dbe94216d353c62af',uuid=3dd5aa3c-dade-42d8-8de7-f34574a0fc31,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "125ae4a6-f619-4ec9-8001-4bec23db9cca", "address": "fa:16:3e:b7:25:80", "network": {"id": "e06ff8b0-4192-49df-b6dd-3887e1c2d179", "bridge": "br-int", "label": "tempest-VolumesActionsTest-410441992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f0da6508a7a44427bd6bc6170a36b453", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap125ae4a6-f6", "ovs_interfaceid": "125ae4a6-f619-4ec9-8001-4bec23db9cca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:02:55.823216 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-d43cacf1-4a4f-438d-934b-7eef65af0ff3 tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Converting VIF {"id": "125ae4a6-f619-4ec9-8001-4bec23db9cca", "address": "fa:16:3e:b7:25:80", "network": {"id": "e06ff8b0-4192-49df-b6dd-3887e1c2d179", "bridge": "br-int", "label": "tempest-VolumesActionsTest-410441992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f0da6508a7a44427bd6bc6170a36b453", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap125ae4a6-f6", "ovs_interfaceid": "125ae4a6-f619-4ec9-8001-4bec23db9cca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:02:55.823988 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-d43cacf1-4a4f-438d-934b-7eef65af0ff3 tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:25:80,bridge_name='br-int',has_traffic_filtering=True,id=125ae4a6-f619-4ec9-8001-4bec23db9cca,network=Network(e06ff8b0-4192-49df-b6dd-3887e1c2d179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap125ae4a6-f6') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:02:55.824255 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-d43cacf1-4a4f-438d-934b-7eef65af0ff3 tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:25:80,bridge_name='br-int',has_traffic_filtering=True,id=125ae4a6-f619-4ec9-8001-4bec23db9cca,network=Network(e06ff8b0-4192-49df-b6dd-3887e1c2d179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap125ae4a6-f6') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:02:55.825764 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:55.826163 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap125ae4a6-f6, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:02:55.833045 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:55.834411 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:02:55.835179 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:55.837016 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:55.837256 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=391029b9-89b3-472f-9add-aa9c3f6008c9) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:02:55.837890 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:55.838583 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:02:55.839692 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:55.842682 np0000001583 nova-compute[98241]: INFO os_vif [None req-d43cacf1-4a4f-438d-934b-7eef65af0ff3 tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:25:80,bridge_name='br-int',has_traffic_filtering=True,id=125ae4a6-f619-4ec9-8001-4bec23db9cca,network=Network(e06ff8b0-4192-49df-b6dd-3887e1c2d179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap125ae4a6-f6')
May 28 02:02:55.842682 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-d43cacf1-4a4f-438d-934b-7eef65af0ff3 tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Deleting instance files /opt/stack/data/nova/instances/3dd5aa3c-dade-42d8-8de7-f34574a0fc31_del
May 28 02:02:55.846721 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-d43cacf1-4a4f-438d-934b-7eef65af0ff3 tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Deletion of /opt/stack/data/nova/instances/3dd5aa3c-dade-42d8-8de7-f34574a0fc31_del complete
May 28 02:02:56.137555 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:56.358434 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 02:02:56.358983 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1', 'iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '776608d6-bb99-44d4-af54-73e3c444e7f1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:02:56.359181 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:02:56.362723 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-d43cacf1-4a4f-438d-934b-7eef65af0ff3 tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Took 1.41 seconds to destroy the instance on the hypervisor.
May 28 02:02:56.363725 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-d43cacf1-4a4f-438d-934b-7eef65af0ff3 tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 02:02:56.364161 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 02:02:56.364390 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 02:02:56.364909 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:02:56.468320 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Found WWN 33000000056ee9b82 for multipath device dm-7 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 02:02:56.469017 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:02:56.469558 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] <== connect_volume: return (3038ms) {'type': 'block', 'scsi_wwn': '33000000056ee9b82', 'path': '/dev/dm-7', 'multipath_id': '33000000056ee9b82'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:02:56.471157 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.259s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:02:56.471157 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000056ee9b82', 'path': '/dev/dm-7', 'multipath_id': '33000000056ee9b82'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 02:02:56.473956 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa', 'iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '130e87d8-0de4-480b-962d-0534472cd0aa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 02:02:56.483092 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:02:56.486717 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lazy-loading 'flavor' on Instance uuid 1f15126e-6636-4765-8650-bb717f186efe {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:02:56.489750 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:02:56.490659 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:02:56.491426 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:02:56.492155 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:02:56.492943 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:02:56.493199 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:02:56.508627 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:02:56.508627 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:56.514794 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:02:56.514794 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:56.525242 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa] added
May 28 02:02:56.525242 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:02:56.525242 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:02:56.525242 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:02:56.525242 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:02:56.525242 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:02:56.525242 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:56.525242 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:02:56.525242 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0323(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:02:56.525242 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:02:56.531309 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa] added
May 28 02:02:56.531309 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:02:56.531309 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:02:56.531309 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:02:56.531309 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:02:56.531309 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:02:56.531309 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:56.531676 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:02:56.531849 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0387(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:02:56.532038 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:02:56.995325 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Attempting to attach volume 093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98241) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 02:02:56.997258 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] attach device xml: <disk type="block" device="disk">
May 28 02:02:56.997258 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:02:56.997258 np0000001583 nova-compute[98241]:   <alias name="ua-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19"/>
May 28 02:02:56.997258 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-7"/>
May 28 02:02:56.997258 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:02:56.997258 np0000001583 nova-compute[98241]:   <serial>093ceec4-8090-44f9-a9d3-1a5fe5fe9b19</serial>
May 28 02:02:56.997258 np0000001583 nova-compute[98241]: </disk>
May 28 02:02:56.997258 np0000001583 nova-compute[98241]:  {{(pid=98241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 02:02:57.340275 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b1187758-367e-437c-bfd6-020c59d11026 req-12376ef6-748e-4739-b9c4-2c8a2fe1c9fe service nova] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Received event network-vif-unplugged-125ae4a6-f619-4ec9-8001-4bec23db9cca {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:02:57.340475 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b1187758-367e-437c-bfd6-020c59d11026 req-12376ef6-748e-4739-b9c4-2c8a2fe1c9fe service nova] Acquiring lock "3dd5aa3c-dade-42d8-8de7-f34574a0fc31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:57.340637 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b1187758-367e-437c-bfd6-020c59d11026 req-12376ef6-748e-4739-b9c4-2c8a2fe1c9fe service nova] Lock "3dd5aa3c-dade-42d8-8de7-f34574a0fc31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:57.340818 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b1187758-367e-437c-bfd6-020c59d11026 req-12376ef6-748e-4739-b9c4-2c8a2fe1c9fe service nova] Lock "3dd5aa3c-dade-42d8-8de7-f34574a0fc31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:02:57.340975 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b1187758-367e-437c-bfd6-020c59d11026 req-12376ef6-748e-4739-b9c4-2c8a2fe1c9fe service nova] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] No waiting events found dispatching network-vif-unplugged-125ae4a6-f619-4ec9-8001-4bec23db9cca {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:02:57.341111 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b1187758-367e-437c-bfd6-020c59d11026 req-12376ef6-748e-4739-b9c4-2c8a2fe1c9fe service nova] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Received event network-vif-unplugged-125ae4a6-f619-4ec9-8001-4bec23db9cca for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:02:57.341234 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b1187758-367e-437c-bfd6-020c59d11026 req-12376ef6-748e-4739-b9c4-2c8a2fe1c9fe service nova] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Received event network-vif-deleted-125ae4a6-f619-4ec9-8001-4bec23db9cca {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:02:57.341376 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-b1187758-367e-437c-bfd6-020c59d11026 req-12376ef6-748e-4739-b9c4-2c8a2fe1c9fe service nova] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Neutron deleted interface 125ae4a6-f619-4ec9-8001-4bec23db9cca; detaching it from the instance and deleting it from the info cache
May 28 02:02:57.347390 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b1187758-367e-437c-bfd6-020c59d11026 req-12376ef6-748e-4739-b9c4-2c8a2fe1c9fe service nova] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Detach interface failed, port_id=125ae4a6-f619-4ec9-8001-4bec23db9cca, reason: Instance 3dd5aa3c-dade-42d8-8de7-f34574a0fc31 could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 02:02:57.514922 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:02:57.525028 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:02:57.532832 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:02:57.542920 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:02:57.542920 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:02:57.550436 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:02:57.550436 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:57.556894 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:57.564322 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:57.577108 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:57.577108 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:57.577108 np0000001583 nova-compute[98241]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:02:57.577108 np0000001583 nova-compute[98241]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:02:57.577108 np0000001583 nova-compute[98241]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:02:57.577108 np0000001583 nova-compute[98241]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:02:57.577108 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:57.577108 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:57.577108 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:02:57.577108 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsi session list stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:57.577108 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:57.577108 np0000001583 nova-compute[98241]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:02:57.577108 np0000001583 nova-compute[98241]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:02:57.577108 np0000001583 nova-compute[98241]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:02:57.577108 np0000001583 nova-compute[98241]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:02:57.577108 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:57.577108 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:57.577108 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:02:57.586697 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:57.586697 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:57.586697 np0000001583 nova-compute[98241]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:02:57.586697 np0000001583 nova-compute[98241]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:02:57.586697 np0000001583 nova-compute[98241]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:02:57.586697 np0000001583 nova-compute[98241]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:02:57.586697 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:57.586697 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:57.586697 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:02:57.587111 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsi session list stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:57.587111 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:57.587111 np0000001583 nova-compute[98241]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:02:57.587111 np0000001583 nova-compute[98241]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:02:57.587111 np0000001583 nova-compute[98241]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:02:57.587111 np0000001583 nova-compute[98241]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:02:57.587111 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:57.587111 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:57.587111 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:02:57.631623 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa, portal: 192.168.40.100,3260]
May 28 02:02:57.631623 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa, portal: 192.168.40.100,3260] successful.
May 28 02:02:57.631623 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:57.643737 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa, portal: 192.168.50.100,3260]
May 28 02:02:57.643737 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa, portal: 192.168.50.100,3260] successful.
May 28 02:02:57.643737 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:57.644432 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:57.657671 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:57.665027 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:57.665027 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:57.665027 np0000001583 nova-compute[98241]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:02:57.665027 np0000001583 nova-compute[98241]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:02:57.665027 np0000001583 nova-compute[98241]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:02:57.665027 np0000001583 nova-compute[98241]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:02:57.665027 np0000001583 nova-compute[98241]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa (non-flash)
May 28 02:02:57.665027 np0000001583 nova-compute[98241]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa (non-flash)
May 28 02:02:57.665027 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:57.665027 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:57.665027 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:02:57.665359 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsi session list stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:57.665359 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:57.665359 np0000001583 nova-compute[98241]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:02:57.665359 np0000001583 nova-compute[98241]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:02:57.665359 np0000001583 nova-compute[98241]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:02:57.665359 np0000001583 nova-compute[98241]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:02:57.665359 np0000001583 nova-compute[98241]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa (non-flash)
May 28 02:02:57.665359 np0000001583 nova-compute[98241]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa (non-flash)
May 28 02:02:57.665359 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:57.665359 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:57.665359 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:02:57.665548 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.174s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:02:57.665635 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:02:57.666720 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] HCTL ('15', '-', '-', 0) found on session 115 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:02:57.666837 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:02:57.674441 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:57.674441 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:57.674441 np0000001583 nova-compute[98241]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:02:57.674441 np0000001583 nova-compute[98241]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:02:57.674441 np0000001583 nova-compute[98241]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:02:57.674441 np0000001583 nova-compute[98241]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:02:57.674441 np0000001583 nova-compute[98241]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa (non-flash)
May 28 02:02:57.674441 np0000001583 nova-compute[98241]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa (non-flash)
May 28 02:02:57.674441 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:57.674441 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:57.674441 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:02:57.674757 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsi session list stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:57.674757 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:02:57.674757 np0000001583 nova-compute[98241]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:02:57.674757 np0000001583 nova-compute[98241]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:02:57.674757 np0000001583 nova-compute[98241]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:02:57.674757 np0000001583 nova-compute[98241]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:02:57.674757 np0000001583 nova-compute[98241]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa (non-flash)
May 28 02:02:57.674757 np0000001583 nova-compute[98241]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa (non-flash)
May 28 02:02:57.674757 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:57.674757 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:02:57.674757 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:02:57.675041 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.182s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:02:57.675041 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:02:57.676187 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] HCTL ('16', '-', '-', 0) found on session 116 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:02:57.676315 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:02:57.682189 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Searching for a device in session 115 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:02:57.682420 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '130e87d8-0de4-480b-962d-0534472cd0aa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:02:57.692188 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Searching for a device in session 116 and hctl ['16', '*', '*', 0] yield: None {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:02:58.007354 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:58.017065 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Took 1.65 seconds to deallocate network for instance.
May 28 02:02:58.309580 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:02:58.522667 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d43cacf1-4a4f-438d-934b-7eef65af0ff3 tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:02:58.523246 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d43cacf1-4a4f-438d-934b-7eef65af0ff3 tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:02:58.692627 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Searching for a device in session 116 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:02:58.692952 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '130e87d8-0de4-480b-962d-0534472cd0aa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:02:58.693910 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:02:58.693910 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:02:58.694089 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:02:58.694383 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] No VIF found with MAC fa:16:3e:c0:11:b8, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:02:59.061388 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-d43cacf1-4a4f-438d-934b-7eef65af0ff3 tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:02:59.061672 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-d43cacf1-4a4f-438d-934b-7eef65af0ff3 tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:02:59.512519 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Found WWN 3300000000d677cdf for multipath device dm-8 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 02:02:59.512822 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.043s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:02:59.512998 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] <== connect_volume: return (4302ms) {'type': 'block', 'scsi_wwn': '3300000000d677cdf', 'path': '/dev/dm-8', 'multipath_id': '3300000000d677cdf'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:02:59.513142 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000000d677cdf', 'path': '/dev/dm-8', 'multipath_id': '3300000000d677cdf'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 02:02:59.513646 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 3.154s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:02:59.513871 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1', 'iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '776608d6-bb99-44d4-af54-73e3c444e7f1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 02:02:59.526450 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:02:59.528904 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:02:59.529542 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:02:59.529783 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:02:59.530591 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:02:59.530591 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:02:59.543919 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:02:59.543919 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:59.549976 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:02:59.549976 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:59.557780 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1] added
May 28 02:02:59.557780 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:02:59.557780 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:02:59.557780 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:02:59.557780 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:02:59.557780 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:02:59.557780 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:59.557985 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:02:59.558273 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0277(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:02:59.558482 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:02:59.563495 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1] added
May 28 02:02:59.563495 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:02:59.563495 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:02:59.563495 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:02:59.563495 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:02:59.563495 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:02:59.563495 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:02:59.563811 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:02:59.563811 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0341(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:02:59.564896 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:02:59.565241 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-d43cacf1-4a4f-438d-934b-7eef65af0ff3 tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:03:00.019732 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:02:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-871699587',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-attachvolumemultiattachtest-server-871699587',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0474090f4f2d4950b51bc317f4302266',ramdisk_id='',reservation_id='r-egcxtoce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-857456921',owner_user_name='tempest-AttachVolumeMultiAttachTest-857456921-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:02:52Z,user_data=None,user_id='cadb612e41314b06914d5f5f47570e98',uuid=ef2472b3-00d4-4d9d-8ebc-266857e4b91d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "276d5af7-b597-4686-a307-b9b7c26cb661", "address": "fa:16:3e:2b:6a:bd", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap276d5af7-b5", "ovs_interfaceid": "276d5af7-b597-4686-a307-b9b7c26cb661", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 02:03:00.019920 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Converting VIF {"id": "276d5af7-b597-4686-a307-b9b7c26cb661", "address": "fa:16:3e:2b:6a:bd", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap276d5af7-b5", "ovs_interfaceid": "276d5af7-b597-4686-a307-b9b7c26cb661", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:03:00.020446 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:6a:bd,bridge_name='br-int',has_traffic_filtering=True,id=276d5af7-b597-4686-a307-b9b7c26cb661,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap276d5af7-b5') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:03:00.021011 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lazy-loading 'pci_devices' on Instance uuid ef2472b3-00d4-4d9d-8ebc-266857e4b91d {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:03:00.073902 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d43cacf1-4a4f-438d-934b-7eef65af0ff3 tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.551s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:00.139992 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-d43cacf1-4a4f-438d-934b-7eef65af0ff3 tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Deleted allocations for instance 3dd5aa3c-dade-42d8-8de7-f34574a0fc31
May 28 02:03:00.259102 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0a7eed7f-0784-414e-8dcc-fec2439671f1 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "1f15126e-6636-4765-8650-bb717f186efe" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.599s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:00.525020 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] End _get_guest_xml xml=<domain type="qemu">
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:   <uuid>ef2472b3-00d4-4d9d-8ebc-266857e4b91d</uuid>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:   <name>instance-00000033</name>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:   <metadata>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:       <nova:name>tempest-AttachVolumeMultiAttachTest-server-871699587</nova:name>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 02:02:55</nova:creationTime>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:       <nova:image uuid="">
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:       </nova:image>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:         <nova:user uuid="cadb612e41314b06914d5f5f47570e98">tempest-AttachVolumeMultiAttachTest-857456921-project-member</nova:user>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:         <nova:project uuid="0474090f4f2d4950b51bc317f4302266">tempest-AttachVolumeMultiAttachTest-857456921</nova:project>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:       <nova:root type="volume" uuid=""/>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:         <nova:port uuid="276d5af7-b597-4686-a307-b9b7c26cb661">
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:         </nova:port>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:   </metadata>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:     <system>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:       <entry name="serial">ef2472b3-00d4-4d9d-8ebc-266857e4b91d</entry>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:       <entry name="uuid">ef2472b3-00d4-4d9d-8ebc-266857e4b91d</entry>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:     </system>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:   <os>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:   </os>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:   <features>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:     <acpi/>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:     <tcg>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:     </tcg>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:   </features>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:   </cpu>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:   <devices>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/ef2472b3-00d4-4d9d-8ebc-266857e4b91d/disk.config"/>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:     </disk>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:     <disk type="block" device="disk">
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:       <alias name="ua-130e87d8-0de4-480b-962d-0534472cd0aa"/>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:       <source dev="/dev/dm-8"/>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:       <serial>130e87d8-0de4-480b-962d-0534472cd0aa</serial>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:       <shareable/>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:     </disk>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:2b:6a:bd"/>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:       <target dev="tap276d5af7-b5"/>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:     </interface>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/ef2472b3-00d4-4d9d-8ebc-266857e4b91d/console.log" append="off"/>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:     </serial>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:     <video>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:     </video>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:     </rng>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:     </memballoon>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:   </devices>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]: </domain>
May 28 02:03:00.525020 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 02:03:00.528179 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Preparing to wait for external event network-vif-plugged-276d5af7-b597-4686-a307-b9b7c26cb661 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 02:03:00.528179 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "ef2472b3-00d4-4d9d-8ebc-266857e4b91d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:00.528179 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "ef2472b3-00d4-4d9d-8ebc-266857e4b91d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:00.528179 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "ef2472b3-00d4-4d9d-8ebc-266857e4b91d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:00.528179 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:02:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-871699587',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-attachvolumemultiattachtest-server-871699587',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0474090f4f2d4950b51bc317f4302266',ramdisk_id='',reservation_id='r-egcxtoce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-857456921',owner_user_name='tempest-AttachVolumeMultiAttachTest-857456921-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:02:52Z,user_data=None,user_id='cadb612e41314b06914d5f5f47570e98',uuid=ef2472b3-00d4-4d9d-8ebc-266857e4b91d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "276d5af7-b597-4686-a307-b9b7c26cb661", "address": "fa:16:3e:2b:6a:bd", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap276d5af7-b5", "ovs_interfaceid": "276d5af7-b597-4686-a307-b9b7c26cb661", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 02:03:00.528179 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Converting VIF {"id": "276d5af7-b597-4686-a307-b9b7c26cb661", "address": "fa:16:3e:2b:6a:bd", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap276d5af7-b5", "ovs_interfaceid": "276d5af7-b597-4686-a307-b9b7c26cb661", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:03:00.528179 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:6a:bd,bridge_name='br-int',has_traffic_filtering=True,id=276d5af7-b597-4686-a307-b9b7c26cb661,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap276d5af7-b5') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:03:00.528179 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:6a:bd,bridge_name='br-int',has_traffic_filtering=True,id=276d5af7-b597-4686-a307-b9b7c26cb661,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap276d5af7-b5') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 02:03:00.528179 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:00.528533 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:03:00.528533 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 02:03:00.533877 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:00.536026 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '81e89a5a-fbb2-5f7f-a991-84ecc822f42e', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:03:00.537539 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:00.538399 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:03:00.540867 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:00.541065 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap276d5af7-b5, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:03:00.541448 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap276d5af7-b5, col_values=(('qos', UUID('507bfcd3-4da9-4417-8661-6d0b44f38e60')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:03:00.541618 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap276d5af7-b5, col_values=(('external_ids', {'iface-id': '276d5af7-b597-4686-a307-b9b7c26cb661', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:6a:bd', 'vm-uuid': 'ef2472b3-00d4-4d9d-8ebc-266857e4b91d'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:03:00.542546 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:00.543843 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:03:00.549412 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:00.550364 np0000001583 nova-compute[98241]: INFO os_vif [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:6a:bd,bridge_name='br-int',has_traffic_filtering=True,id=276d5af7-b597-4686-a307-b9b7c26cb661,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap276d5af7-b5')
May 28 02:03:00.559212 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:03:00.564401 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:03:00.574012 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:03:00.574012 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:03:00.580039 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:03:00.580039 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:03:00.586312 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:03:00.595947 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:03:00.603963 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:03:00.603963 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:03:00.603963 np0000001583 nova-compute[98241]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:03:00.603963 np0000001583 nova-compute[98241]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:03:00.603963 np0000001583 nova-compute[98241]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:03:00.603963 np0000001583 nova-compute[98241]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:03:00.603963 np0000001583 nova-compute[98241]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa (non-flash)
May 28 02:03:00.603963 np0000001583 nova-compute[98241]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa (non-flash)
May 28 02:03:00.603963 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:03:00.603963 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:03:00.603963 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:03:00.603963 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsi session list stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:03:00.603963 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:03:00.603963 np0000001583 nova-compute[98241]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:03:00.603963 np0000001583 nova-compute[98241]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:03:00.603963 np0000001583 nova-compute[98241]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:03:00.603963 np0000001583 nova-compute[98241]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:03:00.603963 np0000001583 nova-compute[98241]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa (non-flash)
May 28 02:03:00.603963 np0000001583 nova-compute[98241]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa (non-flash)
May 28 02:03:00.603963 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:03:00.603963 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:03:00.603963 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:03:00.617540 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:03:00.617540 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:03:00.617540 np0000001583 nova-compute[98241]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:03:00.617540 np0000001583 nova-compute[98241]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:03:00.617540 np0000001583 nova-compute[98241]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:03:00.617540 np0000001583 nova-compute[98241]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:03:00.617540 np0000001583 nova-compute[98241]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa (non-flash)
May 28 02:03:00.617540 np0000001583 nova-compute[98241]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa (non-flash)
May 28 02:03:00.617540 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:03:00.617540 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:03:00.617540 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:03:00.617928 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsi session list stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:03:00.617928 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:03:00.617928 np0000001583 nova-compute[98241]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:03:00.617928 np0000001583 nova-compute[98241]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:03:00.617928 np0000001583 nova-compute[98241]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:03:00.617928 np0000001583 nova-compute[98241]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:03:00.617928 np0000001583 nova-compute[98241]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa (non-flash)
May 28 02:03:00.617928 np0000001583 nova-compute[98241]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa (non-flash)
May 28 02:03:00.617928 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:03:00.617928 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:03:00.617928 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:03:00.645670 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1, portal: 192.168.40.100,3260]
May 28 02:03:00.645670 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1, portal: 192.168.40.100,3260] successful.
May 28 02:03:00.645670 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:03:00.659864 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:03:00.673845 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1, portal: 192.168.50.100,3260]
May 28 02:03:00.673845 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1, portal: 192.168.50.100,3260] successful.
May 28 02:03:00.673845 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:03:00.678816 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:03:00.678816 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:03:00.678816 np0000001583 nova-compute[98241]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:03:00.678816 np0000001583 nova-compute[98241]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:03:00.678816 np0000001583 nova-compute[98241]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:03:00.678816 np0000001583 nova-compute[98241]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:03:00.678816 np0000001583 nova-compute[98241]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa (non-flash)
May 28 02:03:00.678816 np0000001583 nova-compute[98241]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa (non-flash)
May 28 02:03:00.678816 np0000001583 nova-compute[98241]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1 (non-flash)
May 28 02:03:00.678816 np0000001583 nova-compute[98241]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1 (non-flash)
May 28 02:03:00.678816 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:03:00.678816 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:03:00.678816 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:03:00.679293 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsi session list stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:03:00.679293 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:03:00.679293 np0000001583 nova-compute[98241]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:03:00.679293 np0000001583 nova-compute[98241]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:03:00.679293 np0000001583 nova-compute[98241]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:03:00.679293 np0000001583 nova-compute[98241]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:03:00.679293 np0000001583 nova-compute[98241]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa (non-flash)
May 28 02:03:00.679293 np0000001583 nova-compute[98241]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa (non-flash)
May 28 02:03:00.679293 np0000001583 nova-compute[98241]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1 (non-flash)
May 28 02:03:00.679293 np0000001583 nova-compute[98241]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1 (non-flash)
May 28 02:03:00.679293 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:03:00.679293 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:03:00.679293 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:03:00.679293 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.149s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:03:00.679293 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:03:00.680370 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] HCTL ('17', '-', '-', 0) found on session 117 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:03:00.680460 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:03:00.689888 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:03:00.700206 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Searching for a device in session 117 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:03:00.700462 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '776608d6-bb99-44d4-af54-73e3c444e7f1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:03:00.714666 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:03:00.714666 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:03:00.714666 np0000001583 nova-compute[98241]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:03:00.714666 np0000001583 nova-compute[98241]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:03:00.714666 np0000001583 nova-compute[98241]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:03:00.714666 np0000001583 nova-compute[98241]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:03:00.714666 np0000001583 nova-compute[98241]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa (non-flash)
May 28 02:03:00.714666 np0000001583 nova-compute[98241]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa (non-flash)
May 28 02:03:00.714666 np0000001583 nova-compute[98241]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1 (non-flash)
May 28 02:03:00.714666 np0000001583 nova-compute[98241]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1 (non-flash)
May 28 02:03:00.714666 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:03:00.714666 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:03:00.714666 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:03:00.715002 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsi session list stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:03:00.715002 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:03:00.715002 np0000001583 nova-compute[98241]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:03:00.715002 np0000001583 nova-compute[98241]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:03:00.715002 np0000001583 nova-compute[98241]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:03:00.715002 np0000001583 nova-compute[98241]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:03:00.715002 np0000001583 nova-compute[98241]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa (non-flash)
May 28 02:03:00.715002 np0000001583 nova-compute[98241]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa (non-flash)
May 28 02:03:00.715002 np0000001583 nova-compute[98241]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1 (non-flash)
May 28 02:03:00.715002 np0000001583 nova-compute[98241]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1 (non-flash)
May 28 02:03:00.715002 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:03:00.715002 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:03:00.715002 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:03:00.715002 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.186s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:03:00.715450 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:03:00.716599 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] HCTL ('18', '-', '-', 0) found on session 118 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:03:00.716599 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:03:00.734054 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Searching for a device in session 118 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:03:00.734433 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '776608d6-bb99-44d4-af54-73e3c444e7f1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:03:00.829552 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Acquiring lock "9a804913-4bfb-4dba-9efe-cbf7c575d8d1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:00.829802 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Lock "9a804913-4bfb-4dba-9efe-cbf7c575d8d1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:01.153948 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d43cacf1-4a4f-438d-934b-7eef65af0ff3 tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Lock "3dd5aa3c-dade-42d8-8de7-f34574a0fc31" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.707s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:01.333139 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 02:03:01.528898 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 02:03:01.890552 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:01.892435 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:01.899438 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 02:03:01.901262 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Claim successful on node np0000001583
May 28 02:03:02.071174 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:03:02.071380 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:03:02.071570 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] No VIF found with MAC fa:16:3e:2b:6a:bd, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:03:02.073676 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Using config drive
May 28 02:03:02.550155 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Found WWN 330000000b5496992 for multipath device dm-11 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 02:03:02.550616 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:03:02.550797 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] <== connect_volume: return (6192ms) {'type': 'block', 'scsi_wwn': '330000000b5496992', 'path': '/dev/dm-11', 'multipath_id': '330000000b5496992'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:03:02.550968 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b5496992', 'path': '/dev/dm-11', 'multipath_id': '330000000b5496992'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 02:03:02.554857 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lazy-loading 'flavor' on Instance uuid e00f21c6-ce7c-4e23-94e2-7f415ae7a9be {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:03:02.581365 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:03:02.745654 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Creating config drive at /opt/stack/data/nova/instances/ef2472b3-00d4-4d9d-8ebc-266857e4b91d/disk.config
May 28 02:03:02.749358 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ef2472b3-00d4-4d9d-8ebc-266857e4b91d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp21cj6_5o {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:03:02.812852 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ef2472b3-00d4-4d9d-8ebc-266857e4b91d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp21cj6_5o" returned: 0 in 0.063s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:03:03.058622 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Attempting to attach volume 776608d6-bb99-44d4-af54-73e3c444e7f1 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98241) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 02:03:03.061126 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] attach device xml: <disk type="block" device="disk">
May 28 02:03:03.061126 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:03:03.061126 np0000001583 nova-compute[98241]:   <alias name="ua-776608d6-bb99-44d4-af54-73e3c444e7f1"/>
May 28 02:03:03.061126 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-11"/>
May 28 02:03:03.061126 np0000001583 nova-compute[98241]:   <target dev="vdc" bus="virtio"/>
May 28 02:03:03.061126 np0000001583 nova-compute[98241]:   <serial>776608d6-bb99-44d4-af54-73e3c444e7f1</serial>
May 28 02:03:03.061126 np0000001583 nova-compute[98241]: </disk>
May 28 02:03:03.061126 np0000001583 nova-compute[98241]:  {{(pid=98241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 02:03:03.275027 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:03.299852 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:03.311452 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:03.470481 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:03.498148 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:03.501541 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:03.501900 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:03:03.502073 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:03:03.562645 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:04.004939 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:03:04.378762 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933784.378227, ef2472b3-00d4-4d9d-8ebc-266857e4b91d => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:03:04.379268 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] VM Started (Lifecycle Event)
May 28 02:03:04.513926 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.623s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:04.514401 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 02:03:04.662421 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f69ccc77-99c4-4d92-ad92-076162d8d641 req-20bfd4cf-9388-41b3-9f93-00fdae7aa7ea service nova] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Received event network-vif-plugged-276d5af7-b597-4686-a307-b9b7c26cb661 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:03:04.662897 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f69ccc77-99c4-4d92-ad92-076162d8d641 req-20bfd4cf-9388-41b3-9f93-00fdae7aa7ea service nova] Acquiring lock "ef2472b3-00d4-4d9d-8ebc-266857e4b91d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:04.662897 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f69ccc77-99c4-4d92-ad92-076162d8d641 req-20bfd4cf-9388-41b3-9f93-00fdae7aa7ea service nova] Lock "ef2472b3-00d4-4d9d-8ebc-266857e4b91d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:04.663202 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f69ccc77-99c4-4d92-ad92-076162d8d641 req-20bfd4cf-9388-41b3-9f93-00fdae7aa7ea service nova] Lock "ef2472b3-00d4-4d9d-8ebc-266857e4b91d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:04.663202 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f69ccc77-99c4-4d92-ad92-076162d8d641 req-20bfd4cf-9388-41b3-9f93-00fdae7aa7ea service nova] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Processing event network-vif-plugged-276d5af7-b597-4686-a307-b9b7c26cb661 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 02:03:04.663937 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 02:03:04.671430 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 02:03:04.673030 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "9dd6bff7-c612-44cb-a1f2-9e1b26f5f342" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:04.674487 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "9dd6bff7-c612-44cb-a1f2-9e1b26f5f342" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:04.678482 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Instance spawned successfully.
May 28 02:03:04.680341 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 02:03:04.882819 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:03:04.887675 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:03:04.968252 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:03:04.968425 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:03:04.968684 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:03:04.968844 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:03:04.968947 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] No VIF found with MAC fa:16:3e:47:cf:5e, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:03:05.020892 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 02:03:05.021488 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 02:03:05.021682 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:03:05.023594 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:03:05.180574 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 02:03:05.193846 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:03:05.194063 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:03:05.195155 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:03:05.195155 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:03:05.195155 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:03:05.195861 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:03:05.224914 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c2fa2fdfb3264e2283e385b876095c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7849e9703e1345b9826a90dc99756d77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 02:03:05.390679 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 02:03:05.390679 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933785.390436, ef2472b3-00d4-4d9d-8ebc-266857e4b91d => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:03:05.390819 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] VM Paused (Lifecycle Event)
May 28 02:03:05.524418 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 02:03:05.545316 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:05.705618 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Took 11.12 seconds to spawn the instance on the hypervisor.
May 28 02:03:05.706236 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:03:05.754315 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:05.755971 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:05.763757 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 02:03:05.763937 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Claim successful on node np0000001583
May 28 02:03:05.893939 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:03:05.900687 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933785.9003327, ef2472b3-00d4-4d9d-8ebc-266857e4b91d => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:03:05.900985 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] VM Resumed (Lifecycle Event)
May 28 02:03:05.930216 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Successfully created port: 4ff6f19c-9ecc-4ac9-a37b-a99bde59db2d {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 02:03:06.030128 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 02:03:06.231750 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Took 18.61 seconds to build instance.
May 28 02:03:06.404690 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:03:06.406946 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:03:06.558680 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4e1a0aee-1a3e-45ac-b342-74cdce47a66f tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "e00f21c6-ce7c-4e23-94e2-7f415ae7a9be" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.939s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:06.715835 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:06.734554 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-79e4c2c7-bacb-411a-af67-105e63a47c47 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "ef2472b3-00d4-4d9d-8ebc-266857e4b91d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.127s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:06.758922 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-77669233-44b4-44e4-ba8a-e5c25d1720c1 req-928f2f12-a88f-416e-8a24-7605f82cbf06 service nova] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Received event network-vif-plugged-276d5af7-b597-4686-a307-b9b7c26cb661 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:03:06.759143 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-77669233-44b4-44e4-ba8a-e5c25d1720c1 req-928f2f12-a88f-416e-8a24-7605f82cbf06 service nova] Acquiring lock "ef2472b3-00d4-4d9d-8ebc-266857e4b91d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:06.759369 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-77669233-44b4-44e4-ba8a-e5c25d1720c1 req-928f2f12-a88f-416e-8a24-7605f82cbf06 service nova] Lock "ef2472b3-00d4-4d9d-8ebc-266857e4b91d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:06.759637 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-77669233-44b4-44e4-ba8a-e5c25d1720c1 req-928f2f12-a88f-416e-8a24-7605f82cbf06 service nova] Lock "ef2472b3-00d4-4d9d-8ebc-266857e4b91d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:06.759637 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-77669233-44b4-44e4-ba8a-e5c25d1720c1 req-928f2f12-a88f-416e-8a24-7605f82cbf06 service nova] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] No waiting events found dispatching network-vif-plugged-276d5af7-b597-4686-a307-b9b7c26cb661 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:03:06.759747 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-77669233-44b4-44e4-ba8a-e5c25d1720c1 req-928f2f12-a88f-416e-8a24-7605f82cbf06 service nova] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Received unexpected event network-vif-plugged-276d5af7-b597-4686-a307-b9b7c26cb661 for instance with vm_state active and task_state None.
May 28 02:03:07.044918 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 02:03:07.044918 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 02:03:07.048638 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Creating image(s)
May 28 02:03:07.048638 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Acquiring lock "/opt/stack/data/nova/instances/9a804913-4bfb-4dba-9efe-cbf7c575d8d1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:07.048638 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Lock "/opt/stack/data/nova/instances/9a804913-4bfb-4dba-9efe-cbf7c575d8d1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:07.050440 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Lock "/opt/stack/data/nova/instances/9a804913-4bfb-4dba-9efe-cbf7c575d8d1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:07.053238 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:03:07.055727 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:03:07.060412 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:03:07.134701 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Successfully updated port: 4ff6f19c-9ecc-4ac9-a37b-a99bde59db2d {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 02:03:07.200377 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.141s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:03:07.200958 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:07.201633 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:07.202266 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:03:07.207120 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:03:07.208042 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:03:07.241573 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-28863e8f-7900-44e8-b3a6-d70fe2002686 req-3f09bc52-cc20-4590-b95e-b2e2dd9ace9f service nova] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Received event network-changed-4ff6f19c-9ecc-4ac9-a37b-a99bde59db2d {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:03:07.241830 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-28863e8f-7900-44e8-b3a6-d70fe2002686 req-3f09bc52-cc20-4590-b95e-b2e2dd9ace9f service nova] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Refreshing instance network info cache due to event network-changed-4ff6f19c-9ecc-4ac9-a37b-a99bde59db2d. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:03:07.243733 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-28863e8f-7900-44e8-b3a6-d70fe2002686 req-3f09bc52-cc20-4590-b95e-b2e2dd9ace9f service nova] Acquiring lock "refresh_cache-9a804913-4bfb-4dba-9efe-cbf7c575d8d1" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:03:07.243733 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-28863e8f-7900-44e8-b3a6-d70fe2002686 req-3f09bc52-cc20-4590-b95e-b2e2dd9ace9f service nova] Acquired lock "refresh_cache-9a804913-4bfb-4dba-9efe-cbf7c575d8d1" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:03:07.243733 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-28863e8f-7900-44e8-b3a6-d70fe2002686 req-3f09bc52-cc20-4590-b95e-b2e2dd9ace9f service nova] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Refreshing network info cache for port 4ff6f19c-9ecc-4ac9-a37b-a99bde59db2d {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:03:07.326519 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.119s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:03:07.327516 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/9a804913-4bfb-4dba-9efe-cbf7c575d8d1/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:03:07.429955 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/9a804913-4bfb-4dba-9efe-cbf7c575d8d1/disk 1073741824" returned: 0 in 0.102s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:03:07.430617 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:07.430932 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:03:07.562577 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.131s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:03:07.564023 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9a804913-4bfb-4dba-9efe-cbf7c575d8d1/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 02:03:07.564023 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a804913-4bfb-4dba-9efe-cbf7c575d8d1/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:03:07.648925 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Acquiring lock "refresh_cache-9a804913-4bfb-4dba-9efe-cbf7c575d8d1" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:03:07.661461 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:03:07.661878 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:03:07.686914 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a804913-4bfb-4dba-9efe-cbf7c575d8d1/disk --force-share --output=json" returned: 0 in 0.124s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:03:07.688097 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Cannot resize image /opt/stack/data/nova/instances/9a804913-4bfb-4dba-9efe-cbf7c575d8d1/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 02:03:07.688097 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 02:03:07.688097 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Ensure instance console log exists: /opt/stack/data/nova/instances/9a804913-4bfb-4dba-9efe-cbf7c575d8d1/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 02:03:07.688331 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:07.688494 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:07.688664 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:07.753214 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-28863e8f-7900-44e8-b3a6-d70fe2002686 req-3f09bc52-cc20-4590-b95e-b2e2dd9ace9f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:03:07.860418 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-28863e8f-7900-44e8-b3a6-d70fe2002686 req-3f09bc52-cc20-4590-b95e-b2e2dd9ace9f service nova] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:03:08.063660 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-28863e8f-7900-44e8-b3a6-d70fe2002686 req-3f09bc52-cc20-4590-b95e-b2e2dd9ace9f service nova] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:03:08.154495 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7fea7684-a674-480e-9743-bfc63b679d05 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Acquiring lock "e00f21c6-ce7c-4e23-94e2-7f415ae7a9be" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:08.155689 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7fea7684-a674-480e-9743-bfc63b679d05 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "e00f21c6-ce7c-4e23-94e2-7f415ae7a9be" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:08.166234 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:03:08.315929 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:08.566708 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-28863e8f-7900-44e8-b3a6-d70fe2002686 req-3f09bc52-cc20-4590-b95e-b2e2dd9ace9f service nova] Releasing lock "refresh_cache-9a804913-4bfb-4dba-9efe-cbf7c575d8d1" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:03:08.567018 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Acquired lock "refresh_cache-9a804913-4bfb-4dba-9efe-cbf7c575d8d1" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:03:08.567229 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:03:08.659329 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-7fea7684-a674-480e-9743-bfc63b679d05 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Detaching volume 69c89952-ecdf-4907-af49-d3937eb47dec
May 28 02:03:08.675594 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.921s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:08.676303 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 02:03:08.723483 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-7fea7684-a674-480e-9743-bfc63b679d05 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Attempting to driver detach volume 69c89952-ecdf-4907-af49-d3937eb47dec from mountpoint /dev/vdb
May 28 02:03:08.736027 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-7fea7684-a674-480e-9743-bfc63b679d05 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Found disk vdb by alias ua-69c89952-ecdf-4907-af49-d3937eb47dec {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:03:08.739692 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-7fea7684-a674-480e-9743-bfc63b679d05 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Found disk vdb by alias ua-69c89952-ecdf-4907-af49-d3937eb47dec {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:03:08.741094 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-7fea7684-a674-480e-9743-bfc63b679d05 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Attempting to detach device vdb from instance e00f21c6-ce7c-4e23-94e2-7f415ae7a9be from the persistent domain config. {{(pid=98241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 02:03:08.741094 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-7fea7684-a674-480e-9743-bfc63b679d05 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:03:08.741094 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:03:08.741094 np0000001583 nova-compute[98241]:   <alias name="ua-69c89952-ecdf-4907-af49-d3937eb47dec"/>
May 28 02:03:08.741094 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-3"/>
May 28 02:03:08.741094 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:03:08.741094 np0000001583 nova-compute[98241]:   <serial>69c89952-ecdf-4907-af49-d3937eb47dec</serial>
May 28 02:03:08.741094 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 02:03:08.741094 np0000001583 nova-compute[98241]: </disk>
May 28 02:03:08.741094 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:03:08.756353 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-7fea7684-a674-480e-9743-bfc63b679d05 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Successfully detached device vdb from instance e00f21c6-ce7c-4e23-94e2-7f415ae7a9be from the persistent domain config.
May 28 02:03:08.756703 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-7fea7684-a674-480e-9743-bfc63b679d05 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] (1/8): Attempting to detach device vdb with device alias ua-69c89952-ecdf-4907-af49-d3937eb47dec from instance e00f21c6-ce7c-4e23-94e2-7f415ae7a9be from the live domain config. {{(pid=98241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 02:03:08.756874 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-7fea7684-a674-480e-9743-bfc63b679d05 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:03:08.756874 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:03:08.756874 np0000001583 nova-compute[98241]:   <alias name="ua-69c89952-ecdf-4907-af49-d3937eb47dec"/>
May 28 02:03:08.756874 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-3"/>
May 28 02:03:08.756874 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:03:08.756874 np0000001583 nova-compute[98241]:   <serial>69c89952-ecdf-4907-af49-d3937eb47dec</serial>
May 28 02:03:08.756874 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 02:03:08.756874 np0000001583 nova-compute[98241]: </disk>
May 28 02:03:08.756874 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:03:09.168497 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:03:09.184099 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 02:03:09.186937 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 02:03:09.186937 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 02:03:09.186937 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:03:09.186937 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:03:09.312434 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6be314b4eed642c3b2c72fe115860220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432aa1094ced436494def17a875aa8e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 02:03:09.333340 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Received event <DeviceRemovedEvent: 1779933789.3310926, e00f21c6-ce7c-4e23-94e2-7f415ae7a9be => ua-69c89952-ecdf-4907-af49-d3937eb47dec> from libvirt while the driver is waiting for it; dispatched. {{(pid=98241) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 02:03:09.335511 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-7fea7684-a674-480e-9743-bfc63b679d05 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-69c89952-ecdf-4907-af49-d3937eb47dec for instance e00f21c6-ce7c-4e23-94e2-7f415ae7a9be {{(pid=98241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 02:03:09.339245 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-7fea7684-a674-480e-9743-bfc63b679d05 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Successfully detached device vdb from instance e00f21c6-ce7c-4e23-94e2-7f415ae7a9be from the live domain config.
May 28 02:03:09.340915 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fea7684-a674-480e-9743-bfc63b679d05 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:03:09.341308 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fea7684-a674-480e-9743-bfc63b679d05 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec', 'iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '69c89952-ecdf-4907-af49-d3937eb47dec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:03:09.342062 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-7fea7684-a674-480e-9743-bfc63b679d05 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:03:09.342062 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-7fea7684-a674-480e-9743-bfc63b679d05 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:03:09.342062 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fea7684-a674-480e-9743-bfc63b679d05 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec', 'iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '69c89952-ecdf-4907-af49-d3937eb47dec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:03:09.342266 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fea7684-a674-480e-9743-bfc63b679d05 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:03:09.383435 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fea7684-a674-480e-9743-bfc63b679d05 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:03:09.383435 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:03:09.383435 np0000001583 nova-compute[98241]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:03:09.383435 np0000001583 nova-compute[98241]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:03:09.383435 np0000001583 nova-compute[98241]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:03:09.383435 np0000001583 nova-compute[98241]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:03:09.383435 np0000001583 nova-compute[98241]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa (non-flash)
May 28 02:03:09.383435 np0000001583 nova-compute[98241]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa (non-flash)
May 28 02:03:09.383435 np0000001583 nova-compute[98241]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1 (non-flash)
May 28 02:03:09.383435 np0000001583 nova-compute[98241]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1 (non-flash)
May 28 02:03:09.383435 np0000001583 nova-compute[98241]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8d9da7c-12ec-4da3-b3cf-1987f7c16b89 (non-flash)
May 28 02:03:09.383435 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:03:09.383435 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:03:09.383435 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:03:09.384920 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fea7684-a674-480e-9743-bfc63b679d05 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsi session list stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:03:09.384920 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:03:09.384920 np0000001583 nova-compute[98241]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:03:09.384920 np0000001583 nova-compute[98241]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec (non-flash)
May 28 02:03:09.384920 np0000001583 nova-compute[98241]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:03:09.384920 np0000001583 nova-compute[98241]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:03:09.384920 np0000001583 nova-compute[98241]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa (non-flash)
May 28 02:03:09.384920 np0000001583 nova-compute[98241]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa (non-flash)
May 28 02:03:09.384920 np0000001583 nova-compute[98241]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1 (non-flash)
May 28 02:03:09.384920 np0000001583 nova-compute[98241]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1 (non-flash)
May 28 02:03:09.384920 np0000001583 nova-compute[98241]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8d9da7c-12ec-4da3-b3cf-1987f7c16b89 (non-flash)
May 28 02:03:09.384920 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:03:09.384920 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:03:09.384920 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:03:09.384920 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fea7684-a674-480e-9743-bfc63b679d05 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86', '109'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86', '110'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec', '111'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec', '112'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19', '113'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19', '114'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa', '115'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa', '116'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1', '117'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1', '118'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b8d9da7c-12ec-4da3-b3cf-1987f7c16b89', '119'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', '68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', '69')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:03:09.384920 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fea7684-a674-480e-9743-bfc63b679d05 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec', '111')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:03:09.389325 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fea7684-a674-480e-9743-bfc63b679d05 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec', '112')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:03:09.393892 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fea7684-a674-480e-9743-bfc63b679d05 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f8182e80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec'): ({'sdf'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:03:09.395563 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-7fea7684-a674-480e-9743-bfc63b679d05 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Removing multipathed devices sdf, sde {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:03:09.396493 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-7fea7684-a674-480e-9743-bfc63b679d05 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Flush multipath device 3300000002d200271 {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:03:09.398488 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:03:09.432740 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-7fea7684-a674-480e-9743-bfc63b679d05 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:03:09.492044 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-7fea7684-a674-480e-9743-bfc63b679d05 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:03:09.550752 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-7fea7684-a674-480e-9743-bfc63b679d05 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Checking to see if SCSI volumes sdf, sde have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:03:09.550972 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-7fea7684-a674-480e-9743-bfc63b679d05 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] SCSI volumes sdf, sde have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:03:09.553175 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-7fea7684-a674-480e-9743-bfc63b679d05 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Checking to see if device paths {'sdf', 'sde'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:03:09.568244 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-7fea7684-a674-480e-9743-bfc63b679d05 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Device paths {'sdf', 'sde'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:03:09.569481 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fea7684-a674-480e-9743-bfc63b679d05 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:03:09.572136 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Updating instance_info_cache with network_info: [{"id": "4ff6f19c-9ecc-4ac9-a37b-a99bde59db2d", "address": "fa:16:3e:92:00:c4", "network": {"id": "59a17812-47e4-4787-a775-e18f05e4d2ec", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1023256595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7849e9703e1345b9826a90dc99756d77", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff6f19c-9e", "ovs_interfaceid": "4ff6f19c-9ecc-4ac9-a37b-a99bde59db2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:03:09.585304 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fea7684-a674-480e-9743-bfc63b679d05 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:03:09.633326 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fea7684-a674-480e-9743-bfc63b679d05 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 111, target: iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec, portal: 192.168.40.100,3260]
May 28 02:03:09.633326 np0000001583 nova-compute[98241]: Logout of [sid: 111, target: iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec, portal: 192.168.40.100,3260] successful.
May 28 02:03:09.633326 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:03:09.658909 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fea7684-a674-480e-9743-bfc63b679d05 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:03:09.671110 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fea7684-a674-480e-9743-bfc63b679d05 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:03:09.687538 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 02:03:09.712300 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fea7684-a674-480e-9743-bfc63b679d05 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 112, target: iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec, portal: 192.168.50.100,3260]
May 28 02:03:09.712300 np0000001583 nova-compute[98241]: Logout of [sid: 112, target: iqn.2023-03.storpool.com:os--volume-69c89952-ecdf-4907-af49-d3937eb47dec, portal: 192.168.50.100,3260] successful.
May 28 02:03:09.712300 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:03:09.745466 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fea7684-a674-480e-9743-bfc63b679d05 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:03:09.745889 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-7fea7684-a674-480e-9743-bfc63b679d05 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.404s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:03:09.745889 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fea7684-a674-480e-9743-bfc63b679d05 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] <== disconnect_volume: return (404ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:03:09.745889 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fea7684-a674-480e-9743-bfc63b679d05 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:03:10.074903 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Releasing lock "refresh_cache-9a804913-4bfb-4dba-9efe-cbf7c575d8d1" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:03:10.075678 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Instance network_info: |[{"id": "4ff6f19c-9ecc-4ac9-a37b-a99bde59db2d", "address": "fa:16:3e:92:00:c4", "network": {"id": "59a17812-47e4-4787-a775-e18f05e4d2ec", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1023256595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7849e9703e1345b9826a90dc99756d77", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff6f19c-9e", "ovs_interfaceid": "4ff6f19c-9ecc-4ac9-a37b-a99bde59db2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 02:03:10.077424 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Start _get_guest_xml network_info=[{"id": "4ff6f19c-9ecc-4ac9-a37b-a99bde59db2d", "address": "fa:16:3e:92:00:c4", "network": {"id": "59a17812-47e4-4787-a775-e18f05e4d2ec", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1023256595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7849e9703e1345b9826a90dc99756d77", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff6f19c-9e", "ovs_interfaceid": "4ff6f19c-9ecc-4ac9-a37b-a99bde59db2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 02:03:10.084143 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:03:10.085655 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1066727671', uuid='9a804913-4bfb-4dba-9efe-cbf7c575d8d1'), owner=OwnerMeta(userid='c2fa2fdfb3264e2283e385b876095c6e', username='tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member', projectid='7849e9703e1345b9826a90dc99756d77', projectname='tempest-TestServerVolumeAttachScenarioOldVersion-649923774'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4ff6f19c-9ecc-4ac9-a37b-a99bde59db2d", "address": "fa:16:3e:92:00:c4", "network": {"id": "59a17812-47e4-4787-a775-e18f05e4d2ec", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1023256595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7849e9703e1345b9826a90dc99756d77", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff6f19c-9e", "ovs_interfaceid": "4ff6f19c-9ecc-4ac9-a37b-a99bde59db2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933790.0853074) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 02:03:10.089868 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 02:03:10.090267 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 02:03:10.092615 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 02:03:10.092835 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 02:03:10.093858 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 02:03:10.094229 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 02:03:10.094441 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 02:03:10.094545 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 02:03:10.094650 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 02:03:10.094755 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 02:03:10.094848 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 02:03:10.094976 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 02:03:10.095131 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 02:03:10.095235 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 02:03:10.095335 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 02:03:10.095455 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 02:03:10.110817 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:03:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1066727671',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1066727671',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testservervolumeattachscenariooldversion-server-1066727',id=52,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBXnxsmyoKyYOicke+a2j41FIiyLQT24hXslEKYEQQVnScvYxCrZKQj44eh6iwnWwA3Q+rKFOnlaa94D1xbB6xVrvJZg4VFFKGTFOcrVQjqs90TcmXH5qJnBKEbDH6uepg==',key_name='tempest-keypair-1475679098',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7849e9703e1345b9826a90dc99756d77',ramdisk_id='',reservation_id='r-rdryf01q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-649923774',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:03:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2fa2fdfb3264e2283e385b876095c6e',uuid=9a804913-4bfb-4dba-9efe-cbf7c575d8d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ff6f19c-9ecc-4ac9-a37b-a99bde59db2d", "address": "fa:16:3e:92:00:c4", "network": {"id": "59a17812-47e4-4787-a775-e18f05e4d2ec", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1023256595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7849e9703e1345b9826a90dc99756d77", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff6f19c-9e", "ovs_interfaceid": "4ff6f19c-9ecc-4ac9-a37b-a99bde59db2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 02:03:10.111023 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Converting VIF {"id": "4ff6f19c-9ecc-4ac9-a37b-a99bde59db2d", "address": "fa:16:3e:92:00:c4", "network": {"id": "59a17812-47e4-4787-a775-e18f05e4d2ec", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1023256595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7849e9703e1345b9826a90dc99756d77", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff6f19c-9e", "ovs_interfaceid": "4ff6f19c-9ecc-4ac9-a37b-a99bde59db2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:03:10.111578 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:00:c4,bridge_name='br-int',has_traffic_filtering=True,id=4ff6f19c-9ecc-4ac9-a37b-a99bde59db2d,network=Network(59a17812-47e4-4787-a775-e18f05e4d2ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ff6f19c-9e') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:03:10.116303 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Lazy-loading 'pci_devices' on Instance uuid 9a804913-4bfb-4dba-9efe-cbf7c575d8d1 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:03:10.191564 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Booting with volume snapshot 05971d50-6226-4ba9-bf01-228cba6c485d at /dev/vda
May 28 02:03:10.226818 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "ef2472b3-00d4-4d9d-8ebc-266857e4b91d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:10.226960 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "ef2472b3-00d4-4d9d-8ebc-266857e4b91d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:10.227212 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "ef2472b3-00d4-4d9d-8ebc-266857e4b91d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:10.227409 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "ef2472b3-00d4-4d9d-8ebc-266857e4b91d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:10.227517 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "ef2472b3-00d4-4d9d-8ebc-266857e4b91d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:10.229419 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Terminating instance
May 28 02:03:10.301821 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-7fea7684-a674-480e-9743-bfc63b679d05 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lazy-loading 'flavor' on Instance uuid e00f21c6-ce7c-4e23-94e2-7f415ae7a9be {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:03:10.316789 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.00038059700000303565 future=<Future at 0x7724ec1991f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:03:10.316924 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:03:10.317290 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Emitting event <LifecycleEvent: 1779933775.3162904, 3dd5aa3c-dade-42d8-8de7-f34574a0fc31 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:03:10.317734 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] VM Stopped (Lifecycle Event)
May 28 02:03:10.430020 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Successfully created port: 1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 02:03:10.547227 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:10.621567 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] End _get_guest_xml xml=<domain type="qemu">
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:   <uuid>9a804913-4bfb-4dba-9efe-cbf7c575d8d1</uuid>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:   <name>instance-00000034</name>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:   <metadata>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1066727671</nova:name>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 02:03:10</nova:creationTime>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:       </nova:image>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:         <nova:user uuid="c2fa2fdfb3264e2283e385b876095c6e">tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member</nova:user>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:         <nova:project uuid="7849e9703e1345b9826a90dc99756d77">tempest-TestServerVolumeAttachScenarioOldVersion-649923774</nova:project>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:         <nova:port uuid="4ff6f19c-9ecc-4ac9-a37b-a99bde59db2d">
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:         </nova:port>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:   </metadata>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:     <system>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:       <entry name="serial">9a804913-4bfb-4dba-9efe-cbf7c575d8d1</entry>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:       <entry name="uuid">9a804913-4bfb-4dba-9efe-cbf7c575d8d1</entry>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:     </system>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:   <os>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:   </os>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:   <features>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:     <acpi/>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:     <tcg>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:     </tcg>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:   </features>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:   </cpu>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:   <devices>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/9a804913-4bfb-4dba-9efe-cbf7c575d8d1/disk"/>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:     </disk>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/9a804913-4bfb-4dba-9efe-cbf7c575d8d1/disk.config"/>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:     </disk>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:92:00:c4"/>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:       <target dev="tap4ff6f19c-9e"/>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:     </interface>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/9a804913-4bfb-4dba-9efe-cbf7c575d8d1/console.log" append="off"/>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:     </serial>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:     <video>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:     </video>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:     </rng>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:     </memballoon>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:   </devices>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]: </domain>
May 28 02:03:10.621567 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 02:03:10.624947 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Preparing to wait for external event network-vif-plugged-4ff6f19c-9ecc-4ac9-a37b-a99bde59db2d {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 02:03:10.624947 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Acquiring lock "9a804913-4bfb-4dba-9efe-cbf7c575d8d1-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:10.624947 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Lock "9a804913-4bfb-4dba-9efe-cbf7c575d8d1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:10.624947 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Lock "9a804913-4bfb-4dba-9efe-cbf7c575d8d1-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:10.624947 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:03:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1066727671',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1066727671',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testservervolumeattachscenariooldversion-server-1066727',id=52,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBXnxsmyoKyYOicke+a2j41FIiyLQT24hXslEKYEQQVnScvYxCrZKQj44eh6iwnWwA3Q+rKFOnlaa94D1xbB6xVrvJZg4VFFKGTFOcrVQjqs90TcmXH5qJnBKEbDH6uepg==',key_name='tempest-keypair-1475679098',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7849e9703e1345b9826a90dc99756d77',ramdisk_id='',reservation_id='r-rdryf01q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-649923774',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:03:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2fa2fdfb3264e2283e385b876095c6e',uuid=9a804913-4bfb-4dba-9efe-cbf7c575d8d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ff6f19c-9ecc-4ac9-a37b-a99bde59db2d", "address": "fa:16:3e:92:00:c4", "network": {"id": "59a17812-47e4-4787-a775-e18f05e4d2ec", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1023256595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7849e9703e1345b9826a90dc99756d77", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff6f19c-9e", "ovs_interfaceid": "4ff6f19c-9ecc-4ac9-a37b-a99bde59db2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 02:03:10.624947 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Converting VIF {"id": "4ff6f19c-9ecc-4ac9-a37b-a99bde59db2d", "address": "fa:16:3e:92:00:c4", "network": {"id": "59a17812-47e4-4787-a775-e18f05e4d2ec", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1023256595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7849e9703e1345b9826a90dc99756d77", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff6f19c-9e", "ovs_interfaceid": "4ff6f19c-9ecc-4ac9-a37b-a99bde59db2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:03:10.624947 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:00:c4,bridge_name='br-int',has_traffic_filtering=True,id=4ff6f19c-9ecc-4ac9-a37b-a99bde59db2d,network=Network(59a17812-47e4-4787-a775-e18f05e4d2ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ff6f19c-9e') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:03:10.624947 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:00:c4,bridge_name='br-int',has_traffic_filtering=True,id=4ff6f19c-9ecc-4ac9-a37b-a99bde59db2d,network=Network(59a17812-47e4-4787-a775-e18f05e4d2ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ff6f19c-9e') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 02:03:10.625813 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:10.626415 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:03:10.627749 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 02:03:10.629361 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:10.629544 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b9e82ce2-5b78-5477-b157-3d085cdf8920', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:03:10.630374 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:10.631195 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:03:10.631690 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:10.635325 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:10.635482 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ff6f19c-9e, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:03:10.635869 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4ff6f19c-9e, col_values=(('qos', UUID('7455b2b6-ca8a-4511-932f-a3922541b5fe')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:03:10.636103 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4ff6f19c-9e, col_values=(('external_ids', {'iface-id': '4ff6f19c-9ecc-4ac9-a37b-a99bde59db2d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:00:c4', 'vm-uuid': '9a804913-4bfb-4dba-9efe-cbf7c575d8d1'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:03:10.639739 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:10.640897 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:03:10.647764 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:10.648689 np0000001583 nova-compute[98241]: INFO os_vif [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:00:c4,bridge_name='br-int',has_traffic_filtering=True,id=4ff6f19c-9ecc-4ac9-a37b-a99bde59db2d,network=Network(59a17812-47e4-4787-a775-e18f05e4d2ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ff6f19c-9e')
May 28 02:03:10.732331 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 02:03:10.756983 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:10.759304 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:10.782948 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:10.820454 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 3dd5aa3c-dade-42d8-8de7-f34574a0fc31] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:03:10.923100 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:10.935014 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:11.074228 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999673086000257 future=<Future at 0x7724f844c7d0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:03:11.074444 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999320664000152 future=<Future at 0x7724f844c7d0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:03:11.074605 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999134640000193 future=<Future at 0x7724f844c7d0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:03:11.081900 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Instance destroyed successfully.
May 28 02:03:11.082477 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lazy-loading 'resources' on Instance uuid ef2472b3-00d4-4d9d-8ebc-266857e4b91d {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:03:11.087652 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-dbd78e26-bdab-49b4-8d55-208a838f5ff4 req-4e6d0640-b890-477a-8acf-dcefa651ae69 service nova] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Received event network-vif-unplugged-276d5af7-b597-4686-a307-b9b7c26cb661 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:03:11.087904 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-dbd78e26-bdab-49b4-8d55-208a838f5ff4 req-4e6d0640-b890-477a-8acf-dcefa651ae69 service nova] Acquiring lock "ef2472b3-00d4-4d9d-8ebc-266857e4b91d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:11.088406 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-dbd78e26-bdab-49b4-8d55-208a838f5ff4 req-4e6d0640-b890-477a-8acf-dcefa651ae69 service nova] Lock "ef2472b3-00d4-4d9d-8ebc-266857e4b91d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:11.088406 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-dbd78e26-bdab-49b4-8d55-208a838f5ff4 req-4e6d0640-b890-477a-8acf-dcefa651ae69 service nova] Lock "ef2472b3-00d4-4d9d-8ebc-266857e4b91d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:11.088542 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-dbd78e26-bdab-49b4-8d55-208a838f5ff4 req-4e6d0640-b890-477a-8acf-dcefa651ae69 service nova] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] No waiting events found dispatching network-vif-unplugged-276d5af7-b597-4686-a307-b9b7c26cb661 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:03:11.088668 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-dbd78e26-bdab-49b4-8d55-208a838f5ff4 req-4e6d0640-b890-477a-8acf-dcefa651ae69 service nova] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Received event network-vif-unplugged-276d5af7-b597-4686-a307-b9b7c26cb661 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:03:11.300764 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Successfully updated port: 1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 02:03:11.305381 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7fea7684-a674-480e-9743-bfc63b679d05 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "e00f21c6-ce7c-4e23-94e2-7f415ae7a9be" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.150s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:11.547515 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e6635020-2fb9-432e-ac4d-59e97fa4fa32 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Acquiring lock "e00f21c6-ce7c-4e23-94e2-7f415ae7a9be" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:11.547713 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e6635020-2fb9-432e-ac4d-59e97fa4fa32 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "e00f21c6-ce7c-4e23-94e2-7f415ae7a9be" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:11.594099 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T02:02:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-871699587',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-attachvolumemultiattachtest-server-871699587',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:03:05Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0474090f4f2d4950b51bc317f4302266',ramdisk_id='',reservation_id='r-egcxtoce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-857456921',owner_user_name='tempest-AttachVolumeMultiAttachTest-857456921-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T02:03:06Z,user_data=None,user_id='cadb612e41314b06914d5f5f47570e98',uuid=ef2472b3-00d4-4d9d-8ebc-266857e4b91d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "276d5af7-b597-4686-a307-b9b7c26cb661", "address": "fa:16:3e:2b:6a:bd", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap276d5af7-b5", "ovs_interfaceid": "276d5af7-b597-4686-a307-b9b7c26cb661", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:03:11.594099 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Converting VIF {"id": "276d5af7-b597-4686-a307-b9b7c26cb661", "address": "fa:16:3e:2b:6a:bd", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap276d5af7-b5", "ovs_interfaceid": "276d5af7-b597-4686-a307-b9b7c26cb661", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:03:11.594099 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:6a:bd,bridge_name='br-int',has_traffic_filtering=True,id=276d5af7-b597-4686-a307-b9b7c26cb661,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap276d5af7-b5') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:03:11.594099 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:6a:bd,bridge_name='br-int',has_traffic_filtering=True,id=276d5af7-b597-4686-a307-b9b7c26cb661,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap276d5af7-b5') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:03:11.597674 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:11.597889 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap276d5af7-b5, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:03:11.598841 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:11.599591 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:03:11.605755 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:11.606835 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:11.606983 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=507bfcd3-4da9-4417-8661-6d0b44f38e60) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:03:11.607502 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:11.607952 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:03:11.613133 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:11.615970 np0000001583 nova-compute[98241]: INFO os_vif [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:6a:bd,bridge_name='br-int',has_traffic_filtering=True,id=276d5af7-b597-4686-a307-b9b7c26cb661,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap276d5af7-b5')
May 28 02:03:11.649673 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:03:11.650061 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa', 'iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '130e87d8-0de4-480b-962d-0534472cd0aa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:03:11.650276 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:03:11.650653 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:03:11.651001 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa', 'iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '130e87d8-0de4-480b-962d-0534472cd0aa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:03:11.651233 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:03:11.685332 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:03:11.685332 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:03:11.685332 np0000001583 nova-compute[98241]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:03:11.685332 np0000001583 nova-compute[98241]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:03:11.685332 np0000001583 nova-compute[98241]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa (non-flash)
May 28 02:03:11.685332 np0000001583 nova-compute[98241]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa (non-flash)
May 28 02:03:11.685332 np0000001583 nova-compute[98241]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1 (non-flash)
May 28 02:03:11.685332 np0000001583 nova-compute[98241]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1 (non-flash)
May 28 02:03:11.685332 np0000001583 nova-compute[98241]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8d9da7c-12ec-4da3-b3cf-1987f7c16b89 (non-flash)
May 28 02:03:11.685332 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:03:11.685332 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:03:11.685332 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:03:11.685763 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsi session list stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:03:11.685763 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:03:11.685763 np0000001583 nova-compute[98241]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:03:11.685763 np0000001583 nova-compute[98241]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:03:11.685763 np0000001583 nova-compute[98241]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa (non-flash)
May 28 02:03:11.685763 np0000001583 nova-compute[98241]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa (non-flash)
May 28 02:03:11.685763 np0000001583 nova-compute[98241]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1 (non-flash)
May 28 02:03:11.685763 np0000001583 nova-compute[98241]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1 (non-flash)
May 28 02:03:11.685763 np0000001583 nova-compute[98241]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8d9da7c-12ec-4da3-b3cf-1987f7c16b89 (non-flash)
May 28 02:03:11.685763 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:03:11.685763 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:03:11.685763 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:03:11.685763 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86', '109'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86', '110'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19', '113'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19', '114'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa', '115'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa', '116'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1', '117'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1', '118'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b8d9da7c-12ec-4da3-b3cf-1987f7c16b89', '119'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', '68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', '69')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:03:11.686167 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa', '115')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:03:11.687355 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa', '116')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:03:11.688594 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724ec25c2c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa'): ({'sdk'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:03:11.688846 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Removing multipathed devices sdk, sdj {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:03:11.689154 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Flush multipath device 3300000000d677cdf {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:03:11.745897 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:03:11.801642 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:03:11.803425 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "refresh_cache-9dd6bff7-c612-44cb-a1f2-9e1b26f5f342" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:03:11.803560 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquired lock "refresh_cache-9dd6bff7-c612-44cb-a1f2-9e1b26f5f342" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:03:11.803815 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:03:11.860181 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Checking to see if SCSI volumes sdk, sdj have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:03:11.860386 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] SCSI volumes sdk, sdj have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:03:11.861790 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Checking to see if device paths {'sdk', 'sdj'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:03:11.874238 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Device paths {'sdk', 'sdj'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:03:11.874485 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:03:11.888760 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:03:11.924750 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 115, target: iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa, portal: 192.168.40.100,3260]
May 28 02:03:11.924750 np0000001583 nova-compute[98241]: Logout of [sid: 115, target: iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa, portal: 192.168.40.100,3260] successful.
May 28 02:03:11.924750 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:03:11.944797 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:03:11.959718 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:03:11.998219 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 116, target: iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa, portal: 192.168.50.100,3260]
May 28 02:03:11.998219 np0000001583 nova-compute[98241]: Logout of [sid: 116, target: iqn.2023-03.storpool.com:os--volume-130e87d8-0de4-480b-962d-0534472cd0aa, portal: 192.168.50.100,3260] successful.
May 28 02:03:11.998219 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:03:12.016435 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:03:12.016710 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:03:12.016831 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] <== disconnect_volume: return (366ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:03:12.016954 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:03:12.017288 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Deleting instance files /opt/stack/data/nova/instances/ef2472b3-00d4-4d9d-8ebc-266857e4b91d_del
May 28 02:03:12.017758 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Deletion of /opt/stack/data/nova/instances/ef2472b3-00d4-4d9d-8ebc-266857e4b91d_del complete
May 28 02:03:12.051523 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-e6635020-2fb9-432e-ac4d-59e97fa4fa32 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Detaching volume 776608d6-bb99-44d4-af54-73e3c444e7f1
May 28 02:03:12.089045 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-e6635020-2fb9-432e-ac4d-59e97fa4fa32 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Attempting to driver detach volume 776608d6-bb99-44d4-af54-73e3c444e7f1 from mountpoint /dev/vdc
May 28 02:03:12.093917 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e6635020-2fb9-432e-ac4d-59e97fa4fa32 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Found disk vdc by alias ua-776608d6-bb99-44d4-af54-73e3c444e7f1 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:03:12.095185 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e6635020-2fb9-432e-ac4d-59e97fa4fa32 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Found disk vdc by alias ua-776608d6-bb99-44d4-af54-73e3c444e7f1 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:03:12.095293 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e6635020-2fb9-432e-ac4d-59e97fa4fa32 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Attempting to detach device vdc from instance e00f21c6-ce7c-4e23-94e2-7f415ae7a9be from the persistent domain config. {{(pid=98241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 02:03:12.095507 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-e6635020-2fb9-432e-ac4d-59e97fa4fa32 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:03:12.095507 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:03:12.095507 np0000001583 nova-compute[98241]:   <alias name="ua-776608d6-bb99-44d4-af54-73e3c444e7f1"/>
May 28 02:03:12.095507 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-11"/>
May 28 02:03:12.095507 np0000001583 nova-compute[98241]:   <target dev="vdc" bus="virtio"/>
May 28 02:03:12.095507 np0000001583 nova-compute[98241]:   <serial>776608d6-bb99-44d4-af54-73e3c444e7f1</serial>
May 28 02:03:12.095507 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 28 02:03:12.095507 np0000001583 nova-compute[98241]: </disk>
May 28 02:03:12.095507 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:03:12.103305 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-e6635020-2fb9-432e-ac4d-59e97fa4fa32 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Successfully detached device vdc from instance e00f21c6-ce7c-4e23-94e2-7f415ae7a9be from the persistent domain config.
May 28 02:03:12.103442 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e6635020-2fb9-432e-ac4d-59e97fa4fa32 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] (1/8): Attempting to detach device vdc with device alias ua-776608d6-bb99-44d4-af54-73e3c444e7f1 from instance e00f21c6-ce7c-4e23-94e2-7f415ae7a9be from the live domain config. {{(pid=98241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 02:03:12.103671 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-e6635020-2fb9-432e-ac4d-59e97fa4fa32 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:03:12.103671 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:03:12.103671 np0000001583 nova-compute[98241]:   <alias name="ua-776608d6-bb99-44d4-af54-73e3c444e7f1"/>
May 28 02:03:12.103671 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-11"/>
May 28 02:03:12.103671 np0000001583 nova-compute[98241]:   <target dev="vdc" bus="virtio"/>
May 28 02:03:12.103671 np0000001583 nova-compute[98241]:   <serial>776608d6-bb99-44d4-af54-73e3c444e7f1</serial>
May 28 02:03:12.103671 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 28 02:03:12.103671 np0000001583 nova-compute[98241]: </disk>
May 28 02:03:12.103671 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:03:12.171522 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:03:12.171522 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:03:12.171522 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] No VIF found with MAC fa:16:3e:92:00:c4, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:03:12.171522 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Using config drive
May 28 02:03:12.398551 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:03:12.523624 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Took 1.79 seconds to destroy the instance on the hypervisor.
May 28 02:03:12.524244 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 02:03:12.524530 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 02:03:12.524646 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 02:03:12.524884 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:03:12.590776 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:03:12.597730 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:03:12.662833 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Received event <DeviceRemovedEvent: 1779933792.6624548, e00f21c6-ce7c-4e23-94e2-7f415ae7a9be => ua-776608d6-bb99-44d4-af54-73e3c444e7f1> from libvirt while the driver is waiting for it; dispatched. {{(pid=98241) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 02:03:12.668711 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e6635020-2fb9-432e-ac4d-59e97fa4fa32 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-776608d6-bb99-44d4-af54-73e3c444e7f1 for instance e00f21c6-ce7c-4e23-94e2-7f415ae7a9be {{(pid=98241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 02:03:12.675094 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-e6635020-2fb9-432e-ac4d-59e97fa4fa32 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Successfully detached device vdc from instance e00f21c6-ce7c-4e23-94e2-7f415ae7a9be from the live domain config.
May 28 02:03:12.678582 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:03:12.682563 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6635020-2fb9-432e-ac4d-59e97fa4fa32 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:03:12.682863 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6635020-2fb9-432e-ac4d-59e97fa4fa32 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1', 'iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '776608d6-bb99-44d4-af54-73e3c444e7f1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, None), 'kwargs': {'force': False}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:03:12.682975 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-e6635020-2fb9-432e-ac4d-59e97fa4fa32 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:03:12.683315 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-e6635020-2fb9-432e-ac4d-59e97fa4fa32 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:03:12.683582 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6635020-2fb9-432e-ac4d-59e97fa4fa32 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1', 'iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '776608d6-bb99-44d4-af54-73e3c444e7f1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:03:12.683704 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6635020-2fb9-432e-ac4d-59e97fa4fa32 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:03:12.718128 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6635020-2fb9-432e-ac4d-59e97fa4fa32 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:03:12.718128 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:03:12.718128 np0000001583 nova-compute[98241]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:03:12.718128 np0000001583 nova-compute[98241]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:03:12.718128 np0000001583 nova-compute[98241]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1 (non-flash)
May 28 02:03:12.718128 np0000001583 nova-compute[98241]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1 (non-flash)
May 28 02:03:12.718128 np0000001583 nova-compute[98241]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8d9da7c-12ec-4da3-b3cf-1987f7c16b89 (non-flash)
May 28 02:03:12.718128 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:03:12.718128 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:03:12.718128 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:03:12.718445 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6635020-2fb9-432e-ac4d-59e97fa4fa32 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsi session list stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:03:12.718445 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:03:12.718445 np0000001583 nova-compute[98241]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:03:12.718445 np0000001583 nova-compute[98241]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:03:12.718445 np0000001583 nova-compute[98241]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1 (non-flash)
May 28 02:03:12.718445 np0000001583 nova-compute[98241]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1 (non-flash)
May 28 02:03:12.718445 np0000001583 nova-compute[98241]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8d9da7c-12ec-4da3-b3cf-1987f7c16b89 (non-flash)
May 28 02:03:12.718445 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:03:12.718445 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:03:12.718445 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:03:12.718445 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6635020-2fb9-432e-ac4d-59e97fa4fa32 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86', '109'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86', '110'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19', '113'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19', '114'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1', '117'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1', '118'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b8d9da7c-12ec-4da3-b3cf-1987f7c16b89', '119'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', '68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', '69')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:03:12.718837 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6635020-2fb9-432e-ac4d-59e97fa4fa32 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1', '117')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:03:12.719398 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6635020-2fb9-432e-ac4d-59e97fa4fa32 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1', '118')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:03:12.720179 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6635020-2fb9-432e-ac4d-59e97fa4fa32 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f839a200>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1'): ({'sdm'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:03:12.720350 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-e6635020-2fb9-432e-ac4d-59e97fa4fa32 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Removing multipathed devices sdl, sdm {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:03:12.720540 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-e6635020-2fb9-432e-ac4d-59e97fa4fa32 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Flush multipath device 330000000b5496992 {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:03:12.759630 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Updating instance_info_cache with network_info: [{"id": "1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc", "address": "fa:16:3e:89:83:47", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e0cbc1d-c7", "ovs_interfaceid": "1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:03:12.767758 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-e6635020-2fb9-432e-ac4d-59e97fa4fa32 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:03:12.814022 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-e6635020-2fb9-432e-ac4d-59e97fa4fa32 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:03:12.837810 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Creating config drive at /opt/stack/data/nova/instances/9a804913-4bfb-4dba-9efe-cbf7c575d8d1/disk.config
May 28 02:03:12.845341 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9a804913-4bfb-4dba-9efe-cbf7c575d8d1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpoet0sn6h {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:03:12.868624 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-e6635020-2fb9-432e-ac4d-59e97fa4fa32 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Checking to see if SCSI volumes sdl, sdm have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:03:12.868853 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-e6635020-2fb9-432e-ac4d-59e97fa4fa32 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] SCSI volumes sdl, sdm have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:03:12.870472 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-e6635020-2fb9-432e-ac4d-59e97fa4fa32 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Checking to see if device paths {'sdl', 'sdm'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:03:12.882816 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-e6635020-2fb9-432e-ac4d-59e97fa4fa32 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Device paths {'sdl', 'sdm'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:03:12.883164 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6635020-2fb9-432e-ac4d-59e97fa4fa32 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:03:12.900829 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6635020-2fb9-432e-ac4d-59e97fa4fa32 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:03:12.907569 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9a804913-4bfb-4dba-9efe-cbf7c575d8d1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpoet0sn6h" returned: 0 in 0.062s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:03:12.940627 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6635020-2fb9-432e-ac4d-59e97fa4fa32 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 117, target: iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1, portal: 192.168.40.100,3260]
May 28 02:03:12.940627 np0000001583 nova-compute[98241]: Logout of [sid: 117, target: iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1, portal: 192.168.40.100,3260] successful.
May 28 02:03:12.940627 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:03:12.963126 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6635020-2fb9-432e-ac4d-59e97fa4fa32 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:03:12.978292 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6635020-2fb9-432e-ac4d-59e97fa4fa32 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:03:13.021167 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6635020-2fb9-432e-ac4d-59e97fa4fa32 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 118, target: iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1, portal: 192.168.50.100,3260]
May 28 02:03:13.021167 np0000001583 nova-compute[98241]: Logout of [sid: 118, target: iqn.2023-03.storpool.com:os--volume-776608d6-bb99-44d4-af54-73e3c444e7f1, portal: 192.168.50.100,3260] successful.
May 28 02:03:13.021167 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:03:13.063461 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6635020-2fb9-432e-ac4d-59e97fa4fa32 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:03:13.063944 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-e6635020-2fb9-432e-ac4d-59e97fa4fa32 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:03:13.064216 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6635020-2fb9-432e-ac4d-59e97fa4fa32 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] <== disconnect_volume: return (381ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:03:13.064475 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6635020-2fb9-432e-ac4d-59e97fa4fa32 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:03:13.114706 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2ad94659-691f-4333-adc7-0728dced6b00 req-8a808753-03c3-4b41-8097-278c8a0d2796 service nova] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Received event network-vif-unplugged-1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:03:13.115819 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2ad94659-691f-4333-adc7-0728dced6b00 req-8a808753-03c3-4b41-8097-278c8a0d2796 service nova] Acquiring lock "9dd6bff7-c612-44cb-a1f2-9e1b26f5f342-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:13.115819 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2ad94659-691f-4333-adc7-0728dced6b00 req-8a808753-03c3-4b41-8097-278c8a0d2796 service nova] Lock "9dd6bff7-c612-44cb-a1f2-9e1b26f5f342-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:13.115819 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2ad94659-691f-4333-adc7-0728dced6b00 req-8a808753-03c3-4b41-8097-278c8a0d2796 service nova] Lock "9dd6bff7-c612-44cb-a1f2-9e1b26f5f342-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:13.116457 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2ad94659-691f-4333-adc7-0728dced6b00 req-8a808753-03c3-4b41-8097-278c8a0d2796 service nova] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] No waiting events found dispatching network-vif-unplugged-1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:03:13.116680 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-2ad94659-691f-4333-adc7-0728dced6b00 req-8a808753-03c3-4b41-8097-278c8a0d2796 service nova] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Received unexpected event network-vif-unplugged-1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc for instance with vm_state building and task_state block_device_mapping.
May 28 02:03:13.152310 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-c3dd56fd-939f-48b0-b157-37abd9b4951c req-26a99997-e3bb-4309-97ed-de5b3dc10e27 service nova] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Received event network-changed-1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:03:13.152310 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-c3dd56fd-939f-48b0-b157-37abd9b4951c req-26a99997-e3bb-4309-97ed-de5b3dc10e27 service nova] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Refreshing instance network info cache due to event network-changed-1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:03:13.152310 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c3dd56fd-939f-48b0-b157-37abd9b4951c req-26a99997-e3bb-4309-97ed-de5b3dc10e27 service nova] Acquiring lock "refresh_cache-9dd6bff7-c612-44cb-a1f2-9e1b26f5f342" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:03:13.266298 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Releasing lock "refresh_cache-9dd6bff7-c612-44cb-a1f2-9e1b26f5f342" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:03:13.266774 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Instance network_info: |[{"id": "1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc", "address": "fa:16:3e:89:83:47", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e0cbc1d-c7", "ovs_interfaceid": "1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 02:03:13.267271 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c3dd56fd-939f-48b0-b157-37abd9b4951c req-26a99997-e3bb-4309-97ed-de5b3dc10e27 service nova] Acquired lock "refresh_cache-9dd6bff7-c612-44cb-a1f2-9e1b26f5f342" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:03:13.267417 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-c3dd56fd-939f-48b0-b157-37abd9b4951c req-26a99997-e3bb-4309-97ed-de5b3dc10e27 service nova] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Refreshing network info cache for port 1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:03:13.317441 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:13.343573 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:03:13.402154 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:13.428558 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:13.430638 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:13.558334 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:13.638229 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-e6635020-2fb9-432e-ac4d-59e97fa4fa32 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lazy-loading 'flavor' on Instance uuid e00f21c6-ce7c-4e23-94e2-7f415ae7a9be {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:03:13.739328 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:03:13.759105 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 02:03:13.773888 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-c3dd56fd-939f-48b0-b157-37abd9b4951c req-26a99997-e3bb-4309-97ed-de5b3dc10e27 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:03:13.783905 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:03:13.830131 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 02:03:13.830395 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 02:03:13.839229 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 02:03:13.840889 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe48:7d7b', 'fe80::d0cf:7bff:fef9:3cc3', 'fe80::fc16:3eff:fed3:cd06', 'fe80::fc16:3eff:fedf:4521', 'fe80::fc16:3eff:fe76:c53f', 'fe80::fc16:3eff:fe57:9502', 'fe80::fc16:3eff:fe47:cf5e', 'fe80::5048:4dff:fe67:fb12', 'fe80::fc16:3eff:fec0:11b8', 'fe80::b0dd:40ff:feb5:6704', 'fe80::fc16:3eff:fe9e:36ca', 'fe80::34e0:eeff:fee2:bede', 'fe80::fc16:3eff:fe92:c4', 'fe80::6011:8bff:feac:407a'] 
May 28 02:03:13.841202 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 02:03:13.841202 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 02:03:13.841476 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] <== get_connector_properties: return (101ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:03:13.841714 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Updating existing volume attachment record: 367d67f0-f7eb-4825-b245-f12aad1911c1 {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 02:03:13.849261 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Took 1.32 seconds to deallocate network for instance.
May 28 02:03:13.869264 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:13.870995 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:13.874962 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:13.900905 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:14.121411 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-c3dd56fd-939f-48b0-b157-37abd9b4951c req-26a99997-e3bb-4309-97ed-de5b3dc10e27 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:03:14.296857 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-c3dd56fd-939f-48b0-b157-37abd9b4951c req-26a99997-e3bb-4309-97ed-de5b3dc10e27 service nova] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Updated VIF entry in instance network info cache for port 1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:03:14.297343 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-c3dd56fd-939f-48b0-b157-37abd9b4951c req-26a99997-e3bb-4309-97ed-de5b3dc10e27 service nova] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Updating instance_info_cache with network_info: [{"id": "1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc", "address": "fa:16:3e:89:83:47", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e0cbc1d-c7", "ovs_interfaceid": "1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:03:14.377370 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933794.376905, 9a804913-4bfb-4dba-9efe-cbf7c575d8d1 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:03:14.377606 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] VM Started (Lifecycle Event)
May 28 02:03:14.413512 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Took 0.56 seconds to detach 1 volumes for instance.
May 28 02:03:14.646705 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e6635020-2fb9-432e-ac4d-59e97fa4fa32 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "e00f21c6-ce7c-4e23-94e2-7f415ae7a9be" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.099s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:14.802264 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c3dd56fd-939f-48b0-b157-37abd9b4951c req-26a99997-e3bb-4309-97ed-de5b3dc10e27 service nova] Releasing lock "refresh_cache-9dd6bff7-c612-44cb-a1f2-9e1b26f5f342" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:03:14.802489 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-c3dd56fd-939f-48b0-b157-37abd9b4951c req-26a99997-e3bb-4309-97ed-de5b3dc10e27 service nova] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Received event network-vif-unplugged-276d5af7-b597-4686-a307-b9b7c26cb661 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:03:14.802638 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c3dd56fd-939f-48b0-b157-37abd9b4951c req-26a99997-e3bb-4309-97ed-de5b3dc10e27 service nova] Acquiring lock "ef2472b3-00d4-4d9d-8ebc-266857e4b91d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:14.802794 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c3dd56fd-939f-48b0-b157-37abd9b4951c req-26a99997-e3bb-4309-97ed-de5b3dc10e27 service nova] Lock "ef2472b3-00d4-4d9d-8ebc-266857e4b91d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:14.802907 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c3dd56fd-939f-48b0-b157-37abd9b4951c req-26a99997-e3bb-4309-97ed-de5b3dc10e27 service nova] Lock "ef2472b3-00d4-4d9d-8ebc-266857e4b91d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:14.803040 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-c3dd56fd-939f-48b0-b157-37abd9b4951c req-26a99997-e3bb-4309-97ed-de5b3dc10e27 service nova] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] No waiting events found dispatching network-vif-unplugged-276d5af7-b597-4686-a307-b9b7c26cb661 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:03:14.803227 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-c3dd56fd-939f-48b0-b157-37abd9b4951c req-26a99997-e3bb-4309-97ed-de5b3dc10e27 service nova] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Received event network-vif-unplugged-276d5af7-b597-4686-a307-b9b7c26cb661 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:03:14.803333 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-c3dd56fd-939f-48b0-b157-37abd9b4951c req-26a99997-e3bb-4309-97ed-de5b3dc10e27 service nova] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Received event network-vif-deleted-276d5af7-b597-4686-a307-b9b7c26cb661 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:03:14.803424 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-c3dd56fd-939f-48b0-b157-37abd9b4951c req-26a99997-e3bb-4309-97ed-de5b3dc10e27 service nova] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Neutron deleted interface 276d5af7-b597-4686-a307-b9b7c26cb661; detaching it from the instance and deleting it from the info cache
May 28 02:03:14.806174 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-c3dd56fd-939f-48b0-b157-37abd9b4951c req-26a99997-e3bb-4309-97ed-de5b3dc10e27 service nova] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Detach interface failed, port_id=276d5af7-b597-4686-a307-b9b7c26cb661, reason: Instance ef2472b3-00d4-4d9d-8ebc-266857e4b91d could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 02:03:14.880620 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:03:14.883025 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933794.8826804, 9a804913-4bfb-4dba-9efe-cbf7c575d8d1 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:03:14.883238 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] VM Paused (Lifecycle Event)
May 28 02:03:14.919820 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:14.920221 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:15.087879 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-af8b4a2b-107b-4eeb-8efb-62b235a74bc8 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Acquiring lock "e00f21c6-ce7c-4e23-94e2-7f415ae7a9be" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:15.087879 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-af8b4a2b-107b-4eeb-8efb-62b235a74bc8 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "e00f21c6-ce7c-4e23-94e2-7f415ae7a9be" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:15.087879 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-af8b4a2b-107b-4eeb-8efb-62b235a74bc8 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Acquiring lock "e00f21c6-ce7c-4e23-94e2-7f415ae7a9be-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:15.087879 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-af8b4a2b-107b-4eeb-8efb-62b235a74bc8 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "e00f21c6-ce7c-4e23-94e2-7f415ae7a9be-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:15.087879 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-af8b4a2b-107b-4eeb-8efb-62b235a74bc8 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "e00f21c6-ce7c-4e23-94e2-7f415ae7a9be-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:15.089951 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-af8b4a2b-107b-4eeb-8efb-62b235a74bc8 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Terminating instance
May 28 02:03:15.190230 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5f2cefd5-9d01-45d0-bcd1-0bf89407eb1e req-c762ae8e-f16e-4f0f-8afd-625bd151e27b service nova] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Received event network-vif-plugged-4ff6f19c-9ecc-4ac9-a37b-a99bde59db2d {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:03:15.190669 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5f2cefd5-9d01-45d0-bcd1-0bf89407eb1e req-c762ae8e-f16e-4f0f-8afd-625bd151e27b service nova] Acquiring lock "9a804913-4bfb-4dba-9efe-cbf7c575d8d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:15.190669 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5f2cefd5-9d01-45d0-bcd1-0bf89407eb1e req-c762ae8e-f16e-4f0f-8afd-625bd151e27b service nova] Lock "9a804913-4bfb-4dba-9efe-cbf7c575d8d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:15.190740 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5f2cefd5-9d01-45d0-bcd1-0bf89407eb1e req-c762ae8e-f16e-4f0f-8afd-625bd151e27b service nova] Lock "9a804913-4bfb-4dba-9efe-cbf7c575d8d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:15.190948 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5f2cefd5-9d01-45d0-bcd1-0bf89407eb1e req-c762ae8e-f16e-4f0f-8afd-625bd151e27b service nova] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Processing event network-vif-plugged-4ff6f19c-9ecc-4ac9-a37b-a99bde59db2d {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 02:03:15.191058 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5f2cefd5-9d01-45d0-bcd1-0bf89407eb1e req-c762ae8e-f16e-4f0f-8afd-625bd151e27b service nova] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Received event network-vif-plugged-4ff6f19c-9ecc-4ac9-a37b-a99bde59db2d {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:03:15.191137 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5f2cefd5-9d01-45d0-bcd1-0bf89407eb1e req-c762ae8e-f16e-4f0f-8afd-625bd151e27b service nova] Acquiring lock "9a804913-4bfb-4dba-9efe-cbf7c575d8d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:15.191305 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5f2cefd5-9d01-45d0-bcd1-0bf89407eb1e req-c762ae8e-f16e-4f0f-8afd-625bd151e27b service nova] Lock "9a804913-4bfb-4dba-9efe-cbf7c575d8d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:15.191405 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5f2cefd5-9d01-45d0-bcd1-0bf89407eb1e req-c762ae8e-f16e-4f0f-8afd-625bd151e27b service nova] Lock "9a804913-4bfb-4dba-9efe-cbf7c575d8d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:15.191527 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5f2cefd5-9d01-45d0-bcd1-0bf89407eb1e req-c762ae8e-f16e-4f0f-8afd-625bd151e27b service nova] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] No waiting events found dispatching network-vif-plugged-4ff6f19c-9ecc-4ac9-a37b-a99bde59db2d {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:03:15.191634 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-5f2cefd5-9d01-45d0-bcd1-0bf89407eb1e req-c762ae8e-f16e-4f0f-8afd-625bd151e27b service nova] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Received unexpected event network-vif-plugged-4ff6f19c-9ecc-4ac9-a37b-a99bde59db2d for instance with vm_state building and task_state spawning.
May 28 02:03:15.192412 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 02:03:15.195735 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 02:03:15.198149 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Instance spawned successfully.
May 28 02:03:15.198490 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 02:03:15.386458 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:03:15.392447 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933795.3921237, 9a804913-4bfb-4dba-9efe-cbf7c575d8d1 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:03:15.392583 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] VM Resumed (Lifecycle Event)
May 28 02:03:15.545901 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:03:15.546203 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:03:15.597979 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-af8b4a2b-107b-4eeb-8efb-62b235a74bc8 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 02:03:15.614949 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:15.619747 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:15.636990 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:15.641441 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:15.661896 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:15.667752 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:15.707371 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:03:15.707505 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:03:15.707798 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:03:15.708007 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:03:15.708351 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:03:15.708620 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:03:15.881258 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-04015405-577c-4ad1-823c-31e0f2743d97 req-2b36fb99-a902-4874-b266-6af18b15671c service nova] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Received event network-vif-unplugged-716e50f8-c111-4e71-92f4-953489d27e91 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:03:15.881258 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-04015405-577c-4ad1-823c-31e0f2743d97 req-2b36fb99-a902-4874-b266-6af18b15671c service nova] Acquiring lock "e00f21c6-ce7c-4e23-94e2-7f415ae7a9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:15.881533 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-04015405-577c-4ad1-823c-31e0f2743d97 req-2b36fb99-a902-4874-b266-6af18b15671c service nova] Lock "e00f21c6-ce7c-4e23-94e2-7f415ae7a9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:15.881710 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-04015405-577c-4ad1-823c-31e0f2743d97 req-2b36fb99-a902-4874-b266-6af18b15671c service nova] Lock "e00f21c6-ce7c-4e23-94e2-7f415ae7a9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:15.881831 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-04015405-577c-4ad1-823c-31e0f2743d97 req-2b36fb99-a902-4874-b266-6af18b15671c service nova] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] No waiting events found dispatching network-vif-unplugged-716e50f8-c111-4e71-92f4-953489d27e91 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:03:15.882008 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-04015405-577c-4ad1-823c-31e0f2743d97 req-2b36fb99-a902-4874-b266-6af18b15671c service nova] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Received event network-vif-unplugged-716e50f8-c111-4e71-92f4-953489d27e91 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:03:15.900105 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:03:15.908306 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:03:15.940156 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Instance destroyed successfully.
May 28 02:03:15.941281 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-af8b4a2b-107b-4eeb-8efb-62b235a74bc8 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lazy-loading 'resources' on Instance uuid e00f21c6-ce7c-4e23-94e2-7f415ae7a9be {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:03:15.968665 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 02:03:15.977403 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 02:03:15.978092 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Creating image(s)
May 28 02:03:15.979031 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Did not create local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 02:03:15.979031 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Ensure instance console log exists: /opt/stack/data/nova/instances/9dd6bff7-c612-44cb-a1f2-9e1b26f5f342/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 02:03:15.979031 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:15.979031 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:15.979031 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:15.979822 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Start _get_guest_xml network_info=[{"id": "1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc", "address": "fa:16:3e:89:83:47", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e0cbc1d-c7", "ovs_interfaceid": "1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2026-05-28T02:03:00Z,direct_url=<?>,disk_format='raw',id=fd8ee45b-4fe8-46c2-88d1-c61b282193b0,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-659480851',owner='432aa1094ced436494def17a875aa8e1',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2026-05-28T02:03:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b', 'iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a666df4f-490f-44bd-8bc4-7729f124192b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '9dd6bff7-c612-44cb-a1f2-9e1b26f5f342', 'attached_at': '', 'detached_at': '', 'volume_id': 'a666df4f-490f-44bd-8bc4-7729f124192b', 'serial': 'a666df4f-490f-44bd-8bc4-7729f124192b'}, 'delete_on_termination': True, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '367d67f0-f7eb-4825-b245-f12aad1911c1', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 02:03:15.992067 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:03:15.992067 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-image-snapshot-server-1267349814', uuid='9dd6bff7-c612-44cb-a1f2-9e1b26f5f342'), owner=OwnerMeta(userid='6be314b4eed642c3b2c72fe115860220', username='tempest-TestVolumeBootPattern-1031057169-project-member', projectid='432aa1094ced436494def17a875aa8e1', projectname='tempest-TestVolumeBootPattern-1031057169'), image=ImageMeta(id='fd8ee45b-4fe8-46c2-88d1-c61b282193b0', name=None, container_format='bare', disk_format='raw', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio', 'img_bdm_v2': True, 'img_root_device_name': '/dev/vda'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc", "address": "fa:16:3e:89:83:47", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e0cbc1d-c7", "ovs_interfaceid": "1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933795.9909558) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 02:03:15.994452 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 02:03:15.994975 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 02:03:15.996498 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 02:03:15.996709 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 02:03:15.997679 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 02:03:15.997904 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2026-05-28T02:03:00Z,direct_url=<?>,disk_format='raw',id=fd8ee45b-4fe8-46c2-88d1-c61b282193b0,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-659480851',owner='432aa1094ced436494def17a875aa8e1',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2026-05-28T02:03:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 02:03:15.998029 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 02:03:15.998154 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 02:03:15.998268 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 02:03:15.998350 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 02:03:15.998439 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 02:03:15.998579 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 02:03:15.998674 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 02:03:15.998775 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 02:03:15.998869 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 02:03:15.998972 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 02:03:16.009418 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 02:03:16.009726 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b', 'iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a666df4f-490f-44bd-8bc4-7729f124192b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:03:16.009852 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:03:16.010235 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:03:16.010447 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b', 'iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a666df4f-490f-44bd-8bc4-7729f124192b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 02:03:16.030712 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:03:16.031477 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:03:16.032201 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:03:16.032726 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:03:16.033269 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:03:16.033733 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:03:16.048555 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:03:16.048555 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:03:16.050487 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:03:16.060701 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:03:16.060701 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:03:16.069809 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b] added
May 28 02:03:16.069809 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:03:16.069809 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:03:16.069809 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:03:16.069809 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:03:16.069809 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:03:16.069809 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:03:16.070180 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:03:16.070180 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0376(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:03:16.070782 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:03:16.079122 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b] added
May 28 02:03:16.079122 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:03:16.079122 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:03:16.079122 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:03:16.079122 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:03:16.079122 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:03:16.079122 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:03:16.079122 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:03:16.079122 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0454(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:03:16.079122 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:03:16.215632 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Took 9.17 seconds to spawn the instance on the hypervisor.
May 28 02:03:16.218773 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:03:16.410841 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 02:03:16.411367 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999704383000335 future=<Future at 0x7724ec2d03b0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:03:16.445503 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-af8b4a2b-107b-4eeb-8efb-62b235a74bc8 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T02:01:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1763737570',display_name='tempest-AttachVolumeTestJSON-server-1763737570',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-attachvolumetestjson-server-1763737570',id=47,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+oroVq9PObpGX6vhXqHL9PdfqupauFjSmVH9pl6f3ucexstLDQMlshQYswaolt8AzzgMZsugJONkBsIevMQ+uyfaLxfkDnerfPRc09vpJibuIvVolMY45WXkOcX0kd4g==',key_name='tempest-keypair-838001831',keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:02:02Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='04ce4063a6ac4afdb5ee359a5c1105d3',ramdisk_id='',reservation_id='r-2b0v9i5q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1276932129',owner_user_name='tempest-AttachVolumeTestJSON-1276932129-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T02:02:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='164f3d08de954440bd716afe5eb1054a',uuid=e00f21c6-ce7c-4e23-94e2-7f415ae7a9be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "716e50f8-c111-4e71-92f4-953489d27e91", "address": "fa:16:3e:47:cf:5e", "network": {"id": "d4bf7f94-4ac7-4145-be11-d2aeeafb6c02", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-972487534-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "04ce4063a6ac4afdb5ee359a5c1105d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap716e50f8-c1", "ovs_interfaceid": "716e50f8-c111-4e71-92f4-953489d27e91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:03:16.445766 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-af8b4a2b-107b-4eeb-8efb-62b235a74bc8 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Converting VIF {"id": "716e50f8-c111-4e71-92f4-953489d27e91", "address": "fa:16:3e:47:cf:5e", "network": {"id": "d4bf7f94-4ac7-4145-be11-d2aeeafb6c02", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-972487534-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "04ce4063a6ac4afdb5ee359a5c1105d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap716e50f8-c1", "ovs_interfaceid": "716e50f8-c111-4e71-92f4-953489d27e91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:03:16.446466 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-af8b4a2b-107b-4eeb-8efb-62b235a74bc8 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:cf:5e,bridge_name='br-int',has_traffic_filtering=True,id=716e50f8-c111-4e71-92f4-953489d27e91,network=Network(d4bf7f94-4ac7-4145-be11-d2aeeafb6c02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap716e50f8-c1') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:03:16.446734 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-af8b4a2b-107b-4eeb-8efb-62b235a74bc8 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:cf:5e,bridge_name='br-int',has_traffic_filtering=True,id=716e50f8-c111-4e71-92f4-953489d27e91,network=Network(d4bf7f94-4ac7-4145-be11-d2aeeafb6c02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap716e50f8-c1') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:03:16.448000 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:16.448411 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap716e50f8-c1, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:03:16.450010 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:16.450796 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:03:16.498573 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:16.499797 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:16.500016 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4e9a9772-9568-47b8-af32-bd61b1b0ee74) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:03:16.500846 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:16.501855 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:03:16.505906 np0000001583 nova-compute[98241]: INFO os_vif [None req-af8b4a2b-107b-4eeb-8efb-62b235a74bc8 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:cf:5e,bridge_name='br-int',has_traffic_filtering=True,id=716e50f8-c111-4e71-92f4-953489d27e91,network=Network(d4bf7f94-4ac7-4145-be11-d2aeeafb6c02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap716e50f8-c1')
May 28 02:03:16.505906 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-af8b4a2b-107b-4eeb-8efb-62b235a74bc8 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Deleting instance files /opt/stack/data/nova/instances/e00f21c6-ce7c-4e23-94e2-7f415ae7a9be_del
May 28 02:03:16.506200 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-af8b4a2b-107b-4eeb-8efb-62b235a74bc8 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Deletion of /opt/stack/data/nova/instances/e00f21c6-ce7c-4e23-94e2-7f415ae7a9be_del complete
May 28 02:03:16.559163 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.639s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:16.638102 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Deleted allocations for instance ef2472b3-00d4-4d9d-8ebc-266857e4b91d
May 28 02:03:16.734552 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Took 14.90 seconds to build instance.
May 28 02:03:17.018152 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-af8b4a2b-107b-4eeb-8efb-62b235a74bc8 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Took 1.42 seconds to destroy the instance on the hypervisor.
May 28 02:03:17.021824 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-af8b4a2b-107b-4eeb-8efb-62b235a74bc8 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 02:03:17.022230 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 02:03:17.022325 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 02:03:17.022540 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:03:17.070873 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:03:17.079521 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:03:17.091260 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:03:17.091260 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:03:17.099488 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:03:17.099488 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:03:17.101702 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:03:17.106808 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:03:17.115746 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:03:17.127998 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:03:17.127998 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:03:17.127998 np0000001583 nova-compute[98241]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:03:17.127998 np0000001583 nova-compute[98241]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:03:17.127998 np0000001583 nova-compute[98241]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8d9da7c-12ec-4da3-b3cf-1987f7c16b89 (non-flash)
May 28 02:03:17.127998 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:03:17.127998 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:03:17.127998 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:03:17.128369 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:03:17.128369 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:03:17.128369 np0000001583 nova-compute[98241]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:03:17.128369 np0000001583 nova-compute[98241]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:03:17.128369 np0000001583 nova-compute[98241]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8d9da7c-12ec-4da3-b3cf-1987f7c16b89 (non-flash)
May 28 02:03:17.128369 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:03:17.128369 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:03:17.128369 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:03:17.139578 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:03:17.139578 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:03:17.139578 np0000001583 nova-compute[98241]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:03:17.139578 np0000001583 nova-compute[98241]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:03:17.139578 np0000001583 nova-compute[98241]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8d9da7c-12ec-4da3-b3cf-1987f7c16b89 (non-flash)
May 28 02:03:17.139578 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:03:17.139578 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:03:17.139578 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:03:17.139860 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:03:17.139860 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:03:17.139860 np0000001583 nova-compute[98241]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:03:17.139860 np0000001583 nova-compute[98241]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:03:17.139860 np0000001583 nova-compute[98241]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8d9da7c-12ec-4da3-b3cf-1987f7c16b89 (non-flash)
May 28 02:03:17.139860 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:03:17.139860 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:03:17.139860 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:03:17.187105 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b, portal: 192.168.50.100,3260]
May 28 02:03:17.187105 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b, portal: 192.168.50.100,3260] successful.
May 28 02:03:17.187105 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:03:17.188677 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b, portal: 192.168.40.100,3260]
May 28 02:03:17.188677 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b, portal: 192.168.40.100,3260] successful.
May 28 02:03:17.188677 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:03:17.195774 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:03:17.195774 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:03:17.201193 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:03:17.208939 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:03:17.225270 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:03:17.225270 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:03:17.225270 np0000001583 nova-compute[98241]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:03:17.225270 np0000001583 nova-compute[98241]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:03:17.225270 np0000001583 nova-compute[98241]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8d9da7c-12ec-4da3-b3cf-1987f7c16b89 (non-flash)
May 28 02:03:17.225270 np0000001583 nova-compute[98241]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b (non-flash)
May 28 02:03:17.225270 np0000001583 nova-compute[98241]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b (non-flash)
May 28 02:03:17.225270 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:03:17.225270 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:03:17.225270 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:03:17.225752 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:03:17.225752 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:03:17.225752 np0000001583 nova-compute[98241]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:03:17.225752 np0000001583 nova-compute[98241]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:03:17.225752 np0000001583 nova-compute[98241]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8d9da7c-12ec-4da3-b3cf-1987f7c16b89 (non-flash)
May 28 02:03:17.225752 np0000001583 nova-compute[98241]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b (non-flash)
May 28 02:03:17.225752 np0000001583 nova-compute[98241]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b (non-flash)
May 28 02:03:17.225752 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:03:17.225752 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:03:17.225752 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:03:17.225752 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.193s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:03:17.225950 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:03:17.226836 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] HCTL ('11', '-', '-', 0) found on session 121 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:03:17.226942 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:03:17.232903 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:03:17.232903 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:03:17.232903 np0000001583 nova-compute[98241]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:03:17.232903 np0000001583 nova-compute[98241]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:03:17.232903 np0000001583 nova-compute[98241]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8d9da7c-12ec-4da3-b3cf-1987f7c16b89 (non-flash)
May 28 02:03:17.232903 np0000001583 nova-compute[98241]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b (non-flash)
May 28 02:03:17.232903 np0000001583 nova-compute[98241]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b (non-flash)
May 28 02:03:17.232903 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:03:17.232903 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:03:17.232903 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:03:17.233185 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:03:17.233185 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:03:17.233185 np0000001583 nova-compute[98241]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:03:17.233185 np0000001583 nova-compute[98241]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:03:17.233185 np0000001583 nova-compute[98241]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8d9da7c-12ec-4da3-b3cf-1987f7c16b89 (non-flash)
May 28 02:03:17.233185 np0000001583 nova-compute[98241]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b (non-flash)
May 28 02:03:17.233185 np0000001583 nova-compute[98241]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b (non-flash)
May 28 02:03:17.233185 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:03:17.233185 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:03:17.233185 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:03:17.235221 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.203s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:03:17.235410 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:03:17.236764 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] HCTL ('10', '-', '-', 0) found on session 120 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:03:17.237289 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Lock "9a804913-4bfb-4dba-9efe-cbf7c575d8d1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.407s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:17.237489 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:03:17.250761 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Searching for a device in session 121 and hctl ['11', '*', '*', 0] yield: sde {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:03:17.250761 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a666df4f-490f-44bd-8bc4-7729f124192b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:03:17.271470 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Searching for a device in session 120 and hctl ['10', '*', '*', 0] yield: sdf {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:03:17.271613 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a666df4f-490f-44bd-8bc4-7729f124192b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:03:17.651513 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c167e9df-86c7-4f9f-ba47-f166c9c107a4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "ef2472b3-00d4-4d9d-8ebc-266857e4b91d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.424s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:17.717398 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-48fece1d-8ee0-4983-8df4-27f8165b5c7f req-94dc2715-3abc-45f3-b425-b9e55a816c05 service nova] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Received event network-vif-deleted-716e50f8-c111-4e71-92f4-953489d27e91 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:03:17.717588 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-48fece1d-8ee0-4983-8df4-27f8165b5c7f req-94dc2715-3abc-45f3-b425-b9e55a816c05 service nova] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Neutron deleted interface 716e50f8-c111-4e71-92f4-953489d27e91; detaching it from the instance and deleting it from the info cache
May 28 02:03:17.720762 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-48fece1d-8ee0-4983-8df4-27f8165b5c7f req-94dc2715-3abc-45f3-b425-b9e55a816c05 service nova] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Detach interface failed, port_id=716e50f8-c111-4e71-92f4-953489d27e91, reason: Instance e00f21c6-ce7c-4e23-94e2-7f415ae7a9be could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 02:03:17.985171 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-eb68a9e9-947e-4388-a6f2-55440c27c0a1 req-0639290f-2f19-4134-b437-1f381267bdb2 service nova] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Received event network-vif-unplugged-716e50f8-c111-4e71-92f4-953489d27e91 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:03:17.989306 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-eb68a9e9-947e-4388-a6f2-55440c27c0a1 req-0639290f-2f19-4134-b437-1f381267bdb2 service nova] Acquiring lock "e00f21c6-ce7c-4e23-94e2-7f415ae7a9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:17.989394 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-eb68a9e9-947e-4388-a6f2-55440c27c0a1 req-0639290f-2f19-4134-b437-1f381267bdb2 service nova] Lock "e00f21c6-ce7c-4e23-94e2-7f415ae7a9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:17.989530 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-eb68a9e9-947e-4388-a6f2-55440c27c0a1 req-0639290f-2f19-4134-b437-1f381267bdb2 service nova] Lock "e00f21c6-ce7c-4e23-94e2-7f415ae7a9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:17.989699 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-eb68a9e9-947e-4388-a6f2-55440c27c0a1 req-0639290f-2f19-4134-b437-1f381267bdb2 service nova] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] No waiting events found dispatching network-vif-unplugged-716e50f8-c111-4e71-92f4-953489d27e91 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:03:17.989870 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-eb68a9e9-947e-4388-a6f2-55440c27c0a1 req-0639290f-2f19-4134-b437-1f381267bdb2 service nova] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Received event network-vif-unplugged-716e50f8-c111-4e71-92f4-953489d27e91 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:03:18.033473 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 02:03:18.170203 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:03:18.323229 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:18.672876 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Took 1.65 seconds to deallocate network for instance.
May 28 02:03:18.725099 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:19.050886 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Found WWN 330000000cbbc8017 for multipath device dm-3 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 02:03:19.051216 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:03:19.051402 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] <== connect_volume: return (3041ms) {'type': 'block', 'scsi_wwn': '330000000cbbc8017', 'path': '/dev/dm-3', 'multipath_id': '330000000cbbc8017'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:03:19.051551 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000cbbc8017', 'path': '/dev/dm-3', 'multipath_id': '330000000cbbc8017'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 02:03:19.182116 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-af8b4a2b-107b-4eeb-8efb-62b235a74bc8 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:19.182702 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-af8b4a2b-107b-4eeb-8efb-62b235a74bc8 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:19.193819 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:03:19.193963 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:03:19.557922 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:03:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1267349814',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1267349814',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testvolumebootpattern-image-snapshot-server-1267349814',id=53,image_ref='fd8ee45b-4fe8-46c2-88d1-c61b282193b0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnEzyzDUw8RFEmiLx3V+KNBPQ659ZCf3P2NKggjsjnnUTXEpRSMlYuikYqpQK1F6mYNi/olRPQ6Y5KSaeP5tA676PQRn5cMJv/9KhK5iTd3ekdgY1q3bXvv4d+nK3YPJQ==',key_name='tempest-keypair-357597489',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='432aa1094ced436494def17a875aa8e1',ramdisk_id='',reservation_id='r-s2nf99u1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='raw',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1031057169',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1031057169-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1031057169',owner_user_name='tempest-TestVolumeBootPattern-1031057169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:03:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6be314b4eed642c3b2c72fe115860220',uuid=9dd6bff7-c612-44cb-a1f2-9e1b26f5f342,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc", "address": "fa:16:3e:89:83:47", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e0cbc1d-c7", "ovs_interfaceid": "1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 02:03:19.558661 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converting VIF {"id": "1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc", "address": "fa:16:3e:89:83:47", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e0cbc1d-c7", "ovs_interfaceid": "1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:03:19.558661 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:83:47,bridge_name='br-int',has_traffic_filtering=True,id=1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e0cbc1d-c7') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:03:19.559289 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lazy-loading 'pci_devices' on Instance uuid 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:03:19.758035 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-af8b4a2b-107b-4eeb-8efb-62b235a74bc8 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:03:19.758362 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-af8b4a2b-107b-4eeb-8efb-62b235a74bc8 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:03:19.801514 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-c5f2682d-7282-4a5c-a8b1-d71f087aa463 req-444fee67-0011-4ba2-9d8a-dded948ff2af service nova] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Received event network-changed-4ff6f19c-9ecc-4ac9-a37b-a99bde59db2d {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:03:19.801634 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-c5f2682d-7282-4a5c-a8b1-d71f087aa463 req-444fee67-0011-4ba2-9d8a-dded948ff2af service nova] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Refreshing instance network info cache due to event network-changed-4ff6f19c-9ecc-4ac9-a37b-a99bde59db2d. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:03:19.801774 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c5f2682d-7282-4a5c-a8b1-d71f087aa463 req-444fee67-0011-4ba2-9d8a-dded948ff2af service nova] Acquiring lock "refresh_cache-9a804913-4bfb-4dba-9efe-cbf7c575d8d1" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:03:19.801910 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c5f2682d-7282-4a5c-a8b1-d71f087aa463 req-444fee67-0011-4ba2-9d8a-dded948ff2af service nova] Acquired lock "refresh_cache-9a804913-4bfb-4dba-9efe-cbf7c575d8d1" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:03:19.801981 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-c5f2682d-7282-4a5c-a8b1-d71f087aa463 req-444fee67-0011-4ba2-9d8a-dded948ff2af service nova] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Refreshing network info cache for port 4ff6f19c-9ecc-4ac9-a37b-a99bde59db2d {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:03:20.062518 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] End _get_guest_xml xml=<domain type="qemu">
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:   <uuid>9dd6bff7-c612-44cb-a1f2-9e1b26f5f342</uuid>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:   <name>instance-00000035</name>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:   <metadata>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1267349814</nova:name>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 02:03:15</nova:creationTime>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:       <nova:image uuid="">
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:         <nova:diskFormat>raw</nova:diskFormat>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:           <nova:property name="img_bdm_v2">True</nova:property>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:           <nova:property name="img_root_device_name">/dev/vda</nova:property>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:       </nova:image>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:         <nova:user uuid="6be314b4eed642c3b2c72fe115860220">tempest-TestVolumeBootPattern-1031057169-project-member</nova:user>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:         <nova:project uuid="432aa1094ced436494def17a875aa8e1">tempest-TestVolumeBootPattern-1031057169</nova:project>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid=""/>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:         <nova:port uuid="1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc">
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:         </nova:port>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:   </metadata>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:     <system>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:       <entry name="serial">9dd6bff7-c612-44cb-a1f2-9e1b26f5f342</entry>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:       <entry name="uuid">9dd6bff7-c612-44cb-a1f2-9e1b26f5f342</entry>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:     </system>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:   <os>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:   </os>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:   <features>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:     <acpi/>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:     <tcg>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:     </tcg>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:   </features>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:   </cpu>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:   <devices>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/9dd6bff7-c612-44cb-a1f2-9e1b26f5f342/disk.config"/>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:     </disk>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:     <disk type="block" device="disk">
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:       <alias name="ua-a666df4f-490f-44bd-8bc4-7729f124192b"/>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:       <source dev="/dev/dm-3"/>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:       <serial>a666df4f-490f-44bd-8bc4-7729f124192b</serial>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:     </disk>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:89:83:47"/>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:       <target dev="tap1e0cbc1d-c7"/>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:     </interface>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/9dd6bff7-c612-44cb-a1f2-9e1b26f5f342/console.log" append="off"/>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:     </serial>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:     <video>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:     </video>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:     </rng>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:     </memballoon>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:   </devices>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]: </domain>
May 28 02:03:20.062518 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 02:03:20.065843 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Preparing to wait for external event network-vif-plugged-1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 02:03:20.065843 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "9dd6bff7-c612-44cb-a1f2-9e1b26f5f342-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:20.065843 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "9dd6bff7-c612-44cb-a1f2-9e1b26f5f342-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:20.065843 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "9dd6bff7-c612-44cb-a1f2-9e1b26f5f342-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:20.065843 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:03:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1267349814',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1267349814',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testvolumebootpattern-image-snapshot-server-1267349814',id=53,image_ref='fd8ee45b-4fe8-46c2-88d1-c61b282193b0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnEzyzDUw8RFEmiLx3V+KNBPQ659ZCf3P2NKggjsjnnUTXEpRSMlYuikYqpQK1F6mYNi/olRPQ6Y5KSaeP5tA676PQRn5cMJv/9KhK5iTd3ekdgY1q3bXvv4d+nK3YPJQ==',key_name='tempest-keypair-357597489',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='432aa1094ced436494def17a875aa8e1',ramdisk_id='',reservation_id='r-s2nf99u1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='raw',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1031057169',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1031057169-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1031057169',owner_user_name='tempest-TestVolumeBootPattern-1031057169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:03:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6be314b4eed642c3b2c72fe115860220',uuid=9dd6bff7-c612-44cb-a1f2-9e1b26f5f342,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc", "address": "fa:16:3e:89:83:47", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e0cbc1d-c7", "ovs_interfaceid": "1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 02:03:20.065843 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converting VIF {"id": "1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc", "address": "fa:16:3e:89:83:47", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e0cbc1d-c7", "ovs_interfaceid": "1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:03:20.065843 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:83:47,bridge_name='br-int',has_traffic_filtering=True,id=1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e0cbc1d-c7') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:03:20.065843 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:83:47,bridge_name='br-int',has_traffic_filtering=True,id=1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e0cbc1d-c7') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 02:03:20.065843 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:20.065843 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:03:20.066651 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 02:03:20.066864 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:20.067073 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bca7f28b-2e67-595e-9f7c-759a6417a180', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:03:20.069867 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:03:20.072101 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:20.072248 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e0cbc1d-c7, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:03:20.072648 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1e0cbc1d-c7, col_values=(('qos', UUID('f66eddf1-e196-4c54-ac13-fbd33c3b62c1')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:03:20.072855 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1e0cbc1d-c7, col_values=(('external_ids', {'iface-id': '1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:83:47', 'vm-uuid': '9dd6bff7-c612-44cb-a1f2-9e1b26f5f342'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:03:20.076593 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:03:20.082298 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:20.082782 np0000001583 nova-compute[98241]: INFO os_vif [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:83:47,bridge_name='br-int',has_traffic_filtering=True,id=1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e0cbc1d-c7')
May 28 02:03:20.193497 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:03:20.260993 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-af8b4a2b-107b-4eeb-8efb-62b235a74bc8 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:03:20.303747 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-c5f2682d-7282-4a5c-a8b1-d71f087aa463 req-444fee67-0011-4ba2-9d8a-dded948ff2af service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:03:20.629144 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-c5f2682d-7282-4a5c-a8b1-d71f087aa463 req-444fee67-0011-4ba2-9d8a-dded948ff2af service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:03:20.703407 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:20.768214 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-af8b4a2b-107b-4eeb-8efb-62b235a74bc8 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.585s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:20.769405 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.065s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:20.770239 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:20.770488 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Auditing locally available compute resources for np0000001583 (node: np0000001583) {{(pid=98241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 02:03:20.800694 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-c5f2682d-7282-4a5c-a8b1-d71f087aa463 req-444fee67-0011-4ba2-9d8a-dded948ff2af service nova] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Updated VIF entry in instance network info cache for port 4ff6f19c-9ecc-4ac9-a37b-a99bde59db2d. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:03:20.801535 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-c5f2682d-7282-4a5c-a8b1-d71f087aa463 req-444fee67-0011-4ba2-9d8a-dded948ff2af service nova] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Updating instance_info_cache with network_info: [{"id": "4ff6f19c-9ecc-4ac9-a37b-a99bde59db2d", "address": "fa:16:3e:92:00:c4", "network": {"id": "59a17812-47e4-4787-a775-e18f05e4d2ec", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1023256595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7849e9703e1345b9826a90dc99756d77", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff6f19c-9e", "ovs_interfaceid": "4ff6f19c-9ecc-4ac9-a37b-a99bde59db2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:03:20.845309 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-af8b4a2b-107b-4eeb-8efb-62b235a74bc8 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Deleted allocations for instance e00f21c6-ce7c-4e23-94e2-7f415ae7a9be
May 28 02:03:21.303464 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c5f2682d-7282-4a5c-a8b1-d71f087aa463 req-444fee67-0011-4ba2-9d8a-dded948ff2af service nova] Releasing lock "refresh_cache-9a804913-4bfb-4dba-9efe-cbf7c575d8d1" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:03:21.475234 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-671a4cd3-b2c4-4a4e-a123-28e38166a0f4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "21c4e225-440e-4103-adaf-cb470d172291" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:21.475234 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-671a4cd3-b2c4-4a4e-a123-28e38166a0f4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "21c4e225-440e-4103-adaf-cb470d172291" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:21.475234 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-671a4cd3-b2c4-4a4e-a123-28e38166a0f4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "21c4e225-440e-4103-adaf-cb470d172291-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:21.475234 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-671a4cd3-b2c4-4a4e-a123-28e38166a0f4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "21c4e225-440e-4103-adaf-cb470d172291-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:21.475234 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-671a4cd3-b2c4-4a4e-a123-28e38166a0f4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "21c4e225-440e-4103-adaf-cb470d172291-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:21.477287 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-671a4cd3-b2c4-4a4e-a123-28e38166a0f4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Terminating instance
May 28 02:03:21.616424 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:03:21.616646 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:03:21.616695 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] No VIF found with MAC fa:16:3e:89:83:47, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:03:21.617281 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Using config drive
May 28 02:03:21.835100 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:03:21.861592 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-af8b4a2b-107b-4eeb-8efb-62b235a74bc8 tempest-AttachVolumeTestJSON-1276932129 tempest-AttachVolumeTestJSON-1276932129-project-member] Lock "e00f21c6-ce7c-4e23-94e2-7f415ae7a9be" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.773s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:21.929415 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:03:21.930144 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:03:21.981893 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-671a4cd3-b2c4-4a4e-a123-28e38166a0f4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 02:03:22.007436 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:22.013846 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:22.035366 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:22.039585 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:03:22.043953 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e9a0d0-72cd-459e-8bc4-cf080adb5267/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:03:22.127109 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:03:22.143271 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e9a0d0-72cd-459e-8bc4-cf080adb5267/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:03:22.144161 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e9a0d0-72cd-459e-8bc4-cf080adb5267/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:03:22.192855 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-bd58732d-8e52-4930-8073-0832b1cfe976 req-c4d85700-e840-4f07-97f4-66814d5469c3 service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Received event network-vif-unplugged-5e52242f-77f4-41cc-ae8f-6a4772243727 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:03:22.193389 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bd58732d-8e52-4930-8073-0832b1cfe976 req-c4d85700-e840-4f07-97f4-66814d5469c3 service nova] Acquiring lock "21c4e225-440e-4103-adaf-cb470d172291-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:22.193768 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bd58732d-8e52-4930-8073-0832b1cfe976 req-c4d85700-e840-4f07-97f4-66814d5469c3 service nova] Lock "21c4e225-440e-4103-adaf-cb470d172291-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:22.194875 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bd58732d-8e52-4930-8073-0832b1cfe976 req-c4d85700-e840-4f07-97f4-66814d5469c3 service nova] Lock "21c4e225-440e-4103-adaf-cb470d172291-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:22.194875 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-bd58732d-8e52-4930-8073-0832b1cfe976 req-c4d85700-e840-4f07-97f4-66814d5469c3 service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] No waiting events found dispatching network-vif-unplugged-5e52242f-77f4-41cc-ae8f-6a4772243727 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:03:22.194875 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-bd58732d-8e52-4930-8073-0832b1cfe976 req-c4d85700-e840-4f07-97f4-66814d5469c3 service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Received event network-vif-unplugged-5e52242f-77f4-41cc-ae8f-6a4772243727 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:03:22.197781 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:22.209818 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:22.251535 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e9a0d0-72cd-459e-8bc4-cf080adb5267/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:03:22.267013 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bbb8cf-c11d-4025-8551-4c1c3557264a/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:03:22.342488 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.99932270599993 future=<Future at 0x7724f83ebc50 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:03:22.349323 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Instance destroyed successfully.
May 28 02:03:22.350149 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-671a4cd3-b2c4-4a4e-a123-28e38166a0f4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lazy-loading 'resources' on Instance uuid 21c4e225-440e-4103-adaf-cb470d172291 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:03:22.372497 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Creating config drive at /opt/stack/data/nova/instances/9dd6bff7-c612-44cb-a1f2-9e1b26f5f342/disk.config
May 28 02:03:22.376831 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9dd6bff7-c612-44cb-a1f2-9e1b26f5f342/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbzxkflyw {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:03:22.395402 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bbb8cf-c11d-4025-8551-4c1c3557264a/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:03:22.397731 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bbb8cf-c11d-4025-8551-4c1c3557264a/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:03:22.448751 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9dd6bff7-c612-44cb-a1f2-9e1b26f5f342/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbzxkflyw" returned: 0 in 0.071s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:03:22.498743 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bbb8cf-c11d-4025-8551-4c1c3557264a/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:03:22.508816 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f15126e-6636-4765-8650-bb717f186efe/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:03:22.627247 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f15126e-6636-4765-8650-bb717f186efe/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:03:22.628422 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f15126e-6636-4765-8650-bb717f186efe/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:03:22.727014 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f15126e-6636-4765-8650-bb717f186efe/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:03:22.730552 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/dm-7 (vdb) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 02:03:22.734718 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:03:22.824344 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:03:22.824901 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:03:22.855572 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-671a4cd3-b2c4-4a4e-a123-28e38166a0f4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T02:00:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001583',hostname='multiattach-server-1',id=42,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAP7CI9wuY8JR5OGc0CpqFzQg3rj7cqVgHC4sPYHH38XlmtTRa9WHg3S3WcIsSpd43tWEYYLHF1/yDpoSsozR5Hrjk+cgmLbTDwUHC3YheiC8VnlV/ymBtBFe0b8oxSz5w==',key_name='tempest-keypair-1713929294',keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:02:01Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0474090f4f2d4950b51bc317f4302266',ramdisk_id='',reservation_id='r-wetp7mrk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-857456921',owner_user_name='tempest-AttachVolumeMultiAttachTest-857456921-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T02:02:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cadb612e41314b06914d5f5f47570e98',uuid=21c4e225-440e-4103-adaf-cb470d172291,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e52242f-77f4-41cc-ae8f-6a4772243727", "address": "fa:16:3e:57:95:02", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e52242f-77", "ovs_interfaceid": "5e52242f-77f4-41cc-ae8f-6a4772243727", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:03:22.856069 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-671a4cd3-b2c4-4a4e-a123-28e38166a0f4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Converting VIF {"id": "5e52242f-77f4-41cc-ae8f-6a4772243727", "address": "fa:16:3e:57:95:02", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e52242f-77", "ovs_interfaceid": "5e52242f-77f4-41cc-ae8f-6a4772243727", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:03:22.857271 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-671a4cd3-b2c4-4a4e-a123-28e38166a0f4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:95:02,bridge_name='br-int',has_traffic_filtering=True,id=5e52242f-77f4-41cc-ae8f-6a4772243727,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e52242f-77') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:03:22.857679 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-671a4cd3-b2c4-4a4e-a123-28e38166a0f4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:95:02,bridge_name='br-int',has_traffic_filtering=True,id=5e52242f-77f4-41cc-ae8f-6a4772243727,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e52242f-77') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:03:22.861974 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:22.862688 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e52242f-77, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:03:22.864636 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:22.865941 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:03:22.870688 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:22.871913 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:22.872184 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1f271f25-29a1-48ee-a452-a70be9504532) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:03:22.872716 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:22.873375 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:03:22.879169 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:22.885213 np0000001583 nova-compute[98241]: INFO os_vif [None req-671a4cd3-b2c4-4a4e-a123-28e38166a0f4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:95:02,bridge_name='br-int',has_traffic_filtering=True,id=5e52242f-77f4-41cc-ae8f-6a4772243727,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e52242f-77')
May 28 02:03:22.885622 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-671a4cd3-b2c4-4a4e-a123-28e38166a0f4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Deleting instance files /opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291_del
May 28 02:03:22.895736 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-671a4cd3-b2c4-4a4e-a123-28e38166a0f4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Deletion of /opt/stack/data/nova/instances/21c4e225-440e-4103-adaf-cb470d172291_del complete
May 28 02:03:22.927581 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:22.940129 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:03:22.949106 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 02:03:22.949539 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:22.952808 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:22.955488 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/dm-4 (vda) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 02:03:22.957563 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a804913-4bfb-4dba-9efe-cbf7c575d8d1/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:03:23.051770 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:23.057905 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a804913-4bfb-4dba-9efe-cbf7c575d8d1/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:03:23.061098 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a804913-4bfb-4dba-9efe-cbf7c575d8d1/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:03:23.098584 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:23.153797 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a804913-4bfb-4dba-9efe-cbf7c575d8d1/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:03:23.163800 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 02:03:23.171944 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:03:23.175262 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:03:23.222942 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.049s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:03:23.225711 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Hypervisor/Node resource view: name=np0000001583 free_ram=11279MB free_disk=73.68331146240234GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 02:03:23.225711 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:23.225711 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:23.226754 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:23.293196 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-94893116-27ab-4919-95c3-4b54b552e332 req-c7646da3-4de2-464e-93bf-2a04c4119542 service nova] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Received event network-vif-plugged-1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:03:23.293536 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-94893116-27ab-4919-95c3-4b54b552e332 req-c7646da3-4de2-464e-93bf-2a04c4119542 service nova] Acquiring lock "9dd6bff7-c612-44cb-a1f2-9e1b26f5f342-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:23.294973 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-94893116-27ab-4919-95c3-4b54b552e332 req-c7646da3-4de2-464e-93bf-2a04c4119542 service nova] Lock "9dd6bff7-c612-44cb-a1f2-9e1b26f5f342-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:23.295177 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-94893116-27ab-4919-95c3-4b54b552e332 req-c7646da3-4de2-464e-93bf-2a04c4119542 service nova] Lock "9dd6bff7-c612-44cb-a1f2-9e1b26f5f342-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:23.295321 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-94893116-27ab-4919-95c3-4b54b552e332 req-c7646da3-4de2-464e-93bf-2a04c4119542 service nova] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Processing event network-vif-plugged-1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 02:03:23.325291 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:23.407517 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-671a4cd3-b2c4-4a4e-a123-28e38166a0f4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Took 1.43 seconds to destroy the instance on the hypervisor.
May 28 02:03:23.408349 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-671a4cd3-b2c4-4a4e-a123-28e38166a0f4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 02:03:23.408562 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 02:03:23.408659 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 21c4e225-440e-4103-adaf-cb470d172291] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 02:03:23.409136 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:03:23.491105 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:03:23.873338 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933803.872816, 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:03:23.873887 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 02:03:23.874174 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] VM Started (Lifecycle Event)
May 28 02:03:23.878176 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 02:03:23.881484 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Instance spawned successfully.
May 28 02:03:23.881864 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 02:03:23.885375 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:03:23.885918 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:03:24.268569 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0999b2a3-130f-4a3b-90c9-6cab5e2acc8f req-73722b2b-301e-43d1-b06a-250f30ee4f2a service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Received event network-vif-unplugged-5e52242f-77f4-41cc-ae8f-6a4772243727 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:03:24.268754 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0999b2a3-130f-4a3b-90c9-6cab5e2acc8f req-73722b2b-301e-43d1-b06a-250f30ee4f2a service nova] Acquiring lock "21c4e225-440e-4103-adaf-cb470d172291-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:24.268830 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0999b2a3-130f-4a3b-90c9-6cab5e2acc8f req-73722b2b-301e-43d1-b06a-250f30ee4f2a service nova] Lock "21c4e225-440e-4103-adaf-cb470d172291-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:24.269005 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0999b2a3-130f-4a3b-90c9-6cab5e2acc8f req-73722b2b-301e-43d1-b06a-250f30ee4f2a service nova] Lock "21c4e225-440e-4103-adaf-cb470d172291-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:24.271528 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0999b2a3-130f-4a3b-90c9-6cab5e2acc8f req-73722b2b-301e-43d1-b06a-250f30ee4f2a service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] No waiting events found dispatching network-vif-unplugged-5e52242f-77f4-41cc-ae8f-6a4772243727 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:03:24.271747 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0999b2a3-130f-4a3b-90c9-6cab5e2acc8f req-73722b2b-301e-43d1-b06a-250f30ee4f2a service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Received event network-vif-unplugged-5e52242f-77f4-41cc-ae8f-6a4772243727 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:03:24.300595 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance e50227a8-b484-447b-abc6-3a3c1379e7ff actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:03:24.300791 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 22bbb8cf-c11d-4025-8551-4c1c3557264a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:03:24.300944 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance e3e9a0d0-72cd-459e-8bc4-cf080adb5267 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:03:24.301073 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 8b2a5f31-1b3d-447f-939e-94fd0be5eb85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:03:24.301200 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 21c4e225-440e-4103-adaf-cb470d172291 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:03:24.301316 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 1f15126e-6636-4765-8650-bb717f186efe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:03:24.301418 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 52013bcc-3652-4009-871a-ae37e6ed1c69 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:03:24.301522 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 9a804913-4bfb-4dba-9efe-cbf7c575d8d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:03:24.301625 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:03:24.301857 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 02:03:24.302036 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Final resource view: name=np0000001583 phys_ram=24030MB used_ram=2368MB phys_disk=95GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:03:23 up 39 min,  2 users,  load average: 6.96, 7.50, 4.97\n', 'num_instances': '9', 'num_vm_active': '8', 'num_task_None': '7', 'num_os_type_None': '9', 'num_proj_0474090f4f2d4950b51bc317f4302266': '5', 'io_workload': '1', 'num_proj_ae04c11a3de34d419d69e1fdf4c7d311': '1', 'num_proj_432aa1094ced436494def17a875aa8e1': '2', 'num_proj_7849e9703e1345b9826a90dc99756d77': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_task_deleting': '1'} {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 02:03:24.380789 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:03:24.384225 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:03:24.390448 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Took 8.42 seconds to spawn the instance on the hypervisor.
May 28 02:03:24.390618 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:03:24.474798 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:03:24.887450 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 02:03:24.887933 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933804.8875406, 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:03:24.888742 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] VM Paused (Lifecycle Event)
May 28 02:03:24.900228 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:03:24.902747 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:03:24.904656 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Took 19.22 seconds to build instance.
May 28 02:03:24.981852 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Took 1.57 seconds to deallocate network for instance.
May 28 02:03:25.395967 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b6c325e7-5f46-42e5-8990-79d430b0ea4c req-a11c31f9-10b3-4a70-9195-9f3e641d8752 service nova] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Received event network-vif-plugged-1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:03:25.396943 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b6c325e7-5f46-42e5-8990-79d430b0ea4c req-a11c31f9-10b3-4a70-9195-9f3e641d8752 service nova] Acquiring lock "9dd6bff7-c612-44cb-a1f2-9e1b26f5f342-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:25.397727 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b6c325e7-5f46-42e5-8990-79d430b0ea4c req-a11c31f9-10b3-4a70-9195-9f3e641d8752 service nova] Lock "9dd6bff7-c612-44cb-a1f2-9e1b26f5f342-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:25.398487 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b6c325e7-5f46-42e5-8990-79d430b0ea4c req-a11c31f9-10b3-4a70-9195-9f3e641d8752 service nova] Lock "9dd6bff7-c612-44cb-a1f2-9e1b26f5f342-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:25.399267 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b6c325e7-5f46-42e5-8990-79d430b0ea4c req-a11c31f9-10b3-4a70-9195-9f3e641d8752 service nova] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] No waiting events found dispatching network-vif-plugged-1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:03:25.400024 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-b6c325e7-5f46-42e5-8990-79d430b0ea4c req-a11c31f9-10b3-4a70-9195-9f3e641d8752 service nova] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Received unexpected event network-vif-plugged-1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc for instance with vm_state active and task_state None.
May 28 02:03:25.400704 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b6c325e7-5f46-42e5-8990-79d430b0ea4c req-a11c31f9-10b3-4a70-9195-9f3e641d8752 service nova] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Received event network-vif-deleted-5e52242f-77f4-41cc-ae8f-6a4772243727 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:03:25.402452 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:03:25.405601 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933805.4053278, 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:03:25.405725 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] VM Resumed (Lifecycle Event)
May 28 02:03:25.409474 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:03:25.415187 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "9dd6bff7-c612-44cb-a1f2-9e1b26f5f342" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.735s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:25.489855 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-671a4cd3-b2c4-4a4e-a123-28e38166a0f4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:25.908495 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:03:25.911896 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:03:25.919102 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Compute_service record updated for np0000001583:np0000001583 {{(pid=98241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 02:03:25.919102 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.694s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:25.919511 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-671a4cd3-b2c4-4a4e-a123-28e38166a0f4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.429s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:25.920226 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:03:26.032824 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2961eb7d-a3e6-4ab1-9f20-464d64e9bf61 req-0dab6420-5544-48c4-8888-d1bebfe43944 service nova] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Received event network-changed-1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:03:26.033223 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2961eb7d-a3e6-4ab1-9f20-464d64e9bf61 req-0dab6420-5544-48c4-8888-d1bebfe43944 service nova] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Refreshing instance network info cache due to event network-changed-1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:03:26.033500 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2961eb7d-a3e6-4ab1-9f20-464d64e9bf61 req-0dab6420-5544-48c4-8888-d1bebfe43944 service nova] Acquiring lock "refresh_cache-9dd6bff7-c612-44cb-a1f2-9e1b26f5f342" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:03:26.033665 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2961eb7d-a3e6-4ab1-9f20-464d64e9bf61 req-0dab6420-5544-48c4-8888-d1bebfe43944 service nova] Acquired lock "refresh_cache-9dd6bff7-c612-44cb-a1f2-9e1b26f5f342" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:03:26.033845 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-2961eb7d-a3e6-4ab1-9f20-464d64e9bf61 req-0dab6420-5544-48c4-8888-d1bebfe43944 service nova] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Refreshing network info cache for port 1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:03:26.074278 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0004584660000546137 future=<Future at 0x7724f844c7d0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:03:26.075099 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Emitting event <LifecycleEvent: 1779933791.0736783, ef2472b3-00d4-4d9d-8ebc-266857e4b91d => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:03:26.075364 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:03:26.075766 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] VM Stopped (Lifecycle Event)
May 28 02:03:26.076394 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=5.3346544580003865 future=<Future at 0x7724ec2d03b0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:03:26.077323 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=5.333714576000148 future=<Future at 0x7724ec2d03b0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:03:26.253823 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:26.540070 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-2961eb7d-a3e6-4ab1-9f20-464d64e9bf61 req-0dab6420-5544-48c4-8888-d1bebfe43944 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:03:26.542540 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-671a4cd3-b2c4-4a4e-a123-28e38166a0f4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:03:26.542721 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-671a4cd3-b2c4-4a4e-a123-28e38166a0f4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:03:26.578757 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: ef2472b3-00d4-4d9d-8ebc-266857e4b91d] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:03:26.915487 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:03:26.917705 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:03:26.917705 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:03:26.917705 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:03:26.917705 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:03:26.917705 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:03:26.917705 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 02:03:26.917705 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 51.28 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:03:26.937638 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-2961eb7d-a3e6-4ab1-9f20-464d64e9bf61 req-0dab6420-5544-48c4-8888-d1bebfe43944 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:03:27.047269 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-671a4cd3-b2c4-4a4e-a123-28e38166a0f4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:03:27.134312 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-2961eb7d-a3e6-4ab1-9f20-464d64e9bf61 req-0dab6420-5544-48c4-8888-d1bebfe43944 service nova] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Updated VIF entry in instance network info cache for port 1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:03:27.134613 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-2961eb7d-a3e6-4ab1-9f20-464d64e9bf61 req-0dab6420-5544-48c4-8888-d1bebfe43944 service nova] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Updating instance_info_cache with network_info: [{"id": "1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc", "address": "fa:16:3e:89:83:47", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e0cbc1d-c7", "ovs_interfaceid": "1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:03:27.555636 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-671a4cd3-b2c4-4a4e-a123-28e38166a0f4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.636s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:27.634739 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-671a4cd3-b2c4-4a4e-a123-28e38166a0f4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Deleted allocations for instance 21c4e225-440e-4103-adaf-cb470d172291
May 28 02:03:27.639622 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2961eb7d-a3e6-4ab1-9f20-464d64e9bf61 req-0dab6420-5544-48c4-8888-d1bebfe43944 service nova] Releasing lock "refresh_cache-9dd6bff7-c612-44cb-a1f2-9e1b26f5f342" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:03:27.873202 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:28.327413 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:28.651760 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-671a4cd3-b2c4-4a4e-a123-28e38166a0f4 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "21c4e225-440e-4103-adaf-cb470d172291" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.177s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:28.666883 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:28.954137 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d6503689-6127-472f-8c71-03ebd8be2878 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "8b2a5f31-1b3d-447f-939e-94fd0be5eb85" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:28.954379 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d6503689-6127-472f-8c71-03ebd8be2878 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "8b2a5f31-1b3d-447f-939e-94fd0be5eb85" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:28.954621 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d6503689-6127-472f-8c71-03ebd8be2878 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "8b2a5f31-1b3d-447f-939e-94fd0be5eb85-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:28.954826 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d6503689-6127-472f-8c71-03ebd8be2878 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "8b2a5f31-1b3d-447f-939e-94fd0be5eb85-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:28.955006 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d6503689-6127-472f-8c71-03ebd8be2878 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "8b2a5f31-1b3d-447f-939e-94fd0be5eb85-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:28.958137 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-d6503689-6127-472f-8c71-03ebd8be2878 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Terminating instance
May 28 02:03:29.270094 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Acquiring lock "ea390d12-4b20-4d31-9dc6-ec47b983ebfa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:29.270281 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Lock "ea390d12-4b20-4d31-9dc6-ec47b983ebfa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:29.466722 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-d6503689-6127-472f-8c71-03ebd8be2878 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 02:03:29.486419 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:29.489504 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:29.509826 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:29.651325 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-8875d6e2-2b39-4c42-9473-1985f7dce97e req-cccb215b-7608-460e-a1bd-1915f0b6c906 service nova] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Received event network-vif-unplugged-77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:03:29.651325 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-8875d6e2-2b39-4c42-9473-1985f7dce97e req-cccb215b-7608-460e-a1bd-1915f0b6c906 service nova] Acquiring lock "8b2a5f31-1b3d-447f-939e-94fd0be5eb85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:29.651325 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-8875d6e2-2b39-4c42-9473-1985f7dce97e req-cccb215b-7608-460e-a1bd-1915f0b6c906 service nova] Lock "8b2a5f31-1b3d-447f-939e-94fd0be5eb85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:29.651325 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-8875d6e2-2b39-4c42-9473-1985f7dce97e req-cccb215b-7608-460e-a1bd-1915f0b6c906 service nova] Lock "8b2a5f31-1b3d-447f-939e-94fd0be5eb85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:29.651325 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-8875d6e2-2b39-4c42-9473-1985f7dce97e req-cccb215b-7608-460e-a1bd-1915f0b6c906 service nova] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] No waiting events found dispatching network-vif-unplugged-77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:03:29.651877 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-8875d6e2-2b39-4c42-9473-1985f7dce97e req-cccb215b-7608-460e-a1bd-1915f0b6c906 service nova] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Received event network-vif-unplugged-77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:03:29.653496 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:29.660569 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:29.774502 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 02:03:29.805320 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999667003000013 future=<Future at 0x7724ec262000 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:03:29.807903 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Instance destroyed successfully.
May 28 02:03:29.808658 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-d6503689-6127-472f-8c71-03ebd8be2878 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lazy-loading 'resources' on Instance uuid 8b2a5f31-1b3d-447f-939e-94fd0be5eb85 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:03:30.317028 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-d6503689-6127-472f-8c71-03ebd8be2878 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:59:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001583',hostname='multiattach-server-0',id=40,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAP7CI9wuY8JR5OGc0CpqFzQg3rj7cqVgHC4sPYHH38XlmtTRa9WHg3S3WcIsSpd43tWEYYLHF1/yDpoSsozR5Hrjk+cgmLbTDwUHC3YheiC8VnlV/ymBtBFe0b8oxSz5w==',key_name='tempest-keypair-1713929294',keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:01:06Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0474090f4f2d4950b51bc317f4302266',ramdisk_id='',reservation_id='r-rozqlw8g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-857456921',owner_user_name='tempest-AttachVolumeMultiAttachTest-857456921-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T02:01:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cadb612e41314b06914d5f5f47570e98',uuid=8b2a5f31-1b3d-447f-939e-94fd0be5eb85,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0", "address": "fa:16:3e:76:c5:3f", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77a0d5b8-3f", "ovs_interfaceid": "77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:03:30.317249 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-d6503689-6127-472f-8c71-03ebd8be2878 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Converting VIF {"id": "77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0", "address": "fa:16:3e:76:c5:3f", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77a0d5b8-3f", "ovs_interfaceid": "77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:03:30.317882 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-d6503689-6127-472f-8c71-03ebd8be2878 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:c5:3f,bridge_name='br-int',has_traffic_filtering=True,id=77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77a0d5b8-3f') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:03:30.318184 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-d6503689-6127-472f-8c71-03ebd8be2878 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:c5:3f,bridge_name='br-int',has_traffic_filtering=True,id=77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77a0d5b8-3f') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:03:30.322175 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:30.323146 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap77a0d5b8-3f, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:03:30.324310 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:30.325184 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:03:30.325677 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:30.328610 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:30.328860 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e42db62b-e1d0-42aa-bad5-f9d081167754) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:03:30.329968 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:30.330931 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:03:30.333627 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:30.333793 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:30.334793 np0000001583 nova-compute[98241]: INFO os_vif [None req-d6503689-6127-472f-8c71-03ebd8be2878 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:c5:3f,bridge_name='br-int',has_traffic_filtering=True,id=77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77a0d5b8-3f')
May 28 02:03:30.335275 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-d6503689-6127-472f-8c71-03ebd8be2878 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Deleting instance files /opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85_del
May 28 02:03:30.338755 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 02:03:30.338933 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Claim successful on node np0000001583
May 28 02:03:30.345105 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-d6503689-6127-472f-8c71-03ebd8be2878 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Deletion of /opt/stack/data/nova/instances/8b2a5f31-1b3d-447f-939e-94fd0be5eb85_del complete
May 28 02:03:30.857525 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-d6503689-6127-472f-8c71-03ebd8be2878 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Took 1.39 seconds to destroy the instance on the hypervisor.
May 28 02:03:30.858098 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-d6503689-6127-472f-8c71-03ebd8be2878 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 02:03:30.858429 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 02:03:30.858600 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 02:03:30.858859 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:03:30.991455 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:03:31.317682 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-dbf4d0dc-49d8-4c8c-97fe-36e1f7e1ff55 req-60628689-2876-4d91-8cf5-e661b96373fc service nova] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Received event network-vif-deleted-77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:03:31.317885 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-dbf4d0dc-49d8-4c8c-97fe-36e1f7e1ff55 req-60628689-2876-4d91-8cf5-e661b96373fc service nova] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Neutron deleted interface 77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0; detaching it from the instance and deleting it from the info cache
May 28 02:03:31.324107 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-dbf4d0dc-49d8-4c8c-97fe-36e1f7e1ff55 req-60628689-2876-4d91-8cf5-e661b96373fc service nova] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Detach interface failed, port_id=77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0, reason: Instance 8b2a5f31-1b3d-447f-939e-94fd0be5eb85 could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 02:03:31.413599 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0024499699998159485 future=<Future at 0x7724ec2d03b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:03:31.413667 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:03:31.413761 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=5.927998543000285 future=<Future at 0x7724f83ebc50 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:03:31.415658 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=5.927834227999938 future=<Future at 0x7724f83ebc50 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:03:31.415658 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Emitting event <LifecycleEvent: 1779933796.4109619, e00f21c6-ce7c-4e23-94e2-7f415ae7a9be => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:03:31.415658 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] VM Stopped (Lifecycle Event)
May 28 02:03:31.725663 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-15102e23-b69c-4a48-bc51-142231917a0b req-6948a629-fccf-431c-b46a-423f3be5a138 service nova] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Received event network-vif-unplugged-77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:03:31.725870 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-15102e23-b69c-4a48-bc51-142231917a0b req-6948a629-fccf-431c-b46a-423f3be5a138 service nova] Acquiring lock "8b2a5f31-1b3d-447f-939e-94fd0be5eb85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:31.726204 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-15102e23-b69c-4a48-bc51-142231917a0b req-6948a629-fccf-431c-b46a-423f3be5a138 service nova] Lock "8b2a5f31-1b3d-447f-939e-94fd0be5eb85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:31.726265 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-15102e23-b69c-4a48-bc51-142231917a0b req-6948a629-fccf-431c-b46a-423f3be5a138 service nova] Lock "8b2a5f31-1b3d-447f-939e-94fd0be5eb85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:31.726376 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-15102e23-b69c-4a48-bc51-142231917a0b req-6948a629-fccf-431c-b46a-423f3be5a138 service nova] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] No waiting events found dispatching network-vif-unplugged-77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:03:31.726501 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-15102e23-b69c-4a48-bc51-142231917a0b req-6948a629-fccf-431c-b46a-423f3be5a138 service nova] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Received event network-vif-unplugged-77a0d5b8-3f40-4a30-b95d-a40bb11ae0c0 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:03:31.752728 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:03:31.881692 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:03:31.882251 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:03:31.917992 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: e00f21c6-ce7c-4e23-94e2-7f415ae7a9be] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:03:32.256186 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Took 1.40 seconds to deallocate network for instance.
May 28 02:03:32.384747 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:03:32.763242 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d6503689-6127-472f-8c71-03ebd8be2878 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:32.892319 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.558s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:32.893132 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d6503689-6127-472f-8c71-03ebd8be2878 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.129s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:32.893325 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 02:03:33.328565 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:33.403137 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 02:03:33.406108 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 02:03:33.406715 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:03:33.407028 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:03:33.413138 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-d6503689-6127-472f-8c71-03ebd8be2878 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:03:33.413427 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-d6503689-6127-472f-8c71-03ebd8be2878 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:03:33.482514 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bdd7dc60a5d6477e9a120c0dbfd7384e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c38124ed2774a80a79d62c26d43f4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 02:03:33.906954 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 02:03:33.916928 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Successfully created port: 400f5579-1db7-476d-b3b5-b6f38a538752 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 02:03:33.919995 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-d6503689-6127-472f-8c71-03ebd8be2878 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:03:34.320408 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:03:34.407707 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 02:03:34.438024 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d6503689-6127-472f-8c71-03ebd8be2878 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.544s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:34.473138 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Successfully updated port: 400f5579-1db7-476d-b3b5-b6f38a538752 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 02:03:34.519040 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-d6503689-6127-472f-8c71-03ebd8be2878 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Deleted allocations for instance 8b2a5f31-1b3d-447f-939e-94fd0be5eb85
May 28 02:03:34.526419 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9b42b6d9-b37c-493f-bebe-da2da2a037e9 req-4838edda-76a2-41d4-8476-9c4f941abc86 service nova] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Received event network-changed-400f5579-1db7-476d-b3b5-b6f38a538752 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:03:34.526419 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9b42b6d9-b37c-493f-bebe-da2da2a037e9 req-4838edda-76a2-41d4-8476-9c4f941abc86 service nova] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Refreshing instance network info cache due to event network-changed-400f5579-1db7-476d-b3b5-b6f38a538752. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:03:34.526419 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9b42b6d9-b37c-493f-bebe-da2da2a037e9 req-4838edda-76a2-41d4-8476-9c4f941abc86 service nova] Acquiring lock "refresh_cache-ea390d12-4b20-4d31-9dc6-ec47b983ebfa" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:03:34.526419 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9b42b6d9-b37c-493f-bebe-da2da2a037e9 req-4838edda-76a2-41d4-8476-9c4f941abc86 service nova] Acquired lock "refresh_cache-ea390d12-4b20-4d31-9dc6-ec47b983ebfa" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:03:34.526419 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-9b42b6d9-b37c-493f-bebe-da2da2a037e9 req-4838edda-76a2-41d4-8476-9c4f941abc86 service nova] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Refreshing network info cache for port 400f5579-1db7-476d-b3b5-b6f38a538752 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:03:34.979102 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Acquiring lock "refresh_cache-ea390d12-4b20-4d31-9dc6-ec47b983ebfa" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:03:35.030822 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-9b42b6d9-b37c-493f-bebe-da2da2a037e9 req-4838edda-76a2-41d4-8476-9c4f941abc86 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:03:35.115521 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-9b42b6d9-b37c-493f-bebe-da2da2a037e9 req-4838edda-76a2-41d4-8476-9c4f941abc86 service nova] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:03:35.295826 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-9b42b6d9-b37c-493f-bebe-da2da2a037e9 req-4838edda-76a2-41d4-8476-9c4f941abc86 service nova] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:03:35.329788 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:35.415070 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 02:03:35.416192 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 02:03:35.416465 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Creating image(s)
May 28 02:03:35.416996 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Acquiring lock "/opt/stack/data/nova/instances/ea390d12-4b20-4d31-9dc6-ec47b983ebfa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:35.417208 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Lock "/opt/stack/data/nova/instances/ea390d12-4b20-4d31-9dc6-ec47b983ebfa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:35.417760 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Lock "/opt/stack/data/nova/instances/ea390d12-4b20-4d31-9dc6-ec47b983ebfa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:35.418414 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:03:35.422308 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:03:35.423380 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:03:35.512281 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.089s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:03:35.512731 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:35.513267 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:35.513727 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:03:35.516068 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:03:35.516480 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:03:35.540924 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d6503689-6127-472f-8c71-03ebd8be2878 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "8b2a5f31-1b3d-447f-939e-94fd0be5eb85" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.586s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:35.626574 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.109s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:03:35.626574 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/ea390d12-4b20-4d31-9dc6-ec47b983ebfa/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:03:35.697988 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/ea390d12-4b20-4d31-9dc6-ec47b983ebfa/disk 1073741824" returned: 0 in 0.071s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:03:35.699519 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.186s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:35.699866 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:03:35.798968 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9b42b6d9-b37c-493f-bebe-da2da2a037e9 req-4838edda-76a2-41d4-8476-9c4f941abc86 service nova] Releasing lock "refresh_cache-ea390d12-4b20-4d31-9dc6-ec47b983ebfa" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:03:35.799735 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Acquired lock "refresh_cache-ea390d12-4b20-4d31-9dc6-ec47b983ebfa" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:03:35.799735 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:03:35.803872 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.103s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:03:35.808273 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ea390d12-4b20-4d31-9dc6-ec47b983ebfa/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 02:03:35.808581 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea390d12-4b20-4d31-9dc6-ec47b983ebfa/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:03:35.905714 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea390d12-4b20-4d31-9dc6-ec47b983ebfa/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:03:35.907175 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Cannot resize image /opt/stack/data/nova/instances/ea390d12-4b20-4d31-9dc6-ec47b983ebfa/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 02:03:35.908692 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 02:03:35.909485 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Ensure instance console log exists: /opt/stack/data/nova/instances/ea390d12-4b20-4d31-9dc6-ec47b983ebfa/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 02:03:35.912252 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:35.913719 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:35.914486 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:36.374818 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:03:36.557690 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:03:36.715534 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Updating instance_info_cache with network_info: [{"id": "400f5579-1db7-476d-b3b5-b6f38a538752", "address": "fa:16:3e:87:07:3c", "network": {"id": "759a6e43-6d1b-44d5-92ea-4f798fb303e0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1542618898-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c38124ed2774a80a79d62c26d43f4da", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap400f5579-1d", "ovs_interfaceid": "400f5579-1db7-476d-b3b5-b6f38a538752", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:03:37.219948 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Releasing lock "refresh_cache-ea390d12-4b20-4d31-9dc6-ec47b983ebfa" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:03:37.220446 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Instance network_info: |[{"id": "400f5579-1db7-476d-b3b5-b6f38a538752", "address": "fa:16:3e:87:07:3c", "network": {"id": "759a6e43-6d1b-44d5-92ea-4f798fb303e0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1542618898-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c38124ed2774a80a79d62c26d43f4da", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap400f5579-1d", "ovs_interfaceid": "400f5579-1db7-476d-b3b5-b6f38a538752", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 02:03:37.225476 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Start _get_guest_xml network_info=[{"id": "400f5579-1db7-476d-b3b5-b6f38a538752", "address": "fa:16:3e:87:07:3c", "network": {"id": "759a6e43-6d1b-44d5-92ea-4f798fb303e0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1542618898-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c38124ed2774a80a79d62c26d43f4da", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap400f5579-1d", "ovs_interfaceid": "400f5579-1db7-476d-b3b5-b6f38a538752", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 02:03:37.240657 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:03:37.244846 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-998452386', uuid='ea390d12-4b20-4d31-9dc6-ec47b983ebfa'), owner=OwnerMeta(userid='bdd7dc60a5d6477e9a120c0dbfd7384e', username='tempest-VolumesActionsTest-1125296363-project-member', projectid='1c38124ed2774a80a79d62c26d43f4da', projectname='tempest-VolumesActionsTest-1125296363'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "400f5579-1db7-476d-b3b5-b6f38a538752", "address": "fa:16:3e:87:07:3c", "network": {"id": "759a6e43-6d1b-44d5-92ea-4f798fb303e0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1542618898-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c38124ed2774a80a79d62c26d43f4da", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap400f5579-1d", "ovs_interfaceid": "400f5579-1db7-476d-b3b5-b6f38a538752", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933817.243255) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 02:03:37.248787 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 02:03:37.249941 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 02:03:37.252474 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 02:03:37.253285 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 02:03:37.256449 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 02:03:37.257884 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 02:03:37.258138 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 02:03:37.258635 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 02:03:37.258811 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 02:03:37.258930 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 02:03:37.259036 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 02:03:37.259638 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 02:03:37.259812 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 02:03:37.259942 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 02:03:37.260626 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 02:03:37.260822 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 02:03:37.283057 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:03:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-998452386',display_name='tempest-VolumesActionsTest-instance-998452386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-volumesactionstest-instance-998452386',id=54,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c38124ed2774a80a79d62c26d43f4da',ramdisk_id='',reservation_id='r-xmv1x1to',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1125296363',owner_user_name='tempest-VolumesActionsTest-1125296363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:03:34Z,user_data=None,user_id='bdd7dc60a5d6477e9a120c0dbfd7384e',uuid=ea390d12-4b20-4d31-9dc6-ec47b983ebfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "400f5579-1db7-476d-b3b5-b6f38a538752", "address": "fa:16:3e:87:07:3c", "network": {"id": "759a6e43-6d1b-44d5-92ea-4f798fb303e0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1542618898-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c38124ed2774a80a79d62c26d43f4da", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap400f5579-1d", "ovs_interfaceid": "400f5579-1db7-476d-b3b5-b6f38a538752", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 02:03:37.283360 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Converting VIF {"id": "400f5579-1db7-476d-b3b5-b6f38a538752", "address": "fa:16:3e:87:07:3c", "network": {"id": "759a6e43-6d1b-44d5-92ea-4f798fb303e0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1542618898-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c38124ed2774a80a79d62c26d43f4da", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap400f5579-1d", "ovs_interfaceid": "400f5579-1db7-476d-b3b5-b6f38a538752", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:03:37.284848 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:07:3c,bridge_name='br-int',has_traffic_filtering=True,id=400f5579-1db7-476d-b3b5-b6f38a538752,network=Network(759a6e43-6d1b-44d5-92ea-4f798fb303e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap400f5579-1d') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:03:37.286419 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Lazy-loading 'pci_devices' on Instance uuid ea390d12-4b20-4d31-9dc6-ec47b983ebfa {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:03:37.342315 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0005014519997530442 future=<Future at 0x7724f83ebc50 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:03:37.342435 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:03:37.344531 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=7.4623997300000156 future=<Future at 0x7724ec262000 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:03:37.344531 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=7.462320742999964 future=<Future at 0x7724ec262000 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:03:37.344531 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Emitting event <LifecycleEvent: 1779933802.3416708, 21c4e225-440e-4103-adaf-cb470d172291 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:03:37.344531 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] VM Stopped (Lifecycle Event)
May 28 02:03:37.461096 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f2636d04-da6c-4b06-91c5-6c6ba0dbc3f2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "e3e9a0d0-72cd-459e-8bc4-cf080adb5267" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:37.461603 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f2636d04-da6c-4b06-91c5-6c6ba0dbc3f2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "e3e9a0d0-72cd-459e-8bc4-cf080adb5267" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:37.461603 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f2636d04-da6c-4b06-91c5-6c6ba0dbc3f2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "e3e9a0d0-72cd-459e-8bc4-cf080adb5267-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:37.461672 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f2636d04-da6c-4b06-91c5-6c6ba0dbc3f2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "e3e9a0d0-72cd-459e-8bc4-cf080adb5267-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:37.461782 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f2636d04-da6c-4b06-91c5-6c6ba0dbc3f2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "e3e9a0d0-72cd-459e-8bc4-cf080adb5267-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:37.465013 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-f2636d04-da6c-4b06-91c5-6c6ba0dbc3f2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Terminating instance
May 28 02:03:37.789049 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] End _get_guest_xml xml=<domain type="qemu">
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:   <uuid>ea390d12-4b20-4d31-9dc6-ec47b983ebfa</uuid>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:   <name>instance-00000036</name>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:   <metadata>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:       <nova:name>tempest-VolumesActionsTest-instance-998452386</nova:name>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 02:03:37</nova:creationTime>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:       </nova:image>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:         <nova:user uuid="bdd7dc60a5d6477e9a120c0dbfd7384e">tempest-VolumesActionsTest-1125296363-project-member</nova:user>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:         <nova:project uuid="1c38124ed2774a80a79d62c26d43f4da">tempest-VolumesActionsTest-1125296363</nova:project>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:         <nova:port uuid="400f5579-1db7-476d-b3b5-b6f38a538752">
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:         </nova:port>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:   </metadata>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:     <system>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:       <entry name="serial">ea390d12-4b20-4d31-9dc6-ec47b983ebfa</entry>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:       <entry name="uuid">ea390d12-4b20-4d31-9dc6-ec47b983ebfa</entry>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:     </system>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:   <os>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:   </os>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:   <features>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:     <acpi/>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:     <tcg>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:     </tcg>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:   </features>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:   </cpu>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:   <devices>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/ea390d12-4b20-4d31-9dc6-ec47b983ebfa/disk"/>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:     </disk>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/ea390d12-4b20-4d31-9dc6-ec47b983ebfa/disk.config"/>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:     </disk>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:87:07:3c"/>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:       <target dev="tap400f5579-1d"/>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:     </interface>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/ea390d12-4b20-4d31-9dc6-ec47b983ebfa/console.log" append="off"/>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:     </serial>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:     <video>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:     </video>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:     </rng>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:     </memballoon>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:   </devices>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]: </domain>
May 28 02:03:37.789049 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 02:03:37.792464 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Preparing to wait for external event network-vif-plugged-400f5579-1db7-476d-b3b5-b6f38a538752 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 02:03:37.792464 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Acquiring lock "ea390d12-4b20-4d31-9dc6-ec47b983ebfa-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:37.792464 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Lock "ea390d12-4b20-4d31-9dc6-ec47b983ebfa-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:37.792464 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Lock "ea390d12-4b20-4d31-9dc6-ec47b983ebfa-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:37.792464 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:03:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-998452386',display_name='tempest-VolumesActionsTest-instance-998452386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-volumesactionstest-instance-998452386',id=54,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c38124ed2774a80a79d62c26d43f4da',ramdisk_id='',reservation_id='r-xmv1x1to',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1125296363',owner_user_name='tempest-VolumesActionsTest-1125296363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:03:34Z,user_data=None,user_id='bdd7dc60a5d6477e9a120c0dbfd7384e',uuid=ea390d12-4b20-4d31-9dc6-ec47b983ebfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "400f5579-1db7-476d-b3b5-b6f38a538752", "address": "fa:16:3e:87:07:3c", "network": {"id": "759a6e43-6d1b-44d5-92ea-4f798fb303e0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1542618898-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c38124ed2774a80a79d62c26d43f4da", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap400f5579-1d", "ovs_interfaceid": "400f5579-1db7-476d-b3b5-b6f38a538752", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 02:03:37.792464 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Converting VIF {"id": "400f5579-1db7-476d-b3b5-b6f38a538752", "address": "fa:16:3e:87:07:3c", "network": {"id": "759a6e43-6d1b-44d5-92ea-4f798fb303e0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1542618898-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c38124ed2774a80a79d62c26d43f4da", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap400f5579-1d", "ovs_interfaceid": "400f5579-1db7-476d-b3b5-b6f38a538752", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:03:37.793323 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:07:3c,bridge_name='br-int',has_traffic_filtering=True,id=400f5579-1db7-476d-b3b5-b6f38a538752,network=Network(759a6e43-6d1b-44d5-92ea-4f798fb303e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap400f5579-1d') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:03:37.794364 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:07:3c,bridge_name='br-int',has_traffic_filtering=True,id=400f5579-1db7-476d-b3b5-b6f38a538752,network=Network(759a6e43-6d1b-44d5-92ea-4f798fb303e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap400f5579-1d') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 02:03:37.794722 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:37.795119 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:03:37.795458 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 02:03:37.797184 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:37.797346 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a11cb689-3139-5218-abc3-c810d4bc350e', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:03:37.799635 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:03:37.802905 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:37.803042 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap400f5579-1d, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:03:37.803430 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap400f5579-1d, col_values=(('qos', UUID('8d880440-6f20-4f1f-ac2c-3081acbd407b')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:03:37.803951 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap400f5579-1d, col_values=(('external_ids', {'iface-id': '400f5579-1db7-476d-b3b5-b6f38a538752', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:07:3c', 'vm-uuid': 'ea390d12-4b20-4d31-9dc6-ec47b983ebfa'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:03:37.806293 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:37.806705 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:03:37.811233 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:37.812598 np0000001583 nova-compute[98241]: INFO os_vif [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:07:3c,bridge_name='br-int',has_traffic_filtering=True,id=400f5579-1db7-476d-b3b5-b6f38a538752,network=Network(759a6e43-6d1b-44d5-92ea-4f798fb303e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap400f5579-1d')
May 28 02:03:37.846576 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 21c4e225-440e-4103-adaf-cb470d172291] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:03:37.970492 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f2636d04-da6c-4b06-91c5-6c6ba0dbc3f2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 02:03:37.997325 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:38.001468 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:38.031297 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:38.202437 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:38.224665 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9162679a-b271-445a-bef1-0c26376a7532 req-1f9f9bcd-01c4-47d8-9b8e-916141a8ddb6 service nova] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Received event network-vif-unplugged-aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:03:38.224665 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9162679a-b271-445a-bef1-0c26376a7532 req-1f9f9bcd-01c4-47d8-9b8e-916141a8ddb6 service nova] Acquiring lock "e3e9a0d0-72cd-459e-8bc4-cf080adb5267-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:38.224665 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9162679a-b271-445a-bef1-0c26376a7532 req-1f9f9bcd-01c4-47d8-9b8e-916141a8ddb6 service nova] Lock "e3e9a0d0-72cd-459e-8bc4-cf080adb5267-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:38.225891 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9162679a-b271-445a-bef1-0c26376a7532 req-1f9f9bcd-01c4-47d8-9b8e-916141a8ddb6 service nova] Lock "e3e9a0d0-72cd-459e-8bc4-cf080adb5267-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:38.226172 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:38.226542 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9162679a-b271-445a-bef1-0c26376a7532 req-1f9f9bcd-01c4-47d8-9b8e-916141a8ddb6 service nova] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] No waiting events found dispatching network-vif-unplugged-aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:03:38.226727 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9162679a-b271-445a-bef1-0c26376a7532 req-1f9f9bcd-01c4-47d8-9b8e-916141a8ddb6 service nova] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Received event network-vif-unplugged-aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:03:38.318135 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.998994944999595 future=<Future at 0x7724ec2ba300 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:03:38.320607 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Instance destroyed successfully.
May 28 02:03:38.321820 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-f2636d04-da6c-4b06-91c5-6c6ba0dbc3f2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lazy-loading 'resources' on Instance uuid e3e9a0d0-72cd-459e-8bc4-cf080adb5267 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:03:38.331042 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:38.824538 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-f2636d04-da6c-4b06-91c5-6c6ba0dbc3f2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:58:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='multiattach-server-1',id=38,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAP7CI9wuY8JR5OGc0CpqFzQg3rj7cqVgHC4sPYHH38XlmtTRa9WHg3S3WcIsSpd43tWEYYLHF1/yDpoSsozR5Hrjk+cgmLbTDwUHC3YheiC8VnlV/ymBtBFe0b8oxSz5w==',key_name='tempest-keypair-1713929294',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:59:08Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0474090f4f2d4950b51bc317f4302266',ramdisk_id='',reservation_id='r-8z0cwax6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-857456921',owner_user_name='tempest-AttachVolumeMultiAttachTest-857456921-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:59:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cadb612e41314b06914d5f5f47570e98',uuid=e3e9a0d0-72cd-459e-8bc4-cf080adb5267,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8", "address": "fa:16:3e:df:45:21", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaec0d58f-da", "ovs_interfaceid": "aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:03:38.825173 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-f2636d04-da6c-4b06-91c5-6c6ba0dbc3f2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Converting VIF {"id": "aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8", "address": "fa:16:3e:df:45:21", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaec0d58f-da", "ovs_interfaceid": "aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:03:38.825262 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-f2636d04-da6c-4b06-91c5-6c6ba0dbc3f2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:45:21,bridge_name='br-int',has_traffic_filtering=True,id=aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaec0d58f-da') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:03:38.825507 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-f2636d04-da6c-4b06-91c5-6c6ba0dbc3f2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:45:21,bridge_name='br-int',has_traffic_filtering=True,id=aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaec0d58f-da') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:03:38.827155 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:38.827394 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaec0d58f-da, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:03:38.829772 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:03:38.834515 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:38.839240 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:38.839532 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c1519c44-4683-4def-aab4-cc03a7dc32d4) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:03:38.841189 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:38.841498 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:03:38.845655 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:38.848163 np0000001583 nova-compute[98241]: INFO os_vif [None req-f2636d04-da6c-4b06-91c5-6c6ba0dbc3f2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:45:21,bridge_name='br-int',has_traffic_filtering=True,id=aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaec0d58f-da')
May 28 02:03:38.849293 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-f2636d04-da6c-4b06-91c5-6c6ba0dbc3f2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Deleting instance files /opt/stack/data/nova/instances/e3e9a0d0-72cd-459e-8bc4-cf080adb5267_del
May 28 02:03:38.850659 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-f2636d04-da6c-4b06-91c5-6c6ba0dbc3f2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Deletion of /opt/stack/data/nova/instances/e3e9a0d0-72cd-459e-8bc4-cf080adb5267_del complete
May 28 02:03:39.350219 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:03:39.350861 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:03:39.352718 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] No VIF found with MAC fa:16:3e:87:07:3c, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:03:39.354608 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Using config drive
May 28 02:03:39.363426 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-f2636d04-da6c-4b06-91c5-6c6ba0dbc3f2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Took 1.39 seconds to destroy the instance on the hypervisor.
May 28 02:03:39.365518 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-f2636d04-da6c-4b06-91c5-6c6ba0dbc3f2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 02:03:39.365994 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 02:03:39.366091 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 02:03:39.366439 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:03:39.433208 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:03:39.749161 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-4f85a7bf-d8f3-4316-87c4-e2a23768de70 req-4a5fcdd2-1f65-470c-9882-97d694a22e61 service nova] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Received event network-vif-deleted-aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:03:39.751755 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-4f85a7bf-d8f3-4316-87c4-e2a23768de70 req-4a5fcdd2-1f65-470c-9882-97d694a22e61 service nova] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Neutron deleted interface aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8; detaching it from the instance and deleting it from the info cache
May 28 02:03:39.765898 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-4f85a7bf-d8f3-4316-87c4-e2a23768de70 req-4a5fcdd2-1f65-470c-9882-97d694a22e61 service nova] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Detach interface failed, port_id=aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8, reason: Instance e3e9a0d0-72cd-459e-8bc4-cf080adb5267 could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 02:03:39.865372 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:03:40.034439 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Creating config drive at /opt/stack/data/nova/instances/ea390d12-4b20-4d31-9dc6-ec47b983ebfa/disk.config
May 28 02:03:40.039021 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ea390d12-4b20-4d31-9dc6-ec47b983ebfa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpds2u9clg {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:03:40.090854 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ea390d12-4b20-4d31-9dc6-ec47b983ebfa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpds2u9clg" returned: 0 in 0.051s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:03:40.179697 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:03:40.288261 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-c01519dc-925b-4cbc-8fdd-594045184989 req-83585f96-79b2-417d-82ef-08487fa4a22e service nova] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Received event network-vif-unplugged-aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:03:40.288261 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c01519dc-925b-4cbc-8fdd-594045184989 req-83585f96-79b2-417d-82ef-08487fa4a22e service nova] Acquiring lock "e3e9a0d0-72cd-459e-8bc4-cf080adb5267-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:40.288261 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c01519dc-925b-4cbc-8fdd-594045184989 req-83585f96-79b2-417d-82ef-08487fa4a22e service nova] Lock "e3e9a0d0-72cd-459e-8bc4-cf080adb5267-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:40.289161 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c01519dc-925b-4cbc-8fdd-594045184989 req-83585f96-79b2-417d-82ef-08487fa4a22e service nova] Lock "e3e9a0d0-72cd-459e-8bc4-cf080adb5267-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:40.289161 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-c01519dc-925b-4cbc-8fdd-594045184989 req-83585f96-79b2-417d-82ef-08487fa4a22e service nova] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] No waiting events found dispatching network-vif-unplugged-aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:03:40.289161 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-c01519dc-925b-4cbc-8fdd-594045184989 req-83585f96-79b2-417d-82ef-08487fa4a22e service nova] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Received event network-vif-unplugged-aec0d58f-da97-4d8e-bb3d-19f5cd33d8b8 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:03:40.515150 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:40.551832 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:40.648138 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:40.682356 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Took 1.32 seconds to deallocate network for instance.
May 28 02:03:40.900780 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:40.902305 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:40.930830 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:41.191889 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f2636d04-da6c-4b06-91c5-6c6ba0dbc3f2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:41.192070 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f2636d04-da6c-4b06-91c5-6c6ba0dbc3f2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:41.381691 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933821.3811975, ea390d12-4b20-4d31-9dc6-ec47b983ebfa => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:03:41.381911 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] VM Started (Lifecycle Event)
May 28 02:03:41.601280 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f2636d04-da6c-4b06-91c5-6c6ba0dbc3f2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:03:41.601503 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-f2636d04-da6c-4b06-91c5-6c6ba0dbc3f2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:03:41.885643 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:03:41.888466 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933821.8881652, ea390d12-4b20-4d31-9dc6-ec47b983ebfa => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:03:41.888599 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] VM Paused (Lifecycle Event)
May 28 02:03:42.104254 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-f2636d04-da6c-4b06-91c5-6c6ba0dbc3f2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:03:42.363063 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-dc8c6f9e-2ac4-4de5-b14e-f047747152c2 req-219f7976-0d9a-4154-890d-7f053a676ca1 service nova] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Received event network-vif-plugged-400f5579-1db7-476d-b3b5-b6f38a538752 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:03:42.366327 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-dc8c6f9e-2ac4-4de5-b14e-f047747152c2 req-219f7976-0d9a-4154-890d-7f053a676ca1 service nova] Acquiring lock "ea390d12-4b20-4d31-9dc6-ec47b983ebfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:42.366327 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-dc8c6f9e-2ac4-4de5-b14e-f047747152c2 req-219f7976-0d9a-4154-890d-7f053a676ca1 service nova] Lock "ea390d12-4b20-4d31-9dc6-ec47b983ebfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:42.366327 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-dc8c6f9e-2ac4-4de5-b14e-f047747152c2 req-219f7976-0d9a-4154-890d-7f053a676ca1 service nova] Lock "ea390d12-4b20-4d31-9dc6-ec47b983ebfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:42.366327 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-dc8c6f9e-2ac4-4de5-b14e-f047747152c2 req-219f7976-0d9a-4154-890d-7f053a676ca1 service nova] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Processing event network-vif-plugged-400f5579-1db7-476d-b3b5-b6f38a538752 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 02:03:42.366327 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-dc8c6f9e-2ac4-4de5-b14e-f047747152c2 req-219f7976-0d9a-4154-890d-7f053a676ca1 service nova] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Received event network-vif-plugged-400f5579-1db7-476d-b3b5-b6f38a538752 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:03:42.366327 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-dc8c6f9e-2ac4-4de5-b14e-f047747152c2 req-219f7976-0d9a-4154-890d-7f053a676ca1 service nova] Acquiring lock "ea390d12-4b20-4d31-9dc6-ec47b983ebfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:42.366327 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-dc8c6f9e-2ac4-4de5-b14e-f047747152c2 req-219f7976-0d9a-4154-890d-7f053a676ca1 service nova] Lock "ea390d12-4b20-4d31-9dc6-ec47b983ebfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:42.366327 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-dc8c6f9e-2ac4-4de5-b14e-f047747152c2 req-219f7976-0d9a-4154-890d-7f053a676ca1 service nova] Lock "ea390d12-4b20-4d31-9dc6-ec47b983ebfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:42.366327 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-dc8c6f9e-2ac4-4de5-b14e-f047747152c2 req-219f7976-0d9a-4154-890d-7f053a676ca1 service nova] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] No waiting events found dispatching network-vif-plugged-400f5579-1db7-476d-b3b5-b6f38a538752 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:03:42.366327 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-dc8c6f9e-2ac4-4de5-b14e-f047747152c2 req-219f7976-0d9a-4154-890d-7f053a676ca1 service nova] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Received unexpected event network-vif-plugged-400f5579-1db7-476d-b3b5-b6f38a538752 for instance with vm_state building and task_state spawning.
May 28 02:03:42.366327 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 02:03:42.370423 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 02:03:42.373441 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Instance spawned successfully.
May 28 02:03:42.373962 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 02:03:42.392111 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:03:42.398242 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933822.3978798, ea390d12-4b20-4d31-9dc6-ec47b983ebfa => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:03:42.398464 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] VM Resumed (Lifecycle Event)
May 28 02:03:42.613128 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f2636d04-da6c-4b06-91c5-6c6ba0dbc3f2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.421s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:42.690539 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-f2636d04-da6c-4b06-91c5-6c6ba0dbc3f2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Deleted allocations for instance e3e9a0d0-72cd-459e-8bc4-cf080adb5267
May 28 02:03:42.881150 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:03:42.881291 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:03:42.881577 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:03:42.881742 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:03:42.882001 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:03:42.882285 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:03:42.900927 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:03:42.904193 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:03:43.332929 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:43.386935 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Took 7.97 seconds to spawn the instance on the hypervisor.
May 28 02:03:43.387175 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:03:43.408523 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 02:03:43.699710 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f2636d04-da6c-4b06-91c5-6c6ba0dbc3f2 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "e3e9a0d0-72cd-459e-8bc4-cf080adb5267" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.238s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:43.852346 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:43.897013 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Took 13.62 seconds to build instance.
May 28 02:03:44.398737 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-85515573-3335-41dd-8c45-b548c1237da6 tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Lock "ea390d12-4b20-4d31-9dc6-ec47b983ebfa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.128s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:44.782055 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a6918548-4f13-4b4e-b50e-ff8720a53ffc tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "22bbb8cf-c11d-4025-8551-4c1c3557264a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:44.782213 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a6918548-4f13-4b4e-b50e-ff8720a53ffc tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "22bbb8cf-c11d-4025-8551-4c1c3557264a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:44.782459 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a6918548-4f13-4b4e-b50e-ff8720a53ffc tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "22bbb8cf-c11d-4025-8551-4c1c3557264a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:44.782625 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a6918548-4f13-4b4e-b50e-ff8720a53ffc tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "22bbb8cf-c11d-4025-8551-4c1c3557264a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:44.782797 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a6918548-4f13-4b4e-b50e-ff8720a53ffc tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "22bbb8cf-c11d-4025-8551-4c1c3557264a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:44.785373 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-a6918548-4f13-4b4e-b50e-ff8720a53ffc tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Terminating instance
May 28 02:03:44.805360 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0004061690001435636 future=<Future at 0x7724ec262000 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:03:44.806097 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Emitting event <LifecycleEvent: 1779933809.804861, 8b2a5f31-1b3d-447f-939e-94fd0be5eb85 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:03:44.806179 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] VM Stopped (Lifecycle Event)
May 28 02:03:44.807482 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:03:44.807482 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=8.509690021999631 future=<Future at 0x7724ec2ba300 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:03:44.807482 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=8.509600675999991 future=<Future at 0x7724ec2ba300 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:03:45.289107 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a6918548-4f13-4b4e-b50e-ff8720a53ffc tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 02:03:45.309352 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:45.312140 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 8b2a5f31-1b3d-447f-939e-94fd0be5eb85] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:03:45.313535 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:45.335023 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:45.470380 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ffc62d0c-4e72-41f9-912c-9f0fc33aff74 req-f15711eb-bce8-4d03-b974-67a80180fbff service nova] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Received event network-vif-unplugged-cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:03:45.470848 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ffc62d0c-4e72-41f9-912c-9f0fc33aff74 req-f15711eb-bce8-4d03-b974-67a80180fbff service nova] Acquiring lock "22bbb8cf-c11d-4025-8551-4c1c3557264a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:45.471029 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ffc62d0c-4e72-41f9-912c-9f0fc33aff74 req-f15711eb-bce8-4d03-b974-67a80180fbff service nova] Lock "22bbb8cf-c11d-4025-8551-4c1c3557264a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:45.471029 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ffc62d0c-4e72-41f9-912c-9f0fc33aff74 req-f15711eb-bce8-4d03-b974-67a80180fbff service nova] Lock "22bbb8cf-c11d-4025-8551-4c1c3557264a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:45.471253 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ffc62d0c-4e72-41f9-912c-9f0fc33aff74 req-f15711eb-bce8-4d03-b974-67a80180fbff service nova] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] No waiting events found dispatching network-vif-unplugged-cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:03:45.471253 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ffc62d0c-4e72-41f9-912c-9f0fc33aff74 req-f15711eb-bce8-4d03-b974-67a80180fbff service nova] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Received event network-vif-unplugged-cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:03:45.480961 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:45.483618 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:45.504363 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-cdfc6d39-7fc6-425f-8575-cb1f2dc16981 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Acquiring lock "1f15126e-6636-4765-8650-bb717f186efe" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:45.504597 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-cdfc6d39-7fc6-425f-8575-cb1f2dc16981 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "1f15126e-6636-4765-8650-bb717f186efe" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:45.545471 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:45.606134 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999758723000014 future=<Future at 0x7724ec1e2d50 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:03:45.608915 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Instance destroyed successfully.
May 28 02:03:45.609308 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-a6918548-4f13-4b4e-b50e-ff8720a53ffc tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lazy-loading 'resources' on Instance uuid 22bbb8cf-c11d-4025-8551-4c1c3557264a {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:03:46.007016 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cdfc6d39-7fc6-425f-8575-cb1f2dc16981 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Detaching volume 093ceec4-8090-44f9-a9d3-1a5fe5fe9b19
May 28 02:03:46.056579 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-cdfc6d39-7fc6-425f-8575-cb1f2dc16981 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Attempting to driver detach volume 093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 from mountpoint /dev/vdb
May 28 02:03:46.068642 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cdfc6d39-7fc6-425f-8575-cb1f2dc16981 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Found disk vdb by alias ua-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:03:46.071945 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cdfc6d39-7fc6-425f-8575-cb1f2dc16981 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Found disk vdb by alias ua-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:03:46.072191 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cdfc6d39-7fc6-425f-8575-cb1f2dc16981 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Attempting to detach device vdb from instance 1f15126e-6636-4765-8650-bb717f186efe from the persistent domain config. {{(pid=98241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 02:03:46.076633 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-cdfc6d39-7fc6-425f-8575-cb1f2dc16981 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:03:46.076633 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:03:46.076633 np0000001583 nova-compute[98241]:   <alias name="ua-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19"/>
May 28 02:03:46.076633 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-7"/>
May 28 02:03:46.076633 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:03:46.076633 np0000001583 nova-compute[98241]:   <serial>093ceec4-8090-44f9-a9d3-1a5fe5fe9b19</serial>
May 28 02:03:46.076633 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 02:03:46.076633 np0000001583 nova-compute[98241]: </disk>
May 28 02:03:46.076633 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:03:46.092216 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-cdfc6d39-7fc6-425f-8575-cb1f2dc16981 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Successfully detached device vdb from instance 1f15126e-6636-4765-8650-bb717f186efe from the persistent domain config.
May 28 02:03:46.092365 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cdfc6d39-7fc6-425f-8575-cb1f2dc16981 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] (1/8): Attempting to detach device vdb with device alias ua-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 from instance 1f15126e-6636-4765-8650-bb717f186efe from the live domain config. {{(pid=98241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 02:03:46.092661 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-cdfc6d39-7fc6-425f-8575-cb1f2dc16981 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:03:46.092661 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:03:46.092661 np0000001583 nova-compute[98241]:   <alias name="ua-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19"/>
May 28 02:03:46.092661 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-7"/>
May 28 02:03:46.092661 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:03:46.092661 np0000001583 nova-compute[98241]:   <serial>093ceec4-8090-44f9-a9d3-1a5fe5fe9b19</serial>
May 28 02:03:46.092661 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 02:03:46.092661 np0000001583 nova-compute[98241]: </disk>
May 28 02:03:46.092661 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:03:46.112210 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-a6918548-4f13-4b4e-b50e-ff8720a53ffc tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:58:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='multiattach-server-0',id=33,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAP7CI9wuY8JR5OGc0CpqFzQg3rj7cqVgHC4sPYHH38XlmtTRa9WHg3S3WcIsSpd43tWEYYLHF1/yDpoSsozR5Hrjk+cgmLbTDwUHC3YheiC8VnlV/ymBtBFe0b8oxSz5w==',key_name='tempest-keypair-1713929294',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:58:47Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0474090f4f2d4950b51bc317f4302266',ramdisk_id='',reservation_id='r-yz328fm1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-857456921',owner_user_name='tempest-AttachVolumeMultiAttachTest-857456921-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:58:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cadb612e41314b06914d5f5f47570e98',uuid=22bbb8cf-c11d-4025-8551-4c1c3557264a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b", "address": "fa:16:3e:d3:cd:06", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc6fcb39-fe", "ovs_interfaceid": "cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:03:46.112502 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a6918548-4f13-4b4e-b50e-ff8720a53ffc tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Converting VIF {"id": "cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b", "address": "fa:16:3e:d3:cd:06", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc6fcb39-fe", "ovs_interfaceid": "cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:03:46.113341 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a6918548-4f13-4b4e-b50e-ff8720a53ffc tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:cd:06,bridge_name='br-int',has_traffic_filtering=True,id=cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc6fcb39-fe') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:03:46.113671 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-a6918548-4f13-4b4e-b50e-ff8720a53ffc tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:cd:06,bridge_name='br-int',has_traffic_filtering=True,id=cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc6fcb39-fe') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:03:46.115476 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:46.115762 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc6fcb39-fe, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:03:46.117219 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:46.117956 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:03:46.119300 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:46.119449 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1fbd1def-e7d4-4f6c-82c9-41510235ac56) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:03:46.121348 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:03:46.124728 np0000001583 nova-compute[98241]: INFO os_vif [None req-a6918548-4f13-4b4e-b50e-ff8720a53ffc tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:cd:06,bridge_name='br-int',has_traffic_filtering=True,id=cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc6fcb39-fe')
May 28 02:03:46.125144 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-a6918548-4f13-4b4e-b50e-ff8720a53ffc tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Deleting instance files /opt/stack/data/nova/instances/22bbb8cf-c11d-4025-8551-4c1c3557264a_del
May 28 02:03:46.126134 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-a6918548-4f13-4b4e-b50e-ff8720a53ffc tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Deletion of /opt/stack/data/nova/instances/22bbb8cf-c11d-4025-8551-4c1c3557264a_del complete
May 28 02:03:46.292149 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-dcd1d09a-967b-4289-b36f-0425cf4bcf4d tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Acquiring lock "ea390d12-4b20-4d31-9dc6-ec47b983ebfa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:46.292356 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-dcd1d09a-967b-4289-b36f-0425cf4bcf4d tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Lock "ea390d12-4b20-4d31-9dc6-ec47b983ebfa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:46.292539 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-dcd1d09a-967b-4289-b36f-0425cf4bcf4d tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Acquiring lock "ea390d12-4b20-4d31-9dc6-ec47b983ebfa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:46.292716 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-dcd1d09a-967b-4289-b36f-0425cf4bcf4d tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Lock "ea390d12-4b20-4d31-9dc6-ec47b983ebfa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:46.292867 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-dcd1d09a-967b-4289-b36f-0425cf4bcf4d tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Lock "ea390d12-4b20-4d31-9dc6-ec47b983ebfa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:46.297362 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-dcd1d09a-967b-4289-b36f-0425cf4bcf4d tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Terminating instance
May 28 02:03:46.635195 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-a6918548-4f13-4b4e-b50e-ff8720a53ffc tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Took 1.35 seconds to destroy the instance on the hypervisor.
May 28 02:03:46.635692 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-a6918548-4f13-4b4e-b50e-ff8720a53ffc tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 02:03:46.635905 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 02:03:46.635997 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 02:03:46.636252 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:03:46.657169 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Received event <DeviceRemovedEvent: 1779933826.65684, 1f15126e-6636-4765-8650-bb717f186efe => ua-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19> from libvirt while the driver is waiting for it; dispatched. {{(pid=98241) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 02:03:46.658385 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cdfc6d39-7fc6-425f-8575-cb1f2dc16981 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 for instance 1f15126e-6636-4765-8650-bb717f186efe {{(pid=98241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 02:03:46.662046 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-cdfc6d39-7fc6-425f-8575-cb1f2dc16981 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Successfully detached device vdb from instance 1f15126e-6636-4765-8650-bb717f186efe from the live domain config.
May 28 02:03:46.663195 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdfc6d39-7fc6-425f-8575-cb1f2dc16981 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 1f15126e-6636-4765-8650-bb717f186efe] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:03:46.663525 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfc6d39-7fc6-425f-8575-cb1f2dc16981 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19', 'iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '093ceec4-8090-44f9-a9d3-1a5fe5fe9b19', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': False}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:03:46.663706 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-cdfc6d39-7fc6-425f-8575-cb1f2dc16981 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:03:46.664098 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-cdfc6d39-7fc6-425f-8575-cb1f2dc16981 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:03:46.664412 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfc6d39-7fc6-425f-8575-cb1f2dc16981 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19', 'iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '093ceec4-8090-44f9-a9d3-1a5fe5fe9b19', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:03:46.664598 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfc6d39-7fc6-425f-8575-cb1f2dc16981 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:03:46.691758 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfc6d39-7fc6-425f-8575-cb1f2dc16981 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:03:46.691758 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:03:46.691758 np0000001583 nova-compute[98241]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:03:46.691758 np0000001583 nova-compute[98241]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:03:46.691758 np0000001583 nova-compute[98241]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b (non-flash)
May 28 02:03:46.691758 np0000001583 nova-compute[98241]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b (non-flash)
May 28 02:03:46.691758 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:03:46.691758 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:03:46.691758 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:03:46.692272 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfc6d39-7fc6-425f-8575-cb1f2dc16981 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsi session list stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:03:46.692272 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:03:46.692272 np0000001583 nova-compute[98241]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:03:46.692272 np0000001583 nova-compute[98241]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19 (non-flash)
May 28 02:03:46.692272 np0000001583 nova-compute[98241]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b (non-flash)
May 28 02:03:46.692272 np0000001583 nova-compute[98241]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b (non-flash)
May 28 02:03:46.692272 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:03:46.692272 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:03:46.692272 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:03:46.692272 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfc6d39-7fc6-425f-8575-cb1f2dc16981 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86', '109'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86', '110'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19', '113'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19', '114'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b', '120'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b', '121'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', '68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', '69')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:03:46.692628 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfc6d39-7fc6-425f-8575-cb1f2dc16981 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19', '114')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:03:46.693397 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfc6d39-7fc6-425f-8575-cb1f2dc16981 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19', '113')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:03:46.694227 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfc6d39-7fc6-425f-8575-cb1f2dc16981 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f83e5d00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19'): ({'sdh'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:03:46.694472 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-cdfc6d39-7fc6-425f-8575-cb1f2dc16981 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Removing multipathed devices sdh, sdi {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:03:46.694715 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-cdfc6d39-7fc6-425f-8575-cb1f2dc16981 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Flush multipath device 33000000056ee9b82 {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:03:46.727505 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-cdfc6d39-7fc6-425f-8575-cb1f2dc16981 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:03:46.747128 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:03:46.768703 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-cdfc6d39-7fc6-425f-8575-cb1f2dc16981 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:03:46.800436 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-dcd1d09a-967b-4289-b36f-0425cf4bcf4d tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 02:03:46.817128 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:46.820059 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:46.845165 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-cdfc6d39-7fc6-425f-8575-cb1f2dc16981 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:03:46.845165 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-cdfc6d39-7fc6-425f-8575-cb1f2dc16981 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:03:46.845165 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-cdfc6d39-7fc6-425f-8575-cb1f2dc16981 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:03:46.846743 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:46.857695 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:46.859428 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-cdfc6d39-7fc6-425f-8575-cb1f2dc16981 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:03:46.860873 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfc6d39-7fc6-425f-8575-cb1f2dc16981 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:03:46.874335 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfc6d39-7fc6-425f-8575-cb1f2dc16981 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:03:46.884891 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:46.932559 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfc6d39-7fc6-425f-8575-cb1f2dc16981 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 114, target: iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19, portal: 192.168.40.100,3260]
May 28 02:03:46.932559 np0000001583 nova-compute[98241]: Logout of [sid: 114, target: iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19, portal: 192.168.40.100,3260] successful.
May 28 02:03:46.932559 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:03:46.953242 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfc6d39-7fc6-425f-8575-cb1f2dc16981 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:03:46.966530 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfc6d39-7fc6-425f-8575-cb1f2dc16981 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:03:47.013730 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfc6d39-7fc6-425f-8575-cb1f2dc16981 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 113, target: iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19, portal: 192.168.50.100,3260]
May 28 02:03:47.013730 np0000001583 nova-compute[98241]: Logout of [sid: 113, target: iqn.2023-03.storpool.com:os--volume-093ceec4-8090-44f9-a9d3-1a5fe5fe9b19, portal: 192.168.50.100,3260] successful.
May 28 02:03:47.013730 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:03:47.019205 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7925b267-597e-4b90-9be6-d62e517b8c74 req-bc5e801d-7125-4bd1-bc78-e510feefeb24 service nova] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Received event network-vif-unplugged-400f5579-1db7-476d-b3b5-b6f38a538752 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:03:47.019205 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7925b267-597e-4b90-9be6-d62e517b8c74 req-bc5e801d-7125-4bd1-bc78-e510feefeb24 service nova] Acquiring lock "ea390d12-4b20-4d31-9dc6-ec47b983ebfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:47.019205 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7925b267-597e-4b90-9be6-d62e517b8c74 req-bc5e801d-7125-4bd1-bc78-e510feefeb24 service nova] Lock "ea390d12-4b20-4d31-9dc6-ec47b983ebfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:47.019870 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7925b267-597e-4b90-9be6-d62e517b8c74 req-bc5e801d-7125-4bd1-bc78-e510feefeb24 service nova] Lock "ea390d12-4b20-4d31-9dc6-ec47b983ebfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:47.019870 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7925b267-597e-4b90-9be6-d62e517b8c74 req-bc5e801d-7125-4bd1-bc78-e510feefeb24 service nova] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] No waiting events found dispatching network-vif-unplugged-400f5579-1db7-476d-b3b5-b6f38a538752 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:03:47.020067 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7925b267-597e-4b90-9be6-d62e517b8c74 req-bc5e801d-7125-4bd1-bc78-e510feefeb24 service nova] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Received event network-vif-unplugged-400f5579-1db7-476d-b3b5-b6f38a538752 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:03:47.039777 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfc6d39-7fc6-425f-8575-cb1f2dc16981 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:03:47.039777 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-cdfc6d39-7fc6-425f-8575-cb1f2dc16981 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:03:47.039777 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfc6d39-7fc6-425f-8575-cb1f2dc16981 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] <== disconnect_volume: return (374ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:03:47.039777 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdfc6d39-7fc6-425f-8575-cb1f2dc16981 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:03:47.075280 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-3f15e133-7865-4901-8e0e-f2647889f422 req-1daf5861-e781-41c5-917b-89e24829ca5f service nova] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Received event network-vif-deleted-cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:03:47.075957 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-3f15e133-7865-4901-8e0e-f2647889f422 req-1daf5861-e781-41c5-917b-89e24829ca5f service nova] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Neutron deleted interface cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b; detaching it from the instance and deleting it from the info cache
May 28 02:03:47.078870 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-3f15e133-7865-4901-8e0e-f2647889f422 req-1daf5861-e781-41c5-917b-89e24829ca5f service nova] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Detach interface failed, port_id=cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b, reason: Instance 22bbb8cf-c11d-4025-8551-4c1c3557264a could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 02:03:47.158766 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999707737000335 future=<Future at 0x7724f85d5ac0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:03:47.164217 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Instance destroyed successfully.
May 28 02:03:47.164715 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-dcd1d09a-967b-4289-b36f-0425cf4bcf4d tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Lazy-loading 'resources' on Instance uuid ea390d12-4b20-4d31-9dc6-ec47b983ebfa {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:03:47.514319 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:03:47.530919 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-934a50f4-cf9e-4a60-8dc4-d416acf15a37 req-ac99f1a8-60f0-47da-b7c1-bb9e4ff5d05c service nova] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Received event network-vif-unplugged-cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:03:47.534317 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-934a50f4-cf9e-4a60-8dc4-d416acf15a37 req-ac99f1a8-60f0-47da-b7c1-bb9e4ff5d05c service nova] Acquiring lock "22bbb8cf-c11d-4025-8551-4c1c3557264a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:47.534317 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-934a50f4-cf9e-4a60-8dc4-d416acf15a37 req-ac99f1a8-60f0-47da-b7c1-bb9e4ff5d05c service nova] Lock "22bbb8cf-c11d-4025-8551-4c1c3557264a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:47.534317 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-934a50f4-cf9e-4a60-8dc4-d416acf15a37 req-ac99f1a8-60f0-47da-b7c1-bb9e4ff5d05c service nova] Lock "22bbb8cf-c11d-4025-8551-4c1c3557264a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:47.534317 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-934a50f4-cf9e-4a60-8dc4-d416acf15a37 req-ac99f1a8-60f0-47da-b7c1-bb9e4ff5d05c service nova] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] No waiting events found dispatching network-vif-unplugged-cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:03:47.535056 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-934a50f4-cf9e-4a60-8dc4-d416acf15a37 req-ac99f1a8-60f0-47da-b7c1-bb9e4ff5d05c service nova] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Received event network-vif-unplugged-cc6fcb39-fe38-4619-8d8d-1a6b66cc4f0b for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:03:47.601900 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-cdfc6d39-7fc6-425f-8575-cb1f2dc16981 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lazy-loading 'flavor' on Instance uuid 1f15126e-6636-4765-8650-bb717f186efe {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:03:47.668936 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-dcd1d09a-967b-4289-b36f-0425cf4bcf4d tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T02:03:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-998452386',display_name='tempest-VolumesActionsTest-instance-998452386',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-volumesactionstest-instance-998452386',id=54,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:03:43Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1c38124ed2774a80a79d62c26d43f4da',ramdisk_id='',reservation_id='r-xmv1x1to',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1125296363',owner_user_name='tempest-VolumesActionsTest-1125296363-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T02:03:43Z,user_data=None,user_id='bdd7dc60a5d6477e9a120c0dbfd7384e',uuid=ea390d12-4b20-4d31-9dc6-ec47b983ebfa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "400f5579-1db7-476d-b3b5-b6f38a538752", "address": "fa:16:3e:87:07:3c", "network": {"id": "759a6e43-6d1b-44d5-92ea-4f798fb303e0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1542618898-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c38124ed2774a80a79d62c26d43f4da", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap400f5579-1d", "ovs_interfaceid": "400f5579-1db7-476d-b3b5-b6f38a538752", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:03:47.668936 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-dcd1d09a-967b-4289-b36f-0425cf4bcf4d tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Converting VIF {"id": "400f5579-1db7-476d-b3b5-b6f38a538752", "address": "fa:16:3e:87:07:3c", "network": {"id": "759a6e43-6d1b-44d5-92ea-4f798fb303e0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1542618898-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c38124ed2774a80a79d62c26d43f4da", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap400f5579-1d", "ovs_interfaceid": "400f5579-1db7-476d-b3b5-b6f38a538752", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:03:47.668936 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-dcd1d09a-967b-4289-b36f-0425cf4bcf4d tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:07:3c,bridge_name='br-int',has_traffic_filtering=True,id=400f5579-1db7-476d-b3b5-b6f38a538752,network=Network(759a6e43-6d1b-44d5-92ea-4f798fb303e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap400f5579-1d') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:03:47.668936 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-dcd1d09a-967b-4289-b36f-0425cf4bcf4d tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:07:3c,bridge_name='br-int',has_traffic_filtering=True,id=400f5579-1db7-476d-b3b5-b6f38a538752,network=Network(759a6e43-6d1b-44d5-92ea-4f798fb303e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap400f5579-1d') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:03:47.670247 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:47.670415 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap400f5579-1d, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:03:47.671310 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:47.674207 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:03:47.674703 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:47.674860 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8d880440-6f20-4f1f-ac2c-3081acbd407b) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:03:47.675293 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:47.675710 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:03:47.677452 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:47.687573 np0000001583 nova-compute[98241]: INFO os_vif [None req-dcd1d09a-967b-4289-b36f-0425cf4bcf4d tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:07:3c,bridge_name='br-int',has_traffic_filtering=True,id=400f5579-1db7-476d-b3b5-b6f38a538752,network=Network(759a6e43-6d1b-44d5-92ea-4f798fb303e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap400f5579-1d')
May 28 02:03:47.687573 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-dcd1d09a-967b-4289-b36f-0425cf4bcf4d tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Deleting instance files /opt/stack/data/nova/instances/ea390d12-4b20-4d31-9dc6-ec47b983ebfa_del
May 28 02:03:47.687573 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-dcd1d09a-967b-4289-b36f-0425cf4bcf4d tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Deletion of /opt/stack/data/nova/instances/ea390d12-4b20-4d31-9dc6-ec47b983ebfa_del complete
May 28 02:03:48.016130 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Took 1.38 seconds to deallocate network for instance.
May 28 02:03:48.194026 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-dcd1d09a-967b-4289-b36f-0425cf4bcf4d tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Took 1.39 seconds to destroy the instance on the hypervisor.
May 28 02:03:48.194026 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-dcd1d09a-967b-4289-b36f-0425cf4bcf4d tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 02:03:48.194026 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 02:03:48.194026 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 02:03:48.194026 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:03:48.315265 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:03:48.335897 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:48.521160 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a6918548-4f13-4b4e-b50e-ff8720a53ffc tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:48.521306 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a6918548-4f13-4b4e-b50e-ff8720a53ffc tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:48.610346 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-cdfc6d39-7fc6-425f-8575-cb1f2dc16981 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "1f15126e-6636-4765-8650-bb717f186efe" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.103s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:48.770139 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e9eab70f-3622-4e4f-9f8d-d590b2a23259 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Acquiring lock "1f15126e-6636-4765-8650-bb717f186efe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:48.770442 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e9eab70f-3622-4e4f-9f8d-d590b2a23259 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "1f15126e-6636-4765-8650-bb717f186efe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:48.770470 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e9eab70f-3622-4e4f-9f8d-d590b2a23259 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Acquiring lock "1f15126e-6636-4765-8650-bb717f186efe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:48.770620 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e9eab70f-3622-4e4f-9f8d-d590b2a23259 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "1f15126e-6636-4765-8650-bb717f186efe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:48.770761 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e9eab70f-3622-4e4f-9f8d-d590b2a23259 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "1f15126e-6636-4765-8650-bb717f186efe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:48.775054 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-e9eab70f-3622-4e4f-9f8d-d590b2a23259 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Terminating instance
May 28 02:03:48.951897 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a6918548-4f13-4b4e-b50e-ff8720a53ffc tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:03:48.952096 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-a6918548-4f13-4b4e-b50e-ff8720a53ffc tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:03:49.082887 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7ec28ba8-d029-47ee-9cd2-08ae17d433b7 req-63ac4614-00e6-45cb-a915-18fd4c597a12 service nova] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Received event network-vif-unplugged-400f5579-1db7-476d-b3b5-b6f38a538752 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:03:49.083141 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7ec28ba8-d029-47ee-9cd2-08ae17d433b7 req-63ac4614-00e6-45cb-a915-18fd4c597a12 service nova] Acquiring lock "ea390d12-4b20-4d31-9dc6-ec47b983ebfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:49.083315 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7ec28ba8-d029-47ee-9cd2-08ae17d433b7 req-63ac4614-00e6-45cb-a915-18fd4c597a12 service nova] Lock "ea390d12-4b20-4d31-9dc6-ec47b983ebfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:49.083437 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7ec28ba8-d029-47ee-9cd2-08ae17d433b7 req-63ac4614-00e6-45cb-a915-18fd4c597a12 service nova] Lock "ea390d12-4b20-4d31-9dc6-ec47b983ebfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:49.083563 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7ec28ba8-d029-47ee-9cd2-08ae17d433b7 req-63ac4614-00e6-45cb-a915-18fd4c597a12 service nova] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] No waiting events found dispatching network-vif-unplugged-400f5579-1db7-476d-b3b5-b6f38a538752 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:03:49.083682 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7ec28ba8-d029-47ee-9cd2-08ae17d433b7 req-63ac4614-00e6-45cb-a915-18fd4c597a12 service nova] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Received event network-vif-unplugged-400f5579-1db7-476d-b3b5-b6f38a538752 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:03:49.083785 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7ec28ba8-d029-47ee-9cd2-08ae17d433b7 req-63ac4614-00e6-45cb-a915-18fd4c597a12 service nova] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Received event network-vif-deleted-400f5579-1db7-476d-b3b5-b6f38a538752 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:03:49.083918 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-7ec28ba8-d029-47ee-9cd2-08ae17d433b7 req-63ac4614-00e6-45cb-a915-18fd4c597a12 service nova] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Neutron deleted interface 400f5579-1db7-476d-b3b5-b6f38a538752; detaching it from the instance and deleting it from the info cache
May 28 02:03:49.085651 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7ec28ba8-d029-47ee-9cd2-08ae17d433b7 req-63ac4614-00e6-45cb-a915-18fd4c597a12 service nova] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Detach interface failed, port_id=400f5579-1db7-476d-b3b5-b6f38a538752, reason: Instance ea390d12-4b20-4d31-9dc6-ec47b983ebfa could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 02:03:49.111695 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:03:49.278286 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-e9eab70f-3622-4e4f-9f8d-d590b2a23259 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 02:03:49.310495 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:49.334647 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:49.355042 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:49.378782 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:49.454906 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-a6918548-4f13-4b4e-b50e-ff8720a53ffc tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:03:49.587587 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:49.596980 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:49.611514 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-29875adb-2be5-44b9-891b-c50daae095cc req-3ed1a2bd-ab34-491e-84b1-0a8fe0ae996c service nova] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Received event network-vif-unplugged-22bcfb63-43d8-411b-814d-d824a342e51f {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:03:49.611960 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-29875adb-2be5-44b9-891b-c50daae095cc req-3ed1a2bd-ab34-491e-84b1-0a8fe0ae996c service nova] Acquiring lock "1f15126e-6636-4765-8650-bb717f186efe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:49.612144 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-29875adb-2be5-44b9-891b-c50daae095cc req-3ed1a2bd-ab34-491e-84b1-0a8fe0ae996c service nova] Lock "1f15126e-6636-4765-8650-bb717f186efe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:49.612264 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-29875adb-2be5-44b9-891b-c50daae095cc req-3ed1a2bd-ab34-491e-84b1-0a8fe0ae996c service nova] Lock "1f15126e-6636-4765-8650-bb717f186efe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:49.612403 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-29875adb-2be5-44b9-891b-c50daae095cc req-3ed1a2bd-ab34-491e-84b1-0a8fe0ae996c service nova] [instance: 1f15126e-6636-4765-8650-bb717f186efe] No waiting events found dispatching network-vif-unplugged-22bcfb63-43d8-411b-814d-d824a342e51f {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:03:49.612521 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-29875adb-2be5-44b9-891b-c50daae095cc req-3ed1a2bd-ab34-491e-84b1-0a8fe0ae996c service nova] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Received event network-vif-unplugged-22bcfb63-43d8-411b-814d-d824a342e51f for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:03:49.613457 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Took 1.42 seconds to deallocate network for instance.
May 28 02:03:49.626381 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.99974277299998 future=<Future at 0x7724ec1e29f0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:03:49.628630 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Instance destroyed successfully.
May 28 02:03:49.629001 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-e9eab70f-3622-4e4f-9f8d-d590b2a23259 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lazy-loading 'resources' on Instance uuid 1f15126e-6636-4765-8650-bb717f186efe {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:03:49.963194 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a6918548-4f13-4b4e-b50e-ff8720a53ffc tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.442s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:50.014359 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-a6918548-4f13-4b4e-b50e-ff8720a53ffc tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Deleted allocations for instance 22bbb8cf-c11d-4025-8551-4c1c3557264a
May 28 02:03:50.121636 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-dcd1d09a-967b-4289-b36f-0425cf4bcf4d tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:50.121636 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-dcd1d09a-967b-4289-b36f-0425cf4bcf4d tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:50.131649 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-e9eab70f-3622-4e4f-9f8d-d590b2a23259 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T02:01:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-666750424',display_name='tempest-VolumesBackupsTest-instance-666750424',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-volumesbackupstest-instance-666750424',id=48,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMMeu+rXQ5QXq7ZZqzeBmbPDzr5SyNIppxdAW38M1ouRfyjV+Pzt1aMhSXIRkZ21uVLVx6pazULqJj+PUGCQcNcC2GpJkQJ0/DLNHEnZNHUd6x15IT9Hq/XwOKPm66Yyjg==',key_name='tempest-keypair-1605555645',keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:02:11Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae04c11a3de34d419d69e1fdf4c7d311',ramdisk_id='',reservation_id='r-hqyn6c94',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesBackupsTest-759555243',owner_user_name='tempest-VolumesBackupsTest-759555243-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T02:02:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1a32813f26c4bb28a681856ad1e9019',uuid=1f15126e-6636-4765-8650-bb717f186efe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22bcfb63-43d8-411b-814d-d824a342e51f", "address": "fa:16:3e:c0:11:b8", "network": {"id": "e8c2820e-c0c4-4756-9e11-38375b138d97", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-50364578-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ae04c11a3de34d419d69e1fdf4c7d311", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bcfb63-43", "ovs_interfaceid": "22bcfb63-43d8-411b-814d-d824a342e51f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:03:50.131891 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-e9eab70f-3622-4e4f-9f8d-d590b2a23259 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Converting VIF {"id": "22bcfb63-43d8-411b-814d-d824a342e51f", "address": "fa:16:3e:c0:11:b8", "network": {"id": "e8c2820e-c0c4-4756-9e11-38375b138d97", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-50364578-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ae04c11a3de34d419d69e1fdf4c7d311", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bcfb63-43", "ovs_interfaceid": "22bcfb63-43d8-411b-814d-d824a342e51f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:03:50.132413 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-e9eab70f-3622-4e4f-9f8d-d590b2a23259 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:11:b8,bridge_name='br-int',has_traffic_filtering=True,id=22bcfb63-43d8-411b-814d-d824a342e51f,network=Network(e8c2820e-c0c4-4756-9e11-38375b138d97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22bcfb63-43') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:03:50.132647 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-e9eab70f-3622-4e4f-9f8d-d590b2a23259 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:11:b8,bridge_name='br-int',has_traffic_filtering=True,id=22bcfb63-43d8-411b-814d-d824a342e51f,network=Network(e8c2820e-c0c4-4756-9e11-38375b138d97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22bcfb63-43') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:03:50.135630 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:50.136092 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22bcfb63-43, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:03:50.137342 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:50.140245 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:03:50.142344 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:50.143153 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d6ee9aff-6652-49b9-83de-dd0308d4439f) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:03:50.145439 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:50.149313 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:03:50.151609 np0000001583 nova-compute[98241]: INFO os_vif [None req-e9eab70f-3622-4e4f-9f8d-d590b2a23259 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:11:b8,bridge_name='br-int',has_traffic_filtering=True,id=22bcfb63-43d8-411b-814d-d824a342e51f,network=Network(e8c2820e-c0c4-4756-9e11-38375b138d97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22bcfb63-43')
May 28 02:03:50.152001 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-e9eab70f-3622-4e4f-9f8d-d590b2a23259 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Deleting instance files /opt/stack/data/nova/instances/1f15126e-6636-4765-8650-bb717f186efe_del
May 28 02:03:50.153257 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-e9eab70f-3622-4e4f-9f8d-d590b2a23259 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Deletion of /opt/stack/data/nova/instances/1f15126e-6636-4765-8650-bb717f186efe_del complete
May 28 02:03:50.501985 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-dcd1d09a-967b-4289-b36f-0425cf4bcf4d tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:03:50.502778 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-dcd1d09a-967b-4289-b36f-0425cf4bcf4d tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:03:50.663254 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-e9eab70f-3622-4e4f-9f8d-d590b2a23259 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Took 1.38 seconds to destroy the instance on the hypervisor.
May 28 02:03:50.663868 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-e9eab70f-3622-4e4f-9f8d-d590b2a23259 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 02:03:50.664099 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 02:03:50.664179 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 1f15126e-6636-4765-8650-bb717f186efe] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 02:03:50.664448 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:03:50.748608 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:03:51.004908 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-dcd1d09a-967b-4289-b36f-0425cf4bcf4d tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:03:51.022007 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a6918548-4f13-4b4e-b50e-ff8720a53ffc tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "22bbb8cf-c11d-4025-8551-4c1c3557264a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.240s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:51.229050 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-1b75cdbb-e5d4-4b94-bb8d-d7254367b561 req-b8ffdf2e-c622-4e1b-879a-a68690884192 service nova] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Received event network-vif-deleted-22bcfb63-43d8-411b-814d-d824a342e51f {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:03:51.229193 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-1b75cdbb-e5d4-4b94-bb8d-d7254367b561 req-b8ffdf2e-c622-4e1b-879a-a68690884192 service nova] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Neutron deleted interface 22bcfb63-43d8-411b-814d-d824a342e51f; detaching it from the instance and deleting it from the info cache
May 28 02:03:51.232584 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-1b75cdbb-e5d4-4b94-bb8d-d7254367b561 req-b8ffdf2e-c622-4e1b-879a-a68690884192 service nova] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Detach interface failed, port_id=22bcfb63-43d8-411b-814d-d824a342e51f, reason: Instance 1f15126e-6636-4765-8650-bb717f186efe could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 02:03:51.515829 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-dcd1d09a-967b-4289-b36f-0425cf4bcf4d tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.395s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:51.575957 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-dcd1d09a-967b-4289-b36f-0425cf4bcf4d tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Deleted allocations for instance ea390d12-4b20-4d31-9dc6-ec47b983ebfa
May 28 02:03:51.681685 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:03:51.685172 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f4f732ff-dd24-4d89-8ee0-19190d783490 req-2ad5b4ee-1a87-4e83-b764-1783f6a2230f service nova] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Received event network-vif-unplugged-22bcfb63-43d8-411b-814d-d824a342e51f {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:03:51.685901 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f4f732ff-dd24-4d89-8ee0-19190d783490 req-2ad5b4ee-1a87-4e83-b764-1783f6a2230f service nova] Acquiring lock "1f15126e-6636-4765-8650-bb717f186efe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:51.685901 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f4f732ff-dd24-4d89-8ee0-19190d783490 req-2ad5b4ee-1a87-4e83-b764-1783f6a2230f service nova] Lock "1f15126e-6636-4765-8650-bb717f186efe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:51.686170 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f4f732ff-dd24-4d89-8ee0-19190d783490 req-2ad5b4ee-1a87-4e83-b764-1783f6a2230f service nova] Lock "1f15126e-6636-4765-8650-bb717f186efe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:51.686336 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f4f732ff-dd24-4d89-8ee0-19190d783490 req-2ad5b4ee-1a87-4e83-b764-1783f6a2230f service nova] [instance: 1f15126e-6636-4765-8650-bb717f186efe] No waiting events found dispatching network-vif-unplugged-22bcfb63-43d8-411b-814d-d824a342e51f {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:03:51.686483 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f4f732ff-dd24-4d89-8ee0-19190d783490 req-2ad5b4ee-1a87-4e83-b764-1783f6a2230f service nova] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Received event network-vif-unplugged-22bcfb63-43d8-411b-814d-d824a342e51f for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:03:52.183823 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Took 1.52 seconds to deallocate network for instance.
May 28 02:03:52.474252 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "e50227a8-b484-447b-abc6-3a3c1379e7ff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:52.474948 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "e50227a8-b484-447b-abc6-3a3c1379e7ff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:52.474948 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "e50227a8-b484-447b-abc6-3a3c1379e7ff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:52.474948 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "e50227a8-b484-447b-abc6-3a3c1379e7ff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:52.475035 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "e50227a8-b484-447b-abc6-3a3c1379e7ff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:52.477465 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Terminating instance
May 28 02:03:52.584687 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-dcd1d09a-967b-4289-b36f-0425cf4bcf4d tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Lock "ea390d12-4b20-4d31-9dc6-ec47b983ebfa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.292s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:52.690942 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e9eab70f-3622-4e4f-9f8d-d590b2a23259 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:52.691106 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e9eab70f-3622-4e4f-9f8d-d590b2a23259 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:52.980944 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 02:03:52.984938 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e9eab70f-3622-4e4f-9f8d-d590b2a23259 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:03:52.985435 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-e9eab70f-3622-4e4f-9f8d-d590b2a23259 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:03:53.004273 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:53.012522 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:53.040296 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:53.049866 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:53.074321 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:53.075997 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:53.305279 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:53.312459 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:53.317452 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.00034021200008282904 future=<Future at 0x7724ec2ba300 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:03:53.317572 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:03:53.317686 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=7.288140696000028 future=<Future at 0x7724ec1e2d50 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:03:53.317808 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=7.288049898000281 future=<Future at 0x7724ec1e2d50 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:03:53.318237 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Emitting event <LifecycleEvent: 1779933818.317013, e3e9a0d0-72cd-459e-8bc4-cf080adb5267 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:03:53.318746 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] VM Stopped (Lifecycle Event)
May 28 02:03:53.336339 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:53.338003 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999736510000275 future=<Future at 0x7724ec1e2780 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:03:53.340514 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Instance destroyed successfully.
May 28 02:03:53.341055 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lazy-loading 'resources' on Instance uuid e50227a8-b484-447b-abc6-3a3c1379e7ff {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:03:53.487701 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-e9eab70f-3622-4e4f-9f8d-d590b2a23259 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:03:53.754112 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-153012ce-fdd6-4512-a63e-13ba60cc16a4 req-f58a5e69-f0c0-4631-b887-d37649e61082 service nova] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Received event network-vif-unplugged-012d880f-9a02-47db-a8d6-2ea821b0bd72 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:03:53.756316 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-153012ce-fdd6-4512-a63e-13ba60cc16a4 req-f58a5e69-f0c0-4631-b887-d37649e61082 service nova] Acquiring lock "e50227a8-b484-447b-abc6-3a3c1379e7ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:53.756316 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-153012ce-fdd6-4512-a63e-13ba60cc16a4 req-f58a5e69-f0c0-4631-b887-d37649e61082 service nova] Lock "e50227a8-b484-447b-abc6-3a3c1379e7ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:53.756316 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-153012ce-fdd6-4512-a63e-13ba60cc16a4 req-f58a5e69-f0c0-4631-b887-d37649e61082 service nova] Lock "e50227a8-b484-447b-abc6-3a3c1379e7ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:53.756316 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-153012ce-fdd6-4512-a63e-13ba60cc16a4 req-f58a5e69-f0c0-4631-b887-d37649e61082 service nova] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] No waiting events found dispatching network-vif-unplugged-012d880f-9a02-47db-a8d6-2ea821b0bd72 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:03:53.756316 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-153012ce-fdd6-4512-a63e-13ba60cc16a4 req-f58a5e69-f0c0-4631-b887-d37649e61082 service nova] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Received event network-vif-unplugged-012d880f-9a02-47db-a8d6-2ea821b0bd72 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:03:53.756316 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-153012ce-fdd6-4512-a63e-13ba60cc16a4 req-f58a5e69-f0c0-4631-b887-d37649e61082 service nova] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Received event network-vif-unplugged-012d880f-9a02-47db-a8d6-2ea821b0bd72 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:03:53.756316 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-153012ce-fdd6-4512-a63e-13ba60cc16a4 req-f58a5e69-f0c0-4631-b887-d37649e61082 service nova] Acquiring lock "e50227a8-b484-447b-abc6-3a3c1379e7ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:53.756316 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-153012ce-fdd6-4512-a63e-13ba60cc16a4 req-f58a5e69-f0c0-4631-b887-d37649e61082 service nova] Lock "e50227a8-b484-447b-abc6-3a3c1379e7ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:53.756316 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-153012ce-fdd6-4512-a63e-13ba60cc16a4 req-f58a5e69-f0c0-4631-b887-d37649e61082 service nova] Lock "e50227a8-b484-447b-abc6-3a3c1379e7ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:53.756316 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-153012ce-fdd6-4512-a63e-13ba60cc16a4 req-f58a5e69-f0c0-4631-b887-d37649e61082 service nova] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] No waiting events found dispatching network-vif-unplugged-012d880f-9a02-47db-a8d6-2ea821b0bd72 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:03:53.756316 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-153012ce-fdd6-4512-a63e-13ba60cc16a4 req-f58a5e69-f0c0-4631-b887-d37649e61082 service nova] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Received event network-vif-unplugged-012d880f-9a02-47db-a8d6-2ea821b0bd72 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:03:53.821494 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: e3e9a0d0-72cd-459e-8bc4-cf080adb5267] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:03:53.843700 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:57:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-255087748',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-attachvolumemultiattachtest-server-255087748',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:58:16Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0474090f4f2d4950b51bc317f4302266',ramdisk_id='',reservation_id='r-hmv2n306',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-857456921',owner_user_name='tempest-AttachVolumeMultiAttachTest-857456921-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:58:17Z,user_data=None,user_id='cadb612e41314b06914d5f5f47570e98',uuid=e50227a8-b484-447b-abc6-3a3c1379e7ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "012d880f-9a02-47db-a8d6-2ea821b0bd72", "address": "fa:16:3e:48:7d:7b", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap012d880f-9a", "ovs_interfaceid": "012d880f-9a02-47db-a8d6-2ea821b0bd72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:03:53.844144 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Converting VIF {"id": "012d880f-9a02-47db-a8d6-2ea821b0bd72", "address": "fa:16:3e:48:7d:7b", "network": {"id": "043f3754-b9d5-4bd7-8352-f0334dbf2e4c", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-37288330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0474090f4f2d4950b51bc317f4302266", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap012d880f-9a", "ovs_interfaceid": "012d880f-9a02-47db-a8d6-2ea821b0bd72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:03:53.844816 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:7d:7b,bridge_name='br-int',has_traffic_filtering=True,id=012d880f-9a02-47db-a8d6-2ea821b0bd72,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap012d880f-9a') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:03:53.844962 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:7d:7b,bridge_name='br-int',has_traffic_filtering=True,id=012d880f-9a02-47db-a8d6-2ea821b0bd72,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap012d880f-9a') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:03:53.846125 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:53.846353 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap012d880f-9a, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:03:53.856982 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:53.858232 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:03:53.859310 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:53.859310 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6dc5d630-202c-4d53-9a18-556102004057) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:03:53.859957 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:53.861429 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:03:53.863383 np0000001583 nova-compute[98241]: INFO os_vif [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:7d:7b,bridge_name='br-int',has_traffic_filtering=True,id=012d880f-9a02-47db-a8d6-2ea821b0bd72,network=Network(043f3754-b9d5-4bd7-8352-f0334dbf2e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap012d880f-9a')
May 28 02:03:53.897419 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:03:53.897690 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4f727671-7b59-48c4-9bb3-9fc3f3a25a71', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:03:53.897827 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:03:53.898160 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:03:53.898420 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4f727671-7b59-48c4-9bb3-9fc3f3a25a71', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:03:53.898561 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:03:53.923148 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:03:53.923148 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:03:53.923148 np0000001583 nova-compute[98241]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b (non-flash)
May 28 02:03:53.923148 np0000001583 nova-compute[98241]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b (non-flash)
May 28 02:03:53.923148 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:03:53.923148 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:03:53.923148 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:03:53.923148 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsi session list stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:03:53.923148 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:03:53.923148 np0000001583 nova-compute[98241]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b (non-flash)
May 28 02:03:53.923148 np0000001583 nova-compute[98241]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b (non-flash)
May 28 02:03:53.923148 np0000001583 nova-compute[98241]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:03:53.923148 np0000001583 nova-compute[98241]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71 (non-flash)
May 28 02:03:53.923148 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:03:53.923148 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86', '109'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86', '110'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b', '120'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b', '121'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', '68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', '69')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:03:53.923591 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', '68')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:03:53.924316 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71', '69')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:03:53.925307 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f90b94e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71'): ({'sdc'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:03:53.925542 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Removing multipathed devices sdc, sdb {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:03:53.925825 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Flush multipath device 330000000adc57e53 {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:03:53.981569 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:03:53.996186 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e9eab70f-3622-4e4f-9f8d-d590b2a23259 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.305s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:54.021410 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:03:54.059968 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:03:54.060408 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-e9eab70f-3622-4e4f-9f8d-d590b2a23259 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Deleted allocations for instance 1f15126e-6636-4765-8650-bb717f186efe
May 28 02:03:54.062694 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:03:54.064276 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:03:54.075134 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:03:54.075519 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:03:54.089845 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:03:54.126685 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71, portal: 192.168.40.100,3260]
May 28 02:03:54.126685 np0000001583 nova-compute[98241]: Logout of [sid: 68, target: iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71, portal: 192.168.40.100,3260] successful.
May 28 02:03:54.126685 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:03:54.145127 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:03:54.159248 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:03:54.190405 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71, portal: 192.168.50.100,3260]
May 28 02:03:54.190405 np0000001583 nova-compute[98241]: Logout of [sid: 69, target: iqn.2023-03.storpool.com:os--volume-4f727671-7b59-48c4-9bb3-9fc3f3a25a71, portal: 192.168.50.100,3260] successful.
May 28 02:03:54.190405 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:03:54.208407 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:03:54.208715 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:03:54.208914 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] <== disconnect_volume: return (311ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:03:54.209044 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:03:54.209330 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Deleting instance files /opt/stack/data/nova/instances/e50227a8-b484-447b-abc6-3a3c1379e7ff_del
May 28 02:03:54.209832 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Deletion of /opt/stack/data/nova/instances/e50227a8-b484-447b-abc6-3a3c1379e7ff_del complete
May 28 02:03:54.272860 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Acquiring lock "22694475-4a1d-4eeb-881f-52234bd9bb7d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:54.273140 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Lock "22694475-4a1d-4eeb-881f-52234bd9bb7d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:54.716388 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Took 1.74 seconds to destroy the instance on the hypervisor.
May 28 02:03:54.717039 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 02:03:54.717252 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 02:03:54.717387 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 02:03:54.717536 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:03:54.775680 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 02:03:54.800291 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:03:55.070866 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e9eab70f-3622-4e4f-9f8d-d590b2a23259 tempest-VolumesBackupsTest-759555243 tempest-VolumesBackupsTest-759555243-project-member] Lock "1f15126e-6636-4765-8650-bb717f186efe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.300s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:55.326696 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:55.326844 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:55.330242 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 02:03:55.330370 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Claim successful on node np0000001583
May 28 02:03:55.611198 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:03:55.827578 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5885b1b2-a612-49dd-922b-2af5aaec8a1e req-67138754-2db0-4e16-b5db-33c08014fcb1 service nova] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Received event network-vif-deleted-012d880f-9a02-47db-a8d6-2ea821b0bd72 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:03:56.113255 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Took 1.40 seconds to deallocate network for instance.
May 28 02:03:56.256545 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Acquiring lock "9a804913-4bfb-4dba-9efe-cbf7c575d8d1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:56.257067 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Lock "9a804913-4bfb-4dba-9efe-cbf7c575d8d1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:56.617768 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:03:56.617994 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:03:56.668537 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Took 0.55 seconds to detach 1 volumes for instance.
May 28 02:03:56.760900 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Lazy-loading 'flavor' on Instance uuid 9a804913-4bfb-4dba-9efe-cbf7c575d8d1 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:03:57.120415 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:03:57.174279 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:57.630256 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.303s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:57.630622 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 02:03:57.636346 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.461s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:57.767051 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Lock "9a804913-4bfb-4dba-9efe-cbf7c575d8d1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:57.927525 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:03:57.927906 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:03:58.139396 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 02:03:58.143766 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 02:03:58.143766 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:03:58.143766 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:03:58.259456 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bdd7dc60a5d6477e9a120c0dbfd7384e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c38124ed2774a80a79d62c26d43f4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 02:03:58.339309 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:58.432579 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:03:58.641031 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 02:03:58.860837 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:58.861703 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Acquiring lock "9a804913-4bfb-4dba-9efe-cbf7c575d8d1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:03:58.861932 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Lock "9a804913-4bfb-4dba-9efe-cbf7c575d8d1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:03:58.862139 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Attaching volume 991907e5-2b73-4365-be97-ba364c2019e3 to /dev/vdb
May 28 02:03:58.873157 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Successfully created port: a4c1b0fa-5874-4114-a2d3-2a1e87ab10de {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 02:03:58.916891 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:03:58.931666 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 02:03:58.939260 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:03:58.941676 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.307s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:03:58.955900 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:03:59.003956 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 02:03:59.004237 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 02:03:59.017116 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 02:03:59.017116 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe9e:36ca', 'fe80::34e0:eeff:fee2:bede', 'fe80::fc16:3eff:fe92:c4', 'fe80::6011:8bff:feac:407a', 'fe80::fc16:3eff:fe89:8347'] 
May 28 02:03:59.017116 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 02:03:59.017116 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 02:03:59.017116 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] <== get_connector_properties: return (99ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:03:59.017116 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Updating existing volume attachment record: b1379380-2602-4e20-b77a-eb34c46bf117 {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 02:03:59.027101 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Deleted allocations for instance e50227a8-b484-447b-abc6-3a3c1379e7ff
May 28 02:03:59.144625 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 02:03:59.385901 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Successfully updated port: a4c1b0fa-5874-4114-a2d3-2a1e87ab10de {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 02:03:59.435508 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9b7cf075-d4fe-4c9e-b6c9-6819776a6dbc req-a9a7afcd-a8d2-4c67-8b83-d2f8e4d6365f service nova] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Received event network-changed-a4c1b0fa-5874-4114-a2d3-2a1e87ab10de {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:03:59.435673 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9b7cf075-d4fe-4c9e-b6c9-6819776a6dbc req-a9a7afcd-a8d2-4c67-8b83-d2f8e4d6365f service nova] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Refreshing instance network info cache due to event network-changed-a4c1b0fa-5874-4114-a2d3-2a1e87ab10de. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:03:59.435913 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9b7cf075-d4fe-4c9e-b6c9-6819776a6dbc req-a9a7afcd-a8d2-4c67-8b83-d2f8e4d6365f service nova] Acquiring lock "refresh_cache-22694475-4a1d-4eeb-881f-52234bd9bb7d" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:03:59.436034 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9b7cf075-d4fe-4c9e-b6c9-6819776a6dbc req-a9a7afcd-a8d2-4c67-8b83-d2f8e4d6365f service nova] Acquired lock "refresh_cache-22694475-4a1d-4eeb-881f-52234bd9bb7d" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:03:59.436164 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-9b7cf075-d4fe-4c9e-b6c9-6819776a6dbc req-a9a7afcd-a8d2-4c67-8b83-d2f8e4d6365f service nova] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Refreshing network info cache for port a4c1b0fa-5874-4114-a2d3-2a1e87ab10de {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:03:59.581550 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 02:03:59.582068 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3', 'iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '991907e5-2b73-4365-be97-ba364c2019e3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:03:59.582302 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:03:59.583044 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:03:59.583347 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3', 'iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '991907e5-2b73-4365-be97-ba364c2019e3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 02:03:59.600262 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:03:59.600900 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:03:59.601329 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:03:59.601521 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:03:59.602049 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:03:59.602049 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:03:59.613599 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:03:59.613599 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:03:59.617633 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:03:59.617633 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:03:59.625585 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3] added
May 28 02:03:59.625585 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:03:59.625585 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:03:59.625585 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:03:59.625585 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:03:59.625585 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:03:59.625585 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:03:59.625819 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:03:59.625949 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0244(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:03:59.626127 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:03:59.630437 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3] added
May 28 02:03:59.630437 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:03:59.630437 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:03:59.630437 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:03:59.630437 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:03:59.630437 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:03:59.630437 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:03:59.630615 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:03:59.630728 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0287(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:03:59.630875 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:03:59.888437 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Acquiring lock "refresh_cache-22694475-4a1d-4eeb-881f-52234bd9bb7d" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:03:59.938772 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-9b7cf075-d4fe-4c9e-b6c9-6819776a6dbc req-a9a7afcd-a8d2-4c67-8b83-d2f8e4d6365f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:04:00.020389 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-9b7cf075-d4fe-4c9e-b6c9-6819776a6dbc req-a9a7afcd-a8d2-4c67-8b83-d2f8e4d6365f service nova] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:04:00.037991 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-23e325b3-8fda-4d10-bd26-334afcf739b7 tempest-AttachVolumeMultiAttachTest-857456921 tempest-AttachVolumeMultiAttachTest-857456921-project-member] Lock "e50227a8-b484-447b-abc6-3a3c1379e7ff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.564s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:00.159174 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 02:04:00.160181 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 02:04:00.160380 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Creating image(s)
May 28 02:04:00.160802 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Acquiring lock "/opt/stack/data/nova/instances/22694475-4a1d-4eeb-881f-52234bd9bb7d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:00.160960 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Lock "/opt/stack/data/nova/instances/22694475-4a1d-4eeb-881f-52234bd9bb7d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:00.162377 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Lock "/opt/stack/data/nova/instances/22694475-4a1d-4eeb-881f-52234bd9bb7d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:00.162865 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:04:00.168867 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:04:00.171435 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-9b7cf075-d4fe-4c9e-b6c9-6819776a6dbc req-a9a7afcd-a8d2-4c67-8b83-d2f8e4d6365f service nova] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:04:00.172608 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:04:00.260912 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.088s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:04:00.261273 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:00.261714 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:00.262143 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:04:00.264502 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:04:00.264824 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:04:00.356983 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.092s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:04:00.357455 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/22694475-4a1d-4eeb-881f-52234bd9bb7d/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:04:00.412918 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/22694475-4a1d-4eeb-881f-52234bd9bb7d/disk 1073741824" returned: 0 in 0.055s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:04:00.413445 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.152s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:00.414467 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:04:00.507155 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.092s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:04:00.507642 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Checking if we can resize image /opt/stack/data/nova/instances/22694475-4a1d-4eeb-881f-52234bd9bb7d/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 02:04:00.507873 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22694475-4a1d-4eeb-881f-52234bd9bb7d/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:04:00.606974 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0007602299997415685 future=<Future at 0x7724ec1e2d50 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:04:00.606974 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:04:00.606974 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=1.55154276400026 future=<Future at 0x7724f85d5ac0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:04:00.606974 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=1.551447547999942 future=<Future at 0x7724f85d5ac0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:04:00.611182 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] Emitting event <LifecycleEvent: 1779933825.6057658, 22bbb8cf-c11d-4025-8551-4c1c3557264a => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:04:00.611182 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] VM Stopped (Lifecycle Event)
May 28 02:04:00.617654 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22694475-4a1d-4eeb-881f-52234bd9bb7d/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:04:00.618086 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Cannot resize image /opt/stack/data/nova/instances/22694475-4a1d-4eeb-881f-52234bd9bb7d/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 02:04:00.618480 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 02:04:00.618716 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Ensure instance console log exists: /opt/stack/data/nova/instances/22694475-4a1d-4eeb-881f-52234bd9bb7d/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 02:04:00.619003 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:00.619228 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:00.619361 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:00.627074 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:04:00.631381 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:04:00.642123 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:04:00.642123 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:04:00.650421 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:04:00.650421 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:04:00.658364 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:04:00.672650 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:04:00.673600 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9b7cf075-d4fe-4c9e-b6c9-6819776a6dbc req-a9a7afcd-a8d2-4c67-8b83-d2f8e4d6365f service nova] Releasing lock "refresh_cache-22694475-4a1d-4eeb-881f-52234bd9bb7d" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:04:00.674141 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Acquired lock "refresh_cache-22694475-4a1d-4eeb-881f-52234bd9bb7d" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:04:00.674646 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:04:00.679153 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:04:00.679153 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:04:00.679153 np0000001583 nova-compute[98241]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b (non-flash)
May 28 02:04:00.679153 np0000001583 nova-compute[98241]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b (non-flash)
May 28 02:04:00.679153 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:04:00.679333 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] iscsi session list stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:04:00.679333 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:04:00.679333 np0000001583 nova-compute[98241]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b (non-flash)
May 28 02:04:00.679333 np0000001583 nova-compute[98241]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b (non-flash)
May 28 02:04:00.679333 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:04:00.688535 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:04:00.688535 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:04:00.688535 np0000001583 nova-compute[98241]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b (non-flash)
May 28 02:04:00.688535 np0000001583 nova-compute[98241]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b (non-flash)
May 28 02:04:00.688535 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:04:00.688717 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] iscsi session list stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:04:00.688717 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:04:00.688717 np0000001583 nova-compute[98241]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b (non-flash)
May 28 02:04:00.688717 np0000001583 nova-compute[98241]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b (non-flash)
May 28 02:04:00.688717 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:04:00.713643 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3, portal: 192.168.40.100,3260]
May 28 02:04:00.713643 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3, portal: 192.168.40.100,3260] successful.
May 28 02:04:00.713643 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:04:00.730548 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:04:00.737623 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3, portal: 192.168.50.100,3260]
May 28 02:04:00.737623 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3, portal: 192.168.50.100,3260] successful.
May 28 02:04:00.737623 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:04:00.746600 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:04:00.746600 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:04:00.746600 np0000001583 nova-compute[98241]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b (non-flash)
May 28 02:04:00.746600 np0000001583 nova-compute[98241]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b (non-flash)
May 28 02:04:00.746600 np0000001583 nova-compute[98241]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3 (non-flash)
May 28 02:04:00.746600 np0000001583 nova-compute[98241]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3 (non-flash)
May 28 02:04:00.746600 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:04:00.746858 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] iscsi session list stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:04:00.746858 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:04:00.746858 np0000001583 nova-compute[98241]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b (non-flash)
May 28 02:04:00.746858 np0000001583 nova-compute[98241]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b (non-flash)
May 28 02:04:00.746858 np0000001583 nova-compute[98241]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3 (non-flash)
May 28 02:04:00.746858 np0000001583 nova-compute[98241]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3 (non-flash)
May 28 02:04:00.746858 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:04:00.747161 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.146s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:04:00.747392 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:04:00.748046 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] HCTL ('7', '-', '-', 0) found on session 124 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:04:00.748170 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:04:00.753131 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:04:00.765661 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Searching for a device in session 124 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:04:00.765661 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '991907e5-2b73-4365-be97-ba364c2019e3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:04:00.772896 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:04:00.772896 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:04:00.772896 np0000001583 nova-compute[98241]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b (non-flash)
May 28 02:04:00.772896 np0000001583 nova-compute[98241]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b (non-flash)
May 28 02:04:00.772896 np0000001583 nova-compute[98241]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3 (non-flash)
May 28 02:04:00.772896 np0000001583 nova-compute[98241]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3 (non-flash)
May 28 02:04:00.772896 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:04:00.773104 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] iscsi session list stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:04:00.773104 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:04:00.773104 np0000001583 nova-compute[98241]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b (non-flash)
May 28 02:04:00.773104 np0000001583 nova-compute[98241]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b (non-flash)
May 28 02:04:00.773104 np0000001583 nova-compute[98241]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3 (non-flash)
May 28 02:04:00.773104 np0000001583 nova-compute[98241]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3 (non-flash)
May 28 02:04:00.773104 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:04:00.773370 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.172s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:04:00.773527 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:04:00.774424 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] HCTL ('8', '-', '-', 0) found on session 125 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:04:00.774564 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:04:00.790187 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Searching for a device in session 125 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:04:00.790187 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '991907e5-2b73-4365-be97-ba364c2019e3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:04:01.122148 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3ce7b9ca-d6d9-4f7e-ab3c-5baf45b5c659 tempest-AttachVolumeNegativeTest-169599115 tempest-AttachVolumeNegativeTest-169599115-project-member] [instance: 22bbb8cf-c11d-4025-8551-4c1c3557264a] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:04:01.247194 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:04:01.426522 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:04:01.602503 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 02:04:01.608601 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Updating instance_info_cache with network_info: [{"id": "a4c1b0fa-5874-4114-a2d3-2a1e87ab10de", "address": "fa:16:3e:e2:f4:ae", "network": {"id": "759a6e43-6d1b-44d5-92ea-4f798fb303e0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1542618898-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c38124ed2774a80a79d62c26d43f4da", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c1b0fa-58", "ovs_interfaceid": "a4c1b0fa-5874-4114-a2d3-2a1e87ab10de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:04:02.111990 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Releasing lock "refresh_cache-22694475-4a1d-4eeb-881f-52234bd9bb7d" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:04:02.112389 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Instance network_info: |[{"id": "a4c1b0fa-5874-4114-a2d3-2a1e87ab10de", "address": "fa:16:3e:e2:f4:ae", "network": {"id": "759a6e43-6d1b-44d5-92ea-4f798fb303e0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1542618898-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c38124ed2774a80a79d62c26d43f4da", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c1b0fa-58", "ovs_interfaceid": "a4c1b0fa-5874-4114-a2d3-2a1e87ab10de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 02:04:02.114285 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Start _get_guest_xml network_info=[{"id": "a4c1b0fa-5874-4114-a2d3-2a1e87ab10de", "address": "fa:16:3e:e2:f4:ae", "network": {"id": "759a6e43-6d1b-44d5-92ea-4f798fb303e0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1542618898-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c38124ed2774a80a79d62c26d43f4da", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c1b0fa-58", "ovs_interfaceid": "a4c1b0fa-5874-4114-a2d3-2a1e87ab10de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 02:04:02.116983 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:04:02.118312 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-2113594863', uuid='22694475-4a1d-4eeb-881f-52234bd9bb7d'), owner=OwnerMeta(userid='bdd7dc60a5d6477e9a120c0dbfd7384e', username='tempest-VolumesActionsTest-1125296363-project-member', projectid='1c38124ed2774a80a79d62c26d43f4da', projectname='tempest-VolumesActionsTest-1125296363'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a4c1b0fa-5874-4114-a2d3-2a1e87ab10de", "address": "fa:16:3e:e2:f4:ae", "network": {"id": "759a6e43-6d1b-44d5-92ea-4f798fb303e0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1542618898-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c38124ed2774a80a79d62c26d43f4da", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c1b0fa-58", "ovs_interfaceid": "a4c1b0fa-5874-4114-a2d3-2a1e87ab10de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933842.1179578) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 02:04:02.119493 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 02:04:02.119881 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 02:04:02.120835 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 02:04:02.121011 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 02:04:02.121949 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 02:04:02.122323 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 02:04:02.122482 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 02:04:02.122557 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 02:04:02.122750 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 02:04:02.122800 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 02:04:02.122895 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 02:04:02.123037 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 02:04:02.123174 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 02:04:02.123286 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 02:04:02.123371 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 02:04:02.123513 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 02:04:02.135255 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:03:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2113594863',display_name='tempest-VolumesActionsTest-instance-2113594863',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-volumesactionstest-instance-2113594863',id=55,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c38124ed2774a80a79d62c26d43f4da',ramdisk_id='',reservation_id='r-5n7tyfyv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1125296363',owner_user_name='tempest-VolumesActionsTest-1125296363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:03:59Z,user_data=None,user_id='bdd7dc60a5d6477e9a120c0dbfd7384e',uuid=22694475-4a1d-4eeb-881f-52234bd9bb7d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4c1b0fa-5874-4114-a2d3-2a1e87ab10de", "address": "fa:16:3e:e2:f4:ae", "network": {"id": "759a6e43-6d1b-44d5-92ea-4f798fb303e0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1542618898-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c38124ed2774a80a79d62c26d43f4da", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c1b0fa-58", "ovs_interfaceid": "a4c1b0fa-5874-4114-a2d3-2a1e87ab10de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 02:04:02.135441 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Converting VIF {"id": "a4c1b0fa-5874-4114-a2d3-2a1e87ab10de", "address": "fa:16:3e:e2:f4:ae", "network": {"id": "759a6e43-6d1b-44d5-92ea-4f798fb303e0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1542618898-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c38124ed2774a80a79d62c26d43f4da", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c1b0fa-58", "ovs_interfaceid": "a4c1b0fa-5874-4114-a2d3-2a1e87ab10de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:04:02.136109 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:f4:ae,bridge_name='br-int',has_traffic_filtering=True,id=a4c1b0fa-5874-4114-a2d3-2a1e87ab10de,network=Network(759a6e43-6d1b-44d5-92ea-4f798fb303e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4c1b0fa-58') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:04:02.136827 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Lazy-loading 'pci_devices' on Instance uuid 22694475-4a1d-4eeb-881f-52234bd9bb7d {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:04:02.158802 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0003200659998583433 future=<Future at 0x7724f85d5ac0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:04:02.158945 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:04:02.159034 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=2.4671032000001105 future=<Future at 0x7724ec1e29f0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:04:02.159103 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=2.4670028639998236 future=<Future at 0x7724ec1e29f0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:04:02.159560 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Emitting event <LifecycleEvent: 1779933827.1583612, ea390d12-4b20-4d31-9dc6-ec47b983ebfa => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:04:02.159715 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] VM Stopped (Lifecycle Event)
May 28 02:04:02.619710 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Found WWN 3300000000771e24c for multipath device dm-0 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 02:04:02.621430 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:04:02.621430 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '3300000000771e24c', 'path': '/dev/dm-0', 'multipath_id': '3300000000771e24c'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:04:02.621430 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000000771e24c', 'path': '/dev/dm-0', 'multipath_id': '3300000000771e24c'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 02:04:02.624397 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Lazy-loading 'flavor' on Instance uuid 9a804913-4bfb-4dba-9efe-cbf7c575d8d1 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:04:02.640355 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] End _get_guest_xml xml=<domain type="qemu">
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:   <uuid>22694475-4a1d-4eeb-881f-52234bd9bb7d</uuid>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:   <name>instance-00000037</name>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:   <metadata>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:       <nova:name>tempest-VolumesActionsTest-instance-2113594863</nova:name>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 02:04:02</nova:creationTime>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:       </nova:image>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:         <nova:user uuid="bdd7dc60a5d6477e9a120c0dbfd7384e">tempest-VolumesActionsTest-1125296363-project-member</nova:user>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:         <nova:project uuid="1c38124ed2774a80a79d62c26d43f4da">tempest-VolumesActionsTest-1125296363</nova:project>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:         <nova:port uuid="a4c1b0fa-5874-4114-a2d3-2a1e87ab10de">
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:         </nova:port>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:   </metadata>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:     <system>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:       <entry name="serial">22694475-4a1d-4eeb-881f-52234bd9bb7d</entry>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:       <entry name="uuid">22694475-4a1d-4eeb-881f-52234bd9bb7d</entry>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:     </system>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:   <os>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:   </os>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:   <features>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:     <acpi/>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:     <tcg>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:     </tcg>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:   </features>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:   </cpu>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:   <devices>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/22694475-4a1d-4eeb-881f-52234bd9bb7d/disk"/>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:     </disk>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/22694475-4a1d-4eeb-881f-52234bd9bb7d/disk.config"/>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:     </disk>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:e2:f4:ae"/>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:       <target dev="tapa4c1b0fa-58"/>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:     </interface>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/22694475-4a1d-4eeb-881f-52234bd9bb7d/console.log" append="off"/>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:     </serial>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:     <video>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:     </video>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:     </rng>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:     </memballoon>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:   </devices>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]: </domain>
May 28 02:04:02.640355 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 02:04:02.643145 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Preparing to wait for external event network-vif-plugged-a4c1b0fa-5874-4114-a2d3-2a1e87ab10de {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 02:04:02.643145 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Acquiring lock "22694475-4a1d-4eeb-881f-52234bd9bb7d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:02.643145 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Lock "22694475-4a1d-4eeb-881f-52234bd9bb7d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:02.643145 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Lock "22694475-4a1d-4eeb-881f-52234bd9bb7d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:02.643145 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:03:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2113594863',display_name='tempest-VolumesActionsTest-instance-2113594863',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-volumesactionstest-instance-2113594863',id=55,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c38124ed2774a80a79d62c26d43f4da',ramdisk_id='',reservation_id='r-5n7tyfyv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1125296363',owner_user_name='tempest-VolumesActionsTest-1125296363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:03:59Z,user_data=None,user_id='bdd7dc60a5d6477e9a120c0dbfd7384e',uuid=22694475-4a1d-4eeb-881f-52234bd9bb7d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4c1b0fa-5874-4114-a2d3-2a1e87ab10de", "address": "fa:16:3e:e2:f4:ae", "network": {"id": "759a6e43-6d1b-44d5-92ea-4f798fb303e0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1542618898-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c38124ed2774a80a79d62c26d43f4da", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c1b0fa-58", "ovs_interfaceid": "a4c1b0fa-5874-4114-a2d3-2a1e87ab10de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 02:04:02.643145 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Converting VIF {"id": "a4c1b0fa-5874-4114-a2d3-2a1e87ab10de", "address": "fa:16:3e:e2:f4:ae", "network": {"id": "759a6e43-6d1b-44d5-92ea-4f798fb303e0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1542618898-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c38124ed2774a80a79d62c26d43f4da", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c1b0fa-58", "ovs_interfaceid": "a4c1b0fa-5874-4114-a2d3-2a1e87ab10de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:04:02.643145 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:f4:ae,bridge_name='br-int',has_traffic_filtering=True,id=a4c1b0fa-5874-4114-a2d3-2a1e87ab10de,network=Network(759a6e43-6d1b-44d5-92ea-4f798fb303e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4c1b0fa-58') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:04:02.643668 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:f4:ae,bridge_name='br-int',has_traffic_filtering=True,id=a4c1b0fa-5874-4114-a2d3-2a1e87ab10de,network=Network(759a6e43-6d1b-44d5-92ea-4f798fb303e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4c1b0fa-58') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 02:04:02.644461 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:02.644826 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:04:02.645195 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 02:04:02.645938 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:02.646164 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '97d0daab-739f-583b-8931-ecc3b4863860', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:04:02.647539 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:02.648330 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:04:02.650058 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:02.650205 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa4c1b0fa-58, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:04:02.650470 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa4c1b0fa-58, col_values=(('qos', UUID('611232b3-30bd-4c61-bfdc-783aeb00650c')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:04:02.650610 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa4c1b0fa-58, col_values=(('external_ids', {'iface-id': 'a4c1b0fa-5874-4114-a2d3-2a1e87ab10de', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:f4:ae', 'vm-uuid': '22694475-4a1d-4eeb-881f-52234bd9bb7d'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:04:02.651310 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:02.652583 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:04:02.656456 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:02.657211 np0000001583 nova-compute[98241]: INFO os_vif [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:f4:ae,bridge_name='br-int',has_traffic_filtering=True,id=a4c1b0fa-5874-4114-a2d3-2a1e87ab10de,network=Network(759a6e43-6d1b-44d5-92ea-4f798fb303e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4c1b0fa-58')
May 28 02:04:02.661746 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: ea390d12-4b20-4d31-9dc6-ec47b983ebfa] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:04:02.971473 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "9dd6bff7-c612-44cb-a1f2-9e1b26f5f342" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:02.971699 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "9dd6bff7-c612-44cb-a1f2-9e1b26f5f342" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:02.971926 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "9dd6bff7-c612-44cb-a1f2-9e1b26f5f342-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:02.972123 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "9dd6bff7-c612-44cb-a1f2-9e1b26f5f342-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:02.972273 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "9dd6bff7-c612-44cb-a1f2-9e1b26f5f342-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:02.974753 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Terminating instance
May 28 02:04:03.127740 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Attempting to attach volume 991907e5-2b73-4365-be97-ba364c2019e3 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98241) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 02:04:03.130179 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] attach device xml: <disk type="block" device="disk">
May 28 02:04:03.130179 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:04:03.130179 np0000001583 nova-compute[98241]:   <alias name="ua-991907e5-2b73-4365-be97-ba364c2019e3"/>
May 28 02:04:03.130179 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-0"/>
May 28 02:04:03.130179 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:04:03.130179 np0000001583 nova-compute[98241]:   <serial>991907e5-2b73-4365-be97-ba364c2019e3</serial>
May 28 02:04:03.130179 np0000001583 nova-compute[98241]: </disk>
May 28 02:04:03.130179 np0000001583 nova-compute[98241]:  {{(pid=98241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 02:04:03.394008 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:03.397127 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:03.478419 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 02:04:03.500007 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:03.504227 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:03.530281 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:03.707651 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:03.719462 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:03.783492 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-801f2cbd-0213-41fe-af78-73e8756f1c3d req-8530384e-98fd-4c35-b43b-b787e767aeeb service nova] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Received event network-vif-unplugged-1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:04:03.783492 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-801f2cbd-0213-41fe-af78-73e8756f1c3d req-8530384e-98fd-4c35-b43b-b787e767aeeb service nova] Acquiring lock "9dd6bff7-c612-44cb-a1f2-9e1b26f5f342-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:03.783492 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-801f2cbd-0213-41fe-af78-73e8756f1c3d req-8530384e-98fd-4c35-b43b-b787e767aeeb service nova] Lock "9dd6bff7-c612-44cb-a1f2-9e1b26f5f342-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:03.783492 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-801f2cbd-0213-41fe-af78-73e8756f1c3d req-8530384e-98fd-4c35-b43b-b787e767aeeb service nova] Lock "9dd6bff7-c612-44cb-a1f2-9e1b26f5f342-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:03.783714 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-801f2cbd-0213-41fe-af78-73e8756f1c3d req-8530384e-98fd-4c35-b43b-b787e767aeeb service nova] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] No waiting events found dispatching network-vif-unplugged-1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:04:03.783828 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-801f2cbd-0213-41fe-af78-73e8756f1c3d req-8530384e-98fd-4c35-b43b-b787e767aeeb service nova] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Received event network-vif-unplugged-1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:04:03.832554 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:03.845173 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:03.856769 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999701435000134 future=<Future at 0x7724ec2ba720 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:04:03.862729 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Instance destroyed successfully.
May 28 02:04:03.863418 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lazy-loading 'resources' on Instance uuid 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:04:04.175002 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:04:04.175207 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:04:04.175376 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] No VIF found with MAC fa:16:3e:e2:f4:ae, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:04:04.176018 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Using config drive
May 28 02:04:04.366279 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T02:03:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1267349814',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1267349814',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testvolumebootpattern-image-snapshot-server-1267349814',id=53,image_ref='fd8ee45b-4fe8-46c2-88d1-c61b282193b0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnEzyzDUw8RFEmiLx3V+KNBPQ659ZCf3P2NKggjsjnnUTXEpRSMlYuikYqpQK1F6mYNi/olRPQ6Y5KSaeP5tA676PQRn5cMJv/9KhK5iTd3ekdgY1q3bXvv4d+nK3YPJQ==',key_name='tempest-keypair-357597489',keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:03:24Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='432aa1094ced436494def17a875aa8e1',ramdisk_id='',reservation_id='r-s2nf99u1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='raw',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1031057169',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1031057169-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1031057169',owner_user_name='tempest-TestVolumeBootPattern-1031057169-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T02:03:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6be314b4eed642c3b2c72fe115860220',uuid=9dd6bff7-c612-44cb-a1f2-9e1b26f5f342,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc", "address": "fa:16:3e:89:83:47", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e0cbc1d-c7", "ovs_interfaceid": "1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:04:04.366570 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converting VIF {"id": "1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc", "address": "fa:16:3e:89:83:47", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e0cbc1d-c7", "ovs_interfaceid": "1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:04:04.367044 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:83:47,bridge_name='br-int',has_traffic_filtering=True,id=1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e0cbc1d-c7') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:04:04.367298 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:83:47,bridge_name='br-int',has_traffic_filtering=True,id=1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e0cbc1d-c7') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:04:04.369290 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:04.369571 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e0cbc1d-c7, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:04:04.370674 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:04.371421 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:04:04.377048 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:04.378115 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:04.378321 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f66eddf1-e196-4c54-ac13-fbd33c3b62c1) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:04:04.379609 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:04.379609 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:04:04.386228 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:04.388792 np0000001583 nova-compute[98241]: INFO os_vif [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:83:47,bridge_name='br-int',has_traffic_filtering=True,id=1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e0cbc1d-c7')
May 28 02:04:04.390860 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:04:04.391280 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b', 'iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a666df4f-490f-44bd-8bc4-7729f124192b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:04:04.391442 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:04:04.541972 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:04.626509 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0003675749999274558 future=<Future at 0x7724ec1e29f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:04:04.626976 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Emitting event <LifecycleEvent: 1779933829.6260488, 1f15126e-6636-4765-8650-bb717f186efe => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:04:04.627303 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:04:04.627602 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 1f15126e-6636-4765-8650-bb717f186efe] VM Stopped (Lifecycle Event)
May 28 02:04:04.628696 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=3.709051332999934 future=<Future at 0x7724ec1e2780 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:04:04.628933 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=3.7087889849999556 future=<Future at 0x7724ec1e2780 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:04:04.681786 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:04:04.787003 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:04:04.790106 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:04:04.790106 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:04:04.790106 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] No VIF found with MAC fa:16:3e:92:00:c4, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:04:04.846450 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.455s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:04:04.846891 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b', 'iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a666df4f-490f-44bd-8bc4-7729f124192b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:04:04.847158 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:04:04.883450 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Creating config drive at /opt/stack/data/nova/instances/22694475-4a1d-4eeb-881f-52234bd9bb7d/disk.config
May 28 02:04:04.884150 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:04:04.884150 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:04:04.884150 np0000001583 nova-compute[98241]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b (non-flash)
May 28 02:04:04.884150 np0000001583 nova-compute[98241]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b (non-flash)
May 28 02:04:04.884150 np0000001583 nova-compute[98241]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3 (non-flash)
May 28 02:04:04.884150 np0000001583 nova-compute[98241]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3 (non-flash)
May 28 02:04:04.884150 np0000001583 nova-compute[98241]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ab8b729c-53c6-4822-a0d9-75a6fe812845 (non-flash)
May 28 02:04:04.884150 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:04:04.884370 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:04:04.884370 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:04:04.884370 np0000001583 nova-compute[98241]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b (non-flash)
May 28 02:04:04.884370 np0000001583 nova-compute[98241]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b (non-flash)
May 28 02:04:04.884370 np0000001583 nova-compute[98241]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3 (non-flash)
May 28 02:04:04.884370 np0000001583 nova-compute[98241]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3 (non-flash)
May 28 02:04:04.884370 np0000001583 nova-compute[98241]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ab8b729c-53c6-4822-a0d9-75a6fe812845 (non-flash)
May 28 02:04:04.884370 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:04:04.884551 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86', '109'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86', '110'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b', '120'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b', '121'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3', '124'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3', '125'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ab8b729c-53c6-4822-a0d9-75a6fe812845', '126')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:04:04.884709 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b', '120')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:04:04.886468 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b', '121')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:04:04.888478 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724ec1ada80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b'): ({'sde'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:04:04.889141 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Removing multipathed devices sdf, sde {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:04:04.889141 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Flush multipath device 330000000cbbc8017 {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:04:04.891780 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/22694475-4a1d-4eeb-881f-52234bd9bb7d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4s8ot85u {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:04:04.947345 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:04:04.958619 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/22694475-4a1d-4eeb-881f-52234bd9bb7d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4s8ot85u" returned: 0 in 0.067s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:04:04.999209 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:04:05.043141 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Checking to see if SCSI volumes sdf, sde have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:04:05.043326 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] SCSI volumes sdf, sde have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:04:05.047292 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Checking to see if device paths {'sdf', 'sde'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:04:05.063004 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Device paths {'sdf', 'sde'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:04:05.063394 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:04:05.080628 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:04:05.123103 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 120, target: iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b, portal: 192.168.40.100,3260]
May 28 02:04:05.123103 np0000001583 nova-compute[98241]: Logout of [sid: 120, target: iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b, portal: 192.168.40.100,3260] successful.
May 28 02:04:05.123103 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:04:05.130668 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-85c36ad5-c93c-4878-b983-4e8d2ac073f6 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 1f15126e-6636-4765-8650-bb717f186efe] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:04:05.146591 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:04:05.165286 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:04:05.205239 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 121, target: iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b, portal: 192.168.50.100,3260]
May 28 02:04:05.205239 np0000001583 nova-compute[98241]: Logout of [sid: 121, target: iqn.2023-03.storpool.com:os--volume-a666df4f-490f-44bd-8bc4-7729f124192b, portal: 192.168.50.100,3260] successful.
May 28 02:04:05.205239 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:04:05.226362 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:04:05.226786 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:04:05.227009 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] <== disconnect_volume: return (835ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:04:05.227241 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:04:05.227614 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Deleting instance files /opt/stack/data/nova/instances/9dd6bff7-c612-44cb-a1f2-9e1b26f5f342_del
May 28 02:04:05.228532 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Deletion of /opt/stack/data/nova/instances/9dd6bff7-c612-44cb-a1f2-9e1b26f5f342_del complete
May 28 02:04:05.505624 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:05.533669 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:05.661316 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:05.746658 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Took 2.27 seconds to destroy the instance on the hypervisor.
May 28 02:04:05.747068 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 02:04:05.747659 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 02:04:05.748312 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 02:04:05.748418 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:04:05.797389 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-89583ba1-41be-4c5c-9150-177cd0363741 req-e7517be1-b3ed-49f7-b026-2dc0c12db578 service nova] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Received event network-vif-plugged-a4c1b0fa-5874-4114-a2d3-2a1e87ab10de {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:04:05.797890 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-89583ba1-41be-4c5c-9150-177cd0363741 req-e7517be1-b3ed-49f7-b026-2dc0c12db578 service nova] Acquiring lock "22694475-4a1d-4eeb-881f-52234bd9bb7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:05.799394 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-89583ba1-41be-4c5c-9150-177cd0363741 req-e7517be1-b3ed-49f7-b026-2dc0c12db578 service nova] Lock "22694475-4a1d-4eeb-881f-52234bd9bb7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:05.799394 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-89583ba1-41be-4c5c-9150-177cd0363741 req-e7517be1-b3ed-49f7-b026-2dc0c12db578 service nova] Lock "22694475-4a1d-4eeb-881f-52234bd9bb7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:05.799394 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-89583ba1-41be-4c5c-9150-177cd0363741 req-e7517be1-b3ed-49f7-b026-2dc0c12db578 service nova] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Processing event network-vif-plugged-a4c1b0fa-5874-4114-a2d3-2a1e87ab10de {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 02:04:05.901594 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-707cce88-2275-4272-9fee-4e61602bdda8 req-fcd66133-96cc-4611-bceb-a0f8446de880 service nova] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Received event network-vif-unplugged-1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:04:05.901594 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-707cce88-2275-4272-9fee-4e61602bdda8 req-fcd66133-96cc-4611-bceb-a0f8446de880 service nova] Acquiring lock "9dd6bff7-c612-44cb-a1f2-9e1b26f5f342-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:05.901594 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-707cce88-2275-4272-9fee-4e61602bdda8 req-fcd66133-96cc-4611-bceb-a0f8446de880 service nova] Lock "9dd6bff7-c612-44cb-a1f2-9e1b26f5f342-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:05.901594 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-707cce88-2275-4272-9fee-4e61602bdda8 req-fcd66133-96cc-4611-bceb-a0f8446de880 service nova] Lock "9dd6bff7-c612-44cb-a1f2-9e1b26f5f342-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:05.901594 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-707cce88-2275-4272-9fee-4e61602bdda8 req-fcd66133-96cc-4611-bceb-a0f8446de880 service nova] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] No waiting events found dispatching network-vif-unplugged-1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:04:05.901594 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-707cce88-2275-4272-9fee-4e61602bdda8 req-fcd66133-96cc-4611-bceb-a0f8446de880 service nova] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Received event network-vif-unplugged-1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:04:05.931589 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:04:06.117190 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:06.118801 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:06.124007 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:06.150420 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:06.427523 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-04b62aa7-505b-4d55-b732-6a6718254989 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Lock "9a804913-4bfb-4dba-9efe-cbf7c575d8d1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.565s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:06.685953 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933846.6855404, 22694475-4a1d-4eeb-881f-52234bd9bb7d => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:04:06.686599 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 02:04:06.686829 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] VM Started (Lifecycle Event)
May 28 02:04:06.693672 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 02:04:06.702755 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Instance spawned successfully.
May 28 02:04:06.703062 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 02:04:07.034015 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:04:07.190839 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:04:07.194154 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:04:07.220032 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:04:07.220032 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:04:07.220032 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:04:07.220032 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:04:07.220032 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:04:07.220381 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:04:07.422773 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9d39c13c-ac8d-4bd8-b6a3-0ee5891455a9 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Acquiring lock "9a804913-4bfb-4dba-9efe-cbf7c575d8d1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:07.422773 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9d39c13c-ac8d-4bd8-b6a3-0ee5891455a9 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Lock "9a804913-4bfb-4dba-9efe-cbf7c575d8d1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:07.490874 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:07.539138 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Took 1.79 seconds to deallocate network for instance.
May 28 02:04:07.699708 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 02:04:07.700184 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933847.6998396, 22694475-4a1d-4eeb-881f-52234bd9bb7d => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:04:07.700184 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] VM Paused (Lifecycle Event)
May 28 02:04:07.731927 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Took 7.57 seconds to spawn the instance on the hypervisor.
May 28 02:04:07.731927 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:04:07.901286 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7201030c-7848-4c3e-acce-a685ff5ed602 req-ceedec4c-c1db-4da4-9c3c-5f18e73a69ad service nova] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Received event network-vif-plugged-a4c1b0fa-5874-4114-a2d3-2a1e87ab10de {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:04:07.901968 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7201030c-7848-4c3e-acce-a685ff5ed602 req-ceedec4c-c1db-4da4-9c3c-5f18e73a69ad service nova] Acquiring lock "22694475-4a1d-4eeb-881f-52234bd9bb7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:07.906058 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7201030c-7848-4c3e-acce-a685ff5ed602 req-ceedec4c-c1db-4da4-9c3c-5f18e73a69ad service nova] Lock "22694475-4a1d-4eeb-881f-52234bd9bb7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:07.906058 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7201030c-7848-4c3e-acce-a685ff5ed602 req-ceedec4c-c1db-4da4-9c3c-5f18e73a69ad service nova] Lock "22694475-4a1d-4eeb-881f-52234bd9bb7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:07.906058 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7201030c-7848-4c3e-acce-a685ff5ed602 req-ceedec4c-c1db-4da4-9c3c-5f18e73a69ad service nova] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] No waiting events found dispatching network-vif-plugged-a4c1b0fa-5874-4114-a2d3-2a1e87ab10de {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:04:07.906058 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-7201030c-7848-4c3e-acce-a685ff5ed602 req-ceedec4c-c1db-4da4-9c3c-5f18e73a69ad service nova] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Received unexpected event network-vif-plugged-a4c1b0fa-5874-4114-a2d3-2a1e87ab10de for instance with vm_state building and task_state spawning.
May 28 02:04:07.906058 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7201030c-7848-4c3e-acce-a685ff5ed602 req-ceedec4c-c1db-4da4-9c3c-5f18e73a69ad service nova] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Received event network-vif-deleted-1e0cbc1d-c7f9-43b4-9b48-9aa33eb2efdc {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:04:07.927938 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-9d39c13c-ac8d-4bd8-b6a3-0ee5891455a9 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Detaching volume 991907e5-2b73-4365-be97-ba364c2019e3
May 28 02:04:07.995808 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-9d39c13c-ac8d-4bd8-b6a3-0ee5891455a9 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Attempting to driver detach volume 991907e5-2b73-4365-be97-ba364c2019e3 from mountpoint /dev/vdb
May 28 02:04:08.004637 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9d39c13c-ac8d-4bd8-b6a3-0ee5891455a9 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Found disk vdb by alias ua-991907e5-2b73-4365-be97-ba364c2019e3 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:04:08.006398 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9d39c13c-ac8d-4bd8-b6a3-0ee5891455a9 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Found disk vdb by alias ua-991907e5-2b73-4365-be97-ba364c2019e3 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:04:08.006600 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9d39c13c-ac8d-4bd8-b6a3-0ee5891455a9 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Attempting to detach device vdb from instance 9a804913-4bfb-4dba-9efe-cbf7c575d8d1 from the persistent domain config. {{(pid=98241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 02:04:08.006880 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-9d39c13c-ac8d-4bd8-b6a3-0ee5891455a9 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:04:08.006880 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:04:08.006880 np0000001583 nova-compute[98241]:   <alias name="ua-991907e5-2b73-4365-be97-ba364c2019e3"/>
May 28 02:04:08.006880 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-0"/>
May 28 02:04:08.006880 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:04:08.006880 np0000001583 nova-compute[98241]:   <serial>991907e5-2b73-4365-be97-ba364c2019e3</serial>
May 28 02:04:08.006880 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 02:04:08.006880 np0000001583 nova-compute[98241]: </disk>
May 28 02:04:08.006880 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:04:08.015385 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-9d39c13c-ac8d-4bd8-b6a3-0ee5891455a9 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Successfully detached device vdb from instance 9a804913-4bfb-4dba-9efe-cbf7c575d8d1 from the persistent domain config.
May 28 02:04:08.015636 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9d39c13c-ac8d-4bd8-b6a3-0ee5891455a9 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] (1/8): Attempting to detach device vdb with device alias ua-991907e5-2b73-4365-be97-ba364c2019e3 from instance 9a804913-4bfb-4dba-9efe-cbf7c575d8d1 from the live domain config. {{(pid=98241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 02:04:08.015759 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-9d39c13c-ac8d-4bd8-b6a3-0ee5891455a9 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:04:08.015759 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:04:08.015759 np0000001583 nova-compute[98241]:   <alias name="ua-991907e5-2b73-4365-be97-ba364c2019e3"/>
May 28 02:04:08.015759 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-0"/>
May 28 02:04:08.015759 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:04:08.015759 np0000001583 nova-compute[98241]:   <serial>991907e5-2b73-4365-be97-ba364c2019e3</serial>
May 28 02:04:08.015759 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 02:04:08.015759 np0000001583 nova-compute[98241]: </disk>
May 28 02:04:08.015759 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:04:08.119796 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Took 0.58 seconds to detach 1 volumes for instance.
May 28 02:04:08.122966 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Deleting volume: a666df4f-490f-44bd-8bc4-7729f124192b {{(pid=98241) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 28 02:04:08.202888 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:04:08.209098 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933848.2087705, 22694475-4a1d-4eeb-881f-52234bd9bb7d => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:04:08.209266 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] VM Resumed (Lifecycle Event)
May 28 02:04:08.245597 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Took 12.96 seconds to build instance.
May 28 02:04:08.338520 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0004895460001534957 future=<Future at 0x7724ec1e2780 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:04:08.338520 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:04:08.338629 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=10.516575793999891 future=<Future at 0x7724ec2ba720 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:04:08.338669 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=10.516458115000205 future=<Future at 0x7724ec2ba720 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:04:08.339518 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Emitting event <LifecycleEvent: 1779933833.337658, e50227a8-b484-447b-abc6-3a3c1379e7ff => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:04:08.339715 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] VM Stopped (Lifecycle Event)
May 28 02:04:08.397483 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:08.654964 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9d39c13c-ac8d-4bd8-b6a3-0ee5891455a9 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-991907e5-2b73-4365-be97-ba364c2019e3 for instance 9a804913-4bfb-4dba-9efe-cbf7c575d8d1 {{(pid=98241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 02:04:08.698790 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:08.699013 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:08.711714 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:04:08.716425 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:04:08.751963 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Lock "22694475-4a1d-4eeb-881f-52234bd9bb7d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.479s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:08.845377 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: e50227a8-b484-447b-abc6-3a3c1379e7ff] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:04:08.992564 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:04:08.992905 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:04:09.218218 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Received event <DeviceRemovedEvent: 1779933849.217841, 9a804913-4bfb-4dba-9efe-cbf7c575d8d1 => ua-991907e5-2b73-4365-be97-ba364c2019e3> from libvirt while the driver is waiting for it; dispatched. {{(pid=98241) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 02:04:09.221132 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-9d39c13c-ac8d-4bd8-b6a3-0ee5891455a9 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Successfully detached device vdb from instance 9a804913-4bfb-4dba-9efe-cbf7c575d8d1 from the live domain config.
May 28 02:04:09.222288 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d39c13c-ac8d-4bd8-b6a3-0ee5891455a9 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:04:09.222680 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d39c13c-ac8d-4bd8-b6a3-0ee5891455a9 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3', 'iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '991907e5-2b73-4365-be97-ba364c2019e3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:04:09.222954 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-9d39c13c-ac8d-4bd8-b6a3-0ee5891455a9 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:04:09.223421 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-9d39c13c-ac8d-4bd8-b6a3-0ee5891455a9 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:04:09.223855 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d39c13c-ac8d-4bd8-b6a3-0ee5891455a9 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3', 'iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '991907e5-2b73-4365-be97-ba364c2019e3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:04:09.224114 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d39c13c-ac8d-4bd8-b6a3-0ee5891455a9 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:04:09.249668 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d39c13c-ac8d-4bd8-b6a3-0ee5891455a9 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:04:09.249668 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:04:09.249668 np0000001583 nova-compute[98241]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3 (non-flash)
May 28 02:04:09.249668 np0000001583 nova-compute[98241]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3 (non-flash)
May 28 02:04:09.249668 np0000001583 nova-compute[98241]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ab8b729c-53c6-4822-a0d9-75a6fe812845 (non-flash)
May 28 02:04:09.249668 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:04:09.249952 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d39c13c-ac8d-4bd8-b6a3-0ee5891455a9 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] iscsi session list stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:04:09.249952 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:04:09.249952 np0000001583 nova-compute[98241]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3 (non-flash)
May 28 02:04:09.249952 np0000001583 nova-compute[98241]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3 (non-flash)
May 28 02:04:09.249952 np0000001583 nova-compute[98241]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ab8b729c-53c6-4822-a0d9-75a6fe812845 (non-flash)
May 28 02:04:09.249952 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:04:09.250168 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d39c13c-ac8d-4bd8-b6a3-0ee5891455a9 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86', '109'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86', '110'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3', '124'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3', '125'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ab8b729c-53c6-4822-a0d9-75a6fe812845', '126')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:04:09.250260 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d39c13c-ac8d-4bd8-b6a3-0ee5891455a9 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3', '124')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:04:09.251261 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d39c13c-ac8d-4bd8-b6a3-0ee5891455a9 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3', '125')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:04:09.252511 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d39c13c-ac8d-4bd8-b6a3-0ee5891455a9 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7725025c91c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3'): ({'sdc'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:04:09.252851 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-9d39c13c-ac8d-4bd8-b6a3-0ee5891455a9 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Removing multipathed devices sdc, sdb {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:04:09.253209 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-9d39c13c-ac8d-4bd8-b6a3-0ee5891455a9 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Flush multipath device 3300000000771e24c {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:04:09.288315 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-9d39c13c-ac8d-4bd8-b6a3-0ee5891455a9 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:04:09.337557 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-9d39c13c-ac8d-4bd8-b6a3-0ee5891455a9 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:04:09.382437 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:09.391289 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-9d39c13c-ac8d-4bd8-b6a3-0ee5891455a9 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:04:09.391289 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-9d39c13c-ac8d-4bd8-b6a3-0ee5891455a9 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:04:09.391289 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-9d39c13c-ac8d-4bd8-b6a3-0ee5891455a9 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:04:09.403474 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-9d39c13c-ac8d-4bd8-b6a3-0ee5891455a9 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:04:09.403710 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d39c13c-ac8d-4bd8-b6a3-0ee5891455a9 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:04:09.416661 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d39c13c-ac8d-4bd8-b6a3-0ee5891455a9 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:04:09.449178 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d39c13c-ac8d-4bd8-b6a3-0ee5891455a9 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 124, target: iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3, portal: 192.168.40.100,3260]
May 28 02:04:09.449178 np0000001583 nova-compute[98241]: Logout of [sid: 124, target: iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3, portal: 192.168.40.100,3260] successful.
May 28 02:04:09.449178 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:04:09.468446 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d39c13c-ac8d-4bd8-b6a3-0ee5891455a9 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:04:09.482310 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d39c13c-ac8d-4bd8-b6a3-0ee5891455a9 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:04:09.495821 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:04:09.515976 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d39c13c-ac8d-4bd8-b6a3-0ee5891455a9 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 125, target: iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3, portal: 192.168.50.100,3260]
May 28 02:04:09.515976 np0000001583 nova-compute[98241]: Logout of [sid: 125, target: iqn.2023-03.storpool.com:os--volume-991907e5-2b73-4365-be97-ba364c2019e3, portal: 192.168.50.100,3260] successful.
May 28 02:04:09.515976 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:04:09.532781 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d39c13c-ac8d-4bd8-b6a3-0ee5891455a9 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:04:09.533014 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-9d39c13c-ac8d-4bd8-b6a3-0ee5891455a9 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:04:09.533172 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d39c13c-ac8d-4bd8-b6a3-0ee5891455a9 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] <== disconnect_volume: return (310ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:04:09.533322 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d39c13c-ac8d-4bd8-b6a3-0ee5891455a9 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:04:10.005244 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.306s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:10.064394 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Deleted allocations for instance 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342
May 28 02:04:10.102547 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-9d39c13c-ac8d-4bd8-b6a3-0ee5891455a9 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Lazy-loading 'flavor' on Instance uuid 9a804913-4bfb-4dba-9efe-cbf7c575d8d1 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:04:10.114038 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d592e381-1c7d-4976-8f9c-665ff2b8c43a tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Acquiring lock "22694475-4a1d-4eeb-881f-52234bd9bb7d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:10.114291 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d592e381-1c7d-4976-8f9c-665ff2b8c43a tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Lock "22694475-4a1d-4eeb-881f-52234bd9bb7d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:10.114489 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d592e381-1c7d-4976-8f9c-665ff2b8c43a tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Acquiring lock "22694475-4a1d-4eeb-881f-52234bd9bb7d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:10.114649 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d592e381-1c7d-4976-8f9c-665ff2b8c43a tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Lock "22694475-4a1d-4eeb-881f-52234bd9bb7d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:10.114827 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d592e381-1c7d-4976-8f9c-665ff2b8c43a tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Lock "22694475-4a1d-4eeb-881f-52234bd9bb7d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:10.117565 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-d592e381-1c7d-4976-8f9c-665ff2b8c43a tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Terminating instance
May 28 02:04:10.621203 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-d592e381-1c7d-4976-8f9c-665ff2b8c43a tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 02:04:10.642009 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:10.670008 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:10.674347 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:10.698210 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:10.826626 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-bd69345a-4429-4d54-bd23-1ada785dd834 req-8d77713d-fded-4e92-8a93-5303637dc70f service nova] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Received event network-vif-unplugged-a4c1b0fa-5874-4114-a2d3-2a1e87ab10de {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:04:10.827244 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bd69345a-4429-4d54-bd23-1ada785dd834 req-8d77713d-fded-4e92-8a93-5303637dc70f service nova] Acquiring lock "22694475-4a1d-4eeb-881f-52234bd9bb7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:10.827491 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bd69345a-4429-4d54-bd23-1ada785dd834 req-8d77713d-fded-4e92-8a93-5303637dc70f service nova] Lock "22694475-4a1d-4eeb-881f-52234bd9bb7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:10.827615 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bd69345a-4429-4d54-bd23-1ada785dd834 req-8d77713d-fded-4e92-8a93-5303637dc70f service nova] Lock "22694475-4a1d-4eeb-881f-52234bd9bb7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:10.827705 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-bd69345a-4429-4d54-bd23-1ada785dd834 req-8d77713d-fded-4e92-8a93-5303637dc70f service nova] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] No waiting events found dispatching network-vif-unplugged-a4c1b0fa-5874-4114-a2d3-2a1e87ab10de {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:04:10.827856 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-bd69345a-4429-4d54-bd23-1ada785dd834 req-8d77713d-fded-4e92-8a93-5303637dc70f service nova] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Received event network-vif-unplugged-a4c1b0fa-5874-4114-a2d3-2a1e87ab10de for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:04:10.886789 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:10.941981 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:10.954818 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:10.981211 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.998729636000007 future=<Future at 0x7724f8465340 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:04:10.991460 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Instance destroyed successfully.
May 28 02:04:10.992987 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-d592e381-1c7d-4976-8f9c-665ff2b8c43a tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Lazy-loading 'resources' on Instance uuid 22694475-4a1d-4eeb-881f-52234bd9bb7d {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:04:11.073538 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3d7d3f8d-d919-4cf2-ab3f-075e6091a5dd tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "9dd6bff7-c612-44cb-a1f2-9e1b26f5f342" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.102s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:11.110462 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9d39c13c-ac8d-4bd8-b6a3-0ee5891455a9 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Lock "9a804913-4bfb-4dba-9efe-cbf7c575d8d1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.688s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:11.495289 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-d592e381-1c7d-4976-8f9c-665ff2b8c43a tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T02:03:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2113594863',display_name='tempest-VolumesActionsTest-instance-2113594863',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-volumesactionstest-instance-2113594863',id=55,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:04:07Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1c38124ed2774a80a79d62c26d43f4da',ramdisk_id='',reservation_id='r-5n7tyfyv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1125296363',owner_user_name='tempest-VolumesActionsTest-1125296363-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T02:04:08Z,user_data=None,user_id='bdd7dc60a5d6477e9a120c0dbfd7384e',uuid=22694475-4a1d-4eeb-881f-52234bd9bb7d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4c1b0fa-5874-4114-a2d3-2a1e87ab10de", "address": "fa:16:3e:e2:f4:ae", "network": {"id": "759a6e43-6d1b-44d5-92ea-4f798fb303e0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1542618898-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c38124ed2774a80a79d62c26d43f4da", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c1b0fa-58", "ovs_interfaceid": "a4c1b0fa-5874-4114-a2d3-2a1e87ab10de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:04:11.495550 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-d592e381-1c7d-4976-8f9c-665ff2b8c43a tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Converting VIF {"id": "a4c1b0fa-5874-4114-a2d3-2a1e87ab10de", "address": "fa:16:3e:e2:f4:ae", "network": {"id": "759a6e43-6d1b-44d5-92ea-4f798fb303e0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1542618898-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c38124ed2774a80a79d62c26d43f4da", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c1b0fa-58", "ovs_interfaceid": "a4c1b0fa-5874-4114-a2d3-2a1e87ab10de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:04:11.496329 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-d592e381-1c7d-4976-8f9c-665ff2b8c43a tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:f4:ae,bridge_name='br-int',has_traffic_filtering=True,id=a4c1b0fa-5874-4114-a2d3-2a1e87ab10de,network=Network(759a6e43-6d1b-44d5-92ea-4f798fb303e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4c1b0fa-58') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:04:11.496651 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-d592e381-1c7d-4976-8f9c-665ff2b8c43a tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:f4:ae,bridge_name='br-int',has_traffic_filtering=True,id=a4c1b0fa-5874-4114-a2d3-2a1e87ab10de,network=Network(759a6e43-6d1b-44d5-92ea-4f798fb303e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4c1b0fa-58') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:04:11.498211 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:11.498464 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa4c1b0fa-58, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:04:11.500165 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:11.501786 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:04:11.502517 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:11.502690 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=611232b3-30bd-4c61-bfdc-783aeb00650c) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:04:11.503777 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:11.508518 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:04:11.511386 np0000001583 nova-compute[98241]: INFO os_vif [None req-d592e381-1c7d-4976-8f9c-665ff2b8c43a tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:f4:ae,bridge_name='br-int',has_traffic_filtering=True,id=a4c1b0fa-5874-4114-a2d3-2a1e87ab10de,network=Network(759a6e43-6d1b-44d5-92ea-4f798fb303e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4c1b0fa-58')
May 28 02:04:11.511801 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-d592e381-1c7d-4976-8f9c-665ff2b8c43a tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Deleting instance files /opt/stack/data/nova/instances/22694475-4a1d-4eeb-881f-52234bd9bb7d_del
May 28 02:04:11.512527 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-d592e381-1c7d-4976-8f9c-665ff2b8c43a tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Deletion of /opt/stack/data/nova/instances/22694475-4a1d-4eeb-881f-52234bd9bb7d_del complete
May 28 02:04:12.021759 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-d592e381-1c7d-4976-8f9c-665ff2b8c43a tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Took 1.40 seconds to destroy the instance on the hypervisor.
May 28 02:04:12.022371 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-d592e381-1c7d-4976-8f9c-665ff2b8c43a tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 02:04:12.022692 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 02:04:12.022692 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 02:04:12.022884 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:04:12.214543 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:04:12.585931 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-02dd4b8e-e747-439b-80b7-d808ad490849 req-3deebbaa-5519-4f95-bc6c-aea22cd95ad2 service nova] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Received event network-vif-deleted-a4c1b0fa-5874-4114-a2d3-2a1e87ab10de {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:04:12.586607 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-02dd4b8e-e747-439b-80b7-d808ad490849 req-3deebbaa-5519-4f95-bc6c-aea22cd95ad2 service nova] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Neutron deleted interface a4c1b0fa-5874-4114-a2d3-2a1e87ab10de; detaching it from the instance and deleting it from the info cache
May 28 02:04:12.589357 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-02dd4b8e-e747-439b-80b7-d808ad490849 req-3deebbaa-5519-4f95-bc6c-aea22cd95ad2 service nova] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Detach interface failed, port_id=a4c1b0fa-5874-4114-a2d3-2a1e87ab10de, reason: Instance 22694475-4a1d-4eeb-881f-52234bd9bb7d could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 02:04:12.704337 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:12.750112 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "52013bcc-3652-4009-871a-ae37e6ed1c69" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:12.750112 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "52013bcc-3652-4009-871a-ae37e6ed1c69" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:12.750214 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "52013bcc-3652-4009-871a-ae37e6ed1c69-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:12.750308 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "52013bcc-3652-4009-871a-ae37e6ed1c69-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:12.750410 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "52013bcc-3652-4009-871a-ae37e6ed1c69-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:12.752299 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Terminating instance
May 28 02:04:12.912637 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-97dc1edb-0cc8-4294-8b54-c328dec7d7fe req-bfcf04f1-c9f6-45cd-846e-1949d2faf5bf service nova] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Received event network-vif-unplugged-a4c1b0fa-5874-4114-a2d3-2a1e87ab10de {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:04:12.912873 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-97dc1edb-0cc8-4294-8b54-c328dec7d7fe req-bfcf04f1-c9f6-45cd-846e-1949d2faf5bf service nova] Acquiring lock "22694475-4a1d-4eeb-881f-52234bd9bb7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:12.913019 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-97dc1edb-0cc8-4294-8b54-c328dec7d7fe req-bfcf04f1-c9f6-45cd-846e-1949d2faf5bf service nova] Lock "22694475-4a1d-4eeb-881f-52234bd9bb7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:12.913187 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-97dc1edb-0cc8-4294-8b54-c328dec7d7fe req-bfcf04f1-c9f6-45cd-846e-1949d2faf5bf service nova] Lock "22694475-4a1d-4eeb-881f-52234bd9bb7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:12.913570 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-97dc1edb-0cc8-4294-8b54-c328dec7d7fe req-bfcf04f1-c9f6-45cd-846e-1949d2faf5bf service nova] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] No waiting events found dispatching network-vif-unplugged-a4c1b0fa-5874-4114-a2d3-2a1e87ab10de {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:04:12.913886 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-97dc1edb-0cc8-4294-8b54-c328dec7d7fe req-bfcf04f1-c9f6-45cd-846e-1949d2faf5bf service nova] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Received event network-vif-unplugged-a4c1b0fa-5874-4114-a2d3-2a1e87ab10de for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:04:13.008195 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5cfa48a4-16ef-4118-8667-b5aabc296c55 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Acquiring lock "9a804913-4bfb-4dba-9efe-cbf7c575d8d1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:13.008387 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5cfa48a4-16ef-4118-8667-b5aabc296c55 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Lock "9a804913-4bfb-4dba-9efe-cbf7c575d8d1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:13.008911 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5cfa48a4-16ef-4118-8667-b5aabc296c55 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Acquiring lock "9a804913-4bfb-4dba-9efe-cbf7c575d8d1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:13.008911 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5cfa48a4-16ef-4118-8667-b5aabc296c55 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Lock "9a804913-4bfb-4dba-9efe-cbf7c575d8d1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:13.008911 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5cfa48a4-16ef-4118-8667-b5aabc296c55 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Lock "9a804913-4bfb-4dba-9efe-cbf7c575d8d1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:13.010995 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-5cfa48a4-16ef-4118-8667-b5aabc296c55 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Terminating instance
May 28 02:04:13.030860 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:04:13.254928 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 02:04:13.273154 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:13.274839 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:13.293062 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:13.297086 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:13.316319 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:13.320721 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:13.398277 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:13.514300 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-5cfa48a4-16ef-4118-8667-b5aabc296c55 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 02:04:13.532890 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Took 1.51 seconds to deallocate network for instance.
May 28 02:04:13.544103 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:13.544997 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:13.574206 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:13.581385 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:13.608251 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:13.621213 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:13.625216 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:13.631380 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.99963238500004 future=<Future at 0x7724ec074a70 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:04:13.639867 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Instance destroyed successfully.
May 28 02:04:13.641109 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lazy-loading 'resources' on Instance uuid 52013bcc-3652-4009-871a-ae37e6ed1c69 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:04:13.856780 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999683801999709 future=<Future at 0x7724f87e55b0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:04:13.860104 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Instance destroyed successfully.
May 28 02:04:13.860809 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-5cfa48a4-16ef-4118-8667-b5aabc296c55 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Lazy-loading 'resources' on Instance uuid 9a804913-4bfb-4dba-9efe-cbf7c575d8d1 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:04:14.041785 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d592e381-1c7d-4976-8f9c-665ff2b8c43a tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:14.043491 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d592e381-1c7d-4976-8f9c-665ff2b8c43a tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:14.148542 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T02:02:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1488296031',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1488296031',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testvolumebootpattern-volume-backed-server-1488296031',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIw+Ze1rkggC7xQeXQuOA1lohwYh9c3tEWdnm04uSqmAuJm+YnW437cgGsA97PJoCju0t5wWsAAFhCPQ46MQsLgCx3FLqk8KzbNg3l90OkEY54OQO0Xz/B0dbHkEuwAFIw==',key_name='tempest-keypair-2048497990',keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:02:20Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='432aa1094ced436494def17a875aa8e1',ramdisk_id='',reservation_id='r-2ypah9tm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1031057169',owner_user_name='tempest-TestVolumeBootPattern-1031057169-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T02:02:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6be314b4eed642c3b2c72fe115860220',uuid=52013bcc-3652-4009-871a-ae37e6ed1c69,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fcd776c5-1b40-47c2-9fb8-71d523362404", "address": "fa:16:3e:9e:36:ca", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd776c5-1b", "ovs_interfaceid": "fcd776c5-1b40-47c2-9fb8-71d523362404", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:04:14.148542 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converting VIF {"id": "fcd776c5-1b40-47c2-9fb8-71d523362404", "address": "fa:16:3e:9e:36:ca", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd776c5-1b", "ovs_interfaceid": "fcd776c5-1b40-47c2-9fb8-71d523362404", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:04:14.148542 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:36:ca,bridge_name='br-int',has_traffic_filtering=True,id=fcd776c5-1b40-47c2-9fb8-71d523362404,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcd776c5-1b') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:04:14.148542 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:36:ca,bridge_name='br-int',has_traffic_filtering=True,id=fcd776c5-1b40-47c2-9fb8-71d523362404,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcd776c5-1b') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:04:14.149852 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:14.149852 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfcd776c5-1b, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:04:14.150672 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:14.151530 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:04:14.156649 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:14.159915 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:14.159915 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4caa4be3-bf2b-4c79-b375-0b105cd0c426) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:04:14.160874 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:14.160874 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:04:14.166778 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:14.171366 np0000001583 nova-compute[98241]: INFO os_vif [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:36:ca,bridge_name='br-int',has_traffic_filtering=True,id=fcd776c5-1b40-47c2-9fb8-71d523362404,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcd776c5-1b')
May 28 02:04:14.175440 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:04:14.175692 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86', 'iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3cbdb2bf-538c-469a-bef3-675c0c55ac86', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:04:14.178111 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:04:14.178111 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:04:14.178111 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86', 'iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3cbdb2bf-538c-469a-bef3-675c0c55ac86', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:04:14.178111 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:04:14.210554 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:04:14.210554 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:04:14.210554 np0000001583 nova-compute[98241]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ab8b729c-53c6-4822-a0d9-75a6fe812845 (non-flash)
May 28 02:04:14.210554 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:04:14.210777 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:04:14.210777 np0000001583 nova-compute[98241]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86 (non-flash)
May 28 02:04:14.210777 np0000001583 nova-compute[98241]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ab8b729c-53c6-4822-a0d9-75a6fe812845 (non-flash)
May 28 02:04:14.210777 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:04:14.211029 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86', '109'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86', '110'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ab8b729c-53c6-4822-a0d9-75a6fe812845', '126')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:04:14.211766 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86', '109')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:04:14.216442 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86', '110')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:04:14.217680 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724ec1ae160>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86'): ({'sdg'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:04:14.218012 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Removing multipathed devices sdd, sdg {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:04:14.218325 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Flush multipath device 330000000a2c0b59b {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:04:14.275767 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:04:14.288760 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-d592e381-1c7d-4976-8f9c-665ff2b8c43a tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:04:14.288760 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-d592e381-1c7d-4976-8f9c-665ff2b8c43a tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:04:14.330947 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:04:14.363732 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-5cfa48a4-16ef-4118-8667-b5aabc296c55 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T02:03:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1066727671',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1066727671',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testservervolumeattachscenariooldversion-server-1066727',id=52,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBXnxsmyoKyYOicke+a2j41FIiyLQT24hXslEKYEQQVnScvYxCrZKQj44eh6iwnWwA3Q+rKFOnlaa94D1xbB6xVrvJZg4VFFKGTFOcrVQjqs90TcmXH5qJnBKEbDH6uepg==',key_name='tempest-keypair-1475679098',keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:03:16Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7849e9703e1345b9826a90dc99756d77',ramdisk_id='',reservation_id='r-rdryf01q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-649923774',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T02:03:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2fa2fdfb3264e2283e385b876095c6e',uuid=9a804913-4bfb-4dba-9efe-cbf7c575d8d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ff6f19c-9ecc-4ac9-a37b-a99bde59db2d", "address": "fa:16:3e:92:00:c4", "network": {"id": "59a17812-47e4-4787-a775-e18f05e4d2ec", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1023256595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7849e9703e1345b9826a90dc99756d77", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff6f19c-9e", "ovs_interfaceid": "4ff6f19c-9ecc-4ac9-a37b-a99bde59db2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:04:14.363968 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-5cfa48a4-16ef-4118-8667-b5aabc296c55 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Converting VIF {"id": "4ff6f19c-9ecc-4ac9-a37b-a99bde59db2d", "address": "fa:16:3e:92:00:c4", "network": {"id": "59a17812-47e4-4787-a775-e18f05e4d2ec", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1023256595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7849e9703e1345b9826a90dc99756d77", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff6f19c-9e", "ovs_interfaceid": "4ff6f19c-9ecc-4ac9-a37b-a99bde59db2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:04:14.364567 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-5cfa48a4-16ef-4118-8667-b5aabc296c55 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:00:c4,bridge_name='br-int',has_traffic_filtering=True,id=4ff6f19c-9ecc-4ac9-a37b-a99bde59db2d,network=Network(59a17812-47e4-4787-a775-e18f05e4d2ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ff6f19c-9e') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:04:14.364801 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-5cfa48a4-16ef-4118-8667-b5aabc296c55 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:00:c4,bridge_name='br-int',has_traffic_filtering=True,id=4ff6f19c-9ecc-4ac9-a37b-a99bde59db2d,network=Network(59a17812-47e4-4787-a775-e18f05e4d2ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ff6f19c-9e') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:04:14.366637 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:14.366637 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ff6f19c-9e, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:04:14.368190 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:14.368804 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:04:14.369260 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:14.370410 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:14.370410 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7455b2b6-ca8a-4511-932f-a3922541b5fe) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:04:14.372882 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:14.372882 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:04:14.373751 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:14.375197 np0000001583 nova-compute[98241]: INFO os_vif [None req-5cfa48a4-16ef-4118-8667-b5aabc296c55 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:00:c4,bridge_name='br-int',has_traffic_filtering=True,id=4ff6f19c-9ecc-4ac9-a37b-a99bde59db2d,network=Network(59a17812-47e4-4787-a775-e18f05e4d2ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ff6f19c-9e')
May 28 02:04:14.377282 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-5cfa48a4-16ef-4118-8667-b5aabc296c55 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Deleting instance files /opt/stack/data/nova/instances/9a804913-4bfb-4dba-9efe-cbf7c575d8d1_del
May 28 02:04:14.377282 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-5cfa48a4-16ef-4118-8667-b5aabc296c55 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Deletion of /opt/stack/data/nova/instances/9a804913-4bfb-4dba-9efe-cbf7c575d8d1_del complete
May 28 02:04:14.381162 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Checking to see if SCSI volumes sdd, sdg have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:04:14.381272 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] SCSI volumes sdd, sdg have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:04:14.381965 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Checking to see if device paths {'sdd', 'sdg'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:04:14.397353 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Device paths {'sdd', 'sdg'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:04:14.397451 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:04:14.412141 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:04:14.452992 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 109, target: iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86, portal: 192.168.40.100,3260]
May 28 02:04:14.452992 np0000001583 nova-compute[98241]: Logout of [sid: 109, target: iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86, portal: 192.168.40.100,3260] successful.
May 28 02:04:14.452992 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:04:14.471544 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:04:14.485351 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:04:14.516240 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 110, target: iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86, portal: 192.168.50.100,3260]
May 28 02:04:14.516240 np0000001583 nova-compute[98241]: Logout of [sid: 110, target: iqn.2023-03.storpool.com:os--volume-3cbdb2bf-538c-469a-bef3-675c0c55ac86, portal: 192.168.50.100,3260] successful.
May 28 02:04:14.516240 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:04:14.532063 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:04:14.532400 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:04:14.532607 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] <== disconnect_volume: return (356ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:04:14.532718 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:04:14.533022 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Deleting instance files /opt/stack/data/nova/instances/52013bcc-3652-4009-871a-ae37e6ed1c69_del
May 28 02:04:14.533858 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Deletion of /opt/stack/data/nova/instances/52013bcc-3652-4009-871a-ae37e6ed1c69_del complete
May 28 02:04:14.791582 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-d592e381-1c7d-4976-8f9c-665ff2b8c43a tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:04:14.890274 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-5cfa48a4-16ef-4118-8667-b5aabc296c55 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Took 1.38 seconds to destroy the instance on the hypervisor.
May 28 02:04:14.891467 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-5cfa48a4-16ef-4118-8667-b5aabc296c55 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 02:04:14.892695 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 02:04:14.892695 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 02:04:14.892695 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:04:14.995547 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-94ae13fd-bd82-43f5-b4f6-9dd565e9ddf6 req-89ba7750-eb1e-4dcb-8525-39664f44665c service nova] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Received event network-vif-unplugged-fcd776c5-1b40-47c2-9fb8-71d523362404 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:04:14.995547 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-94ae13fd-bd82-43f5-b4f6-9dd565e9ddf6 req-89ba7750-eb1e-4dcb-8525-39664f44665c service nova] Acquiring lock "52013bcc-3652-4009-871a-ae37e6ed1c69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:14.995547 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-94ae13fd-bd82-43f5-b4f6-9dd565e9ddf6 req-89ba7750-eb1e-4dcb-8525-39664f44665c service nova] Lock "52013bcc-3652-4009-871a-ae37e6ed1c69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:14.995547 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-94ae13fd-bd82-43f5-b4f6-9dd565e9ddf6 req-89ba7750-eb1e-4dcb-8525-39664f44665c service nova] Lock "52013bcc-3652-4009-871a-ae37e6ed1c69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:14.995547 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-94ae13fd-bd82-43f5-b4f6-9dd565e9ddf6 req-89ba7750-eb1e-4dcb-8525-39664f44665c service nova] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] No waiting events found dispatching network-vif-unplugged-fcd776c5-1b40-47c2-9fb8-71d523362404 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:04:14.995547 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-94ae13fd-bd82-43f5-b4f6-9dd565e9ddf6 req-89ba7750-eb1e-4dcb-8525-39664f44665c service nova] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Received event network-vif-unplugged-fcd776c5-1b40-47c2-9fb8-71d523362404 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:04:14.995547 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-94ae13fd-bd82-43f5-b4f6-9dd565e9ddf6 req-89ba7750-eb1e-4dcb-8525-39664f44665c service nova] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Received event network-vif-unplugged-fcd776c5-1b40-47c2-9fb8-71d523362404 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:04:14.996251 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-94ae13fd-bd82-43f5-b4f6-9dd565e9ddf6 req-89ba7750-eb1e-4dcb-8525-39664f44665c service nova] Acquiring lock "52013bcc-3652-4009-871a-ae37e6ed1c69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:14.996251 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-94ae13fd-bd82-43f5-b4f6-9dd565e9ddf6 req-89ba7750-eb1e-4dcb-8525-39664f44665c service nova] Lock "52013bcc-3652-4009-871a-ae37e6ed1c69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:14.996251 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-94ae13fd-bd82-43f5-b4f6-9dd565e9ddf6 req-89ba7750-eb1e-4dcb-8525-39664f44665c service nova] Lock "52013bcc-3652-4009-871a-ae37e6ed1c69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:14.996251 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-94ae13fd-bd82-43f5-b4f6-9dd565e9ddf6 req-89ba7750-eb1e-4dcb-8525-39664f44665c service nova] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] No waiting events found dispatching network-vif-unplugged-fcd776c5-1b40-47c2-9fb8-71d523362404 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:04:14.998428 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-94ae13fd-bd82-43f5-b4f6-9dd565e9ddf6 req-89ba7750-eb1e-4dcb-8525-39664f44665c service nova] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Received event network-vif-unplugged-fcd776c5-1b40-47c2-9fb8-71d523362404 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:04:15.034394 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:04:15.043383 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Took 1.79 seconds to destroy the instance on the hypervisor.
May 28 02:04:15.044785 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 02:04:15.045095 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 02:04:15.045265 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 02:04:15.045592 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:04:15.145890 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:04:15.298194 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d592e381-1c7d-4976-8f9c-665ff2b8c43a tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.255s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:15.391800 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-d592e381-1c7d-4976-8f9c-665ff2b8c43a tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Deleted allocations for instance 22694475-4a1d-4eeb-881f-52234bd9bb7d
May 28 02:04:15.579907 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-94301ac9-9829-491b-8d31-4ae7b17bfc2a req-b520d54c-c2b6-477c-80b7-91d992c280a0 service nova] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Received event network-vif-deleted-4ff6f19c-9ecc-4ac9-a37b-a99bde59db2d {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:04:15.580235 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-94301ac9-9829-491b-8d31-4ae7b17bfc2a req-b520d54c-c2b6-477c-80b7-91d992c280a0 service nova] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Neutron deleted interface 4ff6f19c-9ecc-4ac9-a37b-a99bde59db2d; detaching it from the instance and deleting it from the info cache
May 28 02:04:15.582237 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-94301ac9-9829-491b-8d31-4ae7b17bfc2a req-b520d54c-c2b6-477c-80b7-91d992c280a0 service nova] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Detach interface failed, port_id=4ff6f19c-9ecc-4ac9-a37b-a99bde59db2d, reason: Instance 9a804913-4bfb-4dba-9efe-cbf7c575d8d1 could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 02:04:16.023614 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:04:16.262132 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:04:16.396272 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Acquiring lock "7751bb1a-84b9-48ce-81da-b3a41d63eadc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:16.396272 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "7751bb1a-84b9-48ce-81da-b3a41d63eadc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:16.407163 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d592e381-1c7d-4976-8f9c-665ff2b8c43a tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Lock "22694475-4a1d-4eeb-881f-52234bd9bb7d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.293s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:16.526481 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Took 1.63 seconds to deallocate network for instance.
May 28 02:04:16.765433 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Took 1.72 seconds to deallocate network for instance.
May 28 02:04:16.899226 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 02:04:17.033943 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5cfa48a4-16ef-4118-8667-b5aabc296c55 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:17.033943 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5cfa48a4-16ef-4118-8667-b5aabc296c55 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:17.067446 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-abe1c0df-6e82-4191-baef-a3de9a3bcbf8 req-242490f6-ab5e-421f-aa3c-a0dacbb20656 service nova] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Received event network-vif-deleted-fcd776c5-1b40-47c2-9fb8-71d523362404 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:04:17.232534 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-5cfa48a4-16ef-4118-8667-b5aabc296c55 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:04:17.232756 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-5cfa48a4-16ef-4118-8667-b5aabc296c55 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:04:17.323067 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Took 0.56 seconds to detach 1 volumes for instance.
May 28 02:04:17.326397 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Deleting volume: 3cbdb2bf-538c-469a-bef3-675c0c55ac86 {{(pid=98241) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 28 02:04:17.460365 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:17.735628 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-5cfa48a4-16ef-4118-8667-b5aabc296c55 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:04:17.876639 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:18.193593 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:04:18.193982 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:04:18.242685 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5cfa48a4-16ef-4118-8667-b5aabc296c55 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.209s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:18.244643 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.783s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:18.250270 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 02:04:18.250270 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Claim successful on node np0000001583
May 28 02:04:18.311798 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-5cfa48a4-16ef-4118-8667-b5aabc296c55 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Deleted allocations for instance 9a804913-4bfb-4dba-9efe-cbf7c575d8d1
May 28 02:04:18.399372 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:18.856427 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0012584410001181823 future=<Future at 0x7724ec2ba720 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:04:18.856540 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:04:18.856657 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=7.123232987999927 future=<Future at 0x7724f8465340 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:04:18.856765 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=7.123122341999988 future=<Future at 0x7724f8465340 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:04:18.857272 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] Emitting event <LifecycleEvent: 1779933843.8550508, 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:04:18.857431 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] VM Stopped (Lifecycle Event)
May 28 02:04:19.321327 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5cfa48a4-16ef-4118-8667-b5aabc296c55 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Lock "9a804913-4bfb-4dba-9efe-cbf7c575d8d1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.313s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:19.360037 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-22147937-646b-4cb9-ac1d-f6291f57f05f tempest-VolumesActionsTest-110721277 tempest-VolumesActionsTest-110721277-project-member] [instance: 9dd6bff7-c612-44cb-a1f2-9e1b26f5f342] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:04:19.371875 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:19.428122 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:04:19.428122 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:04:19.933961 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:04:20.193432 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:04:20.193686 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:04:20.443170 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.200s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:20.443997 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.567s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:20.444198 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 02:04:20.617798 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:04:20.618042 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:04:20.918291 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:20.953288 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 02:04:20.953395 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 02:04:20.953663 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:04:20.953894 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:04:21.051878 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'db5b8b66a90b4a2dba53c340347aff1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9663116fe18428d8e37dea7b30d8b5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 02:04:21.123614 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:04:21.194527 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:04:21.196031 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:04:21.456129 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 02:04:21.633223 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.189s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:21.699766 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Deleted allocations for instance 52013bcc-3652-4009-871a-ae37e6ed1c69
May 28 02:04:21.707125 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:21.707125 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:21.707125 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:21.707125 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Auditing locally available compute resources for np0000001583 (node: np0000001583) {{(pid=98241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 02:04:21.736103 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:04:21.736103 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:04:21.757465 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Successfully created port: 2aa7c86f-9ae8-453b-990a-a25050f0da90 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 02:04:21.787526 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.053s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:04:21.787956 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Hypervisor/Node resource view: name=np0000001583 free_ram=13720MB free_disk=73.78861999511719GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 02:04:21.788182 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:21.788469 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:21.962459 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 02:04:22.334380 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Successfully updated port: 2aa7c86f-9ae8-453b-990a-a25050f0da90 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 02:04:22.384282 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-309a4660-f493-4f51-8bd7-c14c08212e09 req-4f1944fd-8e7f-4e2c-8437-afd5eeeed0ac service nova] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Received event network-changed-2aa7c86f-9ae8-453b-990a-a25050f0da90 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:04:22.384436 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-309a4660-f493-4f51-8bd7-c14c08212e09 req-4f1944fd-8e7f-4e2c-8437-afd5eeeed0ac service nova] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Refreshing instance network info cache due to event network-changed-2aa7c86f-9ae8-453b-990a-a25050f0da90. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:04:22.384650 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-309a4660-f493-4f51-8bd7-c14c08212e09 req-4f1944fd-8e7f-4e2c-8437-afd5eeeed0ac service nova] Acquiring lock "refresh_cache-7751bb1a-84b9-48ce-81da-b3a41d63eadc" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:04:22.384815 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-309a4660-f493-4f51-8bd7-c14c08212e09 req-4f1944fd-8e7f-4e2c-8437-afd5eeeed0ac service nova] Acquired lock "refresh_cache-7751bb1a-84b9-48ce-81da-b3a41d63eadc" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:04:22.384889 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-309a4660-f493-4f51-8bd7-c14c08212e09 req-4f1944fd-8e7f-4e2c-8437-afd5eeeed0ac service nova] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Refreshing network info cache for port 2aa7c86f-9ae8-453b-990a-a25050f0da90 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:04:22.712329 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d8f34c76-b713-4a54-a337-99e09be01659 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "52013bcc-3652-4009-871a-ae37e6ed1c69" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.962s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:22.836852 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Acquiring lock "refresh_cache-7751bb1a-84b9-48ce-81da-b3a41d63eadc" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:04:22.879257 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 7751bb1a-84b9-48ce-81da-b3a41d63eadc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:04:22.879257 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 02:04:22.879257 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Final resource view: name=np0000001583 phys_ram=24030MB used_ram=704MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:04:21 up 40 min,  2 users,  load average: 5.22, 6.94, 4.92\n', 'num_instances': '1', 'num_vm_building': '1', 'num_task_networking': '1', 'num_os_type_None': '1', 'num_proj_d9663116fe18428d8e37dea7b30d8b5a': '1', 'io_workload': '1'} {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 02:04:22.892890 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-309a4660-f493-4f51-8bd7-c14c08212e09 req-4f1944fd-8e7f-4e2c-8437-afd5eeeed0ac service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:04:22.972786 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 02:04:22.974193 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 02:04:22.975506 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Creating image(s)
May 28 02:04:22.975506 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Acquiring lock "/opt/stack/data/nova/instances/7751bb1a-84b9-48ce-81da-b3a41d63eadc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:22.980798 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "/opt/stack/data/nova/instances/7751bb1a-84b9-48ce-81da-b3a41d63eadc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.005s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:22.981623 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "/opt/stack/data/nova/instances/7751bb1a-84b9-48ce-81da-b3a41d63eadc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:22.982222 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:04:22.984964 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:04:22.987694 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:04:23.030691 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-309a4660-f493-4f51-8bd7-c14c08212e09 req-4f1944fd-8e7f-4e2c-8437-afd5eeeed0ac service nova] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:04:23.081696 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:04:23.081696 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:04:23.118665 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.131s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:04:23.119588 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:23.119986 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:23.121328 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:04:23.127565 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:04:23.128411 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:04:23.241465 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.113s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:04:23.241909 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/7751bb1a-84b9-48ce-81da-b3a41d63eadc/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:04:23.316532 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/7751bb1a-84b9-48ce-81da-b3a41d63eadc/disk 1073741824" returned: 0 in 0.074s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:04:23.317033 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:23.317373 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:04:23.358534 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-309a4660-f493-4f51-8bd7-c14c08212e09 req-4f1944fd-8e7f-4e2c-8437-afd5eeeed0ac service nova] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:04:23.403437 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:23.439893 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.120s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:04:23.439893 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7751bb1a-84b9-48ce-81da-b3a41d63eadc/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 02:04:23.439893 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7751bb1a-84b9-48ce-81da-b3a41d63eadc/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:04:23.565517 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7751bb1a-84b9-48ce-81da-b3a41d63eadc/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:04:23.568054 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Cannot resize image /opt/stack/data/nova/instances/7751bb1a-84b9-48ce-81da-b3a41d63eadc/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 02:04:23.568589 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 02:04:23.568826 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Ensure instance console log exists: /opt/stack/data/nova/instances/7751bb1a-84b9-48ce-81da-b3a41d63eadc/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 02:04:23.569245 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:23.569531 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:23.569733 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:23.586986 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:04:23.769040 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:23.865835 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-309a4660-f493-4f51-8bd7-c14c08212e09 req-4f1944fd-8e7f-4e2c-8437-afd5eeeed0ac service nova] Releasing lock "refresh_cache-7751bb1a-84b9-48ce-81da-b3a41d63eadc" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:04:23.866480 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Acquired lock "refresh_cache-7751bb1a-84b9-48ce-81da-b3a41d63eadc" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:04:23.866740 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:04:24.098661 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Compute_service record updated for np0000001583:np0000001583 {{(pid=98241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 02:04:24.098935 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.310s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:24.105553 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.09 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:04:24.194174 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:04:24.194174 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:04:24.194374 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:04:24.194504 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:04:24.194667 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 02:04:24.194908 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:04:24.195038 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Cleaning up deleted instances {{(pid=98241) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}}
May 28 02:04:24.375275 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:24.476106 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:04:24.695790 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:04:24.700983 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] There are 0 instances to clean {{(pid=98241) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}}
May 28 02:04:24.701277 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:04:24.701431 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98241) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}}
May 28 02:04:24.883327 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Updating instance_info_cache with network_info: [{"id": "2aa7c86f-9ae8-453b-990a-a25050f0da90", "address": "fa:16:3e:e6:d6:9e", "network": {"id": "4f6e8375-a959-44b0-9cab-ae7918680bf7", "bridge": "br-int", "label": "tempest-TestStampPattern-914776722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d9663116fe18428d8e37dea7b30d8b5a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aa7c86f-9a", "ovs_interfaceid": "2aa7c86f-9ae8-453b-990a-a25050f0da90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:04:25.204422 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 5.99 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:04:25.388098 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Releasing lock "refresh_cache-7751bb1a-84b9-48ce-81da-b3a41d63eadc" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:04:25.388098 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Instance network_info: |[{"id": "2aa7c86f-9ae8-453b-990a-a25050f0da90", "address": "fa:16:3e:e6:d6:9e", "network": {"id": "4f6e8375-a959-44b0-9cab-ae7918680bf7", "bridge": "br-int", "label": "tempest-TestStampPattern-914776722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d9663116fe18428d8e37dea7b30d8b5a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aa7c86f-9a", "ovs_interfaceid": "2aa7c86f-9ae8-453b-990a-a25050f0da90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 02:04:25.391309 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Start _get_guest_xml network_info=[{"id": "2aa7c86f-9ae8-453b-990a-a25050f0da90", "address": "fa:16:3e:e6:d6:9e", "network": {"id": "4f6e8375-a959-44b0-9cab-ae7918680bf7", "bridge": "br-int", "label": "tempest-TestStampPattern-914776722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d9663116fe18428d8e37dea7b30d8b5a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aa7c86f-9a", "ovs_interfaceid": "2aa7c86f-9ae8-453b-990a-a25050f0da90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 02:04:25.397302 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:04:25.398866 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-TestStampPattern-server-126740994', uuid='7751bb1a-84b9-48ce-81da-b3a41d63eadc'), owner=OwnerMeta(userid='db5b8b66a90b4a2dba53c340347aff1d', username='tempest-TestStampPattern-897366137-project-member', projectid='d9663116fe18428d8e37dea7b30d8b5a', projectname='tempest-TestStampPattern-897366137'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2aa7c86f-9ae8-453b-990a-a25050f0da90", "address": "fa:16:3e:e6:d6:9e", "network": {"id": "4f6e8375-a959-44b0-9cab-ae7918680bf7", "bridge": "br-int", "label": "tempest-TestStampPattern-914776722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d9663116fe18428d8e37dea7b30d8b5a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aa7c86f-9a", "ovs_interfaceid": "2aa7c86f-9ae8-453b-990a-a25050f0da90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933865.3983245) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 02:04:25.400545 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 02:04:25.400980 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 02:04:25.402236 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 02:04:25.402430 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 02:04:25.403397 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 02:04:25.403841 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 02:04:25.406018 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 02:04:25.406197 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 02:04:25.406284 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 02:04:25.406400 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 02:04:25.406488 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 02:04:25.406634 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 02:04:25.406834 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 02:04:25.406834 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 02:04:25.407028 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 02:04:25.407144 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 02:04:25.423773 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:04:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-126740994',display_name='tempest-TestStampPattern-server-126740994',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-teststamppattern-server-126740994',id=56,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGla4S7tzFQM3H7dOtPyxXylIxo5cIZbTOWxzJqFZg2znrJ8fjc45cg7DBtdnBMMzNou2BAybRIZM9Fj+5atQu7kwWfQaIDwG2yH2osFl+wPy/fI2Pvg+h4A9P59YVZ+gw==',key_name='tempest-TestStampPattern-1385235397',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9663116fe18428d8e37dea7b30d8b5a',ramdisk_id='',reservation_id='r-o44fb0f5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-897366137',owner_user_name='tempest-TestStampPattern-897366137-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:04:22Z,user_data=None,user_id='db5b8b66a90b4a2dba53c340347aff1d',uuid=7751bb1a-84b9-48ce-81da-b3a41d63eadc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2aa7c86f-9ae8-453b-990a-a25050f0da90", "address": "fa:16:3e:e6:d6:9e", "network": {"id": "4f6e8375-a959-44b0-9cab-ae7918680bf7", "bridge": "br-int", "label": "tempest-TestStampPattern-914776722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d9663116fe18428d8e37dea7b30d8b5a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aa7c86f-9a", "ovs_interfaceid": "2aa7c86f-9ae8-453b-990a-a25050f0da90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 02:04:25.424093 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Converting VIF {"id": "2aa7c86f-9ae8-453b-990a-a25050f0da90", "address": "fa:16:3e:e6:d6:9e", "network": {"id": "4f6e8375-a959-44b0-9cab-ae7918680bf7", "bridge": "br-int", "label": "tempest-TestStampPattern-914776722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d9663116fe18428d8e37dea7b30d8b5a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aa7c86f-9a", "ovs_interfaceid": "2aa7c86f-9ae8-453b-990a-a25050f0da90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:04:25.424915 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:d6:9e,bridge_name='br-int',has_traffic_filtering=True,id=2aa7c86f-9ae8-453b-990a-a25050f0da90,network=Network(4f6e8375-a959-44b0-9cab-ae7918680bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2aa7c86f-9a') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:04:25.425698 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lazy-loading 'pci_devices' on Instance uuid 7751bb1a-84b9-48ce-81da-b3a41d63eadc {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:04:25.929848 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] End _get_guest_xml xml=<domain type="qemu">
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:   <uuid>7751bb1a-84b9-48ce-81da-b3a41d63eadc</uuid>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:   <name>instance-00000038</name>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:   <metadata>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:       <nova:name>tempest-TestStampPattern-server-126740994</nova:name>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 02:04:25</nova:creationTime>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:       </nova:image>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:         <nova:user uuid="db5b8b66a90b4a2dba53c340347aff1d">tempest-TestStampPattern-897366137-project-member</nova:user>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:         <nova:project uuid="d9663116fe18428d8e37dea7b30d8b5a">tempest-TestStampPattern-897366137</nova:project>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:         <nova:port uuid="2aa7c86f-9ae8-453b-990a-a25050f0da90">
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:         </nova:port>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:   </metadata>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:     <system>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:       <entry name="serial">7751bb1a-84b9-48ce-81da-b3a41d63eadc</entry>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:       <entry name="uuid">7751bb1a-84b9-48ce-81da-b3a41d63eadc</entry>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:     </system>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:   <os>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:   </os>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:   <features>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:     <acpi/>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:     <tcg>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:     </tcg>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:   </features>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:   </cpu>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:   <devices>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/7751bb1a-84b9-48ce-81da-b3a41d63eadc/disk"/>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:     </disk>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/7751bb1a-84b9-48ce-81da-b3a41d63eadc/disk.config"/>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:     </disk>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:e6:d6:9e"/>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:       <target dev="tap2aa7c86f-9a"/>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:     </interface>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/7751bb1a-84b9-48ce-81da-b3a41d63eadc/console.log" append="off"/>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:     </serial>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:     <video>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:     </video>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:     </rng>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:     </memballoon>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:   </devices>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]: </domain>
May 28 02:04:25.929848 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 02:04:25.929848 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Preparing to wait for external event network-vif-plugged-2aa7c86f-9ae8-453b-990a-a25050f0da90 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 02:04:25.935091 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Acquiring lock "7751bb1a-84b9-48ce-81da-b3a41d63eadc-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:25.935091 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "7751bb1a-84b9-48ce-81da-b3a41d63eadc-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:25.935091 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "7751bb1a-84b9-48ce-81da-b3a41d63eadc-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:25.935091 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:04:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-126740994',display_name='tempest-TestStampPattern-server-126740994',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-teststamppattern-server-126740994',id=56,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGla4S7tzFQM3H7dOtPyxXylIxo5cIZbTOWxzJqFZg2znrJ8fjc45cg7DBtdnBMMzNou2BAybRIZM9Fj+5atQu7kwWfQaIDwG2yH2osFl+wPy/fI2Pvg+h4A9P59YVZ+gw==',key_name='tempest-TestStampPattern-1385235397',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9663116fe18428d8e37dea7b30d8b5a',ramdisk_id='',reservation_id='r-o44fb0f5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-897366137',owner_user_name='tempest-TestStampPattern-897366137-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:04:22Z,user_data=None,user_id='db5b8b66a90b4a2dba53c340347aff1d',uuid=7751bb1a-84b9-48ce-81da-b3a41d63eadc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2aa7c86f-9ae8-453b-990a-a25050f0da90", "address": "fa:16:3e:e6:d6:9e", "network": {"id": "4f6e8375-a959-44b0-9cab-ae7918680bf7", "bridge": "br-int", "label": "tempest-TestStampPattern-914776722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d9663116fe18428d8e37dea7b30d8b5a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aa7c86f-9a", "ovs_interfaceid": "2aa7c86f-9ae8-453b-990a-a25050f0da90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 02:04:25.935091 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Converting VIF {"id": "2aa7c86f-9ae8-453b-990a-a25050f0da90", "address": "fa:16:3e:e6:d6:9e", "network": {"id": "4f6e8375-a959-44b0-9cab-ae7918680bf7", "bridge": "br-int", "label": "tempest-TestStampPattern-914776722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d9663116fe18428d8e37dea7b30d8b5a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aa7c86f-9a", "ovs_interfaceid": "2aa7c86f-9ae8-453b-990a-a25050f0da90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:04:25.935091 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:d6:9e,bridge_name='br-int',has_traffic_filtering=True,id=2aa7c86f-9ae8-453b-990a-a25050f0da90,network=Network(4f6e8375-a959-44b0-9cab-ae7918680bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2aa7c86f-9a') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:04:25.935091 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:d6:9e,bridge_name='br-int',has_traffic_filtering=True,id=2aa7c86f-9ae8-453b-990a-a25050f0da90,network=Network(4f6e8375-a959-44b0-9cab-ae7918680bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2aa7c86f-9a') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 02:04:25.935091 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:25.935091 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:04:25.935091 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 02:04:25.937820 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:25.937820 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dc40d4bd-dc5b-5cc7-bc6d-8bec8399277e', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:04:25.940000 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:25.940861 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:04:25.945880 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:25.946265 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2aa7c86f-9a, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:04:25.947424 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2aa7c86f-9a, col_values=(('qos', UUID('ed09ca01-8f7c-4955-ad39-4141241f3f49')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:04:25.947501 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2aa7c86f-9a, col_values=(('external_ids', {'iface-id': '2aa7c86f-9ae8-453b-990a-a25050f0da90', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:d6:9e', 'vm-uuid': '7751bb1a-84b9-48ce-81da-b3a41d63eadc'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:04:25.950183 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:25.950870 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:04:25.957092 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:25.960144 np0000001583 nova-compute[98241]: INFO os_vif [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:d6:9e,bridge_name='br-int',has_traffic_filtering=True,id=2aa7c86f-9ae8-453b-990a-a25050f0da90,network=Network(4f6e8375-a959-44b0-9cab-ae7918680bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2aa7c86f-9a')
May 28 02:04:25.980725 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0006518629998026881 future=<Future at 0x7724f8465340 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:04:25.982798 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Emitting event <LifecycleEvent: 1779933850.9798245, 22694475-4a1d-4eeb-881f-52234bd9bb7d => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:04:25.982798 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:04:25.983436 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=2.647958681000091 future=<Future at 0x7724ec074a70 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:04:25.983436 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] VM Stopped (Lifecycle Event)
May 28 02:04:25.985905 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=2.645313484000326 future=<Future at 0x7724ec074a70 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:04:26.487581 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: 22694475-4a1d-4eeb-881f-52234bd9bb7d] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:04:27.487890 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:04:27.489128 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:04:27.489128 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] No VIF found with MAC fa:16:3e:e6:d6:9e, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:04:27.489128 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Using config drive
May 28 02:04:27.998104 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:04:28.177101 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Creating config drive at /opt/stack/data/nova/instances/7751bb1a-84b9-48ce-81da-b3a41d63eadc/disk.config
May 28 02:04:28.183503 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7751bb1a-84b9-48ce-81da-b3a41d63eadc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpghdo_d2l {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:04:28.253246 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7751bb1a-84b9-48ce-81da-b3a41d63eadc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpghdo_d2l" returned: 0 in 0.071s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:04:28.404027 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:28.631733 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0005419099998107413 future=<Future at 0x7724ec074a70 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:04:28.632102 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:04:28.632102 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=0.22421144600002663 future=<Future at 0x7724f87e55b0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:04:28.632102 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=0.2241269889996147 future=<Future at 0x7724f87e55b0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:04:28.634010 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] Emitting event <LifecycleEvent: 1779933853.6308901, 52013bcc-3652-4009-871a-ae37e6ed1c69 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:04:28.634010 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] VM Stopped (Lifecycle Event)
May 28 02:04:28.802655 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:28.830269 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:28.856575 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.00032674200019755517 future=<Future at 0x7724f87e55b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:04:28.856691 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:04:28.859592 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Emitting event <LifecycleEvent: 1779933853.8561552, 9a804913-4bfb-4dba-9efe-cbf7c575d8d1 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:04:28.859791 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] VM Stopped (Lifecycle Event)
May 28 02:04:28.948573 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:28.950286 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:29.055794 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0fb3976f-8c36-4205-ae7d-584364e7c702 req-8dfb1bfb-f137-449d-8bad-c986a5a2d78b service nova] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Received event network-vif-plugged-2aa7c86f-9ae8-453b-990a-a25050f0da90 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:04:29.056191 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0fb3976f-8c36-4205-ae7d-584364e7c702 req-8dfb1bfb-f137-449d-8bad-c986a5a2d78b service nova] Acquiring lock "7751bb1a-84b9-48ce-81da-b3a41d63eadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:29.056323 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0fb3976f-8c36-4205-ae7d-584364e7c702 req-8dfb1bfb-f137-449d-8bad-c986a5a2d78b service nova] Lock "7751bb1a-84b9-48ce-81da-b3a41d63eadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:29.057074 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0fb3976f-8c36-4205-ae7d-584364e7c702 req-8dfb1bfb-f137-449d-8bad-c986a5a2d78b service nova] Lock "7751bb1a-84b9-48ce-81da-b3a41d63eadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:29.057074 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0fb3976f-8c36-4205-ae7d-584364e7c702 req-8dfb1bfb-f137-449d-8bad-c986a5a2d78b service nova] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Processing event network-vif-plugged-2aa7c86f-9ae8-453b-990a-a25050f0da90 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 02:04:29.136572 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-4db9c484-a367-4a13-a827-cd9f9f579902 tempest-TestMinimumBasicScenario-1092247749 tempest-TestMinimumBasicScenario-1092247749-project-member] [instance: 52013bcc-3652-4009-871a-ae37e6ed1c69] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:04:29.275376 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:29.282910 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:29.284108 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:29.316332 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:29.365202 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-db2fdca8-c2e4-4e4b-a0e9-dacffda84b9a tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 9a804913-4bfb-4dba-9efe-cbf7c575d8d1] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:04:29.598941 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:29.747987 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "d81ea788-4a10-41c8-a695-8dc5ac2c5701" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:29.749121 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "d81ea788-4a10-41c8-a695-8dc5ac2c5701" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:30.008107 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933870.0076346, 7751bb1a-84b9-48ce-81da-b3a41d63eadc => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:04:30.008384 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] VM Started (Lifecycle Event)
May 28 02:04:30.010250 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 02:04:30.018628 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 02:04:30.025244 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Instance spawned successfully.
May 28 02:04:30.030262 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 02:04:30.255092 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 02:04:30.343414 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Acquiring lock "14c6f881-05d4-417a-9285-197415ae35a1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:30.344129 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Lock "14c6f881-05d4-417a-9285-197415ae35a1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:30.512280 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:04:30.518979 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:04:30.553127 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:04:30.554255 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:04:30.554255 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:04:30.554255 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:04:30.554801 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:04:30.554801 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:04:30.848902 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 02:04:30.859068 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:30.859382 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:30.863668 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 02:04:30.863848 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Claim successful on node np0000001583
May 28 02:04:30.949995 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:31.022997 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 02:04:31.022997 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933871.0227456, 7751bb1a-84b9-48ce-81da-b3a41d63eadc => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:04:31.022997 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] VM Paused (Lifecycle Event)
May 28 02:04:31.062798 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Took 8.09 seconds to spawn the instance on the hypervisor.
May 28 02:04:31.063056 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:04:31.170743 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-984c938d-b9a7-4d4c-9bd4-3c15f032f28a req-7cc86513-3666-4b03-a95a-956b6baaaef5 service nova] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Received event network-vif-plugged-2aa7c86f-9ae8-453b-990a-a25050f0da90 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:04:31.170958 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-984c938d-b9a7-4d4c-9bd4-3c15f032f28a req-7cc86513-3666-4b03-a95a-956b6baaaef5 service nova] Acquiring lock "7751bb1a-84b9-48ce-81da-b3a41d63eadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:31.171167 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-984c938d-b9a7-4d4c-9bd4-3c15f032f28a req-7cc86513-3666-4b03-a95a-956b6baaaef5 service nova] Lock "7751bb1a-84b9-48ce-81da-b3a41d63eadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:31.172234 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-984c938d-b9a7-4d4c-9bd4-3c15f032f28a req-7cc86513-3666-4b03-a95a-956b6baaaef5 service nova] Lock "7751bb1a-84b9-48ce-81da-b3a41d63eadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:31.172234 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-984c938d-b9a7-4d4c-9bd4-3c15f032f28a req-7cc86513-3666-4b03-a95a-956b6baaaef5 service nova] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] No waiting events found dispatching network-vif-plugged-2aa7c86f-9ae8-453b-990a-a25050f0da90 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:04:31.172234 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-984c938d-b9a7-4d4c-9bd4-3c15f032f28a req-7cc86513-3666-4b03-a95a-956b6baaaef5 service nova] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Received unexpected event network-vif-plugged-2aa7c86f-9ae8-453b-990a-a25050f0da90 for instance with vm_state building and task_state spawning.
May 28 02:04:31.194314 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:04:31.459374 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:31.531744 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:04:31.537957 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933871.5376008, 7751bb1a-84b9-48ce-81da-b3a41d63eadc => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:04:31.538132 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] VM Resumed (Lifecycle Event)
May 28 02:04:31.588839 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Took 14.18 seconds to build instance.
May 28 02:04:31.698092 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 49.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:04:32.040982 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:04:32.047262 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:04:32.096879 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0c72af98-b858-4a5d-ac6b-252013d914f4 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "7751bb1a-84b9-48ce-81da-b3a41d63eadc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.700s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:32.182899 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:04:32.183936 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:04:32.634327 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:32.691838 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:04:33.201182 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.342s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:33.202280 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.746s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:33.205023 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 02:04:33.213726 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 02:04:33.213891 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Claim successful on node np0000001583
May 28 02:04:33.417240 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:33.723229 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 02:04:33.723449 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 02:04:33.723772 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:04:33.724169 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:04:33.817947 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6be314b4eed642c3b2c72fe115860220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432aa1094ced436494def17a875aa8e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 02:04:34.226852 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 02:04:34.486257 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-24d37bf8-1cbe-4e97-ab41-ef450e43e999 req-df7ecacb-12ef-48b1-ad8d-8f001c808672 service nova] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Received event network-changed-2aa7c86f-9ae8-453b-990a-a25050f0da90 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:04:34.487140 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-24d37bf8-1cbe-4e97-ab41-ef450e43e999 req-df7ecacb-12ef-48b1-ad8d-8f001c808672 service nova] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Refreshing instance network info cache due to event network-changed-2aa7c86f-9ae8-453b-990a-a25050f0da90. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:04:34.487739 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-24d37bf8-1cbe-4e97-ab41-ef450e43e999 req-df7ecacb-12ef-48b1-ad8d-8f001c808672 service nova] Acquiring lock "refresh_cache-7751bb1a-84b9-48ce-81da-b3a41d63eadc" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:04:34.488914 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-24d37bf8-1cbe-4e97-ab41-ef450e43e999 req-df7ecacb-12ef-48b1-ad8d-8f001c808672 service nova] Acquired lock "refresh_cache-7751bb1a-84b9-48ce-81da-b3a41d63eadc" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:04:34.488914 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-24d37bf8-1cbe-4e97-ab41-ef450e43e999 req-df7ecacb-12ef-48b1-ad8d-8f001c808672 service nova] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Refreshing network info cache for port 2aa7c86f-9ae8-453b-990a-a25050f0da90 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:04:34.494296 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:04:34.494578 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:04:34.548283 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Successfully created port: 203448a3-3550-4972-8c14-146165af89d2 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 02:04:34.731211 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 02:04:34.990421 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-24d37bf8-1cbe-4e97-ab41-ef450e43e999 req-df7ecacb-12ef-48b1-ad8d-8f001c808672 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:04:35.003042 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:04:35.117304 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Successfully updated port: 203448a3-3550-4972-8c14-146165af89d2 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 02:04:35.236512 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Booting with volume 873f9b75-1314-4acd-9c69-c4ae877916aa at /dev/vda
May 28 02:04:35.278999 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:04:35.291280 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 02:04:35.320673 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:04:35.349277 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-24d37bf8-1cbe-4e97-ab41-ef450e43e999 req-df7ecacb-12ef-48b1-ad8d-8f001c808672 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:04:35.369124 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 02:04:35.369801 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 02:04:35.384950 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 02:04:35.386301 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fee6:d69e', 'fe80::f881:28ff:fef8:dbfc'] 
May 28 02:04:35.386301 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 02:04:35.386442 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 02:04:35.387005 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:04:35.387179 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Updating existing volume attachment record: 688135f6-cf85-491a-baea-33fc4d536fb2 {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 02:04:35.519786 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.318s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:35.520482 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 02:04:35.540699 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-24d37bf8-1cbe-4e97-ab41-ef450e43e999 req-df7ecacb-12ef-48b1-ad8d-8f001c808672 service nova] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Updated VIF entry in instance network info cache for port 2aa7c86f-9ae8-453b-990a-a25050f0da90. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:04:35.541042 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-24d37bf8-1cbe-4e97-ab41-ef450e43e999 req-df7ecacb-12ef-48b1-ad8d-8f001c808672 service nova] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Updating instance_info_cache with network_info: [{"id": "2aa7c86f-9ae8-453b-990a-a25050f0da90", "address": "fa:16:3e:e6:d6:9e", "network": {"id": "4f6e8375-a959-44b0-9cab-ae7918680bf7", "bridge": "br-int", "label": "tempest-TestStampPattern-914776722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d9663116fe18428d8e37dea7b30d8b5a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aa7c86f-9a", "ovs_interfaceid": "2aa7c86f-9ae8-453b-990a-a25050f0da90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:04:35.619433 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "refresh_cache-d81ea788-4a10-41c8-a695-8dc5ac2c5701" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:04:35.619646 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquired lock "refresh_cache-d81ea788-4a10-41c8-a695-8dc5ac2c5701" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:04:35.619861 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:04:35.950728 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:36.031472 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 02:04:36.032172 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 02:04:36.032172 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:04:36.032412 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:04:36.043601 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-24d37bf8-1cbe-4e97-ab41-ef450e43e999 req-df7ecacb-12ef-48b1-ad8d-8f001c808672 service nova] Releasing lock "refresh_cache-7751bb1a-84b9-48ce-81da-b3a41d63eadc" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:04:36.168235 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:36.236010 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:04:36.336597 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b42604c941f54ed7803146970f1b0922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '045365722a2d4da3810ac50b09436047', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 02:04:36.534455 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 02:04:36.548539 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:04:36.573983 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e5e5f198-29dc-4f79-8dc3-b65ce66ea1e9 req-9b8d5ae7-216f-444f-95fe-cece7b9636b9 service nova] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Received event network-changed-203448a3-3550-4972-8c14-146165af89d2 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:04:36.574940 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e5e5f198-29dc-4f79-8dc3-b65ce66ea1e9 req-9b8d5ae7-216f-444f-95fe-cece7b9636b9 service nova] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Refreshing instance network info cache due to event network-changed-203448a3-3550-4972-8c14-146165af89d2. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:04:36.574940 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e5e5f198-29dc-4f79-8dc3-b65ce66ea1e9 req-9b8d5ae7-216f-444f-95fe-cece7b9636b9 service nova] Acquiring lock "refresh_cache-d81ea788-4a10-41c8-a695-8dc5ac2c5701" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:04:36.770799 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Updating instance_info_cache with network_info: [{"id": "203448a3-3550-4972-8c14-146165af89d2", "address": "fa:16:3e:a5:62:55", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap203448a3-35", "ovs_interfaceid": "203448a3-3550-4972-8c14-146165af89d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:04:37.037327 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Successfully created port: a3fba340-eb11-4c87-8c76-e2a3d60b48ac {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 02:04:37.042034 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 02:04:37.272907 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Releasing lock "refresh_cache-d81ea788-4a10-41c8-a695-8dc5ac2c5701" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:04:37.273125 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Instance network_info: |[{"id": "203448a3-3550-4972-8c14-146165af89d2", "address": "fa:16:3e:a5:62:55", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap203448a3-35", "ovs_interfaceid": "203448a3-3550-4972-8c14-146165af89d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 02:04:37.273587 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e5e5f198-29dc-4f79-8dc3-b65ce66ea1e9 req-9b8d5ae7-216f-444f-95fe-cece7b9636b9 service nova] Acquired lock "refresh_cache-d81ea788-4a10-41c8-a695-8dc5ac2c5701" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:04:37.273880 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-e5e5f198-29dc-4f79-8dc3-b65ce66ea1e9 req-9b8d5ae7-216f-444f-95fe-cece7b9636b9 service nova] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Refreshing network info cache for port 203448a3-3550-4972-8c14-146165af89d2 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:04:37.524112 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 02:04:37.526216 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 02:04:37.529069 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Creating image(s)
May 28 02:04:37.529069 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Did not create local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 02:04:37.529413 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Ensure instance console log exists: /opt/stack/data/nova/instances/d81ea788-4a10-41c8-a695-8dc5ac2c5701/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 02:04:37.532117 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:37.532117 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:37.532117 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:37.532117 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Start _get_guest_xml network_info=[{"id": "203448a3-3550-4972-8c14-146165af89d2", "address": "fa:16:3e:a5:62:55", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap203448a3-35", "ovs_interfaceid": "203448a3-3550-4972-8c14-146165af89d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa', 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '873f9b75-1314-4acd-9c69-c4ae877916aa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'd81ea788-4a10-41c8-a695-8dc5ac2c5701', 'attached_at': '', 'detached_at': '', 'volume_id': '873f9b75-1314-4acd-9c69-c4ae877916aa', 'serial': '873f9b75-1314-4acd-9c69-c4ae877916aa'}, 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '688135f6-cf85-491a-baea-33fc4d536fb2', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 02:04:37.537861 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:04:37.539791 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1246212049', uuid='d81ea788-4a10-41c8-a695-8dc5ac2c5701'), owner=OwnerMeta(userid='6be314b4eed642c3b2c72fe115860220', username='tempest-TestVolumeBootPattern-1031057169-project-member', projectid='432aa1094ced436494def17a875aa8e1', projectname='tempest-TestVolumeBootPattern-1031057169'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "203448a3-3550-4972-8c14-146165af89d2", "address": "fa:16:3e:a5:62:55", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap203448a3-35", "ovs_interfaceid": "203448a3-3550-4972-8c14-146165af89d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933877.5390642) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 02:04:37.553128 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 02:04:37.553524 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 02:04:37.555545 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 02:04:37.555827 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 02:04:37.556944 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 02:04:37.557399 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 02:04:37.557528 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 02:04:37.557528 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 02:04:37.557668 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 02:04:37.557843 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 02:04:37.557903 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 02:04:37.558042 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 02:04:37.559108 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 02:04:37.559108 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 02:04:37.559108 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 02:04:37.559108 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 02:04:37.575004 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 02:04:37.576926 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa', 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '873f9b75-1314-4acd-9c69-c4ae877916aa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:04:37.579455 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:04:37.681359 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Successfully updated port: a3fba340-eb11-4c87-8c76-e2a3d60b48ac {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 02:04:37.777203 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-e5e5f198-29dc-4f79-8dc3-b65ce66ea1e9 req-9b8d5ae7-216f-444f-95fe-cece7b9636b9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:04:38.057324 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 02:04:38.058753 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 02:04:38.059127 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Creating image(s)
May 28 02:04:38.059430 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Acquiring lock "/opt/stack/data/nova/instances/14c6f881-05d4-417a-9285-197415ae35a1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:38.059594 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Lock "/opt/stack/data/nova/instances/14c6f881-05d4-417a-9285-197415ae35a1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:38.060094 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Lock "/opt/stack/data/nova/instances/14c6f881-05d4-417a-9285-197415ae35a1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:38.060646 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:04:38.068486 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:04:38.069793 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:04:38.134301 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-e5e5f198-29dc-4f79-8dc3-b65ce66ea1e9 req-9b8d5ae7-216f-444f-95fe-cece7b9636b9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:04:38.185204 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Acquiring lock "refresh_cache-14c6f881-05d4-417a-9285-197415ae35a1" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:04:38.185377 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Acquired lock "refresh_cache-14c6f881-05d4-417a-9285-197415ae35a1" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:04:38.185703 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:04:38.188820 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.119s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:04:38.189512 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:38.189946 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:38.190404 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:04:38.194690 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:04:38.195010 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:04:38.295053 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-e5e5f198-29dc-4f79-8dc3-b65ce66ea1e9 req-9b8d5ae7-216f-444f-95fe-cece7b9636b9 service nova] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Updated VIF entry in instance network info cache for port 203448a3-3550-4972-8c14-146165af89d2. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:04:38.295799 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-e5e5f198-29dc-4f79-8dc3-b65ce66ea1e9 req-9b8d5ae7-216f-444f-95fe-cece7b9636b9 service nova] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Updating instance_info_cache with network_info: [{"id": "203448a3-3550-4972-8c14-146165af89d2", "address": "fa:16:3e:a5:62:55", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap203448a3-35", "ovs_interfaceid": "203448a3-3550-4972-8c14-146165af89d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:04:38.299470 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.104s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:04:38.299918 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/14c6f881-05d4-417a-9285-197415ae35a1/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:04:38.362364 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/14c6f881-05d4-417a-9285-197415ae35a1/disk 1073741824" returned: 0 in 0.062s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:04:38.362848 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.173s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:38.363229 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:04:38.421559 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:38.472696 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.109s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:04:38.473238 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Checking if we can resize image /opt/stack/data/nova/instances/14c6f881-05d4-417a-9285-197415ae35a1/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 02:04:38.473468 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c6f881-05d4-417a-9285-197415ae35a1/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:04:38.580774 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c6f881-05d4-417a-9285-197415ae35a1/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:04:38.580774 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Cannot resize image /opt/stack/data/nova/instances/14c6f881-05d4-417a-9285-197415ae35a1/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 02:04:38.581203 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 02:04:38.581203 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Ensure instance console log exists: /opt/stack/data/nova/instances/14c6f881-05d4-417a-9285-197415ae35a1/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 02:04:38.581348 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:38.582531 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:38.582531 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:38.659022 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b598a424-fd59-4668-a1a4-eeb870ce3a91 req-d578f77e-b206-49ff-bf78-b89bf40505a9 service nova] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Received event network-changed-a3fba340-eb11-4c87-8c76-e2a3d60b48ac {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:04:38.659180 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b598a424-fd59-4668-a1a4-eeb870ce3a91 req-d578f77e-b206-49ff-bf78-b89bf40505a9 service nova] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Refreshing instance network info cache due to event network-changed-a3fba340-eb11-4c87-8c76-e2a3d60b48ac. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:04:38.659330 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b598a424-fd59-4668-a1a4-eeb870ce3a91 req-d578f77e-b206-49ff-bf78-b89bf40505a9 service nova] Acquiring lock "refresh_cache-14c6f881-05d4-417a-9285-197415ae35a1" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:04:38.668926 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:38.788920 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:04:38.798442 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e5e5f198-29dc-4f79-8dc3-b65ce66ea1e9 req-9b8d5ae7-216f-444f-95fe-cece7b9636b9 service nova] Releasing lock "refresh_cache-d81ea788-4a10-41c8-a695-8dc5ac2c5701" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:04:38.969814 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:04:39.117691 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Updating instance_info_cache with network_info: [{"id": "a3fba340-eb11-4c87-8c76-e2a3d60b48ac", "address": "fa:16:3e:88:7e:41", "network": {"id": "c60710fd-eeb6-4948-8a84-8b95cae31191", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6b98ce7597d45a6b839c720f99fa1e9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3fba340-eb", "ovs_interfaceid": "a3fba340-eb11-4c87-8c76-e2a3d60b48ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:04:39.439978 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.862s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:04:39.440204 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa', 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '873f9b75-1314-4acd-9c69-c4ae877916aa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 02:04:39.452983 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:04:39.454447 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:04:39.454946 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:04:39.455120 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:04:39.458058 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:04:39.458058 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:04:39.467746 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:04:39.467746 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:04:39.476916 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:04:39.476916 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:04:39.483881 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa] added
May 28 02:04:39.483881 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:04:39.483881 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:04:39.483881 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:04:39.483881 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:04:39.483881 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:04:39.483881 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:04:39.484153 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:04:39.485453 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0292(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:04:39.485453 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:04:39.491848 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa] added
May 28 02:04:39.491848 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:04:39.491848 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:04:39.491848 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:04:39.491848 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:04:39.491848 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:04:39.491848 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:04:39.491848 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:04:39.491848 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.035(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:04:39.491848 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:04:39.622600 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Releasing lock "refresh_cache-14c6f881-05d4-417a-9285-197415ae35a1" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:04:39.623065 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Instance network_info: |[{"id": "a3fba340-eb11-4c87-8c76-e2a3d60b48ac", "address": "fa:16:3e:88:7e:41", "network": {"id": "c60710fd-eeb6-4948-8a84-8b95cae31191", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6b98ce7597d45a6b839c720f99fa1e9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3fba340-eb", "ovs_interfaceid": "a3fba340-eb11-4c87-8c76-e2a3d60b48ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 02:04:39.624014 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b598a424-fd59-4668-a1a4-eeb870ce3a91 req-d578f77e-b206-49ff-bf78-b89bf40505a9 service nova] Acquired lock "refresh_cache-14c6f881-05d4-417a-9285-197415ae35a1" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:04:39.624014 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-b598a424-fd59-4668-a1a4-eeb870ce3a91 req-d578f77e-b206-49ff-bf78-b89bf40505a9 service nova] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Refreshing network info cache for port a3fba340-eb11-4c87-8c76-e2a3d60b48ac {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:04:39.626636 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Start _get_guest_xml network_info=[{"id": "a3fba340-eb11-4c87-8c76-e2a3d60b48ac", "address": "fa:16:3e:88:7e:41", "network": {"id": "c60710fd-eeb6-4948-8a84-8b95cae31191", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6b98ce7597d45a6b839c720f99fa1e9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3fba340-eb", "ovs_interfaceid": "a3fba340-eb11-4c87-8c76-e2a3d60b48ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 02:04:39.634237 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:04:39.635782 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-VolumesNegativeTest-instance-167204155', uuid='14c6f881-05d4-417a-9285-197415ae35a1'), owner=OwnerMeta(userid='b42604c941f54ed7803146970f1b0922', username='tempest-VolumesNegativeTest-324661917-project-member', projectid='045365722a2d4da3810ac50b09436047', projectname='tempest-VolumesNegativeTest-324661917'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a3fba340-eb11-4c87-8c76-e2a3d60b48ac", "address": "fa:16:3e:88:7e:41", "network": {"id": "c60710fd-eeb6-4948-8a84-8b95cae31191", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6b98ce7597d45a6b839c720f99fa1e9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3fba340-eb", "ovs_interfaceid": "a3fba340-eb11-4c87-8c76-e2a3d60b48ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933879.6352453) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 02:04:39.637449 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 02:04:39.637838 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 02:04:39.639374 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 02:04:39.639595 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 02:04:39.640725 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 02:04:39.641402 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 02:04:39.641596 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 02:04:39.641753 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 02:04:39.641922 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 02:04:39.642048 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 02:04:39.642213 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 02:04:39.642418 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 02:04:39.642559 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 02:04:39.642711 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 02:04:39.642867 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 02:04:39.643042 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 02:04:39.655880 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-167204155',display_name='tempest-VolumesNegativeTest-instance-167204155',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-volumesnegativetest-instance-167204155',id=58,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='045365722a2d4da3810ac50b09436047',ramdisk_id='',reservation_id='r-nih9yhgy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-324661917',owner_user_name='tempest-VolumesNegativeTest-324661917-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:04:37Z,user_data=None,user_id='b42604c941f54ed7803146970f1b0922',uuid=14c6f881-05d4-417a-9285-197415ae35a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3fba340-eb11-4c87-8c76-e2a3d60b48ac", "address": "fa:16:3e:88:7e:41", "network": {"id": "c60710fd-eeb6-4948-8a84-8b95cae31191", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6b98ce7597d45a6b839c720f99fa1e9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3fba340-eb", "ovs_interfaceid": "a3fba340-eb11-4c87-8c76-e2a3d60b48ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 02:04:39.656190 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Converting VIF {"id": "a3fba340-eb11-4c87-8c76-e2a3d60b48ac", "address": "fa:16:3e:88:7e:41", "network": {"id": "c60710fd-eeb6-4948-8a84-8b95cae31191", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6b98ce7597d45a6b839c720f99fa1e9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3fba340-eb", "ovs_interfaceid": "a3fba340-eb11-4c87-8c76-e2a3d60b48ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:04:39.657034 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:7e:41,bridge_name='br-int',has_traffic_filtering=True,id=a3fba340-eb11-4c87-8c76-e2a3d60b48ac,network=Network(c60710fd-eeb6-4948-8a84-8b95cae31191),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3fba340-eb') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:04:39.657651 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Lazy-loading 'pci_devices' on Instance uuid 14c6f881-05d4-417a-9285-197415ae35a1 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:04:40.128829 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-b598a424-fd59-4668-a1a4-eeb870ce3a91 req-d578f77e-b206-49ff-bf78-b89bf40505a9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:04:40.161854 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] End _get_guest_xml xml=<domain type="qemu">
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:   <uuid>14c6f881-05d4-417a-9285-197415ae35a1</uuid>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:   <name>instance-0000003a</name>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:   <metadata>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:       <nova:name>tempest-VolumesNegativeTest-instance-167204155</nova:name>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 02:04:39</nova:creationTime>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:       </nova:image>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:         <nova:user uuid="b42604c941f54ed7803146970f1b0922">tempest-VolumesNegativeTest-324661917-project-member</nova:user>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:         <nova:project uuid="045365722a2d4da3810ac50b09436047">tempest-VolumesNegativeTest-324661917</nova:project>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:         <nova:port uuid="a3fba340-eb11-4c87-8c76-e2a3d60b48ac">
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="192.168.233.69" ipVersion="4"/>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:         </nova:port>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:   </metadata>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:     <system>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:       <entry name="serial">14c6f881-05d4-417a-9285-197415ae35a1</entry>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:       <entry name="uuid">14c6f881-05d4-417a-9285-197415ae35a1</entry>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:     </system>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:   <os>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:   </os>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:   <features>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:     <acpi/>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:     <tcg>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:     </tcg>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:   </features>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:   </cpu>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:   <devices>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/14c6f881-05d4-417a-9285-197415ae35a1/disk"/>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:     </disk>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/14c6f881-05d4-417a-9285-197415ae35a1/disk.config"/>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:     </disk>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:88:7e:41"/>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:       <target dev="tapa3fba340-eb"/>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:     </interface>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/14c6f881-05d4-417a-9285-197415ae35a1/console.log" append="off"/>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:     </serial>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:     <video>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:     </video>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:     </rng>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:     </memballoon>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:   </devices>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]: </domain>
May 28 02:04:40.161854 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 02:04:40.163874 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Preparing to wait for external event network-vif-plugged-a3fba340-eb11-4c87-8c76-e2a3d60b48ac {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 02:04:40.163874 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Acquiring lock "14c6f881-05d4-417a-9285-197415ae35a1-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:40.163874 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Lock "14c6f881-05d4-417a-9285-197415ae35a1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:40.163874 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Lock "14c6f881-05d4-417a-9285-197415ae35a1-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:40.163874 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-167204155',display_name='tempest-VolumesNegativeTest-instance-167204155',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-volumesnegativetest-instance-167204155',id=58,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='045365722a2d4da3810ac50b09436047',ramdisk_id='',reservation_id='r-nih9yhgy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-324661917',owner_user_name='tempest-VolumesNegativeTest-324661917-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:04:37Z,user_data=None,user_id='b42604c941f54ed7803146970f1b0922',uuid=14c6f881-05d4-417a-9285-197415ae35a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3fba340-eb11-4c87-8c76-e2a3d60b48ac", "address": "fa:16:3e:88:7e:41", "network": {"id": "c60710fd-eeb6-4948-8a84-8b95cae31191", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6b98ce7597d45a6b839c720f99fa1e9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3fba340-eb", "ovs_interfaceid": "a3fba340-eb11-4c87-8c76-e2a3d60b48ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 02:04:40.163874 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Converting VIF {"id": "a3fba340-eb11-4c87-8c76-e2a3d60b48ac", "address": "fa:16:3e:88:7e:41", "network": {"id": "c60710fd-eeb6-4948-8a84-8b95cae31191", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6b98ce7597d45a6b839c720f99fa1e9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3fba340-eb", "ovs_interfaceid": "a3fba340-eb11-4c87-8c76-e2a3d60b48ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:04:40.163874 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:7e:41,bridge_name='br-int',has_traffic_filtering=True,id=a3fba340-eb11-4c87-8c76-e2a3d60b48ac,network=Network(c60710fd-eeb6-4948-8a84-8b95cae31191),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3fba340-eb') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:04:40.164189 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:7e:41,bridge_name='br-int',has_traffic_filtering=True,id=a3fba340-eb11-4c87-8c76-e2a3d60b48ac,network=Network(c60710fd-eeb6-4948-8a84-8b95cae31191),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3fba340-eb') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 02:04:40.164767 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:40.164767 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:04:40.164767 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 02:04:40.165519 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:40.165669 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1401b97f-dc14-5bed-8846-e9de309441e9', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:04:40.166549 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:40.167176 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:04:40.167874 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:40.170041 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:40.170194 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa3fba340-eb, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:04:40.170471 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa3fba340-eb, col_values=(('qos', UUID('d3ba5bf8-5366-4419-bcc1-a6c37ef2111f')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:04:40.170639 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa3fba340-eb, col_values=(('external_ids', {'iface-id': 'a3fba340-eb11-4c87-8c76-e2a3d60b48ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:7e:41', 'vm-uuid': '14c6f881-05d4-417a-9285-197415ae35a1'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:04:40.171404 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:40.173053 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:04:40.177260 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:40.178127 np0000001583 nova-compute[98241]: INFO os_vif [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:7e:41,bridge_name='br-int',has_traffic_filtering=True,id=a3fba340-eb11-4c87-8c76-e2a3d60b48ac,network=Network(c60710fd-eeb6-4948-8a84-8b95cae31191),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3fba340-eb')
May 28 02:04:40.427255 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-b598a424-fd59-4668-a1a4-eeb870ce3a91 req-d578f77e-b206-49ff-bf78-b89bf40505a9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:04:40.485041 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:04:40.491561 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:04:40.500928 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:04:40.500928 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:04:40.512338 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:04:40.512338 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:04:40.519458 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:04:40.527010 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:04:40.541272 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-87a4f274-c091-48b8-a289-959be60a2fb9 (non-flash)
May 28 02:04:40.541272 np0000001583 nova-compute[98241]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87a4f274-c091-48b8-a289-959be60a2fb9 (non-flash)
May 28 02:04:40.541272 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:04:40.541272 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-87a4f274-c091-48b8-a289-959be60a2fb9 (non-flash)
May 28 02:04:40.541272 np0000001583 nova-compute[98241]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87a4f274-c091-48b8-a289-959be60a2fb9 (non-flash)
May 28 02:04:40.541272 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:04:40.547572 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-87a4f274-c091-48b8-a289-959be60a2fb9 (non-flash)
May 28 02:04:40.547572 np0000001583 nova-compute[98241]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87a4f274-c091-48b8-a289-959be60a2fb9 (non-flash)
May 28 02:04:40.547572 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:04:40.547771 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-87a4f274-c091-48b8-a289-959be60a2fb9 (non-flash)
May 28 02:04:40.547771 np0000001583 nova-compute[98241]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87a4f274-c091-48b8-a289-959be60a2fb9 (non-flash)
May 28 02:04:40.547771 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:04:40.586975 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa, portal: 192.168.50.100,3260]
May 28 02:04:40.586975 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa, portal: 192.168.50.100,3260] successful.
May 28 02:04:40.586975 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:04:40.596504 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa, portal: 192.168.40.100,3260]
May 28 02:04:40.596504 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa, portal: 192.168.40.100,3260] successful.
May 28 02:04:40.596504 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:04:40.604622 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:04:40.613204 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:04:40.633225 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-b598a424-fd59-4668-a1a4-eeb870ce3a91 req-d578f77e-b206-49ff-bf78-b89bf40505a9 service nova] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Updated VIF entry in instance network info cache for port a3fba340-eb11-4c87-8c76-e2a3d60b48ac. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:04:40.634330 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-b598a424-fd59-4668-a1a4-eeb870ce3a91 req-d578f77e-b206-49ff-bf78-b89bf40505a9 service nova] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Updating instance_info_cache with network_info: [{"id": "a3fba340-eb11-4c87-8c76-e2a3d60b48ac", "address": "fa:16:3e:88:7e:41", "network": {"id": "c60710fd-eeb6-4948-8a84-8b95cae31191", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6b98ce7597d45a6b839c720f99fa1e9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3fba340-eb", "ovs_interfaceid": "a3fba340-eb11-4c87-8c76-e2a3d60b48ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:04:40.635183 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-87a4f274-c091-48b8-a289-959be60a2fb9 (non-flash)
May 28 02:04:40.635183 np0000001583 nova-compute[98241]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87a4f274-c091-48b8-a289-959be60a2fb9 (non-flash)
May 28 02:04:40.635183 np0000001583 nova-compute[98241]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:04:40.635183 np0000001583 nova-compute[98241]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:04:40.635183 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:04:40.636101 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-87a4f274-c091-48b8-a289-959be60a2fb9 (non-flash)
May 28 02:04:40.636101 np0000001583 nova-compute[98241]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87a4f274-c091-48b8-a289-959be60a2fb9 (non-flash)
May 28 02:04:40.636101 np0000001583 nova-compute[98241]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:04:40.636101 np0000001583 nova-compute[98241]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:04:40.636101 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:04:40.636377 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-87a4f274-c091-48b8-a289-959be60a2fb9 (non-flash)
May 28 02:04:40.636377 np0000001583 nova-compute[98241]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87a4f274-c091-48b8-a289-959be60a2fb9 (non-flash)
May 28 02:04:40.636377 np0000001583 nova-compute[98241]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:04:40.636377 np0000001583 nova-compute[98241]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:04:40.636377 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:04:40.637121 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-87a4f274-c091-48b8-a289-959be60a2fb9 (non-flash)
May 28 02:04:40.637121 np0000001583 nova-compute[98241]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87a4f274-c091-48b8-a289-959be60a2fb9 (non-flash)
May 28 02:04:40.637121 np0000001583 nova-compute[98241]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:04:40.637121 np0000001583 nova-compute[98241]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:04:40.637121 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:04:40.637498 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.181s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:04:40.637714 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:04:40.638117 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.183s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:04:40.638286 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:04:40.639146 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] HCTL ('9', '-', '-', 0) found on session 131 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:04:40.639376 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:04:40.640032 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] HCTL ('10', '-', '-', 0) found on session 132 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:04:40.640100 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:04:40.667828 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Searching for a device in session 131 and hctl ['9', '*', '*', 0] yield: None {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:04:40.673635 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Searching for a device in session 132 and hctl ['10', '*', '*', 0] yield: None {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:04:40.750710 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ae765ea1-d0cf-4d9f-bce4-a3bd98fc42e2 req-b519dc00-70c8-47fb-9301-315e71cd6b53 service nova] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Received event network-vif-unplugged-203448a3-3550-4972-8c14-146165af89d2 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:04:40.751127 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ae765ea1-d0cf-4d9f-bce4-a3bd98fc42e2 req-b519dc00-70c8-47fb-9301-315e71cd6b53 service nova] Acquiring lock "d81ea788-4a10-41c8-a695-8dc5ac2c5701-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:40.751345 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ae765ea1-d0cf-4d9f-bce4-a3bd98fc42e2 req-b519dc00-70c8-47fb-9301-315e71cd6b53 service nova] Lock "d81ea788-4a10-41c8-a695-8dc5ac2c5701-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:40.752003 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ae765ea1-d0cf-4d9f-bce4-a3bd98fc42e2 req-b519dc00-70c8-47fb-9301-315e71cd6b53 service nova] Lock "d81ea788-4a10-41c8-a695-8dc5ac2c5701-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:40.752205 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ae765ea1-d0cf-4d9f-bce4-a3bd98fc42e2 req-b519dc00-70c8-47fb-9301-315e71cd6b53 service nova] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] No waiting events found dispatching network-vif-unplugged-203448a3-3550-4972-8c14-146165af89d2 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:04:40.752392 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-ae765ea1-d0cf-4d9f-bce4-a3bd98fc42e2 req-b519dc00-70c8-47fb-9301-315e71cd6b53 service nova] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Received unexpected event network-vif-unplugged-203448a3-3550-4972-8c14-146165af89d2 for instance with vm_state building and task_state spawning.
May 28 02:04:40.752546 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ae765ea1-d0cf-4d9f-bce4-a3bd98fc42e2 req-b519dc00-70c8-47fb-9301-315e71cd6b53 service nova] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Received event network-vif-unplugged-a3fba340-eb11-4c87-8c76-e2a3d60b48ac {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:04:40.752812 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ae765ea1-d0cf-4d9f-bce4-a3bd98fc42e2 req-b519dc00-70c8-47fb-9301-315e71cd6b53 service nova] Acquiring lock "14c6f881-05d4-417a-9285-197415ae35a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:40.753031 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ae765ea1-d0cf-4d9f-bce4-a3bd98fc42e2 req-b519dc00-70c8-47fb-9301-315e71cd6b53 service nova] Lock "14c6f881-05d4-417a-9285-197415ae35a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:40.753221 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ae765ea1-d0cf-4d9f-bce4-a3bd98fc42e2 req-b519dc00-70c8-47fb-9301-315e71cd6b53 service nova] Lock "14c6f881-05d4-417a-9285-197415ae35a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:40.753400 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ae765ea1-d0cf-4d9f-bce4-a3bd98fc42e2 req-b519dc00-70c8-47fb-9301-315e71cd6b53 service nova] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] No event matching network-vif-unplugged-a3fba340-eb11-4c87-8c76-e2a3d60b48ac in dict_keys([('network-vif-plugged', 'a3fba340-eb11-4c87-8c76-e2a3d60b48ac')]) {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 02:04:40.753565 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-ae765ea1-d0cf-4d9f-bce4-a3bd98fc42e2 req-b519dc00-70c8-47fb-9301-315e71cd6b53 service nova] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Received unexpected event network-vif-unplugged-a3fba340-eb11-4c87-8c76-e2a3d60b48ac for instance with vm_state building and task_state spawning.
May 28 02:04:41.137993 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b598a424-fd59-4668-a1a4-eeb870ce3a91 req-d578f77e-b206-49ff-bf78-b89bf40505a9 service nova] Releasing lock "refresh_cache-14c6f881-05d4-417a-9285-197415ae35a1" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:04:41.668316 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Searching for a device in session 131 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:04:41.668747 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '873f9b75-1314-4acd-9c69-c4ae877916aa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:04:41.674184 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Searching for a device in session 132 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:04:41.674339 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '873f9b75-1314-4acd-9c69-c4ae877916aa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:04:41.704374 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:04:41.704501 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:04:41.704591 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] No VIF found with MAC fa:16:3e:88:7e:41, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:04:41.705009 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Using config drive
May 28 02:04:42.212149 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:04:42.366290 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Creating config drive at /opt/stack/data/nova/instances/14c6f881-05d4-417a-9285-197415ae35a1/disk.config
May 28 02:04:42.369651 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/14c6f881-05d4-417a-9285-197415ae35a1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpeteldqbg {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:04:42.444126 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/14c6f881-05d4-417a-9285-197415ae35a1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpeteldqbg" returned: 0 in 0.074s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:04:42.463020 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 02:04:42.963448 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:42.968253 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:43.036744 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:43.118780 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:43.220369 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-208eaff3-8710-45ef-a574-4a67083b5dd8 req-93ef101b-471c-4862-8f3f-fede06d317d1 service nova] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Received event network-vif-plugged-a3fba340-eb11-4c87-8c76-e2a3d60b48ac {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:04:43.220747 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-208eaff3-8710-45ef-a574-4a67083b5dd8 req-93ef101b-471c-4862-8f3f-fede06d317d1 service nova] Acquiring lock "14c6f881-05d4-417a-9285-197415ae35a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:43.221348 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-208eaff3-8710-45ef-a574-4a67083b5dd8 req-93ef101b-471c-4862-8f3f-fede06d317d1 service nova] Lock "14c6f881-05d4-417a-9285-197415ae35a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:43.221490 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-208eaff3-8710-45ef-a574-4a67083b5dd8 req-93ef101b-471c-4862-8f3f-fede06d317d1 service nova] Lock "14c6f881-05d4-417a-9285-197415ae35a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:43.224244 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-208eaff3-8710-45ef-a574-4a67083b5dd8 req-93ef101b-471c-4862-8f3f-fede06d317d1 service nova] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Processing event network-vif-plugged-a3fba340-eb11-4c87-8c76-e2a3d60b48ac {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 02:04:43.348847 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:43.358777 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:43.359826 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:43.387337 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:43.419547 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:43.484071 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Found WWN 3300000009e23c2de for multipath device dm-1 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 02:04:43.484635 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.045s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:04:43.484796 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] <== connect_volume: return (5908ms) {'type': 'block', 'scsi_wwn': '3300000009e23c2de', 'path': '/dev/dm-1', 'multipath_id': '3300000009e23c2de'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:04:43.484960 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000009e23c2de', 'path': '/dev/dm-1', 'multipath_id': '3300000009e23c2de'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 02:04:43.930273 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933883.929807, 14c6f881-05d4-417a-9285-197415ae35a1 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:04:43.930404 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] VM Started (Lifecycle Event)
May 28 02:04:43.931973 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 02:04:43.936456 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 02:04:43.940150 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Instance spawned successfully.
May 28 02:04:43.944137 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 02:04:43.995706 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1246212049',display_name='tempest-TestVolumeBootPattern-server-1246212049',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testvolumebootpattern-server-1246212049',id=57,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwh6E4i05I/O8lsE0bUEzocgUz6EHWmEWnV87akBvJyUZCaSgScF6CqBqpI/yb99Eh4gFmhgnyBDUzlF9t565ox0untLBipqeePS0CqQE7tD/Pd6ddczsNL4V+3d8XsQw==',key_name='tempest-TestVolumeBootPattern-1374779836',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='432aa1094ced436494def17a875aa8e1',ramdisk_id='',reservation_id='r-em6a8l7s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1031057169',owner_user_name='tempest-TestVolumeBootPattern-1031057169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:04:35Z,user_data=None,user_id='6be314b4eed642c3b2c72fe115860220',uuid=d81ea788-4a10-41c8-a695-8dc5ac2c5701,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "203448a3-3550-4972-8c14-146165af89d2", "address": "fa:16:3e:a5:62:55", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap203448a3-35", "ovs_interfaceid": "203448a3-3550-4972-8c14-146165af89d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 02:04:43.997900 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converting VIF {"id": "203448a3-3550-4972-8c14-146165af89d2", "address": "fa:16:3e:a5:62:55", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap203448a3-35", "ovs_interfaceid": "203448a3-3550-4972-8c14-146165af89d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:04:44.000417 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:62:55,bridge_name='br-int',has_traffic_filtering=True,id=203448a3-3550-4972-8c14-146165af89d2,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap203448a3-35') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:04:44.001599 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lazy-loading 'pci_devices' on Instance uuid d81ea788-4a10-41c8-a695-8dc5ac2c5701 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:04:44.434311 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:04:44.439429 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:04:44.450255 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:04:44.450255 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:04:44.450580 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:04:44.450896 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:04:44.451194 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:04:44.451470 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:04:44.508926 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] End _get_guest_xml xml=<domain type="qemu">
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:   <uuid>d81ea788-4a10-41c8-a695-8dc5ac2c5701</uuid>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:   <name>instance-00000039</name>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:   <metadata>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:       <nova:name>tempest-TestVolumeBootPattern-server-1246212049</nova:name>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 02:04:37</nova:creationTime>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:       <nova:image uuid="">
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:       </nova:image>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:         <nova:user uuid="6be314b4eed642c3b2c72fe115860220">tempest-TestVolumeBootPattern-1031057169-project-member</nova:user>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:         <nova:project uuid="432aa1094ced436494def17a875aa8e1">tempest-TestVolumeBootPattern-1031057169</nova:project>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:       <nova:root type="volume" uuid=""/>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:         <nova:port uuid="203448a3-3550-4972-8c14-146165af89d2">
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:         </nova:port>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:   </metadata>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:     <system>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:       <entry name="serial">d81ea788-4a10-41c8-a695-8dc5ac2c5701</entry>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:       <entry name="uuid">d81ea788-4a10-41c8-a695-8dc5ac2c5701</entry>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:     </system>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:   <os>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:   </os>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:   <features>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:     <acpi/>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:     <tcg>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:     </tcg>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:   </features>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:   </cpu>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:   <devices>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/d81ea788-4a10-41c8-a695-8dc5ac2c5701/disk.config"/>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:     </disk>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:     <disk type="block" device="disk">
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:       <alias name="ua-873f9b75-1314-4acd-9c69-c4ae877916aa"/>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:       <source dev="/dev/dm-1"/>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:       <serial>873f9b75-1314-4acd-9c69-c4ae877916aa</serial>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:     </disk>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:a5:62:55"/>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:       <target dev="tap203448a3-35"/>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:     </interface>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/d81ea788-4a10-41c8-a695-8dc5ac2c5701/console.log" append="off"/>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:     </serial>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:     <video>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:     </video>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:     </rng>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:     </memballoon>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:   </devices>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]: </domain>
May 28 02:04:44.508926 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 02:04:44.510921 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Preparing to wait for external event network-vif-plugged-203448a3-3550-4972-8c14-146165af89d2 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 02:04:44.510921 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "d81ea788-4a10-41c8-a695-8dc5ac2c5701-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:44.511063 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "d81ea788-4a10-41c8-a695-8dc5ac2c5701-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:44.511450 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "d81ea788-4a10-41c8-a695-8dc5ac2c5701-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:44.512754 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1246212049',display_name='tempest-TestVolumeBootPattern-server-1246212049',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testvolumebootpattern-server-1246212049',id=57,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwh6E4i05I/O8lsE0bUEzocgUz6EHWmEWnV87akBvJyUZCaSgScF6CqBqpI/yb99Eh4gFmhgnyBDUzlF9t565ox0untLBipqeePS0CqQE7tD/Pd6ddczsNL4V+3d8XsQw==',key_name='tempest-TestVolumeBootPattern-1374779836',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='432aa1094ced436494def17a875aa8e1',ramdisk_id='',reservation_id='r-em6a8l7s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1031057169',owner_user_name='tempest-TestVolumeBootPattern-1031057169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:04:35Z,user_data=None,user_id='6be314b4eed642c3b2c72fe115860220',uuid=d81ea788-4a10-41c8-a695-8dc5ac2c5701,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "203448a3-3550-4972-8c14-146165af89d2", "address": "fa:16:3e:a5:62:55", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap203448a3-35", "ovs_interfaceid": "203448a3-3550-4972-8c14-146165af89d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 02:04:44.513222 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converting VIF {"id": "203448a3-3550-4972-8c14-146165af89d2", "address": "fa:16:3e:a5:62:55", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap203448a3-35", "ovs_interfaceid": "203448a3-3550-4972-8c14-146165af89d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:04:44.513936 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:62:55,bridge_name='br-int',has_traffic_filtering=True,id=203448a3-3550-4972-8c14-146165af89d2,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap203448a3-35') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:04:44.514513 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:62:55,bridge_name='br-int',has_traffic_filtering=True,id=203448a3-3550-4972-8c14-146165af89d2,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap203448a3-35') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 02:04:44.515247 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:44.516477 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:04:44.516819 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 02:04:44.517740 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:44.518184 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f6feb038-11b1-511b-809c-7502ab4e2f7a', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:04:44.530380 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:44.531063 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:04:44.531542 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:44.534039 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:44.534210 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap203448a3-35, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:04:44.534510 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap203448a3-35, col_values=(('qos', UUID('c371ca69-6f25-4374-9ecf-ac5413fd1848')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:04:44.534657 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap203448a3-35, col_values=(('external_ids', {'iface-id': '203448a3-3550-4972-8c14-146165af89d2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:62:55', 'vm-uuid': 'd81ea788-4a10-41c8-a695-8dc5ac2c5701'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:04:44.535576 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:44.536545 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:04:44.542376 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:44.544601 np0000001583 nova-compute[98241]: INFO os_vif [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:62:55,bridge_name='br-int',has_traffic_filtering=True,id=203448a3-3550-4972-8c14-146165af89d2,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap203448a3-35')
May 28 02:04:44.942406 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 02:04:44.942687 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933884.9424436, 14c6f881-05d4-417a-9285-197415ae35a1 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:04:44.942854 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] VM Paused (Lifecycle Event)
May 28 02:04:44.958557 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Took 6.90 seconds to spawn the instance on the hypervisor.
May 28 02:04:44.958812 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:04:45.307095 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7c543699-1261-4162-82cc-c2e72bdce475 req-b7eb54e1-7b79-4d23-8bfa-f01cd428cba8 service nova] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Received event network-vif-plugged-a3fba340-eb11-4c87-8c76-e2a3d60b48ac {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:04:45.308098 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7c543699-1261-4162-82cc-c2e72bdce475 req-b7eb54e1-7b79-4d23-8bfa-f01cd428cba8 service nova] Acquiring lock "14c6f881-05d4-417a-9285-197415ae35a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:45.309461 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7c543699-1261-4162-82cc-c2e72bdce475 req-b7eb54e1-7b79-4d23-8bfa-f01cd428cba8 service nova] Lock "14c6f881-05d4-417a-9285-197415ae35a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:45.309673 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7c543699-1261-4162-82cc-c2e72bdce475 req-b7eb54e1-7b79-4d23-8bfa-f01cd428cba8 service nova] Lock "14c6f881-05d4-417a-9285-197415ae35a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:45.309896 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7c543699-1261-4162-82cc-c2e72bdce475 req-b7eb54e1-7b79-4d23-8bfa-f01cd428cba8 service nova] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] No waiting events found dispatching network-vif-plugged-a3fba340-eb11-4c87-8c76-e2a3d60b48ac {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:04:45.310097 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-7c543699-1261-4162-82cc-c2e72bdce475 req-b7eb54e1-7b79-4d23-8bfa-f01cd428cba8 service nova] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Received unexpected event network-vif-plugged-a3fba340-eb11-4c87-8c76-e2a3d60b48ac for instance with vm_state active and task_state None.
May 28 02:04:45.445463 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:04:45.449227 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933885.4488404, 14c6f881-05d4-417a-9285-197415ae35a1 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:04:45.449397 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] VM Resumed (Lifecycle Event)
May 28 02:04:45.475276 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Took 14.12 seconds to build instance.
May 28 02:04:45.955195 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:04:45.958924 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:04:45.978535 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Lock "14c6f881-05d4-417a-9285-197415ae35a1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.635s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:46.067264 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:04:46.067264 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:04:46.067264 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] No VIF found with MAC fa:16:3e:a5:62:55, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:04:46.067694 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Using config drive
May 28 02:04:46.576330 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:04:46.724125 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Creating config drive at /opt/stack/data/nova/instances/d81ea788-4a10-41c8-a695-8dc5ac2c5701/disk.config
May 28 02:04:46.728366 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d81ea788-4a10-41c8-a695-8dc5ac2c5701/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnqdkpgqq {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:04:46.772183 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-903a327f-7b7f-4f08-a1f5-f1e4c5c6fcd1 tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Acquiring lock "14c6f881-05d4-417a-9285-197415ae35a1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:46.772542 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-903a327f-7b7f-4f08-a1f5-f1e4c5c6fcd1 tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Lock "14c6f881-05d4-417a-9285-197415ae35a1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:46.772789 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-903a327f-7b7f-4f08-a1f5-f1e4c5c6fcd1 tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Acquiring lock "14c6f881-05d4-417a-9285-197415ae35a1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:46.772957 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-903a327f-7b7f-4f08-a1f5-f1e4c5c6fcd1 tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Lock "14c6f881-05d4-417a-9285-197415ae35a1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:46.773123 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-903a327f-7b7f-4f08-a1f5-f1e4c5c6fcd1 tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Lock "14c6f881-05d4-417a-9285-197415ae35a1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:46.780716 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-903a327f-7b7f-4f08-a1f5-f1e4c5c6fcd1 tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Terminating instance
May 28 02:04:46.793346 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d81ea788-4a10-41c8-a695-8dc5ac2c5701/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnqdkpgqq" returned: 0 in 0.065s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:04:47.263106 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:47.285684 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-903a327f-7b7f-4f08-a1f5-f1e4c5c6fcd1 tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 02:04:47.305431 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:47.308837 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:47.346226 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:47.349548 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:47.412749 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:47.528403 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-df9fa969-d1f2-4911-969f-a980a32e78fa req-fc079a46-ad49-404b-bbfd-ed2bebea7373 service nova] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Received event network-vif-plugged-203448a3-3550-4972-8c14-146165af89d2 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:04:47.528549 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-df9fa969-d1f2-4911-969f-a980a32e78fa req-fc079a46-ad49-404b-bbfd-ed2bebea7373 service nova] Acquiring lock "d81ea788-4a10-41c8-a695-8dc5ac2c5701-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:47.528717 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-df9fa969-d1f2-4911-969f-a980a32e78fa req-fc079a46-ad49-404b-bbfd-ed2bebea7373 service nova] Lock "d81ea788-4a10-41c8-a695-8dc5ac2c5701-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:47.529050 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-df9fa969-d1f2-4911-969f-a980a32e78fa req-fc079a46-ad49-404b-bbfd-ed2bebea7373 service nova] Lock "d81ea788-4a10-41c8-a695-8dc5ac2c5701-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:47.529050 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-df9fa969-d1f2-4911-969f-a980a32e78fa req-fc079a46-ad49-404b-bbfd-ed2bebea7373 service nova] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Processing event network-vif-plugged-203448a3-3550-4972-8c14-146165af89d2 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 02:04:47.647609 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:47.656088 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:47.698947 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.998933069000032 future=<Future at 0x7724f8459dc0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:04:47.699278 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:47.701586 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.996291440999812 future=<Future at 0x7724f8459dc0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:04:47.701778 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.996091477999926 future=<Future at 0x7724f8459dc0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:04:47.706683 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Instance destroyed successfully.
May 28 02:04:47.707235 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-903a327f-7b7f-4f08-a1f5-f1e4c5c6fcd1 tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Lazy-loading 'resources' on Instance uuid 14c6f881-05d4-417a-9285-197415ae35a1 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:04:47.708260 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:47.713470 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:47.736531 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:47.742416 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:47.849808 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:47.875346 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:48.212499 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-903a327f-7b7f-4f08-a1f5-f1e4c5c6fcd1 tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T02:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-167204155',display_name='tempest-VolumesNegativeTest-instance-167204155',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-volumesnegativetest-instance-167204155',id=58,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:04:44Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='045365722a2d4da3810ac50b09436047',ramdisk_id='',reservation_id='r-nih9yhgy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-324661917',owner_user_name='tempest-VolumesNegativeTest-324661917-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T02:04:45Z,user_data=None,user_id='b42604c941f54ed7803146970f1b0922',uuid=14c6f881-05d4-417a-9285-197415ae35a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3fba340-eb11-4c87-8c76-e2a3d60b48ac", "address": "fa:16:3e:88:7e:41", "network": {"id": "c60710fd-eeb6-4948-8a84-8b95cae31191", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6b98ce7597d45a6b839c720f99fa1e9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3fba340-eb", "ovs_interfaceid": "a3fba340-eb11-4c87-8c76-e2a3d60b48ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:04:48.212719 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-903a327f-7b7f-4f08-a1f5-f1e4c5c6fcd1 tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Converting VIF {"id": "a3fba340-eb11-4c87-8c76-e2a3d60b48ac", "address": "fa:16:3e:88:7e:41", "network": {"id": "c60710fd-eeb6-4948-8a84-8b95cae31191", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6b98ce7597d45a6b839c720f99fa1e9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3fba340-eb", "ovs_interfaceid": "a3fba340-eb11-4c87-8c76-e2a3d60b48ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:04:48.213316 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-903a327f-7b7f-4f08-a1f5-f1e4c5c6fcd1 tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:7e:41,bridge_name='br-int',has_traffic_filtering=True,id=a3fba340-eb11-4c87-8c76-e2a3d60b48ac,network=Network(c60710fd-eeb6-4948-8a84-8b95cae31191),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3fba340-eb') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:04:48.213624 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-903a327f-7b7f-4f08-a1f5-f1e4c5c6fcd1 tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:7e:41,bridge_name='br-int',has_traffic_filtering=True,id=a3fba340-eb11-4c87-8c76-e2a3d60b48ac,network=Network(c60710fd-eeb6-4948-8a84-8b95cae31191),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3fba340-eb') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:04:48.215303 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:48.215530 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa3fba340-eb, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:04:48.216676 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:48.218474 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:04:48.219132 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:48.219285 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d3ba5bf8-5366-4419-bcc1-a6c37ef2111f) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:04:48.220044 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:48.221258 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:04:48.221458 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:48.223660 np0000001583 nova-compute[98241]: INFO os_vif [None req-903a327f-7b7f-4f08-a1f5-f1e4c5c6fcd1 tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:7e:41,bridge_name='br-int',has_traffic_filtering=True,id=a3fba340-eb11-4c87-8c76-e2a3d60b48ac,network=Network(c60710fd-eeb6-4948-8a84-8b95cae31191),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3fba340-eb')
May 28 02:04:48.224319 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-903a327f-7b7f-4f08-a1f5-f1e4c5c6fcd1 tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Deleting instance files /opt/stack/data/nova/instances/14c6f881-05d4-417a-9285-197415ae35a1_del
May 28 02:04:48.225395 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-903a327f-7b7f-4f08-a1f5-f1e4c5c6fcd1 tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Deletion of /opt/stack/data/nova/instances/14c6f881-05d4-417a-9285-197415ae35a1_del complete
May 28 02:04:48.235449 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 02:04:48.236539 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933888.2361176, d81ea788-4a10-41c8-a695-8dc5ac2c5701 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:04:48.236727 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] VM Started (Lifecycle Event)
May 28 02:04:48.239225 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 02:04:48.241498 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Instance spawned successfully.
May 28 02:04:48.241765 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 02:04:48.421160 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:48.735054 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-903a327f-7b7f-4f08-a1f5-f1e4c5c6fcd1 tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Took 1.45 seconds to destroy the instance on the hypervisor.
May 28 02:04:48.736231 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-903a327f-7b7f-4f08-a1f5-f1e4c5c6fcd1 tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 02:04:48.736231 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 02:04:48.736231 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 02:04:48.736231 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:04:48.740230 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:04:48.742241 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:04:48.754705 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:04:48.754705 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:04:48.754963 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:04:48.755051 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:04:48.755293 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:04:48.755553 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:04:48.888696 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:04:49.145635 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:49.246508 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 02:04:49.246795 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933889.2465198, d81ea788-4a10-41c8-a695-8dc5ac2c5701 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:04:49.246925 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] VM Paused (Lifecycle Event)
May 28 02:04:49.264119 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Took 11.74 seconds to spawn the instance on the hypervisor.
May 28 02:04:49.264297 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:04:49.287504 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e0eb7a1b-fff7-4f0f-9de9-04abec9bf87b req-805c5f4c-2843-4520-9d94-2b98adf9ec58 service nova] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Received event network-vif-deleted-a3fba340-eb11-4c87-8c76-e2a3d60b48ac {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:04:49.287680 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-e0eb7a1b-fff7-4f0f-9de9-04abec9bf87b req-805c5f4c-2843-4520-9d94-2b98adf9ec58 service nova] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Neutron deleted interface a3fba340-eb11-4c87-8c76-e2a3d60b48ac; detaching it from the instance and deleting it from the info cache
May 28 02:04:49.289828 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e0eb7a1b-fff7-4f0f-9de9-04abec9bf87b req-805c5f4c-2843-4520-9d94-2b98adf9ec58 service nova] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Detach interface failed, port_id=a3fba340-eb11-4c87-8c76-e2a3d60b48ac, reason: Instance 14c6f881-05d4-417a-9285-197415ae35a1 could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 02:04:49.594917 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f2652647-5c0c-43d4-9153-4dc807722d49 req-3bd841eb-17e4-4733-83e0-4bb20b8211c6 service nova] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Received event network-vif-plugged-203448a3-3550-4972-8c14-146165af89d2 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:04:49.594917 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f2652647-5c0c-43d4-9153-4dc807722d49 req-3bd841eb-17e4-4733-83e0-4bb20b8211c6 service nova] Acquiring lock "d81ea788-4a10-41c8-a695-8dc5ac2c5701-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:49.594917 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f2652647-5c0c-43d4-9153-4dc807722d49 req-3bd841eb-17e4-4733-83e0-4bb20b8211c6 service nova] Lock "d81ea788-4a10-41c8-a695-8dc5ac2c5701-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:49.595117 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f2652647-5c0c-43d4-9153-4dc807722d49 req-3bd841eb-17e4-4733-83e0-4bb20b8211c6 service nova] Lock "d81ea788-4a10-41c8-a695-8dc5ac2c5701-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:49.595250 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f2652647-5c0c-43d4-9153-4dc807722d49 req-3bd841eb-17e4-4733-83e0-4bb20b8211c6 service nova] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] No waiting events found dispatching network-vif-plugged-203448a3-3550-4972-8c14-146165af89d2 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:04:49.595742 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-f2652647-5c0c-43d4-9153-4dc807722d49 req-3bd841eb-17e4-4733-83e0-4bb20b8211c6 service nova] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Received unexpected event network-vif-plugged-203448a3-3550-4972-8c14-146165af89d2 for instance with vm_state active and task_state None.
May 28 02:04:49.598266 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f2652647-5c0c-43d4-9153-4dc807722d49 req-3bd841eb-17e4-4733-83e0-4bb20b8211c6 service nova] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Received event network-vif-unplugged-a3fba340-eb11-4c87-8c76-e2a3d60b48ac {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:04:49.598902 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f2652647-5c0c-43d4-9153-4dc807722d49 req-3bd841eb-17e4-4733-83e0-4bb20b8211c6 service nova] Acquiring lock "14c6f881-05d4-417a-9285-197415ae35a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:49.599067 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f2652647-5c0c-43d4-9153-4dc807722d49 req-3bd841eb-17e4-4733-83e0-4bb20b8211c6 service nova] Lock "14c6f881-05d4-417a-9285-197415ae35a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:49.599221 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f2652647-5c0c-43d4-9153-4dc807722d49 req-3bd841eb-17e4-4733-83e0-4bb20b8211c6 service nova] Lock "14c6f881-05d4-417a-9285-197415ae35a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:49.599412 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f2652647-5c0c-43d4-9153-4dc807722d49 req-3bd841eb-17e4-4733-83e0-4bb20b8211c6 service nova] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] No waiting events found dispatching network-vif-unplugged-a3fba340-eb11-4c87-8c76-e2a3d60b48ac {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:04:49.599583 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f2652647-5c0c-43d4-9153-4dc807722d49 req-3bd841eb-17e4-4733-83e0-4bb20b8211c6 service nova] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Received event network-vif-unplugged-a3fba340-eb11-4c87-8c76-e2a3d60b48ac for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:04:49.599725 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f2652647-5c0c-43d4-9153-4dc807722d49 req-3bd841eb-17e4-4733-83e0-4bb20b8211c6 service nova] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Received event network-vif-unplugged-a3fba340-eb11-4c87-8c76-e2a3d60b48ac {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:04:49.599975 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f2652647-5c0c-43d4-9153-4dc807722d49 req-3bd841eb-17e4-4733-83e0-4bb20b8211c6 service nova] Acquiring lock "14c6f881-05d4-417a-9285-197415ae35a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:49.600167 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f2652647-5c0c-43d4-9153-4dc807722d49 req-3bd841eb-17e4-4733-83e0-4bb20b8211c6 service nova] Lock "14c6f881-05d4-417a-9285-197415ae35a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:49.600295 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f2652647-5c0c-43d4-9153-4dc807722d49 req-3bd841eb-17e4-4733-83e0-4bb20b8211c6 service nova] Lock "14c6f881-05d4-417a-9285-197415ae35a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:49.600472 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f2652647-5c0c-43d4-9153-4dc807722d49 req-3bd841eb-17e4-4733-83e0-4bb20b8211c6 service nova] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] No waiting events found dispatching network-vif-unplugged-a3fba340-eb11-4c87-8c76-e2a3d60b48ac {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:04:49.600626 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f2652647-5c0c-43d4-9153-4dc807722d49 req-3bd841eb-17e4-4733-83e0-4bb20b8211c6 service nova] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Received event network-vif-unplugged-a3fba340-eb11-4c87-8c76-e2a3d60b48ac for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:04:49.707384 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:04:49.750239 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:04:49.755029 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933889.7546744, d81ea788-4a10-41c8-a695-8dc5ac2c5701 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:04:49.755226 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] VM Resumed (Lifecycle Event)
May 28 02:04:49.782634 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Took 19.02 seconds to build instance.
May 28 02:04:50.209928 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Took 1.47 seconds to deallocate network for instance.
May 28 02:04:50.257980 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:04:50.261368 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:04:50.284606 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "d81ea788-4a10-41c8-a695-8dc5ac2c5701" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.536s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:50.298112 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:50.718562 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-903a327f-7b7f-4f08-a1f5-f1e4c5c6fcd1 tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:04:50.718745 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-903a327f-7b7f-4f08-a1f5-f1e4c5c6fcd1 tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:04:51.005558 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-903a327f-7b7f-4f08-a1f5-f1e4c5c6fcd1 tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Refreshing inventories for resource provider cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 28 02:04:51.080891 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-903a327f-7b7f-4f08-a1f5-f1e4c5c6fcd1 tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Updating ProviderTree inventory for provider cfa1af79-477d-460a-869d-84a19fa91765 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 28 02:04:51.081806 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-903a327f-7b7f-4f08-a1f5-f1e4c5c6fcd1 tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Updating inventory in ProviderTree for provider cfa1af79-477d-460a-869d-84a19fa91765 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 28 02:04:51.162343 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-903a327f-7b7f-4f08-a1f5-f1e4c5c6fcd1 tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Refreshing aggregate associations for resource provider cfa1af79-477d-460a-869d-84a19fa91765, aggregates: None {{(pid=98241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 28 02:04:51.244886 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-903a327f-7b7f-4f08-a1f5-f1e4c5c6fcd1 tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Refreshing trait associations for resource provider cfa1af79-477d-460a-869d-84a19fa91765, traits: COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_NET_VIF_MODEL_IGB,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_ARCH_AARCH64,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_ARCH_S390X,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ARCH_MIPSEL,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,COMPUTE_SOUND_MODEL_USB,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ARCH_X86_64,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ARCH_RISCV64,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ARCH_PPC64LE,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_SOUND_MODEL_SB16,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_SOUND_MODEL_AC97,COMPUTE_RESCUE_BFV,HW_ARCH_X86_64,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=98241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 28 02:04:51.449770 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-903a327f-7b7f-4f08-a1f5-f1e4c5c6fcd1 tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:04:51.450206 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-903a327f-7b7f-4f08-a1f5-f1e4c5c6fcd1 tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:04:51.953358 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-903a327f-7b7f-4f08-a1f5-f1e4c5c6fcd1 tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:04:52.091622 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5451dd86-a295-4c62-b91b-03633b340c7d req-3f8fc894-f92b-4b9d-9960-1c616c0b6661 service nova] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Received event network-changed-203448a3-3550-4972-8c14-146165af89d2 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:04:52.092136 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5451dd86-a295-4c62-b91b-03633b340c7d req-3f8fc894-f92b-4b9d-9960-1c616c0b6661 service nova] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Refreshing instance network info cache due to event network-changed-203448a3-3550-4972-8c14-146165af89d2. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:04:52.092309 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5451dd86-a295-4c62-b91b-03633b340c7d req-3f8fc894-f92b-4b9d-9960-1c616c0b6661 service nova] Acquiring lock "refresh_cache-d81ea788-4a10-41c8-a695-8dc5ac2c5701" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:04:52.092552 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5451dd86-a295-4c62-b91b-03633b340c7d req-3f8fc894-f92b-4b9d-9960-1c616c0b6661 service nova] Acquired lock "refresh_cache-d81ea788-4a10-41c8-a695-8dc5ac2c5701" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:04:52.092894 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-5451dd86-a295-4c62-b91b-03633b340c7d req-3f8fc894-f92b-4b9d-9960-1c616c0b6661 service nova] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Refreshing network info cache for port 203448a3-3550-4972-8c14-146165af89d2 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:04:52.462491 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-903a327f-7b7f-4f08-a1f5-f1e4c5c6fcd1 tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.744s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:52.530533 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-903a327f-7b7f-4f08-a1f5-f1e4c5c6fcd1 tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Deleted allocations for instance 14c6f881-05d4-417a-9285-197415ae35a1
May 28 02:04:52.595986 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-5451dd86-a295-4c62-b91b-03633b340c7d req-3f8fc894-f92b-4b9d-9960-1c616c0b6661 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:04:53.031682 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-5451dd86-a295-4c62-b91b-03633b340c7d req-3f8fc894-f92b-4b9d-9960-1c616c0b6661 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:04:53.191742 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-5451dd86-a295-4c62-b91b-03633b340c7d req-3f8fc894-f92b-4b9d-9960-1c616c0b6661 service nova] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Updated VIF entry in instance network info cache for port 203448a3-3550-4972-8c14-146165af89d2. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:04:53.192246 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-5451dd86-a295-4c62-b91b-03633b340c7d req-3f8fc894-f92b-4b9d-9960-1c616c0b6661 service nova] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Updating instance_info_cache with network_info: [{"id": "203448a3-3550-4972-8c14-146165af89d2", "address": "fa:16:3e:a5:62:55", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap203448a3-35", "ovs_interfaceid": "203448a3-3550-4972-8c14-146165af89d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:04:53.220694 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:53.422668 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:53.545657 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-903a327f-7b7f-4f08-a1f5-f1e4c5c6fcd1 tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Lock "14c6f881-05d4-417a-9285-197415ae35a1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.773s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:04:53.694146 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5451dd86-a295-4c62-b91b-03633b340c7d req-3f8fc894-f92b-4b9d-9960-1c616c0b6661 service nova] Releasing lock "refresh_cache-d81ea788-4a10-41c8-a695-8dc5ac2c5701" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:04:54.455882 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:56.387640 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:58.221267 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:58.424433 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:04:59.723830 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:01.918440 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:02.698323 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.00042441499999767984 future=<Future at 0x7724f8459dc0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:05:02.698627 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:05:02.698895 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] Emitting event <LifecycleEvent: 1779933887.697765, 14c6f881-05d4-417a-9285-197415ae35a1 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:05:02.699050 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] VM Stopped (Lifecycle Event)
May 28 02:05:03.206549 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-b0a396ed-70ef-494c-b15a-206aeb95da85 tempest-TestServerVolumeAttachScenarioOldVersion-649923774 tempest-TestServerVolumeAttachScenarioOldVersion-649923774-project-member] [instance: 14c6f881-05d4-417a-9285-197415ae35a1] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:05:03.225555 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:03.254619 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:03.427027 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:04.288833 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:05.738751 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:06.557643 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:08.202752 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Acquiring lock "19d774e3-96a1-4dd4-8953-062105d5f0b2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:05:08.203258 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Lock "19d774e3-96a1-4dd4-8953-062105d5f0b2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:05:08.227225 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:08.429438 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:08.705099 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 02:05:09.103056 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:09.280823 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:05:09.281415 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:05:09.286466 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 02:05:09.287089 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Claim successful on node np0000001583
May 28 02:05:10.086944 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:10.547760 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:05:10.548256 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:05:11.053017 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:05:11.201827 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Acquiring lock "7751bb1a-84b9-48ce-81da-b3a41d63eadc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:05:11.202060 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "7751bb1a-84b9-48ce-81da-b3a41d63eadc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:05:11.561051 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.280s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:05:11.561528 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 02:05:11.662098 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:11.708369 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lazy-loading 'flavor' on Instance uuid 7751bb1a-84b9-48ce-81da-b3a41d63eadc {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:05:12.068364 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 02:05:12.068536 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 02:05:12.068853 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:05:12.069488 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:05:12.206053 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '20d40467c45044a5aaeaa43c84e7a470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd772abe23aca4eb5b0e7b107c859c20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 02:05:12.571936 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 02:05:12.713606 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "7751bb1a-84b9-48ce-81da-b3a41d63eadc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:05:12.737117 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Successfully created port: deb0d435-44b2-4669-a015-149a269fbdd5 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 02:05:12.999814 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:13.079102 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 02:05:13.229537 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:13.430955 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:13.630821 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Successfully updated port: deb0d435-44b2-4669-a015-149a269fbdd5 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 02:05:13.681857 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-40352623-9aa0-47c1-b61c-d39a6adce28c req-e900b174-cd64-4eff-9f03-e7b915225da2 service nova] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Received event network-changed-deb0d435-44b2-4669-a015-149a269fbdd5 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:05:13.682290 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-40352623-9aa0-47c1-b61c-d39a6adce28c req-e900b174-cd64-4eff-9f03-e7b915225da2 service nova] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Refreshing instance network info cache due to event network-changed-deb0d435-44b2-4669-a015-149a269fbdd5. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:05:13.682523 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-40352623-9aa0-47c1-b61c-d39a6adce28c req-e900b174-cd64-4eff-9f03-e7b915225da2 service nova] Acquiring lock "refresh_cache-19d774e3-96a1-4dd4-8953-062105d5f0b2" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:05:13.682683 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-40352623-9aa0-47c1-b61c-d39a6adce28c req-e900b174-cd64-4eff-9f03-e7b915225da2 service nova] Acquired lock "refresh_cache-19d774e3-96a1-4dd4-8953-062105d5f0b2" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:05:13.682812 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-40352623-9aa0-47c1-b61c-d39a6adce28c req-e900b174-cd64-4eff-9f03-e7b915225da2 service nova] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Refreshing network info cache for port deb0d435-44b2-4669-a015-149a269fbdd5 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:05:13.900697 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Acquiring lock "7751bb1a-84b9-48ce-81da-b3a41d63eadc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:05:13.900848 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "7751bb1a-84b9-48ce-81da-b3a41d63eadc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:05:13.901049 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Attaching volume ac9702c2-f086-4648-8db2-3a060a485aa4 to /dev/vdb
May 28 02:05:13.935487 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:05:13.946388 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 02:05:13.964762 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:05:14.010841 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 02:05:14.011174 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 02:05:14.021724 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 02:05:14.023011 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fee6:d69e', 'fe80::f881:28ff:fef8:dbfc', 'fe80::fc16:3eff:fea5:6255', 'fe80::34e0:eeff:fee2:bede'] 
May 28 02:05:14.023248 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 02:05:14.023424 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 02:05:14.023756 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] <== get_connector_properties: return (87ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:05:14.024144 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Updating existing volume attachment record: b4b91b7c-46e3-438e-9253-8fb7699fac82 {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 02:05:14.092382 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 02:05:14.093923 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 02:05:14.094262 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Creating image(s)
May 28 02:05:14.094967 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Acquiring lock "/opt/stack/data/nova/instances/19d774e3-96a1-4dd4-8953-062105d5f0b2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:05:14.095231 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Lock "/opt/stack/data/nova/instances/19d774e3-96a1-4dd4-8953-062105d5f0b2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:05:14.096011 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Lock "/opt/stack/data/nova/instances/19d774e3-96a1-4dd4-8953-062105d5f0b2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:05:14.096654 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:05:14.100336 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:05:14.102867 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:05:14.135832 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Acquiring lock "refresh_cache-19d774e3-96a1-4dd4-8953-062105d5f0b2" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:05:14.186108 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-40352623-9aa0-47c1-b61c-d39a6adce28c req-e900b174-cd64-4eff-9f03-e7b915225da2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:05:14.191547 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.089s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:05:14.192182 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:05:14.192759 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:05:14.193397 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:05:14.198187 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:05:14.199621 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:05:14.276700 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-40352623-9aa0-47c1-b61c-d39a6adce28c req-e900b174-cd64-4eff-9f03-e7b915225da2 service nova] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:05:14.286574 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.087s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:05:14.287121 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/19d774e3-96a1-4dd4-8953-062105d5f0b2/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:05:14.342165 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/19d774e3-96a1-4dd4-8953-062105d5f0b2/disk 1073741824" returned: 0 in 0.055s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:05:14.342608 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.150s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:05:14.342946 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:05:14.452143 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.109s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:05:14.452330 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Checking if we can resize image /opt/stack/data/nova/instances/19d774e3-96a1-4dd4-8953-062105d5f0b2/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 02:05:14.452759 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d774e3-96a1-4dd4-8953-062105d5f0b2/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:05:14.477925 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-40352623-9aa0-47c1-b61c-d39a6adce28c req-e900b174-cd64-4eff-9f03-e7b915225da2 service nova] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:05:14.553611 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d774e3-96a1-4dd4-8953-062105d5f0b2/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:05:14.553934 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Cannot resize image /opt/stack/data/nova/instances/19d774e3-96a1-4dd4-8953-062105d5f0b2/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 02:05:14.554342 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 02:05:14.555183 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Ensure instance console log exists: /opt/stack/data/nova/instances/19d774e3-96a1-4dd4-8953-062105d5f0b2/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 02:05:14.555183 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:05:14.555558 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:05:14.555780 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:05:14.598703 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 02:05:14.599201 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4', 'iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ac9702c2-f086-4648-8db2-3a060a485aa4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:05:14.599392 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:05:14.601331 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:05:14.601331 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4', 'iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ac9702c2-f086-4648-8db2-3a060a485aa4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 02:05:14.616411 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:05:14.618286 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:05:14.618903 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:05:14.619449 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:05:14.620434 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:05:14.620719 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:05:14.634606 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:05:14.634606 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:05:14.637744 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:05:14.637744 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:05:14.650709 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4] added
May 28 02:05:14.650709 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:05:14.650709 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:05:14.650709 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:05:14.650709 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:05:14.650709 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:05:14.650709 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:05:14.651073 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:05:14.651137 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0317(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:05:14.651270 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:05:14.658858 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4] added
May 28 02:05:14.658858 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:05:14.658858 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:05:14.658858 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:05:14.658858 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:05:14.658858 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:05:14.658858 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:05:14.659267 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:05:14.660124 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0387(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:05:14.660124 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:05:14.982704 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-40352623-9aa0-47c1-b61c-d39a6adce28c req-e900b174-cd64-4eff-9f03-e7b915225da2 service nova] Releasing lock "refresh_cache-19d774e3-96a1-4dd4-8953-062105d5f0b2" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:05:14.983130 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Acquired lock "refresh_cache-19d774e3-96a1-4dd4-8953-062105d5f0b2" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:05:14.983336 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:05:15.553424 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:05:15.651822 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:05:15.661528 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:05:15.669195 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:05:15.669195 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:05:15.677333 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:05:15.677333 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:05:15.684980 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:05:15.696876 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:05:15.704180 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:05:15.704180 np0000001583 nova-compute[98241]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:05:15.704180 np0000001583 nova-compute[98241]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:05:15.704180 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:05:15.704413 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsi session list stdout=tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:05:15.704413 np0000001583 nova-compute[98241]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:05:15.704413 np0000001583 nova-compute[98241]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:05:15.704413 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:05:15.714859 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:05:15.714859 np0000001583 nova-compute[98241]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:05:15.714859 np0000001583 nova-compute[98241]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:05:15.714859 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:05:15.714859 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsi session list stdout=tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:05:15.714859 np0000001583 nova-compute[98241]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:05:15.714859 np0000001583 nova-compute[98241]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:05:15.714859 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:05:15.737097 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4, portal: 192.168.40.100,3260]
May 28 02:05:15.737097 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4, portal: 192.168.40.100,3260] successful.
May 28 02:05:15.737097 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:05:15.757575 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:05:15.758459 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4, portal: 192.168.50.100,3260]
May 28 02:05:15.758459 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4, portal: 192.168.50.100,3260] successful.
May 28 02:05:15.758459 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:05:15.776397 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:05:15.778920 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:05:15.779293 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:05:15.779293 np0000001583 nova-compute[98241]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:05:15.779293 np0000001583 nova-compute[98241]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:05:15.779293 np0000001583 nova-compute[98241]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4 (non-flash)
May 28 02:05:15.779293 np0000001583 nova-compute[98241]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4 (non-flash)
May 28 02:05:15.779293 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:05:15.779779 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsi session list stdout=tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:05:15.779779 np0000001583 nova-compute[98241]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:05:15.779779 np0000001583 nova-compute[98241]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:05:15.779779 np0000001583 nova-compute[98241]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4 (non-flash)
May 28 02:05:15.779779 np0000001583 nova-compute[98241]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4 (non-flash)
May 28 02:05:15.779779 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:05:15.780205 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.161s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:05:15.781452 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:05:15.781452 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] HCTL ('8', '-', '-', 0) found on session 135 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:05:15.781452 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:05:15.794837 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:05:15.794837 np0000001583 nova-compute[98241]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:05:15.794837 np0000001583 nova-compute[98241]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:05:15.794837 np0000001583 nova-compute[98241]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4 (non-flash)
May 28 02:05:15.794837 np0000001583 nova-compute[98241]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4 (non-flash)
May 28 02:05:15.794837 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:05:15.794837 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsi session list stdout=tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:05:15.794837 np0000001583 nova-compute[98241]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:05:15.794837 np0000001583 nova-compute[98241]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:05:15.794837 np0000001583 nova-compute[98241]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4 (non-flash)
May 28 02:05:15.794837 np0000001583 nova-compute[98241]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4 (non-flash)
May 28 02:05:15.794837 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:05:15.794837 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.175s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:05:15.795441 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:05:15.795492 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] HCTL ('11', '-', '-', 0) found on session 136 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:05:15.796494 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:05:15.809770 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Searching for a device in session 135 and hctl ['8', '*', '*', 0] yield: None {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:05:15.827905 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Searching for a device in session 136 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:05:15.827905 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ac9702c2-f086-4648-8db2-3a060a485aa4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:05:15.958242 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "0cc444e2-c821-4786-b7d7-296bd945d4d4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:05:15.958242 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "0cc444e2-c821-4786-b7d7-296bd945d4d4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:05:15.971485 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Updating instance_info_cache with network_info: [{"id": "deb0d435-44b2-4669-a015-149a269fbdd5", "address": "fa:16:3e:ff:6c:b9", "network": {"id": "2c66b30f-b14b-4986-ac5f-ecd11f2846b0", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1535175285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d772abe23aca4eb5b0e7b107c859c20b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb0d435-44", "ovs_interfaceid": "deb0d435-44b2-4669-a015-149a269fbdd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:05:16.460645 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 02:05:16.477217 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Releasing lock "refresh_cache-19d774e3-96a1-4dd4-8953-062105d5f0b2" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:05:16.477563 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Instance network_info: |[{"id": "deb0d435-44b2-4669-a015-149a269fbdd5", "address": "fa:16:3e:ff:6c:b9", "network": {"id": "2c66b30f-b14b-4986-ac5f-ecd11f2846b0", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1535175285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d772abe23aca4eb5b0e7b107c859c20b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb0d435-44", "ovs_interfaceid": "deb0d435-44b2-4669-a015-149a269fbdd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 02:05:16.479968 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Start _get_guest_xml network_info=[{"id": "deb0d435-44b2-4669-a015-149a269fbdd5", "address": "fa:16:3e:ff:6c:b9", "network": {"id": "2c66b30f-b14b-4986-ac5f-ecd11f2846b0", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1535175285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d772abe23aca4eb5b0e7b107c859c20b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb0d435-44", "ovs_interfaceid": "deb0d435-44b2-4669-a015-149a269fbdd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 02:05:16.486684 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:05:16.488065 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-VolumesExtendAttachedTest-instance-1266036083', uuid='19d774e3-96a1-4dd4-8953-062105d5f0b2'), owner=OwnerMeta(userid='20d40467c45044a5aaeaa43c84e7a470', username='tempest-VolumesExtendAttachedTest-1888616504-project-member', projectid='d772abe23aca4eb5b0e7b107c859c20b', projectname='tempest-VolumesExtendAttachedTest-1888616504'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "deb0d435-44b2-4669-a015-149a269fbdd5", "address": "fa:16:3e:ff:6c:b9", "network": {"id": "2c66b30f-b14b-4986-ac5f-ecd11f2846b0", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1535175285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d772abe23aca4eb5b0e7b107c859c20b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb0d435-44", "ovs_interfaceid": "deb0d435-44b2-4669-a015-149a269fbdd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933916.4876008) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 02:05:16.489580 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 02:05:16.489984 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 02:05:16.491090 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 02:05:16.491295 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 02:05:16.492196 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 02:05:16.492481 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 02:05:16.492618 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 02:05:16.492739 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 02:05:16.492874 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 02:05:16.492996 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 02:05:16.493971 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 02:05:16.493971 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 02:05:16.493971 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 02:05:16.493971 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 02:05:16.493971 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 02:05:16.493971 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 02:05:16.505514 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:05:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesExtendAttachedTest-instance-1266036083',display_name='tempest-VolumesExtendAttachedTest-instance-1266036083',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-volumesextendattachedtest-instance-1266036083',id=59,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQ8J7rQr/v8G5T6OlyrmtM5zGrUSsJ2+og2hpIpxkCvfCgFxRwjj/WUd+jw0pQDDw2DL1ZT4S6gLVnwD+TKZdDXwltO0IcfFVo/3xV90Zvw+P70ZrHjBXcFgWF0UT1CQQ==',key_name='tempest-keypair-1067261923',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d772abe23aca4eb5b0e7b107c859c20b',ramdisk_id='',reservation_id='r-e5acg04t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesExtendAttachedTest-1888616504',owner_user_name='tempest-VolumesExtendAttachedTest-1888616504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:05:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='20d40467c45044a5aaeaa43c84e7a470',uuid=19d774e3-96a1-4dd4-8953-062105d5f0b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "deb0d435-44b2-4669-a015-149a269fbdd5", "address": "fa:16:3e:ff:6c:b9", "network": {"id": "2c66b30f-b14b-4986-ac5f-ecd11f2846b0", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1535175285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d772abe23aca4eb5b0e7b107c859c20b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb0d435-44", "ovs_interfaceid": "deb0d435-44b2-4669-a015-149a269fbdd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 02:05:16.505759 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Converting VIF {"id": "deb0d435-44b2-4669-a015-149a269fbdd5", "address": "fa:16:3e:ff:6c:b9", "network": {"id": "2c66b30f-b14b-4986-ac5f-ecd11f2846b0", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1535175285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d772abe23aca4eb5b0e7b107c859c20b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb0d435-44", "ovs_interfaceid": "deb0d435-44b2-4669-a015-149a269fbdd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:05:16.506758 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:6c:b9,bridge_name='br-int',has_traffic_filtering=True,id=deb0d435-44b2-4669-a015-149a269fbdd5,network=Network(2c66b30f-b14b-4986-ac5f-ecd11f2846b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeb0d435-44') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:05:16.507143 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Lazy-loading 'pci_devices' on Instance uuid 19d774e3-96a1-4dd4-8953-062105d5f0b2 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:05:16.808259 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Searching for a device in session 135 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:05:16.808724 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ac9702c2-f086-4648-8db2-3a060a485aa4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:05:17.010519 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] End _get_guest_xml xml=<domain type="qemu">
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:   <uuid>19d774e3-96a1-4dd4-8953-062105d5f0b2</uuid>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:   <name>instance-0000003b</name>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:   <metadata>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:       <nova:name>tempest-VolumesExtendAttachedTest-instance-1266036083</nova:name>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 02:05:16</nova:creationTime>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:       </nova:image>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:         <nova:user uuid="20d40467c45044a5aaeaa43c84e7a470">tempest-VolumesExtendAttachedTest-1888616504-project-member</nova:user>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:         <nova:project uuid="d772abe23aca4eb5b0e7b107c859c20b">tempest-VolumesExtendAttachedTest-1888616504</nova:project>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:         <nova:port uuid="deb0d435-44b2-4669-a015-149a269fbdd5">
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:         </nova:port>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:   </metadata>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:     <system>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:       <entry name="serial">19d774e3-96a1-4dd4-8953-062105d5f0b2</entry>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:       <entry name="uuid">19d774e3-96a1-4dd4-8953-062105d5f0b2</entry>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:     </system>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:   <os>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:   </os>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:   <features>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:     <acpi/>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:     <tcg>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:     </tcg>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:   </features>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:   </cpu>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:   <devices>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/19d774e3-96a1-4dd4-8953-062105d5f0b2/disk"/>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:     </disk>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/19d774e3-96a1-4dd4-8953-062105d5f0b2/disk.config"/>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:     </disk>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:ff:6c:b9"/>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:       <target dev="tapdeb0d435-44"/>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:     </interface>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/19d774e3-96a1-4dd4-8953-062105d5f0b2/console.log" append="off"/>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:     </serial>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:     <video>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:     </video>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:     </rng>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:     </memballoon>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:   </devices>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]: </domain>
May 28 02:05:17.010519 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 02:05:17.014914 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Preparing to wait for external event network-vif-plugged-deb0d435-44b2-4669-a015-149a269fbdd5 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 02:05:17.014914 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Acquiring lock "19d774e3-96a1-4dd4-8953-062105d5f0b2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:05:17.014914 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Lock "19d774e3-96a1-4dd4-8953-062105d5f0b2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:05:17.014914 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Lock "19d774e3-96a1-4dd4-8953-062105d5f0b2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:05:17.014914 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:05:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesExtendAttachedTest-instance-1266036083',display_name='tempest-VolumesExtendAttachedTest-instance-1266036083',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-volumesextendattachedtest-instance-1266036083',id=59,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQ8J7rQr/v8G5T6OlyrmtM5zGrUSsJ2+og2hpIpxkCvfCgFxRwjj/WUd+jw0pQDDw2DL1ZT4S6gLVnwD+TKZdDXwltO0IcfFVo/3xV90Zvw+P70ZrHjBXcFgWF0UT1CQQ==',key_name='tempest-keypair-1067261923',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d772abe23aca4eb5b0e7b107c859c20b',ramdisk_id='',reservation_id='r-e5acg04t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesExtendAttachedTest-1888616504',owner_user_name='tempest-VolumesExtendAttachedTest-1888616504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:05:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='20d40467c45044a5aaeaa43c84e7a470',uuid=19d774e3-96a1-4dd4-8953-062105d5f0b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "deb0d435-44b2-4669-a015-149a269fbdd5", "address": "fa:16:3e:ff:6c:b9", "network": {"id": "2c66b30f-b14b-4986-ac5f-ecd11f2846b0", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1535175285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d772abe23aca4eb5b0e7b107c859c20b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb0d435-44", "ovs_interfaceid": "deb0d435-44b2-4669-a015-149a269fbdd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 02:05:17.014914 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Converting VIF {"id": "deb0d435-44b2-4669-a015-149a269fbdd5", "address": "fa:16:3e:ff:6c:b9", "network": {"id": "2c66b30f-b14b-4986-ac5f-ecd11f2846b0", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1535175285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d772abe23aca4eb5b0e7b107c859c20b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb0d435-44", "ovs_interfaceid": "deb0d435-44b2-4669-a015-149a269fbdd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:05:17.014914 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:6c:b9,bridge_name='br-int',has_traffic_filtering=True,id=deb0d435-44b2-4669-a015-149a269fbdd5,network=Network(2c66b30f-b14b-4986-ac5f-ecd11f2846b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeb0d435-44') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:05:17.014914 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:6c:b9,bridge_name='br-int',has_traffic_filtering=True,id=deb0d435-44b2-4669-a015-149a269fbdd5,network=Network(2c66b30f-b14b-4986-ac5f-ecd11f2846b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeb0d435-44') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 02:05:17.014914 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:17.014914 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:05:17.014914 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 02:05:17.015518 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:17.015733 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ae4a5676-934e-5c67-9945-6635856d9b49', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:05:17.019099 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:17.019099 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:05:17.020825 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:17.021139 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdeb0d435-44, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:05:17.021805 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdeb0d435-44, col_values=(('qos', UUID('e4566d27-e8e0-4e5b-9ec0-58f4222e61d7')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:05:17.021805 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdeb0d435-44, col_values=(('external_ids', {'iface-id': 'deb0d435-44b2-4669-a015-149a269fbdd5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:6c:b9', 'vm-uuid': '19d774e3-96a1-4dd4-8953-062105d5f0b2'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:05:17.024423 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:17.026239 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:05:17.032855 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:05:17.033295 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:17.034670 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:05:17.035112 np0000001583 nova-compute[98241]: INFO os_vif [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:6c:b9,bridge_name='br-int',has_traffic_filtering=True,id=deb0d435-44b2-4669-a015-149a269fbdd5,network=Network(2c66b30f-b14b-4986-ac5f-ecd11f2846b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeb0d435-44')
May 28 02:05:17.039324 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 02:05:17.039449 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Claim successful on node np0000001583
May 28 02:05:17.639104 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Found WWN 3300000003854e481 for multipath device dm-0 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 02:05:17.639952 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:05:17.639952 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '3300000003854e481', 'path': '/dev/dm-0', 'multipath_id': '3300000003854e481'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:05:17.639952 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000003854e481', 'path': '/dev/dm-0', 'multipath_id': '3300000003854e481'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 02:05:17.643043 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lazy-loading 'flavor' on Instance uuid 7751bb1a-84b9-48ce-81da-b3a41d63eadc {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:05:18.147328 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Attempting to attach volume ac9702c2-f086-4648-8db2-3a060a485aa4 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98241) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 02:05:18.150193 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] attach device xml: <disk type="block" device="disk">
May 28 02:05:18.150193 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:05:18.150193 np0000001583 nova-compute[98241]:   <alias name="ua-ac9702c2-f086-4648-8db2-3a060a485aa4"/>
May 28 02:05:18.150193 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-0"/>
May 28 02:05:18.150193 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:05:18.150193 np0000001583 nova-compute[98241]:   <serial>ac9702c2-f086-4648-8db2-3a060a485aa4</serial>
May 28 02:05:18.150193 np0000001583 nova-compute[98241]: </disk>
May 28 02:05:18.150193 np0000001583 nova-compute[98241]:  {{(pid=98241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 02:05:18.280769 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:05:18.282068 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:05:18.433704 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:18.558631 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:05:18.558779 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:05:18.558779 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] No VIF found with MAC fa:16:3e:ff:6c:b9, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:05:18.559254 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Using config drive
May 28 02:05:18.783554 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:05:19.065113 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:05:19.204771 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Creating config drive at /opt/stack/data/nova/instances/19d774e3-96a1-4dd4-8953-062105d5f0b2/disk.config
May 28 02:05:19.208455 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/19d774e3-96a1-4dd4-8953-062105d5f0b2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmppwo5xlnj {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:05:19.264506 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/19d774e3-96a1-4dd4-8953-062105d5f0b2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmppwo5xlnj" returned: 0 in 0.056s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:05:19.292257 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.259s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:05:19.292995 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 02:05:19.784295 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:19.804519 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 02:05:19.806108 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 02:05:19.806595 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:05:19.806963 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:05:19.822882 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:19.824779 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:19.827479 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:05:19.828813 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:05:19.829991 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:05:19.831112 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] No VIF found with MAC fa:16:3e:e6:d6:9e, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:05:19.924536 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:19.949794 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0f09c9f1da7e4d32979e47c96d41ae99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd192b18567fd4735988dd19da06fb868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 02:05:20.181150 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5b7a0c05-b728-40fb-be3e-22d0ac8220a2 req-7d1d0fed-d554-4146-922f-5a3843c83892 service nova] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Received event network-vif-plugged-deb0d435-44b2-4669-a015-149a269fbdd5 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:05:20.181668 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5b7a0c05-b728-40fb-be3e-22d0ac8220a2 req-7d1d0fed-d554-4146-922f-5a3843c83892 service nova] Acquiring lock "19d774e3-96a1-4dd4-8953-062105d5f0b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:05:20.181829 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5b7a0c05-b728-40fb-be3e-22d0ac8220a2 req-7d1d0fed-d554-4146-922f-5a3843c83892 service nova] Lock "19d774e3-96a1-4dd4-8953-062105d5f0b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:05:20.183053 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5b7a0c05-b728-40fb-be3e-22d0ac8220a2 req-7d1d0fed-d554-4146-922f-5a3843c83892 service nova] Lock "19d774e3-96a1-4dd4-8953-062105d5f0b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:05:20.183233 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5b7a0c05-b728-40fb-be3e-22d0ac8220a2 req-7d1d0fed-d554-4146-922f-5a3843c83892 service nova] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Processing event network-vif-plugged-deb0d435-44b2-4669-a015-149a269fbdd5 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 02:05:20.230787 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:20.234572 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:20.238298 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:20.238848 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:20.265190 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:20.305167 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 02:05:20.531672 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Successfully created port: ae352d09-61f5-40a7-b8f2-5f7c2daab5c5 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 02:05:20.696632 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:05:20.697422 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:05:20.697614 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.50 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:05:20.792659 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933920.7921984, 19d774e3-96a1-4dd4-8953-062105d5f0b2 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:05:20.793229 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] VM Started (Lifecycle Event)
May 28 02:05:20.794612 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 02:05:20.797929 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 02:05:20.800605 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Instance spawned successfully.
May 28 02:05:20.801061 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 02:05:20.808769 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 02:05:21.194690 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:05:21.195624 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:05:21.295876 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:05:21.298593 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:05:21.321405 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:05:21.321689 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:05:21.322238 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:05:21.323057 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:05:21.325294 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:05:21.326111 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:05:21.406251 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-162634d3-8f39-4eda-ab79-d76352ff2107 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "7751bb1a-84b9-48ce-81da-b3a41d63eadc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.505s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:05:21.547662 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:21.706272 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Successfully updated port: ae352d09-61f5-40a7-b8f2-5f7c2daab5c5 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 02:05:21.809010 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 02:05:21.809311 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933921.8091233, 19d774e3-96a1-4dd4-8953-062105d5f0b2 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:05:21.809430 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] VM Paused (Lifecycle Event)
May 28 02:05:21.817841 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 02:05:21.818992 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 02:05:21.819292 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Creating image(s)
May 28 02:05:21.822662 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "/opt/stack/data/nova/instances/0cc444e2-c821-4786-b7d7-296bd945d4d4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:05:21.823811 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "/opt/stack/data/nova/instances/0cc444e2-c821-4786-b7d7-296bd945d4d4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:05:21.824779 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "/opt/stack/data/nova/instances/0cc444e2-c821-4786-b7d7-296bd945d4d4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:05:21.825918 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:05:21.831121 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:05:21.832716 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:05:21.859594 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Took 7.77 seconds to spawn the instance on the hypervisor.
May 28 02:05:21.863258 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:05:21.954693 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.122s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:05:21.955291 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:05:21.955824 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:05:21.956414 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:05:21.966777 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:05:21.967832 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:05:22.024786 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:22.075208 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.107s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:05:22.075731 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/0cc444e2-c821-4786-b7d7-296bd945d4d4/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:05:22.135271 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/0cc444e2-c821-4786-b7d7-296bd945d4d4/disk 1073741824" returned: 0 in 0.059s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:05:22.135707 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.180s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:05:22.136196 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:05:22.196866 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:05:22.197978 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:05:22.211172 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "refresh_cache-0cc444e2-c821-4786-b7d7-296bd945d4d4" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:05:22.211172 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquired lock "refresh_cache-0cc444e2-c821-4786-b7d7-296bd945d4d4" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:05:22.211172 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:05:22.246911 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.111s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:05:22.247594 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0cc444e2-c821-4786-b7d7-296bd945d4d4/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 02:05:22.248031 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cc444e2-c821-4786-b7d7-296bd945d4d4/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:05:22.271726 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a9f0de27-6e60-48a9-a530-c4da84eded15 req-bcc2dc8c-5d2e-46d2-9106-c3d08493de6f service nova] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Received event network-vif-plugged-deb0d435-44b2-4669-a015-149a269fbdd5 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:05:22.273910 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a9f0de27-6e60-48a9-a530-c4da84eded15 req-bcc2dc8c-5d2e-46d2-9106-c3d08493de6f service nova] Acquiring lock "19d774e3-96a1-4dd4-8953-062105d5f0b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:05:22.274226 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a9f0de27-6e60-48a9-a530-c4da84eded15 req-bcc2dc8c-5d2e-46d2-9106-c3d08493de6f service nova] Lock "19d774e3-96a1-4dd4-8953-062105d5f0b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:05:22.274373 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a9f0de27-6e60-48a9-a530-c4da84eded15 req-bcc2dc8c-5d2e-46d2-9106-c3d08493de6f service nova] Lock "19d774e3-96a1-4dd4-8953-062105d5f0b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:05:22.274554 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a9f0de27-6e60-48a9-a530-c4da84eded15 req-bcc2dc8c-5d2e-46d2-9106-c3d08493de6f service nova] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] No waiting events found dispatching network-vif-plugged-deb0d435-44b2-4669-a015-149a269fbdd5 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:05:22.274726 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-a9f0de27-6e60-48a9-a530-c4da84eded15 req-bcc2dc8c-5d2e-46d2-9106-c3d08493de6f service nova] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Received unexpected event network-vif-plugged-deb0d435-44b2-4669-a015-149a269fbdd5 for instance with vm_state active and task_state None.
May 28 02:05:22.274849 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a9f0de27-6e60-48a9-a530-c4da84eded15 req-bcc2dc8c-5d2e-46d2-9106-c3d08493de6f service nova] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Received event network-changed-ae352d09-61f5-40a7-b8f2-5f7c2daab5c5 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:05:22.275090 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a9f0de27-6e60-48a9-a530-c4da84eded15 req-bcc2dc8c-5d2e-46d2-9106-c3d08493de6f service nova] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Refreshing instance network info cache due to event network-changed-ae352d09-61f5-40a7-b8f2-5f7c2daab5c5. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:05:22.275482 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a9f0de27-6e60-48a9-a530-c4da84eded15 req-bcc2dc8c-5d2e-46d2-9106-c3d08493de6f service nova] Acquiring lock "refresh_cache-0cc444e2-c821-4786-b7d7-296bd945d4d4" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:05:22.312156 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:05:22.317537 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933922.3171904, 19d774e3-96a1-4dd4-8953-062105d5f0b2 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:05:22.317729 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] VM Resumed (Lifecycle Event)
May 28 02:05:22.356413 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Acquiring lock "a2a2bf8a-242c-4f60-b772-5052084fee50" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:05:22.356591 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Lock "a2a2bf8a-242c-4f60-b772-5052084fee50" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:05:22.359704 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cc444e2-c821-4786-b7d7-296bd945d4d4/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:05:22.360489 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Cannot resize image /opt/stack/data/nova/instances/0cc444e2-c821-4786-b7d7-296bd945d4d4/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 02:05:22.360823 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 02:05:22.361036 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Ensure instance console log exists: /opt/stack/data/nova/instances/0cc444e2-c821-4786-b7d7-296bd945d4d4/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 02:05:22.361365 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:05:22.361531 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:05:22.361659 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:05:22.389297 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Took 13.18 seconds to build instance.
May 28 02:05:22.806740 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:05:22.821613 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:05:22.827409 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:05:22.860605 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 02:05:22.897319 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Lock "19d774e3-96a1-4dd4-8953-062105d5f0b2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.694s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:05:23.031995 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:05:23.111725 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2db0cc99-796d-44f2-a1b0-a00b83f335d7 req-fd5e52c0-cb8d-4716-bc23-2da42fc1040d service nova] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Received event network-changed-deb0d435-44b2-4669-a015-149a269fbdd5 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:05:23.111919 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2db0cc99-796d-44f2-a1b0-a00b83f335d7 req-fd5e52c0-cb8d-4716-bc23-2da42fc1040d service nova] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Refreshing instance network info cache due to event network-changed-deb0d435-44b2-4669-a015-149a269fbdd5. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:05:23.115537 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2db0cc99-796d-44f2-a1b0-a00b83f335d7 req-fd5e52c0-cb8d-4716-bc23-2da42fc1040d service nova] Acquiring lock "refresh_cache-19d774e3-96a1-4dd4-8953-062105d5f0b2" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:05:23.115703 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2db0cc99-796d-44f2-a1b0-a00b83f335d7 req-fd5e52c0-cb8d-4716-bc23-2da42fc1040d service nova] Acquired lock "refresh_cache-19d774e3-96a1-4dd4-8953-062105d5f0b2" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:05:23.115894 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-2db0cc99-796d-44f2-a1b0-a00b83f335d7 req-fd5e52c0-cb8d-4716-bc23-2da42fc1040d service nova] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Refreshing network info cache for port deb0d435-44b2-4669-a015-149a269fbdd5 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:05:23.193572 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:05:23.234495 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Updating instance_info_cache with network_info: [{"id": "ae352d09-61f5-40a7-b8f2-5f7c2daab5c5", "address": "fa:16:3e:46:84:69", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae352d09-61", "ovs_interfaceid": "ae352d09-61f5-40a7-b8f2-5f7c2daab5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:05:23.410436 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:05:23.410882 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:05:23.413867 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 02:05:23.414044 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Claim successful on node np0000001583
May 28 02:05:23.434949 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:23.618373 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-2db0cc99-796d-44f2-a1b0-a00b83f335d7 req-fd5e52c0-cb8d-4716-bc23-2da42fc1040d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:05:23.698583 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:05:23.741282 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Releasing lock "refresh_cache-0cc444e2-c821-4786-b7d7-296bd945d4d4" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:05:23.741282 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Instance network_info: |[{"id": "ae352d09-61f5-40a7-b8f2-5f7c2daab5c5", "address": "fa:16:3e:46:84:69", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae352d09-61", "ovs_interfaceid": "ae352d09-61f5-40a7-b8f2-5f7c2daab5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 02:05:23.741282 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a9f0de27-6e60-48a9-a530-c4da84eded15 req-bcc2dc8c-5d2e-46d2-9106-c3d08493de6f service nova] Acquired lock "refresh_cache-0cc444e2-c821-4786-b7d7-296bd945d4d4" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:05:23.741282 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Start _get_guest_xml network_info=[{"id": "ae352d09-61f5-40a7-b8f2-5f7c2daab5c5", "address": "fa:16:3e:46:84:69", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae352d09-61", "ovs_interfaceid": "ae352d09-61f5-40a7-b8f2-5f7c2daab5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 02:05:23.741806 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-a9f0de27-6e60-48a9-a530-c4da84eded15 req-bcc2dc8c-5d2e-46d2-9106-c3d08493de6f service nova] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Refreshing network info cache for port ae352d09-61f5-40a7-b8f2-5f7c2daab5c5 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:05:23.744539 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:05:23.745709 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-571466772', uuid='0cc444e2-c821-4786-b7d7-296bd945d4d4'), owner=OwnerMeta(userid='0f09c9f1da7e4d32979e47c96d41ae99', username='tempest-TestEncryptedCinderVolumes-243696963-project-member', projectid='d192b18567fd4735988dd19da06fb868', projectname='tempest-TestEncryptedCinderVolumes-243696963'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ae352d09-61f5-40a7-b8f2-5f7c2daab5c5", "address": "fa:16:3e:46:84:69", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae352d09-61", "ovs_interfaceid": "ae352d09-61f5-40a7-b8f2-5f7c2daab5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933923.745334) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 02:05:23.748113 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 02:05:23.748113 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 02:05:23.749338 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 02:05:23.749545 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 02:05:23.750505 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 02:05:23.751072 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 02:05:23.751072 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 02:05:23.751257 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 02:05:23.751257 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 02:05:23.752276 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 02:05:23.752276 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 02:05:23.752276 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 02:05:23.752276 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 02:05:23.752482 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 02:05:23.752588 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 02:05:23.752641 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 02:05:23.775217 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:05:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-571466772',display_name='tempest-TestEncryptedCinderVolumes-server-571466772',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testencryptedcindervolumes-server-571466772',id=60,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKojYJ7TcdtHSbcc1MLYbBExy47EvWKYMSG3x+u7byLmf87yeb/owByssR5LtduMEdOMVdFz71GfEdSZQnHy4uSQ52tMXfF3WzlTWvGsWOFxFTG60/d15VQx0V1HDWfctA==',key_name='tempest-keypair-306195562',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d192b18567fd4735988dd19da06fb868',ramdisk_id='',reservation_id='r-3wbp5f6f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-243696963',owner_user_name='tempest-TestEncryptedCinderVolumes-243696963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:05:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f09c9f1da7e4d32979e47c96d41ae99',uuid=0cc444e2-c821-4786-b7d7-296bd945d4d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae352d09-61f5-40a7-b8f2-5f7c2daab5c5", "address": "fa:16:3e:46:84:69", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae352d09-61", "ovs_interfaceid": "ae352d09-61f5-40a7-b8f2-5f7c2daab5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 02:05:23.775497 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Converting VIF {"id": "ae352d09-61f5-40a7-b8f2-5f7c2daab5c5", "address": "fa:16:3e:46:84:69", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae352d09-61", "ovs_interfaceid": "ae352d09-61f5-40a7-b8f2-5f7c2daab5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:05:23.776040 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:84:69,bridge_name='br-int',has_traffic_filtering=True,id=ae352d09-61f5-40a7-b8f2-5f7c2daab5c5,network=Network(fccbc55c-a449-42c3-bf68-d3d337f7b0ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae352d09-61') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:05:23.777068 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lazy-loading 'pci_devices' on Instance uuid 0cc444e2-c821-4786-b7d7-296bd945d4d4 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:05:23.887662 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:23.998348 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-2db0cc99-796d-44f2-a1b0-a00b83f335d7 req-fd5e52c0-cb8d-4716-bc23-2da42fc1040d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:05:24.198942 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-2db0cc99-796d-44f2-a1b0-a00b83f335d7 req-fd5e52c0-cb8d-4716-bc23-2da42fc1040d service nova] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Updated VIF entry in instance network info cache for port deb0d435-44b2-4669-a015-149a269fbdd5. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:05:24.199788 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-2db0cc99-796d-44f2-a1b0-a00b83f335d7 req-fd5e52c0-cb8d-4716-bc23-2da42fc1040d service nova] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Updating instance_info_cache with network_info: [{"id": "deb0d435-44b2-4669-a015-149a269fbdd5", "address": "fa:16:3e:ff:6c:b9", "network": {"id": "2c66b30f-b14b-4986-ac5f-ecd11f2846b0", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1535175285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d772abe23aca4eb5b0e7b107c859c20b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb0d435-44", "ovs_interfaceid": "deb0d435-44b2-4669-a015-149a269fbdd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:05:24.248307 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-a9f0de27-6e60-48a9-a530-c4da84eded15 req-bcc2dc8c-5d2e-46d2-9106-c3d08493de6f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:05:24.280653 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] End _get_guest_xml xml=<domain type="qemu">
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:   <uuid>0cc444e2-c821-4786-b7d7-296bd945d4d4</uuid>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:   <name>instance-0000003c</name>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:   <metadata>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-571466772</nova:name>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 02:05:23</nova:creationTime>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:       </nova:image>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:         <nova:user uuid="0f09c9f1da7e4d32979e47c96d41ae99">tempest-TestEncryptedCinderVolumes-243696963-project-member</nova:user>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:         <nova:project uuid="d192b18567fd4735988dd19da06fb868">tempest-TestEncryptedCinderVolumes-243696963</nova:project>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:         <nova:port uuid="ae352d09-61f5-40a7-b8f2-5f7c2daab5c5">
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:         </nova:port>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:   </metadata>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:     <system>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:       <entry name="serial">0cc444e2-c821-4786-b7d7-296bd945d4d4</entry>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:       <entry name="uuid">0cc444e2-c821-4786-b7d7-296bd945d4d4</entry>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:     </system>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:   <os>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:   </os>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:   <features>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:     <acpi/>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:     <tcg>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:     </tcg>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:   </features>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:   </cpu>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:   <devices>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/0cc444e2-c821-4786-b7d7-296bd945d4d4/disk"/>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:     </disk>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/0cc444e2-c821-4786-b7d7-296bd945d4d4/disk.config"/>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:     </disk>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:46:84:69"/>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:       <target dev="tapae352d09-61"/>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:     </interface>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/0cc444e2-c821-4786-b7d7-296bd945d4d4/console.log" append="off"/>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:     </serial>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:     <video>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:     </video>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:     </rng>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:     </memballoon>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:   </devices>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]: </domain>
May 28 02:05:24.280653 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 02:05:24.282554 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Preparing to wait for external event network-vif-plugged-ae352d09-61f5-40a7-b8f2-5f7c2daab5c5 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 02:05:24.282554 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "0cc444e2-c821-4786-b7d7-296bd945d4d4-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:05:24.282554 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "0cc444e2-c821-4786-b7d7-296bd945d4d4-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:05:24.282554 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "0cc444e2-c821-4786-b7d7-296bd945d4d4-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:05:24.282695 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:05:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-571466772',display_name='tempest-TestEncryptedCinderVolumes-server-571466772',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testencryptedcindervolumes-server-571466772',id=60,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKojYJ7TcdtHSbcc1MLYbBExy47EvWKYMSG3x+u7byLmf87yeb/owByssR5LtduMEdOMVdFz71GfEdSZQnHy4uSQ52tMXfF3WzlTWvGsWOFxFTG60/d15VQx0V1HDWfctA==',key_name='tempest-keypair-306195562',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d192b18567fd4735988dd19da06fb868',ramdisk_id='',reservation_id='r-3wbp5f6f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-243696963',owner_user_name='tempest-TestEncryptedCinderVolumes-243696963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:05:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f09c9f1da7e4d32979e47c96d41ae99',uuid=0cc444e2-c821-4786-b7d7-296bd945d4d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae352d09-61f5-40a7-b8f2-5f7c2daab5c5", "address": "fa:16:3e:46:84:69", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae352d09-61", "ovs_interfaceid": "ae352d09-61f5-40a7-b8f2-5f7c2daab5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 02:05:24.283136 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Converting VIF {"id": "ae352d09-61f5-40a7-b8f2-5f7c2daab5c5", "address": "fa:16:3e:46:84:69", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae352d09-61", "ovs_interfaceid": "ae352d09-61f5-40a7-b8f2-5f7c2daab5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:05:24.283451 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:84:69,bridge_name='br-int',has_traffic_filtering=True,id=ae352d09-61f5-40a7-b8f2-5f7c2daab5c5,network=Network(fccbc55c-a449-42c3-bf68-d3d337f7b0ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae352d09-61') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:05:24.283996 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:84:69,bridge_name='br-int',has_traffic_filtering=True,id=ae352d09-61f5-40a7-b8f2-5f7c2daab5c5,network=Network(fccbc55c-a449-42c3-bf68-d3d337f7b0ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae352d09-61') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 02:05:24.284626 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:24.285319 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:05:24.285612 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 02:05:24.286717 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:24.286838 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1d2c9a0e-f5e2-5bb0-abf7-cec06c96c65f', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:05:24.287588 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:24.288449 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:05:24.289067 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:24.291320 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:24.291453 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae352d09-61, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:05:24.291821 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapae352d09-61, col_values=(('qos', UUID('03e496d9-b639-49e5-abb5-2789934edfbc')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:05:24.292031 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapae352d09-61, col_values=(('external_ids', {'iface-id': 'ae352d09-61f5-40a7-b8f2-5f7c2daab5c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:84:69', 'vm-uuid': '0cc444e2-c821-4786-b7d7-296bd945d4d4'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:05:24.293184 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:24.294540 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:05:24.300091 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:24.300091 np0000001583 nova-compute[98241]: INFO os_vif [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:84:69,bridge_name='br-int',has_traffic_filtering=True,id=ae352d09-61f5-40a7-b8f2-5f7c2daab5c5,network=Network(fccbc55c-a449-42c3-bf68-d3d337f7b0ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae352d09-61')
May 28 02:05:24.668270 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-a9f0de27-6e60-48a9-a530-c4da84eded15 req-bcc2dc8c-5d2e-46d2-9106-c3d08493de6f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:05:24.702658 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2db0cc99-796d-44f2-a1b0-a00b83f335d7 req-fd5e52c0-cb8d-4716-bc23-2da42fc1040d service nova] Releasing lock "refresh_cache-19d774e3-96a1-4dd4-8953-062105d5f0b2" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:05:24.816542 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:05:24.816789 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:05:24.851310 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-a9f0de27-6e60-48a9-a530-c4da84eded15 req-bcc2dc8c-5d2e-46d2-9106-c3d08493de6f service nova] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Updated VIF entry in instance network info cache for port ae352d09-61f5-40a7-b8f2-5f7c2daab5c5. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:05:24.851596 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-a9f0de27-6e60-48a9-a530-c4da84eded15 req-bcc2dc8c-5d2e-46d2-9106-c3d08493de6f service nova] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Updating instance_info_cache with network_info: [{"id": "ae352d09-61f5-40a7-b8f2-5f7c2daab5c5", "address": "fa:16:3e:46:84:69", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae352d09-61", "ovs_interfaceid": "ae352d09-61f5-40a7-b8f2-5f7c2daab5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:05:25.195787 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f13b215a-e103-4aa6-bf0f-5890f37c31c4 req-42157f86-289a-4566-bd32-e397f446a430 service nova] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Received event network-vif-unplugged-ae352d09-61f5-40a7-b8f2-5f7c2daab5c5 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:05:25.198214 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f13b215a-e103-4aa6-bf0f-5890f37c31c4 req-42157f86-289a-4566-bd32-e397f446a430 service nova] Acquiring lock "0cc444e2-c821-4786-b7d7-296bd945d4d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:05:25.198214 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f13b215a-e103-4aa6-bf0f-5890f37c31c4 req-42157f86-289a-4566-bd32-e397f446a430 service nova] Lock "0cc444e2-c821-4786-b7d7-296bd945d4d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:05:25.198214 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f13b215a-e103-4aa6-bf0f-5890f37c31c4 req-42157f86-289a-4566-bd32-e397f446a430 service nova] Lock "0cc444e2-c821-4786-b7d7-296bd945d4d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:05:25.198354 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f13b215a-e103-4aa6-bf0f-5890f37c31c4 req-42157f86-289a-4566-bd32-e397f446a430 service nova] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] No event matching network-vif-unplugged-ae352d09-61f5-40a7-b8f2-5f7c2daab5c5 in dict_keys([('network-vif-plugged', 'ae352d09-61f5-40a7-b8f2-5f7c2daab5c5')]) {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 02:05:25.198505 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-f13b215a-e103-4aa6-bf0f-5890f37c31c4 req-42157f86-289a-4566-bd32-e397f446a430 service nova] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Received unexpected event network-vif-unplugged-ae352d09-61f5-40a7-b8f2-5f7c2daab5c5 for instance with vm_state building and task_state spawning.
May 28 02:05:25.320907 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:05:25.353967 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a9f0de27-6e60-48a9-a530-c4da84eded15 req-bcc2dc8c-5d2e-46d2-9106-c3d08493de6f service nova] Releasing lock "refresh_cache-0cc444e2-c821-4786-b7d7-296bd945d4d4" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:05:25.768844 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4a977513-72e1-4832-a097-6314026acdfe tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Acquiring lock "7751bb1a-84b9-48ce-81da-b3a41d63eadc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:05:25.769401 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4a977513-72e1-4832-a097-6314026acdfe tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "7751bb1a-84b9-48ce-81da-b3a41d63eadc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:05:25.828845 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.418s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:05:25.829356 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 2.131s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:05:25.829498 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:05:25.829664 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Auditing locally available compute resources for np0000001583 (node: np0000001583) {{(pid=98241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 02:05:25.831201 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 02:05:25.838724 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:05:25.838724 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:05:25.838724 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] No VIF found with MAC fa:16:3e:46:84:69, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:05:25.838724 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Using config drive
May 28 02:05:26.275553 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-4a977513-72e1-4832-a097-6314026acdfe tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Detaching volume ac9702c2-f086-4648-8db2-3a060a485aa4
May 28 02:05:26.338625 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 02:05:26.338867 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 02:05:26.339172 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:05:26.340218 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:05:26.351716 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:05:26.354684 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-4a977513-72e1-4832-a097-6314026acdfe tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Attempting to driver detach volume ac9702c2-f086-4648-8db2-3a060a485aa4 from mountpoint /dev/vdb
May 28 02:05:26.378295 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4a977513-72e1-4832-a097-6314026acdfe tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Found disk vdb by alias ua-ac9702c2-f086-4648-8db2-3a060a485aa4 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:05:26.384110 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4a977513-72e1-4832-a097-6314026acdfe tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Found disk vdb by alias ua-ac9702c2-f086-4648-8db2-3a060a485aa4 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:05:26.384110 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4a977513-72e1-4832-a097-6314026acdfe tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Attempting to detach device vdb from instance 7751bb1a-84b9-48ce-81da-b3a41d63eadc from the persistent domain config. {{(pid=98241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 02:05:26.384110 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-4a977513-72e1-4832-a097-6314026acdfe tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:05:26.384110 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:05:26.384110 np0000001583 nova-compute[98241]:   <alias name="ua-ac9702c2-f086-4648-8db2-3a060a485aa4"/>
May 28 02:05:26.384110 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-0"/>
May 28 02:05:26.384110 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:05:26.384110 np0000001583 nova-compute[98241]:   <serial>ac9702c2-f086-4648-8db2-3a060a485aa4</serial>
May 28 02:05:26.384110 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 02:05:26.384110 np0000001583 nova-compute[98241]: </disk>
May 28 02:05:26.384110 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:05:26.398509 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-4a977513-72e1-4832-a097-6314026acdfe tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Successfully detached device vdb from instance 7751bb1a-84b9-48ce-81da-b3a41d63eadc from the persistent domain config.
May 28 02:05:26.398698 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4a977513-72e1-4832-a097-6314026acdfe tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] (1/8): Attempting to detach device vdb with device alias ua-ac9702c2-f086-4648-8db2-3a060a485aa4 from instance 7751bb1a-84b9-48ce-81da-b3a41d63eadc from the live domain config. {{(pid=98241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 02:05:26.399343 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-4a977513-72e1-4832-a097-6314026acdfe tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:05:26.399343 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:05:26.399343 np0000001583 nova-compute[98241]:   <alias name="ua-ac9702c2-f086-4648-8db2-3a060a485aa4"/>
May 28 02:05:26.399343 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-0"/>
May 28 02:05:26.399343 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:05:26.399343 np0000001583 nova-compute[98241]:   <serial>ac9702c2-f086-4648-8db2-3a060a485aa4</serial>
May 28 02:05:26.399343 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 02:05:26.399343 np0000001583 nova-compute[98241]: </disk>
May 28 02:05:26.399343 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:05:26.443191 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e77dd271ad8b4d07891b96412807ec50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c478b25f90f24714a03a0be223706df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 02:05:26.537546 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Creating config drive at /opt/stack/data/nova/instances/0cc444e2-c821-4786-b7d7-296bd945d4d4/disk.config
May 28 02:05:26.542883 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0cc444e2-c821-4786-b7d7-296bd945d4d4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_15c2l4_ {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:05:26.604234 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0cc444e2-c821-4786-b7d7-296bd945d4d4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_15c2l4_" returned: 0 in 0.061s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:05:26.842361 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 02:05:27.066817 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Received event <DeviceRemovedEvent: 1779933927.0662265, 7751bb1a-84b9-48ce-81da-b3a41d63eadc => ua-ac9702c2-f086-4648-8db2-3a060a485aa4> from libvirt while the driver is waiting for it; dispatched. {{(pid=98241) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 02:05:27.075984 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4a977513-72e1-4832-a097-6314026acdfe tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-ac9702c2-f086-4648-8db2-3a060a485aa4 for instance 7751bb1a-84b9-48ce-81da-b3a41d63eadc {{(pid=98241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 02:05:27.083198 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-4a977513-72e1-4832-a097-6314026acdfe tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Successfully detached device vdb from instance 7751bb1a-84b9-48ce-81da-b3a41d63eadc from the live domain config.
May 28 02:05:27.084907 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a977513-72e1-4832-a097-6314026acdfe tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:05:27.085831 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a977513-72e1-4832-a097-6314026acdfe tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4', 'iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ac9702c2-f086-4648-8db2-3a060a485aa4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:05:27.085831 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-4a977513-72e1-4832-a097-6314026acdfe tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:05:27.086292 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-4a977513-72e1-4832-a097-6314026acdfe tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:05:27.090125 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a977513-72e1-4832-a097-6314026acdfe tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4', 'iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ac9702c2-f086-4648-8db2-3a060a485aa4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:05:27.090125 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a977513-72e1-4832-a097-6314026acdfe tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:05:27.116302 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Successfully created port: 84cef5f8-6465-4a29-b1e5-a96f8cd4145b {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 02:05:27.119453 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a977513-72e1-4832-a097-6314026acdfe tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:05:27.119453 np0000001583 nova-compute[98241]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:05:27.119453 np0000001583 nova-compute[98241]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4 (non-flash)
May 28 02:05:27.119453 np0000001583 nova-compute[98241]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4 (non-flash)
May 28 02:05:27.119453 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:05:27.119656 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a977513-72e1-4832-a097-6314026acdfe tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsi session list stdout=tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:05:27.119656 np0000001583 nova-compute[98241]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:05:27.119656 np0000001583 nova-compute[98241]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4 (non-flash)
May 28 02:05:27.119656 np0000001583 nova-compute[98241]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4 (non-flash)
May 28 02:05:27.119656 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:05:27.119855 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a977513-72e1-4832-a097-6314026acdfe tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa', '131'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa', '132'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4', '135'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4', '136')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:05:27.120071 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a977513-72e1-4832-a097-6314026acdfe tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4', '135')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:05:27.122121 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a977513-72e1-4832-a097-6314026acdfe tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4', '136')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:05:27.123316 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a977513-72e1-4832-a097-6314026acdfe tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724ec1f74c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4'): ({'sdf'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:05:27.123412 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-4a977513-72e1-4832-a097-6314026acdfe tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Removing multipathed devices sdf, sdc {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:05:27.123705 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-4a977513-72e1-4832-a097-6314026acdfe tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Flush multipath device 3300000003854e481 {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:05:27.162453 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-4a977513-72e1-4832-a097-6314026acdfe tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:05:27.210699 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-4a977513-72e1-4832-a097-6314026acdfe tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:05:27.212174 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:27.219315 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:27.240830 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:27.268999 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-4a977513-72e1-4832-a097-6314026acdfe tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Checking to see if SCSI volumes sdf, sdc have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:05:27.269616 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-4a977513-72e1-4832-a097-6314026acdfe tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] SCSI volumes sdf, sdc have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:05:27.270179 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-4a977513-72e1-4832-a097-6314026acdfe tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Checking to see if device paths {'sdf', 'sdc'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:05:27.284965 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-4a977513-72e1-4832-a097-6314026acdfe tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Device paths {'sdf', 'sdc'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:05:27.285293 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a977513-72e1-4832-a097-6314026acdfe tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:05:27.301213 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a977513-72e1-4832-a097-6314026acdfe tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:05:27.339674 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a977513-72e1-4832-a097-6314026acdfe tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 135, target: iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4, portal: 192.168.40.100,3260]
May 28 02:05:27.339674 np0000001583 nova-compute[98241]: Logout of [sid: 135, target: iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4, portal: 192.168.40.100,3260] successful.
May 28 02:05:27.339674 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:05:27.346766 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 02:05:27.361713 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:27.363472 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a977513-72e1-4832-a097-6314026acdfe tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:05:27.386270 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a977513-72e1-4832-a097-6314026acdfe tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:05:27.419469 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a977513-72e1-4832-a097-6314026acdfe tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 136, target: iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4, portal: 192.168.50.100,3260]
May 28 02:05:27.419469 np0000001583 nova-compute[98241]: Logout of [sid: 136, target: iqn.2023-03.storpool.com:os--volume-ac9702c2-f086-4648-8db2-3a060a485aa4, portal: 192.168.50.100,3260] successful.
May 28 02:05:27.419469 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:05:27.434790 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cc444e2-c821-4786-b7d7-296bd945d4d4/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:05:27.452097 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a977513-72e1-4832-a097-6314026acdfe tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:05:27.453147 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-4a977513-72e1-4832-a097-6314026acdfe tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:05:27.453420 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a977513-72e1-4832-a097-6314026acdfe tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] <== disconnect_volume: return (367ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:05:27.453714 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a977513-72e1-4832-a097-6314026acdfe tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:05:27.550227 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cc444e2-c821-4786-b7d7-296bd945d4d4/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:05:27.550227 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cc444e2-c821-4786-b7d7-296bd945d4d4/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:05:27.593468 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b4de6dad-b1ee-438e-98f4-c6f2ef4ebcfb req-41578b1c-2ddc-43ed-af3c-a08d478bda5e service nova] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Received event network-vif-plugged-ae352d09-61f5-40a7-b8f2-5f7c2daab5c5 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:05:27.594985 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b4de6dad-b1ee-438e-98f4-c6f2ef4ebcfb req-41578b1c-2ddc-43ed-af3c-a08d478bda5e service nova] Acquiring lock "0cc444e2-c821-4786-b7d7-296bd945d4d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:05:27.596318 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b4de6dad-b1ee-438e-98f4-c6f2ef4ebcfb req-41578b1c-2ddc-43ed-af3c-a08d478bda5e service nova] Lock "0cc444e2-c821-4786-b7d7-296bd945d4d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:05:27.596318 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b4de6dad-b1ee-438e-98f4-c6f2ef4ebcfb req-41578b1c-2ddc-43ed-af3c-a08d478bda5e service nova] Lock "0cc444e2-c821-4786-b7d7-296bd945d4d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:05:27.596550 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b4de6dad-b1ee-438e-98f4-c6f2ef4ebcfb req-41578b1c-2ddc-43ed-af3c-a08d478bda5e service nova] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Processing event network-vif-plugged-ae352d09-61f5-40a7-b8f2-5f7c2daab5c5 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 02:05:27.664560 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:27.668851 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cc444e2-c821-4786-b7d7-296bd945d4d4/disk --force-share --output=json" returned: 0 in 0.121s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:05:27.677009 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d774e3-96a1-4dd4-8953-062105d5f0b2/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:05:27.692227 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:27.704576 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:27.790353 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d774e3-96a1-4dd4-8953-062105d5f0b2/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:05:27.792005 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d774e3-96a1-4dd4-8953-062105d5f0b2/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:05:27.858874 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Booting with volume 9690511e-7a48-45cc-a85b-02cc0c6add68 at /dev/vda
May 28 02:05:27.892456 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d774e3-96a1-4dd4-8953-062105d5f0b2/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:05:27.898761 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7751bb1a-84b9-48ce-81da-b3a41d63eadc/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:05:27.930577 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:05:27.943506 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 02:05:27.972949 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:05:28.008761 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7751bb1a-84b9-48ce-81da-b3a41d63eadc/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:05:28.010169 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7751bb1a-84b9-48ce-81da-b3a41d63eadc/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:05:28.045562 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 02:05:28.046256 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 02:05:28.057621 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-4a977513-72e1-4832-a097-6314026acdfe tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lazy-loading 'flavor' on Instance uuid 7751bb1a-84b9-48ce-81da-b3a41d63eadc {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:05:28.061774 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 02:05:28.063529 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fee6:d69e', 'fe80::f881:28ff:fef8:dbfc', 'fe80::fc16:3eff:fea5:6255', 'fe80::34e0:eeff:fee2:bede', 'fe80::fc16:3eff:feff:6cb9', 'fe80::501c:3bff:feff:e2e6', 'fe80::fc16:3eff:fe46:8469', 'fe80::d05a:66ff:fe6d:1718'] 
May 28 02:05:28.064508 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 02:05:28.064939 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 02:05:28.065673 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:05:28.066061 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Updating existing volume attachment record: e00a7587-82a8-44c9-85da-feb688a37520 {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 02:05:28.123967 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7751bb1a-84b9-48ce-81da-b3a41d63eadc/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:05:28.132215 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 02:05:28.139441 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:05:28.140635 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:05:28.203595 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.062s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:05:28.204095 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Hypervisor/Node resource view: name=np0000001583 free_ram=12843MB free_disk=72.8848648071289GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 02:05:28.204298 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:05:28.204611 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:05:28.280446 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Successfully updated port: 84cef5f8-6465-4a29-b1e5-a96f8cd4145b {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 02:05:28.378101 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 02:05:28.378743 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933928.3782566, 0cc444e2-c821-4786-b7d7-296bd945d4d4 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:05:28.378938 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] VM Started (Lifecycle Event)
May 28 02:05:28.388349 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 02:05:28.394054 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Instance spawned successfully.
May 28 02:05:28.394474 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 02:05:28.451202 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:28.651358 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:28.783724 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Acquiring lock "refresh_cache-a2a2bf8a-242c-4f60-b772-5052084fee50" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:05:28.783724 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Acquired lock "refresh_cache-a2a2bf8a-242c-4f60-b772-5052084fee50" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:05:28.783724 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:05:28.881645 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:05:28.887329 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:05:28.902013 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:05:28.905102 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:05:28.905102 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:05:28.905102 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:05:28.905102 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:05:28.905102 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:05:29.080316 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4a977513-72e1-4832-a097-6314026acdfe tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "7751bb1a-84b9-48ce-81da-b3a41d63eadc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.311s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:05:29.293917 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:29.299249 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 7751bb1a-84b9-48ce-81da-b3a41d63eadc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:05:29.299508 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance d81ea788-4a10-41c8-a695-8dc5ac2c5701 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:05:29.299508 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 19d774e3-96a1-4dd4-8953-062105d5f0b2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:05:29.299606 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 0cc444e2-c821-4786-b7d7-296bd945d4d4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:05:29.299657 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance a2a2bf8a-242c-4f60-b772-5052084fee50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:05:29.299941 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 02:05:29.300002 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Final resource view: name=np0000001583 phys_ram=24030MB used_ram=1472MB phys_disk=95GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:05:28 up 41 min,  2 users,  load average: 6.40, 6.97, 5.09\n', 'num_instances': '5', 'num_vm_active': '3', 'num_task_None': '3', 'num_os_type_None': '5', 'num_proj_d9663116fe18428d8e37dea7b30d8b5a': '1', 'io_workload': '2', 'num_proj_432aa1094ced436494def17a875aa8e1': '1', 'num_proj_d772abe23aca4eb5b0e7b107c859c20b': '1', 'num_vm_building': '2', 'num_task_spawning': '1', 'num_proj_d192b18567fd4735988dd19da06fb868': '1', 'num_task_block_device_mapping': '1', 'num_proj_c478b25f90f24714a03a0be223706df3': '1'} {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 02:05:29.389325 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 02:05:29.389618 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933929.3894083, 0cc444e2-c821-4786-b7d7-296bd945d4d4 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:05:29.389776 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] VM Paused (Lifecycle Event)
May 28 02:05:29.406330 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:05:29.409050 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Took 7.59 seconds to spawn the instance on the hypervisor.
May 28 02:05:29.409266 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:05:29.650933 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:05:29.677566 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-fd41f51b-af72-4440-8023-604db1d55598 req-7653d4ff-5614-43e0-a7d0-55cdaf2c1a06 service nova] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Received event network-vif-plugged-ae352d09-61f5-40a7-b8f2-5f7c2daab5c5 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:05:29.677566 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-fd41f51b-af72-4440-8023-604db1d55598 req-7653d4ff-5614-43e0-a7d0-55cdaf2c1a06 service nova] Acquiring lock "0cc444e2-c821-4786-b7d7-296bd945d4d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:05:29.677773 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-fd41f51b-af72-4440-8023-604db1d55598 req-7653d4ff-5614-43e0-a7d0-55cdaf2c1a06 service nova] Lock "0cc444e2-c821-4786-b7d7-296bd945d4d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:05:29.679049 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-fd41f51b-af72-4440-8023-604db1d55598 req-7653d4ff-5614-43e0-a7d0-55cdaf2c1a06 service nova] Lock "0cc444e2-c821-4786-b7d7-296bd945d4d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:05:29.679049 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-fd41f51b-af72-4440-8023-604db1d55598 req-7653d4ff-5614-43e0-a7d0-55cdaf2c1a06 service nova] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] No waiting events found dispatching network-vif-plugged-ae352d09-61f5-40a7-b8f2-5f7c2daab5c5 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:05:29.680484 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-fd41f51b-af72-4440-8023-604db1d55598 req-7653d4ff-5614-43e0-a7d0-55cdaf2c1a06 service nova] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Received unexpected event network-vif-plugged-ae352d09-61f5-40a7-b8f2-5f7c2daab5c5 for instance with vm_state active and task_state None.
May 28 02:05:29.680564 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-fd41f51b-af72-4440-8023-604db1d55598 req-7653d4ff-5614-43e0-a7d0-55cdaf2c1a06 service nova] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Received event network-changed-84cef5f8-6465-4a29-b1e5-a96f8cd4145b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:05:29.680771 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-fd41f51b-af72-4440-8023-604db1d55598 req-7653d4ff-5614-43e0-a7d0-55cdaf2c1a06 service nova] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Refreshing instance network info cache due to event network-changed-84cef5f8-6465-4a29-b1e5-a96f8cd4145b. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:05:29.681186 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-fd41f51b-af72-4440-8023-604db1d55598 req-7653d4ff-5614-43e0-a7d0-55cdaf2c1a06 service nova] Acquiring lock "refresh_cache-a2a2bf8a-242c-4f60-b772-5052084fee50" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:05:29.710232 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:05:29.710588 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:05:29.892680 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:05:29.895762 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933929.8954425, 0cc444e2-c821-4786-b7d7-296bd945d4d4 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:05:29.896005 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] VM Resumed (Lifecycle Event)
May 28 02:05:29.902877 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Updating instance_info_cache with network_info: [{"id": "84cef5f8-6465-4a29-b1e5-a96f8cd4145b", "address": "fa:16:3e:30:43:2f", "network": {"id": "d2e4884a-fbbb-43bb-8732-ef3a2aa18b0a", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1578138919-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c478b25f90f24714a03a0be223706df3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84cef5f8-64", "ovs_interfaceid": "84cef5f8-6465-4a29-b1e5-a96f8cd4145b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:05:29.930183 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Took 12.96 seconds to build instance.
May 28 02:05:30.094217 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "d81ea788-4a10-41c8-a695-8dc5ac2c5701" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:05:30.094482 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "d81ea788-4a10-41c8-a695-8dc5ac2c5701" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:05:30.094725 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "d81ea788-4a10-41c8-a695-8dc5ac2c5701-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:05:30.094881 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "d81ea788-4a10-41c8-a695-8dc5ac2c5701-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:05:30.094969 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "d81ea788-4a10-41c8-a695-8dc5ac2c5701-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:05:30.103128 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Terminating instance
May 28 02:05:30.213983 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 02:05:30.216471 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:05:30.222276 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 02:05:30.222276 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Creating image(s)
May 28 02:05:30.222659 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Did not create local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 02:05:30.222834 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Ensure instance console log exists: /opt/stack/data/nova/instances/a2a2bf8a-242c-4f60-b772-5052084fee50/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 02:05:30.223388 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:05:30.223437 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:05:30.223846 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:05:30.399015 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:05:30.402901 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:05:30.406184 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Releasing lock "refresh_cache-a2a2bf8a-242c-4f60-b772-5052084fee50" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:05:30.406512 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Instance network_info: |[{"id": "84cef5f8-6465-4a29-b1e5-a96f8cd4145b", "address": "fa:16:3e:30:43:2f", "network": {"id": "d2e4884a-fbbb-43bb-8732-ef3a2aa18b0a", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1578138919-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c478b25f90f24714a03a0be223706df3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84cef5f8-64", "ovs_interfaceid": "84cef5f8-6465-4a29-b1e5-a96f8cd4145b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 02:05:30.408101 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-fd41f51b-af72-4440-8023-604db1d55598 req-7653d4ff-5614-43e0-a7d0-55cdaf2c1a06 service nova] Acquired lock "refresh_cache-a2a2bf8a-242c-4f60-b772-5052084fee50" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:05:30.408101 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-fd41f51b-af72-4440-8023-604db1d55598 req-7653d4ff-5614-43e0-a7d0-55cdaf2c1a06 service nova] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Refreshing network info cache for port 84cef5f8-6465-4a29-b1e5-a96f8cd4145b {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:05:30.410635 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Start _get_guest_xml network_info=[{"id": "84cef5f8-6465-4a29-b1e5-a96f8cd4145b", "address": "fa:16:3e:30:43:2f", "network": {"id": "d2e4884a-fbbb-43bb-8732-ef3a2aa18b0a", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1578138919-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c478b25f90f24714a03a0be223706df3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84cef5f8-64", "ovs_interfaceid": "84cef5f8-6465-4a29-b1e5-a96f8cd4145b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68', 'iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9690511e-7a48-45cc-a85b-02cc0c6add68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'a2a2bf8a-242c-4f60-b772-5052084fee50', 'attached_at': '', 'detached_at': '', 'volume_id': '9690511e-7a48-45cc-a85b-02cc0c6add68', 'serial': '9690511e-7a48-45cc-a85b-02cc0c6add68'}, 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'e00a7587-82a8-44c9-85da-feb688a37520', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 02:05:30.416162 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:05:30.417794 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBackupRestore-server-835127379', uuid='a2a2bf8a-242c-4f60-b772-5052084fee50'), owner=OwnerMeta(userid='e77dd271ad8b4d07891b96412807ec50', username='tempest-TestVolumeBackupRestore-709519274-project-member', projectid='c478b25f90f24714a03a0be223706df3', projectname='tempest-TestVolumeBackupRestore-709519274'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "84cef5f8-6465-4a29-b1e5-a96f8cd4145b", "address": "fa:16:3e:30:43:2f", "network": {"id": "d2e4884a-fbbb-43bb-8732-ef3a2aa18b0a", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1578138919-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c478b25f90f24714a03a0be223706df3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84cef5f8-64", "ovs_interfaceid": "84cef5f8-6465-4a29-b1e5-a96f8cd4145b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933930.4174404) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 02:05:30.422755 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 02:05:30.423110 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 02:05:30.424037 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 02:05:30.425111 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 02:05:30.426934 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 02:05:30.427297 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 02:05:30.427450 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 02:05:30.427567 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 02:05:30.427686 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 02:05:30.427774 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 02:05:30.427870 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 02:05:30.428043 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 02:05:30.428166 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 02:05:30.428335 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 02:05:30.428778 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 02:05:30.428778 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 02:05:30.436595 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f1530482-1997-40f9-ba70-8a577442fda1 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "0cc444e2-c821-4786-b7d7-296bd945d4d4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.480s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:05:30.443520 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 02:05:30.443828 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68', 'iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9690511e-7a48-45cc-a85b-02cc0c6add68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:05:30.444012 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:05:30.444731 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:05:30.444956 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68', 'iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9690511e-7a48-45cc-a85b-02cc0c6add68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 02:05:30.461062 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:05:30.461762 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:05:30.462317 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:05:30.462548 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:05:30.463053 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:05:30.463401 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:05:30.477165 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:05:30.477165 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:05:30.484271 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:05:30.484271 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:05:30.497121 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68] added
May 28 02:05:30.497121 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:05:30.497121 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:05:30.497121 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:05:30.497121 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:05:30.497121 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:05:30.497121 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:05:30.497121 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:05:30.497470 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0347(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:05:30.500098 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:05:30.500098 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68] added
May 28 02:05:30.500098 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:05:30.500098 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:05:30.500098 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:05:30.500098 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:05:30.500098 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:05:30.500098 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:05:30.500098 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:05:30.500098 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0361(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:05:30.500098 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:05:30.589104 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:30.613058 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 02:05:30.633508 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:30.658993 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:30.662960 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:30.688600 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:30.689855 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:30.722889 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Compute_service record updated for np0000001583:np0000001583 {{(pid=98241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 02:05:30.723130 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.518s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:05:30.723505 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:05:30.911967 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-fd41f51b-af72-4440-8023-604db1d55598 req-7653d4ff-5614-43e0-a7d0-55cdaf2c1a06 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:05:30.933344 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:30.946163 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:30.958780 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999702634000187 future=<Future at 0x7724ec47a4b0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:05:30.959778 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.99868066099998 future=<Future at 0x7724ec47a4b0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:05:30.960097 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.998405978000392 future=<Future at 0x7724ec47a4b0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:05:30.971750 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Instance destroyed successfully.
May 28 02:05:30.973809 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lazy-loading 'resources' on Instance uuid d81ea788-4a10-41c8-a695-8dc5ac2c5701 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:05:31.332632 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a23b6ee4-7032-470c-919b-818e43a88bbb req-200fed82-42e3-4cbd-8ff4-dac9a407b21f service nova] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Received event network-changed-ae352d09-61f5-40a7-b8f2-5f7c2daab5c5 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:05:31.333648 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a23b6ee4-7032-470c-919b-818e43a88bbb req-200fed82-42e3-4cbd-8ff4-dac9a407b21f service nova] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Refreshing instance network info cache due to event network-changed-ae352d09-61f5-40a7-b8f2-5f7c2daab5c5. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:05:31.333904 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a23b6ee4-7032-470c-919b-818e43a88bbb req-200fed82-42e3-4cbd-8ff4-dac9a407b21f service nova] Acquiring lock "refresh_cache-0cc444e2-c821-4786-b7d7-296bd945d4d4" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:05:31.333904 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a23b6ee4-7032-470c-919b-818e43a88bbb req-200fed82-42e3-4cbd-8ff4-dac9a407b21f service nova] Acquired lock "refresh_cache-0cc444e2-c821-4786-b7d7-296bd945d4d4" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:05:31.334014 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-a23b6ee4-7032-470c-919b-818e43a88bbb req-200fed82-42e3-4cbd-8ff4-dac9a407b21f service nova] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Refreshing network info cache for port ae352d09-61f5-40a7-b8f2-5f7c2daab5c5 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:05:31.347885 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-fd41f51b-af72-4440-8023-604db1d55598 req-7653d4ff-5614-43e0-a7d0-55cdaf2c1a06 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:05:31.476349 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T02:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1246212049',display_name='tempest-TestVolumeBootPattern-server-1246212049',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testvolumebootpattern-server-1246212049',id=57,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwh6E4i05I/O8lsE0bUEzocgUz6EHWmEWnV87akBvJyUZCaSgScF6CqBqpI/yb99Eh4gFmhgnyBDUzlF9t565ox0untLBipqeePS0CqQE7tD/Pd6ddczsNL4V+3d8XsQw==',key_name='tempest-TestVolumeBootPattern-1374779836',keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:04:49Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='432aa1094ced436494def17a875aa8e1',ramdisk_id='',reservation_id='r-em6a8l7s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1031057169',owner_user_name='tempest-TestVolumeBootPattern-1031057169-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T02:04:49Z,user_data=None,user_id='6be314b4eed642c3b2c72fe115860220',uuid=d81ea788-4a10-41c8-a695-8dc5ac2c5701,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "203448a3-3550-4972-8c14-146165af89d2", "address": "fa:16:3e:a5:62:55", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap203448a3-35", "ovs_interfaceid": "203448a3-3550-4972-8c14-146165af89d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:05:31.476575 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converting VIF {"id": "203448a3-3550-4972-8c14-146165af89d2", "address": "fa:16:3e:a5:62:55", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap203448a3-35", "ovs_interfaceid": "203448a3-3550-4972-8c14-146165af89d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:05:31.477327 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:62:55,bridge_name='br-int',has_traffic_filtering=True,id=203448a3-3550-4972-8c14-146165af89d2,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap203448a3-35') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:05:31.477600 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:62:55,bridge_name='br-int',has_traffic_filtering=True,id=203448a3-3550-4972-8c14-146165af89d2,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap203448a3-35') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:05:31.479058 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:31.479282 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap203448a3-35, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:05:31.482973 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:05:31.483648 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:31.483935 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c371ca69-6f25-4374-9ecf-ac5413fd1848) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:05:31.485158 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:05:31.485967 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:31.488847 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-fd41f51b-af72-4440-8023-604db1d55598 req-7653d4ff-5614-43e0-a7d0-55cdaf2c1a06 service nova] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Updated VIF entry in instance network info cache for port 84cef5f8-6465-4a29-b1e5-a96f8cd4145b. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:05:31.489344 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-fd41f51b-af72-4440-8023-604db1d55598 req-7653d4ff-5614-43e0-a7d0-55cdaf2c1a06 service nova] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Updating instance_info_cache with network_info: [{"id": "84cef5f8-6465-4a29-b1e5-a96f8cd4145b", "address": "fa:16:3e:30:43:2f", "network": {"id": "d2e4884a-fbbb-43bb-8732-ef3a2aa18b0a", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1578138919-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c478b25f90f24714a03a0be223706df3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84cef5f8-64", "ovs_interfaceid": "84cef5f8-6465-4a29-b1e5-a96f8cd4145b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:05:31.491328 np0000001583 nova-compute[98241]: INFO os_vif [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:62:55,bridge_name='br-int',has_traffic_filtering=True,id=203448a3-3550-4972-8c14-146165af89d2,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap203448a3-35')
May 28 02:05:31.493657 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:05:31.493995 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa', 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '873f9b75-1314-4acd-9c69-c4ae877916aa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:05:31.494109 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:05:31.499147 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:05:31.499980 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:05:31.516264 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:05:31.516264 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:05:31.527109 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:05:31.527109 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:05:31.536255 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:05:31.542506 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:05:31.550783 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:05:31.550783 np0000001583 nova-compute[98241]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:05:31.550783 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:05:31.551068 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] iscsi session list stdout=tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:05:31.551068 np0000001583 nova-compute[98241]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:05:31.551068 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:05:31.560117 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:05:31.560117 np0000001583 nova-compute[98241]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:05:31.560117 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:05:31.560117 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] iscsi session list stdout=tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:05:31.560117 np0000001583 nova-compute[98241]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:05:31.560117 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:05:31.599100 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68, portal: 192.168.40.100,3260]
May 28 02:05:31.599100 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68, portal: 192.168.40.100,3260] successful.
May 28 02:05:31.599100 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:05:31.599100 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68, portal: 192.168.50.100,3260]
May 28 02:05:31.599100 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68, portal: 192.168.50.100,3260] successful.
May 28 02:05:31.599100 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:05:31.614288 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:05:31.619017 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:05:31.630667 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:05:31.630667 np0000001583 nova-compute[98241]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:05:31.630667 np0000001583 nova-compute[98241]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:05:31.630667 np0000001583 nova-compute[98241]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:05:31.630667 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:05:31.630866 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] iscsi session list stdout=tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:05:31.630866 np0000001583 nova-compute[98241]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:05:31.630866 np0000001583 nova-compute[98241]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:05:31.630866 np0000001583 nova-compute[98241]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:05:31.630866 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:05:31.631257 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.168s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:05:31.632533 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:05:31.634272 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] HCTL ('8', '-', '-', 0) found on session 138 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:05:31.634453 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:05:31.639537 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:05:31.639537 np0000001583 nova-compute[98241]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:05:31.639537 np0000001583 nova-compute[98241]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:05:31.639537 np0000001583 nova-compute[98241]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:05:31.639537 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:05:31.639697 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] iscsi session list stdout=tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:05:31.639697 np0000001583 nova-compute[98241]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:05:31.639697 np0000001583 nova-compute[98241]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:05:31.639697 np0000001583 nova-compute[98241]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:05:31.639697 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:05:31.639965 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.178s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:05:31.640170 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:05:31.640775 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] HCTL ('7', '-', '-', 0) found on session 137 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:05:31.640918 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:05:31.652499 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Searching for a device in session 138 and hctl ['8', '*', '*', 0] yield: sdb {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:05:31.652499 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9690511e-7a48-45cc-a85b-02cc0c6add68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:05:31.660087 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Searching for a device in session 137 and hctl ['7', '*', '*', 0] yield: sdc {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:05:31.660087 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9690511e-7a48-45cc-a85b-02cc0c6add68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:05:31.726513 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:05:31.727302 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:05:31.727590 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:05:31.727819 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:05:31.727964 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 02:05:31.728253 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 48.46 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:05:31.837945 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-a23b6ee4-7032-470c-919b-818e43a88bbb req-200fed82-42e3-4cbd-8ff4-dac9a407b21f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:05:31.996643 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-fd41f51b-af72-4440-8023-604db1d55598 req-7653d4ff-5614-43e0-a7d0-55cdaf2c1a06 service nova] Releasing lock "refresh_cache-a2a2bf8a-242c-4f60-b772-5052084fee50" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:05:32.193391 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-a23b6ee4-7032-470c-919b-818e43a88bbb req-200fed82-42e3-4cbd-8ff4-dac9a407b21f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:05:32.354595 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-a23b6ee4-7032-470c-919b-818e43a88bbb req-200fed82-42e3-4cbd-8ff4-dac9a407b21f service nova] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Updated VIF entry in instance network info cache for port ae352d09-61f5-40a7-b8f2-5f7c2daab5c5. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:05:32.354903 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-a23b6ee4-7032-470c-919b-818e43a88bbb req-200fed82-42e3-4cbd-8ff4-dac9a407b21f service nova] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Updating instance_info_cache with network_info: [{"id": "ae352d09-61f5-40a7-b8f2-5f7c2daab5c5", "address": "fa:16:3e:46:84:69", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae352d09-61", "ovs_interfaceid": "ae352d09-61f5-40a7-b8f2-5f7c2daab5c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:05:32.463184 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 02:05:32.594910 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3aadd4a8-e085-4fda-8e49-bbae19f80f11 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:05:32.857790 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a23b6ee4-7032-470c-919b-818e43a88bbb req-200fed82-42e3-4cbd-8ff4-dac9a407b21f service nova] Releasing lock "refresh_cache-0cc444e2-c821-4786-b7d7-296bd945d4d4" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:05:33.103156 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-3aadd4a8-e085-4fda-8e49-bbae19f80f11 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] instance snapshotting
May 28 02:05:33.193385 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-3aadd4a8-e085-4fda-8e49-bbae19f80f11 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Beginning live snapshot process
May 28 02:05:33.449465 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:33.480734 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Found WWN 330000000d2a13dc6 for multipath device dm-0 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 02:05:33.481048 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:05:33.481800 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] <== connect_volume: return (3038ms) {'type': 'block', 'scsi_wwn': '330000000d2a13dc6', 'path': '/dev/dm-0', 'multipath_id': '330000000d2a13dc6'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:05:33.482108 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d2a13dc6', 'path': '/dev/dm-0', 'multipath_id': '330000000d2a13dc6'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 02:05:33.483570 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.988s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:05:33.484057 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa', 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '873f9b75-1314-4acd-9c69-c4ae877916aa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:05:33.484455 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:05:33.520558 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:05:33.520558 np0000001583 nova-compute[98241]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:05:33.520558 np0000001583 nova-compute[98241]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:05:33.520558 np0000001583 nova-compute[98241]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:05:33.520558 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:05:33.520558 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:05:33.520558 np0000001583 nova-compute[98241]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:05:33.520558 np0000001583 nova-compute[98241]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:05:33.520558 np0000001583 nova-compute[98241]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:05:33.520558 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:05:33.520558 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa', '131'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa', '132'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68', '137'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68', '138')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:05:33.521155 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa', '132')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:05:33.522944 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa', '131')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:05:33.523887 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f82abc40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa'): ({'sdd'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:05:33.525498 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Removing multipathed devices sdd, sde {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:05:33.525498 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Flush multipath device 3300000009e23c2de {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:05:33.547365 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:33.587746 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:05:33.648850 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:05:33.705832 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:05:33.706016 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:05:33.706804 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:05:33.727257 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:05:33.727257 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:05:33.739316 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:05:33.772574 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 132, target: iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa, portal: 192.168.40.100,3260]
May 28 02:05:33.772574 np0000001583 nova-compute[98241]: Logout of [sid: 132, target: iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa, portal: 192.168.40.100,3260] successful.
May 28 02:05:33.772574 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:05:33.789970 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:05:33.802380 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:05:33.846661 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 131, target: iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa, portal: 192.168.50.100,3260]
May 28 02:05:33.846661 np0000001583 nova-compute[98241]: Logout of [sid: 131, target: iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa, portal: 192.168.50.100,3260] successful.
May 28 02:05:33.846661 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:05:33.861253 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:05:33.861253 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:05:33.861451 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] <== disconnect_volume: return (2367ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:05:33.861451 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:05:33.861702 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Deleting instance files /opt/stack/data/nova/instances/d81ea788-4a10-41c8-a695-8dc5ac2c5701_del
May 28 02:05:33.862178 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Deletion of /opt/stack/data/nova/instances/d81ea788-4a10-41c8-a695-8dc5ac2c5701_del complete
May 28 02:05:34.005344 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:05:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBackupRestore-server-835127379',display_name='tempest-TestVolumeBackupRestore-server-835127379',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testvolumebackuprestore-server-835127379',id=61,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyMrgZSYjMUeiSq2hozyfOPWNuOo5jDAxNzkCPw4e0PbQX/K57qTuJS+06TIYpo0z53Oxv5it3o6cwsIotiO+EI4iinNCwA1+wdhy90dAj4gqIrxV4HIGr8GzUS2RX3DQ==',key_name='tempest-TestVolumeBackupRestore-10349980',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c478b25f90f24714a03a0be223706df3',ramdisk_id='',reservation_id='r-tt4u7ixi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBackupRestore-709519274',owner_user_name='tempest-TestVolumeBackupRestore-709519274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:05:27Z,user_data=None,user_id='e77dd271ad8b4d07891b96412807ec50',uuid=a2a2bf8a-242c-4f60-b772-5052084fee50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84cef5f8-6465-4a29-b1e5-a96f8cd4145b", "address": "fa:16:3e:30:43:2f", "network": {"id": "d2e4884a-fbbb-43bb-8732-ef3a2aa18b0a", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1578138919-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c478b25f90f24714a03a0be223706df3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84cef5f8-64", "ovs_interfaceid": "84cef5f8-6465-4a29-b1e5-a96f8cd4145b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 02:05:34.005581 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Converting VIF {"id": "84cef5f8-6465-4a29-b1e5-a96f8cd4145b", "address": "fa:16:3e:30:43:2f", "network": {"id": "d2e4884a-fbbb-43bb-8732-ef3a2aa18b0a", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1578138919-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c478b25f90f24714a03a0be223706df3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84cef5f8-64", "ovs_interfaceid": "84cef5f8-6465-4a29-b1e5-a96f8cd4145b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:05:34.006005 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:43:2f,bridge_name='br-int',has_traffic_filtering=True,id=84cef5f8-6465-4a29-b1e5-a96f8cd4145b,network=Network(d2e4884a-fbbb-43bb-8732-ef3a2aa18b0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84cef5f8-64') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:05:34.006487 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Lazy-loading 'pci_devices' on Instance uuid a2a2bf8a-242c-4f60-b772-5052084fee50 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:05:34.323310 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:05:34.369360 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Took 3.76 seconds to destroy the instance on the hypervisor.
May 28 02:05:34.370346 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 02:05:34.370651 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 02:05:34.370920 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 02:05:34.371221 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:05:34.485601 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:05:34.509501 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] End _get_guest_xml xml=<domain type="qemu">
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:   <uuid>a2a2bf8a-242c-4f60-b772-5052084fee50</uuid>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:   <name>instance-0000003d</name>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:   <metadata>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:       <nova:name>tempest-TestVolumeBackupRestore-server-835127379</nova:name>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 02:05:30</nova:creationTime>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:       <nova:image uuid="">
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:       </nova:image>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:         <nova:user uuid="e77dd271ad8b4d07891b96412807ec50">tempest-TestVolumeBackupRestore-709519274-project-member</nova:user>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:         <nova:project uuid="c478b25f90f24714a03a0be223706df3">tempest-TestVolumeBackupRestore-709519274</nova:project>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:       <nova:root type="volume" uuid=""/>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:         <nova:port uuid="84cef5f8-6465-4a29-b1e5-a96f8cd4145b">
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:         </nova:port>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:   </metadata>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:     <system>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:       <entry name="serial">a2a2bf8a-242c-4f60-b772-5052084fee50</entry>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:       <entry name="uuid">a2a2bf8a-242c-4f60-b772-5052084fee50</entry>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:     </system>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:   <os>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:   </os>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:   <features>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:     <acpi/>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:     <tcg>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:     </tcg>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:   </features>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:   </cpu>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:   <devices>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/a2a2bf8a-242c-4f60-b772-5052084fee50/disk.config"/>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:     </disk>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:     <disk type="block" device="disk">
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:       <alias name="ua-9690511e-7a48-45cc-a85b-02cc0c6add68"/>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:       <source dev="/dev/dm-0"/>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:       <serial>9690511e-7a48-45cc-a85b-02cc0c6add68</serial>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:     </disk>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:30:43:2f"/>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:       <target dev="tap84cef5f8-64"/>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:     </interface>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/a2a2bf8a-242c-4f60-b772-5052084fee50/console.log" append="off"/>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:     </serial>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:     <video>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:     </video>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:     </rng>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:     </memballoon>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:   </devices>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]: </domain>
May 28 02:05:34.509501 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 02:05:34.511927 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Preparing to wait for external event network-vif-plugged-84cef5f8-6465-4a29-b1e5-a96f8cd4145b {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 02:05:34.511927 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Acquiring lock "a2a2bf8a-242c-4f60-b772-5052084fee50-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:05:34.511927 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Lock "a2a2bf8a-242c-4f60-b772-5052084fee50-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:05:34.511927 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Lock "a2a2bf8a-242c-4f60-b772-5052084fee50-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:05:34.511927 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:05:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBackupRestore-server-835127379',display_name='tempest-TestVolumeBackupRestore-server-835127379',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testvolumebackuprestore-server-835127379',id=61,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyMrgZSYjMUeiSq2hozyfOPWNuOo5jDAxNzkCPw4e0PbQX/K57qTuJS+06TIYpo0z53Oxv5it3o6cwsIotiO+EI4iinNCwA1+wdhy90dAj4gqIrxV4HIGr8GzUS2RX3DQ==',key_name='tempest-TestVolumeBackupRestore-10349980',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c478b25f90f24714a03a0be223706df3',ramdisk_id='',reservation_id='r-tt4u7ixi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBackupRestore-709519274',owner_user_name='tempest-TestVolumeBackupRestore-709519274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:05:27Z,user_data=None,user_id='e77dd271ad8b4d07891b96412807ec50',uuid=a2a2bf8a-242c-4f60-b772-5052084fee50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84cef5f8-6465-4a29-b1e5-a96f8cd4145b", "address": "fa:16:3e:30:43:2f", "network": {"id": "d2e4884a-fbbb-43bb-8732-ef3a2aa18b0a", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1578138919-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c478b25f90f24714a03a0be223706df3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84cef5f8-64", "ovs_interfaceid": "84cef5f8-6465-4a29-b1e5-a96f8cd4145b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 02:05:34.511927 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Converting VIF {"id": "84cef5f8-6465-4a29-b1e5-a96f8cd4145b", "address": "fa:16:3e:30:43:2f", "network": {"id": "d2e4884a-fbbb-43bb-8732-ef3a2aa18b0a", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1578138919-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c478b25f90f24714a03a0be223706df3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84cef5f8-64", "ovs_interfaceid": "84cef5f8-6465-4a29-b1e5-a96f8cd4145b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:05:34.512350 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:43:2f,bridge_name='br-int',has_traffic_filtering=True,id=84cef5f8-6465-4a29-b1e5-a96f8cd4145b,network=Network(d2e4884a-fbbb-43bb-8732-ef3a2aa18b0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84cef5f8-64') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:05:34.512448 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:43:2f,bridge_name='br-int',has_traffic_filtering=True,id=84cef5f8-6465-4a29-b1e5-a96f8cd4145b,network=Network(d2e4884a-fbbb-43bb-8732-ef3a2aa18b0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84cef5f8-64') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 02:05:34.513439 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:34.513716 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:05:34.513903 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 02:05:34.514596 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:34.514790 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '52068db1-571c-51fc-a86a-63e757dc8eb5', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:05:34.521597 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:05:34.524440 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:34.524685 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84cef5f8-64, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:05:34.525125 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap84cef5f8-64, col_values=(('qos', UUID('193c84f9-2511-4209-a68b-d8a14f1a82c4')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:05:34.525331 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap84cef5f8-64, col_values=(('external_ids', {'iface-id': '84cef5f8-6465-4a29-b1e5-a96f8cd4145b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:43:2f', 'vm-uuid': 'a2a2bf8a-242c-4f60-b772-5052084fee50'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:05:34.528291 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:05:34.533492 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:34.535468 np0000001583 nova-compute[98241]: INFO os_vif [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:43:2f,bridge_name='br-int',has_traffic_filtering=True,id=84cef5f8-6465-4a29-b1e5-a96f8cd4145b,network=Network(d2e4884a-fbbb-43bb-8732-ef3a2aa18b0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84cef5f8-64')
May 28 02:05:34.711166 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3aadd4a8-e085-4fda-8e49-bbae19f80f11 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7751bb1a-84b9-48ce-81da-b3a41d63eadc/disk --force-share --output=json -f qcow2 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:05:34.802337 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3aadd4a8-e085-4fda-8e49-bbae19f80f11 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7751bb1a-84b9-48ce-81da-b3a41d63eadc/disk --force-share --output=json -f qcow2" returned: 0 in 0.090s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:05:34.802337 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3aadd4a8-e085-4fda-8e49-bbae19f80f11 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7751bb1a-84b9-48ce-81da-b3a41d63eadc/disk --force-share --output=json -f qcow2 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:05:34.896748 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3aadd4a8-e085-4fda-8e49-bbae19f80f11 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7751bb1a-84b9-48ce-81da-b3a41d63eadc/disk --force-share --output=json -f qcow2" returned: 0 in 0.094s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:05:34.898184 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-3aadd4a8-e085-4fda-8e49-bbae19f80f11 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:05:34.902271 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-3aadd4a8-e085-4fda-8e49-bbae19f80f11 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:05:34.902271 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3aadd4a8-e085-4fda-8e49-bbae19f80f11 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:05:35.002436 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3aadd4a8-e085-4fda-8e49-bbae19f80f11 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.100s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:05:35.006125 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3aadd4a8-e085-4fda-8e49-bbae19f80f11 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0j7ljhte/446a7a3fad314764b428464a9ce19871.delta 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:05:35.060188 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-6e3b7c21-48ff-4764-a0be-4d68490784dc req-decfb3b5-abff-4e30-aaba-c1626f2046a2 service nova] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Received event network-vif-deleted-203448a3-3550-4972-8c14-146165af89d2 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:05:35.062102 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-6e3b7c21-48ff-4764-a0be-4d68490784dc req-decfb3b5-abff-4e30-aaba-c1626f2046a2 service nova] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Neutron deleted interface 203448a3-3550-4972-8c14-146165af89d2; detaching it from the instance and deleting it from the info cache
May 28 02:05:35.066654 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3aadd4a8-e085-4fda-8e49-bbae19f80f11 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0j7ljhte/446a7a3fad314764b428464a9ce19871.delta 1073741824" returned: 0 in 0.060s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:05:35.067018 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-3aadd4a8-e085-4fda-8e49-bbae19f80f11 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Quiescing instance not available: QEMU guest agent is not enabled.
May 28 02:05:35.067949 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-6e3b7c21-48ff-4764-a0be-4d68490784dc req-decfb3b5-abff-4e30-aaba-c1626f2046a2 service nova] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Detach interface failed, port_id=203448a3-3550-4972-8c14-146165af89d2, reason: Instance d81ea788-4a10-41c8-a695-8dc5ac2c5701 could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 02:05:35.268357 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:35.340446 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-3aadd4a8-e085-4fda-8e49-bbae19f80f11 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] COPY block job progress, current cursor: 0 final cursor: 76808192 {{(pid=98241) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 28 02:05:35.507008 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:05:35.843337 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-3aadd4a8-e085-4fda-8e49-bbae19f80f11 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] COPY block job progress, current cursor: 76808192 final cursor: 76808192 {{(pid=98241) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 28 02:05:35.845271 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-3aadd4a8-e085-4fda-8e49-bbae19f80f11 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Skipping quiescing instance: QEMU guest agent is not enabled.
May 28 02:05:35.885185 np0000001583 nova-compute[98241]: DEBUG nova.privsep.utils [None req-3aadd4a8-e085-4fda-8e49-bbae19f80f11 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98241) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 02:05:35.885442 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3aadd4a8-e085-4fda-8e49-bbae19f80f11 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0j7ljhte/446a7a3fad314764b428464a9ce19871.delta /opt/stack/data/nova/instances/snapshots/tmp0j7ljhte/446a7a3fad314764b428464a9ce19871 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:05:36.010429 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Took 1.64 seconds to deallocate network for instance.
May 28 02:05:36.066792 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:05:36.066792 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:05:36.066792 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] No VIF found with MAC fa:16:3e:30:43:2f, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:05:36.066792 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Using config drive
May 28 02:05:36.113974 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3aadd4a8-e085-4fda-8e49-bbae19f80f11 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0j7ljhte/446a7a3fad314764b428464a9ce19871.delta /opt/stack/data/nova/instances/snapshots/tmp0j7ljhte/446a7a3fad314764b428464a9ce19871" returned: 0 in 0.228s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:05:36.118606 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-3aadd4a8-e085-4fda-8e49-bbae19f80f11 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Snapshot extracted, beginning image upload
May 28 02:05:36.573125 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:05:36.591830 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Took 0.58 seconds to detach 1 volumes for instance.
May 28 02:05:36.723105 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Creating config drive at /opt/stack/data/nova/instances/a2a2bf8a-242c-4f60-b772-5052084fee50/disk.config
May 28 02:05:36.726763 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a2a2bf8a-242c-4f60-b772-5052084fee50/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxg95x35l {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:05:36.798227 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a2a2bf8a-242c-4f60-b772-5052084fee50/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxg95x35l" returned: 0 in 0.071s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:05:37.098688 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:05:37.098961 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:05:37.268535 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:37.310022 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:37.313357 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:37.425682 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:37.515964 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:05:37.516284 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:05:37.532188 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2332623b-8cb1-4d41-b65a-b097fd6e919e req-0c2c907c-f8aa-487f-ac75-3076b18ea49c service nova] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Received event network-vif-plugged-84cef5f8-6465-4a29-b1e5-a96f8cd4145b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:05:37.532188 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2332623b-8cb1-4d41-b65a-b097fd6e919e req-0c2c907c-f8aa-487f-ac75-3076b18ea49c service nova] Acquiring lock "a2a2bf8a-242c-4f60-b772-5052084fee50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:05:37.532982 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2332623b-8cb1-4d41-b65a-b097fd6e919e req-0c2c907c-f8aa-487f-ac75-3076b18ea49c service nova] Lock "a2a2bf8a-242c-4f60-b772-5052084fee50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:05:37.538229 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2332623b-8cb1-4d41-b65a-b097fd6e919e req-0c2c907c-f8aa-487f-ac75-3076b18ea49c service nova] Lock "a2a2bf8a-242c-4f60-b772-5052084fee50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:05:37.538229 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2332623b-8cb1-4d41-b65a-b097fd6e919e req-0c2c907c-f8aa-487f-ac75-3076b18ea49c service nova] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Processing event network-vif-plugged-84cef5f8-6465-4a29-b1e5-a96f8cd4145b {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 02:05:37.737605 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:37.742229 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:37.744410 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:37.768034 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:38.019507 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:05:38.198845 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933938.1974418, a2a2bf8a-242c-4f60-b772-5052084fee50 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:05:38.198845 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 02:05:38.198845 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] VM Started (Lifecycle Event)
May 28 02:05:38.205764 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 02:05:38.206956 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Instance spawned successfully.
May 28 02:05:38.206956 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 02:05:38.452766 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:38.529492 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.430s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:05:38.627437 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Deleted allocations for instance d81ea788-4a10-41c8-a695-8dc5ac2c5701
May 28 02:05:38.701642 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:05:38.704221 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:05:38.715999 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:05:38.716854 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:05:38.717239 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:05:38.717417 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:05:38.717654 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:05:38.717872 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:05:39.076367 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-3aadd4a8-e085-4fda-8e49-bbae19f80f11 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Snapshot image upload complete
May 28 02:05:39.076899 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-3aadd4a8-e085-4fda-8e49-bbae19f80f11 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Took 5.97 seconds to snapshot the instance on the hypervisor.
May 28 02:05:39.207176 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 02:05:39.207669 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933939.2073774, a2a2bf8a-242c-4f60-b772-5052084fee50 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:05:39.207873 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] VM Paused (Lifecycle Event)
May 28 02:05:39.222373 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Took 9.01 seconds to spawn the instance on the hypervisor.
May 28 02:05:39.222515 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:05:39.534931 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:39.602956 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d7723a59-2c1d-469b-802f-080a397abd7c req-aaef6524-263a-471d-b2b3-54f980730683 service nova] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Received event network-vif-plugged-84cef5f8-6465-4a29-b1e5-a96f8cd4145b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:05:39.603554 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d7723a59-2c1d-469b-802f-080a397abd7c req-aaef6524-263a-471d-b2b3-54f980730683 service nova] Acquiring lock "a2a2bf8a-242c-4f60-b772-5052084fee50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:05:39.603751 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d7723a59-2c1d-469b-802f-080a397abd7c req-aaef6524-263a-471d-b2b3-54f980730683 service nova] Lock "a2a2bf8a-242c-4f60-b772-5052084fee50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:05:39.603907 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d7723a59-2c1d-469b-802f-080a397abd7c req-aaef6524-263a-471d-b2b3-54f980730683 service nova] Lock "a2a2bf8a-242c-4f60-b772-5052084fee50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:05:39.604059 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d7723a59-2c1d-469b-802f-080a397abd7c req-aaef6524-263a-471d-b2b3-54f980730683 service nova] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] No waiting events found dispatching network-vif-plugged-84cef5f8-6465-4a29-b1e5-a96f8cd4145b {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:05:39.604264 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-d7723a59-2c1d-469b-802f-080a397abd7c req-aaef6524-263a-471d-b2b3-54f980730683 service nova] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Received unexpected event network-vif-plugged-84cef5f8-6465-4a29-b1e5-a96f8cd4145b for instance with vm_state active and task_state None.
May 28 02:05:39.640624 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e822a1ce-a5f3-4b96-bbd0-ed3850d7fb68 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "d81ea788-4a10-41c8-a695-8dc5ac2c5701" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.546s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:05:39.712303 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:05:39.714208 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933939.7140152, a2a2bf8a-242c-4f60-b772-5052084fee50 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:05:39.714349 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] VM Resumed (Lifecycle Event)
May 28 02:05:39.733175 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Took 16.36 seconds to build instance.
May 28 02:05:40.217009 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:05:40.221142 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:05:40.237298 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d428f3a3-35ea-44ad-a935-9c17864d0f51 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Lock "a2a2bf8a-242c-4f60-b772-5052084fee50" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.881s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:05:40.990468 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "39ea2f26-6a01-4d24-a2b3-d681e0b22d80" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:05:40.990675 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "39ea2f26-6a01-4d24-a2b3-d681e0b22d80" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:05:41.498417 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 02:05:41.627499 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Acquiring lock "0ce1d609-b3fe-4fb6-81ac-7a683c8f1992" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:05:41.627718 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "0ce1d609-b3fe-4fb6-81ac-7a683c8f1992" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:05:42.056154 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:05:42.056609 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:05:42.063808 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 02:05:42.064159 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Claim successful on node np0000001583
May 28 02:05:42.074674 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-344bbc16-b6b3-4098-a47c-bb43c6c16d12 req-6ecffda5-8b17-4920-9b48-b90f03b23300 service nova] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Received event network-changed-84cef5f8-6465-4a29-b1e5-a96f8cd4145b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:05:42.074853 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-344bbc16-b6b3-4098-a47c-bb43c6c16d12 req-6ecffda5-8b17-4920-9b48-b90f03b23300 service nova] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Refreshing instance network info cache due to event network-changed-84cef5f8-6465-4a29-b1e5-a96f8cd4145b. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:05:42.075141 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-344bbc16-b6b3-4098-a47c-bb43c6c16d12 req-6ecffda5-8b17-4920-9b48-b90f03b23300 service nova] Acquiring lock "refresh_cache-a2a2bf8a-242c-4f60-b772-5052084fee50" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:05:42.075288 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-344bbc16-b6b3-4098-a47c-bb43c6c16d12 req-6ecffda5-8b17-4920-9b48-b90f03b23300 service nova] Acquired lock "refresh_cache-a2a2bf8a-242c-4f60-b772-5052084fee50" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:05:42.075429 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-344bbc16-b6b3-4098-a47c-bb43c6c16d12 req-6ecffda5-8b17-4920-9b48-b90f03b23300 service nova] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Refreshing network info cache for port 84cef5f8-6465-4a29-b1e5-a96f8cd4145b {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:05:42.130233 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 02:05:42.577748 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-344bbc16-b6b3-4098-a47c-bb43c6c16d12 req-6ecffda5-8b17-4920-9b48-b90f03b23300 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:05:42.719535 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:05:42.755270 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d59e8549-d81d-4469-b16a-36adc94278c5 req-230e16f5-5437-4fdb-8637-8548386f5dc9 service nova] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Received event network-changed-84cef5f8-6465-4a29-b1e5-a96f8cd4145b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:05:42.755707 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d59e8549-d81d-4469-b16a-36adc94278c5 req-230e16f5-5437-4fdb-8637-8548386f5dc9 service nova] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Refreshing instance network info cache due to event network-changed-84cef5f8-6465-4a29-b1e5-a96f8cd4145b. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:05:42.755838 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d59e8549-d81d-4469-b16a-36adc94278c5 req-230e16f5-5437-4fdb-8637-8548386f5dc9 service nova] Acquiring lock "refresh_cache-a2a2bf8a-242c-4f60-b772-5052084fee50" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:05:42.908602 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-344bbc16-b6b3-4098-a47c-bb43c6c16d12 req-6ecffda5-8b17-4920-9b48-b90f03b23300 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:05:43.023712 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-344bbc16-b6b3-4098-a47c-bb43c6c16d12 req-6ecffda5-8b17-4920-9b48-b90f03b23300 service nova] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Updated VIF entry in instance network info cache for port 84cef5f8-6465-4a29-b1e5-a96f8cd4145b. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:05:43.023937 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-344bbc16-b6b3-4098-a47c-bb43c6c16d12 req-6ecffda5-8b17-4920-9b48-b90f03b23300 service nova] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Updating instance_info_cache with network_info: [{"id": "84cef5f8-6465-4a29-b1e5-a96f8cd4145b", "address": "fa:16:3e:30:43:2f", "network": {"id": "d2e4884a-fbbb-43bb-8732-ef3a2aa18b0a", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1578138919-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c478b25f90f24714a03a0be223706df3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84cef5f8-64", "ovs_interfaceid": "84cef5f8-6465-4a29-b1e5-a96f8cd4145b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:05:43.365455 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:05:43.365591 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:05:43.454709 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:43.526266 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-344bbc16-b6b3-4098-a47c-bb43c6c16d12 req-6ecffda5-8b17-4920-9b48-b90f03b23300 service nova] Releasing lock "refresh_cache-a2a2bf8a-242c-4f60-b772-5052084fee50" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:05:43.526266 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d59e8549-d81d-4469-b16a-36adc94278c5 req-230e16f5-5437-4fdb-8637-8548386f5dc9 service nova] Acquired lock "refresh_cache-a2a2bf8a-242c-4f60-b772-5052084fee50" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:05:43.526266 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-d59e8549-d81d-4469-b16a-36adc94278c5 req-230e16f5-5437-4fdb-8637-8548386f5dc9 service nova] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Refreshing network info cache for port 84cef5f8-6465-4a29-b1e5-a96f8cd4145b {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:05:43.868253 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:05:44.029476 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-d59e8549-d81d-4469-b16a-36adc94278c5 req-230e16f5-5437-4fdb-8637-8548386f5dc9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:05:44.305656 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-d59e8549-d81d-4469-b16a-36adc94278c5 req-230e16f5-5437-4fdb-8637-8548386f5dc9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:05:44.375518 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.319s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:05:44.375839 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 02:05:44.379350 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.660s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:05:44.382221 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 02:05:44.382357 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Claim successful on node np0000001583
May 28 02:05:44.497442 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-d59e8549-d81d-4469-b16a-36adc94278c5 req-230e16f5-5437-4fdb-8637-8548386f5dc9 service nova] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Updated VIF entry in instance network info cache for port 84cef5f8-6465-4a29-b1e5-a96f8cd4145b. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:05:44.497442 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-d59e8549-d81d-4469-b16a-36adc94278c5 req-230e16f5-5437-4fdb-8637-8548386f5dc9 service nova] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Updating instance_info_cache with network_info: [{"id": "84cef5f8-6465-4a29-b1e5-a96f8cd4145b", "address": "fa:16:3e:30:43:2f", "network": {"id": "d2e4884a-fbbb-43bb-8732-ef3a2aa18b0a", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1578138919-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c478b25f90f24714a03a0be223706df3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84cef5f8-64", "ovs_interfaceid": "84cef5f8-6465-4a29-b1e5-a96f8cd4145b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:05:44.536954 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:44.834481 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f71be689-4310-44e0-b937-ff3729977916 req-9afbfbf3-5e23-40f5-bf77-018cc17701ff service nova] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Received event network-changed-84cef5f8-6465-4a29-b1e5-a96f8cd4145b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:05:44.834961 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f71be689-4310-44e0-b937-ff3729977916 req-9afbfbf3-5e23-40f5-bf77-018cc17701ff service nova] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Refreshing instance network info cache due to event network-changed-84cef5f8-6465-4a29-b1e5-a96f8cd4145b. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:05:44.835349 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f71be689-4310-44e0-b937-ff3729977916 req-9afbfbf3-5e23-40f5-bf77-018cc17701ff service nova] Acquiring lock "refresh_cache-a2a2bf8a-242c-4f60-b772-5052084fee50" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:05:44.883309 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 02:05:44.883750 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 02:05:44.883750 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:05:44.883958 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:05:44.958971 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6be314b4eed642c3b2c72fe115860220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432aa1094ced436494def17a875aa8e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 02:05:45.000204 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d59e8549-d81d-4469-b16a-36adc94278c5 req-230e16f5-5437-4fdb-8637-8548386f5dc9 service nova] Releasing lock "refresh_cache-a2a2bf8a-242c-4f60-b772-5052084fee50" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:05:45.000204 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f71be689-4310-44e0-b937-ff3729977916 req-9afbfbf3-5e23-40f5-bf77-018cc17701ff service nova] Acquired lock "refresh_cache-a2a2bf8a-242c-4f60-b772-5052084fee50" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:05:45.000204 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-f71be689-4310-44e0-b937-ff3729977916 req-9afbfbf3-5e23-40f5-bf77-018cc17701ff service nova] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Refreshing network info cache for port 84cef5f8-6465-4a29-b1e5-a96f8cd4145b {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:05:45.387591 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 02:05:45.400812 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Successfully created port: 0479db3d-2d90-4116-b8e7-b1282c111d9b {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 02:05:45.502234 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-f71be689-4310-44e0-b937-ff3729977916 req-9afbfbf3-5e23-40f5-bf77-018cc17701ff service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:05:45.809737 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:05:45.810040 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:05:45.853956 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-f71be689-4310-44e0-b937-ff3729977916 req-9afbfbf3-5e23-40f5-bf77-018cc17701ff service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:05:45.890179 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Successfully updated port: 0479db3d-2d90-4116-b8e7-b1282c111d9b {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 02:05:45.891797 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 02:05:45.959777 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0013265389998196042 future=<Future at 0x7724ec47a4b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:05:45.960195 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Emitting event <LifecycleEvent: 1779933930.9583414, d81ea788-4a10-41c8-a695-8dc5ac2c5701 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:05:45.960366 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] VM Stopped (Lifecycle Event)
May 28 02:05:45.962130 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:05:46.044647 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-f71be689-4310-44e0-b937-ff3729977916 req-9afbfbf3-5e23-40f5-bf77-018cc17701ff service nova] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Updated VIF entry in instance network info cache for port 84cef5f8-6465-4a29-b1e5-a96f8cd4145b. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:05:46.044976 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-f71be689-4310-44e0-b937-ff3729977916 req-9afbfbf3-5e23-40f5-bf77-018cc17701ff service nova] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Updating instance_info_cache with network_info: [{"id": "84cef5f8-6465-4a29-b1e5-a96f8cd4145b", "address": "fa:16:3e:30:43:2f", "network": {"id": "d2e4884a-fbbb-43bb-8732-ef3a2aa18b0a", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1578138919-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c478b25f90f24714a03a0be223706df3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84cef5f8-64", "ovs_interfaceid": "84cef5f8-6465-4a29-b1e5-a96f8cd4145b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:05:46.315930 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:05:46.392508 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "refresh_cache-39ea2f26-6a01-4d24-a2b3-d681e0b22d80" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:05:46.392666 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquired lock "refresh_cache-39ea2f26-6a01-4d24-a2b3-d681e0b22d80" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:05:46.392849 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:05:46.400131 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Booting with volume 873f9b75-1314-4acd-9c69-c4ae877916aa at /dev/vda
May 28 02:05:46.442699 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:05:46.458535 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 02:05:46.463712 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-95499bf6-d097-4418-977b-13854473a38d tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: d81ea788-4a10-41c8-a695-8dc5ac2c5701] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:05:46.486108 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:05:46.544782 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 02:05:46.545795 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 02:05:46.550318 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f71be689-4310-44e0-b937-ff3729977916 req-9afbfbf3-5e23-40f5-bf77-018cc17701ff service nova] Releasing lock "refresh_cache-a2a2bf8a-242c-4f60-b772-5052084fee50" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:05:46.557108 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 02:05:46.557108 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fee6:d69e', 'fe80::f881:28ff:fef8:dbfc', 'fe80::fc16:3eff:feff:6cb9', 'fe80::501c:3bff:feff:e2e6', 'fe80::fc16:3eff:fe46:8469', 'fe80::d05a:66ff:fe6d:1718', 'fe80::fc16:3eff:fe30:432f', 'fe80::c3c:54ff:fe7c:1b9'] 
May 28 02:05:46.557108 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 02:05:46.557108 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 02:05:46.557108 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:05:46.557108 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Updating existing volume attachment record: f38d8f7a-3a9e-4d5f-a2ba-52cfb8fc3eeb {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 02:05:46.819951 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.441s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:05:46.820631 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 02:05:46.893311 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-eb691432-27e1-4f2c-b954-c2138a355e9e req-b5cf52fe-629e-4e2a-8da9-1b65f223430c service nova] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Received event network-changed-0479db3d-2d90-4116-b8e7-b1282c111d9b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:05:46.893311 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-eb691432-27e1-4f2c-b954-c2138a355e9e req-b5cf52fe-629e-4e2a-8da9-1b65f223430c service nova] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Refreshing instance network info cache due to event network-changed-0479db3d-2d90-4116-b8e7-b1282c111d9b. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:05:46.893311 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-eb691432-27e1-4f2c-b954-c2138a355e9e req-b5cf52fe-629e-4e2a-8da9-1b65f223430c service nova] Acquiring lock "refresh_cache-39ea2f26-6a01-4d24-a2b3-d681e0b22d80" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:05:46.976241 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:05:47.136135 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:05:47.326733 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 02:05:47.326934 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 02:05:47.327242 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:05:47.327473 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:05:47.336201 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Updating instance_info_cache with network_info: [{"id": "0479db3d-2d90-4116-b8e7-b1282c111d9b", "address": "fa:16:3e:9c:a6:6d", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0479db3d-2d", "ovs_interfaceid": "0479db3d-2d90-4116-b8e7-b1282c111d9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:05:47.396073 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'db5b8b66a90b4a2dba53c340347aff1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9663116fe18428d8e37dea7b30d8b5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 02:05:47.829412 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 02:05:47.838181 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Releasing lock "refresh_cache-39ea2f26-6a01-4d24-a2b3-d681e0b22d80" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:05:47.839015 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Instance network_info: |[{"id": "0479db3d-2d90-4116-b8e7-b1282c111d9b", "address": "fa:16:3e:9c:a6:6d", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0479db3d-2d", "ovs_interfaceid": "0479db3d-2d90-4116-b8e7-b1282c111d9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 02:05:47.839359 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-eb691432-27e1-4f2c-b954-c2138a355e9e req-b5cf52fe-629e-4e2a-8da9-1b65f223430c service nova] Acquired lock "refresh_cache-39ea2f26-6a01-4d24-a2b3-d681e0b22d80" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:05:47.839529 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-eb691432-27e1-4f2c-b954-c2138a355e9e req-b5cf52fe-629e-4e2a-8da9-1b65f223430c service nova] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Refreshing network info cache for port 0479db3d-2d90-4116-b8e7-b1282c111d9b {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:05:47.937900 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Successfully created port: 5a494f64-719c-4d87-af16-acf57733b3b9 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 02:05:48.334142 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 02:05:48.342541 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-eb691432-27e1-4f2c-b954-c2138a355e9e req-b5cf52fe-629e-4e2a-8da9-1b65f223430c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:05:48.457130 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:48.482398 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Successfully updated port: 5a494f64-719c-4d87-af16-acf57733b3b9 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 02:05:48.637037 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-eb691432-27e1-4f2c-b954-c2138a355e9e req-b5cf52fe-629e-4e2a-8da9-1b65f223430c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:05:48.667325 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 02:05:48.668234 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 02:05:48.668511 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Creating image(s)
May 28 02:05:48.668778 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Did not create local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 02:05:48.668908 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Ensure instance console log exists: /opt/stack/data/nova/instances/39ea2f26-6a01-4d24-a2b3-d681e0b22d80/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 02:05:48.669202 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:05:48.669415 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:05:48.669571 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:05:48.670024 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Start _get_guest_xml network_info=[{"id": "0479db3d-2d90-4116-b8e7-b1282c111d9b", "address": "fa:16:3e:9c:a6:6d", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0479db3d-2d", "ovs_interfaceid": "0479db3d-2d90-4116-b8e7-b1282c111d9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa', 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '873f9b75-1314-4acd-9c69-c4ae877916aa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '39ea2f26-6a01-4d24-a2b3-d681e0b22d80', 'attached_at': '', 'detached_at': '', 'volume_id': '873f9b75-1314-4acd-9c69-c4ae877916aa', 'serial': '873f9b75-1314-4acd-9c69-c4ae877916aa'}, 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'f38d8f7a-3a9e-4d5f-a2ba-52cfb8fc3eeb', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 02:05:48.673967 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:05:48.675154 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-801974265', uuid='39ea2f26-6a01-4d24-a2b3-d681e0b22d80'), owner=OwnerMeta(userid='6be314b4eed642c3b2c72fe115860220', username='tempest-TestVolumeBootPattern-1031057169-project-member', projectid='432aa1094ced436494def17a875aa8e1', projectname='tempest-TestVolumeBootPattern-1031057169'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0479db3d-2d90-4116-b8e7-b1282c111d9b", "address": "fa:16:3e:9c:a6:6d", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0479db3d-2d", "ovs_interfaceid": "0479db3d-2d90-4116-b8e7-b1282c111d9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933948.6747556) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 02:05:48.676367 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 02:05:48.676703 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 02:05:48.677686 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 02:05:48.677868 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 02:05:48.678704 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 02:05:48.679002 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 02:05:48.679204 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 02:05:48.679342 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 02:05:48.679484 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 02:05:48.679602 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 02:05:48.679740 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 02:05:48.679977 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 02:05:48.680088 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 02:05:48.680278 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 02:05:48.680397 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 02:05:48.680531 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 02:05:48.690825 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 02:05:48.691182 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa', 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '873f9b75-1314-4acd-9c69-c4ae877916aa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:05:48.691373 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:05:48.691830 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:05:48.692044 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa', 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '873f9b75-1314-4acd-9c69-c4ae877916aa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 02:05:48.704114 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:05:48.704687 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:05:48.705116 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:05:48.705306 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:05:48.705622 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:05:48.706001 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:05:48.716488 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:05:48.716488 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:05:48.721566 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:05:48.721566 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:05:48.728933 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa] added
May 28 02:05:48.728933 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:05:48.728933 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:05:48.728933 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:05:48.728933 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:05:48.728933 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:05:48.728933 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:05:48.729252 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:05:48.729252 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0234(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:05:48.729387 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:05:48.734014 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa] added
May 28 02:05:48.734014 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:05:48.734014 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:05:48.734014 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:05:48.734014 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:05:48.734014 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:05:48.734014 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:05:48.734281 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:05:48.734281 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0291(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:05:48.734372 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:05:48.758746 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-eb691432-27e1-4f2c-b954-c2138a355e9e req-b5cf52fe-629e-4e2a-8da9-1b65f223430c service nova] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Updated VIF entry in instance network info cache for port 0479db3d-2d90-4116-b8e7-b1282c111d9b. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:05:48.758967 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-eb691432-27e1-4f2c-b954-c2138a355e9e req-b5cf52fe-629e-4e2a-8da9-1b65f223430c service nova] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Updating instance_info_cache with network_info: [{"id": "0479db3d-2d90-4116-b8e7-b1282c111d9b", "address": "fa:16:3e:9c:a6:6d", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0479db3d-2d", "ovs_interfaceid": "0479db3d-2d90-4116-b8e7-b1282c111d9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:05:48.855743 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Acquiring lock "b369292d-fea0-46aa-b5c4-908b8bfb6209" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:05:48.855988 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "b369292d-fea0-46aa-b5c4-908b8bfb6209" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:05:48.951923 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-09fbacb7-919b-4f39-a60f-b63032090f9c req-66caa2bb-90e1-494c-804b-c7eec183d568 service nova] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Received event network-changed-5a494f64-719c-4d87-af16-acf57733b3b9 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:05:48.952692 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-09fbacb7-919b-4f39-a60f-b63032090f9c req-66caa2bb-90e1-494c-804b-c7eec183d568 service nova] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Refreshing instance network info cache due to event network-changed-5a494f64-719c-4d87-af16-acf57733b3b9. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:05:48.952840 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-09fbacb7-919b-4f39-a60f-b63032090f9c req-66caa2bb-90e1-494c-804b-c7eec183d568 service nova] Acquiring lock "refresh_cache-0ce1d609-b3fe-4fb6-81ac-7a683c8f1992" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:05:48.952925 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-09fbacb7-919b-4f39-a60f-b63032090f9c req-66caa2bb-90e1-494c-804b-c7eec183d568 service nova] Acquired lock "refresh_cache-0ce1d609-b3fe-4fb6-81ac-7a683c8f1992" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:05:48.953058 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-09fbacb7-919b-4f39-a60f-b63032090f9c req-66caa2bb-90e1-494c-804b-c7eec183d568 service nova] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Refreshing network info cache for port 5a494f64-719c-4d87-af16-acf57733b3b9 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:05:48.986327 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Acquiring lock "refresh_cache-0ce1d609-b3fe-4fb6-81ac-7a683c8f1992" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:05:49.261073 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-eb691432-27e1-4f2c-b954-c2138a355e9e req-b5cf52fe-629e-4e2a-8da9-1b65f223430c service nova] Releasing lock "refresh_cache-39ea2f26-6a01-4d24-a2b3-d681e0b22d80" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:05:49.346013 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 02:05:49.346809 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 02:05:49.347016 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Creating image(s)
May 28 02:05:49.347484 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ce1d609-b3fe-4fb6-81ac-7a683c8f1992/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:05:49.347606 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "/opt/stack/data/nova/instances/0ce1d609-b3fe-4fb6-81ac-7a683c8f1992/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:05:49.348011 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "/opt/stack/data/nova/instances/0ce1d609-b3fe-4fb6-81ac-7a683c8f1992/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:05:49.348372 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Acquiring lock "5ff04dfbf78a91fdd2fa92ad36c8b3d1c67b2990" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:05:49.348682 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "5ff04dfbf78a91fdd2fa92ad36c8b3d1c67b2990" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:05:49.358394 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 02:05:49.454973 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-09fbacb7-919b-4f39-a60f-b63032090f9c req-66caa2bb-90e1-494c-804b-c7eec183d568 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:05:49.532318 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-09fbacb7-919b-4f39-a60f-b63032090f9c req-66caa2bb-90e1-494c-804b-c7eec183d568 service nova] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:05:49.539288 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:49.731029 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:05:49.734943 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:05:49.753551 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:05:49.753551 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:05:49.758126 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-09fbacb7-919b-4f39-a60f-b63032090f9c req-66caa2bb-90e1-494c-804b-c7eec183d568 service nova] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:05:49.762895 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:05:49.762895 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:05:49.771201 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:05:49.778964 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:05:49.793154 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:05:49.793154 np0000001583 nova-compute[98241]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:05:49.793154 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:05:49.793624 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:05:49.793624 np0000001583 nova-compute[98241]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:05:49.793624 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:05:49.800540 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:05:49.800540 np0000001583 nova-compute[98241]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:05:49.800540 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:05:49.800765 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:05:49.800765 np0000001583 nova-compute[98241]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:05:49.800765 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:05:49.831428 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa, portal: 192.168.50.100,3260]
May 28 02:05:49.831428 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa, portal: 192.168.50.100,3260] successful.
May 28 02:05:49.831428 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:05:49.841878 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa, portal: 192.168.40.100,3260]
May 28 02:05:49.841878 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa, portal: 192.168.40.100,3260] successful.
May 28 02:05:49.841878 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:05:49.849175 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:05:49.859258 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:05:49.873069 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:05:49.873069 np0000001583 nova-compute[98241]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:05:49.873069 np0000001583 nova-compute[98241]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:05:49.873069 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:05:49.873069 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:05:49.873069 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:05:49.873069 np0000001583 nova-compute[98241]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:05:49.873069 np0000001583 nova-compute[98241]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:05:49.873069 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:05:49.873069 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:05:49.873069 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.167s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:05:49.873069 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:05:49.874527 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] HCTL ('9', '-', '-', 0) found on session 141 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:05:49.874726 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:05:49.882578 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:05:49.882578 np0000001583 nova-compute[98241]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:05:49.882578 np0000001583 nova-compute[98241]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:05:49.882578 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:05:49.882578 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:05:49.883010 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:05:49.883010 np0000001583 nova-compute[98241]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:05:49.883010 np0000001583 nova-compute[98241]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:05:49.883010 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:05:49.883010 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:05:49.883288 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.178s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:05:49.883390 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:05:49.884594 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] HCTL ('10', '-', '-', 0) found on session 142 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:05:49.884778 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:05:49.892748 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Searching for a device in session 141 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:05:49.892748 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '873f9b75-1314-4acd-9c69-c4ae877916aa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:05:49.906311 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Searching for a device in session 142 and hctl ['10', '*', '*', 0] yield: None {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:05:49.925969 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:05:49.926173 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:05:49.930162 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 02:05:49.930303 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Claim successful on node np0000001583
May 28 02:05:50.176104 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:05:50.178960 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:05:50.179357 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5ff04dfbf78a91fdd2fa92ad36c8b3d1c67b2990.part --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:05:50.261816 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-09fbacb7-919b-4f39-a60f-b63032090f9c req-66caa2bb-90e1-494c-804b-c7eec183d568 service nova] Releasing lock "refresh_cache-0ce1d609-b3fe-4fb6-81ac-7a683c8f1992" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:05:50.262621 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Acquired lock "refresh_cache-0ce1d609-b3fe-4fb6-81ac-7a683c8f1992" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:05:50.262861 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:05:50.271406 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5ff04dfbf78a91fdd2fa92ad36c8b3d1c67b2990.part --force-share --output=json" returned: 0 in 0.092s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:05:50.272043 np0000001583 nova-compute[98241]: DEBUG nova.virt.images [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] 2128c605-74b4-4566-878a-c29ca1ec7e50 was qcow2, converting to raw {{(pid=98241) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 02:05:50.272837 np0000001583 nova-compute[98241]: DEBUG nova.privsep.utils [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98241) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 02:05:50.273233 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5ff04dfbf78a91fdd2fa92ad36c8b3d1c67b2990.part /opt/stack/data/nova/instances/_base/5ff04dfbf78a91fdd2fa92ad36c8b3d1c67b2990.converted {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:05:50.420435 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5ff04dfbf78a91fdd2fa92ad36c8b3d1c67b2990.part /opt/stack/data/nova/instances/_base/5ff04dfbf78a91fdd2fa92ad36c8b3d1c67b2990.converted" returned: 0 in 0.147s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:05:50.431839 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5ff04dfbf78a91fdd2fa92ad36c8b3d1c67b2990.converted --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:05:50.533103 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5ff04dfbf78a91fdd2fa92ad36c8b3d1c67b2990.converted --force-share --output=json" returned: 0 in 0.101s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:05:50.533636 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "5ff04dfbf78a91fdd2fa92ad36c8b3d1c67b2990" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.185s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:05:50.534123 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:05:50.537486 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:05:50.538710 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5ff04dfbf78a91fdd2fa92ad36c8b3d1c67b2990 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:05:50.646517 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5ff04dfbf78a91fdd2fa92ad36c8b3d1c67b2990 --force-share --output=json" returned: 0 in 0.107s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:05:50.647045 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Acquiring lock "5ff04dfbf78a91fdd2fa92ad36c8b3d1c67b2990" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:05:50.647673 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "5ff04dfbf78a91fdd2fa92ad36c8b3d1c67b2990" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:05:50.648235 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:05:50.652148 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:05:50.652636 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5ff04dfbf78a91fdd2fa92ad36c8b3d1c67b2990 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:05:50.755280 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5ff04dfbf78a91fdd2fa92ad36c8b3d1c67b2990 --force-share --output=json" returned: 0 in 0.102s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:05:50.756802 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5ff04dfbf78a91fdd2fa92ad36c8b3d1c67b2990,backing_fmt=raw /opt/stack/data/nova/instances/0ce1d609-b3fe-4fb6-81ac-7a683c8f1992/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:05:50.815154 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5ff04dfbf78a91fdd2fa92ad36c8b3d1c67b2990,backing_fmt=raw /opt/stack/data/nova/instances/0ce1d609-b3fe-4fb6-81ac-7a683c8f1992/disk 1073741824" returned: 0 in 0.058s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:05:50.815627 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "5ff04dfbf78a91fdd2fa92ad36c8b3d1c67b2990" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.168s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:05:50.815971 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5ff04dfbf78a91fdd2fa92ad36c8b3d1c67b2990 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:05:50.843584 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:05:50.906412 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Searching for a device in session 142 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:05:50.906721 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '873f9b75-1314-4acd-9c69-c4ae877916aa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:05:50.920792 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5ff04dfbf78a91fdd2fa92ad36c8b3d1c67b2990 --force-share --output=json" returned: 0 in 0.105s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:05:50.921375 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 02:05:50.921580 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Ensure instance console log exists: /opt/stack/data/nova/instances/0ce1d609-b3fe-4fb6-81ac-7a683c8f1992/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 02:05:50.921878 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:05:50.922135 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:05:50.922292 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:05:51.024691 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:05:51.221915 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Updating instance_info_cache with network_info: [{"id": "5a494f64-719c-4d87-af16-acf57733b3b9", "address": "fa:16:3e:ed:a3:d2", "network": {"id": "4f6e8375-a959-44b0-9cab-ae7918680bf7", "bridge": "br-int", "label": "tempest-TestStampPattern-914776722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d9663116fe18428d8e37dea7b30d8b5a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a494f64-71", "ovs_interfaceid": "5a494f64-719c-4d87-af16-acf57733b3b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:05:51.414167 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:05:51.414504 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:05:51.724904 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Releasing lock "refresh_cache-0ce1d609-b3fe-4fb6-81ac-7a683c8f1992" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:05:51.725213 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Instance network_info: |[{"id": "5a494f64-719c-4d87-af16-acf57733b3b9", "address": "fa:16:3e:ed:a3:d2", "network": {"id": "4f6e8375-a959-44b0-9cab-ae7918680bf7", "bridge": "br-int", "label": "tempest-TestStampPattern-914776722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d9663116fe18428d8e37dea7b30d8b5a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a494f64-71", "ovs_interfaceid": "5a494f64-719c-4d87-af16-acf57733b3b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 02:05:51.727177 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Start _get_guest_xml network_info=[{"id": "5a494f64-719c-4d87-af16-acf57733b3b9", "address": "fa:16:3e:ed:a3:d2", "network": {"id": "4f6e8375-a959-44b0-9cab-ae7918680bf7", "bridge": "br-int", "label": "tempest-TestStampPattern-914776722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d9663116fe18428d8e37dea7b30d8b5a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a494f64-71", "ovs_interfaceid": "5a494f64-719c-4d87-af16-acf57733b3b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='d11ddb0feea9c81c03f48be565110cb8',container_format='bare',created_at=2026-05-28T02:05:31Z,direct_url=<?>,disk_format='qcow2',id=2128c605-74b4-4566-878a-c29ca1ec7e50,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1318199132',owner='d9663116fe18428d8e37dea7b30d8b5a',properties=ImageMetaProps,protected=<?>,size=53739520,status='active',tags=<?>,updated_at=2026-05-28T02:05:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '2128c605-74b4-4566-878a-c29ca1ec7e50'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 02:05:51.727915 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Found WWN 3300000009e23c2de for multipath device dm-1 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 02:05:51.728381 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:05:51.728758 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] <== connect_volume: return (3036ms) {'type': 'block', 'scsi_wwn': '3300000009e23c2de', 'path': '/dev/dm-1', 'multipath_id': '3300000009e23c2de'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:05:51.728980 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000009e23c2de', 'path': '/dev/dm-1', 'multipath_id': '3300000009e23c2de'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 02:05:51.732213 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:05:51.733478 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-TestStampPattern-server-554433487', uuid='0ce1d609-b3fe-4fb6-81ac-7a683c8f1992'), owner=OwnerMeta(userid='db5b8b66a90b4a2dba53c340347aff1d', username='tempest-TestStampPattern-897366137-project-member', projectid='d9663116fe18428d8e37dea7b30d8b5a', projectname='tempest-TestStampPattern-897366137'), image=ImageMeta(id='2128c605-74b4-4566-878a-c29ca1ec7e50', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio', 'img_owner_id': 'd9663116fe18428d8e37dea7b30d8b5a'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5a494f64-719c-4d87-af16-acf57733b3b9", "address": "fa:16:3e:ed:a3:d2", "network": {"id": "4f6e8375-a959-44b0-9cab-ae7918680bf7", "bridge": "br-int", "label": "tempest-TestStampPattern-914776722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d9663116fe18428d8e37dea7b30d8b5a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a494f64-71", "ovs_interfaceid": "5a494f64-719c-4d87-af16-acf57733b3b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933951.7331157) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 02:05:51.736477 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 02:05:51.736803 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 02:05:51.737692 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 02:05:51.737857 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 02:05:51.738793 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 02:05:51.739249 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d11ddb0feea9c81c03f48be565110cb8',container_format='bare',created_at=2026-05-28T02:05:31Z,direct_url=<?>,disk_format='qcow2',id=2128c605-74b4-4566-878a-c29ca1ec7e50,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1318199132',owner='d9663116fe18428d8e37dea7b30d8b5a',properties=ImageMetaProps,protected=<?>,size=53739520,status='active',tags=<?>,updated_at=2026-05-28T02:05:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 02:05:51.740024 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 02:05:51.740024 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 02:05:51.740024 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 02:05:51.740024 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 02:05:51.740024 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 02:05:51.740024 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 02:05:51.740024 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 02:05:51.740514 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 02:05:51.740514 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 02:05:51.740514 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 02:05:51.751700 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:05:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-554433487',display_name='tempest-TestStampPattern-server-554433487',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-teststamppattern-server-554433487',id=63,image_ref='2128c605-74b4-4566-878a-c29ca1ec7e50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGla4S7tzFQM3H7dOtPyxXylIxo5cIZbTOWxzJqFZg2znrJ8fjc45cg7DBtdnBMMzNou2BAybRIZM9Fj+5atQu7kwWfQaIDwG2yH2osFl+wPy/fI2Pvg+h4A9P59YVZ+gw==',key_name='tempest-TestStampPattern-1385235397',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9663116fe18428d8e37dea7b30d8b5a',ramdisk_id='',reservation_id='r-4biy80qd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='7751bb1a-84b9-48ce-81da-b3a41d63eadc',image_min_disk='1',image_min_ram='0',image_owner_id='d9663116fe18428d8e37dea7b30d8b5a',image_owner_project_name='tempest-TestStampPattern-897366137',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-897366137-project-member',image_user_id='db5b8b66a90b4a2dba53c340347aff1d',network_allocated='True',owner_project_name='tempest-TestStampPattern-897366137',owner_user_name='tempest-TestStampPattern-897366137-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:05:48Z,user_data=None,user_id='db5b8b66a90b4a2dba53c340347aff1d',uuid=0ce1d609-b3fe-4fb6-81ac-7a683c8f1992,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a494f64-719c-4d87-af16-acf57733b3b9", "address": "fa:16:3e:ed:a3:d2", "network": {"id": "4f6e8375-a959-44b0-9cab-ae7918680bf7", "bridge": "br-int", "label": "tempest-TestStampPattern-914776722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d9663116fe18428d8e37dea7b30d8b5a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a494f64-71", "ovs_interfaceid": "5a494f64-719c-4d87-af16-acf57733b3b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 02:05:51.752053 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Converting VIF {"id": "5a494f64-719c-4d87-af16-acf57733b3b9", "address": "fa:16:3e:ed:a3:d2", "network": {"id": "4f6e8375-a959-44b0-9cab-ae7918680bf7", "bridge": "br-int", "label": "tempest-TestStampPattern-914776722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d9663116fe18428d8e37dea7b30d8b5a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a494f64-71", "ovs_interfaceid": "5a494f64-719c-4d87-af16-acf57733b3b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:05:51.752447 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:a3:d2,bridge_name='br-int',has_traffic_filtering=True,id=5a494f64-719c-4d87-af16-acf57733b3b9,network=Network(4f6e8375-a959-44b0-9cab-ae7918680bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a494f64-71') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:05:51.752968 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:05:51.917634 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:05:52.238111 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:05:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-801974265',display_name='tempest-TestVolumeBootPattern-server-801974265',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testvolumebootpattern-server-801974265',id=62,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwh6E4i05I/O8lsE0bUEzocgUz6EHWmEWnV87akBvJyUZCaSgScF6CqBqpI/yb99Eh4gFmhgnyBDUzlF9t565ox0untLBipqeePS0CqQE7tD/Pd6ddczsNL4V+3d8XsQw==',key_name='tempest-TestVolumeBootPattern-1374779836',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='432aa1094ced436494def17a875aa8e1',ramdisk_id='',reservation_id='r-1uocswld',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1031057169',owner_user_name='tempest-TestVolumeBootPattern-1031057169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:05:46Z,user_data=None,user_id='6be314b4eed642c3b2c72fe115860220',uuid=39ea2f26-6a01-4d24-a2b3-d681e0b22d80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0479db3d-2d90-4116-b8e7-b1282c111d9b", "address": "fa:16:3e:9c:a6:6d", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0479db3d-2d", "ovs_interfaceid": "0479db3d-2d90-4116-b8e7-b1282c111d9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 02:05:52.238111 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converting VIF {"id": "0479db3d-2d90-4116-b8e7-b1282c111d9b", "address": "fa:16:3e:9c:a6:6d", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0479db3d-2d", "ovs_interfaceid": "0479db3d-2d90-4116-b8e7-b1282c111d9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:05:52.241552 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:a6:6d,bridge_name='br-int',has_traffic_filtering=True,id=0479db3d-2d90-4116-b8e7-b1282c111d9b,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0479db3d-2d') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:05:52.241552 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lazy-loading 'pci_devices' on Instance uuid 39ea2f26-6a01-4d24-a2b3-d681e0b22d80 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:05:52.256672 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] End _get_guest_xml xml=<domain type="qemu">
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:   <uuid>0ce1d609-b3fe-4fb6-81ac-7a683c8f1992</uuid>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:   <name>instance-0000003f</name>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:   <metadata>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:       <nova:name>tempest-TestStampPattern-server-554433487</nova:name>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 02:05:51</nova:creationTime>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:           <nova:property name="img_owner_id">d9663116fe18428d8e37dea7b30d8b5a</nova:property>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:       </nova:image>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:         <nova:user uuid="db5b8b66a90b4a2dba53c340347aff1d">tempest-TestStampPattern-897366137-project-member</nova:user>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:         <nova:project uuid="d9663116fe18428d8e37dea7b30d8b5a">tempest-TestStampPattern-897366137</nova:project>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:         <nova:port uuid="5a494f64-719c-4d87-af16-acf57733b3b9">
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:         </nova:port>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:   </metadata>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:     <system>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:       <entry name="serial">0ce1d609-b3fe-4fb6-81ac-7a683c8f1992</entry>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:       <entry name="uuid">0ce1d609-b3fe-4fb6-81ac-7a683c8f1992</entry>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:     </system>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:   <os>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:   </os>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:   <features>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:     <acpi/>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:     <tcg>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:     </tcg>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:   </features>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:   </cpu>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:   <devices>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/0ce1d609-b3fe-4fb6-81ac-7a683c8f1992/disk"/>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:     </disk>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/0ce1d609-b3fe-4fb6-81ac-7a683c8f1992/disk.config"/>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:     </disk>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:ed:a3:d2"/>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:       <target dev="tap5a494f64-71"/>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:     </interface>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/0ce1d609-b3fe-4fb6-81ac-7a683c8f1992/console.log" append="off"/>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:     </serial>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:     <video>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:     </video>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:     </rng>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:     </memballoon>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:   </devices>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]: </domain>
May 28 02:05:52.256672 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 02:05:52.263315 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Preparing to wait for external event network-vif-plugged-5a494f64-719c-4d87-af16-acf57733b3b9 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 02:05:52.263315 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Acquiring lock "0ce1d609-b3fe-4fb6-81ac-7a683c8f1992-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:05:52.263315 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "0ce1d609-b3fe-4fb6-81ac-7a683c8f1992-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:05:52.263315 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "0ce1d609-b3fe-4fb6-81ac-7a683c8f1992-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:05:52.263315 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:05:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-554433487',display_name='tempest-TestStampPattern-server-554433487',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-teststamppattern-server-554433487',id=63,image_ref='2128c605-74b4-4566-878a-c29ca1ec7e50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGla4S7tzFQM3H7dOtPyxXylIxo5cIZbTOWxzJqFZg2znrJ8fjc45cg7DBtdnBMMzNou2BAybRIZM9Fj+5atQu7kwWfQaIDwG2yH2osFl+wPy/fI2Pvg+h4A9P59YVZ+gw==',key_name='tempest-TestStampPattern-1385235397',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9663116fe18428d8e37dea7b30d8b5a',ramdisk_id='',reservation_id='r-4biy80qd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='7751bb1a-84b9-48ce-81da-b3a41d63eadc',image_min_disk='1',image_min_ram='0',image_owner_id='d9663116fe18428d8e37dea7b30d8b5a',image_owner_project_name='tempest-TestStampPattern-897366137',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-897366137-project-member',image_user_id='db5b8b66a90b4a2dba53c340347aff1d',network_allocated='True',owner_project_name='tempest-TestStampPattern-897366137',owner_user_name='tempest-TestStampPattern-897366137-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:05:48Z,user_data=None,user_id='db5b8b66a90b4a2dba53c340347aff1d',uuid=0ce1d609-b3fe-4fb6-81ac-7a683c8f1992,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a494f64-719c-4d87-af16-acf57733b3b9", "address": "fa:16:3e:ed:a3:d2", "network": {"id": "4f6e8375-a959-44b0-9cab-ae7918680bf7", "bridge": "br-int", "label": "tempest-TestStampPattern-914776722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d9663116fe18428d8e37dea7b30d8b5a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a494f64-71", "ovs_interfaceid": "5a494f64-719c-4d87-af16-acf57733b3b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 02:05:52.263315 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Converting VIF {"id": "5a494f64-719c-4d87-af16-acf57733b3b9", "address": "fa:16:3e:ed:a3:d2", "network": {"id": "4f6e8375-a959-44b0-9cab-ae7918680bf7", "bridge": "br-int", "label": "tempest-TestStampPattern-914776722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d9663116fe18428d8e37dea7b30d8b5a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a494f64-71", "ovs_interfaceid": "5a494f64-719c-4d87-af16-acf57733b3b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:05:52.263315 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:a3:d2,bridge_name='br-int',has_traffic_filtering=True,id=5a494f64-719c-4d87-af16-acf57733b3b9,network=Network(4f6e8375-a959-44b0-9cab-ae7918680bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a494f64-71') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:05:52.263315 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:a3:d2,bridge_name='br-int',has_traffic_filtering=True,id=5a494f64-719c-4d87-af16-acf57733b3b9,network=Network(4f6e8375-a959-44b0-9cab-ae7918680bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a494f64-71') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 02:05:52.263315 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:52.263315 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:05:52.263315 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 02:05:52.265366 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:52.265366 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b86050ed-0c74-5dcf-83c4-dd7411c83b39', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:05:52.265770 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:52.267175 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:05:52.270184 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:52.270605 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5a494f64-71, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:05:52.272197 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5a494f64-71, col_values=(('qos', UUID('718a5a74-4edb-40a0-985b-24ca3993bf04')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:05:52.272197 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5a494f64-71, col_values=(('external_ids', {'iface-id': '5a494f64-719c-4d87-af16-acf57733b3b9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:a3:d2', 'vm-uuid': '0ce1d609-b3fe-4fb6-81ac-7a683c8f1992'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:05:52.275615 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:05:52.279274 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:52.280514 np0000001583 nova-compute[98241]: INFO os_vif [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:a3:d2,bridge_name='br-int',has_traffic_filtering=True,id=5a494f64-719c-4d87-af16-acf57733b3b9,network=Network(4f6e8375-a959-44b0-9cab-ae7918680bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a494f64-71')
May 28 02:05:52.426284 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.500s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:05:52.426702 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 02:05:52.741809 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] End _get_guest_xml xml=<domain type="qemu">
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:   <uuid>39ea2f26-6a01-4d24-a2b3-d681e0b22d80</uuid>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:   <name>instance-0000003e</name>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:   <metadata>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:       <nova:name>tempest-TestVolumeBootPattern-server-801974265</nova:name>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 02:05:48</nova:creationTime>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:       <nova:image uuid="">
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:       </nova:image>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:         <nova:user uuid="6be314b4eed642c3b2c72fe115860220">tempest-TestVolumeBootPattern-1031057169-project-member</nova:user>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:         <nova:project uuid="432aa1094ced436494def17a875aa8e1">tempest-TestVolumeBootPattern-1031057169</nova:project>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:       <nova:root type="volume" uuid=""/>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:         <nova:port uuid="0479db3d-2d90-4116-b8e7-b1282c111d9b">
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:         </nova:port>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:   </metadata>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:     <system>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:       <entry name="serial">39ea2f26-6a01-4d24-a2b3-d681e0b22d80</entry>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:       <entry name="uuid">39ea2f26-6a01-4d24-a2b3-d681e0b22d80</entry>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:     </system>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:   <os>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:   </os>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:   <features>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:     <acpi/>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:     <tcg>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:     </tcg>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:   </features>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:   </cpu>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:   <devices>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/39ea2f26-6a01-4d24-a2b3-d681e0b22d80/disk.config"/>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:     </disk>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:     <disk type="block" device="disk">
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:       <alias name="ua-873f9b75-1314-4acd-9c69-c4ae877916aa"/>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:       <source dev="/dev/dm-1"/>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:       <serial>873f9b75-1314-4acd-9c69-c4ae877916aa</serial>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:     </disk>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:9c:a6:6d"/>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:       <target dev="tap0479db3d-2d"/>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:     </interface>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/39ea2f26-6a01-4d24-a2b3-d681e0b22d80/console.log" append="off"/>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:     </serial>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:     <video>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:     </video>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:     </rng>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:     </memballoon>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:   </devices>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]: </domain>
May 28 02:05:52.741809 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 02:05:52.744789 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Preparing to wait for external event network-vif-plugged-0479db3d-2d90-4116-b8e7-b1282c111d9b {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 02:05:52.744789 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "39ea2f26-6a01-4d24-a2b3-d681e0b22d80-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:05:52.744789 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "39ea2f26-6a01-4d24-a2b3-d681e0b22d80-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:05:52.744789 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "39ea2f26-6a01-4d24-a2b3-d681e0b22d80-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:05:52.744789 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:05:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-801974265',display_name='tempest-TestVolumeBootPattern-server-801974265',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testvolumebootpattern-server-801974265',id=62,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwh6E4i05I/O8lsE0bUEzocgUz6EHWmEWnV87akBvJyUZCaSgScF6CqBqpI/yb99Eh4gFmhgnyBDUzlF9t565ox0untLBipqeePS0CqQE7tD/Pd6ddczsNL4V+3d8XsQw==',key_name='tempest-TestVolumeBootPattern-1374779836',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='432aa1094ced436494def17a875aa8e1',ramdisk_id='',reservation_id='r-1uocswld',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1031057169',owner_user_name='tempest-TestVolumeBootPattern-1031057169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:05:46Z,user_data=None,user_id='6be314b4eed642c3b2c72fe115860220',uuid=39ea2f26-6a01-4d24-a2b3-d681e0b22d80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0479db3d-2d90-4116-b8e7-b1282c111d9b", "address": "fa:16:3e:9c:a6:6d", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0479db3d-2d", "ovs_interfaceid": "0479db3d-2d90-4116-b8e7-b1282c111d9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 02:05:52.744789 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converting VIF {"id": "0479db3d-2d90-4116-b8e7-b1282c111d9b", "address": "fa:16:3e:9c:a6:6d", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0479db3d-2d", "ovs_interfaceid": "0479db3d-2d90-4116-b8e7-b1282c111d9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:05:52.744789 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:a6:6d,bridge_name='br-int',has_traffic_filtering=True,id=0479db3d-2d90-4116-b8e7-b1282c111d9b,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0479db3d-2d') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:05:52.744789 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:a6:6d,bridge_name='br-int',has_traffic_filtering=True,id=0479db3d-2d90-4116-b8e7-b1282c111d9b,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0479db3d-2d') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 02:05:52.749729 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:52.749729 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:05:52.749729 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 02:05:52.749729 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:52.749729 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f3987b17-86e4-5514-8710-91fef85059bb', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:05:52.749729 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:52.749729 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:05:52.755331 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:52.758706 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:52.758706 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0479db3d-2d, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:05:52.758706 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0479db3d-2d, col_values=(('qos', UUID('591faa3d-a918-4e84-812f-364dd27f0455')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:05:52.758706 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0479db3d-2d, col_values=(('external_ids', {'iface-id': '0479db3d-2d90-4116-b8e7-b1282c111d9b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:a6:6d', 'vm-uuid': '39ea2f26-6a01-4d24-a2b3-d681e0b22d80'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:05:52.761257 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:52.763244 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:05:52.773762 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:52.774154 np0000001583 nova-compute[98241]: INFO os_vif [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:a6:6d,bridge_name='br-int',has_traffic_filtering=True,id=0479db3d-2d90-4116-b8e7-b1282c111d9b,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0479db3d-2d')
May 28 02:05:52.932335 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 02:05:52.933601 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 02:05:52.934433 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:05:52.934433 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:05:53.007113 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2b5bf0f126624ddab4bd36a1b707899e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2896b1043bfb246c28ad9d1e174', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 02:05:53.312640 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:53.435638 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 02:05:53.461898 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:53.505490 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Successfully created port: c8e61437-9a2f-4506-a4c8-d07d919364b6 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 02:05:53.799532 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:05:53.799681 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:05:53.799802 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] No VIF found with MAC fa:16:3e:ed:a3:d2, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:05:53.800282 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Using config drive
May 28 02:05:53.940245 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 02:05:54.037112 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Successfully updated port: c8e61437-9a2f-4506-a4c8-d07d919364b6 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 02:05:54.109370 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b9e4e29d-f2e6-4d23-b0e3-0f6b818814c3 req-ead0c9d4-6588-4c1f-81e0-98ce972e829f service nova] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Received event network-changed-c8e61437-9a2f-4506-a4c8-d07d919364b6 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:05:54.109586 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b9e4e29d-f2e6-4d23-b0e3-0f6b818814c3 req-ead0c9d4-6588-4c1f-81e0-98ce972e829f service nova] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Refreshing instance network info cache due to event network-changed-c8e61437-9a2f-4506-a4c8-d07d919364b6. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:05:54.109829 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b9e4e29d-f2e6-4d23-b0e3-0f6b818814c3 req-ead0c9d4-6588-4c1f-81e0-98ce972e829f service nova] Acquiring lock "refresh_cache-b369292d-fea0-46aa-b5c4-908b8bfb6209" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:05:54.110057 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b9e4e29d-f2e6-4d23-b0e3-0f6b818814c3 req-ead0c9d4-6588-4c1f-81e0-98ce972e829f service nova] Acquired lock "refresh_cache-b369292d-fea0-46aa-b5c4-908b8bfb6209" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:05:54.110158 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-b9e4e29d-f2e6-4d23-b0e3-0f6b818814c3 req-ead0c9d4-6588-4c1f-81e0-98ce972e829f service nova] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Refreshing network info cache for port c8e61437-9a2f-4506-a4c8-d07d919364b6 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:05:54.293399 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:05:54.293399 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:05:54.293618 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] No VIF found with MAC fa:16:3e:9c:a6:6d, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:05:54.293823 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Using config drive
May 28 02:05:54.307464 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:05:54.431724 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Creating config drive at /opt/stack/data/nova/instances/0ce1d609-b3fe-4fb6-81ac-7a683c8f1992/disk.config
May 28 02:05:54.432728 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0ce1d609-b3fe-4fb6-81ac-7a683c8f1992/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp8xxh21lr {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:05:54.488486 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0ce1d609-b3fe-4fb6-81ac-7a683c8f1992/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp8xxh21lr" returned: 0 in 0.056s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:05:54.540161 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Acquiring lock "refresh_cache-b369292d-fea0-46aa-b5c4-908b8bfb6209" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:05:54.614588 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-b9e4e29d-f2e6-4d23-b0e3-0f6b818814c3 req-ead0c9d4-6588-4c1f-81e0-98ce972e829f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:05:54.680425 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-b9e4e29d-f2e6-4d23-b0e3-0f6b818814c3 req-ead0c9d4-6588-4c1f-81e0-98ce972e829f service nova] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:05:54.799598 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:05:54.859100 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-b9e4e29d-f2e6-4d23-b0e3-0f6b818814c3 req-ead0c9d4-6588-4c1f-81e0-98ce972e829f service nova] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:05:54.932226 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Creating config drive at /opt/stack/data/nova/instances/39ea2f26-6a01-4d24-a2b3-d681e0b22d80/disk.config
May 28 02:05:54.932552 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:54.938859 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/39ea2f26-6a01-4d24-a2b3-d681e0b22d80/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpa4f4rd7i {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:05:54.959692 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 02:05:54.961701 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 02:05:54.961954 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Creating image(s)
May 28 02:05:54.962858 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Acquiring lock "/opt/stack/data/nova/instances/b369292d-fea0-46aa-b5c4-908b8bfb6209/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:05:54.964104 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "/opt/stack/data/nova/instances/b369292d-fea0-46aa-b5c4-908b8bfb6209/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:05:54.964718 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "/opt/stack/data/nova/instances/b369292d-fea0-46aa-b5c4-908b8bfb6209/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:05:54.965514 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:05:54.974281 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:05:54.974920 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:54.980226 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:05:55.002552 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/39ea2f26-6a01-4d24-a2b3-d681e0b22d80/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpa4f4rd7i" returned: 0 in 0.063s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:05:55.049205 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:55.087952 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.109s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:05:55.088525 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:05:55.089165 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:05:55.091696 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:05:55.095548 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:05:55.096018 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:05:55.140047 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:55.148839 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:55.158632 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-c759e4f3-6235-4d1c-98b2-3bd764754bee req-ec6d1913-24b1-402b-9d8b-90f8635d056b service nova] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Received event network-vif-plugged-5a494f64-719c-4d87-af16-acf57733b3b9 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:05:55.161032 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c759e4f3-6235-4d1c-98b2-3bd764754bee req-ec6d1913-24b1-402b-9d8b-90f8635d056b service nova] Acquiring lock "0ce1d609-b3fe-4fb6-81ac-7a683c8f1992-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:05:55.161277 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c759e4f3-6235-4d1c-98b2-3bd764754bee req-ec6d1913-24b1-402b-9d8b-90f8635d056b service nova] Lock "0ce1d609-b3fe-4fb6-81ac-7a683c8f1992-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:05:55.161390 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c759e4f3-6235-4d1c-98b2-3bd764754bee req-ec6d1913-24b1-402b-9d8b-90f8635d056b service nova] Lock "0ce1d609-b3fe-4fb6-81ac-7a683c8f1992-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:05:55.161488 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-c759e4f3-6235-4d1c-98b2-3bd764754bee req-ec6d1913-24b1-402b-9d8b-90f8635d056b service nova] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Processing event network-vif-plugged-5a494f64-719c-4d87-af16-acf57733b3b9 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 02:05:55.210920 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.115s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:05:55.211421 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/b369292d-fea0-46aa-b5c4-908b8bfb6209/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:05:55.286745 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/b369292d-fea0-46aa-b5c4-908b8bfb6209/disk 1073741824" returned: 0 in 0.075s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:05:55.292606 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:05:55.293523 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:05:55.362441 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b9e4e29d-f2e6-4d23-b0e3-0f6b818814c3 req-ead0c9d4-6588-4c1f-81e0-98ce972e829f service nova] Releasing lock "refresh_cache-b369292d-fea0-46aa-b5c4-908b8bfb6209" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:05:55.363236 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Acquired lock "refresh_cache-b369292d-fea0-46aa-b5c4-908b8bfb6209" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:05:55.363508 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:05:55.402627 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.109s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:05:55.403120 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b369292d-fea0-46aa-b5c4-908b8bfb6209/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 02:05:55.403452 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b369292d-fea0-46aa-b5c4-908b8bfb6209/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:05:55.502237 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b369292d-fea0-46aa-b5c4-908b8bfb6209/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:05:55.502736 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Cannot resize image /opt/stack/data/nova/instances/b369292d-fea0-46aa-b5c4-908b8bfb6209/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 02:05:55.503032 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 02:05:55.503326 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Ensure instance console log exists: /opt/stack/data/nova/instances/b369292d-fea0-46aa-b5c4-908b8bfb6209/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 02:05:55.503751 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:05:55.503992 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:05:55.504337 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:05:55.529631 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:55.560211 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:55.560873 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:55.658066 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:55.906139 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:55.915977 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:55.919804 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:55.944109 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:55.965675 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:05:56.139520 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:05:56.169311 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9fadf428-6f28-4266-8697-6ab22bc9f8d4 req-7dd9f71b-2120-4b95-93e2-1a0e0fa804ae service nova] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Received event network-vif-plugged-0479db3d-2d90-4116-b8e7-b1282c111d9b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:05:56.169506 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9fadf428-6f28-4266-8697-6ab22bc9f8d4 req-7dd9f71b-2120-4b95-93e2-1a0e0fa804ae service nova] Acquiring lock "39ea2f26-6a01-4d24-a2b3-d681e0b22d80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:05:56.169674 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9fadf428-6f28-4266-8697-6ab22bc9f8d4 req-7dd9f71b-2120-4b95-93e2-1a0e0fa804ae service nova] Lock "39ea2f26-6a01-4d24-a2b3-d681e0b22d80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:05:56.169790 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9fadf428-6f28-4266-8697-6ab22bc9f8d4 req-7dd9f71b-2120-4b95-93e2-1a0e0fa804ae service nova] Lock "39ea2f26-6a01-4d24-a2b3-d681e0b22d80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:05:56.169901 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9fadf428-6f28-4266-8697-6ab22bc9f8d4 req-7dd9f71b-2120-4b95-93e2-1a0e0fa804ae service nova] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Processing event network-vif-plugged-0479db3d-2d90-4116-b8e7-b1282c111d9b {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 02:05:56.170056 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9fadf428-6f28-4266-8697-6ab22bc9f8d4 req-7dd9f71b-2120-4b95-93e2-1a0e0fa804ae service nova] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Received event network-vif-plugged-0479db3d-2d90-4116-b8e7-b1282c111d9b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:05:56.170151 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9fadf428-6f28-4266-8697-6ab22bc9f8d4 req-7dd9f71b-2120-4b95-93e2-1a0e0fa804ae service nova] Acquiring lock "39ea2f26-6a01-4d24-a2b3-d681e0b22d80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:05:56.170280 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9fadf428-6f28-4266-8697-6ab22bc9f8d4 req-7dd9f71b-2120-4b95-93e2-1a0e0fa804ae service nova] Lock "39ea2f26-6a01-4d24-a2b3-d681e0b22d80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:05:56.170381 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9fadf428-6f28-4266-8697-6ab22bc9f8d4 req-7dd9f71b-2120-4b95-93e2-1a0e0fa804ae service nova] Lock "39ea2f26-6a01-4d24-a2b3-d681e0b22d80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:05:56.170484 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9fadf428-6f28-4266-8697-6ab22bc9f8d4 req-7dd9f71b-2120-4b95-93e2-1a0e0fa804ae service nova] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] No waiting events found dispatching network-vif-plugged-0479db3d-2d90-4116-b8e7-b1282c111d9b {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:05:56.170665 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-9fadf428-6f28-4266-8697-6ab22bc9f8d4 req-7dd9f71b-2120-4b95-93e2-1a0e0fa804ae service nova] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Received unexpected event network-vif-plugged-0479db3d-2d90-4116-b8e7-b1282c111d9b for instance with vm_state building and task_state spawning.
May 28 02:05:56.270470 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933956.2699952, 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:05:56.270621 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] VM Started (Lifecycle Event)
May 28 02:05:56.272152 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 02:05:56.279262 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Updating instance_info_cache with network_info: [{"id": "c8e61437-9a2f-4506-a4c8-d07d919364b6", "address": "fa:16:3e:b4:d0:b8", "network": {"id": "ef15cd88-386f-4fc6-8df0-74267f73d3fb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1804869041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b7ada2896b1043bfb246c28ad9d1e174", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8e61437-9a", "ovs_interfaceid": "c8e61437-9a2f-4506-a4c8-d07d919364b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:05:56.280270 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 02:05:56.286121 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Instance spawned successfully.
May 28 02:05:56.286576 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 02:05:56.290056 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:05:56.290352 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:05:56.415173 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 02:05:56.420418 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 02:05:56.431304 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Instance spawned successfully.
May 28 02:05:56.431894 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 02:05:56.773385 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:05:56.775821 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:05:56.781503 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Releasing lock "refresh_cache-b369292d-fea0-46aa-b5c4-908b8bfb6209" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:05:56.781969 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Instance network_info: |[{"id": "c8e61437-9a2f-4506-a4c8-d07d919364b6", "address": "fa:16:3e:b4:d0:b8", "network": {"id": "ef15cd88-386f-4fc6-8df0-74267f73d3fb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1804869041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b7ada2896b1043bfb246c28ad9d1e174", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8e61437-9a", "ovs_interfaceid": "c8e61437-9a2f-4506-a4c8-d07d919364b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 02:05:56.783762 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Start _get_guest_xml network_info=[{"id": "c8e61437-9a2f-4506-a4c8-d07d919364b6", "address": "fa:16:3e:b4:d0:b8", "network": {"id": "ef15cd88-386f-4fc6-8df0-74267f73d3fb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1804869041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b7ada2896b1043bfb246c28ad9d1e174", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8e61437-9a", "ovs_interfaceid": "c8e61437-9a2f-4506-a4c8-d07d919364b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 02:05:56.786233 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:05:56.787334 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1865984652', uuid='b369292d-fea0-46aa-b5c4-908b8bfb6209'), owner=OwnerMeta(userid='2b5bf0f126624ddab4bd36a1b707899e', username='tempest-TestEncryptedCinderVolumes-1693604386-project-member', projectid='b7ada2896b1043bfb246c28ad9d1e174', projectname='tempest-TestEncryptedCinderVolumes-1693604386'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c8e61437-9a2f-4506-a4c8-d07d919364b6", "address": "fa:16:3e:b4:d0:b8", "network": {"id": "ef15cd88-386f-4fc6-8df0-74267f73d3fb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1804869041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b7ada2896b1043bfb246c28ad9d1e174", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8e61437-9a", "ovs_interfaceid": "c8e61437-9a2f-4506-a4c8-d07d919364b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779933956.786987) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 02:05:56.788578 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 02:05:56.789342 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 02:05:56.790587 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 02:05:56.790771 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 02:05:56.791631 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 02:05:56.791912 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 02:05:56.792056 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 02:05:56.792179 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 02:05:56.792306 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 02:05:56.792382 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 02:05:56.792480 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 02:05:56.792613 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 02:05:56.792710 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 02:05:56.792811 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 02:05:56.792912 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 02:05:56.793396 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 02:05:56.804567 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Took 7.46 seconds to spawn the instance on the hypervisor.
May 28 02:05:56.805227 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:05:56.808400 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:05:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1865984652',display_name='tempest-TestEncryptedCinderVolumes-server-1865984652',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testencryptedcindervolumes-server-1865984652',id=64,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtMnSwfhTrZZGwe2NVdu2w6ZAaFpHVjoHIoB+NxFDfBrY/yQ0K1HMrBh5Wz6DnMSPvUJcQuIQ0iZNmHi3Br+rGFrep5SGtIuc1lu4gEx52ULcvouqX09ddDTiBfaJr+Pg==',key_name='tempest-keypair-2048724505',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7ada2896b1043bfb246c28ad9d1e174',ramdisk_id='',reservation_id='r-00irh5t4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1693604386',owner_user_name='tempest-TestEncryptedCinderVolumes-1693604386-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:05:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b5bf0f126624ddab4bd36a1b707899e',uuid=b369292d-fea0-46aa-b5c4-908b8bfb6209,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8e61437-9a2f-4506-a4c8-d07d919364b6", "address": "fa:16:3e:b4:d0:b8", "network": {"id": "ef15cd88-386f-4fc6-8df0-74267f73d3fb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1804869041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b7ada2896b1043bfb246c28ad9d1e174", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8e61437-9a", "ovs_interfaceid": "c8e61437-9a2f-4506-a4c8-d07d919364b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 02:05:56.808631 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Converting VIF {"id": "c8e61437-9a2f-4506-a4c8-d07d919364b6", "address": "fa:16:3e:b4:d0:b8", "network": {"id": "ef15cd88-386f-4fc6-8df0-74267f73d3fb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1804869041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b7ada2896b1043bfb246c28ad9d1e174", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8e61437-9a", "ovs_interfaceid": "c8e61437-9a2f-4506-a4c8-d07d919364b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:05:56.809494 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:d0:b8,bridge_name='br-int',has_traffic_filtering=True,id=c8e61437-9a2f-4506-a4c8-d07d919364b6,network=Network(ef15cd88-386f-4fc6-8df0-74267f73d3fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8e61437-9a') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:05:56.810635 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lazy-loading 'pci_devices' on Instance uuid b369292d-fea0-46aa-b5c4-908b8bfb6209 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:05:56.940049 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:05:56.940224 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:05:56.940365 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:05:56.940579 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:05:56.940834 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:05:56.940984 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:05:57.225511 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-3f213463-e724-4a49-a337-dba979713d29 req-8b44eb56-fb3c-4e85-855f-a21a0c7dfcc7 service nova] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Received event network-vif-plugged-5a494f64-719c-4d87-af16-acf57733b3b9 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:05:57.225511 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-3f213463-e724-4a49-a337-dba979713d29 req-8b44eb56-fb3c-4e85-855f-a21a0c7dfcc7 service nova] Acquiring lock "0ce1d609-b3fe-4fb6-81ac-7a683c8f1992-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:05:57.225511 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-3f213463-e724-4a49-a337-dba979713d29 req-8b44eb56-fb3c-4e85-855f-a21a0c7dfcc7 service nova] Lock "0ce1d609-b3fe-4fb6-81ac-7a683c8f1992-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:05:57.225511 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-3f213463-e724-4a49-a337-dba979713d29 req-8b44eb56-fb3c-4e85-855f-a21a0c7dfcc7 service nova] Lock "0ce1d609-b3fe-4fb6-81ac-7a683c8f1992-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:05:57.225511 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-3f213463-e724-4a49-a337-dba979713d29 req-8b44eb56-fb3c-4e85-855f-a21a0c7dfcc7 service nova] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] No waiting events found dispatching network-vif-plugged-5a494f64-719c-4d87-af16-acf57733b3b9 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:05:57.225511 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-3f213463-e724-4a49-a337-dba979713d29 req-8b44eb56-fb3c-4e85-855f-a21a0c7dfcc7 service nova] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Received unexpected event network-vif-plugged-5a494f64-719c-4d87-af16-acf57733b3b9 for instance with vm_state active and task_state None.
May 28 02:05:57.278386 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 02:05:57.278663 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933957.2785013, 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:05:57.278797 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] VM Paused (Lifecycle Event)
May 28 02:05:57.317015 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] End _get_guest_xml xml=<domain type="qemu">
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:   <uuid>b369292d-fea0-46aa-b5c4-908b8bfb6209</uuid>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:   <name>instance-00000040</name>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:   <metadata>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1865984652</nova:name>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 02:05:56</nova:creationTime>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:       </nova:image>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:         <nova:user uuid="2b5bf0f126624ddab4bd36a1b707899e">tempest-TestEncryptedCinderVolumes-1693604386-project-member</nova:user>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:         <nova:project uuid="b7ada2896b1043bfb246c28ad9d1e174">tempest-TestEncryptedCinderVolumes-1693604386</nova:project>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:         <nova:port uuid="c8e61437-9a2f-4506-a4c8-d07d919364b6">
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:         </nova:port>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:   </metadata>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:     <system>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:       <entry name="serial">b369292d-fea0-46aa-b5c4-908b8bfb6209</entry>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:       <entry name="uuid">b369292d-fea0-46aa-b5c4-908b8bfb6209</entry>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:     </system>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:   <os>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:   </os>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:   <features>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:     <acpi/>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:     <tcg>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:     </tcg>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:   </features>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:   </cpu>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:   <devices>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/b369292d-fea0-46aa-b5c4-908b8bfb6209/disk"/>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:     </disk>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/b369292d-fea0-46aa-b5c4-908b8bfb6209/disk.config"/>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:     </disk>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:b4:d0:b8"/>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:       <target dev="tapc8e61437-9a"/>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:     </interface>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/b369292d-fea0-46aa-b5c4-908b8bfb6209/console.log" append="off"/>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:     </serial>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:     <video>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:     </video>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:     </rng>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:     </memballoon>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:   </devices>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]: </domain>
May 28 02:05:57.317015 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 02:05:57.319638 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Preparing to wait for external event network-vif-plugged-c8e61437-9a2f-4506-a4c8-d07d919364b6 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 02:05:57.319638 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Acquiring lock "b369292d-fea0-46aa-b5c4-908b8bfb6209-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:05:57.319638 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "b369292d-fea0-46aa-b5c4-908b8bfb6209-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:05:57.319638 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "b369292d-fea0-46aa-b5c4-908b8bfb6209-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:05:57.319638 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:05:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1865984652',display_name='tempest-TestEncryptedCinderVolumes-server-1865984652',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testencryptedcindervolumes-server-1865984652',id=64,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtMnSwfhTrZZGwe2NVdu2w6ZAaFpHVjoHIoB+NxFDfBrY/yQ0K1HMrBh5Wz6DnMSPvUJcQuIQ0iZNmHi3Br+rGFrep5SGtIuc1lu4gEx52ULcvouqX09ddDTiBfaJr+Pg==',key_name='tempest-keypair-2048724505',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7ada2896b1043bfb246c28ad9d1e174',ramdisk_id='',reservation_id='r-00irh5t4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1693604386',owner_user_name='tempest-TestEncryptedCinderVolumes-1693604386-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:05:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b5bf0f126624ddab4bd36a1b707899e',uuid=b369292d-fea0-46aa-b5c4-908b8bfb6209,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8e61437-9a2f-4506-a4c8-d07d919364b6", "address": "fa:16:3e:b4:d0:b8", "network": {"id": "ef15cd88-386f-4fc6-8df0-74267f73d3fb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1804869041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b7ada2896b1043bfb246c28ad9d1e174", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8e61437-9a", "ovs_interfaceid": "c8e61437-9a2f-4506-a4c8-d07d919364b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 02:05:57.319638 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Converting VIF {"id": "c8e61437-9a2f-4506-a4c8-d07d919364b6", "address": "fa:16:3e:b4:d0:b8", "network": {"id": "ef15cd88-386f-4fc6-8df0-74267f73d3fb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1804869041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b7ada2896b1043bfb246c28ad9d1e174", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8e61437-9a", "ovs_interfaceid": "c8e61437-9a2f-4506-a4c8-d07d919364b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:05:57.319638 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:d0:b8,bridge_name='br-int',has_traffic_filtering=True,id=c8e61437-9a2f-4506-a4c8-d07d919364b6,network=Network(ef15cd88-386f-4fc6-8df0-74267f73d3fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8e61437-9a') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:05:57.319638 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:d0:b8,bridge_name='br-int',has_traffic_filtering=True,id=c8e61437-9a2f-4506-a4c8-d07d919364b6,network=Network(ef15cd88-386f-4fc6-8df0-74267f73d3fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8e61437-9a') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 02:05:57.319638 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:57.322665 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:05:57.322960 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 02:05:57.323526 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Took 14.69 seconds to build instance.
May 28 02:05:57.325344 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:57.325542 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '74ec7790-452e-5923-82ef-ab3bb4c0a774', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:05:57.326323 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:57.326892 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:05:57.328245 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:57.330570 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:57.330775 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc8e61437-9a, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:05:57.331313 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc8e61437-9a, col_values=(('qos', UUID('fd5f8da6-1df7-4545-ae1b-d6bd65ac3156')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:05:57.331758 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc8e61437-9a, col_values=(('external_ids', {'iface-id': 'c8e61437-9a2f-4506-a4c8-d07d919364b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:d0:b8', 'vm-uuid': 'b369292d-fea0-46aa-b5c4-908b8bfb6209'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:05:57.332628 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:57.333742 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:05:57.339119 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:57.340979 np0000001583 nova-compute[98241]: INFO os_vif [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:d0:b8,bridge_name='br-int',has_traffic_filtering=True,id=c8e61437-9a2f-4506-a4c8-d07d919364b6,network=Network(ef15cd88-386f-4fc6-8df0-74267f73d3fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8e61437-9a')
May 28 02:05:57.445487 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Took 8.78 seconds to spawn the instance on the hypervisor.
May 28 02:05:57.445652 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:05:57.783684 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:05:57.786580 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933957.7863605, 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:05:57.786791 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] VM Resumed (Lifecycle Event)
May 28 02:05:57.826612 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "0ce1d609-b3fe-4fb6-81ac-7a683c8f1992" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.199s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:05:57.953433 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Took 15.95 seconds to build instance.
May 28 02:05:58.288805 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:05:58.290996 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:05:58.454884 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-64a7f119-e8e1-454d-9969-aa1c1708e164 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "39ea2f26-6a01-4d24-a2b3-d681e0b22d80" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.464s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:05:58.459196 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:05:58.794947 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933958.7928004, 39ea2f26-6a01-4d24-a2b3-d681e0b22d80 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:05:58.794947 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] VM Started (Lifecycle Event)
May 28 02:05:58.857650 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:05:58.857781 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:05:58.857909 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] No VIF found with MAC fa:16:3e:b4:d0:b8, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:05:58.858395 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Using config drive
May 28 02:05:59.295979 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:05:59.298639 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:05:59.364664 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:05:59.479193 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Acquiring lock "19d774e3-96a1-4dd4-8953-062105d5f0b2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:05:59.479539 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Lock "19d774e3-96a1-4dd4-8953-062105d5f0b2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:05:59.579690 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Creating config drive at /opt/stack/data/nova/instances/b369292d-fea0-46aa-b5c4-908b8bfb6209/disk.config
May 28 02:05:59.585534 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b369292d-fea0-46aa-b5c4-908b8bfb6209/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzv7mgapj {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:05:59.651208 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b369292d-fea0-46aa-b5c4-908b8bfb6209/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzv7mgapj" returned: 0 in 0.065s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:05:59.678337 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0e8ae70b-3aa7-4adc-aaab-b0d8769ec84a req-89bbb6bf-877b-407a-8ffa-6fa92f86b8b5 service nova] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Received event network-changed-5a494f64-719c-4d87-af16-acf57733b3b9 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:05:59.678484 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0e8ae70b-3aa7-4adc-aaab-b0d8769ec84a req-89bbb6bf-877b-407a-8ffa-6fa92f86b8b5 service nova] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Refreshing instance network info cache due to event network-changed-5a494f64-719c-4d87-af16-acf57733b3b9. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:05:59.678827 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0e8ae70b-3aa7-4adc-aaab-b0d8769ec84a req-89bbb6bf-877b-407a-8ffa-6fa92f86b8b5 service nova] Acquiring lock "refresh_cache-0ce1d609-b3fe-4fb6-81ac-7a683c8f1992" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:05:59.678932 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0e8ae70b-3aa7-4adc-aaab-b0d8769ec84a req-89bbb6bf-877b-407a-8ffa-6fa92f86b8b5 service nova] Acquired lock "refresh_cache-0ce1d609-b3fe-4fb6-81ac-7a683c8f1992" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:05:59.679060 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-0e8ae70b-3aa7-4adc-aaab-b0d8769ec84a req-89bbb6bf-877b-407a-8ffa-6fa92f86b8b5 service nova] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Refreshing network info cache for port 5a494f64-719c-4d87-af16-acf57733b3b9 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:05:59.801729 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933959.8012865, 39ea2f26-6a01-4d24-a2b3-d681e0b22d80 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:05:59.802256 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] VM Paused (Lifecycle Event)
May 28 02:05:59.985222 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Lazy-loading 'flavor' on Instance uuid 19d774e3-96a1-4dd4-8953-062105d5f0b2 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:06:00.023522 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5fba4675-f2df-4d4c-ad86-47aa8b966e9b req-f3914518-0f84-4842-a510-32b327228609 service nova] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Received event network-changed-0479db3d-2d90-4116-b8e7-b1282c111d9b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:06:00.023980 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5fba4675-f2df-4d4c-ad86-47aa8b966e9b req-f3914518-0f84-4842-a510-32b327228609 service nova] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Refreshing instance network info cache due to event network-changed-0479db3d-2d90-4116-b8e7-b1282c111d9b. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:06:00.024197 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5fba4675-f2df-4d4c-ad86-47aa8b966e9b req-f3914518-0f84-4842-a510-32b327228609 service nova] Acquiring lock "refresh_cache-39ea2f26-6a01-4d24-a2b3-d681e0b22d80" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:06:00.024416 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5fba4675-f2df-4d4c-ad86-47aa8b966e9b req-f3914518-0f84-4842-a510-32b327228609 service nova] Acquired lock "refresh_cache-39ea2f26-6a01-4d24-a2b3-d681e0b22d80" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:06:00.024622 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-5fba4675-f2df-4d4c-ad86-47aa8b966e9b req-f3914518-0f84-4842-a510-32b327228609 service nova] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Refreshing network info cache for port 0479db3d-2d90-4116-b8e7-b1282c111d9b {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:06:00.096141 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:00.130524 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:00.132024 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:00.182643 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-0e8ae70b-3aa7-4adc-aaab-b0d8769ec84a req-89bbb6bf-877b-407a-8ffa-6fa92f86b8b5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:06:00.229713 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:00.305848 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:06:00.312812 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933960.3125288, 39ea2f26-6a01-4d24-a2b3-d681e0b22d80 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:06:00.312952 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] VM Resumed (Lifecycle Event)
May 28 02:06:00.488539 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Ignoring supplied device name: /dev/vdb
May 28 02:06:00.498061 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:00.507851 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:00.526764 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-5fba4675-f2df-4d4c-ad86-47aa8b966e9b req-f3914518-0f84-4842-a510-32b327228609 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:06:00.531745 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:00.605539 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-0e8ae70b-3aa7-4adc-aaab-b0d8769ec84a req-89bbb6bf-877b-407a-8ffa-6fa92f86b8b5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:06:00.759508 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-0e8ae70b-3aa7-4adc-aaab-b0d8769ec84a req-89bbb6bf-877b-407a-8ffa-6fa92f86b8b5 service nova] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Updated VIF entry in instance network info cache for port 5a494f64-719c-4d87-af16-acf57733b3b9. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:06:00.759945 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-0e8ae70b-3aa7-4adc-aaab-b0d8769ec84a req-89bbb6bf-877b-407a-8ffa-6fa92f86b8b5 service nova] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Updating instance_info_cache with network_info: [{"id": "5a494f64-719c-4d87-af16-acf57733b3b9", "address": "fa:16:3e:ed:a3:d2", "network": {"id": "4f6e8375-a959-44b0-9cab-ae7918680bf7", "bridge": "br-int", "label": "tempest-TestStampPattern-914776722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d9663116fe18428d8e37dea7b30d8b5a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a494f64-71", "ovs_interfaceid": "5a494f64-719c-4d87-af16-acf57733b3b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:06:00.817132 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:06:00.820736 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:06:00.912248 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-5fba4675-f2df-4d4c-ad86-47aa8b966e9b req-f3914518-0f84-4842-a510-32b327228609 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:06:00.992621 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Lock "19d774e3-96a1-4dd4-8953-062105d5f0b2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.513s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:06:01.053234 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-5fba4675-f2df-4d4c-ad86-47aa8b966e9b req-f3914518-0f84-4842-a510-32b327228609 service nova] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Updated VIF entry in instance network info cache for port 0479db3d-2d90-4116-b8e7-b1282c111d9b. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:06:01.053584 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-5fba4675-f2df-4d4c-ad86-47aa8b966e9b req-f3914518-0f84-4842-a510-32b327228609 service nova] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Updating instance_info_cache with network_info: [{"id": "0479db3d-2d90-4116-b8e7-b1282c111d9b", "address": "fa:16:3e:9c:a6:6d", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0479db3d-2d", "ovs_interfaceid": "0479db3d-2d90-4116-b8e7-b1282c111d9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:06:01.262455 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0e8ae70b-3aa7-4adc-aaab-b0d8769ec84a req-89bbb6bf-877b-407a-8ffa-6fa92f86b8b5 service nova] Releasing lock "refresh_cache-0ce1d609-b3fe-4fb6-81ac-7a683c8f1992" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:06:01.322864 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933961.322529, b369292d-fea0-46aa-b5c4-908b8bfb6209 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:06:01.323035 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] VM Started (Lifecycle Event)
May 28 02:06:01.555911 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5fba4675-f2df-4d4c-ad86-47aa8b966e9b req-f3914518-0f84-4842-a510-32b327228609 service nova] Releasing lock "refresh_cache-39ea2f26-6a01-4d24-a2b3-d681e0b22d80" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:06:01.825469 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:06:01.828608 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933961.828066, b369292d-fea0-46aa-b5c4-908b8bfb6209 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:06:01.828748 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] VM Paused (Lifecycle Event)
May 28 02:06:02.072308 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Acquiring lock "19d774e3-96a1-4dd4-8953-062105d5f0b2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:06:02.072476 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Lock "19d774e3-96a1-4dd4-8953-062105d5f0b2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:06:02.072656 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Attaching volume 268feab1-932a-4c23-a2b2-f73cc3f0502b to /dev/vdb
May 28 02:06:02.086214 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-68abebe9-bc1e-4b62-ac3f-71c0d98a3b94 req-c19eb2e0-79fd-4486-9e21-94b018898750 service nova] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Received event network-vif-plugged-c8e61437-9a2f-4506-a4c8-d07d919364b6 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:06:02.088531 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-68abebe9-bc1e-4b62-ac3f-71c0d98a3b94 req-c19eb2e0-79fd-4486-9e21-94b018898750 service nova] Acquiring lock "b369292d-fea0-46aa-b5c4-908b8bfb6209-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:06:02.088797 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-68abebe9-bc1e-4b62-ac3f-71c0d98a3b94 req-c19eb2e0-79fd-4486-9e21-94b018898750 service nova] Lock "b369292d-fea0-46aa-b5c4-908b8bfb6209-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:06:02.089037 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-68abebe9-bc1e-4b62-ac3f-71c0d98a3b94 req-c19eb2e0-79fd-4486-9e21-94b018898750 service nova] Lock "b369292d-fea0-46aa-b5c4-908b8bfb6209-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:06:02.089335 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-68abebe9-bc1e-4b62-ac3f-71c0d98a3b94 req-c19eb2e0-79fd-4486-9e21-94b018898750 service nova] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Processing event network-vif-plugged-c8e61437-9a2f-4506-a4c8-d07d919364b6 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 02:06:02.089546 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-68abebe9-bc1e-4b62-ac3f-71c0d98a3b94 req-c19eb2e0-79fd-4486-9e21-94b018898750 service nova] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Received event network-vif-plugged-c8e61437-9a2f-4506-a4c8-d07d919364b6 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:06:02.089887 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 02:06:02.090760 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-68abebe9-bc1e-4b62-ac3f-71c0d98a3b94 req-c19eb2e0-79fd-4486-9e21-94b018898750 service nova] Acquiring lock "b369292d-fea0-46aa-b5c4-908b8bfb6209-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:06:02.090760 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-68abebe9-bc1e-4b62-ac3f-71c0d98a3b94 req-c19eb2e0-79fd-4486-9e21-94b018898750 service nova] Lock "b369292d-fea0-46aa-b5c4-908b8bfb6209-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:06:02.090760 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-68abebe9-bc1e-4b62-ac3f-71c0d98a3b94 req-c19eb2e0-79fd-4486-9e21-94b018898750 service nova] Lock "b369292d-fea0-46aa-b5c4-908b8bfb6209-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:06:02.090760 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-68abebe9-bc1e-4b62-ac3f-71c0d98a3b94 req-c19eb2e0-79fd-4486-9e21-94b018898750 service nova] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] No waiting events found dispatching network-vif-plugged-c8e61437-9a2f-4506-a4c8-d07d919364b6 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:06:02.090760 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-68abebe9-bc1e-4b62-ac3f-71c0d98a3b94 req-c19eb2e0-79fd-4486-9e21-94b018898750 service nova] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Received unexpected event network-vif-plugged-c8e61437-9a2f-4506-a4c8-d07d919364b6 for instance with vm_state building and task_state spawning.
May 28 02:06:02.094574 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 02:06:02.096028 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Instance spawned successfully.
May 28 02:06:02.096410 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 02:06:02.110101 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:06:02.123466 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 02:06:02.152104 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:06:02.202888 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 02:06:02.203427 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 02:06:02.213977 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 02:06:02.215166 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fee6:d69e', 'fe80::f881:28ff:fef8:dbfc', 'fe80::fc16:3eff:feff:6cb9', 'fe80::501c:3bff:feff:e2e6', 'fe80::fc16:3eff:fe46:8469', 'fe80::d05a:66ff:fe6d:1718', 'fe80::fc16:3eff:fe30:432f', 'fe80::c3c:54ff:fe7c:1b9', 'fe80::fc16:3eff:feed:a3d2', 'fe80::fc16:3eff:fe9c:a66d', 'fe80::34e0:eeff:fee2:bede', 'fe80::fc16:3eff:feb4:d0b8', 'fe80::5461:55ff:fe41:c1b7'] 
May 28 02:06:02.215378 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 02:06:02.215699 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 02:06:02.216188 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] <== get_connector_properties: return (105ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:06:02.216551 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Updating existing volume attachment record: 0d92d4f1-d9a7-4a7d-997a-bdefeed9ce7c {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 02:06:02.332394 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:06:02.334872 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:02.336725 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779933962.3364222, b369292d-fea0-46aa-b5c4-908b8bfb6209 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:06:02.336895 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] VM Resumed (Lifecycle Event)
May 28 02:06:02.603702 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:06:02.603860 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:06:02.604544 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:06:02.604544 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:06:02.604862 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:06:02.605448 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:06:02.781133 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 02:06:02.781469 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b', 'iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '268feab1-932a-4c23-a2b2-f73cc3f0502b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:06:02.781592 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:06:02.781995 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:06:02.782344 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b', 'iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '268feab1-932a-4c23-a2b2-f73cc3f0502b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 02:06:02.794944 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:06:02.795674 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:06:02.796046 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:06:02.796265 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:06:02.797348 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:06:02.798815 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:06:02.810345 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:06:02.810345 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:02.816844 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:06:02.816844 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:02.829905 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b] added
May 28 02:06:02.829905 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:06:02.829905 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:06:02.829905 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:06:02.829905 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:06:02.829905 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:06:02.829905 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:02.829905 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:06:02.830666 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0337(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:06:02.830666 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:06:02.839422 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b] added
May 28 02:06:02.839422 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:06:02.839422 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:06:02.839422 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:06:02.839422 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:06:02.839422 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:06:02.839422 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:02.840469 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:06:02.840715 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:06:02.840935 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0432(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:06:02.841127 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:06:02.842486 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:06:03.111542 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Took 8.15 seconds to spawn the instance on the hypervisor.
May 28 02:06:03.111692 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:06:03.344946 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 02:06:03.463267 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:03.620766 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Took 13.76 seconds to build instance.
May 28 02:06:03.830657 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:06:03.841584 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:06:03.850717 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:06:03.850717 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:06:03.854887 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:06:03.854887 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:03.867720 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:03.873962 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:03.884059 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:06:03.884059 np0000001583 nova-compute[98241]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:06:03.884059 np0000001583 nova-compute[98241]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:03.884059 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:03.884059 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:06:03.884255 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] iscsi session list stdout=tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:06:03.884255 np0000001583 nova-compute[98241]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:06:03.884255 np0000001583 nova-compute[98241]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:03.884255 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:03.884255 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:06:03.890947 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:06:03.890947 np0000001583 nova-compute[98241]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:06:03.890947 np0000001583 nova-compute[98241]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:03.890947 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:03.890947 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:06:03.891092 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] iscsi session list stdout=tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:06:03.891092 np0000001583 nova-compute[98241]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:06:03.891092 np0000001583 nova-compute[98241]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:03.891092 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:03.891092 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:06:03.920595 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b, portal: 192.168.40.100,3260]
May 28 02:06:03.920595 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b, portal: 192.168.40.100,3260] successful.
May 28 02:06:03.920595 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:03.933737 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:03.939484 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b, portal: 192.168.50.100,3260]
May 28 02:06:03.939484 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b, portal: 192.168.50.100,3260] successful.
May 28 02:06:03.939484 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:03.951501 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:06:03.951501 np0000001583 nova-compute[98241]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:06:03.951501 np0000001583 nova-compute[98241]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:03.951501 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:03.951501 np0000001583 nova-compute[98241]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b (non-flash)
May 28 02:06:03.951501 np0000001583 nova-compute[98241]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b (non-flash)
May 28 02:06:03.951501 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:06:03.951696 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] iscsi session list stdout=tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:06:03.951696 np0000001583 nova-compute[98241]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:06:03.951696 np0000001583 nova-compute[98241]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:03.951696 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:03.951696 np0000001583 nova-compute[98241]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b (non-flash)
May 28 02:06:03.951696 np0000001583 nova-compute[98241]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b (non-flash)
May 28 02:06:03.951696 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:06:03.951896 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.156s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:06:03.951988 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:06:03.952805 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] HCTL ('11', '-', '-', 0) found on session 143 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:06:03.952936 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:06:03.961639 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:03.974678 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Searching for a device in session 143 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:06:03.974678 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '268feab1-932a-4c23-a2b2-f73cc3f0502b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:06:03.980723 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:06:03.980723 np0000001583 nova-compute[98241]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:06:03.980723 np0000001583 nova-compute[98241]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:03.980723 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:03.980723 np0000001583 nova-compute[98241]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b (non-flash)
May 28 02:06:03.980723 np0000001583 nova-compute[98241]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b (non-flash)
May 28 02:06:03.980723 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:06:03.980910 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] iscsi session list stdout=tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:06:03.980910 np0000001583 nova-compute[98241]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:06:03.980910 np0000001583 nova-compute[98241]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:03.980910 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:03.980910 np0000001583 nova-compute[98241]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b (non-flash)
May 28 02:06:03.980910 np0000001583 nova-compute[98241]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b (non-flash)
May 28 02:06:03.980910 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:06:03.981650 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.184s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:06:03.981650 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:06:03.982310 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] HCTL ('12', '-', '-', 0) found on session 144 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:06:03.982371 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:06:04.004897 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Searching for a device in session 144 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:06:04.004897 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '268feab1-932a-4c23-a2b2-f73cc3f0502b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:06:04.122495 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-badab091-663c-4d81-b224-3be4c0429597 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "b369292d-fea0-46aa-b5c4-908b8bfb6209" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.266s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:06:04.797618 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 02:06:04.903752 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-805d1e36-fdf0-4b6d-b4c7-654eb486e507 req-e7575533-26fa-4051-9a2a-9aafeed50214 service nova] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Received event network-changed-c8e61437-9a2f-4506-a4c8-d07d919364b6 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:06:04.904196 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-805d1e36-fdf0-4b6d-b4c7-654eb486e507 req-e7575533-26fa-4051-9a2a-9aafeed50214 service nova] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Refreshing instance network info cache due to event network-changed-c8e61437-9a2f-4506-a4c8-d07d919364b6. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:06:04.904196 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-805d1e36-fdf0-4b6d-b4c7-654eb486e507 req-e7575533-26fa-4051-9a2a-9aafeed50214 service nova] Acquiring lock "refresh_cache-b369292d-fea0-46aa-b5c4-908b8bfb6209" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:06:04.904196 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-805d1e36-fdf0-4b6d-b4c7-654eb486e507 req-e7575533-26fa-4051-9a2a-9aafeed50214 service nova] Acquired lock "refresh_cache-b369292d-fea0-46aa-b5c4-908b8bfb6209" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:06:04.904196 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-805d1e36-fdf0-4b6d-b4c7-654eb486e507 req-e7575533-26fa-4051-9a2a-9aafeed50214 service nova] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Refreshing network info cache for port c8e61437-9a2f-4506-a4c8-d07d919364b6 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:06:05.406494 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-805d1e36-fdf0-4b6d-b4c7-654eb486e507 req-e7575533-26fa-4051-9a2a-9aafeed50214 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:06:05.712242 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-805d1e36-fdf0-4b6d-b4c7-654eb486e507 req-e7575533-26fa-4051-9a2a-9aafeed50214 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:06:05.815276 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Found WWN 330000000a9ffd31b for multipath device dm-6 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 02:06:05.815535 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:06:05.815675 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] <== connect_volume: return (3034ms) {'type': 'block', 'scsi_wwn': '330000000a9ffd31b', 'path': '/dev/dm-6', 'multipath_id': '330000000a9ffd31b'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:06:05.815794 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a9ffd31b', 'path': '/dev/dm-6', 'multipath_id': '330000000a9ffd31b'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 02:06:05.818442 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Lazy-loading 'flavor' on Instance uuid 19d774e3-96a1-4dd4-8953-062105d5f0b2 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:06:05.843663 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-805d1e36-fdf0-4b6d-b4c7-654eb486e507 req-e7575533-26fa-4051-9a2a-9aafeed50214 service nova] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Updated VIF entry in instance network info cache for port c8e61437-9a2f-4506-a4c8-d07d919364b6. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:06:05.843910 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-805d1e36-fdf0-4b6d-b4c7-654eb486e507 req-e7575533-26fa-4051-9a2a-9aafeed50214 service nova] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Updating instance_info_cache with network_info: [{"id": "c8e61437-9a2f-4506-a4c8-d07d919364b6", "address": "fa:16:3e:b4:d0:b8", "network": {"id": "ef15cd88-386f-4fc6-8df0-74267f73d3fb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1804869041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b7ada2896b1043bfb246c28ad9d1e174", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8e61437-9a", "ovs_interfaceid": "c8e61437-9a2f-4506-a4c8-d07d919364b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:06:06.321399 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Attempting to attach volume 268feab1-932a-4c23-a2b2-f73cc3f0502b with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98241) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 02:06:06.322980 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] attach device xml: <disk type="block" device="disk">
May 28 02:06:06.322980 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:06:06.322980 np0000001583 nova-compute[98241]:   <alias name="ua-268feab1-932a-4c23-a2b2-f73cc3f0502b"/>
May 28 02:06:06.322980 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-6"/>
May 28 02:06:06.322980 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:06:06.322980 np0000001583 nova-compute[98241]:   <serial>268feab1-932a-4c23-a2b2-f73cc3f0502b</serial>
May 28 02:06:06.322980 np0000001583 nova-compute[98241]: </disk>
May 28 02:06:06.322980 np0000001583 nova-compute[98241]:  {{(pid=98241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 02:06:06.346024 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-805d1e36-fdf0-4b6d-b4c7-654eb486e507 req-e7575533-26fa-4051-9a2a-9aafeed50214 service nova] Releasing lock "refresh_cache-b369292d-fea0-46aa-b5c4-908b8bfb6209" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:06:07.338127 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:07.971750 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:06:07.972015 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:06:07.972280 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:06:07.972751 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] No VIF found with MAC fa:16:3e:ff:6c:b9, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:06:07.977554 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "0cc444e2-c821-4786-b7d7-296bd945d4d4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:06:07.978166 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "0cc444e2-c821-4786-b7d7-296bd945d4d4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:06:08.465316 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:08.482733 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lazy-loading 'flavor' on Instance uuid 0cc444e2-c821-4786-b7d7-296bd945d4d4 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:06:09.346072 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0fe60e84-ebd4-4661-b569-fe3eca59b47e req-db2481dc-59b6-4d4b-9d57-bb0f128e8e02 service nova] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Received event network-changed-84cef5f8-6465-4a29-b1e5-a96f8cd4145b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:06:09.348143 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0fe60e84-ebd4-4661-b569-fe3eca59b47e req-db2481dc-59b6-4d4b-9d57-bb0f128e8e02 service nova] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Refreshing instance network info cache due to event network-changed-84cef5f8-6465-4a29-b1e5-a96f8cd4145b. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:06:09.348462 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0fe60e84-ebd4-4661-b569-fe3eca59b47e req-db2481dc-59b6-4d4b-9d57-bb0f128e8e02 service nova] Acquiring lock "refresh_cache-a2a2bf8a-242c-4f60-b772-5052084fee50" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:06:09.348462 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0fe60e84-ebd4-4661-b569-fe3eca59b47e req-db2481dc-59b6-4d4b-9d57-bb0f128e8e02 service nova] Acquired lock "refresh_cache-a2a2bf8a-242c-4f60-b772-5052084fee50" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:06:09.348635 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-0fe60e84-ebd4-4661-b569-fe3eca59b47e req-db2481dc-59b6-4d4b-9d57-bb0f128e8e02 service nova] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Refreshing network info cache for port 84cef5f8-6465-4a29-b1e5-a96f8cd4145b {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:06:09.490786 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "0cc444e2-c821-4786-b7d7-296bd945d4d4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:06:09.533497 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-391d6bbb-de32-4f18-9476-0aab4a6cb80d tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Lock "19d774e3-96a1-4dd4-8953-062105d5f0b2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.461s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:06:09.698539 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b74e8176-7279-4b00-8f8f-20dbb5608dd4 req-4dbff5f0-0c24-4375-8a9d-e5056e8e72e3 service nova] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Received event volume-extended-268feab1-932a-4c23-a2b2-f73cc3f0502b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:06:09.852005 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-0fe60e84-ebd4-4661-b569-fe3eca59b47e req-db2481dc-59b6-4d4b-9d57-bb0f128e8e02 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:06:09.869766 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Acquiring lock "a2a2bf8a-242c-4f60-b772-5052084fee50" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:06:09.869973 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Lock "a2a2bf8a-242c-4f60-b772-5052084fee50" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:06:09.870252 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Acquiring lock "a2a2bf8a-242c-4f60-b772-5052084fee50-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:06:09.870400 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Lock "a2a2bf8a-242c-4f60-b772-5052084fee50-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:06:09.870521 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Lock "a2a2bf8a-242c-4f60-b772-5052084fee50-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:06:09.872555 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Terminating instance
May 28 02:06:10.201104 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b74e8176-7279-4b00-8f8f-20dbb5608dd4 req-4dbff5f0-0c24-4375-8a9d-e5056e8e72e3 service nova] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Handling volume-extended event for volume 268feab1-932a-4c23-a2b2-f73cc3f0502b {{(pid=98241) extend_volume /opt/stack/nova/nova/compute/manager.py:11836}}
May 28 02:06:10.205653 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-0fe60e84-ebd4-4661-b569-fe3eca59b47e req-db2481dc-59b6-4d4b-9d57-bb0f128e8e02 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:06:10.354068 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-0fe60e84-ebd4-4661-b569-fe3eca59b47e req-db2481dc-59b6-4d4b-9d57-bb0f128e8e02 service nova] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Updated VIF entry in instance network info cache for port 84cef5f8-6465-4a29-b1e5-a96f8cd4145b. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:06:10.354654 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-0fe60e84-ebd4-4661-b569-fe3eca59b47e req-db2481dc-59b6-4d4b-9d57-bb0f128e8e02 service nova] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Updating instance_info_cache with network_info: [{"id": "84cef5f8-6465-4a29-b1e5-a96f8cd4145b", "address": "fa:16:3e:30:43:2f", "network": {"id": "d2e4884a-fbbb-43bb-8732-ef3a2aa18b0a", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1578138919-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c478b25f90f24714a03a0be223706df3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84cef5f8-64", "ovs_interfaceid": "84cef5f8-6465-4a29-b1e5-a96f8cd4145b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:06:10.375854 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 02:06:10.400772 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:10.416914 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:10.421810 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:10.442242 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:10.449344 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:10.613673 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "0cc444e2-c821-4786-b7d7-296bd945d4d4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:06:10.614168 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "0cc444e2-c821-4786-b7d7-296bd945d4d4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:06:10.614168 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Attaching volume 4c3e5215-a437-4105-ae2a-b9a117415efc to /dev/vdb
May 28 02:06:10.662225 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:06:10.677760 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 02:06:10.704866 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-b74e8176-7279-4b00-8f8f-20dbb5608dd4 req-4dbff5f0-0c24-4375-8a9d-e5056e8e72e3 service nova] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Cinder extended volume 268feab1-932a-4c23-a2b2-f73cc3f0502b; extending it to detect new size
May 28 02:06:10.709189 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:06:10.744368 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.998654808000083 future=<Future at 0x7724ec071d00 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:06:10.745574 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.997412549000273 future=<Future at 0x7724ec071d00 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:06:10.745795 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.997150077000242 future=<Future at 0x7724ec071d00 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:06:10.747620 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Instance destroyed successfully.
May 28 02:06:10.749528 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Lazy-loading 'resources' on Instance uuid a2a2bf8a-242c-4f60-b772-5052084fee50 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:06:10.756266 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 02:06:10.756604 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 02:06:10.771945 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 02:06:10.773787 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fee6:d69e', 'fe80::f881:28ff:fef8:dbfc', 'fe80::fc16:3eff:feff:6cb9', 'fe80::501c:3bff:feff:e2e6', 'fe80::fc16:3eff:fe46:8469', 'fe80::d05a:66ff:fe6d:1718', 'fe80::fc16:3eff:feed:a3d2', 'fe80::fc16:3eff:fe9c:a66d', 'fe80::34e0:eeff:fee2:bede', 'fe80::fc16:3eff:feb4:d0b8', 'fe80::5461:55ff:fe41:c1b7'] 
May 28 02:06:10.773787 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 02:06:10.773787 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 02:06:10.773787 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:06:10.774129 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Updating existing volume attachment record: 37475931-0e13-4046-8400-b7afba2265b2 {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 02:06:10.857144 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0fe60e84-ebd4-4661-b569-fe3eca59b47e req-db2481dc-59b6-4d4b-9d57-bb0f128e8e02 service nova] Releasing lock "refresh_cache-a2a2bf8a-242c-4f60-b772-5052084fee50" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:06:11.253527 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T02:05:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBackupRestore-server-835127379',display_name='tempest-TestVolumeBackupRestore-server-835127379',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testvolumebackuprestore-server-835127379',id=61,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyMrgZSYjMUeiSq2hozyfOPWNuOo5jDAxNzkCPw4e0PbQX/K57qTuJS+06TIYpo0z53Oxv5it3o6cwsIotiO+EI4iinNCwA1+wdhy90dAj4gqIrxV4HIGr8GzUS2RX3DQ==',key_name='tempest-TestVolumeBackupRestore-10349980',keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:05:39Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c478b25f90f24714a03a0be223706df3',ramdisk_id='',reservation_id='r-tt4u7ixi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBackupRestore-709519274',owner_user_name='tempest-TestVolumeBackupRestore-709519274-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T02:05:39Z,user_data=None,user_id='e77dd271ad8b4d07891b96412807ec50',uuid=a2a2bf8a-242c-4f60-b772-5052084fee50,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84cef5f8-6465-4a29-b1e5-a96f8cd4145b", "address": "fa:16:3e:30:43:2f", "network": {"id": "d2e4884a-fbbb-43bb-8732-ef3a2aa18b0a", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1578138919-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c478b25f90f24714a03a0be223706df3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84cef5f8-64", "ovs_interfaceid": "84cef5f8-6465-4a29-b1e5-a96f8cd4145b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:06:11.254213 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Converting VIF {"id": "84cef5f8-6465-4a29-b1e5-a96f8cd4145b", "address": "fa:16:3e:30:43:2f", "network": {"id": "d2e4884a-fbbb-43bb-8732-ef3a2aa18b0a", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1578138919-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c478b25f90f24714a03a0be223706df3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84cef5f8-64", "ovs_interfaceid": "84cef5f8-6465-4a29-b1e5-a96f8cd4145b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:06:11.255009 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:43:2f,bridge_name='br-int',has_traffic_filtering=True,id=84cef5f8-6465-4a29-b1e5-a96f8cd4145b,network=Network(d2e4884a-fbbb-43bb-8732-ef3a2aa18b0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84cef5f8-64') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:06:11.255307 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:43:2f,bridge_name='br-int',has_traffic_filtering=True,id=84cef5f8-6465-4a29-b1e5-a96f8cd4145b,network=Network(d2e4884a-fbbb-43bb-8732-ef3a2aa18b0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84cef5f8-64') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:06:11.257137 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:11.257586 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84cef5f8-64, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:06:11.260930 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:06:11.261572 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:11.262719 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:11.262961 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=193c84f9-2511-4209-a68b-d8a14f1a82c4) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:06:11.265045 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:06:11.267124 np0000001583 nova-compute[98241]: INFO os_vif [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:43:2f,bridge_name='br-int',has_traffic_filtering=True,id=84cef5f8-6465-4a29-b1e5-a96f8cd4145b,network=Network(d2e4884a-fbbb-43bb-8732-ef3a2aa18b0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84cef5f8-64')
May 28 02:06:11.269311 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:06:11.270247 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [req-b74e8176-7279-4b00-8f8f-20dbb5608dd4 req-4dbff5f0-0c24-4375-8a9d-e5056e8e72e3 service nova] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] calling os-brick to extend iSCSI Volume {{(pid=98241) extend_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:88}}
May 28 02:06:11.270682 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68', 'iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9690511e-7a48-45cc-a85b-02cc0c6add68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:06:11.270954 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [req-b74e8176-7279-4b00-8f8f-20dbb5608dd4 req-4dbff5f0-0c24-4375-8a9d-e5056e8e72e3 service nova] ==> extend_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b', 'iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '268feab1-932a-4c23-a2b2-f73cc3f0502b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}), 'kwargs': {}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:06:11.271301 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:06:11.271576 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [req-b74e8176-7279-4b00-8f8f-20dbb5608dd4 req-4dbff5f0-0c24-4375-8a9d-e5056e8e72e3 service nova] Acquiring lock "extend_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.extend_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:06:11.272096 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:06:11.272580 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68', 'iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9690511e-7a48-45cc-a85b-02cc0c6add68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:06:11.272776 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:06:11.273176 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [req-b74e8176-7279-4b00-8f8f-20dbb5608dd4 req-4dbff5f0-0c24-4375-8a9d-e5056e8e72e3 service nova] Lock "extend_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.extend_volume" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:06:11.273554 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [req-b74e8176-7279-4b00-8f8f-20dbb5608dd4 req-4dbff5f0-0c24-4375-8a9d-e5056e8e72e3 service nova] Extend volume for {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b', 'iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '268feab1-932a-4c23-a2b2-f73cc3f0502b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}
May 28 02:06:11.273683 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [req-b74e8176-7279-4b00-8f8f-20dbb5608dd4 req-4dbff5f0-0c24-4375-8a9d-e5056e8e72e3 service nova] Multipath discovery for iSCSI enabled
May 28 02:06:11.273879 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [req-b74e8176-7279-4b00-8f8f-20dbb5608dd4 req-4dbff5f0-0c24-4375-8a9d-e5056e8e72e3 service nova] Found paths for volume ['/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b-lun-0', '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b-lun-0']
May 28 02:06:11.274001 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [req-b74e8176-7279-4b00-8f8f-20dbb5608dd4 req-4dbff5f0-0c24-4375-8a9d-e5056e8e72e3 service nova] Checking paths are valid ['/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b-lun-0', '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b-lun-0'] {{(pid=98241) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:711}}
May 28 02:06:11.301045 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [req-b74e8176-7279-4b00-8f8f-20dbb5608dd4 req-4dbff5f0-0c24-4375-8a9d-e5056e8e72e3 service nova] extend volume ['/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b-lun-0', '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b-lun-0'] {{(pid=98241) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:718}}
May 28 02:06:11.301407 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [req-b74e8176-7279-4b00-8f8f-20dbb5608dd4 req-4dbff5f0-0c24-4375-8a9d-e5056e8e72e3 service nova] Running cmd (subprocess): lsscsi {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:06:11.320277 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:06:11.320277 np0000001583 nova-compute[98241]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:06:11.320277 np0000001583 nova-compute[98241]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:11.320277 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:11.320277 np0000001583 nova-compute[98241]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b (non-flash)
May 28 02:06:11.320277 np0000001583 nova-compute[98241]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b (non-flash)
May 28 02:06:11.320277 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:06:11.320683 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] iscsi session list stdout=tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:06:11.320683 np0000001583 nova-compute[98241]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68 (non-flash)
May 28 02:06:11.320683 np0000001583 nova-compute[98241]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:11.320683 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:11.320683 np0000001583 nova-compute[98241]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b (non-flash)
May 28 02:06:11.320683 np0000001583 nova-compute[98241]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b (non-flash)
May 28 02:06:11.320683 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:06:11.321007 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68', '137'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68', '138'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa', '141'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa', '142'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b', '143'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b', '144')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:06:11.321265 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68', '137')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:06:11.322870 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68', '138')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:06:11.323682 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724ec1eaca0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68'): ({'sdb'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:06:11.324058 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Removing multipathed devices sdc, sdb {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:06:11.324491 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Flush multipath device 330000000d2a13dc6 {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:06:11.360339 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [req-b74e8176-7279-4b00-8f8f-20dbb5608dd4 req-4dbff5f0-0c24-4375-8a9d-e5056e8e72e3 service nova] CMD "lsscsi" returned: 0 in 0.059s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:06:11.360832 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [req-b74e8176-7279-4b00-8f8f-20dbb5608dd4 req-4dbff5f0-0c24-4375-8a9d-e5056e8e72e3 service nova] dev_info={'device': '/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b-lun-0', 'host': '11', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=98241) get_device_info /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:201}}
May 28 02:06:11.361039 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [req-b74e8176-7279-4b00-8f8f-20dbb5608dd4 req-4dbff5f0-0c24-4375-8a9d-e5056e8e72e3 service nova] Volume device info = {'device': '/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b-lun-0', 'host': '11', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=98241) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:722}}
May 28 02:06:11.373408 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [req-b74e8176-7279-4b00-8f8f-20dbb5608dd4 req-4dbff5f0-0c24-4375-8a9d-e5056e8e72e3 service nova] Starting size: 1073741824 {{(pid=98241) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:733}}
May 28 02:06:11.380525 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:06:11.409342 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [req-b74e8176-7279-4b00-8f8f-20dbb5608dd4 req-4dbff5f0-0c24-4375-8a9d-e5056e8e72e3 service nova] volume size after scsi device rescan 2147483648 {{(pid=98241) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:739}}
May 28 02:06:11.409342 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [req-b74e8176-7279-4b00-8f8f-20dbb5608dd4 req-4dbff5f0-0c24-4375-8a9d-e5056e8e72e3 service nova] Running cmd (subprocess): lsscsi {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:06:11.431009 np0000001583 nova-compute[98241]: DEBUG os_brick.encryptors [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'plain'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc', 'iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4c3e5215-a437-4105-ae2a-b9a117415efc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '0cc444e2-c821-4786-b7d7-296bd945d4d4', 'attached_at': '', 'detached_at': '', 'volume_id': '4c3e5215-a437-4105-ae2a-b9a117415efc', 'serial': '4c3e5215-a437-4105-ae2a-b9a117415efc'} {{(pid=98241) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 02:06:11.444253 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0c3331b2-da30-4e39-bcaa-ca1af03e7be2 req-98deaa6d-8f8d-42bb-83f7-977a863b911b service nova] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Received event network-vif-unplugged-84cef5f8-6465-4a29-b1e5-a96f8cd4145b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:06:11.445200 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0c3331b2-da30-4e39-bcaa-ca1af03e7be2 req-98deaa6d-8f8d-42bb-83f7-977a863b911b service nova] Acquiring lock "a2a2bf8a-242c-4f60-b772-5052084fee50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:06:11.445717 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0c3331b2-da30-4e39-bcaa-ca1af03e7be2 req-98deaa6d-8f8d-42bb-83f7-977a863b911b service nova] Lock "a2a2bf8a-242c-4f60-b772-5052084fee50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:06:11.445988 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0c3331b2-da30-4e39-bcaa-ca1af03e7be2 req-98deaa6d-8f8d-42bb-83f7-977a863b911b service nova] Lock "a2a2bf8a-242c-4f60-b772-5052084fee50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:06:11.446679 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0c3331b2-da30-4e39-bcaa-ca1af03e7be2 req-98deaa6d-8f8d-42bb-83f7-977a863b911b service nova] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] No waiting events found dispatching network-vif-unplugged-84cef5f8-6465-4a29-b1e5-a96f8cd4145b {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:06:11.447184 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0c3331b2-da30-4e39-bcaa-ca1af03e7be2 req-98deaa6d-8f8d-42bb-83f7-977a863b911b service nova] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Received event network-vif-unplugged-84cef5f8-6465-4a29-b1e5-a96f8cd4145b for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:06:11.447184 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0c3331b2-da30-4e39-bcaa-ca1af03e7be2 req-98deaa6d-8f8d-42bb-83f7-977a863b911b service nova] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Received event network-vif-unplugged-84cef5f8-6465-4a29-b1e5-a96f8cd4145b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:06:11.447358 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:06:11.447818 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0c3331b2-da30-4e39-bcaa-ca1af03e7be2 req-98deaa6d-8f8d-42bb-83f7-977a863b911b service nova] Acquiring lock "a2a2bf8a-242c-4f60-b772-5052084fee50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:06:11.448546 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0c3331b2-da30-4e39-bcaa-ca1af03e7be2 req-98deaa6d-8f8d-42bb-83f7-977a863b911b service nova] Lock "a2a2bf8a-242c-4f60-b772-5052084fee50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:06:11.449379 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 02:06:11.449379 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0c3331b2-da30-4e39-bcaa-ca1af03e7be2 req-98deaa6d-8f8d-42bb-83f7-977a863b911b service nova] Lock "a2a2bf8a-242c-4f60-b772-5052084fee50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:06:11.449528 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0c3331b2-da30-4e39-bcaa-ca1af03e7be2 req-98deaa6d-8f8d-42bb-83f7-977a863b911b service nova] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] No waiting events found dispatching network-vif-unplugged-84cef5f8-6465-4a29-b1e5-a96f8cd4145b {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:06:11.449674 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0c3331b2-da30-4e39-bcaa-ca1af03e7be2 req-98deaa6d-8f8d-42bb-83f7-977a863b911b service nova] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Received event network-vif-unplugged-84cef5f8-6465-4a29-b1e5-a96f8cd4145b for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:06:11.449958 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc', 'iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4c3e5215-a437-4105-ae2a-b9a117415efc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:06:11.450185 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:06:11.470275 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [req-b74e8176-7279-4b00-8f8f-20dbb5608dd4 req-4dbff5f0-0c24-4375-8a9d-e5056e8e72e3 service nova] CMD "lsscsi" returned: 0 in 0.062s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:06:11.471448 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [req-b74e8176-7279-4b00-8f8f-20dbb5608dd4 req-4dbff5f0-0c24-4375-8a9d-e5056e8e72e3 service nova] dev_info={'device': '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b-lun-0', 'host': '12', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=98241) get_device_info /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:201}}
May 28 02:06:11.471448 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [req-b74e8176-7279-4b00-8f8f-20dbb5608dd4 req-4dbff5f0-0c24-4375-8a9d-e5056e8e72e3 service nova] Volume device info = {'device': '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b-lun-0', 'host': '12', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=98241) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:722}}
May 28 02:06:11.480680 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [req-b74e8176-7279-4b00-8f8f-20dbb5608dd4 req-4dbff5f0-0c24-4375-8a9d-e5056e8e72e3 service nova] Starting size: 1073741824 {{(pid=98241) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:733}}
May 28 02:06:11.502557 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:06:11.502758 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:06:11.504190 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:06:11.508994 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [req-b74e8176-7279-4b00-8f8f-20dbb5608dd4 req-4dbff5f0-0c24-4375-8a9d-e5056e8e72e3 service nova] volume size after scsi device rescan 2147483648 {{(pid=98241) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:739}}
May 28 02:06:11.522957 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:06:11.523705 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:06:11.524390 np0000001583 nova-compute[98241]: INFO os_brick.initiator.linuxscsi [req-b74e8176-7279-4b00-8f8f-20dbb5608dd4 req-4dbff5f0-0c24-4375-8a9d-e5056e8e72e3 service nova] Find Multipath device file for volume WWN 330000000a9ffd31b
May 28 02:06:11.525359 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [req-b74e8176-7279-4b00-8f8f-20dbb5608dd4 req-4dbff5f0-0c24-4375-8a9d-e5056e8e72e3 service nova] Checking to see if /dev/disk/by-id/dm-uuid-mpath-330000000a9ffd31b exists yet. {{(pid=98241) wait_for_path /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:482}}
May 28 02:06:11.525359 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [req-b74e8176-7279-4b00-8f8f-20dbb5608dd4 req-4dbff5f0-0c24-4375-8a9d-e5056e8e72e3 service nova] /dev/disk/by-id/dm-uuid-mpath-330000000a9ffd31b has shown up. {{(pid=98241) wait_for_path /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:489}}
May 28 02:06:11.540111 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:11.570526 np0000001583 nova-compute[98241]: INFO os_brick.initiator.linuxscsi [req-b74e8176-7279-4b00-8f8f-20dbb5608dd4 req-4dbff5f0-0c24-4375-8a9d-e5056e8e72e3 service nova] mpath(/dev/disk/by-id/dm-uuid-mpath-330000000a9ffd31b) current size 1073741824
May 28 02:06:11.578599 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 137, target: iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68, portal: 192.168.40.100,3260]
May 28 02:06:11.578599 np0000001583 nova-compute[98241]: Logout of [sid: 137, target: iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68, portal: 192.168.40.100,3260] successful.
May 28 02:06:11.578599 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:11.601165 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:11.605540 np0000001583 nova-compute[98241]: INFO os_brick.initiator.linuxscsi [req-b74e8176-7279-4b00-8f8f-20dbb5608dd4 req-4dbff5f0-0c24-4375-8a9d-e5056e8e72e3 service nova] mpath(/dev/disk/by-id/dm-uuid-mpath-330000000a9ffd31b) new size 2147483648
May 28 02:06:11.605802 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [req-b74e8176-7279-4b00-8f8f-20dbb5608dd4 req-4dbff5f0-0c24-4375-8a9d-e5056e8e72e3 service nova] Lock "extend_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.extend_volume" :: held 0.333s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:06:11.605925 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [req-b74e8176-7279-4b00-8f8f-20dbb5608dd4 req-4dbff5f0-0c24-4375-8a9d-e5056e8e72e3 service nova] <== extend_volume: return (335ms) 2147483648 {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:06:11.606051 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [req-b74e8176-7279-4b00-8f8f-20dbb5608dd4 req-4dbff5f0-0c24-4375-8a9d-e5056e8e72e3 service nova] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Extend iSCSI Volume: new_size=2147483648 {{(pid=98241) extend_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:90}}
May 28 02:06:11.608322 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [req-b74e8176-7279-4b00-8f8f-20dbb5608dd4 req-4dbff5f0-0c24-4375-8a9d-e5056e8e72e3 service nova] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Resizing target device /dev/dm-6 to 2147483648 {{(pid=98241) _resize_attached_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2945}}
May 28 02:06:11.609928 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:11.643325 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 138, target: iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68, portal: 192.168.50.100,3260]
May 28 02:06:11.643325 np0000001583 nova-compute[98241]: Logout of [sid: 138, target: iqn.2023-03.storpool.com:os--volume-9690511e-7a48-45cc-a85b-02cc0c6add68, portal: 192.168.50.100,3260] successful.
May 28 02:06:11.643325 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:11.658760 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:11.659010 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:06:11.659353 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] <== disconnect_volume: return (388ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:06:11.659543 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:06:11.659917 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.210s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:06:11.660225 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc', 'iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4c3e5215-a437-4105-ae2a-b9a117415efc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 02:06:11.660613 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Deleting instance files /opt/stack/data/nova/instances/a2a2bf8a-242c-4f60-b772-5052084fee50_del
May 28 02:06:11.661202 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Deletion of /opt/stack/data/nova/instances/a2a2bf8a-242c-4f60-b772-5052084fee50_del complete
May 28 02:06:11.679140 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:06:11.679989 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:06:11.680601 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:06:11.680819 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:06:11.681305 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:06:11.681562 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:06:11.698497 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:06:11.698497 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:11.699367 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:06:11.699367 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:11.710672 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc] added
May 28 02:06:11.710672 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:06:11.710672 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:06:11.710672 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:06:11.710672 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:06:11.710672 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:06:11.710672 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:11.710936 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:06:11.711098 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0302(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:06:11.711279 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:06:11.716363 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc] added
May 28 02:06:11.716363 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:06:11.716363 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:06:11.716363 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:06:11.716363 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:06:11.716363 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:06:11.716363 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:11.716677 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:06:11.716849 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0353(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:06:11.717063 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:06:12.177098 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Took 1.80 seconds to destroy the instance on the hypervisor.
May 28 02:06:12.178029 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 02:06:12.178404 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 02:06:12.178629 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 02:06:12.179107 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:06:12.285709 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:06:12.371142 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1afe53d7-31be-4d67-9a8f-a5c197ba7300 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Acquiring lock "19d774e3-96a1-4dd4-8953-062105d5f0b2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:06:12.371873 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1afe53d7-31be-4d67-9a8f-a5c197ba7300 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Lock "19d774e3-96a1-4dd4-8953-062105d5f0b2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:06:12.711866 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:06:12.717588 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:06:12.726902 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:06:12.726902 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:06:12.734107 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:06:12.734107 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:12.740677 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:12.747842 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:12.755630 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:12.755630 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:12.755630 np0000001583 nova-compute[98241]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b (non-flash)
May 28 02:06:12.755630 np0000001583 nova-compute[98241]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b (non-flash)
May 28 02:06:12.755630 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:06:12.756413 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsi session list stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:12.756413 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:12.756413 np0000001583 nova-compute[98241]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b (non-flash)
May 28 02:06:12.756413 np0000001583 nova-compute[98241]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b (non-flash)
May 28 02:06:12.756413 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:06:12.764636 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:12.764636 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:12.764636 np0000001583 nova-compute[98241]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b (non-flash)
May 28 02:06:12.764636 np0000001583 nova-compute[98241]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b (non-flash)
May 28 02:06:12.764636 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:06:12.764914 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsi session list stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:12.764914 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:12.764914 np0000001583 nova-compute[98241]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b (non-flash)
May 28 02:06:12.764914 np0000001583 nova-compute[98241]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b (non-flash)
May 28 02:06:12.764914 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:06:12.793803 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc, portal: 192.168.40.100,3260]
May 28 02:06:12.793803 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc, portal: 192.168.40.100,3260] successful.
May 28 02:06:12.793803 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:12.798368 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc, portal: 192.168.50.100,3260]
May 28 02:06:12.798368 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc, portal: 192.168.50.100,3260] successful.
May 28 02:06:12.798368 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:12.808905 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:12.814772 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:12.826443 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:12.826443 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:12.826443 np0000001583 nova-compute[98241]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b (non-flash)
May 28 02:06:12.826443 np0000001583 nova-compute[98241]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b (non-flash)
May 28 02:06:12.826443 np0000001583 nova-compute[98241]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc (non-flash)
May 28 02:06:12.826443 np0000001583 nova-compute[98241]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc (non-flash)
May 28 02:06:12.826443 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:06:12.826443 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsi session list stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:12.826443 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:12.826443 np0000001583 nova-compute[98241]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b (non-flash)
May 28 02:06:12.826443 np0000001583 nova-compute[98241]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b (non-flash)
May 28 02:06:12.826443 np0000001583 nova-compute[98241]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc (non-flash)
May 28 02:06:12.826443 np0000001583 nova-compute[98241]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc (non-flash)
May 28 02:06:12.826443 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:06:12.826443 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.144s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:06:12.826443 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:06:12.826443 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] HCTL ('7', '-', '-', 0) found on session 145 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:06:12.826443 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:06:12.833341 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:12.833341 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:12.833341 np0000001583 nova-compute[98241]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b (non-flash)
May 28 02:06:12.833341 np0000001583 nova-compute[98241]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b (non-flash)
May 28 02:06:12.833341 np0000001583 nova-compute[98241]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc (non-flash)
May 28 02:06:12.833341 np0000001583 nova-compute[98241]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc (non-flash)
May 28 02:06:12.833341 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:06:12.833677 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsi session list stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:12.833677 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:12.833677 np0000001583 nova-compute[98241]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b (non-flash)
May 28 02:06:12.833677 np0000001583 nova-compute[98241]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b (non-flash)
May 28 02:06:12.833677 np0000001583 nova-compute[98241]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc (non-flash)
May 28 02:06:12.833677 np0000001583 nova-compute[98241]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc (non-flash)
May 28 02:06:12.833677 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:06:12.833899 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.153s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:06:12.833982 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:06:12.834771 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] HCTL ('8', '-', '-', 0) found on session 146 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:06:12.834889 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:06:12.846444 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Searching for a device in session 145 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:06:12.846852 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4c3e5215-a437-4105-ae2a-b9a117415efc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:06:12.855330 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Searching for a device in session 146 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:06:12.855603 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '4c3e5215-a437-4105-ae2a-b9a117415efc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:06:12.876333 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-1afe53d7-31be-4d67-9a8f-a5c197ba7300 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Detaching volume 268feab1-932a-4c23-a2b2-f73cc3f0502b
May 28 02:06:12.939590 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-1afe53d7-31be-4d67-9a8f-a5c197ba7300 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Attempting to driver detach volume 268feab1-932a-4c23-a2b2-f73cc3f0502b from mountpoint /dev/vdb
May 28 02:06:12.951122 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1afe53d7-31be-4d67-9a8f-a5c197ba7300 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Found disk vdb by alias ua-268feab1-932a-4c23-a2b2-f73cc3f0502b {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:06:12.952706 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1afe53d7-31be-4d67-9a8f-a5c197ba7300 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Found disk vdb by alias ua-268feab1-932a-4c23-a2b2-f73cc3f0502b {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:06:12.952839 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1afe53d7-31be-4d67-9a8f-a5c197ba7300 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Attempting to detach device vdb from instance 19d774e3-96a1-4dd4-8953-062105d5f0b2 from the persistent domain config. {{(pid=98241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 02:06:12.953121 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-1afe53d7-31be-4d67-9a8f-a5c197ba7300 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:06:12.953121 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:06:12.953121 np0000001583 nova-compute[98241]:   <alias name="ua-268feab1-932a-4c23-a2b2-f73cc3f0502b"/>
May 28 02:06:12.953121 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-6"/>
May 28 02:06:12.953121 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:06:12.953121 np0000001583 nova-compute[98241]:   <serial>268feab1-932a-4c23-a2b2-f73cc3f0502b</serial>
May 28 02:06:12.953121 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 02:06:12.953121 np0000001583 nova-compute[98241]: </disk>
May 28 02:06:12.953121 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:06:12.959170 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-1afe53d7-31be-4d67-9a8f-a5c197ba7300 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Successfully detached device vdb from instance 19d774e3-96a1-4dd4-8953-062105d5f0b2 from the persistent domain config.
May 28 02:06:12.959410 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1afe53d7-31be-4d67-9a8f-a5c197ba7300 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] (1/8): Attempting to detach device vdb with device alias ua-268feab1-932a-4c23-a2b2-f73cc3f0502b from instance 19d774e3-96a1-4dd4-8953-062105d5f0b2 from the live domain config. {{(pid=98241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 02:06:12.959670 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-1afe53d7-31be-4d67-9a8f-a5c197ba7300 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:06:12.959670 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:06:12.959670 np0000001583 nova-compute[98241]:   <alias name="ua-268feab1-932a-4c23-a2b2-f73cc3f0502b"/>
May 28 02:06:12.959670 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-6"/>
May 28 02:06:12.959670 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:06:12.959670 np0000001583 nova-compute[98241]:   <serial>268feab1-932a-4c23-a2b2-f73cc3f0502b</serial>
May 28 02:06:12.959670 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 02:06:12.959670 np0000001583 nova-compute[98241]: </disk>
May 28 02:06:12.959670 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:06:13.037051 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:06:13.465145 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:13.480835 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9d5cea42-b62d-45ae-b103-968021a7b131 req-3ff8f2bd-eab5-4211-9ed0-044ff9a24f2e service nova] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Received event network-vif-deleted-84cef5f8-6465-4a29-b1e5-a96f8cd4145b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:06:13.497625 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Received event <DeviceRemovedEvent: 1779933973.4971588, 19d774e3-96a1-4dd4-8953-062105d5f0b2 => ua-268feab1-932a-4c23-a2b2-f73cc3f0502b> from libvirt while the driver is waiting for it; dispatched. {{(pid=98241) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 02:06:13.499607 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1afe53d7-31be-4d67-9a8f-a5c197ba7300 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-268feab1-932a-4c23-a2b2-f73cc3f0502b for instance 19d774e3-96a1-4dd4-8953-062105d5f0b2 {{(pid=98241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 02:06:13.504964 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-1afe53d7-31be-4d67-9a8f-a5c197ba7300 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Successfully detached device vdb from instance 19d774e3-96a1-4dd4-8953-062105d5f0b2 from the live domain config.
May 28 02:06:13.506435 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1afe53d7-31be-4d67-9a8f-a5c197ba7300 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:06:13.506864 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afe53d7-31be-4d67-9a8f-a5c197ba7300 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b', 'iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '268feab1-932a-4c23-a2b2-f73cc3f0502b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': False}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:06:13.507249 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-1afe53d7-31be-4d67-9a8f-a5c197ba7300 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:06:13.536115 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Took 1.36 seconds to deallocate network for instance.
May 28 02:06:13.680643 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 02:06:14.091125 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Took 0.55 seconds to detach 1 volumes for instance.
May 28 02:06:14.596288 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:06:14.596447 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:06:14.702430 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Found WWN 330000000c886bb45 for multipath device dm-0 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 02:06:14.702680 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.043s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:06:14.703063 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-1afe53d7-31be-4d67-9a8f-a5c197ba7300 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.196s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:06:14.703504 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afe53d7-31be-4d67-9a8f-a5c197ba7300 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b', 'iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '268feab1-932a-4c23-a2b2-f73cc3f0502b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:06:14.703758 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afe53d7-31be-4d67-9a8f-a5c197ba7300 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:06:14.707209 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] <== connect_volume: return (3257ms) {'type': 'block', 'scsi_wwn': '330000000c886bb45', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '330000000c886bb45'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:06:14.707355 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c886bb45', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '330000000c886bb45'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 02:06:14.709350 np0000001583 nova-compute[98241]: WARNING stevedore.named [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 02:06:14.709581 np0000001583 nova-compute[98241]: WARNING castellan.key_manager [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 02:06:14.709900 np0000001583 nova-compute[98241]: WARNING nova.keymgr.conf_key_mgr [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 02:06:14.711346 np0000001583 nova-compute[98241]: DEBUG os_brick.encryptors [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Using volume encryptor '<os_brick.encryptors.cryptsetup.CryptsetupEncryptor object at 0x7724ec0652e0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc', 'iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4c3e5215-a437-4105-ae2a-b9a117415efc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': '0cc444e2-c821-4786-b7d7-296bd945d4d4', 'attached_at': '', 'detached_at': '', 'volume_id': '4c3e5215-a437-4105-ae2a-b9a117415efc', 'serial': '4c3e5215-a437-4105-ae2a-b9a117415efc'} {{(pid=98241) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 28 02:06:14.711622 np0000001583 nova-compute[98241]: WARNING os_brick.encryptors.cryptsetup [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Deprecated: The plain CryptsetupEncryptor is deprecated and will be removed in a future release. Existing users are encouraged to retype any existing volumes using this encryptor to the 'luks' LuksEncryptor or 'luks2' Luks2Encryptor encryptors as soon as possible.
May 28 02:06:14.711816 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] os_brick.utils.get_passphrase_from_secret: the secret is not of type passphrase and will be converted using hex representation {{(pid=98241) get_passphrase_from_secret /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:486}}
May 28 02:06:14.711939 np0000001583 nova-compute[98241]: DEBUG os_brick.encryptors.cryptsetup [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] opening encrypted volume /dev/dm-0 {{(pid=98241) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/cryptsetup.py:104}}
May 28 02:06:14.737712 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afe53d7-31be-4d67-9a8f-a5c197ba7300 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:14.737712 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:14.737712 np0000001583 nova-compute[98241]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b (non-flash)
May 28 02:06:14.737712 np0000001583 nova-compute[98241]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b (non-flash)
May 28 02:06:14.737712 np0000001583 nova-compute[98241]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc (non-flash)
May 28 02:06:14.737712 np0000001583 nova-compute[98241]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc (non-flash)
May 28 02:06:14.737712 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:06:14.738370 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afe53d7-31be-4d67-9a8f-a5c197ba7300 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] iscsi session list stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:14.738370 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:14.738370 np0000001583 nova-compute[98241]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b (non-flash)
May 28 02:06:14.738370 np0000001583 nova-compute[98241]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b (non-flash)
May 28 02:06:14.738370 np0000001583 nova-compute[98241]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc (non-flash)
May 28 02:06:14.738370 np0000001583 nova-compute[98241]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc (non-flash)
May 28 02:06:14.738370 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:06:14.738779 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afe53d7-31be-4d67-9a8f-a5c197ba7300 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa', '141'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa', '142'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b', '143'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b', '144'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc', '145'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc', '146')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:06:14.739230 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afe53d7-31be-4d67-9a8f-a5c197ba7300 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b', '143')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:06:14.742017 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afe53d7-31be-4d67-9a8f-a5c197ba7300 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b', '144')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:06:14.743025 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afe53d7-31be-4d67-9a8f-a5c197ba7300 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724ec1aed40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b'): ({'sdg'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:06:14.743271 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-1afe53d7-31be-4d67-9a8f-a5c197ba7300 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Removing multipathed devices sdf, sdg {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:06:14.743554 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-1afe53d7-31be-4d67-9a8f-a5c197ba7300 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Flush multipath device 330000000a9ffd31b {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:06:14.778268 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-1afe53d7-31be-4d67-9a8f-a5c197ba7300 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:06:14.813759 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lazy-loading 'flavor' on Instance uuid 0cc444e2-c821-4786-b7d7-296bd945d4d4 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:06:14.823527 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-1afe53d7-31be-4d67-9a8f-a5c197ba7300 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:06:14.872594 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-1afe53d7-31be-4d67-9a8f-a5c197ba7300 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:06:14.872772 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-1afe53d7-31be-4d67-9a8f-a5c197ba7300 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:06:14.873687 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-1afe53d7-31be-4d67-9a8f-a5c197ba7300 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:06:14.885979 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-1afe53d7-31be-4d67-9a8f-a5c197ba7300 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:06:14.886127 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afe53d7-31be-4d67-9a8f-a5c197ba7300 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:06:14.900843 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afe53d7-31be-4d67-9a8f-a5c197ba7300 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:14.930162 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afe53d7-31be-4d67-9a8f-a5c197ba7300 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 143, target: iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b, portal: 192.168.40.100,3260]
May 28 02:06:14.930162 np0000001583 nova-compute[98241]: Logout of [sid: 143, target: iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b, portal: 192.168.40.100,3260] successful.
May 28 02:06:14.930162 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:14.944537 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afe53d7-31be-4d67-9a8f-a5c197ba7300 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:14.955807 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afe53d7-31be-4d67-9a8f-a5c197ba7300 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:14.983331 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afe53d7-31be-4d67-9a8f-a5c197ba7300 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 144, target: iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b, portal: 192.168.50.100,3260]
May 28 02:06:14.983331 np0000001583 nova-compute[98241]: Logout of [sid: 144, target: iqn.2023-03.storpool.com:os--volume-268feab1-932a-4c23-a2b2-f73cc3f0502b, portal: 192.168.50.100,3260] successful.
May 28 02:06:14.983331 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:15.007587 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afe53d7-31be-4d67-9a8f-a5c197ba7300 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:15.007810 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-1afe53d7-31be-4d67-9a8f-a5c197ba7300 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:06:15.007985 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afe53d7-31be-4d67-9a8f-a5c197ba7300 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] <== disconnect_volume: return (1501ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:06:15.008187 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1afe53d7-31be-4d67-9a8f-a5c197ba7300 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:06:15.026599 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:06:15.026899 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:06:15.318892 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Attempting to attach volume 4c3e5215-a437-4105-ae2a-b9a117415efc with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98241) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 02:06:15.320806 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] attach device xml: <disk type="block" device="disk">
May 28 02:06:15.320806 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:06:15.320806 np0000001583 nova-compute[98241]:   <alias name="ua-4c3e5215-a437-4105-ae2a-b9a117415efc"/>
May 28 02:06:15.320806 np0000001583 nova-compute[98241]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 28 02:06:15.320806 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:06:15.320806 np0000001583 nova-compute[98241]:   <serial>4c3e5215-a437-4105-ae2a-b9a117415efc</serial>
May 28 02:06:15.320806 np0000001583 nova-compute[98241]: </disk>
May 28 02:06:15.320806 np0000001583 nova-compute[98241]:  {{(pid=98241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 02:06:15.530129 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:06:15.562974 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-1afe53d7-31be-4d67-9a8f-a5c197ba7300 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Lazy-loading 'flavor' on Instance uuid 19d774e3-96a1-4dd4-8953-062105d5f0b2 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:06:16.041177 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.442s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:06:16.106267 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Deleted allocations for instance a2a2bf8a-242c-4f60-b772-5052084fee50
May 28 02:06:16.275933 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:16.569494 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1afe53d7-31be-4d67-9a8f-a5c197ba7300 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Lock "19d774e3-96a1-4dd4-8953-062105d5f0b2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.198s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:06:16.675735 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7656c807-e576-4e90-8479-52652611812f tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Acquiring lock "19d774e3-96a1-4dd4-8953-062105d5f0b2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:06:16.675932 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7656c807-e576-4e90-8479-52652611812f tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Lock "19d774e3-96a1-4dd4-8953-062105d5f0b2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:06:16.676141 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7656c807-e576-4e90-8479-52652611812f tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Acquiring lock "19d774e3-96a1-4dd4-8953-062105d5f0b2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:06:16.676302 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7656c807-e576-4e90-8479-52652611812f tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Lock "19d774e3-96a1-4dd4-8953-062105d5f0b2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:06:16.676426 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7656c807-e576-4e90-8479-52652611812f tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Lock "19d774e3-96a1-4dd4-8953-062105d5f0b2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:06:16.678371 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-7656c807-e576-4e90-8479-52652611812f tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Terminating instance
May 28 02:06:16.989781 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:06:16.989948 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:06:16.990056 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:06:16.990207 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] No VIF found with MAC fa:16:3e:46:84:69, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:06:17.116421 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6b66fb02-8f88-4fa4-aa51-5ea30a27dce1 tempest-TestVolumeBackupRestore-709519274 tempest-TestVolumeBackupRestore-709519274-project-member] Lock "a2a2bf8a-242c-4f60-b772-5052084fee50" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.246s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:06:17.181338 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-7656c807-e576-4e90-8479-52652611812f tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 02:06:17.195206 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:17.198010 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:17.219339 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:17.230191 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:17.254416 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:17.332734 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-85d2e054-28f7-439a-9513-8d4619319e3d req-02f91c4b-208c-4018-b075-d19f0b4c0a86 service nova] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Received event network-vif-unplugged-deb0d435-44b2-4669-a015-149a269fbdd5 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:06:17.336152 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-85d2e054-28f7-439a-9513-8d4619319e3d req-02f91c4b-208c-4018-b075-d19f0b4c0a86 service nova] Acquiring lock "19d774e3-96a1-4dd4-8953-062105d5f0b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:06:17.336152 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-85d2e054-28f7-439a-9513-8d4619319e3d req-02f91c4b-208c-4018-b075-d19f0b4c0a86 service nova] Lock "19d774e3-96a1-4dd4-8953-062105d5f0b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:06:17.336152 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-85d2e054-28f7-439a-9513-8d4619319e3d req-02f91c4b-208c-4018-b075-d19f0b4c0a86 service nova] Lock "19d774e3-96a1-4dd4-8953-062105d5f0b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:06:17.336152 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-85d2e054-28f7-439a-9513-8d4619319e3d req-02f91c4b-208c-4018-b075-d19f0b4c0a86 service nova] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] No waiting events found dispatching network-vif-unplugged-deb0d435-44b2-4669-a015-149a269fbdd5 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:06:17.336152 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-85d2e054-28f7-439a-9513-8d4619319e3d req-02f91c4b-208c-4018-b075-d19f0b4c0a86 service nova] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Received event network-vif-unplugged-deb0d435-44b2-4669-a015-149a269fbdd5 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:06:17.515941 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.99972789100002 future=<Future at 0x7724f84652b0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:06:17.518188 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Instance destroyed successfully.
May 28 02:06:17.518552 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-7656c807-e576-4e90-8479-52652611812f tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Lazy-loading 'resources' on Instance uuid 19d774e3-96a1-4dd4-8953-062105d5f0b2 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:06:18.020691 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-7656c807-e576-4e90-8479-52652611812f tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T02:05:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesExtendAttachedTest-instance-1266036083',display_name='tempest-VolumesExtendAttachedTest-instance-1266036083',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-volumesextendattachedtest-instance-1266036083',id=59,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQ8J7rQr/v8G5T6OlyrmtM5zGrUSsJ2+og2hpIpxkCvfCgFxRwjj/WUd+jw0pQDDw2DL1ZT4S6gLVnwD+TKZdDXwltO0IcfFVo/3xV90Zvw+P70ZrHjBXcFgWF0UT1CQQ==',key_name='tempest-keypair-1067261923',keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:05:21Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d772abe23aca4eb5b0e7b107c859c20b',ramdisk_id='',reservation_id='r-e5acg04t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesExtendAttachedTest-1888616504',owner_user_name='tempest-VolumesExtendAttachedTest-1888616504-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T02:05:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='20d40467c45044a5aaeaa43c84e7a470',uuid=19d774e3-96a1-4dd4-8953-062105d5f0b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "deb0d435-44b2-4669-a015-149a269fbdd5", "address": "fa:16:3e:ff:6c:b9", "network": {"id": "2c66b30f-b14b-4986-ac5f-ecd11f2846b0", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1535175285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d772abe23aca4eb5b0e7b107c859c20b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb0d435-44", "ovs_interfaceid": "deb0d435-44b2-4669-a015-149a269fbdd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:06:18.021165 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-7656c807-e576-4e90-8479-52652611812f tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Converting VIF {"id": "deb0d435-44b2-4669-a015-149a269fbdd5", "address": "fa:16:3e:ff:6c:b9", "network": {"id": "2c66b30f-b14b-4986-ac5f-ecd11f2846b0", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1535175285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d772abe23aca4eb5b0e7b107c859c20b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb0d435-44", "ovs_interfaceid": "deb0d435-44b2-4669-a015-149a269fbdd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:06:18.021704 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-7656c807-e576-4e90-8479-52652611812f tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:6c:b9,bridge_name='br-int',has_traffic_filtering=True,id=deb0d435-44b2-4669-a015-149a269fbdd5,network=Network(2c66b30f-b14b-4986-ac5f-ecd11f2846b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeb0d435-44') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:06:18.021988 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-7656c807-e576-4e90-8479-52652611812f tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:6c:b9,bridge_name='br-int',has_traffic_filtering=True,id=deb0d435-44b2-4669-a015-149a269fbdd5,network=Network(2c66b30f-b14b-4986-ac5f-ecd11f2846b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeb0d435-44') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:06:18.023558 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:18.023794 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdeb0d435-44, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:06:18.027759 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:06:18.029525 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:18.029525 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e4566d27-e8e0-4e5b-9ec0-58f4222e61d7) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:06:18.030488 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:06:18.032702 np0000001583 nova-compute[98241]: INFO os_vif [None req-7656c807-e576-4e90-8479-52652611812f tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:6c:b9,bridge_name='br-int',has_traffic_filtering=True,id=deb0d435-44b2-4669-a015-149a269fbdd5,network=Network(2c66b30f-b14b-4986-ac5f-ecd11f2846b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeb0d435-44')
May 28 02:06:18.033440 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-7656c807-e576-4e90-8479-52652611812f tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Deleting instance files /opt/stack/data/nova/instances/19d774e3-96a1-4dd4-8953-062105d5f0b2_del
May 28 02:06:18.034279 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-7656c807-e576-4e90-8479-52652611812f tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Deletion of /opt/stack/data/nova/instances/19d774e3-96a1-4dd4-8953-062105d5f0b2_del complete
May 28 02:06:18.482588 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:18.540614 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-7656c807-e576-4e90-8479-52652611812f tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Took 1.36 seconds to destroy the instance on the hypervisor.
May 28 02:06:18.541110 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-7656c807-e576-4e90-8479-52652611812f tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 02:06:18.541316 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 02:06:18.541453 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 02:06:18.541946 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:06:18.572108 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-494086e7-e920-4a7b-b5f4-0040a8f246f7 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "0cc444e2-c821-4786-b7d7-296bd945d4d4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.958s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:06:18.615464 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:06:19.082653 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-24458254-993e-4fe1-a0cf-e8f98e416e9a req-9b3d4c78-0b9f-4514-a118-7668edb40395 service nova] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Received event network-vif-deleted-deb0d435-44b2-4669-a015-149a269fbdd5 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:06:19.083390 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-24458254-993e-4fe1-a0cf-e8f98e416e9a req-9b3d4c78-0b9f-4514-a118-7668edb40395 service nova] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Neutron deleted interface deb0d435-44b2-4669-a015-149a269fbdd5; detaching it from the instance and deleting it from the info cache
May 28 02:06:19.084933 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-24458254-993e-4fe1-a0cf-e8f98e416e9a req-9b3d4c78-0b9f-4514-a118-7668edb40395 service nova] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Detach interface failed, port_id=deb0d435-44b2-4669-a015-149a269fbdd5, reason: Instance 19d774e3-96a1-4dd4-8953-062105d5f0b2 could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 02:06:19.397444 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-8c279584-cb7b-47db-acc3-67e94062edad req-a8b2faee-1b06-4866-a24c-2d112b7cf5c7 service nova] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Received event network-vif-unplugged-deb0d435-44b2-4669-a015-149a269fbdd5 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:06:19.398174 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-8c279584-cb7b-47db-acc3-67e94062edad req-a8b2faee-1b06-4866-a24c-2d112b7cf5c7 service nova] Acquiring lock "19d774e3-96a1-4dd4-8953-062105d5f0b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:06:19.398439 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-8c279584-cb7b-47db-acc3-67e94062edad req-a8b2faee-1b06-4866-a24c-2d112b7cf5c7 service nova] Lock "19d774e3-96a1-4dd4-8953-062105d5f0b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:06:19.398617 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-8c279584-cb7b-47db-acc3-67e94062edad req-a8b2faee-1b06-4866-a24c-2d112b7cf5c7 service nova] Lock "19d774e3-96a1-4dd4-8953-062105d5f0b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:06:19.398795 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-8c279584-cb7b-47db-acc3-67e94062edad req-a8b2faee-1b06-4866-a24c-2d112b7cf5c7 service nova] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] No waiting events found dispatching network-vif-unplugged-deb0d435-44b2-4669-a015-149a269fbdd5 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:06:19.398934 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-8c279584-cb7b-47db-acc3-67e94062edad req-a8b2faee-1b06-4866-a24c-2d112b7cf5c7 service nova] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Received event network-vif-unplugged-deb0d435-44b2-4669-a015-149a269fbdd5 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:06:19.519971 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-32baaae1-2bc6-43dd-a6d6-26558a1484d3 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "0cc444e2-c821-4786-b7d7-296bd945d4d4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:06:19.520203 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-32baaae1-2bc6-43dd-a6d6-26558a1484d3 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "0cc444e2-c821-4786-b7d7-296bd945d4d4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:06:19.525161 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:06:20.023180 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-32baaae1-2bc6-43dd-a6d6-26558a1484d3 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Detaching volume 4c3e5215-a437-4105-ae2a-b9a117415efc
May 28 02:06:20.028677 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Took 1.49 seconds to deallocate network for instance.
May 28 02:06:20.073226 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-32baaae1-2bc6-43dd-a6d6-26558a1484d3 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Attempting to driver detach volume 4c3e5215-a437-4105-ae2a-b9a117415efc from mountpoint /dev/vdb
May 28 02:06:20.118059 np0000001583 nova-compute[98241]: DEBUG os_brick.encryptors [None req-32baaae1-2bc6-43dd-a6d6-26558a1484d3 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'plain'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc', 'iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4c3e5215-a437-4105-ae2a-b9a117415efc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': '0cc444e2-c821-4786-b7d7-296bd945d4d4', 'attached_at': '', 'detached_at': '', 'volume_id': '4c3e5215-a437-4105-ae2a-b9a117415efc', 'serial': '4c3e5215-a437-4105-ae2a-b9a117415efc'} {{(pid=98241) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 02:06:20.122721 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-32baaae1-2bc6-43dd-a6d6-26558a1484d3 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Found disk vdb by alias ua-4c3e5215-a437-4105-ae2a-b9a117415efc {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:06:20.124435 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-32baaae1-2bc6-43dd-a6d6-26558a1484d3 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Found disk vdb by alias ua-4c3e5215-a437-4105-ae2a-b9a117415efc {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:06:20.124636 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-32baaae1-2bc6-43dd-a6d6-26558a1484d3 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Attempting to detach device vdb from instance 0cc444e2-c821-4786-b7d7-296bd945d4d4 from the persistent domain config. {{(pid=98241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 02:06:20.125052 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-32baaae1-2bc6-43dd-a6d6-26558a1484d3 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:06:20.125052 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:06:20.125052 np0000001583 nova-compute[98241]:   <alias name="ua-4c3e5215-a437-4105-ae2a-b9a117415efc"/>
May 28 02:06:20.125052 np0000001583 nova-compute[98241]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 28 02:06:20.125052 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:06:20.125052 np0000001583 nova-compute[98241]:   <serial>4c3e5215-a437-4105-ae2a-b9a117415efc</serial>
May 28 02:06:20.125052 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 02:06:20.125052 np0000001583 nova-compute[98241]: </disk>
May 28 02:06:20.125052 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:06:20.131917 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-32baaae1-2bc6-43dd-a6d6-26558a1484d3 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Successfully detached device vdb from instance 0cc444e2-c821-4786-b7d7-296bd945d4d4 from the persistent domain config.
May 28 02:06:20.132162 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-32baaae1-2bc6-43dd-a6d6-26558a1484d3 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] (1/8): Attempting to detach device vdb with device alias ua-4c3e5215-a437-4105-ae2a-b9a117415efc from instance 0cc444e2-c821-4786-b7d7-296bd945d4d4 from the live domain config. {{(pid=98241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 02:06:20.132480 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-32baaae1-2bc6-43dd-a6d6-26558a1484d3 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:06:20.132480 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:06:20.132480 np0000001583 nova-compute[98241]:   <alias name="ua-4c3e5215-a437-4105-ae2a-b9a117415efc"/>
May 28 02:06:20.132480 np0000001583 nova-compute[98241]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 28 02:06:20.132480 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:06:20.132480 np0000001583 nova-compute[98241]:   <serial>4c3e5215-a437-4105-ae2a-b9a117415efc</serial>
May 28 02:06:20.132480 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 02:06:20.132480 np0000001583 nova-compute[98241]: </disk>
May 28 02:06:20.132480 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:06:20.193762 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:06:20.194317 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:06:20.194317 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:06:20.531337 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:20.535297 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7656c807-e576-4e90-8479-52652611812f tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:06:20.535524 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7656c807-e576-4e90-8479-52652611812f tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:06:20.720309 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Received event <DeviceRemovedEvent: 1779933980.7198796, 0cc444e2-c821-4786-b7d7-296bd945d4d4 => ua-4c3e5215-a437-4105-ae2a-b9a117415efc> from libvirt while the driver is waiting for it; dispatched. {{(pid=98241) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 02:06:20.721438 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-32baaae1-2bc6-43dd-a6d6-26558a1484d3 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-4c3e5215-a437-4105-ae2a-b9a117415efc for instance 0cc444e2-c821-4786-b7d7-296bd945d4d4 {{(pid=98241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 02:06:20.727093 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-32baaae1-2bc6-43dd-a6d6-26558a1484d3 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Successfully detached device vdb from instance 0cc444e2-c821-4786-b7d7-296bd945d4d4 from the live domain config.
May 28 02:06:20.728387 np0000001583 nova-compute[98241]: WARNING stevedore.named [None req-32baaae1-2bc6-43dd-a6d6-26558a1484d3 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 02:06:20.728622 np0000001583 nova-compute[98241]: WARNING castellan.key_manager [None req-32baaae1-2bc6-43dd-a6d6-26558a1484d3 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 02:06:20.728716 np0000001583 nova-compute[98241]: WARNING nova.keymgr.conf_key_mgr [None req-32baaae1-2bc6-43dd-a6d6-26558a1484d3 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 02:06:20.729192 np0000001583 nova-compute[98241]: DEBUG os_brick.encryptors [None req-32baaae1-2bc6-43dd-a6d6-26558a1484d3 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Using volume encryptor '<os_brick.encryptors.cryptsetup.CryptsetupEncryptor object at 0x7724f87e4fe0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc', 'iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4c3e5215-a437-4105-ae2a-b9a117415efc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': '0cc444e2-c821-4786-b7d7-296bd945d4d4', 'attached_at': '', 'detached_at': '', 'volume_id': '4c3e5215-a437-4105-ae2a-b9a117415efc', 'serial': '4c3e5215-a437-4105-ae2a-b9a117415efc'} {{(pid=98241) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 28 02:06:20.729340 np0000001583 nova-compute[98241]: DEBUG os_brick.encryptors.cryptsetup [None req-32baaae1-2bc6-43dd-a6d6-26558a1484d3 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] closing encrypted volume /dev/dm-4 {{(pid=98241) _close_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/cryptsetup.py:153}}
May 28 02:06:20.756617 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32baaae1-2bc6-43dd-a6d6-26558a1484d3 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:06:20.756798 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-32baaae1-2bc6-43dd-a6d6-26558a1484d3 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc', 'iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4c3e5215-a437-4105-ae2a-b9a117415efc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:06:20.757680 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-32baaae1-2bc6-43dd-a6d6-26558a1484d3 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:06:20.757680 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-32baaae1-2bc6-43dd-a6d6-26558a1484d3 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:06:20.757680 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-32baaae1-2bc6-43dd-a6d6-26558a1484d3 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc', 'iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4c3e5215-a437-4105-ae2a-b9a117415efc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:06:20.757863 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-32baaae1-2bc6-43dd-a6d6-26558a1484d3 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:06:20.783269 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-32baaae1-2bc6-43dd-a6d6-26558a1484d3 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:20.783269 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:20.783269 np0000001583 nova-compute[98241]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc (non-flash)
May 28 02:06:20.783269 np0000001583 nova-compute[98241]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc (non-flash)
May 28 02:06:20.783269 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:06:20.783633 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-32baaae1-2bc6-43dd-a6d6-26558a1484d3 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsi session list stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:20.783633 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:20.783633 np0000001583 nova-compute[98241]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc (non-flash)
May 28 02:06:20.783633 np0000001583 nova-compute[98241]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc (non-flash)
May 28 02:06:20.783633 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:06:20.783633 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-32baaae1-2bc6-43dd-a6d6-26558a1484d3 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa', '141'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa', '142'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc', '145'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc', '146')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:06:20.784044 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-32baaae1-2bc6-43dd-a6d6-26558a1484d3 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc', '145')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:06:20.784611 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-32baaae1-2bc6-43dd-a6d6-26558a1484d3 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc', '146')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:06:20.785351 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-32baaae1-2bc6-43dd-a6d6-26558a1484d3 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724ec325ee0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc'): ({'sdc'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:06:20.785541 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-32baaae1-2bc6-43dd-a6d6-26558a1484d3 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Removing multipathed devices sdc, sdb {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:06:20.785811 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-32baaae1-2bc6-43dd-a6d6-26558a1484d3 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Flush multipath device 330000000c886bb45 {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:06:20.822447 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-32baaae1-2bc6-43dd-a6d6-26558a1484d3 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:06:20.863979 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-32baaae1-2bc6-43dd-a6d6-26558a1484d3 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:06:20.882193 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-7656c807-e576-4e90-8479-52652611812f tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:06:20.882433 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-7656c807-e576-4e90-8479-52652611812f tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:06:20.918935 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-32baaae1-2bc6-43dd-a6d6-26558a1484d3 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:06:20.919184 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-32baaae1-2bc6-43dd-a6d6-26558a1484d3 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:06:20.920612 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-32baaae1-2bc6-43dd-a6d6-26558a1484d3 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:06:20.934107 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-32baaae1-2bc6-43dd-a6d6-26558a1484d3 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:06:20.934329 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-32baaae1-2bc6-43dd-a6d6-26558a1484d3 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:06:20.948206 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-32baaae1-2bc6-43dd-a6d6-26558a1484d3 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:20.979870 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-32baaae1-2bc6-43dd-a6d6-26558a1484d3 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 145, target: iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc, portal: 192.168.40.100,3260]
May 28 02:06:20.979870 np0000001583 nova-compute[98241]: Logout of [sid: 145, target: iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc, portal: 192.168.40.100,3260] successful.
May 28 02:06:20.979870 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:20.994062 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-32baaae1-2bc6-43dd-a6d6-26558a1484d3 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:21.005483 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-32baaae1-2bc6-43dd-a6d6-26558a1484d3 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:21.037586 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-32baaae1-2bc6-43dd-a6d6-26558a1484d3 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 146, target: iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc, portal: 192.168.50.100,3260]
May 28 02:06:21.037586 np0000001583 nova-compute[98241]: Logout of [sid: 146, target: iqn.2023-03.storpool.com:os--volume-4c3e5215-a437-4105-ae2a-b9a117415efc, portal: 192.168.50.100,3260] successful.
May 28 02:06:21.037586 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:21.053791 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-32baaae1-2bc6-43dd-a6d6-26558a1484d3 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:21.054954 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-32baaae1-2bc6-43dd-a6d6-26558a1484d3 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:06:21.055067 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-32baaae1-2bc6-43dd-a6d6-26558a1484d3 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] <== disconnect_volume: return (298ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:06:21.055211 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32baaae1-2bc6-43dd-a6d6-26558a1484d3 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:06:21.193814 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:06:21.194228 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:06:21.385874 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-7656c807-e576-4e90-8479-52652611812f tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:06:21.607887 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-32baaae1-2bc6-43dd-a6d6-26558a1484d3 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lazy-loading 'flavor' on Instance uuid 0cc444e2-c821-4786-b7d7-296bd945d4d4 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:06:21.892616 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7656c807-e576-4e90-8479-52652611812f tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.357s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:06:21.941915 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-7656c807-e576-4e90-8479-52652611812f tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Deleted allocations for instance 19d774e3-96a1-4dd4-8953-062105d5f0b2
May 28 02:06:22.360119 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:22.613567 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-32baaae1-2bc6-43dd-a6d6-26558a1484d3 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "0cc444e2-c821-4786-b7d7-296bd945d4d4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.093s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:06:22.816669 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2c278a3d-0ce3-4144-85ac-42e83c57e27f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "0cc444e2-c821-4786-b7d7-296bd945d4d4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:06:22.816822 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2c278a3d-0ce3-4144-85ac-42e83c57e27f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "0cc444e2-c821-4786-b7d7-296bd945d4d4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:06:22.816970 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2c278a3d-0ce3-4144-85ac-42e83c57e27f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "0cc444e2-c821-4786-b7d7-296bd945d4d4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:06:22.817084 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2c278a3d-0ce3-4144-85ac-42e83c57e27f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "0cc444e2-c821-4786-b7d7-296bd945d4d4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:06:22.817226 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2c278a3d-0ce3-4144-85ac-42e83c57e27f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "0cc444e2-c821-4786-b7d7-296bd945d4d4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:06:22.819166 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-2c278a3d-0ce3-4144-85ac-42e83c57e27f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Terminating instance
May 28 02:06:22.951094 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7656c807-e576-4e90-8479-52652611812f tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Lock "19d774e3-96a1-4dd4-8953-062105d5f0b2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.275s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:06:23.029263 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:23.193242 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:06:23.194033 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:06:23.321777 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-2c278a3d-0ce3-4144-85ac-42e83c57e27f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 02:06:23.338467 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:23.341069 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:23.359419 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:23.382487 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:23.481491 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-1a048801-4e17-4e55-a5da-05d743388436 req-6db3a106-0474-4fbd-b494-15449ab1da9b service nova] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Received event network-vif-unplugged-ae352d09-61f5-40a7-b8f2-5f7c2daab5c5 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:06:23.481657 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-1a048801-4e17-4e55-a5da-05d743388436 req-6db3a106-0474-4fbd-b494-15449ab1da9b service nova] Acquiring lock "0cc444e2-c821-4786-b7d7-296bd945d4d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:06:23.481794 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-1a048801-4e17-4e55-a5da-05d743388436 req-6db3a106-0474-4fbd-b494-15449ab1da9b service nova] Lock "0cc444e2-c821-4786-b7d7-296bd945d4d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:06:23.481895 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-1a048801-4e17-4e55-a5da-05d743388436 req-6db3a106-0474-4fbd-b494-15449ab1da9b service nova] Lock "0cc444e2-c821-4786-b7d7-296bd945d4d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:06:23.482002 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-1a048801-4e17-4e55-a5da-05d743388436 req-6db3a106-0474-4fbd-b494-15449ab1da9b service nova] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] No waiting events found dispatching network-vif-unplugged-ae352d09-61f5-40a7-b8f2-5f7c2daab5c5 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:06:23.482128 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-1a048801-4e17-4e55-a5da-05d743388436 req-6db3a106-0474-4fbd-b494-15449ab1da9b service nova] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Received event network-vif-unplugged-ae352d09-61f5-40a7-b8f2-5f7c2daab5c5 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:06:23.484883 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:23.648933 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999752726000224 future=<Future at 0x7724ec47a810 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:06:23.650392 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Instance destroyed successfully.
May 28 02:06:23.651065 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-2c278a3d-0ce3-4144-85ac-42e83c57e27f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lazy-loading 'resources' on Instance uuid 0cc444e2-c821-4786-b7d7-296bd945d4d4 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:06:23.698044 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:06:23.698281 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:06:23.698460 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:06:23.698657 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Auditing locally available compute resources for np0000001583 (node: np0000001583) {{(pid=98241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 02:06:24.154731 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-2c278a3d-0ce3-4144-85ac-42e83c57e27f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T02:05:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-571466772',display_name='tempest-TestEncryptedCinderVolumes-server-571466772',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testencryptedcindervolumes-server-571466772',id=60,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKojYJ7TcdtHSbcc1MLYbBExy47EvWKYMSG3x+u7byLmf87yeb/owByssR5LtduMEdOMVdFz71GfEdSZQnHy4uSQ52tMXfF3WzlTWvGsWOFxFTG60/d15VQx0V1HDWfctA==',key_name='tempest-keypair-306195562',keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:05:29Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d192b18567fd4735988dd19da06fb868',ramdisk_id='',reservation_id='r-3wbp5f6f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-243696963',owner_user_name='tempest-TestEncryptedCinderVolumes-243696963-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T02:05:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f09c9f1da7e4d32979e47c96d41ae99',uuid=0cc444e2-c821-4786-b7d7-296bd945d4d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae352d09-61f5-40a7-b8f2-5f7c2daab5c5", "address": "fa:16:3e:46:84:69", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae352d09-61", "ovs_interfaceid": "ae352d09-61f5-40a7-b8f2-5f7c2daab5c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:06:24.154731 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-2c278a3d-0ce3-4144-85ac-42e83c57e27f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Converting VIF {"id": "ae352d09-61f5-40a7-b8f2-5f7c2daab5c5", "address": "fa:16:3e:46:84:69", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae352d09-61", "ovs_interfaceid": "ae352d09-61f5-40a7-b8f2-5f7c2daab5c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:06:24.155028 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-2c278a3d-0ce3-4144-85ac-42e83c57e27f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:84:69,bridge_name='br-int',has_traffic_filtering=True,id=ae352d09-61f5-40a7-b8f2-5f7c2daab5c5,network=Network(fccbc55c-a449-42c3-bf68-d3d337f7b0ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae352d09-61') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:06:24.155145 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-2c278a3d-0ce3-4144-85ac-42e83c57e27f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:84:69,bridge_name='br-int',has_traffic_filtering=True,id=ae352d09-61f5-40a7-b8f2-5f7c2daab5c5,network=Network(fccbc55c-a449-42c3-bf68-d3d337f7b0ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae352d09-61') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:06:24.156120 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:24.156334 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae352d09-61, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:06:24.157300 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:24.157984 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:06:24.158354 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:24.159018 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:24.159183 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=03e496d9-b639-49e5-abb5-2789934edfbc) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:06:24.159569 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:24.159991 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:06:24.160329 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:24.161828 np0000001583 nova-compute[98241]: INFO os_vif [None req-2c278a3d-0ce3-4144-85ac-42e83c57e27f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:84:69,bridge_name='br-int',has_traffic_filtering=True,id=ae352d09-61f5-40a7-b8f2-5f7c2daab5c5,network=Network(fccbc55c-a449-42c3-bf68-d3d337f7b0ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae352d09-61')
May 28 02:06:24.162070 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-2c278a3d-0ce3-4144-85ac-42e83c57e27f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Deleting instance files /opt/stack/data/nova/instances/0cc444e2-c821-4786-b7d7-296bd945d4d4_del
May 28 02:06:24.162741 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-2c278a3d-0ce3-4144-85ac-42e83c57e27f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Deletion of /opt/stack/data/nova/instances/0cc444e2-c821-4786-b7d7-296bd945d4d4_del complete
May 28 02:06:24.668739 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-2c278a3d-0ce3-4144-85ac-42e83c57e27f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Took 1.35 seconds to destroy the instance on the hypervisor.
May 28 02:06:24.669329 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-2c278a3d-0ce3-4144-85ac-42e83c57e27f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 02:06:24.669683 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 02:06:24.669804 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 02:06:24.670429 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:06:24.723092 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 02:06:24.724969 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ce1d609-b3fe-4fb6-81ac-7a683c8f1992/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:06:24.749059 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:06:24.821747 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ce1d609-b3fe-4fb6-81ac-7a683c8f1992/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:06:24.822986 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ce1d609-b3fe-4fb6-81ac-7a683c8f1992/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:06:24.918179 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ce1d609-b3fe-4fb6-81ac-7a683c8f1992/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:06:24.921625 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Error from libvirt while getting description of instance-0000003c: [Error Code 42] Domain not found: no domain with matching uuid '0cc444e2-c821-4786-b7d7-296bd945d4d4' (instance-0000003c): libvirt.libvirtError: Domain not found: no domain with matching uuid '0cc444e2-c821-4786-b7d7-296bd945d4d4' (instance-0000003c)
May 28 02:06:24.924127 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7751bb1a-84b9-48ce-81da-b3a41d63eadc/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:06:25.033097 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7751bb1a-84b9-48ce-81da-b3a41d63eadc/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:06:25.033689 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7751bb1a-84b9-48ce-81da-b3a41d63eadc/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:06:25.162062 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7751bb1a-84b9-48ce-81da-b3a41d63eadc/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:06:25.166059 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b369292d-fea0-46aa-b5c4-908b8bfb6209/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:06:25.271906 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b369292d-fea0-46aa-b5c4-908b8bfb6209/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:06:25.272400 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b369292d-fea0-46aa-b5c4-908b8bfb6209/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:06:25.380422 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b369292d-fea0-46aa-b5c4-908b8bfb6209/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:06:25.385933 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:06:25.387324 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:06:25.444552 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.057s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:06:25.448856 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Hypervisor/Node resource view: name=np0000001583 free_ram=12572MB free_disk=72.69888687133789GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 02:06:25.449127 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:06:25.449405 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:06:25.569441 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-23ec5aea-7178-46b6-8e9c-93921e6f5b84 req-016c6e9b-ae0c-4dd9-a0a5-f284cc30d979 service nova] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Received event network-vif-unplugged-ae352d09-61f5-40a7-b8f2-5f7c2daab5c5 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:06:25.569864 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-23ec5aea-7178-46b6-8e9c-93921e6f5b84 req-016c6e9b-ae0c-4dd9-a0a5-f284cc30d979 service nova] Acquiring lock "0cc444e2-c821-4786-b7d7-296bd945d4d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:06:25.570006 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-23ec5aea-7178-46b6-8e9c-93921e6f5b84 req-016c6e9b-ae0c-4dd9-a0a5-f284cc30d979 service nova] Lock "0cc444e2-c821-4786-b7d7-296bd945d4d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:06:25.570186 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-23ec5aea-7178-46b6-8e9c-93921e6f5b84 req-016c6e9b-ae0c-4dd9-a0a5-f284cc30d979 service nova] Lock "0cc444e2-c821-4786-b7d7-296bd945d4d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:06:25.570333 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-23ec5aea-7178-46b6-8e9c-93921e6f5b84 req-016c6e9b-ae0c-4dd9-a0a5-f284cc30d979 service nova] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] No waiting events found dispatching network-vif-unplugged-ae352d09-61f5-40a7-b8f2-5f7c2daab5c5 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:06:25.570483 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-23ec5aea-7178-46b6-8e9c-93921e6f5b84 req-016c6e9b-ae0c-4dd9-a0a5-f284cc30d979 service nova] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Received event network-vif-unplugged-ae352d09-61f5-40a7-b8f2-5f7c2daab5c5 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:06:25.570593 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-23ec5aea-7178-46b6-8e9c-93921e6f5b84 req-016c6e9b-ae0c-4dd9-a0a5-f284cc30d979 service nova] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Received event network-vif-deleted-ae352d09-61f5-40a7-b8f2-5f7c2daab5c5 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:06:25.570731 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-23ec5aea-7178-46b6-8e9c-93921e6f5b84 req-016c6e9b-ae0c-4dd9-a0a5-f284cc30d979 service nova] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Neutron deleted interface ae352d09-61f5-40a7-b8f2-5f7c2daab5c5; detaching it from the instance and deleting it from the info cache
May 28 02:06:25.573864 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-23ec5aea-7178-46b6-8e9c-93921e6f5b84 req-016c6e9b-ae0c-4dd9-a0a5-f284cc30d979 service nova] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Detach interface failed, port_id=ae352d09-61f5-40a7-b8f2-5f7c2daab5c5, reason: Instance 0cc444e2-c821-4786-b7d7-296bd945d4d4 could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 02:06:25.743139 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:06:25.744259 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0013074589996904251 future=<Future at 0x7724ec071d00 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:06:25.744378 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:06:25.744483 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=6.771085890999984 future=<Future at 0x7724f84652b0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:06:25.744550 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=6.771006923000186 future=<Future at 0x7724f84652b0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:06:25.746311 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Emitting event <LifecycleEvent: 1779933970.742783, a2a2bf8a-242c-4f60-b772-5052084fee50 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:06:25.746311 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] VM Stopped (Lifecycle Event)
May 28 02:06:26.247391 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Took 1.58 seconds to deallocate network for instance.
May 28 02:06:26.254577 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: a2a2bf8a-242c-4f60-b772-5052084fee50] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:06:26.277875 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:26.538903 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 7751bb1a-84b9-48ce-81da-b3a41d63eadc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:06:26.539097 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 0cc444e2-c821-4786-b7d7-296bd945d4d4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:06:26.539264 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 39ea2f26-6a01-4d24-a2b3-d681e0b22d80 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:06:26.539361 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:06:26.539502 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance b369292d-fea0-46aa-b5c4-908b8bfb6209 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:06:26.539716 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 02:06:26.539926 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Final resource view: name=np0000001583 phys_ram=24030MB used_ram=1472MB phys_disk=95GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:06:25 up 42 min,  2 users,  load average: 5.40, 6.65, 5.09\n', 'num_instances': '5', 'num_vm_active': '5', 'num_task_None': '4', 'num_os_type_None': '5', 'num_proj_d9663116fe18428d8e37dea7b30d8b5a': '2', 'io_workload': '0', 'num_proj_432aa1094ced436494def17a875aa8e1': '1', 'num_proj_b7ada2896b1043bfb246c28ad9d1e174': '1', 'num_task_deleting': '1', 'num_proj_d192b18567fd4735988dd19da06fb868': '1'} {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 02:06:26.755981 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2c278a3d-0ce3-4144-85ac-42e83c57e27f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:06:26.807040 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:06:26.807281 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:06:27.309731 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:06:27.822507 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Compute_service record updated for np0000001583:np0000001583 {{(pid=98241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 02:06:27.822919 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.373s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:06:27.823228 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2c278a3d-0ce3-4144-85ac-42e83c57e27f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.067s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:06:27.825194 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:06:28.104560 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2c278a3d-0ce3-4144-85ac-42e83c57e27f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:06:28.104815 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-2c278a3d-0ce3-4144-85ac-42e83c57e27f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:06:28.119903 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:28.487060 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:28.607309 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-2c278a3d-0ce3-4144-85ac-42e83c57e27f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:06:29.113693 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2c278a3d-0ce3-4144-85ac-42e83c57e27f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.291s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:06:29.160580 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:29.162366 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-2c278a3d-0ce3-4144-85ac-42e83c57e27f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Deleted allocations for instance 0cc444e2-c821-4786-b7d7-296bd945d4d4
May 28 02:06:30.173359 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2c278a3d-0ce3-4144-85ac-42e83c57e27f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "0cc444e2-c821-4786-b7d7-296bd945d4d4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.354s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:06:30.820972 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:06:30.821256 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:06:30.821494 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:06:30.821641 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 02:06:30.821886 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 49.37 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:06:32.516036 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.00039642199999434524 future=<Future at 0x7724f84652b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:06:32.516586 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] Emitting event <LifecycleEvent: 1779933977.5154917, 19d774e3-96a1-4dd4-8953-062105d5f0b2 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:06:32.516784 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:06:32.517017 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] VM Stopped (Lifecycle Event)
May 28 02:06:32.518026 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=6.130653855000219 future=<Future at 0x7724ec47a810 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:06:32.518203 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=6.130454761000237 future=<Future at 0x7724ec47a810 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:06:33.019612 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1a9f58a5-8877-449a-8e55-a92b45fb450b tempest-VolumesActionsTest-1125296363 tempest-VolumesActionsTest-1125296363-project-member] [instance: 19d774e3-96a1-4dd4-8953-062105d5f0b2] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:06:33.489140 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:34.161675 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:34.592271 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "c9bfbfaa-4d10-4c18-8ad9-0f115a757b60" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:06:34.592493 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "c9bfbfaa-4d10-4c18-8ad9-0f115a757b60" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:06:35.094747 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 02:06:35.650806 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:06:35.651301 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:06:35.654120 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 02:06:35.654257 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Claim successful on node np0000001583
May 28 02:06:36.412914 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Acquiring lock "0ce1d609-b3fe-4fb6-81ac-7a683c8f1992" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:06:36.413168 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "0ce1d609-b3fe-4fb6-81ac-7a683c8f1992" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:06:36.916485 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lazy-loading 'flavor' on Instance uuid 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:06:36.960577 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:06:36.960795 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:06:37.463389 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:06:37.898051 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:37.922443 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "0ce1d609-b3fe-4fb6-81ac-7a683c8f1992" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:06:37.970669 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.320s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:06:37.971251 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 02:06:38.478469 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 02:06:38.478874 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 02:06:38.479658 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:06:38.479658 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:06:38.490501 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:38.586496 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0f09c9f1da7e4d32979e47c96d41ae99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd192b18567fd4735988dd19da06fb868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 02:06:38.649049 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0003442679999352549 future=<Future at 0x7724ec47a810 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:06:38.649552 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Emitting event <LifecycleEvent: 1779933983.6485856, 0cc444e2-c821-4786-b7d7-296bd945d4d4 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:06:38.650013 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:06:38.650196 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] VM Stopped (Lifecycle Event)
May 28 02:06:38.982143 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 02:06:39.021156 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Acquiring lock "0ce1d609-b3fe-4fb6-81ac-7a683c8f1992" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:06:39.022343 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "0ce1d609-b3fe-4fb6-81ac-7a683c8f1992" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:06:39.025394 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Successfully created port: 69995ecd-0071-47d1-8844-2a23a5274ec6 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 02:06:39.028060 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Attaching volume 36cd6d7e-70fb-4cf4-aeab-f233a5b36bab to /dev/vdb
May 28 02:06:39.074832 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:06:39.093134 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 02:06:39.121256 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:06:39.155219 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] [instance: 0cc444e2-c821-4786-b7d7-296bd945d4d4] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:06:39.163483 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:39.169756 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 02:06:39.170030 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 02:06:39.181345 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 02:06:39.182456 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fee6:d69e', 'fe80::f881:28ff:fef8:dbfc', 'fe80::fc16:3eff:feed:a3d2', 'fe80::fc16:3eff:fe9c:a66d', 'fe80::34e0:eeff:fee2:bede', 'fe80::fc16:3eff:feb4:d0b8', 'fe80::5461:55ff:fe41:c1b7'] 
May 28 02:06:39.182593 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 02:06:39.182711 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 02:06:39.182972 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:06:39.183213 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Updating existing volume attachment record: e293a370-d0e2-4bb9-a52a-d75ea57d8bf8 {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 02:06:39.485329 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 02:06:39.587280 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Successfully updated port: 69995ecd-0071-47d1-8844-2a23a5274ec6 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 02:06:39.643494 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:39.648053 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-31855f63-3e0b-4362-930e-94f7bfdfd0ba req-c4e4257a-2d14-48bf-bf72-6f1c947eb321 service nova] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Received event network-changed-69995ecd-0071-47d1-8844-2a23a5274ec6 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:06:39.648274 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-31855f63-3e0b-4362-930e-94f7bfdfd0ba req-c4e4257a-2d14-48bf-bf72-6f1c947eb321 service nova] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Refreshing instance network info cache due to event network-changed-69995ecd-0071-47d1-8844-2a23a5274ec6. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:06:39.648662 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-31855f63-3e0b-4362-930e-94f7bfdfd0ba req-c4e4257a-2d14-48bf-bf72-6f1c947eb321 service nova] Acquiring lock "refresh_cache-c9bfbfaa-4d10-4c18-8ad9-0f115a757b60" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:06:39.648662 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-31855f63-3e0b-4362-930e-94f7bfdfd0ba req-c4e4257a-2d14-48bf-bf72-6f1c947eb321 service nova] Acquired lock "refresh_cache-c9bfbfaa-4d10-4c18-8ad9-0f115a757b60" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:06:39.648662 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-31855f63-3e0b-4362-930e-94f7bfdfd0ba req-c4e4257a-2d14-48bf-bf72-6f1c947eb321 service nova] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Refreshing network info cache for port 69995ecd-0071-47d1-8844-2a23a5274ec6 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:06:39.735436 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 02:06:39.735928 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab', 'iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '36cd6d7e-70fb-4cf4-aeab-f233a5b36bab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:06:39.736168 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:06:39.736686 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:06:39.736983 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab', 'iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '36cd6d7e-70fb-4cf4-aeab-f233a5b36bab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 02:06:39.749431 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:06:39.750165 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:06:39.750681 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:06:39.750917 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:06:39.751674 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:06:39.751674 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:06:39.765003 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:06:39.765003 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:39.776225 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:06:39.776225 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:39.782671 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab] added
May 28 02:06:39.782671 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:06:39.782671 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:06:39.782671 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:06:39.782671 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:06:39.782671 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:06:39.782671 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:39.782671 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:06:39.782671 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0307(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:06:39.782671 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:06:39.788804 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab] added
May 28 02:06:39.788804 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:06:39.788804 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:06:39.788804 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:06:39.788804 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:06:39.788804 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:06:39.788804 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:39.789317 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:06:39.789493 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0386(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:06:39.789724 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:06:40.088852 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "refresh_cache-c9bfbfaa-4d10-4c18-8ad9-0f115a757b60" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:06:40.152387 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-31855f63-3e0b-4362-930e-94f7bfdfd0ba req-c4e4257a-2d14-48bf-bf72-6f1c947eb321 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:06:40.219694 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-31855f63-3e0b-4362-930e-94f7bfdfd0ba req-c4e4257a-2d14-48bf-bf72-6f1c947eb321 service nova] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:06:40.347603 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-31855f63-3e0b-4362-930e-94f7bfdfd0ba req-c4e4257a-2d14-48bf-bf72-6f1c947eb321 service nova] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:06:40.494928 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 02:06:40.496178 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 02:06:40.496455 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Creating image(s)
May 28 02:06:40.497124 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "/opt/stack/data/nova/instances/c9bfbfaa-4d10-4c18-8ad9-0f115a757b60/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:06:40.497288 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "/opt/stack/data/nova/instances/c9bfbfaa-4d10-4c18-8ad9-0f115a757b60/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:06:40.497761 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "/opt/stack/data/nova/instances/c9bfbfaa-4d10-4c18-8ad9-0f115a757b60/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:06:40.498345 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:06:40.501128 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:06:40.502582 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:06:40.605461 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.102s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:06:40.606038 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:06:40.606564 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:06:40.607175 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:06:40.610527 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:06:40.610884 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:06:40.650162 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "e8bc20b7-8f2f-4226-9fcd-63c123604535" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:06:40.650554 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "e8bc20b7-8f2f-4226-9fcd-63c123604535" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:06:40.700682 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.090s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:06:40.701088 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/c9bfbfaa-4d10-4c18-8ad9-0f115a757b60/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:06:40.754222 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/c9bfbfaa-4d10-4c18-8ad9-0f115a757b60/disk 1073741824" returned: 0 in 0.053s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:06:40.754759 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.148s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:06:40.755277 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:06:40.783995 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:06:40.790521 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:06:40.801012 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:06:40.801012 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:06:40.816110 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:06:40.816110 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:40.818109 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:40.831300 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:40.836192 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:40.836192 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:40.836192 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:06:40.836406 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsi session list stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:40.836406 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:40.836406 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:06:40.845922 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:40.845922 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:40.845922 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:06:40.846058 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsi session list stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:40.846058 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:40.846058 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:06:40.851152 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-31855f63-3e0b-4362-930e-94f7bfdfd0ba req-c4e4257a-2d14-48bf-bf72-6f1c947eb321 service nova] Releasing lock "refresh_cache-c9bfbfaa-4d10-4c18-8ad9-0f115a757b60" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:06:40.851267 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquired lock "refresh_cache-c9bfbfaa-4d10-4c18-8ad9-0f115a757b60" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:06:40.851510 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:06:40.867116 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.110s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:06:40.867116 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c9bfbfaa-4d10-4c18-8ad9-0f115a757b60/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 02:06:40.867116 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9bfbfaa-4d10-4c18-8ad9-0f115a757b60/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:06:40.878115 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab, portal: 192.168.50.100,3260]
May 28 02:06:40.878115 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab, portal: 192.168.50.100,3260] successful.
May 28 02:06:40.878115 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:40.888499 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab, portal: 192.168.40.100,3260]
May 28 02:06:40.888499 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab, portal: 192.168.40.100,3260] successful.
May 28 02:06:40.888499 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:40.895284 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:40.904516 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:40.915515 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:40.915515 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:40.915515 np0000001583 nova-compute[98241]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab (non-flash)
May 28 02:06:40.915515 np0000001583 nova-compute[98241]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab (non-flash)
May 28 02:06:40.915515 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:06:40.916095 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsi session list stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:40.916095 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:40.916095 np0000001583 nova-compute[98241]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab (non-flash)
May 28 02:06:40.916095 np0000001583 nova-compute[98241]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab (non-flash)
May 28 02:06:40.916095 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:06:40.917161 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.165s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:06:40.917161 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:06:40.920617 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:40.920617 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:40.920617 np0000001583 nova-compute[98241]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab (non-flash)
May 28 02:06:40.920617 np0000001583 nova-compute[98241]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab (non-flash)
May 28 02:06:40.920617 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:06:40.924096 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsi session list stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:40.924096 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:40.924096 np0000001583 nova-compute[98241]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab (non-flash)
May 28 02:06:40.924096 np0000001583 nova-compute[98241]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab (non-flash)
May 28 02:06:40.924096 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:06:40.924096 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.171s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:06:40.924096 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] HCTL ('7', '-', '-', 0) found on session 147 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:06:40.924096 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:06:40.924096 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:06:40.924096 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] HCTL ('8', '-', '-', 0) found on session 148 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:06:40.924096 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:06:40.948550 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Searching for a device in session 147 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:06:40.948550 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '36cd6d7e-70fb-4cf4-aeab-f233a5b36bab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:06:40.948550 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Searching for a device in session 148 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:06:40.948550 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '36cd6d7e-70fb-4cf4-aeab-f233a5b36bab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:06:40.977190 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9bfbfaa-4d10-4c18-8ad9-0f115a757b60/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:06:40.977544 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Cannot resize image /opt/stack/data/nova/instances/c9bfbfaa-4d10-4c18-8ad9-0f115a757b60/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 02:06:40.978488 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 02:06:40.978488 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Ensure instance console log exists: /opt/stack/data/nova/instances/c9bfbfaa-4d10-4c18-8ad9-0f115a757b60/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 02:06:40.978721 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:06:40.978797 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:06:40.978979 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:06:41.154038 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 02:06:41.255992 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Acquiring lock "b369292d-fea0-46aa-b5c4-908b8bfb6209" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:06:41.257384 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "b369292d-fea0-46aa-b5c4-908b8bfb6209" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:06:41.415361 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:06:41.552843 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:06:41.682279 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Updating instance_info_cache with network_info: [{"id": "69995ecd-0071-47d1-8844-2a23a5274ec6", "address": "fa:16:3e:e5:ab:c0", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap69995ecd-00", "ovs_interfaceid": "69995ecd-0071-47d1-8844-2a23a5274ec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:06:41.710374 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:06:41.710769 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:06:41.715184 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 02:06:41.715329 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Claim successful on node np0000001583
May 28 02:06:41.750728 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 02:06:41.761840 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lazy-loading 'flavor' on Instance uuid b369292d-fea0-46aa-b5c4-908b8bfb6209 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:06:42.184276 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Releasing lock "refresh_cache-c9bfbfaa-4d10-4c18-8ad9-0f115a757b60" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:06:42.184679 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Instance network_info: |[{"id": "69995ecd-0071-47d1-8844-2a23a5274ec6", "address": "fa:16:3e:e5:ab:c0", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap69995ecd-00", "ovs_interfaceid": "69995ecd-0071-47d1-8844-2a23a5274ec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 02:06:42.186309 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Start _get_guest_xml network_info=[{"id": "69995ecd-0071-47d1-8844-2a23a5274ec6", "address": "fa:16:3e:e5:ab:c0", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap69995ecd-00", "ovs_interfaceid": "69995ecd-0071-47d1-8844-2a23a5274ec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 02:06:42.189152 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:06:42.190392 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1300175185', uuid='c9bfbfaa-4d10-4c18-8ad9-0f115a757b60'), owner=OwnerMeta(userid='0f09c9f1da7e4d32979e47c96d41ae99', username='tempest-TestEncryptedCinderVolumes-243696963-project-member', projectid='d192b18567fd4735988dd19da06fb868', projectname='tempest-TestEncryptedCinderVolumes-243696963'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "69995ecd-0071-47d1-8844-2a23a5274ec6", "address": "fa:16:3e:e5:ab:c0", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap69995ecd-00", "ovs_interfaceid": "69995ecd-0071-47d1-8844-2a23a5274ec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779934002.189984) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 02:06:42.191994 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 02:06:42.192352 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 02:06:42.193732 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 02:06:42.193732 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 02:06:42.194749 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 02:06:42.195096 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 02:06:42.195294 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 02:06:42.195412 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 02:06:42.195564 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 02:06:42.195648 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 02:06:42.195763 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 02:06:42.195962 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 02:06:42.196104 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 02:06:42.196244 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 02:06:42.196350 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 02:06:42.196987 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 02:06:42.207250 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:06:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1300175185',display_name='tempest-TestEncryptedCinderVolumes-server-1300175185',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testencryptedcindervolumes-server-1300175185',id=65,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9e7modxscTnBCqXHqkkmGwoeokYFlHeKUWFdzSHoD4fgXOAVTmmbP/yM1n7tCbsxammjaihp376sPCILbjop0hqjRnmPT5drh/c3gnmHwQQDNtSyIFY2rmYixFoKe3xg==',key_name='tempest-keypair-1897192669',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d192b18567fd4735988dd19da06fb868',ramdisk_id='',reservation_id='r-qkeutkcn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-243696963',owner_user_name='tempest-TestEncryptedCinderVolumes-243696963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:06:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f09c9f1da7e4d32979e47c96d41ae99',uuid=c9bfbfaa-4d10-4c18-8ad9-0f115a757b60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69995ecd-0071-47d1-8844-2a23a5274ec6", "address": "fa:16:3e:e5:ab:c0", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap69995ecd-00", "ovs_interfaceid": "69995ecd-0071-47d1-8844-2a23a5274ec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 02:06:42.207456 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Converting VIF {"id": "69995ecd-0071-47d1-8844-2a23a5274ec6", "address": "fa:16:3e:e5:ab:c0", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap69995ecd-00", "ovs_interfaceid": "69995ecd-0071-47d1-8844-2a23a5274ec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:06:42.208060 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:ab:c0,bridge_name='br-int',has_traffic_filtering=True,id=69995ecd-0071-47d1-8844-2a23a5274ec6,network=Network(fccbc55c-a449-42c3-bf68-d3d337f7b0ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69995ecd-00') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:06:42.208955 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lazy-loading 'pci_devices' on Instance uuid c9bfbfaa-4d10-4c18-8ad9-0f115a757b60 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:06:42.711539 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] End _get_guest_xml xml=<domain type="qemu">
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:   <uuid>c9bfbfaa-4d10-4c18-8ad9-0f115a757b60</uuid>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:   <name>instance-00000041</name>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:   <metadata>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1300175185</nova:name>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 02:06:42</nova:creationTime>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:       </nova:image>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:         <nova:user uuid="0f09c9f1da7e4d32979e47c96d41ae99">tempest-TestEncryptedCinderVolumes-243696963-project-member</nova:user>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:         <nova:project uuid="d192b18567fd4735988dd19da06fb868">tempest-TestEncryptedCinderVolumes-243696963</nova:project>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:         <nova:port uuid="69995ecd-0071-47d1-8844-2a23a5274ec6">
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:         </nova:port>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:   </metadata>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:     <system>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:       <entry name="serial">c9bfbfaa-4d10-4c18-8ad9-0f115a757b60</entry>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:       <entry name="uuid">c9bfbfaa-4d10-4c18-8ad9-0f115a757b60</entry>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:     </system>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:   <os>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:   </os>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:   <features>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:     <acpi/>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:     <tcg>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:     </tcg>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:   </features>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:   </cpu>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:   <devices>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/c9bfbfaa-4d10-4c18-8ad9-0f115a757b60/disk"/>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:     </disk>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/c9bfbfaa-4d10-4c18-8ad9-0f115a757b60/disk.config"/>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:     </disk>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:e5:ab:c0"/>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:       <target dev="tap69995ecd-00"/>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:     </interface>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/c9bfbfaa-4d10-4c18-8ad9-0f115a757b60/console.log" append="off"/>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:     </serial>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:     <video>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:     </video>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:     </rng>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:     </memballoon>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:   </devices>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]: </domain>
May 28 02:06:42.711539 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 02:06:42.714201 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Preparing to wait for external event network-vif-plugged-69995ecd-0071-47d1-8844-2a23a5274ec6 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 02:06:42.714201 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "c9bfbfaa-4d10-4c18-8ad9-0f115a757b60-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:06:42.714201 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "c9bfbfaa-4d10-4c18-8ad9-0f115a757b60-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:06:42.714201 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "c9bfbfaa-4d10-4c18-8ad9-0f115a757b60-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:06:42.714201 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:06:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1300175185',display_name='tempest-TestEncryptedCinderVolumes-server-1300175185',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testencryptedcindervolumes-server-1300175185',id=65,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9e7modxscTnBCqXHqkkmGwoeokYFlHeKUWFdzSHoD4fgXOAVTmmbP/yM1n7tCbsxammjaihp376sPCILbjop0hqjRnmPT5drh/c3gnmHwQQDNtSyIFY2rmYixFoKe3xg==',key_name='tempest-keypair-1897192669',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d192b18567fd4735988dd19da06fb868',ramdisk_id='',reservation_id='r-qkeutkcn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-243696963',owner_user_name='tempest-TestEncryptedCinderVolumes-243696963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:06:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f09c9f1da7e4d32979e47c96d41ae99',uuid=c9bfbfaa-4d10-4c18-8ad9-0f115a757b60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69995ecd-0071-47d1-8844-2a23a5274ec6", "address": "fa:16:3e:e5:ab:c0", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap69995ecd-00", "ovs_interfaceid": "69995ecd-0071-47d1-8844-2a23a5274ec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 02:06:42.714201 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Converting VIF {"id": "69995ecd-0071-47d1-8844-2a23a5274ec6", "address": "fa:16:3e:e5:ab:c0", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap69995ecd-00", "ovs_interfaceid": "69995ecd-0071-47d1-8844-2a23a5274ec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:06:42.714201 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:ab:c0,bridge_name='br-int',has_traffic_filtering=True,id=69995ecd-0071-47d1-8844-2a23a5274ec6,network=Network(fccbc55c-a449-42c3-bf68-d3d337f7b0ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69995ecd-00') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:06:42.714506 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:ab:c0,bridge_name='br-int',has_traffic_filtering=True,id=69995ecd-0071-47d1-8844-2a23a5274ec6,network=Network(fccbc55c-a449-42c3-bf68-d3d337f7b0ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69995ecd-00') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 02:06:42.714806 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:42.715113 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:06:42.715372 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 02:06:42.716127 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:42.716278 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9ffd36fc-03d2-5f2d-83ce-5924ecfa48e6', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:06:42.717021 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:42.717706 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:06:42.719060 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:42.720686 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:42.720869 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69995ecd-00, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:06:42.721329 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap69995ecd-00, col_values=(('qos', UUID('dddae1cf-dfd6-4415-b644-5bee79a02197')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:06:42.721329 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap69995ecd-00, col_values=(('external_ids', {'iface-id': '69995ecd-0071-47d1-8844-2a23a5274ec6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:ab:c0', 'vm-uuid': 'c9bfbfaa-4d10-4c18-8ad9-0f115a757b60'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:06:42.722008 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:42.723046 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:06:42.727763 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:42.728562 np0000001583 nova-compute[98241]: INFO os_vif [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:ab:c0,bridge_name='br-int',has_traffic_filtering=True,id=69995ecd-0071-47d1-8844-2a23a5274ec6,network=Network(fccbc55c-a449-42c3-bf68-d3d337f7b0ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69995ecd-00')
May 28 02:06:42.767551 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Found WWN 330000000ccde5228 for multipath device dm-0 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 02:06:42.767952 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:06:42.768177 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] <== connect_volume: return (3032ms) {'type': 'block', 'scsi_wwn': '330000000ccde5228', 'path': '/dev/dm-0', 'multipath_id': '330000000ccde5228'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:06:42.768331 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ccde5228', 'path': '/dev/dm-0', 'multipath_id': '330000000ccde5228'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 02:06:42.769569 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "b369292d-fea0-46aa-b5c4-908b8bfb6209" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:06:42.773209 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lazy-loading 'flavor' on Instance uuid 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:06:43.029061 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:06:43.029366 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:06:43.275867 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Attempting to attach volume 36cd6d7e-70fb-4cf4-aeab-f233a5b36bab with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98241) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 02:06:43.277386 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] attach device xml: <disk type="block" device="disk">
May 28 02:06:43.277386 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:06:43.277386 np0000001583 nova-compute[98241]:   <alias name="ua-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab"/>
May 28 02:06:43.277386 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-0"/>
May 28 02:06:43.277386 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:06:43.277386 np0000001583 nova-compute[98241]:   <serial>36cd6d7e-70fb-4cf4-aeab-f233a5b36bab</serial>
May 28 02:06:43.277386 np0000001583 nova-compute[98241]: </disk>
May 28 02:06:43.277386 np0000001583 nova-compute[98241]:  {{(pid=98241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 02:06:43.492663 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:43.532266 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:06:43.972242 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Acquiring lock "b369292d-fea0-46aa-b5c4-908b8bfb6209" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:06:43.972242 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "b369292d-fea0-46aa-b5c4-908b8bfb6209" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:06:43.972479 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Attaching volume 384a8e77-6054-4d06-8bcf-4a41cbac8d5f to /dev/vdb
May 28 02:06:44.009843 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:06:44.020234 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 02:06:44.040948 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.330s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:06:44.041203 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 02:06:44.044426 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:06:44.090669 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 02:06:44.092056 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 02:06:44.105591 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 02:06:44.106937 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fee6:d69e', 'fe80::f881:28ff:fef8:dbfc', 'fe80::fc16:3eff:feed:a3d2', 'fe80::fc16:3eff:fe9c:a66d', 'fe80::34e0:eeff:fee2:bede', 'fe80::fc16:3eff:feb4:d0b8', 'fe80::5461:55ff:fe41:c1b7'] 
May 28 02:06:44.107119 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 02:06:44.107270 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 02:06:44.107542 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] <== get_connector_properties: return (97ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:06:44.107930 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Updating existing volume attachment record: 1d7d16c5-032f-47c0-8291-428a2946510a {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 02:06:44.187259 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:44.247778 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:06:44.247905 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:06:44.248102 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] No VIF found with MAC fa:16:3e:e5:ab:c0, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:06:44.248734 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Using config drive
May 28 02:06:44.547071 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 02:06:44.548266 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 02:06:44.548723 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:06:44.549072 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:06:44.638096 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6be314b4eed642c3b2c72fe115860220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432aa1094ced436494def17a875aa8e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 02:06:44.705389 np0000001583 nova-compute[98241]: DEBUG os_brick.encryptors [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f', 'iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '384a8e77-6054-4d06-8bcf-4a41cbac8d5f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'b369292d-fea0-46aa-b5c4-908b8bfb6209', 'attached_at': '', 'detached_at': '', 'volume_id': '384a8e77-6054-4d06-8bcf-4a41cbac8d5f', 'serial': '384a8e77-6054-4d06-8bcf-4a41cbac8d5f'} {{(pid=98241) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 02:06:44.707130 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 02:06:44.707536 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f', 'iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '384a8e77-6054-4d06-8bcf-4a41cbac8d5f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:06:44.707718 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:06:44.708272 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:06:44.708527 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f', 'iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '384a8e77-6054-4d06-8bcf-4a41cbac8d5f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 02:06:44.719543 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:06:44.720193 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:06:44.720193 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:06:44.721174 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:06:44.721602 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:06:44.721808 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:06:44.731198 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:06:44.731198 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:44.737870 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:06:44.737870 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:44.745546 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f] added
May 28 02:06:44.745546 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:06:44.745546 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:06:44.745546 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:06:44.745546 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:06:44.745546 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:06:44.745546 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:44.745780 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:06:44.745908 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0257(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:06:44.746049 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:06:44.750547 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f] added
May 28 02:06:44.750547 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:06:44.750547 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:06:44.750547 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:06:44.750547 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:06:44.750547 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:06:44.750547 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:44.750547 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:06:44.750547 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0286(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:06:44.750547 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:06:44.754304 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:06:44.900568 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Creating config drive at /opt/stack/data/nova/instances/c9bfbfaa-4d10-4c18-8ad9-0f115a757b60/disk.config
May 28 02:06:44.906067 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c9bfbfaa-4d10-4c18-8ad9-0f115a757b60/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpd0w11r3q {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:06:44.943498 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:06:44.943633 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:06:44.943774 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:06:44.943967 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] No VIF found with MAC fa:16:3e:ed:a3:d2, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:06:44.961656 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c9bfbfaa-4d10-4c18-8ad9-0f115a757b60/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpd0w11r3q" returned: 0 in 0.056s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:06:45.048650 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 02:06:45.097750 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Successfully created port: b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 02:06:45.387627 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:45.408275 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:45.506325 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:45.551819 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 02:06:45.602541 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Successfully updated port: b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 02:06:45.660245 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d898e70c-9817-4846-8eea-0c62939e1321 req-bda6db14-140c-46f8-8a1d-f04c2e4d3cbb service nova] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Received event network-changed-b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:06:45.660245 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d898e70c-9817-4846-8eea-0c62939e1321 req-bda6db14-140c-46f8-8a1d-f04c2e4d3cbb service nova] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Refreshing instance network info cache due to event network-changed-b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:06:45.660245 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d898e70c-9817-4846-8eea-0c62939e1321 req-bda6db14-140c-46f8-8a1d-f04c2e4d3cbb service nova] Acquiring lock "refresh_cache-e8bc20b7-8f2f-4226-9fcd-63c123604535" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:06:45.660245 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d898e70c-9817-4846-8eea-0c62939e1321 req-bda6db14-140c-46f8-8a1d-f04c2e4d3cbb service nova] Acquired lock "refresh_cache-e8bc20b7-8f2f-4226-9fcd-63c123604535" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:06:45.660245 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-d898e70c-9817-4846-8eea-0c62939e1321 req-bda6db14-140c-46f8-8a1d-f04c2e4d3cbb service nova] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Refreshing network info cache for port b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:06:45.746845 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:06:45.750201 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:45.753131 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:06:45.753882 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:45.756022 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:06:45.762269 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:06:45.762269 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:06:45.769712 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:06:45.769712 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:45.776523 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:45.777580 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:45.783375 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:45.792756 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:45.792756 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:45.792756 np0000001583 nova-compute[98241]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab (non-flash)
May 28 02:06:45.792756 np0000001583 nova-compute[98241]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab (non-flash)
May 28 02:06:45.792756 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:06:45.793655 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsi session list stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:45.793655 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:45.793655 np0000001583 nova-compute[98241]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab (non-flash)
May 28 02:06:45.793655 np0000001583 nova-compute[98241]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab (non-flash)
May 28 02:06:45.793655 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:06:45.798944 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:45.798944 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:45.798944 np0000001583 nova-compute[98241]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab (non-flash)
May 28 02:06:45.798944 np0000001583 nova-compute[98241]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab (non-flash)
May 28 02:06:45.798944 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:06:45.798944 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsi session list stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:45.798944 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:45.798944 np0000001583 nova-compute[98241]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab (non-flash)
May 28 02:06:45.798944 np0000001583 nova-compute[98241]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab (non-flash)
May 28 02:06:45.798944 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:06:45.833911 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f, portal: 192.168.40.100,3260]
May 28 02:06:45.833911 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f, portal: 192.168.40.100,3260] successful.
May 28 02:06:45.833911 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:45.843623 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f, portal: 192.168.50.100,3260]
May 28 02:06:45.843623 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f, portal: 192.168.50.100,3260] successful.
May 28 02:06:45.843623 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:45.854381 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:45.862555 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:45.872108 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:45.872108 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:45.872108 np0000001583 nova-compute[98241]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab (non-flash)
May 28 02:06:45.872108 np0000001583 nova-compute[98241]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab (non-flash)
May 28 02:06:45.872108 np0000001583 nova-compute[98241]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f (non-flash)
May 28 02:06:45.872108 np0000001583 nova-compute[98241]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f (non-flash)
May 28 02:06:45.872108 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:06:45.872403 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsi session list stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:45.872403 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:45.872403 np0000001583 nova-compute[98241]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab (non-flash)
May 28 02:06:45.872403 np0000001583 nova-compute[98241]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab (non-flash)
May 28 02:06:45.872403 np0000001583 nova-compute[98241]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f (non-flash)
May 28 02:06:45.872403 np0000001583 nova-compute[98241]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f (non-flash)
May 28 02:06:45.872403 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:06:45.872610 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.153s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:06:45.872729 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:06:45.874265 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] HCTL ('11', '-', '-', 0) found on session 149 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:06:45.874265 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:06:45.882526 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:45.882526 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:45.882526 np0000001583 nova-compute[98241]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab (non-flash)
May 28 02:06:45.882526 np0000001583 nova-compute[98241]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab (non-flash)
May 28 02:06:45.882526 np0000001583 nova-compute[98241]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f (non-flash)
May 28 02:06:45.882526 np0000001583 nova-compute[98241]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f (non-flash)
May 28 02:06:45.882526 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:06:45.882526 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsi session list stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:45.882526 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:45.882526 np0000001583 nova-compute[98241]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab (non-flash)
May 28 02:06:45.882526 np0000001583 nova-compute[98241]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab (non-flash)
May 28 02:06:45.882526 np0000001583 nova-compute[98241]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f (non-flash)
May 28 02:06:45.882526 np0000001583 nova-compute[98241]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f (non-flash)
May 28 02:06:45.882526 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:06:45.882526 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.161s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:06:45.882526 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:06:45.883729 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] HCTL ('12', '-', '-', 0) found on session 150 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:06:45.883956 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:06:45.894626 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Searching for a device in session 149 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:06:45.894847 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '384a8e77-6054-4d06-8bcf-4a41cbac8d5f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:06:45.902985 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Searching for a device in session 150 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:06:45.902985 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '384a8e77-6054-4d06-8bcf-4a41cbac8d5f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:06:46.059987 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Booting with volume 8bbe457d-aa5f-4e82-95e0-29d1ffc48145 at /dev/vda
May 28 02:06:46.068063 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-53600529-121a-41d6-9610-60dd9ccefe71 req-80d1c96b-79ad-4e31-b0f1-e2ef213abf34 service nova] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Received event network-vif-plugged-69995ecd-0071-47d1-8844-2a23a5274ec6 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:06:46.069681 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-53600529-121a-41d6-9610-60dd9ccefe71 req-80d1c96b-79ad-4e31-b0f1-e2ef213abf34 service nova] Acquiring lock "c9bfbfaa-4d10-4c18-8ad9-0f115a757b60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:06:46.069860 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-53600529-121a-41d6-9610-60dd9ccefe71 req-80d1c96b-79ad-4e31-b0f1-e2ef213abf34 service nova] Lock "c9bfbfaa-4d10-4c18-8ad9-0f115a757b60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:06:46.070027 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-53600529-121a-41d6-9610-60dd9ccefe71 req-80d1c96b-79ad-4e31-b0f1-e2ef213abf34 service nova] Lock "c9bfbfaa-4d10-4c18-8ad9-0f115a757b60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:06:46.070200 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-53600529-121a-41d6-9610-60dd9ccefe71 req-80d1c96b-79ad-4e31-b0f1-e2ef213abf34 service nova] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Processing event network-vif-plugged-69995ecd-0071-47d1-8844-2a23a5274ec6 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 02:06:46.107678 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "refresh_cache-e8bc20b7-8f2f-4226-9fcd-63c123604535" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:06:46.109942 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:06:46.129978 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 02:06:46.159058 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:06:46.177538 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-d898e70c-9817-4846-8eea-0c62939e1321 req-bda6db14-140c-46f8-8a1d-f04c2e4d3cbb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:06:46.211617 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 02:06:46.211912 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 02:06:46.220703 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 02:06:46.222383 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fee6:d69e', 'fe80::f881:28ff:fef8:dbfc', 'fe80::fc16:3eff:feed:a3d2', 'fe80::fc16:3eff:fe9c:a66d', 'fe80::34e0:eeff:fee2:bede', 'fe80::fc16:3eff:feb4:d0b8', 'fe80::5461:55ff:fe41:c1b7', 'fe80::fc16:3eff:fee5:abc0', 'fe80::d05a:66ff:fe6d:1718'] 
May 28 02:06:46.222510 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 02:06:46.222646 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 02:06:46.223090 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:06:46.224620 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Updating existing volume attachment record: 0b260c50-eabf-46e7-951c-32f0d26ba79d {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 02:06:46.264321 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-d898e70c-9817-4846-8eea-0c62939e1321 req-bda6db14-140c-46f8-8a1d-f04c2e4d3cbb service nova] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:06:46.358110 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934006.3575885, c9bfbfaa-4d10-4c18-8ad9-0f115a757b60 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:06:46.358844 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 02:06:46.359121 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] VM Started (Lifecycle Event)
May 28 02:06:46.361238 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 02:06:46.365055 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Instance spawned successfully.
May 28 02:06:46.365508 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 02:06:46.406897 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-d898e70c-9817-4846-8eea-0c62939e1321 req-bda6db14-140c-46f8-8a1d-f04c2e4d3cbb service nova] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:06:46.541384 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-54aa5117-d1b7-4ee6-b9c1-d311b0ad0805 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "0ce1d609-b3fe-4fb6-81ac-7a683c8f1992" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.519s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:06:46.723284 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 02:06:46.863489 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:06:46.866124 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:06:46.875506 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:06:46.875676 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:06:46.876149 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:06:46.876398 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:06:46.876716 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:06:46.877011 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:06:46.909329 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d898e70c-9817-4846-8eea-0c62939e1321 req-bda6db14-140c-46f8-8a1d-f04c2e4d3cbb service nova] Releasing lock "refresh_cache-e8bc20b7-8f2f-4226-9fcd-63c123604535" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:06:46.910345 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquired lock "refresh_cache-e8bc20b7-8f2f-4226-9fcd-63c123604535" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:06:46.910477 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:06:47.372298 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 02:06:47.372587 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934007.3723571, c9bfbfaa-4d10-4c18-8ad9-0f115a757b60 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:06:47.372718 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] VM Paused (Lifecycle Event)
May 28 02:06:47.388825 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Took 6.89 seconds to spawn the instance on the hypervisor.
May 28 02:06:47.389205 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:06:47.500670 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:06:47.660803 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:06:47.722582 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:47.745891 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Found WWN 33000000033117cec for multipath device dm-4 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 02:06:47.745891 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:06:47.748380 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '33000000033117cec', 'path': '/dev/disk/by-id/os-brick+dev+dm-4', 'multipath_id': '33000000033117cec'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:06:47.748380 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000033117cec', 'path': '/dev/disk/by-id/os-brick+dev+dm-4', 'multipath_id': '33000000033117cec'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 02:06:47.755638 np0000001583 nova-compute[98241]: WARNING stevedore.named [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 02:06:47.755638 np0000001583 nova-compute[98241]: WARNING castellan.key_manager [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 02:06:47.755638 np0000001583 nova-compute[98241]: WARNING nova.keymgr.conf_key_mgr [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 02:06:47.773426 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Secret XML: <secret ephemeral="no" private="no">
May 28 02:06:47.773426 np0000001583 nova-compute[98241]:   <usage type="volume">
May 28 02:06:47.773426 np0000001583 nova-compute[98241]:     <volume>384a8e77-6054-4d06-8bcf-4a41cbac8d5f</volume>
May 28 02:06:47.773426 np0000001583 nova-compute[98241]:   </usage>
May 28 02:06:47.773426 np0000001583 nova-compute[98241]: </secret>
May 28 02:06:47.773426 np0000001583 nova-compute[98241]:  {{(pid=98241) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 28 02:06:47.781545 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lazy-loading 'flavor' on Instance uuid b369292d-fea0-46aa-b5c4-908b8bfb6209 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:06:47.804541 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Updating instance_info_cache with network_info: [{"id": "b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0", "address": "fa:16:3e:7c:9a:06", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2ddd1f1-c8", "ovs_interfaceid": "b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:06:47.875142 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:06:47.878672 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934007.878345, c9bfbfaa-4d10-4c18-8ad9-0f115a757b60 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:06:47.878903 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] VM Resumed (Lifecycle Event)
May 28 02:06:47.902737 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Took 12.30 seconds to build instance.
May 28 02:06:48.122477 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-645893af-ff9e-4dc5-b4da-c4202234f908 req-0a35b69c-2c46-4fbb-ac01-73ede27b1fb4 service nova] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Received event network-vif-plugged-69995ecd-0071-47d1-8844-2a23a5274ec6 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:06:48.123739 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-645893af-ff9e-4dc5-b4da-c4202234f908 req-0a35b69c-2c46-4fbb-ac01-73ede27b1fb4 service nova] Acquiring lock "c9bfbfaa-4d10-4c18-8ad9-0f115a757b60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:06:48.126098 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-645893af-ff9e-4dc5-b4da-c4202234f908 req-0a35b69c-2c46-4fbb-ac01-73ede27b1fb4 service nova] Lock "c9bfbfaa-4d10-4c18-8ad9-0f115a757b60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:06:48.126098 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-645893af-ff9e-4dc5-b4da-c4202234f908 req-0a35b69c-2c46-4fbb-ac01-73ede27b1fb4 service nova] Lock "c9bfbfaa-4d10-4c18-8ad9-0f115a757b60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:06:48.126098 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-645893af-ff9e-4dc5-b4da-c4202234f908 req-0a35b69c-2c46-4fbb-ac01-73ede27b1fb4 service nova] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] No waiting events found dispatching network-vif-plugged-69995ecd-0071-47d1-8844-2a23a5274ec6 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:06:48.126098 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-645893af-ff9e-4dc5-b4da-c4202234f908 req-0a35b69c-2c46-4fbb-ac01-73ede27b1fb4 service nova] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Received unexpected event network-vif-plugged-69995ecd-0071-47d1-8844-2a23a5274ec6 for instance with vm_state active and task_state None.
May 28 02:06:48.284174 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Attempting to attach volume 384a8e77-6054-4d06-8bcf-4a41cbac8d5f with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98241) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 02:06:48.285175 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] attach device xml: <disk type="block" device="disk">
May 28 02:06:48.285175 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:06:48.285175 np0000001583 nova-compute[98241]:   <alias name="ua-384a8e77-6054-4d06-8bcf-4a41cbac8d5f"/>
May 28 02:06:48.285175 np0000001583 nova-compute[98241]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-4"/>
May 28 02:06:48.285175 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:06:48.285175 np0000001583 nova-compute[98241]:   <serial>384a8e77-6054-4d06-8bcf-4a41cbac8d5f</serial>
May 28 02:06:48.285175 np0000001583 nova-compute[98241]:   <encryption format="luks">
May 28 02:06:48.285175 np0000001583 nova-compute[98241]:     <secret type="passphrase" uuid="94bb45c1-f08f-4196-ab84-69298ecb3abe"/>
May 28 02:06:48.285175 np0000001583 nova-compute[98241]:   </encryption>
May 28 02:06:48.285175 np0000001583 nova-compute[98241]: </disk>
May 28 02:06:48.285175 np0000001583 nova-compute[98241]:  {{(pid=98241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 02:06:48.306937 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Releasing lock "refresh_cache-e8bc20b7-8f2f-4226-9fcd-63c123604535" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:06:48.307604 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Instance network_info: |[{"id": "b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0", "address": "fa:16:3e:7c:9a:06", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2ddd1f1-c8", "ovs_interfaceid": "b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 02:06:48.362835 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 02:06:48.364872 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 02:06:48.365235 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Creating image(s)
May 28 02:06:48.366267 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Did not create local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 02:06:48.366492 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Ensure instance console log exists: /opt/stack/data/nova/instances/e8bc20b7-8f2f-4226-9fcd-63c123604535/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 02:06:48.366819 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:06:48.367113 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:06:48.367358 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:06:48.368212 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Start _get_guest_xml network_info=[{"id": "b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0", "address": "fa:16:3e:7c:9a:06", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2ddd1f1-c8", "ovs_interfaceid": "b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145', 'iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8bbe457d-aa5f-4e82-95e0-29d1ffc48145', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'e8bc20b7-8f2f-4226-9fcd-63c123604535', 'attached_at': '', 'detached_at': '', 'volume_id': '8bbe457d-aa5f-4e82-95e0-29d1ffc48145', 'serial': '8bbe457d-aa5f-4e82-95e0-29d1ffc48145'}, 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '0b260c50-eabf-46e7-951c-32f0d26ba79d', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 02:06:48.371820 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:06:48.373427 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-36597890', uuid='e8bc20b7-8f2f-4226-9fcd-63c123604535'), owner=OwnerMeta(userid='6be314b4eed642c3b2c72fe115860220', username='tempest-TestVolumeBootPattern-1031057169-project-member', projectid='432aa1094ced436494def17a875aa8e1', projectname='tempest-TestVolumeBootPattern-1031057169'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0", "address": "fa:16:3e:7c:9a:06", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2ddd1f1-c8", "ovs_interfaceid": "b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779934008.3728824) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 02:06:48.375103 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 02:06:48.375541 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 02:06:48.376913 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 02:06:48.377181 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 02:06:48.378572 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 02:06:48.379086 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 02:06:48.379292 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 02:06:48.379459 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 02:06:48.379971 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 02:06:48.380441 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 02:06:48.380608 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 02:06:48.380827 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 02:06:48.381010 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 02:06:48.381297 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 02:06:48.381636 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 02:06:48.381930 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 02:06:48.391255 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:06:48.397452 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:06:48.402945 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 02:06:48.403403 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145', 'iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8bbe457d-aa5f-4e82-95e0-29d1ffc48145', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:06:48.403651 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:06:48.405224 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "c9bfbfaa-4d10-4c18-8ad9-0f115a757b60" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.812s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:06:48.406467 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:06:48.406467 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145', 'iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8bbe457d-aa5f-4e82-95e0-29d1ffc48145', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 02:06:48.422193 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:06:48.422193 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:06:48.422193 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:06:48.422193 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:06:48.422193 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:06:48.422496 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:06:48.437235 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:06:48.437235 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:48.439735 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:06:48.439735 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:48.457185 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145] added
May 28 02:06:48.457185 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:06:48.457185 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:06:48.457185 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:06:48.457185 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:06:48.457185 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:06:48.457185 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:48.457185 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:06:48.457185 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0325(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:06:48.457185 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:06:48.459229 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145] added
May 28 02:06:48.459229 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:06:48.459229 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:06:48.459229 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:06:48.459229 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:06:48.459229 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:06:48.459229 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:48.459611 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:06:48.459611 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0371(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:06:48.459717 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:06:48.493938 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:49.362291 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0e3f2b03-4676-432d-98db-f4205f787463 req-7d9c25b3-98ae-435b-afa9-e4547d1708a3 service nova] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Received event network-changed-69995ecd-0071-47d1-8844-2a23a5274ec6 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:06:49.362291 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0e3f2b03-4676-432d-98db-f4205f787463 req-7d9c25b3-98ae-435b-afa9-e4547d1708a3 service nova] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Refreshing instance network info cache due to event network-changed-69995ecd-0071-47d1-8844-2a23a5274ec6. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:06:49.362291 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0e3f2b03-4676-432d-98db-f4205f787463 req-7d9c25b3-98ae-435b-afa9-e4547d1708a3 service nova] Acquiring lock "refresh_cache-c9bfbfaa-4d10-4c18-8ad9-0f115a757b60" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:06:49.362291 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0e3f2b03-4676-432d-98db-f4205f787463 req-7d9c25b3-98ae-435b-afa9-e4547d1708a3 service nova] Acquired lock "refresh_cache-c9bfbfaa-4d10-4c18-8ad9-0f115a757b60" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:06:49.362291 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-0e3f2b03-4676-432d-98db-f4205f787463 req-7d9c25b3-98ae-435b-afa9-e4547d1708a3 service nova] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Refreshing network info cache for port 69995ecd-0071-47d1-8844-2a23a5274ec6 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:06:49.455066 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:06:49.460480 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:06:49.472647 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:06:49.472647 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:06:49.478013 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:06:49.478013 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:49.486090 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:49.491317 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:49.504710 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:49.504710 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:49.504710 np0000001583 nova-compute[98241]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab (non-flash)
May 28 02:06:49.504710 np0000001583 nova-compute[98241]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab (non-flash)
May 28 02:06:49.504710 np0000001583 nova-compute[98241]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f (non-flash)
May 28 02:06:49.504710 np0000001583 nova-compute[98241]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f (non-flash)
May 28 02:06:49.504710 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:06:49.505401 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:49.505401 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:49.505401 np0000001583 nova-compute[98241]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab (non-flash)
May 28 02:06:49.505401 np0000001583 nova-compute[98241]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab (non-flash)
May 28 02:06:49.505401 np0000001583 nova-compute[98241]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f (non-flash)
May 28 02:06:49.505401 np0000001583 nova-compute[98241]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f (non-flash)
May 28 02:06:49.505401 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:06:49.515596 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:49.515596 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:49.515596 np0000001583 nova-compute[98241]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab (non-flash)
May 28 02:06:49.515596 np0000001583 nova-compute[98241]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab (non-flash)
May 28 02:06:49.515596 np0000001583 nova-compute[98241]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f (non-flash)
May 28 02:06:49.515596 np0000001583 nova-compute[98241]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f (non-flash)
May 28 02:06:49.515596 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:06:49.515886 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:49.515886 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:49.515886 np0000001583 nova-compute[98241]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab (non-flash)
May 28 02:06:49.515886 np0000001583 nova-compute[98241]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab (non-flash)
May 28 02:06:49.515886 np0000001583 nova-compute[98241]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f (non-flash)
May 28 02:06:49.515886 np0000001583 nova-compute[98241]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f (non-flash)
May 28 02:06:49.515886 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:06:49.552621 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145, portal: 192.168.40.100,3260]
May 28 02:06:49.552621 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145, portal: 192.168.40.100,3260] successful.
May 28 02:06:49.552621 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:49.569070 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:49.575353 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145, portal: 192.168.50.100,3260]
May 28 02:06:49.575353 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145, portal: 192.168.50.100,3260] successful.
May 28 02:06:49.575353 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:49.586948 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:49.587665 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:49.587665 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:49.587665 np0000001583 nova-compute[98241]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab (non-flash)
May 28 02:06:49.587665 np0000001583 nova-compute[98241]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab (non-flash)
May 28 02:06:49.587665 np0000001583 nova-compute[98241]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f (non-flash)
May 28 02:06:49.587665 np0000001583 nova-compute[98241]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f (non-flash)
May 28 02:06:49.587665 np0000001583 nova-compute[98241]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:06:49.587665 np0000001583 nova-compute[98241]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:06:49.587665 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:06:49.587930 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:49.587930 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:49.587930 np0000001583 nova-compute[98241]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab (non-flash)
May 28 02:06:49.587930 np0000001583 nova-compute[98241]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab (non-flash)
May 28 02:06:49.587930 np0000001583 nova-compute[98241]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f (non-flash)
May 28 02:06:49.587930 np0000001583 nova-compute[98241]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f (non-flash)
May 28 02:06:49.587930 np0000001583 nova-compute[98241]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:06:49.587930 np0000001583 nova-compute[98241]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:06:49.587930 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:06:49.588931 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.167s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:06:49.588931 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:06:49.589272 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] HCTL ('13', '-', '-', 0) found on session 151 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:06:49.589417 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:06:49.603744 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:49.603744 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:49.603744 np0000001583 nova-compute[98241]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab (non-flash)
May 28 02:06:49.603744 np0000001583 nova-compute[98241]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab (non-flash)
May 28 02:06:49.603744 np0000001583 nova-compute[98241]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f (non-flash)
May 28 02:06:49.603744 np0000001583 nova-compute[98241]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f (non-flash)
May 28 02:06:49.603744 np0000001583 nova-compute[98241]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:06:49.603744 np0000001583 nova-compute[98241]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:06:49.603744 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:06:49.604108 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:49.604108 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:49.604108 np0000001583 nova-compute[98241]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab (non-flash)
May 28 02:06:49.604108 np0000001583 nova-compute[98241]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab (non-flash)
May 28 02:06:49.604108 np0000001583 nova-compute[98241]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f (non-flash)
May 28 02:06:49.604108 np0000001583 nova-compute[98241]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f (non-flash)
May 28 02:06:49.604108 np0000001583 nova-compute[98241]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:06:49.604108 np0000001583 nova-compute[98241]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:06:49.604108 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:06:49.604434 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.182s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:06:49.604598 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:06:49.607922 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] HCTL ('14', '-', '-', 0) found on session 152 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:06:49.610189 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:06:49.610189 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Searching for a device in session 151 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:06:49.610189 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8bbe457d-aa5f-4e82-95e0-29d1ffc48145', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:06:49.629062 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Searching for a device in session 152 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:06:49.629062 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8bbe457d-aa5f-4e82-95e0-29d1ffc48145', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:06:49.655708 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-055a2514-182d-4345-8618-00f7c5ac5bb0 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Acquiring lock "0ce1d609-b3fe-4fb6-81ac-7a683c8f1992" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:06:49.655975 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-055a2514-182d-4345-8618-00f7c5ac5bb0 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "0ce1d609-b3fe-4fb6-81ac-7a683c8f1992" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:06:49.864148 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-0e3f2b03-4676-432d-98db-f4205f787463 req-7d9c25b3-98ae-435b-afa9-e4547d1708a3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:06:50.162727 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-055a2514-182d-4345-8618-00f7c5ac5bb0 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Detaching volume 36cd6d7e-70fb-4cf4-aeab-f233a5b36bab
May 28 02:06:50.206485 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-055a2514-182d-4345-8618-00f7c5ac5bb0 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Attempting to driver detach volume 36cd6d7e-70fb-4cf4-aeab-f233a5b36bab from mountpoint /dev/vdb
May 28 02:06:50.220239 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-055a2514-182d-4345-8618-00f7c5ac5bb0 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Found disk vdb by alias ua-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:06:50.221523 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-055a2514-182d-4345-8618-00f7c5ac5bb0 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Found disk vdb by alias ua-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:06:50.221633 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-055a2514-182d-4345-8618-00f7c5ac5bb0 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Attempting to detach device vdb from instance 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992 from the persistent domain config. {{(pid=98241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 02:06:50.221850 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-055a2514-182d-4345-8618-00f7c5ac5bb0 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:06:50.221850 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:06:50.221850 np0000001583 nova-compute[98241]:   <alias name="ua-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab"/>
May 28 02:06:50.221850 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-0"/>
May 28 02:06:50.221850 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:06:50.221850 np0000001583 nova-compute[98241]:   <serial>36cd6d7e-70fb-4cf4-aeab-f233a5b36bab</serial>
May 28 02:06:50.221850 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 02:06:50.221850 np0000001583 nova-compute[98241]: </disk>
May 28 02:06:50.221850 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:06:50.228569 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-0e3f2b03-4676-432d-98db-f4205f787463 req-7d9c25b3-98ae-435b-afa9-e4547d1708a3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:06:50.232714 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-055a2514-182d-4345-8618-00f7c5ac5bb0 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Successfully detached device vdb from instance 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992 from the persistent domain config.
May 28 02:06:50.232935 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-055a2514-182d-4345-8618-00f7c5ac5bb0 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] (1/8): Attempting to detach device vdb with device alias ua-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab from instance 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992 from the live domain config. {{(pid=98241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 02:06:50.233287 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-055a2514-182d-4345-8618-00f7c5ac5bb0 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:06:50.233287 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:06:50.233287 np0000001583 nova-compute[98241]:   <alias name="ua-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab"/>
May 28 02:06:50.233287 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-0"/>
May 28 02:06:50.233287 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:06:50.233287 np0000001583 nova-compute[98241]:   <serial>36cd6d7e-70fb-4cf4-aeab-f233a5b36bab</serial>
May 28 02:06:50.233287 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 02:06:50.233287 np0000001583 nova-compute[98241]: </disk>
May 28 02:06:50.233287 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:06:50.368873 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-0e3f2b03-4676-432d-98db-f4205f787463 req-7d9c25b3-98ae-435b-afa9-e4547d1708a3 service nova] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Updated VIF entry in instance network info cache for port 69995ecd-0071-47d1-8844-2a23a5274ec6. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:06:50.369847 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-0e3f2b03-4676-432d-98db-f4205f787463 req-7d9c25b3-98ae-435b-afa9-e4547d1708a3 service nova] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Updating instance_info_cache with network_info: [{"id": "69995ecd-0071-47d1-8844-2a23a5274ec6", "address": "fa:16:3e:e5:ab:c0", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap69995ecd-00", "ovs_interfaceid": "69995ecd-0071-47d1-8844-2a23a5274ec6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:06:50.422205 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 02:06:50.749283 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Received event <DeviceRemovedEvent: 1779934010.7489085, 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992 => ua-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab> from libvirt while the driver is waiting for it; dispatched. {{(pid=98241) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 02:06:50.750627 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-055a2514-182d-4345-8618-00f7c5ac5bb0 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab for instance 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992 {{(pid=98241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 02:06:50.753170 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-055a2514-182d-4345-8618-00f7c5ac5bb0 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Successfully detached device vdb from instance 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992 from the live domain config.
May 28 02:06:50.756492 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-055a2514-182d-4345-8618-00f7c5ac5bb0 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:06:50.756799 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-055a2514-182d-4345-8618-00f7c5ac5bb0 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab', 'iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '36cd6d7e-70fb-4cf4-aeab-f233a5b36bab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:06:50.756973 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-055a2514-182d-4345-8618-00f7c5ac5bb0 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:06:50.871949 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0e3f2b03-4676-432d-98db-f4205f787463 req-7d9c25b3-98ae-435b-afa9-e4547d1708a3 service nova] Releasing lock "refresh_cache-c9bfbfaa-4d10-4c18-8ad9-0f115a757b60" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:06:50.954687 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:06:50.954867 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:06:50.954961 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:06:50.955109 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] No VIF found with MAC fa:16:3e:b4:d0:b8, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:06:51.435525 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5f25e9a5-5b01-4f7e-ac7a-b70d7d88b8b6 req-6da4fd25-d11a-484f-b693-25784eafd195 service nova] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Received event network-vif-unplugged-b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:06:51.436264 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5f25e9a5-5b01-4f7e-ac7a-b70d7d88b8b6 req-6da4fd25-d11a-484f-b693-25784eafd195 service nova] Acquiring lock "e8bc20b7-8f2f-4226-9fcd-63c123604535-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:06:51.436477 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5f25e9a5-5b01-4f7e-ac7a-b70d7d88b8b6 req-6da4fd25-d11a-484f-b693-25784eafd195 service nova] Lock "e8bc20b7-8f2f-4226-9fcd-63c123604535-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:06:51.436642 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5f25e9a5-5b01-4f7e-ac7a-b70d7d88b8b6 req-6da4fd25-d11a-484f-b693-25784eafd195 service nova] Lock "e8bc20b7-8f2f-4226-9fcd-63c123604535-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:06:51.436791 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5f25e9a5-5b01-4f7e-ac7a-b70d7d88b8b6 req-6da4fd25-d11a-484f-b693-25784eafd195 service nova] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] No waiting events found dispatching network-vif-unplugged-b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:06:51.436931 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-5f25e9a5-5b01-4f7e-ac7a-b70d7d88b8b6 req-6da4fd25-d11a-484f-b693-25784eafd195 service nova] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Received unexpected event network-vif-unplugged-b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0 for instance with vm_state building and task_state spawning.
May 28 02:06:51.441100 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Found WWN 3300000006fea8150 for multipath device dm-5 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 02:06:51.441328 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:06:51.441467 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '3300000006fea8150', 'path': '/dev/dm-5', 'multipath_id': '3300000006fea8150'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:06:51.441581 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006fea8150', 'path': '/dev/dm-5', 'multipath_id': '3300000006fea8150'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 02:06:51.441934 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-055a2514-182d-4345-8618-00f7c5ac5bb0 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.685s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:06:51.442310 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-055a2514-182d-4345-8618-00f7c5ac5bb0 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab', 'iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '36cd6d7e-70fb-4cf4-aeab-f233a5b36bab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:06:51.442452 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-055a2514-182d-4345-8618-00f7c5ac5bb0 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:06:51.471497 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-055a2514-182d-4345-8618-00f7c5ac5bb0 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:51.471497 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:51.471497 np0000001583 nova-compute[98241]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab (non-flash)
May 28 02:06:51.471497 np0000001583 nova-compute[98241]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab (non-flash)
May 28 02:06:51.471497 np0000001583 nova-compute[98241]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f (non-flash)
May 28 02:06:51.471497 np0000001583 nova-compute[98241]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f (non-flash)
May 28 02:06:51.471497 np0000001583 nova-compute[98241]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:06:51.471497 np0000001583 nova-compute[98241]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:06:51.471497 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:06:51.471851 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-055a2514-182d-4345-8618-00f7c5ac5bb0 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsi session list stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:51.471851 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:51.471851 np0000001583 nova-compute[98241]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab (non-flash)
May 28 02:06:51.471851 np0000001583 nova-compute[98241]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab (non-flash)
May 28 02:06:51.471851 np0000001583 nova-compute[98241]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f (non-flash)
May 28 02:06:51.471851 np0000001583 nova-compute[98241]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f (non-flash)
May 28 02:06:51.471851 np0000001583 nova-compute[98241]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:06:51.471851 np0000001583 nova-compute[98241]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:06:51.471851 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:06:51.471851 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-055a2514-182d-4345-8618-00f7c5ac5bb0 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa', '141'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa', '142'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab', '147'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab', '148'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f', '149'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f', '150'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145', '151'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145', '152')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:06:51.472244 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-055a2514-182d-4345-8618-00f7c5ac5bb0 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab', '148')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:06:51.474025 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-055a2514-182d-4345-8618-00f7c5ac5bb0 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab', '147')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:06:51.475638 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-055a2514-182d-4345-8618-00f7c5ac5bb0 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f8156160>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab'): ({'sdb'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:06:51.475889 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-055a2514-182d-4345-8618-00f7c5ac5bb0 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Removing multipathed devices sdc, sdb {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:06:51.476350 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-055a2514-182d-4345-8618-00f7c5ac5bb0 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Flush multipath device 330000000ccde5228 {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:06:51.510555 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-055a2514-182d-4345-8618-00f7c5ac5bb0 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:06:51.557761 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-055a2514-182d-4345-8618-00f7c5ac5bb0 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:06:51.599726 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-055a2514-182d-4345-8618-00f7c5ac5bb0 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:06:51.599912 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-055a2514-182d-4345-8618-00f7c5ac5bb0 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:06:51.601731 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-055a2514-182d-4345-8618-00f7c5ac5bb0 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:06:51.612135 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-055a2514-182d-4345-8618-00f7c5ac5bb0 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:06:51.612313 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-055a2514-182d-4345-8618-00f7c5ac5bb0 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:06:51.623491 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-055a2514-182d-4345-8618-00f7c5ac5bb0 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:51.663475 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-055a2514-182d-4345-8618-00f7c5ac5bb0 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 148, target: iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab, portal: 192.168.40.100,3260]
May 28 02:06:51.663475 np0000001583 nova-compute[98241]: Logout of [sid: 148, target: iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab, portal: 192.168.40.100,3260] successful.
May 28 02:06:51.663475 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:51.681105 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-055a2514-182d-4345-8618-00f7c5ac5bb0 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:51.692390 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-055a2514-182d-4345-8618-00f7c5ac5bb0 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:51.719465 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-055a2514-182d-4345-8618-00f7c5ac5bb0 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 147, target: iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab, portal: 192.168.50.100,3260]
May 28 02:06:51.719465 np0000001583 nova-compute[98241]: Logout of [sid: 147, target: iqn.2023-03.storpool.com:os--volume-36cd6d7e-70fb-4cf4-aeab-f233a5b36bab, portal: 192.168.50.100,3260] successful.
May 28 02:06:51.719465 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:51.737128 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-055a2514-182d-4345-8618-00f7c5ac5bb0 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:51.737248 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-055a2514-182d-4345-8618-00f7c5ac5bb0 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:06:51.737352 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-055a2514-182d-4345-8618-00f7c5ac5bb0 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] <== disconnect_volume: return (980ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:06:51.737475 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-055a2514-182d-4345-8618-00f7c5ac5bb0 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:06:51.949681 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:06:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-36597890',display_name='tempest-TestVolumeBootPattern-server-36597890',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testvolumebootpattern-server-36597890',id=66,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwh6E4i05I/O8lsE0bUEzocgUz6EHWmEWnV87akBvJyUZCaSgScF6CqBqpI/yb99Eh4gFmhgnyBDUzlF9t565ox0untLBipqeePS0CqQE7tD/Pd6ddczsNL4V+3d8XsQw==',key_name='tempest-TestVolumeBootPattern-1374779836',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='432aa1094ced436494def17a875aa8e1',ramdisk_id='',reservation_id='r-9p6bosr0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1031057169',owner_user_name='tempest-TestVolumeBootPattern-1031057169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:06:46Z,user_data=None,user_id='6be314b4eed642c3b2c72fe115860220',uuid=e8bc20b7-8f2f-4226-9fcd-63c123604535,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0", "address": "fa:16:3e:7c:9a:06", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2ddd1f1-c8", "ovs_interfaceid": "b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 02:06:51.950412 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converting VIF {"id": "b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0", "address": "fa:16:3e:7c:9a:06", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2ddd1f1-c8", "ovs_interfaceid": "b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:06:51.952199 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:9a:06,bridge_name='br-int',has_traffic_filtering=True,id=b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2ddd1f1-c8') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:06:51.953438 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lazy-loading 'pci_devices' on Instance uuid e8bc20b7-8f2f-4226-9fcd-63c123604535 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:06:52.298855 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-055a2514-182d-4345-8618-00f7c5ac5bb0 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lazy-loading 'flavor' on Instance uuid 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:06:52.456666 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] End _get_guest_xml xml=<domain type="qemu">
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:   <uuid>e8bc20b7-8f2f-4226-9fcd-63c123604535</uuid>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:   <name>instance-00000042</name>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:   <metadata>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:       <nova:name>tempest-TestVolumeBootPattern-server-36597890</nova:name>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 02:06:48</nova:creationTime>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:       <nova:image uuid="">
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:       </nova:image>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:         <nova:user uuid="6be314b4eed642c3b2c72fe115860220">tempest-TestVolumeBootPattern-1031057169-project-member</nova:user>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:         <nova:project uuid="432aa1094ced436494def17a875aa8e1">tempest-TestVolumeBootPattern-1031057169</nova:project>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:       <nova:root type="volume" uuid=""/>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:         <nova:port uuid="b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0">
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:         </nova:port>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:   </metadata>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:     <system>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:       <entry name="serial">e8bc20b7-8f2f-4226-9fcd-63c123604535</entry>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:       <entry name="uuid">e8bc20b7-8f2f-4226-9fcd-63c123604535</entry>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:     </system>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:   <os>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:   </os>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:   <features>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:     <acpi/>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:     <tcg>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:     </tcg>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:   </features>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:   </cpu>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:   <devices>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/e8bc20b7-8f2f-4226-9fcd-63c123604535/disk.config"/>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:     </disk>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:     <disk type="block" device="disk">
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:       <alias name="ua-8bbe457d-aa5f-4e82-95e0-29d1ffc48145"/>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:       <source dev="/dev/dm-5"/>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:       <serial>8bbe457d-aa5f-4e82-95e0-29d1ffc48145</serial>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:     </disk>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:7c:9a:06"/>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:       <target dev="tapb2ddd1f1-c8"/>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:     </interface>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/e8bc20b7-8f2f-4226-9fcd-63c123604535/console.log" append="off"/>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:     </serial>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:     <video>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:     </video>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:     </rng>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:     </memballoon>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:   </devices>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]: </domain>
May 28 02:06:52.456666 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 02:06:52.459971 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Preparing to wait for external event network-vif-plugged-b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 02:06:52.459971 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "e8bc20b7-8f2f-4226-9fcd-63c123604535-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:06:52.459971 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "e8bc20b7-8f2f-4226-9fcd-63c123604535-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:06:52.459971 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "e8bc20b7-8f2f-4226-9fcd-63c123604535-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:06:52.459971 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:06:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-36597890',display_name='tempest-TestVolumeBootPattern-server-36597890',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testvolumebootpattern-server-36597890',id=66,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwh6E4i05I/O8lsE0bUEzocgUz6EHWmEWnV87akBvJyUZCaSgScF6CqBqpI/yb99Eh4gFmhgnyBDUzlF9t565ox0untLBipqeePS0CqQE7tD/Pd6ddczsNL4V+3d8XsQw==',key_name='tempest-TestVolumeBootPattern-1374779836',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='432aa1094ced436494def17a875aa8e1',ramdisk_id='',reservation_id='r-9p6bosr0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1031057169',owner_user_name='tempest-TestVolumeBootPattern-1031057169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:06:46Z,user_data=None,user_id='6be314b4eed642c3b2c72fe115860220',uuid=e8bc20b7-8f2f-4226-9fcd-63c123604535,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0", "address": "fa:16:3e:7c:9a:06", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2ddd1f1-c8", "ovs_interfaceid": "b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 02:06:52.459971 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converting VIF {"id": "b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0", "address": "fa:16:3e:7c:9a:06", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2ddd1f1-c8", "ovs_interfaceid": "b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:06:52.459971 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:9a:06,bridge_name='br-int',has_traffic_filtering=True,id=b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2ddd1f1-c8') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:06:52.459971 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:9a:06,bridge_name='br-int',has_traffic_filtering=True,id=b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2ddd1f1-c8') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 02:06:52.459971 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:52.459971 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:06:52.459971 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 02:06:52.460973 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:52.461208 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '40990822-9e52-504d-8c19-4b7150b0676b', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:06:52.462217 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:52.463183 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:06:52.464453 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:52.467471 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:52.467603 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb2ddd1f1-c8, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:06:52.467902 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb2ddd1f1-c8, col_values=(('qos', UUID('fa281f53-e4a3-410f-a7cb-b16b561681ef')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:06:52.468107 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb2ddd1f1-c8, col_values=(('external_ids', {'iface-id': 'b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:9a:06', 'vm-uuid': 'e8bc20b7-8f2f-4226-9fcd-63c123604535'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:06:52.468985 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:52.470547 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:06:52.476322 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:52.478048 np0000001583 nova-compute[98241]: INFO os_vif [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:9a:06,bridge_name='br-int',has_traffic_filtering=True,id=b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2ddd1f1-c8')
May 28 02:06:52.516883 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c3a3e90f-2490-417a-9cba-4adcb61c6d1c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "b369292d-fea0-46aa-b5c4-908b8bfb6209" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.545s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:06:52.782194 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-907fd427-7cd0-4719-ad00-f6d1c777509c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Acquiring lock "b369292d-fea0-46aa-b5c4-908b8bfb6209" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:06:52.782378 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-907fd427-7cd0-4719-ad00-f6d1c777509c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "b369292d-fea0-46aa-b5c4-908b8bfb6209" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:06:53.287138 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-907fd427-7cd0-4719-ad00-f6d1c777509c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Detaching volume 384a8e77-6054-4d06-8bcf-4a41cbac8d5f
May 28 02:06:53.305772 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-055a2514-182d-4345-8618-00f7c5ac5bb0 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "0ce1d609-b3fe-4fb6-81ac-7a683c8f1992" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.650s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:06:53.327915 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-907fd427-7cd0-4719-ad00-f6d1c777509c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Attempting to driver detach volume 384a8e77-6054-4d06-8bcf-4a41cbac8d5f from mountpoint /dev/vdb
May 28 02:06:53.362017 np0000001583 nova-compute[98241]: DEBUG os_brick.encryptors [None req-907fd427-7cd0-4719-ad00-f6d1c777509c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f', 'iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '384a8e77-6054-4d06-8bcf-4a41cbac8d5f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-4'}, 'status': 'reserved', 'instance': 'b369292d-fea0-46aa-b5c4-908b8bfb6209', 'attached_at': '', 'detached_at': '', 'volume_id': '384a8e77-6054-4d06-8bcf-4a41cbac8d5f', 'serial': '384a8e77-6054-4d06-8bcf-4a41cbac8d5f'} {{(pid=98241) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 02:06:53.365796 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-907fd427-7cd0-4719-ad00-f6d1c777509c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Found disk vdb by alias ua-384a8e77-6054-4d06-8bcf-4a41cbac8d5f {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:06:53.369404 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-907fd427-7cd0-4719-ad00-f6d1c777509c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Found disk vdb by alias ua-384a8e77-6054-4d06-8bcf-4a41cbac8d5f {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:06:53.371536 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-907fd427-7cd0-4719-ad00-f6d1c777509c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Attempting to detach device vdb from instance b369292d-fea0-46aa-b5c4-908b8bfb6209 from the persistent domain config. {{(pid=98241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 02:06:53.371536 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-907fd427-7cd0-4719-ad00-f6d1c777509c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:06:53.371536 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:06:53.371536 np0000001583 nova-compute[98241]:   <alias name="ua-384a8e77-6054-4d06-8bcf-4a41cbac8d5f"/>
May 28 02:06:53.371536 np0000001583 nova-compute[98241]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-4"/>
May 28 02:06:53.371536 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:06:53.371536 np0000001583 nova-compute[98241]:   <serial>384a8e77-6054-4d06-8bcf-4a41cbac8d5f</serial>
May 28 02:06:53.371536 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 02:06:53.371536 np0000001583 nova-compute[98241]:   <encryption format="luks">
May 28 02:06:53.371536 np0000001583 nova-compute[98241]:     <secret type="passphrase" uuid="94bb45c1-f08f-4196-ab84-69298ecb3abe"/>
May 28 02:06:53.371536 np0000001583 nova-compute[98241]:   </encryption>
May 28 02:06:53.371536 np0000001583 nova-compute[98241]: </disk>
May 28 02:06:53.371536 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:06:53.381120 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-907fd427-7cd0-4719-ad00-f6d1c777509c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Successfully detached device vdb from instance b369292d-fea0-46aa-b5c4-908b8bfb6209 from the persistent domain config.
May 28 02:06:53.381804 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-907fd427-7cd0-4719-ad00-f6d1c777509c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] (1/8): Attempting to detach device vdb with device alias ua-384a8e77-6054-4d06-8bcf-4a41cbac8d5f from instance b369292d-fea0-46aa-b5c4-908b8bfb6209 from the live domain config. {{(pid=98241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 02:06:53.381804 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-907fd427-7cd0-4719-ad00-f6d1c777509c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:06:53.381804 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:06:53.381804 np0000001583 nova-compute[98241]:   <alias name="ua-384a8e77-6054-4d06-8bcf-4a41cbac8d5f"/>
May 28 02:06:53.381804 np0000001583 nova-compute[98241]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-4"/>
May 28 02:06:53.381804 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:06:53.381804 np0000001583 nova-compute[98241]:   <serial>384a8e77-6054-4d06-8bcf-4a41cbac8d5f</serial>
May 28 02:06:53.381804 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 02:06:53.381804 np0000001583 nova-compute[98241]:   <encryption format="luks">
May 28 02:06:53.381804 np0000001583 nova-compute[98241]:     <secret type="passphrase" uuid="94bb45c1-f08f-4196-ab84-69298ecb3abe"/>
May 28 02:06:53.381804 np0000001583 nova-compute[98241]:   </encryption>
May 28 02:06:53.381804 np0000001583 nova-compute[98241]: </disk>
May 28 02:06:53.381804 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:06:53.498435 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:53.746622 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-13901315-5aa6-46ae-9716-718c55a68431 req-891558d2-1dd3-4084-aa2d-233e7ecee886 service nova] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Received event network-changed-5a494f64-719c-4d87-af16-acf57733b3b9 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:06:53.747302 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-13901315-5aa6-46ae-9716-718c55a68431 req-891558d2-1dd3-4084-aa2d-233e7ecee886 service nova] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Refreshing instance network info cache due to event network-changed-5a494f64-719c-4d87-af16-acf57733b3b9. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:06:53.747800 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-13901315-5aa6-46ae-9716-718c55a68431 req-891558d2-1dd3-4084-aa2d-233e7ecee886 service nova] Acquiring lock "refresh_cache-0ce1d609-b3fe-4fb6-81ac-7a683c8f1992" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:06:53.748577 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-13901315-5aa6-46ae-9716-718c55a68431 req-891558d2-1dd3-4084-aa2d-233e7ecee886 service nova] Acquired lock "refresh_cache-0ce1d609-b3fe-4fb6-81ac-7a683c8f1992" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:06:53.748577 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-13901315-5aa6-46ae-9716-718c55a68431 req-891558d2-1dd3-4084-aa2d-233e7ecee886 service nova] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Refreshing network info cache for port 5a494f64-719c-4d87-af16-acf57733b3b9 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:06:53.939305 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-907fd427-7cd0-4719-ad00-f6d1c777509c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-384a8e77-6054-4d06-8bcf-4a41cbac8d5f for instance b369292d-fea0-46aa-b5c4-908b8bfb6209 {{(pid=98241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 02:06:53.939986 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Received event <DeviceRemovedEvent: 1779934013.9393828, b369292d-fea0-46aa-b5c4-908b8bfb6209 => ua-384a8e77-6054-4d06-8bcf-4a41cbac8d5f> from libvirt while the driver is waiting for it; dispatched. {{(pid=98241) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 02:06:53.942032 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-907fd427-7cd0-4719-ad00-f6d1c777509c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Successfully detached device vdb from instance b369292d-fea0-46aa-b5c4-908b8bfb6209 from the live domain config.
May 28 02:06:53.945663 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-907fd427-7cd0-4719-ad00-f6d1c777509c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:06:53.945663 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-907fd427-7cd0-4719-ad00-f6d1c777509c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f', 'iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '384a8e77-6054-4d06-8bcf-4a41cbac8d5f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:06:53.945663 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-907fd427-7cd0-4719-ad00-f6d1c777509c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:06:54.004840 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:06:54.004840 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:06:54.004840 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] No VIF found with MAC fa:16:3e:7c:9a:06, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:06:54.004840 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Using config drive
May 28 02:06:54.251171 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-13901315-5aa6-46ae-9716-718c55a68431 req-891558d2-1dd3-4084-aa2d-233e7ecee886 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:06:54.282566 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-656c0d3c-ae9f-4070-9951-10047be0adc8 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Acquiring lock "0ce1d609-b3fe-4fb6-81ac-7a683c8f1992" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:06:54.282757 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-656c0d3c-ae9f-4070-9951-10047be0adc8 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "0ce1d609-b3fe-4fb6-81ac-7a683c8f1992" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:06:54.282965 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-656c0d3c-ae9f-4070-9951-10047be0adc8 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Acquiring lock "0ce1d609-b3fe-4fb6-81ac-7a683c8f1992-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:06:54.283143 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-656c0d3c-ae9f-4070-9951-10047be0adc8 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "0ce1d609-b3fe-4fb6-81ac-7a683c8f1992-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:06:54.283271 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-656c0d3c-ae9f-4070-9951-10047be0adc8 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "0ce1d609-b3fe-4fb6-81ac-7a683c8f1992-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:06:54.286664 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-656c0d3c-ae9f-4070-9951-10047be0adc8 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Terminating instance
May 28 02:06:54.510166 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:06:54.574822 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-13901315-5aa6-46ae-9716-718c55a68431 req-891558d2-1dd3-4084-aa2d-233e7ecee886 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:06:54.661148 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Creating config drive at /opt/stack/data/nova/instances/e8bc20b7-8f2f-4226-9fcd-63c123604535/disk.config
May 28 02:06:54.664751 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e8bc20b7-8f2f-4226-9fcd-63c123604535/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp78pxx8b_ {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:06:54.727105 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e8bc20b7-8f2f-4226-9fcd-63c123604535/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp78pxx8b_" returned: 0 in 0.062s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:06:54.733604 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-13901315-5aa6-46ae-9716-718c55a68431 req-891558d2-1dd3-4084-aa2d-233e7ecee886 service nova] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Updated VIF entry in instance network info cache for port 5a494f64-719c-4d87-af16-acf57733b3b9. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:06:54.734069 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-13901315-5aa6-46ae-9716-718c55a68431 req-891558d2-1dd3-4084-aa2d-233e7ecee886 service nova] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Updating instance_info_cache with network_info: [{"id": "5a494f64-719c-4d87-af16-acf57733b3b9", "address": "fa:16:3e:ed:a3:d2", "network": {"id": "4f6e8375-a959-44b0-9cab-ae7918680bf7", "bridge": "br-int", "label": "tempest-TestStampPattern-914776722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d9663116fe18428d8e37dea7b30d8b5a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a494f64-71", "ovs_interfaceid": "5a494f64-719c-4d87-af16-acf57733b3b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:06:54.790358 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-656c0d3c-ae9f-4070-9951-10047be0adc8 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 02:06:54.814146 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:54.817107 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:54.846371 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:54.963192 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-497442fb-55b9-4897-807e-4105737eac92 req-af6d03c3-66aa-4f17-a977-cd6e587d44ef service nova] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Received event network-vif-unplugged-5a494f64-719c-4d87-af16-acf57733b3b9 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:06:54.963192 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-497442fb-55b9-4897-807e-4105737eac92 req-af6d03c3-66aa-4f17-a977-cd6e587d44ef service nova] Acquiring lock "0ce1d609-b3fe-4fb6-81ac-7a683c8f1992-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:06:54.963192 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-497442fb-55b9-4897-807e-4105737eac92 req-af6d03c3-66aa-4f17-a977-cd6e587d44ef service nova] Lock "0ce1d609-b3fe-4fb6-81ac-7a683c8f1992-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:06:54.963192 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-497442fb-55b9-4897-807e-4105737eac92 req-af6d03c3-66aa-4f17-a977-cd6e587d44ef service nova] Lock "0ce1d609-b3fe-4fb6-81ac-7a683c8f1992-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:06:54.963192 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-497442fb-55b9-4897-807e-4105737eac92 req-af6d03c3-66aa-4f17-a977-cd6e587d44ef service nova] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] No waiting events found dispatching network-vif-unplugged-5a494f64-719c-4d87-af16-acf57733b3b9 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:06:54.963192 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-497442fb-55b9-4897-807e-4105737eac92 req-af6d03c3-66aa-4f17-a977-cd6e587d44ef service nova] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Received event network-vif-unplugged-5a494f64-719c-4d87-af16-acf57733b3b9 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:06:54.985678 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:54.994017 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:55.236821 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-13901315-5aa6-46ae-9716-718c55a68431 req-891558d2-1dd3-4084-aa2d-233e7ecee886 service nova] Releasing lock "refresh_cache-0ce1d609-b3fe-4fb6-81ac-7a683c8f1992" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:06:55.274604 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:55.293260 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999585621999813 future=<Future at 0x7724ec2305f0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:06:55.294161 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.998769117999927 future=<Future at 0x7724ec2305f0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:06:55.294161 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.998629786000038 future=<Future at 0x7724ec2305f0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:06:55.301108 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Instance destroyed successfully.
May 28 02:06:55.301108 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-656c0d3c-ae9f-4070-9951-10047be0adc8 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lazy-loading 'resources' on Instance uuid 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:06:55.314221 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:55.420380 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:55.470574 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:55.475938 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:55.580441 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:55.804798 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-656c0d3c-ae9f-4070-9951-10047be0adc8 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T02:05:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-554433487',display_name='tempest-TestStampPattern-server-554433487',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-teststamppattern-server-554433487',id=63,image_ref='2128c605-74b4-4566-878a-c29ca1ec7e50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGla4S7tzFQM3H7dOtPyxXylIxo5cIZbTOWxzJqFZg2znrJ8fjc45cg7DBtdnBMMzNou2BAybRIZM9Fj+5atQu7kwWfQaIDwG2yH2osFl+wPy/fI2Pvg+h4A9P59YVZ+gw==',key_name='tempest-TestStampPattern-1385235397',keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:05:56Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d9663116fe18428d8e37dea7b30d8b5a',ramdisk_id='',reservation_id='r-4biy80qd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='7751bb1a-84b9-48ce-81da-b3a41d63eadc',image_min_disk='1',image_min_ram='0',image_owner_id='d9663116fe18428d8e37dea7b30d8b5a',image_owner_project_name='tempest-TestStampPattern-897366137',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-897366137-project-member',image_user_id='db5b8b66a90b4a2dba53c340347aff1d',owner_project_name='tempest-TestStampPattern-897366137',owner_user_name='tempest-TestStampPattern-897366137-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T02:05:57Z,user_data=None,user_id='db5b8b66a90b4a2dba53c340347aff1d',uuid=0ce1d609-b3fe-4fb6-81ac-7a683c8f1992,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a494f64-719c-4d87-af16-acf57733b3b9", "address": "fa:16:3e:ed:a3:d2", "network": {"id": "4f6e8375-a959-44b0-9cab-ae7918680bf7", "bridge": "br-int", "label": "tempest-TestStampPattern-914776722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d9663116fe18428d8e37dea7b30d8b5a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a494f64-71", "ovs_interfaceid": "5a494f64-719c-4d87-af16-acf57733b3b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:06:55.805025 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-656c0d3c-ae9f-4070-9951-10047be0adc8 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Converting VIF {"id": "5a494f64-719c-4d87-af16-acf57733b3b9", "address": "fa:16:3e:ed:a3:d2", "network": {"id": "4f6e8375-a959-44b0-9cab-ae7918680bf7", "bridge": "br-int", "label": "tempest-TestStampPattern-914776722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d9663116fe18428d8e37dea7b30d8b5a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a494f64-71", "ovs_interfaceid": "5a494f64-719c-4d87-af16-acf57733b3b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:06:55.805804 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-656c0d3c-ae9f-4070-9951-10047be0adc8 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:a3:d2,bridge_name='br-int',has_traffic_filtering=True,id=5a494f64-719c-4d87-af16-acf57733b3b9,network=Network(4f6e8375-a959-44b0-9cab-ae7918680bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a494f64-71') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:06:55.806044 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-656c0d3c-ae9f-4070-9951-10047be0adc8 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:a3:d2,bridge_name='br-int',has_traffic_filtering=True,id=5a494f64-719c-4d87-af16-acf57733b3b9,network=Network(4f6e8375-a959-44b0-9cab-ae7918680bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a494f64-71') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:06:55.807384 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:55.807721 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a494f64-71, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:06:55.810102 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:06:55.810859 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:55.811008 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=718a5a74-4edb-40a0-985b-24ca3993bf04) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:06:55.812500 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:06:55.814184 np0000001583 nova-compute[98241]: INFO os_vif [None req-656c0d3c-ae9f-4070-9951-10047be0adc8 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:a3:d2,bridge_name='br-int',has_traffic_filtering=True,id=5a494f64-719c-4d87-af16-acf57733b3b9,network=Network(4f6e8375-a959-44b0-9cab-ae7918680bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a494f64-71')
May 28 02:06:55.814492 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-656c0d3c-ae9f-4070-9951-10047be0adc8 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Deleting instance files /opt/stack/data/nova/instances/0ce1d609-b3fe-4fb6-81ac-7a683c8f1992_del
May 28 02:06:55.815198 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-656c0d3c-ae9f-4070-9951-10047be0adc8 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Deletion of /opt/stack/data/nova/instances/0ce1d609-b3fe-4fb6-81ac-7a683c8f1992_del complete
May 28 02:06:55.903492 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-907fd427-7cd0-4719-ad00-f6d1c777509c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.958s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:06:55.904852 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-907fd427-7cd0-4719-ad00-f6d1c777509c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f', 'iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '384a8e77-6054-4d06-8bcf-4a41cbac8d5f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:06:55.904852 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-907fd427-7cd0-4719-ad00-f6d1c777509c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:06:55.936671 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-907fd427-7cd0-4719-ad00-f6d1c777509c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:55.936671 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:55.936671 np0000001583 nova-compute[98241]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f (non-flash)
May 28 02:06:55.936671 np0000001583 nova-compute[98241]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f (non-flash)
May 28 02:06:55.936671 np0000001583 nova-compute[98241]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:06:55.936671 np0000001583 nova-compute[98241]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:06:55.936671 np0000001583 nova-compute[98241]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:06:55.936671 np0000001583 nova-compute[98241]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:06:55.936671 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:06:55.936949 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-907fd427-7cd0-4719-ad00-f6d1c777509c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsi session list stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:55.936949 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:06:55.936949 np0000001583 nova-compute[98241]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f (non-flash)
May 28 02:06:55.936949 np0000001583 nova-compute[98241]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f (non-flash)
May 28 02:06:55.936949 np0000001583 nova-compute[98241]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:06:55.936949 np0000001583 nova-compute[98241]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:06:55.936949 np0000001583 nova-compute[98241]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:06:55.936949 np0000001583 nova-compute[98241]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:06:55.936949 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:06:55.937203 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-907fd427-7cd0-4719-ad00-f6d1c777509c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa', '141'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa', '142'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f', '149'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f', '150'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145', '151'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145', '152'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d', '153'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d', '154')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:06:55.937203 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-907fd427-7cd0-4719-ad00-f6d1c777509c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f', '149')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:06:55.938071 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-907fd427-7cd0-4719-ad00-f6d1c777509c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f', '150')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:06:55.938936 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-907fd427-7cd0-4719-ad00-f6d1c777509c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724ec2c77e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f'): ({'sdg'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:06:55.939107 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-907fd427-7cd0-4719-ad00-f6d1c777509c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Removing multipathed devices sdf, sdg {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:06:55.939996 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-907fd427-7cd0-4719-ad00-f6d1c777509c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Flush multipath device 33000000033117cec {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:06:55.979540 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-907fd427-7cd0-4719-ad00-f6d1c777509c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:06:56.037891 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-907fd427-7cd0-4719-ad00-f6d1c777509c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:06:56.082317 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-907fd427-7cd0-4719-ad00-f6d1c777509c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:06:56.082317 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-907fd427-7cd0-4719-ad00-f6d1c777509c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:06:56.082764 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-907fd427-7cd0-4719-ad00-f6d1c777509c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:06:56.095766 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-907fd427-7cd0-4719-ad00-f6d1c777509c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:06:56.096036 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-907fd427-7cd0-4719-ad00-f6d1c777509c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:06:56.109483 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-907fd427-7cd0-4719-ad00-f6d1c777509c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:56.148464 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-907fd427-7cd0-4719-ad00-f6d1c777509c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 149, target: iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f, portal: 192.168.40.100,3260]
May 28 02:06:56.148464 np0000001583 nova-compute[98241]: Logout of [sid: 149, target: iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f, portal: 192.168.40.100,3260] successful.
May 28 02:06:56.148464 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:56.170556 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-907fd427-7cd0-4719-ad00-f6d1c777509c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:56.173071 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934016.1726894, e8bc20b7-8f2f-4226-9fcd-63c123604535 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:06:56.173408 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] VM Started (Lifecycle Event)
May 28 02:06:56.186021 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-907fd427-7cd0-4719-ad00-f6d1c777509c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:56.231225 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-907fd427-7cd0-4719-ad00-f6d1c777509c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 150, target: iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f, portal: 192.168.50.100,3260]
May 28 02:06:56.231225 np0000001583 nova-compute[98241]: Logout of [sid: 150, target: iqn.2023-03.storpool.com:os--volume-384a8e77-6054-4d06-8bcf-4a41cbac8d5f, portal: 192.168.50.100,3260] successful.
May 28 02:06:56.231225 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:56.246513 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-907fd427-7cd0-4719-ad00-f6d1c777509c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:06:56.247875 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-907fd427-7cd0-4719-ad00-f6d1c777509c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:06:56.248268 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-907fd427-7cd0-4719-ad00-f6d1c777509c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] <== disconnect_volume: return (2302ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:06:56.248442 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-907fd427-7cd0-4719-ad00-f6d1c777509c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:06:56.321717 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-656c0d3c-ae9f-4070-9951-10047be0adc8 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Took 1.53 seconds to destroy the instance on the hypervisor.
May 28 02:06:56.322971 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-656c0d3c-ae9f-4070-9951-10047be0adc8 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 02:06:56.322971 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 02:06:56.323048 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 02:06:56.323349 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:06:56.425785 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:06:56.675997 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:06:56.680707 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934016.6803124, e8bc20b7-8f2f-4226-9fcd-63c123604535 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:06:56.681026 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] VM Paused (Lifecycle Event)
May 28 02:06:56.800261 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-907fd427-7cd0-4719-ad00-f6d1c777509c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lazy-loading 'flavor' on Instance uuid b369292d-fea0-46aa-b5c4-908b8bfb6209 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:06:57.044368 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e6c24a8a-d7e3-4a48-b974-89f85876ae25 req-b1971897-a8d1-4f07-ae5f-0a1082917dbe service nova] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Received event network-vif-unplugged-5a494f64-719c-4d87-af16-acf57733b3b9 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:06:57.044754 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e6c24a8a-d7e3-4a48-b974-89f85876ae25 req-b1971897-a8d1-4f07-ae5f-0a1082917dbe service nova] Acquiring lock "0ce1d609-b3fe-4fb6-81ac-7a683c8f1992-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:06:57.044939 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e6c24a8a-d7e3-4a48-b974-89f85876ae25 req-b1971897-a8d1-4f07-ae5f-0a1082917dbe service nova] Lock "0ce1d609-b3fe-4fb6-81ac-7a683c8f1992-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:06:57.045095 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e6c24a8a-d7e3-4a48-b974-89f85876ae25 req-b1971897-a8d1-4f07-ae5f-0a1082917dbe service nova] Lock "0ce1d609-b3fe-4fb6-81ac-7a683c8f1992-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:06:57.045281 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e6c24a8a-d7e3-4a48-b974-89f85876ae25 req-b1971897-a8d1-4f07-ae5f-0a1082917dbe service nova] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] No waiting events found dispatching network-vif-unplugged-5a494f64-719c-4d87-af16-acf57733b3b9 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:06:57.045405 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e6c24a8a-d7e3-4a48-b974-89f85876ae25 req-b1971897-a8d1-4f07-ae5f-0a1082917dbe service nova] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Received event network-vif-unplugged-5a494f64-719c-4d87-af16-acf57733b3b9 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:06:57.045515 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e6c24a8a-d7e3-4a48-b974-89f85876ae25 req-b1971897-a8d1-4f07-ae5f-0a1082917dbe service nova] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Received event network-vif-plugged-b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:06:57.045661 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e6c24a8a-d7e3-4a48-b974-89f85876ae25 req-b1971897-a8d1-4f07-ae5f-0a1082917dbe service nova] Acquiring lock "e8bc20b7-8f2f-4226-9fcd-63c123604535-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:06:57.045993 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e6c24a8a-d7e3-4a48-b974-89f85876ae25 req-b1971897-a8d1-4f07-ae5f-0a1082917dbe service nova] Lock "e8bc20b7-8f2f-4226-9fcd-63c123604535-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:06:57.045993 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e6c24a8a-d7e3-4a48-b974-89f85876ae25 req-b1971897-a8d1-4f07-ae5f-0a1082917dbe service nova] Lock "e8bc20b7-8f2f-4226-9fcd-63c123604535-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:06:57.046526 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e6c24a8a-d7e3-4a48-b974-89f85876ae25 req-b1971897-a8d1-4f07-ae5f-0a1082917dbe service nova] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Processing event network-vif-plugged-b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 02:06:57.046699 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e6c24a8a-d7e3-4a48-b974-89f85876ae25 req-b1971897-a8d1-4f07-ae5f-0a1082917dbe service nova] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Received event network-vif-plugged-b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:06:57.046857 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e6c24a8a-d7e3-4a48-b974-89f85876ae25 req-b1971897-a8d1-4f07-ae5f-0a1082917dbe service nova] Acquiring lock "e8bc20b7-8f2f-4226-9fcd-63c123604535-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:06:57.047275 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e6c24a8a-d7e3-4a48-b974-89f85876ae25 req-b1971897-a8d1-4f07-ae5f-0a1082917dbe service nova] Lock "e8bc20b7-8f2f-4226-9fcd-63c123604535-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:06:57.047429 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e6c24a8a-d7e3-4a48-b974-89f85876ae25 req-b1971897-a8d1-4f07-ae5f-0a1082917dbe service nova] Lock "e8bc20b7-8f2f-4226-9fcd-63c123604535-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:06:57.047661 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e6c24a8a-d7e3-4a48-b974-89f85876ae25 req-b1971897-a8d1-4f07-ae5f-0a1082917dbe service nova] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] No waiting events found dispatching network-vif-plugged-b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:06:57.047661 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-e6c24a8a-d7e3-4a48-b974-89f85876ae25 req-b1971897-a8d1-4f07-ae5f-0a1082917dbe service nova] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Received unexpected event network-vif-plugged-b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0 for instance with vm_state building and task_state spawning.
May 28 02:06:57.047775 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e6c24a8a-d7e3-4a48-b974-89f85876ae25 req-b1971897-a8d1-4f07-ae5f-0a1082917dbe service nova] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Received event network-vif-deleted-5a494f64-719c-4d87-af16-acf57733b3b9 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:06:57.047871 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-e6c24a8a-d7e3-4a48-b974-89f85876ae25 req-b1971897-a8d1-4f07-ae5f-0a1082917dbe service nova] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Neutron deleted interface 5a494f64-719c-4d87-af16-acf57733b3b9; detaching it from the instance and deleting it from the info cache
May 28 02:06:57.049539 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 02:06:57.050042 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e6c24a8a-d7e3-4a48-b974-89f85876ae25 req-b1971897-a8d1-4f07-ae5f-0a1082917dbe service nova] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Detach interface failed, port_id=5a494f64-719c-4d87-af16-acf57733b3b9, reason: Instance 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992 could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 02:06:57.052840 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 02:06:57.054997 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Instance spawned successfully.
May 28 02:06:57.055308 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 02:06:57.182964 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:06:57.184279 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:06:57.187011 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934017.1867595, e8bc20b7-8f2f-4226-9fcd-63c123604535 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:06:57.187230 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] VM Resumed (Lifecycle Event)
May 28 02:06:57.563525 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:06:57.563740 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:06:57.564212 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:06:57.564560 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:06:57.565374 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:06:57.565736 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:06:57.685337 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Took 1.36 seconds to deallocate network for instance.
May 28 02:06:57.689737 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:06:57.703098 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:06:57.806195 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-907fd427-7cd0-4719-ad00-f6d1c777509c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "b369292d-fea0-46aa-b5c4-908b8bfb6209" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.024s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:06:58.071274 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Took 9.71 seconds to spawn the instance on the hypervisor.
May 28 02:06:58.071602 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:06:58.198866 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-656c0d3c-ae9f-4070-9951-10047be0adc8 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:06:58.199190 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-656c0d3c-ae9f-4070-9951-10047be0adc8 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:06:58.206224 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 02:06:58.258043 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-213ad483-30a0-4e1b-b0c8-2ff51bbf2821 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Acquiring lock "b369292d-fea0-46aa-b5c4-908b8bfb6209" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:06:58.258258 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-213ad483-30a0-4e1b-b0c8-2ff51bbf2821 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "b369292d-fea0-46aa-b5c4-908b8bfb6209" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:06:58.258430 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-213ad483-30a0-4e1b-b0c8-2ff51bbf2821 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Acquiring lock "b369292d-fea0-46aa-b5c4-908b8bfb6209-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:06:58.258560 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-213ad483-30a0-4e1b-b0c8-2ff51bbf2821 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "b369292d-fea0-46aa-b5c4-908b8bfb6209-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:06:58.258661 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-213ad483-30a0-4e1b-b0c8-2ff51bbf2821 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "b369292d-fea0-46aa-b5c4-908b8bfb6209-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:06:58.260486 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-213ad483-30a0-4e1b-b0c8-2ff51bbf2821 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Terminating instance
May 28 02:06:58.499863 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:58.535458 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-656c0d3c-ae9f-4070-9951-10047be0adc8 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:06:58.535593 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-656c0d3c-ae9f-4070-9951-10047be0adc8 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:06:58.581701 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Took 16.92 seconds to build instance.
May 28 02:06:58.763049 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-213ad483-30a0-4e1b-b0c8-2ff51bbf2821 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 02:06:58.782310 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:58.803762 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:58.806753 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:58.821632 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:58.826988 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:59.038550 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-656c0d3c-ae9f-4070-9951-10047be0adc8 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:06:59.083746 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "e8bc20b7-8f2f-4226-9fcd-63c123604535" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.433s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:06:59.090364 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999774487000195 future=<Future at 0x7724f879e3f0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:06:59.092242 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Instance destroyed successfully.
May 28 02:06:59.092537 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-213ad483-30a0-4e1b-b0c8-2ff51bbf2821 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lazy-loading 'resources' on Instance uuid b369292d-fea0-46aa-b5c4-908b8bfb6209 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:06:59.130463 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-1eb28d48-d085-4b7d-afc6-ea8605f60d08 req-17005b1e-6d9b-43d9-8e4a-d45d7ca1e650 service nova] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Received event network-vif-unplugged-c8e61437-9a2f-4506-a4c8-d07d919364b6 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:06:59.130985 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-1eb28d48-d085-4b7d-afc6-ea8605f60d08 req-17005b1e-6d9b-43d9-8e4a-d45d7ca1e650 service nova] Acquiring lock "b369292d-fea0-46aa-b5c4-908b8bfb6209-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:06:59.132295 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-1eb28d48-d085-4b7d-afc6-ea8605f60d08 req-17005b1e-6d9b-43d9-8e4a-d45d7ca1e650 service nova] Lock "b369292d-fea0-46aa-b5c4-908b8bfb6209-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:06:59.132472 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-1eb28d48-d085-4b7d-afc6-ea8605f60d08 req-17005b1e-6d9b-43d9-8e4a-d45d7ca1e650 service nova] Lock "b369292d-fea0-46aa-b5c4-908b8bfb6209-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:06:59.132665 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-1eb28d48-d085-4b7d-afc6-ea8605f60d08 req-17005b1e-6d9b-43d9-8e4a-d45d7ca1e650 service nova] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] No waiting events found dispatching network-vif-unplugged-c8e61437-9a2f-4506-a4c8-d07d919364b6 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:06:59.132810 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-1eb28d48-d085-4b7d-afc6-ea8605f60d08 req-17005b1e-6d9b-43d9-8e4a-d45d7ca1e650 service nova] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Received event network-vif-unplugged-c8e61437-9a2f-4506-a4c8-d07d919364b6 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:06:59.133023 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-1eb28d48-d085-4b7d-afc6-ea8605f60d08 req-17005b1e-6d9b-43d9-8e4a-d45d7ca1e650 service nova] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Received event network-vif-unplugged-c8e61437-9a2f-4506-a4c8-d07d919364b6 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:06:59.133222 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-1eb28d48-d085-4b7d-afc6-ea8605f60d08 req-17005b1e-6d9b-43d9-8e4a-d45d7ca1e650 service nova] Acquiring lock "b369292d-fea0-46aa-b5c4-908b8bfb6209-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:06:59.133397 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-1eb28d48-d085-4b7d-afc6-ea8605f60d08 req-17005b1e-6d9b-43d9-8e4a-d45d7ca1e650 service nova] Lock "b369292d-fea0-46aa-b5c4-908b8bfb6209-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:06:59.133785 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-1eb28d48-d085-4b7d-afc6-ea8605f60d08 req-17005b1e-6d9b-43d9-8e4a-d45d7ca1e650 service nova] Lock "b369292d-fea0-46aa-b5c4-908b8bfb6209-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:06:59.133956 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-1eb28d48-d085-4b7d-afc6-ea8605f60d08 req-17005b1e-6d9b-43d9-8e4a-d45d7ca1e650 service nova] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] No waiting events found dispatching network-vif-unplugged-c8e61437-9a2f-4506-a4c8-d07d919364b6 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:06:59.134168 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-1eb28d48-d085-4b7d-afc6-ea8605f60d08 req-17005b1e-6d9b-43d9-8e4a-d45d7ca1e650 service nova] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Received event network-vif-unplugged-c8e61437-9a2f-4506-a4c8-d07d919364b6 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:06:59.545046 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-656c0d3c-ae9f-4070-9951-10047be0adc8 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.346s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:06:59.590866 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-656c0d3c-ae9f-4070-9951-10047be0adc8 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Deleted allocations for instance 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992
May 28 02:06:59.595970 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-213ad483-30a0-4e1b-b0c8-2ff51bbf2821 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T02:05:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1865984652',display_name='tempest-TestEncryptedCinderVolumes-server-1865984652',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testencryptedcindervolumes-server-1865984652',id=64,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtMnSwfhTrZZGwe2NVdu2w6ZAaFpHVjoHIoB+NxFDfBrY/yQ0K1HMrBh5Wz6DnMSPvUJcQuIQ0iZNmHi3Br+rGFrep5SGtIuc1lu4gEx52ULcvouqX09ddDTiBfaJr+Pg==',key_name='tempest-keypair-2048724505',keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:06:03Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b7ada2896b1043bfb246c28ad9d1e174',ramdisk_id='',reservation_id='r-00irh5t4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-1693604386',owner_user_name='tempest-TestEncryptedCinderVolumes-1693604386-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T02:06:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b5bf0f126624ddab4bd36a1b707899e',uuid=b369292d-fea0-46aa-b5c4-908b8bfb6209,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c8e61437-9a2f-4506-a4c8-d07d919364b6", "address": "fa:16:3e:b4:d0:b8", "network": {"id": "ef15cd88-386f-4fc6-8df0-74267f73d3fb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1804869041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b7ada2896b1043bfb246c28ad9d1e174", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8e61437-9a", "ovs_interfaceid": "c8e61437-9a2f-4506-a4c8-d07d919364b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:06:59.596503 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-213ad483-30a0-4e1b-b0c8-2ff51bbf2821 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Converting VIF {"id": "c8e61437-9a2f-4506-a4c8-d07d919364b6", "address": "fa:16:3e:b4:d0:b8", "network": {"id": "ef15cd88-386f-4fc6-8df0-74267f73d3fb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1804869041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b7ada2896b1043bfb246c28ad9d1e174", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8e61437-9a", "ovs_interfaceid": "c8e61437-9a2f-4506-a4c8-d07d919364b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:06:59.596861 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-213ad483-30a0-4e1b-b0c8-2ff51bbf2821 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:d0:b8,bridge_name='br-int',has_traffic_filtering=True,id=c8e61437-9a2f-4506-a4c8-d07d919364b6,network=Network(ef15cd88-386f-4fc6-8df0-74267f73d3fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8e61437-9a') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:06:59.597088 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-213ad483-30a0-4e1b-b0c8-2ff51bbf2821 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:d0:b8,bridge_name='br-int',has_traffic_filtering=True,id=c8e61437-9a2f-4506-a4c8-d07d919364b6,network=Network(ef15cd88-386f-4fc6-8df0-74267f73d3fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8e61437-9a') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:06:59.600132 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:59.600386 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc8e61437-9a, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:06:59.601466 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:59.602418 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:06:59.603742 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:59.603896 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fd5f8da6-1df7-4545-ae1b-d6bd65ac3156) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:06:59.604370 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:06:59.605358 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:06:59.607381 np0000001583 nova-compute[98241]: INFO os_vif [None req-213ad483-30a0-4e1b-b0c8-2ff51bbf2821 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:d0:b8,bridge_name='br-int',has_traffic_filtering=True,id=c8e61437-9a2f-4506-a4c8-d07d919364b6,network=Network(ef15cd88-386f-4fc6-8df0-74267f73d3fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8e61437-9a')
May 28 02:06:59.607629 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-213ad483-30a0-4e1b-b0c8-2ff51bbf2821 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Deleting instance files /opt/stack/data/nova/instances/b369292d-fea0-46aa-b5c4-908b8bfb6209_del
May 28 02:06:59.608279 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-213ad483-30a0-4e1b-b0c8-2ff51bbf2821 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Deletion of /opt/stack/data/nova/instances/b369292d-fea0-46aa-b5c4-908b8bfb6209_del complete
May 28 02:07:00.114414 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-213ad483-30a0-4e1b-b0c8-2ff51bbf2821 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Took 1.35 seconds to destroy the instance on the hypervisor.
May 28 02:07:00.115255 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-213ad483-30a0-4e1b-b0c8-2ff51bbf2821 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 02:07:00.115568 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 02:07:00.115687 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 02:07:00.115927 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:07:00.241606 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:07:00.600504 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-656c0d3c-ae9f-4070-9951-10047be0adc8 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "0ce1d609-b3fe-4fb6-81ac-7a683c8f1992" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.318s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:07:00.759210 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-1066bf3d-ff1e-4618-8d25-1a1c9933ce47 req-42f2521b-96ee-4c57-b86f-5364b95f6e12 service nova] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Received event network-vif-deleted-c8e61437-9a2f-4506-a4c8-d07d919364b6 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:07:00.760177 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-1066bf3d-ff1e-4618-8d25-1a1c9933ce47 req-42f2521b-96ee-4c57-b86f-5364b95f6e12 service nova] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Neutron deleted interface c8e61437-9a2f-4506-a4c8-d07d919364b6; detaching it from the instance and deleting it from the info cache
May 28 02:07:00.762918 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-1066bf3d-ff1e-4618-8d25-1a1c9933ce47 req-42f2521b-96ee-4c57-b86f-5364b95f6e12 service nova] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Detach interface failed, port_id=c8e61437-9a2f-4506-a4c8-d07d919364b6, reason: Instance b369292d-fea0-46aa-b5c4-908b8bfb6209 could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 02:07:01.085103 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Acquiring lock "a7b60291-5fd2-479e-9c9c-924b79f880a7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:07:01.085343 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lock "a7b60291-5fd2-479e-9c9c-924b79f880a7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:07:01.203712 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-559f0d55-022d-4293-ab7b-976782f027b0 req-573b1653-193e-4d08-956c-88b829c7a972 service nova] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Received event network-changed-b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:07:01.203712 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-559f0d55-022d-4293-ab7b-976782f027b0 req-573b1653-193e-4d08-956c-88b829c7a972 service nova] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Refreshing instance network info cache due to event network-changed-b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:07:01.203712 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-559f0d55-022d-4293-ab7b-976782f027b0 req-573b1653-193e-4d08-956c-88b829c7a972 service nova] Acquiring lock "refresh_cache-e8bc20b7-8f2f-4226-9fcd-63c123604535" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:07:01.203712 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-559f0d55-022d-4293-ab7b-976782f027b0 req-573b1653-193e-4d08-956c-88b829c7a972 service nova] Acquired lock "refresh_cache-e8bc20b7-8f2f-4226-9fcd-63c123604535" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:07:01.203712 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-559f0d55-022d-4293-ab7b-976782f027b0 req-573b1653-193e-4d08-956c-88b829c7a972 service nova] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Refreshing network info cache for port b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:07:01.205216 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:07:01.587232 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 02:07:01.707950 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-559f0d55-022d-4293-ab7b-976782f027b0 req-573b1653-193e-4d08-956c-88b829c7a972 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:07:01.708237 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Took 1.59 seconds to deallocate network for instance.
May 28 02:07:02.011037 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-559f0d55-022d-4293-ab7b-976782f027b0 req-573b1653-193e-4d08-956c-88b829c7a972 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:07:02.156738 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:07:02.156894 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:07:02.161025 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 02:07:02.161241 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Claim successful on node np0000001583
May 28 02:07:02.201614 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-559f0d55-022d-4293-ab7b-976782f027b0 req-573b1653-193e-4d08-956c-88b829c7a972 service nova] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Updated VIF entry in instance network info cache for port b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:07:02.202511 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-559f0d55-022d-4293-ab7b-976782f027b0 req-573b1653-193e-4d08-956c-88b829c7a972 service nova] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Updating instance_info_cache with network_info: [{"id": "b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0", "address": "fa:16:3e:7c:9a:06", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2ddd1f1-c8", "ovs_interfaceid": "b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:07:02.216331 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-213ad483-30a0-4e1b-b0c8-2ff51bbf2821 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:07:02.703997 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-559f0d55-022d-4293-ab7b-976782f027b0 req-573b1653-193e-4d08-956c-88b829c7a972 service nova] Releasing lock "refresh_cache-e8bc20b7-8f2f-4226-9fcd-63c123604535" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:07:03.496055 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:07:03.496478 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:07:03.502002 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:03.822939 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b6df5e80-a37a-44cc-94be-3804cbe22eb1 req-783992a7-e4bd-4be3-9c7b-008ebee05b65 service nova] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Received event network-changed-2aa7c86f-9ae8-453b-990a-a25050f0da90 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:07:03.826832 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b6df5e80-a37a-44cc-94be-3804cbe22eb1 req-783992a7-e4bd-4be3-9c7b-008ebee05b65 service nova] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Refreshing instance network info cache due to event network-changed-2aa7c86f-9ae8-453b-990a-a25050f0da90. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:07:03.826832 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b6df5e80-a37a-44cc-94be-3804cbe22eb1 req-783992a7-e4bd-4be3-9c7b-008ebee05b65 service nova] Acquiring lock "refresh_cache-7751bb1a-84b9-48ce-81da-b3a41d63eadc" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:07:03.826832 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b6df5e80-a37a-44cc-94be-3804cbe22eb1 req-783992a7-e4bd-4be3-9c7b-008ebee05b65 service nova] Acquired lock "refresh_cache-7751bb1a-84b9-48ce-81da-b3a41d63eadc" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:07:03.826832 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-b6df5e80-a37a-44cc-94be-3804cbe22eb1 req-783992a7-e4bd-4be3-9c7b-008ebee05b65 service nova] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Refreshing network info cache for port 2aa7c86f-9ae8-453b-990a-a25050f0da90 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:07:03.998772 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:07:04.332240 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-b6df5e80-a37a-44cc-94be-3804cbe22eb1 req-783992a7-e4bd-4be3-9c7b-008ebee05b65 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:07:04.343449 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6b3ee157-d8ab-4af3-a80c-4ec140de7e44 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Acquiring lock "7751bb1a-84b9-48ce-81da-b3a41d63eadc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:07:04.343662 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6b3ee157-d8ab-4af3-a80c-4ec140de7e44 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "7751bb1a-84b9-48ce-81da-b3a41d63eadc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:07:04.343859 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6b3ee157-d8ab-4af3-a80c-4ec140de7e44 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Acquiring lock "7751bb1a-84b9-48ce-81da-b3a41d63eadc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:07:04.344089 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6b3ee157-d8ab-4af3-a80c-4ec140de7e44 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "7751bb1a-84b9-48ce-81da-b3a41d63eadc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:07:04.344223 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6b3ee157-d8ab-4af3-a80c-4ec140de7e44 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "7751bb1a-84b9-48ce-81da-b3a41d63eadc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:07:04.346660 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-6b3ee157-d8ab-4af3-a80c-4ec140de7e44 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Terminating instance
May 28 02:07:04.507658 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.349s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:07:04.507658 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 02:07:04.508143 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-213ad483-30a0-4e1b-b0c8-2ff51bbf2821 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.292s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:07:04.605524 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:04.625330 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-b6df5e80-a37a-44cc-94be-3804cbe22eb1 req-783992a7-e4bd-4be3-9c7b-008ebee05b65 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:07:04.774755 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-b6df5e80-a37a-44cc-94be-3804cbe22eb1 req-783992a7-e4bd-4be3-9c7b-008ebee05b65 service nova] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Updated VIF entry in instance network info cache for port 2aa7c86f-9ae8-453b-990a-a25050f0da90. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:07:04.774755 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-b6df5e80-a37a-44cc-94be-3804cbe22eb1 req-783992a7-e4bd-4be3-9c7b-008ebee05b65 service nova] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Updating instance_info_cache with network_info: [{"id": "2aa7c86f-9ae8-453b-990a-a25050f0da90", "address": "fa:16:3e:e6:d6:9e", "network": {"id": "4f6e8375-a959-44b0-9cab-ae7918680bf7", "bridge": "br-int", "label": "tempest-TestStampPattern-914776722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d9663116fe18428d8e37dea7b30d8b5a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aa7c86f-9a", "ovs_interfaceid": "2aa7c86f-9ae8-453b-990a-a25050f0da90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:07:04.820559 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-213ad483-30a0-4e1b-b0c8-2ff51bbf2821 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:07:04.820762 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-213ad483-30a0-4e1b-b0c8-2ff51bbf2821 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:07:04.849911 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-6b3ee157-d8ab-4af3-a80c-4ec140de7e44 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 02:07:04.879100 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:04.886486 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:04.904932 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:04.930983 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:05.011467 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 02:07:05.011694 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 02:07:05.011961 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:07:05.012863 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:07:05.087756 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76a39c8fe434421392f1276fcb452550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359205e9f0214f1795234b72dbbf45c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 02:07:05.174523 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999733349000053 future=<Future at 0x7724ec230620 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:07:05.176587 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Instance destroyed successfully.
May 28 02:07:05.177135 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-6b3ee157-d8ab-4af3-a80c-4ec140de7e44 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lazy-loading 'resources' on Instance uuid 7751bb1a-84b9-48ce-81da-b3a41d63eadc {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:07:05.279462 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b6df5e80-a37a-44cc-94be-3804cbe22eb1 req-783992a7-e4bd-4be3-9c7b-008ebee05b65 service nova] Releasing lock "refresh_cache-7751bb1a-84b9-48ce-81da-b3a41d63eadc" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:07:05.323096 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-213ad483-30a0-4e1b-b0c8-2ff51bbf2821 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:07:05.515411 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 02:07:05.592564 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Successfully created port: 02f4d882-7b01-4a87-8666-10c3d4295a89 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 02:07:05.681858 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-6b3ee157-d8ab-4af3-a80c-4ec140de7e44 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T02:04:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-126740994',display_name='tempest-TestStampPattern-server-126740994',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-teststamppattern-server-126740994',id=56,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGla4S7tzFQM3H7dOtPyxXylIxo5cIZbTOWxzJqFZg2znrJ8fjc45cg7DBtdnBMMzNou2BAybRIZM9Fj+5atQu7kwWfQaIDwG2yH2osFl+wPy/fI2Pvg+h4A9P59YVZ+gw==',key_name='tempest-TestStampPattern-1385235397',keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:04:31Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d9663116fe18428d8e37dea7b30d8b5a',ramdisk_id='',reservation_id='r-o44fb0f5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-897366137',owner_user_name='tempest-TestStampPattern-897366137-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T02:05:39Z,user_data=None,user_id='db5b8b66a90b4a2dba53c340347aff1d',uuid=7751bb1a-84b9-48ce-81da-b3a41d63eadc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2aa7c86f-9ae8-453b-990a-a25050f0da90", "address": "fa:16:3e:e6:d6:9e", "network": {"id": "4f6e8375-a959-44b0-9cab-ae7918680bf7", "bridge": "br-int", "label": "tempest-TestStampPattern-914776722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d9663116fe18428d8e37dea7b30d8b5a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aa7c86f-9a", "ovs_interfaceid": "2aa7c86f-9ae8-453b-990a-a25050f0da90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:07:05.682106 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-6b3ee157-d8ab-4af3-a80c-4ec140de7e44 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Converting VIF {"id": "2aa7c86f-9ae8-453b-990a-a25050f0da90", "address": "fa:16:3e:e6:d6:9e", "network": {"id": "4f6e8375-a959-44b0-9cab-ae7918680bf7", "bridge": "br-int", "label": "tempest-TestStampPattern-914776722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d9663116fe18428d8e37dea7b30d8b5a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aa7c86f-9a", "ovs_interfaceid": "2aa7c86f-9ae8-453b-990a-a25050f0da90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:07:05.682831 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-6b3ee157-d8ab-4af3-a80c-4ec140de7e44 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e6:d6:9e,bridge_name='br-int',has_traffic_filtering=True,id=2aa7c86f-9ae8-453b-990a-a25050f0da90,network=Network(4f6e8375-a959-44b0-9cab-ae7918680bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2aa7c86f-9a') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:07:05.683099 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-6b3ee157-d8ab-4af3-a80c-4ec140de7e44 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:d6:9e,bridge_name='br-int',has_traffic_filtering=True,id=2aa7c86f-9ae8-453b-990a-a25050f0da90,network=Network(4f6e8375-a959-44b0-9cab-ae7918680bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2aa7c86f-9a') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:07:05.684184 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:05.684415 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2aa7c86f-9a, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:07:05.685308 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:05.686005 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:07:05.687095 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:05.687878 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:05.688026 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ed09ca01-8f7c-4955-ad39-4141241f3f49) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:07:05.688469 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:05.688882 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:07:05.689604 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:05.691768 np0000001583 nova-compute[98241]: INFO os_vif [None req-6b3ee157-d8ab-4af3-a80c-4ec140de7e44 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:d6:9e,bridge_name='br-int',has_traffic_filtering=True,id=2aa7c86f-9ae8-453b-990a-a25050f0da90,network=Network(4f6e8375-a959-44b0-9cab-ae7918680bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2aa7c86f-9a')
May 28 02:07:05.692098 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-6b3ee157-d8ab-4af3-a80c-4ec140de7e44 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Deleting instance files /opt/stack/data/nova/instances/7751bb1a-84b9-48ce-81da-b3a41d63eadc_del
May 28 02:07:05.692967 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-6b3ee157-d8ab-4af3-a80c-4ec140de7e44 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Deletion of /opt/stack/data/nova/instances/7751bb1a-84b9-48ce-81da-b3a41d63eadc_del complete
May 28 02:07:05.832640 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-213ad483-30a0-4e1b-b0c8-2ff51bbf2821 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.325s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:07:05.891933 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-6cd77f12-1fe2-4935-86cd-8ae4f7496186 req-385a4197-a83d-419e-b260-871446c8dcbb service nova] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Received event network-vif-unplugged-2aa7c86f-9ae8-453b-990a-a25050f0da90 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:07:05.895051 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-6cd77f12-1fe2-4935-86cd-8ae4f7496186 req-385a4197-a83d-419e-b260-871446c8dcbb service nova] Acquiring lock "7751bb1a-84b9-48ce-81da-b3a41d63eadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:07:05.895051 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-6cd77f12-1fe2-4935-86cd-8ae4f7496186 req-385a4197-a83d-419e-b260-871446c8dcbb service nova] Lock "7751bb1a-84b9-48ce-81da-b3a41d63eadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:07:05.895051 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-6cd77f12-1fe2-4935-86cd-8ae4f7496186 req-385a4197-a83d-419e-b260-871446c8dcbb service nova] Lock "7751bb1a-84b9-48ce-81da-b3a41d63eadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:07:05.895051 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-6cd77f12-1fe2-4935-86cd-8ae4f7496186 req-385a4197-a83d-419e-b260-871446c8dcbb service nova] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] No waiting events found dispatching network-vif-unplugged-2aa7c86f-9ae8-453b-990a-a25050f0da90 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:07:05.895051 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-6cd77f12-1fe2-4935-86cd-8ae4f7496186 req-385a4197-a83d-419e-b260-871446c8dcbb service nova] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Received event network-vif-unplugged-2aa7c86f-9ae8-453b-990a-a25050f0da90 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:07:05.895051 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-6cd77f12-1fe2-4935-86cd-8ae4f7496186 req-385a4197-a83d-419e-b260-871446c8dcbb service nova] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Received event network-vif-unplugged-2aa7c86f-9ae8-453b-990a-a25050f0da90 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:07:05.895051 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-6cd77f12-1fe2-4935-86cd-8ae4f7496186 req-385a4197-a83d-419e-b260-871446c8dcbb service nova] Acquiring lock "7751bb1a-84b9-48ce-81da-b3a41d63eadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:07:05.895051 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-6cd77f12-1fe2-4935-86cd-8ae4f7496186 req-385a4197-a83d-419e-b260-871446c8dcbb service nova] Lock "7751bb1a-84b9-48ce-81da-b3a41d63eadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:07:05.895051 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-6cd77f12-1fe2-4935-86cd-8ae4f7496186 req-385a4197-a83d-419e-b260-871446c8dcbb service nova] Lock "7751bb1a-84b9-48ce-81da-b3a41d63eadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:07:05.895501 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-6cd77f12-1fe2-4935-86cd-8ae4f7496186 req-385a4197-a83d-419e-b260-871446c8dcbb service nova] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] No waiting events found dispatching network-vif-unplugged-2aa7c86f-9ae8-453b-990a-a25050f0da90 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:07:05.895501 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-6cd77f12-1fe2-4935-86cd-8ae4f7496186 req-385a4197-a83d-419e-b260-871446c8dcbb service nova] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Received event network-vif-unplugged-2aa7c86f-9ae8-453b-990a-a25050f0da90 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:07:05.907786 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-213ad483-30a0-4e1b-b0c8-2ff51bbf2821 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Deleted allocations for instance b369292d-fea0-46aa-b5c4-908b8bfb6209
May 28 02:07:06.020230 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 02:07:06.113961 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Successfully updated port: 02f4d882-7b01-4a87-8666-10c3d4295a89 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 02:07:06.199048 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-6b3ee157-d8ab-4af3-a80c-4ec140de7e44 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Took 1.35 seconds to destroy the instance on the hypervisor.
May 28 02:07:06.199535 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-6b3ee157-d8ab-4af3-a80c-4ec140de7e44 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 02:07:06.199839 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 02:07:06.199947 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 02:07:06.200196 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:07:06.210602 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-8412302d-eb86-4506-9240-4dc5d2110289 req-8a6d6200-a72c-4370-8308-e593d9e43ef7 service nova] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Received event network-changed-02f4d882-7b01-4a87-8666-10c3d4295a89 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:07:06.210676 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-8412302d-eb86-4506-9240-4dc5d2110289 req-8a6d6200-a72c-4370-8308-e593d9e43ef7 service nova] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Refreshing instance network info cache due to event network-changed-02f4d882-7b01-4a87-8666-10c3d4295a89. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:07:06.210910 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-8412302d-eb86-4506-9240-4dc5d2110289 req-8a6d6200-a72c-4370-8308-e593d9e43ef7 service nova] Acquiring lock "refresh_cache-a7b60291-5fd2-479e-9c9c-924b79f880a7" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:07:06.211065 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-8412302d-eb86-4506-9240-4dc5d2110289 req-8a6d6200-a72c-4370-8308-e593d9e43ef7 service nova] Acquired lock "refresh_cache-a7b60291-5fd2-479e-9c9c-924b79f880a7" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:07:06.211264 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-8412302d-eb86-4506-9240-4dc5d2110289 req-8a6d6200-a72c-4370-8308-e593d9e43ef7 service nova] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Refreshing network info cache for port 02f4d882-7b01-4a87-8666-10c3d4295a89 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:07:06.322414 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:07:06.524937 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Booting with volume ca1813c1-91d2-4ccd-8d9a-0d07267db49d at /dev/vda
May 28 02:07:06.567655 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:07:06.580703 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 02:07:06.605200 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:07:06.623846 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Acquiring lock "refresh_cache-a7b60291-5fd2-479e-9c9c-924b79f880a7" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:07:06.657285 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 02:07:06.657545 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 02:07:06.667308 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 02:07:06.668385 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe9c:a66d', 'fe80::34e0:eeff:fee2:bede', 'fe80::fc16:3eff:fee5:abc0', 'fe80::d05a:66ff:fe6d:1718', 'fe80::fc16:3eff:fe7c:9a06'] 
May 28 02:07:06.668486 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 02:07:06.668558 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 02:07:06.668769 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] <== get_connector_properties: return (101ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:07:06.668946 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Updating existing volume attachment record: ac49e85c-7e1a-44d3-a13a-155af4502456 {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 02:07:06.715498 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-8412302d-eb86-4506-9240-4dc5d2110289 req-8a6d6200-a72c-4370-8308-e593d9e43ef7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:07:06.773825 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-8412302d-eb86-4506-9240-4dc5d2110289 req-8a6d6200-a72c-4370-8308-e593d9e43ef7 service nova] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:07:06.896134 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-8412302d-eb86-4506-9240-4dc5d2110289 req-8a6d6200-a72c-4370-8308-e593d9e43ef7 service nova] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:07:06.917710 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-213ad483-30a0-4e1b-b0c8-2ff51bbf2821 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "b369292d-fea0-46aa-b5c4-908b8bfb6209" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.659s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:07:07.059715 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:07:07.398539 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-8412302d-eb86-4506-9240-4dc5d2110289 req-8a6d6200-a72c-4370-8308-e593d9e43ef7 service nova] Releasing lock "refresh_cache-a7b60291-5fd2-479e-9c9c-924b79f880a7" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:07:07.399805 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Acquired lock "refresh_cache-a7b60291-5fd2-479e-9c9c-924b79f880a7" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:07:07.399805 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:07:07.561795 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Took 1.36 seconds to deallocate network for instance.
May 28 02:07:07.969105 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:07:08.073194 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6b3ee157-d8ab-4af3-a80c-4ec140de7e44 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:07:08.073194 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6b3ee157-d8ab-4af3-a80c-4ec140de7e44 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:07:08.145290 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:07:08.264951 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-585f171e-209c-44b8-a84b-94162cb393e9 req-e7343e66-461b-4dd9-a3bd-6d50274e8a8b service nova] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Received event network-vif-deleted-2aa7c86f-9ae8-453b-990a-a25050f0da90 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:07:08.304895 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Updating instance_info_cache with network_info: [{"id": "02f4d882-7b01-4a87-8666-10c3d4295a89", "address": "fa:16:3e:63:3f:3b", "network": {"id": "716b3825-100d-45f0-8db3-3d2dc26813c4", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1126424154-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "359205e9f0214f1795234b72dbbf45c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap02f4d882-7b", "ovs_interfaceid": "02f4d882-7b01-4a87-8666-10c3d4295a89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:07:08.405741 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6b3ee157-d8ab-4af3-a80c-4ec140de7e44 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:07:08.406006 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-6b3ee157-d8ab-4af3-a80c-4ec140de7e44 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:07:08.503342 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:08.772226 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 02:07:08.773289 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 02:07:08.773515 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Creating image(s)
May 28 02:07:08.773770 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Did not create local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 02:07:08.773889 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Ensure instance console log exists: /opt/stack/data/nova/instances/a7b60291-5fd2-479e-9c9c-924b79f880a7/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 02:07:08.774105 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:07:08.774272 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:07:08.774398 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:07:08.809444 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Releasing lock "refresh_cache-a7b60291-5fd2-479e-9c9c-924b79f880a7" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:07:08.809693 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Instance network_info: |[{"id": "02f4d882-7b01-4a87-8666-10c3d4295a89", "address": "fa:16:3e:63:3f:3b", "network": {"id": "716b3825-100d-45f0-8db3-3d2dc26813c4", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1126424154-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "359205e9f0214f1795234b72dbbf45c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap02f4d882-7b", "ovs_interfaceid": "02f4d882-7b01-4a87-8666-10c3d4295a89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 02:07:08.810466 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Start _get_guest_xml network_info=[{"id": "02f4d882-7b01-4a87-8666-10c3d4295a89", "address": "fa:16:3e:63:3f:3b", "network": {"id": "716b3825-100d-45f0-8db3-3d2dc26813c4", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1126424154-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "359205e9f0214f1795234b72dbbf45c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap02f4d882-7b", "ovs_interfaceid": "02f4d882-7b01-4a87-8666-10c3d4295a89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d', 'iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ca1813c1-91d2-4ccd-8d9a-0d07267db49d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'a7b60291-5fd2-479e-9c9c-924b79f880a7', 'attached_at': '', 'detached_at': '', 'volume_id': 'ca1813c1-91d2-4ccd-8d9a-0d07267db49d', 'serial': 'ca1813c1-91d2-4ccd-8d9a-0d07267db49d'}, 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'ac49e85c-7e1a-44d3-a13a-155af4502456', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 02:07:08.813188 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:07:08.814284 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestInstancesWithCinderVolumes-server-1520684336', uuid='a7b60291-5fd2-479e-9c9c-924b79f880a7'), owner=OwnerMeta(userid='76a39c8fe434421392f1276fcb452550', username='tempest-TestInstancesWithCinderVolumes-117749394-project-member', projectid='359205e9f0214f1795234b72dbbf45c6', projectname='tempest-TestInstancesWithCinderVolumes-117749394'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "02f4d882-7b01-4a87-8666-10c3d4295a89", "address": "fa:16:3e:63:3f:3b", "network": {"id": "716b3825-100d-45f0-8db3-3d2dc26813c4", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1126424154-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "359205e9f0214f1795234b72dbbf45c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap02f4d882-7b", "ovs_interfaceid": "02f4d882-7b01-4a87-8666-10c3d4295a89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779934028.8139205) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 02:07:08.815588 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 02:07:08.815946 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 02:07:08.816864 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 02:07:08.817030 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 02:07:08.817910 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 02:07:08.818195 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 02:07:08.818342 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 02:07:08.818468 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 02:07:08.818594 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 02:07:08.818677 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 02:07:08.818809 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 02:07:08.819008 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 02:07:08.819162 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 02:07:08.819447 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 02:07:08.819593 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 02:07:08.819772 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 02:07:08.832466 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 02:07:08.832916 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d', 'iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ca1813c1-91d2-4ccd-8d9a-0d07267db49d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:07:08.833139 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:07:08.833499 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:07:08.833734 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d', 'iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ca1813c1-91d2-4ccd-8d9a-0d07267db49d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 02:07:08.848447 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:07:08.849026 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:07:08.849620 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:07:08.849775 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:07:08.850185 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:07:08.850439 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:07:08.861859 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:07:08.861859 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:07:08.869099 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:07:08.869099 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:07:08.876436 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d] added
May 28 02:07:08.876436 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:07:08.876436 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:07:08.876436 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:07:08.876436 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:07:08.876436 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:07:08.876436 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:07:08.876635 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:07:08.876772 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0269(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:07:08.876872 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:07:08.880167 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d] added
May 28 02:07:08.880167 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:07:08.880167 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:07:08.880167 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:07:08.880167 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:07:08.880167 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:07:08.880167 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:07:08.880370 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:07:08.880548 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0301(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:07:08.880655 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:07:08.909174 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-6b3ee157-d8ab-4af3-a80c-4ec140de7e44 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:07:09.417433 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6b3ee157-d8ab-4af3-a80c-4ec140de7e44 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.346s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:07:09.460618 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-6b3ee157-d8ab-4af3-a80c-4ec140de7e44 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Deleted allocations for instance 7751bb1a-84b9-48ce-81da-b3a41d63eadc
May 28 02:07:09.877390 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:07:09.881287 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:07:09.894681 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:07:09.894681 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:07:09.904821 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:07:09.904821 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:07:09.913618 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:07:09.923164 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:07:09.931995 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:09.931995 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:09.931995 np0000001583 nova-compute[98241]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:07:09.931995 np0000001583 nova-compute[98241]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:07:09.931995 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:07:09.931995 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsi session list stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:09.931995 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:09.931995 np0000001583 nova-compute[98241]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:07:09.931995 np0000001583 nova-compute[98241]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:07:09.931995 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:07:09.940592 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:09.940592 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:09.940592 np0000001583 nova-compute[98241]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:07:09.940592 np0000001583 nova-compute[98241]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:07:09.940592 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:07:09.940823 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsi session list stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:09.940823 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:09.940823 np0000001583 nova-compute[98241]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:07:09.940823 np0000001583 nova-compute[98241]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:07:09.940823 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:07:09.979279 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d, portal: 192.168.40.100,3260]
May 28 02:07:09.979279 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d, portal: 192.168.40.100,3260] successful.
May 28 02:07:09.979279 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:07:09.985661 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d, portal: 192.168.50.100,3260]
May 28 02:07:09.985661 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d, portal: 192.168.50.100,3260] successful.
May 28 02:07:09.985661 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:07:09.993312 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:07:10.000260 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:07:10.013101 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:10.013101 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:10.013101 np0000001583 nova-compute[98241]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:07:10.013101 np0000001583 nova-compute[98241]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:07:10.013101 np0000001583 nova-compute[98241]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:07:10.013101 np0000001583 nova-compute[98241]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:07:10.013101 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:07:10.013101 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsi session list stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:10.013101 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:10.013101 np0000001583 nova-compute[98241]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:07:10.013101 np0000001583 nova-compute[98241]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:07:10.013101 np0000001583 nova-compute[98241]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:07:10.013101 np0000001583 nova-compute[98241]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:07:10.013101 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:07:10.013101 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.162s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:07:10.013101 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:07:10.013101 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] HCTL ('7', '-', '-', 0) found on session 155 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:07:10.013101 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:07:10.019838 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:10.019838 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:10.019838 np0000001583 nova-compute[98241]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:07:10.019838 np0000001583 nova-compute[98241]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:07:10.019838 np0000001583 nova-compute[98241]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:07:10.019838 np0000001583 nova-compute[98241]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:07:10.019838 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:07:10.020243 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsi session list stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:10.020243 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:10.020243 np0000001583 nova-compute[98241]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:07:10.020243 np0000001583 nova-compute[98241]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:07:10.020243 np0000001583 nova-compute[98241]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:07:10.020243 np0000001583 nova-compute[98241]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:07:10.020243 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:07:10.020710 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.171s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:07:10.020820 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:07:10.021583 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] HCTL ('8', '-', '-', 0) found on session 156 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:07:10.021709 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:07:10.035523 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Searching for a device in session 155 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:07:10.035815 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ca1813c1-91d2-4ccd-8d9a-0d07267db49d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:07:10.042763 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Searching for a device in session 156 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:07:10.042763 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ca1813c1-91d2-4ccd-8d9a-0d07267db49d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:07:10.293774 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0013935820002188848 future=<Future at 0x7724ec2305f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:07:10.293874 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:07:10.293950 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=3.795866111000123 future=<Future at 0x7724f879e3f0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:07:10.294021 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=3.7957926030003364 future=<Future at 0x7724f879e3f0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:07:10.295582 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Emitting event <LifecycleEvent: 1779934015.292264, 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:07:10.295808 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] VM Stopped (Lifecycle Event)
May 28 02:07:10.478224 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6b3ee157-d8ab-4af3-a80c-4ec140de7e44 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Lock "7751bb1a-84b9-48ce-81da-b3a41d63eadc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.134s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:07:10.689581 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:10.798828 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-59f668db-c0f9-4b2e-9e07-f0409e21be58 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 0ce1d609-b3fe-4fb6-81ac-7a683c8f1992] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:07:10.850910 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 02:07:11.867998 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Found WWN 330000000646e0a24 for multipath device dm-0 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 02:07:11.868482 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:07:11.868482 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '330000000646e0a24', 'path': '/dev/dm-0', 'multipath_id': '330000000646e0a24'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:07:11.868554 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000646e0a24', 'path': '/dev/dm-0', 'multipath_id': '330000000646e0a24'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 02:07:12.377816 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:07:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-server-1520684336',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testinstanceswithcindervolumes-server-1520684336',id=67,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAOMO4z0Q1I2hlWqF86l1q6L1sJIZ+GdV9rU75w/a7dsdeBC24HI9zarZtxyVrEBincgWbi3ByTWpdtMEYvgfZfgn1Wtzm/PnUPbhKup63GrBsxHRchAd0CfA4sPdnQUEg==',key_name='tempest-TestInstancesWithCinderVolumes-1570564010',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='359205e9f0214f1795234b72dbbf45c6',ramdisk_id='',reservation_id='r-bxu6x0nw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestInstancesWithCinderVolumes-117749394',owner_user_name='tempest-TestInstancesWithCinderVolumes-117749394-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:07:06Z,user_data=None,user_id='76a39c8fe434421392f1276fcb452550',uuid=a7b60291-5fd2-479e-9c9c-924b79f880a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02f4d882-7b01-4a87-8666-10c3d4295a89", "address": "fa:16:3e:63:3f:3b", "network": {"id": "716b3825-100d-45f0-8db3-3d2dc26813c4", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1126424154-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "359205e9f0214f1795234b72dbbf45c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap02f4d882-7b", "ovs_interfaceid": "02f4d882-7b01-4a87-8666-10c3d4295a89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 02:07:12.378106 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Converting VIF {"id": "02f4d882-7b01-4a87-8666-10c3d4295a89", "address": "fa:16:3e:63:3f:3b", "network": {"id": "716b3825-100d-45f0-8db3-3d2dc26813c4", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1126424154-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "359205e9f0214f1795234b72dbbf45c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap02f4d882-7b", "ovs_interfaceid": "02f4d882-7b01-4a87-8666-10c3d4295a89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:07:12.379538 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:3f:3b,bridge_name='br-int',has_traffic_filtering=True,id=02f4d882-7b01-4a87-8666-10c3d4295a89,network=Network(716b3825-100d-45f0-8db3-3d2dc26813c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02f4d882-7b') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:07:12.379538 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lazy-loading 'pci_devices' on Instance uuid a7b60291-5fd2-479e-9c9c-924b79f880a7 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:07:12.882097 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] End _get_guest_xml xml=<domain type="qemu">
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:   <uuid>a7b60291-5fd2-479e-9c9c-924b79f880a7</uuid>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:   <name>instance-00000043</name>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:   <metadata>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:       <nova:name>tempest-TestInstancesWithCinderVolumes-server-1520684336</nova:name>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 02:07:08</nova:creationTime>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:       <nova:image uuid="">
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:         <nova:properties/>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:       </nova:image>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:         <nova:user uuid="76a39c8fe434421392f1276fcb452550">tempest-TestInstancesWithCinderVolumes-117749394-project-member</nova:user>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:         <nova:project uuid="359205e9f0214f1795234b72dbbf45c6">tempest-TestInstancesWithCinderVolumes-117749394</nova:project>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:       <nova:root type="volume" uuid=""/>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:         <nova:port uuid="02f4d882-7b01-4a87-8666-10c3d4295a89">
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:         </nova:port>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:   </metadata>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:     <system>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:       <entry name="serial">a7b60291-5fd2-479e-9c9c-924b79f880a7</entry>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:       <entry name="uuid">a7b60291-5fd2-479e-9c9c-924b79f880a7</entry>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:     </system>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:   <os>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:   </os>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:   <features>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:     <acpi/>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:     <tcg>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:     </tcg>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:   </features>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:   </cpu>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:   <devices>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/a7b60291-5fd2-479e-9c9c-924b79f880a7/disk.config"/>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:     </disk>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:     <disk type="block" device="disk">
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:       <alias name="ua-ca1813c1-91d2-4ccd-8d9a-0d07267db49d"/>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:       <source dev="/dev/dm-0"/>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:       <serial>ca1813c1-91d2-4ccd-8d9a-0d07267db49d</serial>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:     </disk>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:63:3f:3b"/>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:       <target dev="tap02f4d882-7b"/>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:     </interface>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/a7b60291-5fd2-479e-9c9c-924b79f880a7/console.log" append="off"/>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:     </serial>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:     <video>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:     </video>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:     </rng>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:     </memballoon>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:   </devices>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]: </domain>
May 28 02:07:12.882097 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 02:07:12.884282 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Preparing to wait for external event network-vif-plugged-02f4d882-7b01-4a87-8666-10c3d4295a89 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 02:07:12.884282 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Acquiring lock "a7b60291-5fd2-479e-9c9c-924b79f880a7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:07:12.884282 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lock "a7b60291-5fd2-479e-9c9c-924b79f880a7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:07:12.884282 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lock "a7b60291-5fd2-479e-9c9c-924b79f880a7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:07:12.884282 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:07:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-server-1520684336',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testinstanceswithcindervolumes-server-1520684336',id=67,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAOMO4z0Q1I2hlWqF86l1q6L1sJIZ+GdV9rU75w/a7dsdeBC24HI9zarZtxyVrEBincgWbi3ByTWpdtMEYvgfZfgn1Wtzm/PnUPbhKup63GrBsxHRchAd0CfA4sPdnQUEg==',key_name='tempest-TestInstancesWithCinderVolumes-1570564010',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='359205e9f0214f1795234b72dbbf45c6',ramdisk_id='',reservation_id='r-bxu6x0nw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestInstancesWithCinderVolumes-117749394',owner_user_name='tempest-TestInstancesWithCinderVolumes-117749394-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:07:06Z,user_data=None,user_id='76a39c8fe434421392f1276fcb452550',uuid=a7b60291-5fd2-479e-9c9c-924b79f880a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02f4d882-7b01-4a87-8666-10c3d4295a89", "address": "fa:16:3e:63:3f:3b", "network": {"id": "716b3825-100d-45f0-8db3-3d2dc26813c4", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1126424154-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "359205e9f0214f1795234b72dbbf45c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap02f4d882-7b", "ovs_interfaceid": "02f4d882-7b01-4a87-8666-10c3d4295a89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 02:07:12.884282 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Converting VIF {"id": "02f4d882-7b01-4a87-8666-10c3d4295a89", "address": "fa:16:3e:63:3f:3b", "network": {"id": "716b3825-100d-45f0-8db3-3d2dc26813c4", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1126424154-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "359205e9f0214f1795234b72dbbf45c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap02f4d882-7b", "ovs_interfaceid": "02f4d882-7b01-4a87-8666-10c3d4295a89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:07:12.885056 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:3f:3b,bridge_name='br-int',has_traffic_filtering=True,id=02f4d882-7b01-4a87-8666-10c3d4295a89,network=Network(716b3825-100d-45f0-8db3-3d2dc26813c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02f4d882-7b') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:07:12.885355 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:3f:3b,bridge_name='br-int',has_traffic_filtering=True,id=02f4d882-7b01-4a87-8666-10c3d4295a89,network=Network(716b3825-100d-45f0-8db3-3d2dc26813c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02f4d882-7b') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 02:07:12.885647 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:12.885832 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:07:12.886008 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 02:07:12.886655 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:12.886832 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a5942870-345f-52a7-b5d8-5f133677fc18', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:07:12.887565 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:12.888272 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:07:12.888894 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:12.890766 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:12.890944 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap02f4d882-7b, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:07:12.891272 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap02f4d882-7b, col_values=(('qos', UUID('6047bccd-fed6-4b24-9720-2b5e3a9183c1')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:07:12.891437 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap02f4d882-7b, col_values=(('external_ids', {'iface-id': '02f4d882-7b01-4a87-8666-10c3d4295a89', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:3f:3b', 'vm-uuid': 'a7b60291-5fd2-479e-9c9c-924b79f880a7'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:07:12.892410 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:12.893680 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:07:12.898508 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:12.899427 np0000001583 nova-compute[98241]: INFO os_vif [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:3f:3b,bridge_name='br-int',has_traffic_filtering=True,id=02f4d882-7b01-4a87-8666-10c3d4295a89,network=Network(716b3825-100d-45f0-8db3-3d2dc26813c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02f4d882-7b')
May 28 02:07:13.504375 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:14.090248 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.00035941199985245476 future=<Future at 0x7724f879e3f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:07:14.090691 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] Emitting event <LifecycleEvent: 1779934019.0897748, b369292d-fea0-46aa-b5c4-908b8bfb6209 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:07:14.090806 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:07:14.090944 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] VM Stopped (Lifecycle Event)
May 28 02:07:14.092448 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=6.081819820999954 future=<Future at 0x7724ec230620 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:07:14.093004 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=6.081691109000076 future=<Future at 0x7724ec230620 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:07:14.404404 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:14.416776 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:07:14.416928 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:07:14.417193 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] No VIF found with MAC fa:16:3e:63:3f:3b, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:07:14.417639 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Using config drive
May 28 02:07:14.593932 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-e967ec62-d369-4e95-bb29-80efbd9bb1cd tempest-VolumesNegativeTest-324661917 tempest-VolumesNegativeTest-324661917-project-member] [instance: b369292d-fea0-46aa-b5c4-908b8bfb6209] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:07:14.924168 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:07:15.063801 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Creating config drive at /opt/stack/data/nova/instances/a7b60291-5fd2-479e-9c9c-924b79f880a7/disk.config
May 28 02:07:15.068765 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a7b60291-5fd2-479e-9c9c-924b79f880a7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6i2o45an {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:07:15.131167 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a7b60291-5fd2-479e-9c9c-924b79f880a7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6i2o45an" returned: 0 in 0.060s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:07:15.576195 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:15.598682 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:15.602546 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:15.706115 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:15.861513 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-295d8ef0-ec62-4989-b51a-4f81e01ce75c req-1ffd1175-6074-49c7-ad44-75c5ade51cfb service nova] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Received event network-vif-plugged-02f4d882-7b01-4a87-8666-10c3d4295a89 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:07:15.862325 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-295d8ef0-ec62-4989-b51a-4f81e01ce75c req-1ffd1175-6074-49c7-ad44-75c5ade51cfb service nova] Acquiring lock "a7b60291-5fd2-479e-9c9c-924b79f880a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:07:15.862734 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-295d8ef0-ec62-4989-b51a-4f81e01ce75c req-1ffd1175-6074-49c7-ad44-75c5ade51cfb service nova] Lock "a7b60291-5fd2-479e-9c9c-924b79f880a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:07:15.862918 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-295d8ef0-ec62-4989-b51a-4f81e01ce75c req-1ffd1175-6074-49c7-ad44-75c5ade51cfb service nova] Lock "a7b60291-5fd2-479e-9c9c-924b79f880a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:07:15.863097 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-295d8ef0-ec62-4989-b51a-4f81e01ce75c req-1ffd1175-6074-49c7-ad44-75c5ade51cfb service nova] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Processing event network-vif-plugged-02f4d882-7b01-4a87-8666-10c3d4295a89 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 02:07:15.967127 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:15.975912 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:15.996500 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:15.997879 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:16.348200 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:16.434723 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 02:07:16.435697 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934036.4351869, a7b60291-5fd2-479e-9c9c-924b79f880a7 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:07:16.435797 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] VM Started (Lifecycle Event)
May 28 02:07:16.439265 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 02:07:16.444932 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Instance spawned successfully.
May 28 02:07:16.445349 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 02:07:16.938939 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:07:16.941404 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:07:16.955970 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:07:16.955970 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:07:16.955970 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:07:16.955970 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:07:16.955970 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:07:16.955970 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:07:17.444034 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 02:07:17.444401 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934037.4441373, a7b60291-5fd2-479e-9c9c-924b79f880a7 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:07:17.444401 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] VM Paused (Lifecycle Event)
May 28 02:07:17.464384 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Took 8.69 seconds to spawn the instance on the hypervisor.
May 28 02:07:17.464539 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:07:17.892486 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:17.919186 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d57fbeee-852a-4b00-a828-d58b06f390f8 req-41334715-401a-4cce-b279-073ecf7e89b9 service nova] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Received event network-vif-plugged-02f4d882-7b01-4a87-8666-10c3d4295a89 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:07:17.919383 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d57fbeee-852a-4b00-a828-d58b06f390f8 req-41334715-401a-4cce-b279-073ecf7e89b9 service nova] Acquiring lock "a7b60291-5fd2-479e-9c9c-924b79f880a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:07:17.920909 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d57fbeee-852a-4b00-a828-d58b06f390f8 req-41334715-401a-4cce-b279-073ecf7e89b9 service nova] Lock "a7b60291-5fd2-479e-9c9c-924b79f880a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:07:17.920967 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d57fbeee-852a-4b00-a828-d58b06f390f8 req-41334715-401a-4cce-b279-073ecf7e89b9 service nova] Lock "a7b60291-5fd2-479e-9c9c-924b79f880a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:07:17.921157 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d57fbeee-852a-4b00-a828-d58b06f390f8 req-41334715-401a-4cce-b279-073ecf7e89b9 service nova] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] No waiting events found dispatching network-vif-plugged-02f4d882-7b01-4a87-8666-10c3d4295a89 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:07:17.921324 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-d57fbeee-852a-4b00-a828-d58b06f390f8 req-41334715-401a-4cce-b279-073ecf7e89b9 service nova] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Received unexpected event network-vif-plugged-02f4d882-7b01-4a87-8666-10c3d4295a89 for instance with vm_state active and task_state None.
May 28 02:07:17.946371 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:07:17.948993 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934037.9487727, a7b60291-5fd2-479e-9c9c-924b79f880a7 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:07:17.949165 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] VM Resumed (Lifecycle Event)
May 28 02:07:17.973703 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Took 15.88 seconds to build instance.
May 28 02:07:18.451551 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:07:18.453582 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:07:18.475036 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-403a2a85-8a4e-4afa-b535-0e92d38bcb2e tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lock "a7b60291-5fd2-479e-9c9c-924b79f880a7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.390s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:07:18.519840 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:19.616165 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b6a69baf-8179-453b-8c0b-3f978e8ea1d6 req-6daf18e0-47f5-4c96-87e4-bc3a1cab9c75 service nova] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Received event network-changed-02f4d882-7b01-4a87-8666-10c3d4295a89 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:07:19.616573 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b6a69baf-8179-453b-8c0b-3f978e8ea1d6 req-6daf18e0-47f5-4c96-87e4-bc3a1cab9c75 service nova] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Refreshing instance network info cache due to event network-changed-02f4d882-7b01-4a87-8666-10c3d4295a89. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:07:19.618868 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b6a69baf-8179-453b-8c0b-3f978e8ea1d6 req-6daf18e0-47f5-4c96-87e4-bc3a1cab9c75 service nova] Acquiring lock "refresh_cache-a7b60291-5fd2-479e-9c9c-924b79f880a7" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:07:19.619037 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b6a69baf-8179-453b-8c0b-3f978e8ea1d6 req-6daf18e0-47f5-4c96-87e4-bc3a1cab9c75 service nova] Acquired lock "refresh_cache-a7b60291-5fd2-479e-9c9c-924b79f880a7" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:07:19.619409 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-b6a69baf-8179-453b-8c0b-3f978e8ea1d6 req-6daf18e0-47f5-4c96-87e4-bc3a1cab9c75 service nova] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Refreshing network info cache for port 02f4d882-7b01-4a87-8666-10c3d4295a89 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:07:20.122814 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-b6a69baf-8179-453b-8c0b-3f978e8ea1d6 req-6daf18e0-47f5-4c96-87e4-bc3a1cab9c75 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:07:20.175169 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.000457500000266009 future=<Future at 0x7724ec230620 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:07:20.175366 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:07:20.176012 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Emitting event <LifecycleEvent: 1779934025.1741812, 7751bb1a-84b9-48ce-81da-b3a41d63eadc => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:07:20.176459 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] VM Stopped (Lifecycle Event)
May 28 02:07:20.193844 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:07:20.196101 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:07:20.529733 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-b6a69baf-8179-453b-8c0b-3f978e8ea1d6 req-6daf18e0-47f5-4c96-87e4-bc3a1cab9c75 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:07:20.679171 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-8c60b134-52b0-4c86-8308-5ce8fddfa52f tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 7751bb1a-84b9-48ce-81da-b3a41d63eadc] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:07:20.684814 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-b6a69baf-8179-453b-8c0b-3f978e8ea1d6 req-6daf18e0-47f5-4c96-87e4-bc3a1cab9c75 service nova] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Updated VIF entry in instance network info cache for port 02f4d882-7b01-4a87-8666-10c3d4295a89. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:07:20.685422 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-b6a69baf-8179-453b-8c0b-3f978e8ea1d6 req-6daf18e0-47f5-4c96-87e4-bc3a1cab9c75 service nova] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Updating instance_info_cache with network_info: [{"id": "02f4d882-7b01-4a87-8666-10c3d4295a89", "address": "fa:16:3e:63:3f:3b", "network": {"id": "716b3825-100d-45f0-8db3-3d2dc26813c4", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1126424154-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "359205e9f0214f1795234b72dbbf45c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap02f4d882-7b", "ovs_interfaceid": "02f4d882-7b01-4a87-8666-10c3d4295a89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:07:21.187938 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b6a69baf-8179-453b-8c0b-3f978e8ea1d6 req-6daf18e0-47f5-4c96-87e4-bc3a1cab9c75 service nova] Releasing lock "refresh_cache-a7b60291-5fd2-479e-9c9c-924b79f880a7" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:07:21.193218 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:07:21.193521 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:07:21.193806 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:07:21.478911 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-00608961-8c7a-4eee-9638-64e29e22d18c req-91e48877-396c-4e85-94b5-ebbd36cd4007 service nova] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Received event network-changed-02f4d882-7b01-4a87-8666-10c3d4295a89 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:07:21.479370 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-00608961-8c7a-4eee-9638-64e29e22d18c req-91e48877-396c-4e85-94b5-ebbd36cd4007 service nova] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Refreshing instance network info cache due to event network-changed-02f4d882-7b01-4a87-8666-10c3d4295a89. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:07:21.479685 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-00608961-8c7a-4eee-9638-64e29e22d18c req-91e48877-396c-4e85-94b5-ebbd36cd4007 service nova] Acquiring lock "refresh_cache-a7b60291-5fd2-479e-9c9c-924b79f880a7" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:07:21.479832 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-00608961-8c7a-4eee-9638-64e29e22d18c req-91e48877-396c-4e85-94b5-ebbd36cd4007 service nova] Acquired lock "refresh_cache-a7b60291-5fd2-479e-9c9c-924b79f880a7" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:07:21.479988 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-00608961-8c7a-4eee-9638-64e29e22d18c req-91e48877-396c-4e85-94b5-ebbd36cd4007 service nova] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Refreshing network info cache for port 02f4d882-7b01-4a87-8666-10c3d4295a89 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:07:21.982564 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-00608961-8c7a-4eee-9638-64e29e22d18c req-91e48877-396c-4e85-94b5-ebbd36cd4007 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:07:22.294100 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-00608961-8c7a-4eee-9638-64e29e22d18c req-91e48877-396c-4e85-94b5-ebbd36cd4007 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:07:22.418643 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-00608961-8c7a-4eee-9638-64e29e22d18c req-91e48877-396c-4e85-94b5-ebbd36cd4007 service nova] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Updated VIF entry in instance network info cache for port 02f4d882-7b01-4a87-8666-10c3d4295a89. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:07:22.418643 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-00608961-8c7a-4eee-9638-64e29e22d18c req-91e48877-396c-4e85-94b5-ebbd36cd4007 service nova] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Updating instance_info_cache with network_info: [{"id": "02f4d882-7b01-4a87-8666-10c3d4295a89", "address": "fa:16:3e:63:3f:3b", "network": {"id": "716b3825-100d-45f0-8db3-3d2dc26813c4", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1126424154-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "359205e9f0214f1795234b72dbbf45c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap02f4d882-7b", "ovs_interfaceid": "02f4d882-7b01-4a87-8666-10c3d4295a89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:07:22.892967 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:22.920181 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-00608961-8c7a-4eee-9638-64e29e22d18c req-91e48877-396c-4e85-94b5-ebbd36cd4007 service nova] Releasing lock "refresh_cache-a7b60291-5fd2-479e-9c9c-924b79f880a7" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:07:23.193277 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:07:23.524571 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:23.698932 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:07:23.699223 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:07:23.699447 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:07:23.699667 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Auditing locally available compute resources for np0000001583 (node: np0000001583) {{(pid=98241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 02:07:24.733108 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 02:07:24.735393 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9bfbfaa-4d10-4c18-8ad9-0f115a757b60/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:07:24.833522 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9bfbfaa-4d10-4c18-8ad9-0f115a757b60/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:07:24.834313 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9bfbfaa-4d10-4c18-8ad9-0f115a757b60/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:07:24.935943 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9bfbfaa-4d10-4c18-8ad9-0f115a757b60/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:07:24.940577 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/dm-5 (vda) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 02:07:24.943092 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 02:07:24.945460 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:07:24.947044 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:07:25.006297 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.059s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:07:25.007003 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Hypervisor/Node resource view: name=np0000001583 free_ram=12505MB free_disk=72.74297714233398GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 02:07:25.007247 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:07:25.007576 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:07:25.887875 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "c9bfbfaa-4d10-4c18-8ad9-0f115a757b60" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:07:25.889101 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "c9bfbfaa-4d10-4c18-8ad9-0f115a757b60" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:07:26.090913 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 39ea2f26-6a01-4d24-a2b3-d681e0b22d80 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:07:26.091045 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance c9bfbfaa-4d10-4c18-8ad9-0f115a757b60 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:07:26.091317 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance e8bc20b7-8f2f-4226-9fcd-63c123604535 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:07:26.091433 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance a7b60291-5fd2-479e-9c9c-924b79f880a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:07:26.091620 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 02:07:26.091760 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Final resource view: name=np0000001583 phys_ram=24030MB used_ram=1280MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=4 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:07:25 up 43 min,  2 users,  load average: 3.97, 6.02, 4.97\n', 'num_instances': '4', 'num_vm_active': '4', 'num_task_None': '4', 'num_os_type_None': '4', 'num_proj_432aa1094ced436494def17a875aa8e1': '2', 'io_workload': '0', 'num_proj_d192b18567fd4735988dd19da06fb868': '1', 'num_proj_359205e9f0214f1795234b72dbbf45c6': '1'} {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 02:07:26.394871 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lazy-loading 'flavor' on Instance uuid c9bfbfaa-4d10-4c18-8ad9-0f115a757b60 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:07:26.423284 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:07:26.423630 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:07:26.928668 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:07:27.406638 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "c9bfbfaa-4d10-4c18-8ad9-0f115a757b60" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.517s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:07:27.432841 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Acquiring lock "5b81046a-d6a2-412e-8f9a-2ab41e8fd991" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:07:27.433057 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "5b81046a-d6a2-412e-8f9a-2ab41e8fd991" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:07:27.439226 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Compute_service record updated for np0000001583:np0000001583 {{(pid=98241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 02:07:27.439226 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.431s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:07:27.439527 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:07:27.894736 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:27.936688 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 02:07:28.483642 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "c9bfbfaa-4d10-4c18-8ad9-0f115a757b60" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:07:28.483843 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "c9bfbfaa-4d10-4c18-8ad9-0f115a757b60" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:07:28.484068 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Attaching volume 2d31cad7-323d-4fcb-bc86-dc315c46f551 to /dev/vdb
May 28 02:07:28.495532 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:07:28.495532 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:07:28.501869 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 02:07:28.502733 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Claim successful on node np0000001583
May 28 02:07:28.527733 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:28.547996 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:07:28.560210 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 02:07:28.586102 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:07:28.637549 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 02:07:28.638529 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 02:07:28.652114 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 02:07:28.652114 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe9c:a66d', 'fe80::34e0:eeff:fee2:bede', 'fe80::fc16:3eff:fee5:abc0', 'fe80::d05a:66ff:fe6d:1718', 'fe80::fc16:3eff:fe7c:9a06', 'fe80::fc16:3eff:fe63:3f3b', 'fe80::d807:fdff:fe71:abb9'] 
May 28 02:07:28.652114 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 02:07:28.652114 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 02:07:28.652114 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] <== get_connector_properties: return (103ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:07:28.652114 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Updating existing volume attachment record: 456379de-2581-4327-bc87-afd8847f6d15 {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 02:07:29.249264 np0000001583 nova-compute[98241]: DEBUG os_brick.encryptors [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551', 'iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2d31cad7-323d-4fcb-bc86-dc315c46f551', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'c9bfbfaa-4d10-4c18-8ad9-0f115a757b60', 'attached_at': '', 'detached_at': '', 'volume_id': '2d31cad7-323d-4fcb-bc86-dc315c46f551', 'serial': '2d31cad7-323d-4fcb-bc86-dc315c46f551'} {{(pid=98241) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 02:07:29.254338 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 02:07:29.254928 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551', 'iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2d31cad7-323d-4fcb-bc86-dc315c46f551', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:07:29.255245 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:07:29.255851 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:07:29.256180 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551', 'iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2d31cad7-323d-4fcb-bc86-dc315c46f551', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 02:07:29.273053 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:07:29.273680 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:07:29.274547 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:07:29.274547 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:07:29.274916 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:07:29.275173 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:07:29.289174 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:07:29.289174 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:07:29.293256 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:07:29.293256 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:07:29.300875 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551] added
May 28 02:07:29.300875 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:07:29.300875 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:07:29.300875 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:07:29.300875 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:07:29.300875 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:07:29.300875 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:07:29.301151 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:07:29.301301 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0267(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:07:29.301482 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:07:29.306530 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551] added
May 28 02:07:29.306530 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:07:29.306530 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:07:29.306530 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:07:29.306530 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:07:29.306530 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:07:29.306530 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:07:29.306782 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:07:29.306845 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0318(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:07:29.306990 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:07:29.439761 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:07:29.440278 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:07:29.440642 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:07:29.441133 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:07:29.441367 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 02:07:29.441743 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.75 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:07:29.784883 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:07:29.785137 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:07:30.288423 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:07:30.302171 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:07:30.307959 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:07:30.320593 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:07:30.320593 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:07:30.328003 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:07:30.328003 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:07:30.341273 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:07:30.346752 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:07:30.360434 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:30.360434 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:30.360434 np0000001583 nova-compute[98241]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:07:30.360434 np0000001583 nova-compute[98241]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:07:30.360434 np0000001583 nova-compute[98241]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:07:30.360434 np0000001583 nova-compute[98241]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:07:30.360434 np0000001583 nova-compute[98241]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a019fc91-9c56-4ffd-a56f-c9f5dc30a98d (non-flash)
May 28 02:07:30.360434 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:07:30.363377 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsi session list stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:30.363377 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:30.363377 np0000001583 nova-compute[98241]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:07:30.363377 np0000001583 nova-compute[98241]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:07:30.363377 np0000001583 nova-compute[98241]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:07:30.363377 np0000001583 nova-compute[98241]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:07:30.363377 np0000001583 nova-compute[98241]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a019fc91-9c56-4ffd-a56f-c9f5dc30a98d (non-flash)
May 28 02:07:30.363377 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:07:30.369453 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:30.369453 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:30.369453 np0000001583 nova-compute[98241]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:07:30.369453 np0000001583 nova-compute[98241]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:07:30.369453 np0000001583 nova-compute[98241]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:07:30.369453 np0000001583 nova-compute[98241]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:07:30.369453 np0000001583 nova-compute[98241]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a019fc91-9c56-4ffd-a56f-c9f5dc30a98d (non-flash)
May 28 02:07:30.369453 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:07:30.369658 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsi session list stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:30.369658 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:30.369658 np0000001583 nova-compute[98241]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:07:30.369658 np0000001583 nova-compute[98241]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:07:30.369658 np0000001583 nova-compute[98241]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:07:30.369658 np0000001583 nova-compute[98241]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:07:30.369658 np0000001583 nova-compute[98241]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a019fc91-9c56-4ffd-a56f-c9f5dc30a98d (non-flash)
May 28 02:07:30.369658 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:07:30.403060 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551, portal: 192.168.50.100,3260]
May 28 02:07:30.403060 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551, portal: 192.168.50.100,3260] successful.
May 28 02:07:30.403060 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:07:30.410979 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551, portal: 192.168.40.100,3260]
May 28 02:07:30.410979 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551, portal: 192.168.40.100,3260] successful.
May 28 02:07:30.410979 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:07:30.425530 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:07:30.427458 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:07:30.445176 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:30.445176 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:30.445176 np0000001583 nova-compute[98241]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:07:30.445176 np0000001583 nova-compute[98241]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:07:30.445176 np0000001583 nova-compute[98241]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:07:30.445176 np0000001583 nova-compute[98241]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:07:30.445176 np0000001583 nova-compute[98241]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a019fc91-9c56-4ffd-a56f-c9f5dc30a98d (non-flash)
May 28 02:07:30.445176 np0000001583 nova-compute[98241]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551 (non-flash)
May 28 02:07:30.445176 np0000001583 nova-compute[98241]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551 (non-flash)
May 28 02:07:30.445176 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:07:30.445176 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsi session list stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:30.445176 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:30.445176 np0000001583 nova-compute[98241]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:07:30.445176 np0000001583 nova-compute[98241]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:07:30.445176 np0000001583 nova-compute[98241]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:07:30.445176 np0000001583 nova-compute[98241]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:07:30.445176 np0000001583 nova-compute[98241]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a019fc91-9c56-4ffd-a56f-c9f5dc30a98d (non-flash)
May 28 02:07:30.445176 np0000001583 nova-compute[98241]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551 (non-flash)
May 28 02:07:30.445176 np0000001583 nova-compute[98241]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551 (non-flash)
May 28 02:07:30.445176 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:07:30.445176 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.171s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:07:30.445176 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:07:30.446631 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] HCTL ('11', '-', '-', 0) found on session 160 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:07:30.446631 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:07:30.457355 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:30.457355 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:30.457355 np0000001583 nova-compute[98241]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:07:30.457355 np0000001583 nova-compute[98241]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:07:30.457355 np0000001583 nova-compute[98241]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:07:30.457355 np0000001583 nova-compute[98241]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:07:30.457355 np0000001583 nova-compute[98241]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a019fc91-9c56-4ffd-a56f-c9f5dc30a98d (non-flash)
May 28 02:07:30.457355 np0000001583 nova-compute[98241]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551 (non-flash)
May 28 02:07:30.457355 np0000001583 nova-compute[98241]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551 (non-flash)
May 28 02:07:30.457355 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:07:30.457753 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsi session list stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:30.457753 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:30.457753 np0000001583 nova-compute[98241]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:07:30.457753 np0000001583 nova-compute[98241]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:07:30.457753 np0000001583 nova-compute[98241]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:07:30.457753 np0000001583 nova-compute[98241]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:07:30.457753 np0000001583 nova-compute[98241]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a019fc91-9c56-4ffd-a56f-c9f5dc30a98d (non-flash)
May 28 02:07:30.457753 np0000001583 nova-compute[98241]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551 (non-flash)
May 28 02:07:30.457753 np0000001583 nova-compute[98241]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551 (non-flash)
May 28 02:07:30.457753 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:07:30.458016 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.183s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:07:30.458016 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:07:30.459456 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] HCTL ('12', '-', '-', 0) found on session 161 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:07:30.459662 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:07:30.470858 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Searching for a device in session 160 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:07:30.471093 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2d31cad7-323d-4fcb-bc86-dc315c46f551', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:07:30.485552 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Searching for a device in session 161 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:07:30.485552 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2d31cad7-323d-4fcb-bc86-dc315c46f551', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:07:30.798205 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.303s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:07:30.798643 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 02:07:31.274983 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 02:07:31.305751 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 02:07:31.306324 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 02:07:31.306673 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:07:31.306673 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:07:31.391039 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2b5bf0f126624ddab4bd36a1b707899e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2896b1043bfb246c28ad9d1e174', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 02:07:31.809822 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 02:07:31.931357 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Successfully created port: 87489626-7d65-4bc9-bd0e-300688717b63 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 02:07:32.190565 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:07:32.190895 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 48.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:07:32.295511 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Found WWN 330000000a4273aff for multipath device dm-9 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 02:07:32.295903 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:07:32.297353 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] <== connect_volume: return (3041ms) {'type': 'block', 'scsi_wwn': '330000000a4273aff', 'path': '/dev/disk/by-id/os-brick+dev+dm-9', 'multipath_id': '330000000a4273aff'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:07:32.297592 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a4273aff', 'path': '/dev/disk/by-id/os-brick+dev+dm-9', 'multipath_id': '330000000a4273aff'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 02:07:32.300959 np0000001583 nova-compute[98241]: WARNING stevedore.named [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 02:07:32.301250 np0000001583 nova-compute[98241]: WARNING castellan.key_manager [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 02:07:32.301428 np0000001583 nova-compute[98241]: WARNING nova.keymgr.conf_key_mgr [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 02:07:32.318837 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 02:07:32.325174 np0000001583 nova-compute[98241]: WARNING os_brick.encryptors.luks [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 28 02:07:32.327347 np0000001583 nova-compute[98241]: WARNING stevedore.named [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 02:07:32.327861 np0000001583 nova-compute[98241]: WARNING castellan.key_manager [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 02:07:32.328168 np0000001583 nova-compute[98241]: WARNING nova.keymgr.conf_key_mgr [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 02:07:32.328928 np0000001583 nova-compute[98241]: DEBUG os_brick.encryptors [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x7724f859b9b0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551', 'iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2d31cad7-323d-4fcb-bc86-dc315c46f551', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-9'}, 'status': 'reserved', 'instance': 'c9bfbfaa-4d10-4c18-8ad9-0f115a757b60', 'attached_at': '', 'detached_at': '', 'volume_id': '2d31cad7-323d-4fcb-bc86-dc315c46f551', 'serial': '2d31cad7-323d-4fcb-bc86-dc315c46f551'} {{(pid=98241) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 28 02:07:32.329064 np0000001583 nova-compute[98241]: DEBUG os_brick.encryptors.luks [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] formatting encrypted volume /dev/dm-9 {{(pid=98241) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 28 02:07:32.543621 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Successfully updated port: 87489626-7d65-4bc9-bd0e-300688717b63 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 02:07:32.603612 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a6f887f5-7a45-4d91-ad41-067d8e05b427 req-6c37d3cb-08fc-4470-b716-ab903c90220e service nova] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Received event network-changed-87489626-7d65-4bc9-bd0e-300688717b63 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:07:32.604181 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a6f887f5-7a45-4d91-ad41-067d8e05b427 req-6c37d3cb-08fc-4470-b716-ab903c90220e service nova] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Refreshing instance network info cache due to event network-changed-87489626-7d65-4bc9-bd0e-300688717b63. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:07:32.604569 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a6f887f5-7a45-4d91-ad41-067d8e05b427 req-6c37d3cb-08fc-4470-b716-ab903c90220e service nova] Acquiring lock "refresh_cache-5b81046a-d6a2-412e-8f9a-2ab41e8fd991" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:07:32.606136 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a6f887f5-7a45-4d91-ad41-067d8e05b427 req-6c37d3cb-08fc-4470-b716-ab903c90220e service nova] Acquired lock "refresh_cache-5b81046a-d6a2-412e-8f9a-2ab41e8fd991" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:07:32.606136 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-a6f887f5-7a45-4d91-ad41-067d8e05b427 req-6c37d3cb-08fc-4470-b716-ab903c90220e service nova] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Refreshing network info cache for port 87489626-7d65-4bc9-bd0e-300688717b63 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:07:32.829936 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Booting with volume 79578bb5-fcb4-42d4-891a-524f17a519d9 at /dev/vda
May 28 02:07:32.873422 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:07:32.886441 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 02:07:32.896351 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:32.911613 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:07:32.962913 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 02:07:32.963334 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 02:07:32.979117 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 02:07:32.980708 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe9c:a66d', 'fe80::34e0:eeff:fee2:bede', 'fe80::fc16:3eff:fee5:abc0', 'fe80::d05a:66ff:fe6d:1718', 'fe80::fc16:3eff:fe7c:9a06', 'fe80::fc16:3eff:fe63:3f3b', 'fe80::d807:fdff:fe71:abb9'] 
May 28 02:07:32.980938 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 02:07:32.981121 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 02:07:32.981477 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:07:32.981796 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Updating existing volume attachment record: f7aea310-daf0-4d68-b1ed-200cdd0de371 {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 02:07:33.047302 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Acquiring lock "refresh_cache-5b81046a-d6a2-412e-8f9a-2ab41e8fd991" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:07:33.109930 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-a6f887f5-7a45-4d91-ad41-067d8e05b427 req-6c37d3cb-08fc-4470-b716-ab903c90220e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:07:33.209929 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-a6f887f5-7a45-4d91-ad41-067d8e05b427 req-6c37d3cb-08fc-4470-b716-ab903c90220e service nova] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:07:33.361254 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-a6f887f5-7a45-4d91-ad41-067d8e05b427 req-6c37d3cb-08fc-4470-b716-ab903c90220e service nova] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:07:33.530480 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:33.864526 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a6f887f5-7a45-4d91-ad41-067d8e05b427 req-6c37d3cb-08fc-4470-b716-ab903c90220e service nova] Releasing lock "refresh_cache-5b81046a-d6a2-412e-8f9a-2ab41e8fd991" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:07:33.865356 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Acquired lock "refresh_cache-5b81046a-d6a2-412e-8f9a-2ab41e8fd991" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:07:33.866169 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:07:34.328563 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:07:34.455490 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:07:34.639740 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:07:34.796878 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Updating instance_info_cache with network_info: [{"id": "87489626-7d65-4bc9-bd0e-300688717b63", "address": "fa:16:3e:1c:a0:9a", "network": {"id": "ef15cd88-386f-4fc6-8df0-74267f73d3fb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1804869041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b7ada2896b1043bfb246c28ad9d1e174", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap87489626-7d", "ovs_interfaceid": "87489626-7d65-4bc9-bd0e-300688717b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:07:35.086989 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 02:07:35.088629 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 02:07:35.088890 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Creating image(s)
May 28 02:07:35.089195 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Did not create local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 02:07:35.089307 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Ensure instance console log exists: /opt/stack/data/nova/instances/5b81046a-d6a2-412e-8f9a-2ab41e8fd991/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 02:07:35.089522 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:07:35.089736 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:07:35.089873 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:07:35.301305 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Releasing lock "refresh_cache-5b81046a-d6a2-412e-8f9a-2ab41e8fd991" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:07:35.301556 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Instance network_info: |[{"id": "87489626-7d65-4bc9-bd0e-300688717b63", "address": "fa:16:3e:1c:a0:9a", "network": {"id": "ef15cd88-386f-4fc6-8df0-74267f73d3fb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1804869041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b7ada2896b1043bfb246c28ad9d1e174", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap87489626-7d", "ovs_interfaceid": "87489626-7d65-4bc9-bd0e-300688717b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 02:07:35.302488 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Start _get_guest_xml network_info=[{"id": "87489626-7d65-4bc9-bd0e-300688717b63", "address": "fa:16:3e:1c:a0:9a", "network": {"id": "ef15cd88-386f-4fc6-8df0-74267f73d3fb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1804869041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b7ada2896b1043bfb246c28ad9d1e174", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap87489626-7d", "ovs_interfaceid": "87489626-7d65-4bc9-bd0e-300688717b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9', 'iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '79578bb5-fcb4-42d4-891a-524f17a519d9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '5b81046a-d6a2-412e-8f9a-2ab41e8fd991', 'attached_at': '', 'detached_at': '', 'volume_id': '79578bb5-fcb4-42d4-891a-524f17a519d9', 'serial': '79578bb5-fcb4-42d4-891a-524f17a519d9'}, 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'f7aea310-daf0-4d68-b1ed-200cdd0de371', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 02:07:35.307156 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:07:35.308486 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1761756426', uuid='5b81046a-d6a2-412e-8f9a-2ab41e8fd991'), owner=OwnerMeta(userid='2b5bf0f126624ddab4bd36a1b707899e', username='tempest-TestEncryptedCinderVolumes-1693604386-project-member', projectid='b7ada2896b1043bfb246c28ad9d1e174', projectname='tempest-TestEncryptedCinderVolumes-1693604386'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "87489626-7d65-4bc9-bd0e-300688717b63", "address": "fa:16:3e:1c:a0:9a", "network": {"id": "ef15cd88-386f-4fc6-8df0-74267f73d3fb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1804869041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b7ada2896b1043bfb246c28ad9d1e174", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap87489626-7d", "ovs_interfaceid": "87489626-7d65-4bc9-bd0e-300688717b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779934055.3081033) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 02:07:35.309891 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 02:07:35.310271 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 02:07:35.311540 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 02:07:35.311841 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 02:07:35.313213 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 02:07:35.313551 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 02:07:35.313799 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 02:07:35.313934 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 02:07:35.314104 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 02:07:35.314247 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 02:07:35.314622 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 02:07:35.314707 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 02:07:35.314856 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 02:07:35.315003 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 02:07:35.315153 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 02:07:35.315460 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 02:07:35.331150 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 02:07:35.331512 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9', 'iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '79578bb5-fcb4-42d4-891a-524f17a519d9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:07:35.331714 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:07:35.332217 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:07:35.332450 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9', 'iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '79578bb5-fcb4-42d4-891a-524f17a519d9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 02:07:35.345733 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:07:35.349063 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:07:35.349293 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:07:35.350008 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:07:35.353265 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:07:35.353536 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:07:35.362121 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:07:35.362121 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:07:35.373065 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:07:35.373065 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:07:35.383820 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9] added
May 28 02:07:35.383820 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:07:35.383820 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:07:35.383820 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:07:35.383820 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:07:35.383820 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:07:35.383820 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:07:35.384214 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:07:35.384270 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0349(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:07:35.384394 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:07:35.389180 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9] added
May 28 02:07:35.389180 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:07:35.389180 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:07:35.389180 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:07:35.389180 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:07:35.389180 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:07:35.389180 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:07:35.389487 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:07:35.389552 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0361(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:07:35.389768 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:07:36.384867 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:07:36.390113 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:07:36.395869 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:07:36.395869 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:07:36.401009 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:07:36.401009 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:07:36.409992 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:07:36.419208 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:07:36.428738 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:36.428738 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:36.428738 np0000001583 nova-compute[98241]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:07:36.428738 np0000001583 nova-compute[98241]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:07:36.428738 np0000001583 nova-compute[98241]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:07:36.428738 np0000001583 nova-compute[98241]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:07:36.428738 np0000001583 nova-compute[98241]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a019fc91-9c56-4ffd-a56f-c9f5dc30a98d (non-flash)
May 28 02:07:36.428738 np0000001583 nova-compute[98241]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551 (non-flash)
May 28 02:07:36.428738 np0000001583 nova-compute[98241]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551 (non-flash)
May 28 02:07:36.428738 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:07:36.428738 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsi session list stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:36.428738 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:36.428738 np0000001583 nova-compute[98241]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:07:36.428738 np0000001583 nova-compute[98241]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:07:36.428738 np0000001583 nova-compute[98241]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:07:36.428738 np0000001583 nova-compute[98241]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:07:36.428738 np0000001583 nova-compute[98241]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a019fc91-9c56-4ffd-a56f-c9f5dc30a98d (non-flash)
May 28 02:07:36.428738 np0000001583 nova-compute[98241]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551 (non-flash)
May 28 02:07:36.428738 np0000001583 nova-compute[98241]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551 (non-flash)
May 28 02:07:36.428738 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:07:36.436341 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:36.436341 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:36.436341 np0000001583 nova-compute[98241]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:07:36.436341 np0000001583 nova-compute[98241]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:07:36.436341 np0000001583 nova-compute[98241]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:07:36.436341 np0000001583 nova-compute[98241]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:07:36.436341 np0000001583 nova-compute[98241]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a019fc91-9c56-4ffd-a56f-c9f5dc30a98d (non-flash)
May 28 02:07:36.436341 np0000001583 nova-compute[98241]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551 (non-flash)
May 28 02:07:36.436341 np0000001583 nova-compute[98241]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551 (non-flash)
May 28 02:07:36.436341 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:07:36.436657 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsi session list stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:36.436657 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:36.436657 np0000001583 nova-compute[98241]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:07:36.436657 np0000001583 nova-compute[98241]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:07:36.436657 np0000001583 nova-compute[98241]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:07:36.436657 np0000001583 nova-compute[98241]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:07:36.436657 np0000001583 nova-compute[98241]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a019fc91-9c56-4ffd-a56f-c9f5dc30a98d (non-flash)
May 28 02:07:36.436657 np0000001583 nova-compute[98241]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551 (non-flash)
May 28 02:07:36.436657 np0000001583 nova-compute[98241]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551 (non-flash)
May 28 02:07:36.436657 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:07:36.470146 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9, portal: 192.168.40.100,3260]
May 28 02:07:36.470146 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9, portal: 192.168.40.100,3260] successful.
May 28 02:07:36.470146 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:07:36.483004 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:07:36.494254 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9, portal: 192.168.50.100,3260]
May 28 02:07:36.494254 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9, portal: 192.168.50.100,3260] successful.
May 28 02:07:36.494254 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:07:36.508658 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:36.508658 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:36.508658 np0000001583 nova-compute[98241]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:07:36.508658 np0000001583 nova-compute[98241]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:07:36.508658 np0000001583 nova-compute[98241]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:07:36.508658 np0000001583 nova-compute[98241]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:07:36.508658 np0000001583 nova-compute[98241]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a019fc91-9c56-4ffd-a56f-c9f5dc30a98d (non-flash)
May 28 02:07:36.508658 np0000001583 nova-compute[98241]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551 (non-flash)
May 28 02:07:36.508658 np0000001583 nova-compute[98241]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551 (non-flash)
May 28 02:07:36.508658 np0000001583 nova-compute[98241]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:07:36.508658 np0000001583 nova-compute[98241]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:07:36.508658 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:07:36.508658 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsi session list stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:36.508658 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:36.508658 np0000001583 nova-compute[98241]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:07:36.508658 np0000001583 nova-compute[98241]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:07:36.508658 np0000001583 nova-compute[98241]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:07:36.508658 np0000001583 nova-compute[98241]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:07:36.508658 np0000001583 nova-compute[98241]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a019fc91-9c56-4ffd-a56f-c9f5dc30a98d (non-flash)
May 28 02:07:36.508658 np0000001583 nova-compute[98241]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551 (non-flash)
May 28 02:07:36.508658 np0000001583 nova-compute[98241]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551 (non-flash)
May 28 02:07:36.508658 np0000001583 nova-compute[98241]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:07:36.508658 np0000001583 nova-compute[98241]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:07:36.508658 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:07:36.508658 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.158s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:07:36.508658 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:07:36.508658 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] HCTL ('16', '-', '-', 0) found on session 162 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:07:36.508658 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:07:36.511042 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:07:36.531775 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Searching for a device in session 162 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:07:36.531775 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '79578bb5-fcb4-42d4-891a-524f17a519d9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:07:36.534398 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:36.534398 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:36.534398 np0000001583 nova-compute[98241]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:07:36.534398 np0000001583 nova-compute[98241]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:07:36.534398 np0000001583 nova-compute[98241]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:07:36.534398 np0000001583 nova-compute[98241]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:07:36.534398 np0000001583 nova-compute[98241]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a019fc91-9c56-4ffd-a56f-c9f5dc30a98d (non-flash)
May 28 02:07:36.534398 np0000001583 nova-compute[98241]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551 (non-flash)
May 28 02:07:36.534398 np0000001583 nova-compute[98241]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551 (non-flash)
May 28 02:07:36.534398 np0000001583 nova-compute[98241]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:07:36.534398 np0000001583 nova-compute[98241]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:07:36.534398 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:07:36.534398 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsi session list stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:36.534398 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:36.534398 np0000001583 nova-compute[98241]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:07:36.534398 np0000001583 nova-compute[98241]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:07:36.534398 np0000001583 nova-compute[98241]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:07:36.534398 np0000001583 nova-compute[98241]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:07:36.534398 np0000001583 nova-compute[98241]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a019fc91-9c56-4ffd-a56f-c9f5dc30a98d (non-flash)
May 28 02:07:36.534398 np0000001583 nova-compute[98241]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551 (non-flash)
May 28 02:07:36.534398 np0000001583 nova-compute[98241]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551 (non-flash)
May 28 02:07:36.534398 np0000001583 nova-compute[98241]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:07:36.534398 np0000001583 nova-compute[98241]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:07:36.534398 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:07:36.535096 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.182s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:07:36.535096 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:07:36.536007 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] HCTL ('17', '-', '-', 0) found on session 163 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:07:36.536173 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:07:36.555152 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Searching for a device in session 163 and hctl ['17', '*', '*', 0] yield: None {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:07:36.567350 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Secret XML: <secret ephemeral="no" private="no">
May 28 02:07:36.567350 np0000001583 nova-compute[98241]:   <usage type="volume">
May 28 02:07:36.567350 np0000001583 nova-compute[98241]:     <volume>2d31cad7-323d-4fcb-bc86-dc315c46f551</volume>
May 28 02:07:36.567350 np0000001583 nova-compute[98241]:   </usage>
May 28 02:07:36.567350 np0000001583 nova-compute[98241]: </secret>
May 28 02:07:36.567350 np0000001583 nova-compute[98241]:  {{(pid=98241) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 28 02:07:36.581667 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lazy-loading 'flavor' on Instance uuid c9bfbfaa-4d10-4c18-8ad9-0f115a757b60 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:07:37.085894 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Attempting to attach volume 2d31cad7-323d-4fcb-bc86-dc315c46f551 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98241) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 02:07:37.087587 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] attach device xml: <disk type="block" device="disk">
May 28 02:07:37.087587 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:07:37.087587 np0000001583 nova-compute[98241]:   <alias name="ua-2d31cad7-323d-4fcb-bc86-dc315c46f551"/>
May 28 02:07:37.087587 np0000001583 nova-compute[98241]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-9"/>
May 28 02:07:37.087587 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:07:37.087587 np0000001583 nova-compute[98241]:   <serial>2d31cad7-323d-4fcb-bc86-dc315c46f551</serial>
May 28 02:07:37.087587 np0000001583 nova-compute[98241]:   <encryption format="luks">
May 28 02:07:37.087587 np0000001583 nova-compute[98241]:     <secret type="passphrase" uuid="d766071d-7f7a-43ed-8d1f-1ddd930fc62f"/>
May 28 02:07:37.087587 np0000001583 nova-compute[98241]:   </encryption>
May 28 02:07:37.087587 np0000001583 nova-compute[98241]: </disk>
May 28 02:07:37.087587 np0000001583 nova-compute[98241]:  {{(pid=98241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 02:07:37.553509 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Searching for a device in session 163 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:07:37.554033 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '79578bb5-fcb4-42d4-891a-524f17a519d9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:07:37.897517 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:37.987800 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-cf6ea26d-b5b6-49be-a2df-ebeffd1ba7bb req-5c075b01-c2db-4439-9ecb-1fe73ddbe34c service nova] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Received event network-changed-b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:07:37.987800 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-cf6ea26d-b5b6-49be-a2df-ebeffd1ba7bb req-5c075b01-c2db-4439-9ecb-1fe73ddbe34c service nova] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Refreshing instance network info cache due to event network-changed-b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:07:37.987895 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-cf6ea26d-b5b6-49be-a2df-ebeffd1ba7bb req-5c075b01-c2db-4439-9ecb-1fe73ddbe34c service nova] Acquiring lock "refresh_cache-e8bc20b7-8f2f-4226-9fcd-63c123604535" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:07:37.987985 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-cf6ea26d-b5b6-49be-a2df-ebeffd1ba7bb req-5c075b01-c2db-4439-9ecb-1fe73ddbe34c service nova] Acquired lock "refresh_cache-e8bc20b7-8f2f-4226-9fcd-63c123604535" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:07:37.988106 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-cf6ea26d-b5b6-49be-a2df-ebeffd1ba7bb req-5c075b01-c2db-4439-9ecb-1fe73ddbe34c service nova] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Refreshing network info cache for port b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:07:38.370074 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Found WWN 330000000db18e4eb for multipath device dm-10 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 02:07:38.370278 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:07:38.371352 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '330000000db18e4eb', 'path': '/dev/disk/by-id/os-brick+dev+dm-10', 'multipath_id': '330000000db18e4eb'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:07:38.371514 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000db18e4eb', 'path': '/dev/disk/by-id/os-brick+dev+dm-10', 'multipath_id': '330000000db18e4eb'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 02:07:38.408558 np0000001583 nova-compute[98241]: DEBUG os_brick.encryptors [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9', 'iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '79578bb5-fcb4-42d4-891a-524f17a519d9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-10'}, 'status': 'reserved', 'instance': '5b81046a-d6a2-412e-8f9a-2ab41e8fd991', 'attached_at': '', 'detached_at': '', 'volume_id': '79578bb5-fcb4-42d4-891a-524f17a519d9', 'serial': '79578bb5-fcb4-42d4-891a-524f17a519d9'} {{(pid=98241) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 02:07:38.409063 np0000001583 nova-compute[98241]: WARNING stevedore.named [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 02:07:38.409349 np0000001583 nova-compute[98241]: WARNING castellan.key_manager [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 02:07:38.409528 np0000001583 nova-compute[98241]: WARNING nova.keymgr.conf_key_mgr [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 02:07:38.425611 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Secret XML: <secret ephemeral="no" private="no">
May 28 02:07:38.425611 np0000001583 nova-compute[98241]:   <usage type="volume">
May 28 02:07:38.425611 np0000001583 nova-compute[98241]:     <volume>79578bb5-fcb4-42d4-891a-524f17a519d9</volume>
May 28 02:07:38.425611 np0000001583 nova-compute[98241]:   </usage>
May 28 02:07:38.425611 np0000001583 nova-compute[98241]: </secret>
May 28 02:07:38.425611 np0000001583 nova-compute[98241]:  {{(pid=98241) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 28 02:07:38.531667 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:38.665737 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-cf6ea26d-b5b6-49be-a2df-ebeffd1ba7bb req-5c075b01-c2db-4439-9ecb-1fe73ddbe34c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:07:38.667443 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "e8bc20b7-8f2f-4226-9fcd-63c123604535" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:07:38.667624 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "e8bc20b7-8f2f-4226-9fcd-63c123604535" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:07:38.667780 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "e8bc20b7-8f2f-4226-9fcd-63c123604535-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:07:38.667909 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "e8bc20b7-8f2f-4226-9fcd-63c123604535-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:07:38.668012 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "e8bc20b7-8f2f-4226-9fcd-63c123604535-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:07:38.670783 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Terminating instance
May 28 02:07:38.934839 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-cf6ea26d-b5b6-49be-a2df-ebeffd1ba7bb req-5c075b01-c2db-4439-9ecb-1fe73ddbe34c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:07:38.937681 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:07:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1761756426',display_name='tempest-TestEncryptedCinderVolumes-server-1761756426',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testencryptedcindervolumes-server-1761756426',id=68,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBvIuscC5Hl9LuYYLq2wWivaHaebRNHPQIeYgqv7q1vZGG0QAw9Hdt3V++LObVUv3gsFUugch3GmPHbbfwH6piykof8GCWeT2LLzcMRX5UhzJRQuWby1FNbyksEPsTs9eg==',key_name='tempest-TestEncryptedCinderVolumes-1555008274',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7ada2896b1043bfb246c28ad9d1e174',ramdisk_id='',reservation_id='r-cw18en14',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1693604386',owner_user_name='tempest-TestEncryptedCinderVolumes-1693604386-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:07:32Z,user_data=None,user_id='2b5bf0f126624ddab4bd36a1b707899e',uuid=5b81046a-d6a2-412e-8f9a-2ab41e8fd991,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87489626-7d65-4bc9-bd0e-300688717b63", "address": "fa:16:3e:1c:a0:9a", "network": {"id": "ef15cd88-386f-4fc6-8df0-74267f73d3fb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1804869041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b7ada2896b1043bfb246c28ad9d1e174", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap87489626-7d", "ovs_interfaceid": "87489626-7d65-4bc9-bd0e-300688717b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 02:07:38.937984 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Converting VIF {"id": "87489626-7d65-4bc9-bd0e-300688717b63", "address": "fa:16:3e:1c:a0:9a", "network": {"id": "ef15cd88-386f-4fc6-8df0-74267f73d3fb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1804869041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b7ada2896b1043bfb246c28ad9d1e174", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap87489626-7d", "ovs_interfaceid": "87489626-7d65-4bc9-bd0e-300688717b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:07:38.938597 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:a0:9a,bridge_name='br-int',has_traffic_filtering=True,id=87489626-7d65-4bc9-bd0e-300688717b63,network=Network(ef15cd88-386f-4fc6-8df0-74267f73d3fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87489626-7d') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:07:38.939807 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lazy-loading 'pci_devices' on Instance uuid 5b81046a-d6a2-412e-8f9a-2ab41e8fd991 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:07:39.052132 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-cf6ea26d-b5b6-49be-a2df-ebeffd1ba7bb req-5c075b01-c2db-4439-9ecb-1fe73ddbe34c service nova] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Updated VIF entry in instance network info cache for port b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:07:39.052424 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-cf6ea26d-b5b6-49be-a2df-ebeffd1ba7bb req-5c075b01-c2db-4439-9ecb-1fe73ddbe34c service nova] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Updating instance_info_cache with network_info: [{"id": "b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0", "address": "fa:16:3e:7c:9a:06", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2ddd1f1-c8", "ovs_interfaceid": "b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:07:39.173725 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 02:07:39.197630 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:39.200188 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:39.216522 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:39.334561 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-add40b8c-664d-4be2-8c19-91ca56dc1ccb req-a7959175-7227-4f8f-bb42-0d16aa45205f service nova] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Received event network-vif-unplugged-b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:07:39.334812 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-add40b8c-664d-4be2-8c19-91ca56dc1ccb req-a7959175-7227-4f8f-bb42-0d16aa45205f service nova] Acquiring lock "e8bc20b7-8f2f-4226-9fcd-63c123604535-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:07:39.335016 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-add40b8c-664d-4be2-8c19-91ca56dc1ccb req-a7959175-7227-4f8f-bb42-0d16aa45205f service nova] Lock "e8bc20b7-8f2f-4226-9fcd-63c123604535-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:07:39.335156 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-add40b8c-664d-4be2-8c19-91ca56dc1ccb req-a7959175-7227-4f8f-bb42-0d16aa45205f service nova] Lock "e8bc20b7-8f2f-4226-9fcd-63c123604535-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:07:39.335302 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-add40b8c-664d-4be2-8c19-91ca56dc1ccb req-a7959175-7227-4f8f-bb42-0d16aa45205f service nova] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] No waiting events found dispatching network-vif-unplugged-b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:07:39.335416 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-add40b8c-664d-4be2-8c19-91ca56dc1ccb req-a7959175-7227-4f8f-bb42-0d16aa45205f service nova] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Received event network-vif-unplugged-b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:07:39.355862 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:39.361834 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:39.442413 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] End _get_guest_xml xml=<domain type="qemu">
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:   <uuid>5b81046a-d6a2-412e-8f9a-2ab41e8fd991</uuid>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:   <name>instance-00000044</name>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:   <metadata>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1761756426</nova:name>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 02:07:35</nova:creationTime>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:       <nova:image uuid="">
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:       </nova:image>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:         <nova:user uuid="2b5bf0f126624ddab4bd36a1b707899e">tempest-TestEncryptedCinderVolumes-1693604386-project-member</nova:user>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:         <nova:project uuid="b7ada2896b1043bfb246c28ad9d1e174">tempest-TestEncryptedCinderVolumes-1693604386</nova:project>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:       <nova:root type="volume" uuid=""/>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:         <nova:port uuid="87489626-7d65-4bc9-bd0e-300688717b63">
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:         </nova:port>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:   </metadata>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:     <system>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:       <entry name="serial">5b81046a-d6a2-412e-8f9a-2ab41e8fd991</entry>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:       <entry name="uuid">5b81046a-d6a2-412e-8f9a-2ab41e8fd991</entry>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:     </system>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:   <os>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:   </os>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:   <features>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:     <acpi/>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:     <tcg>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:     </tcg>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:   </features>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:   </cpu>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:   <devices>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/5b81046a-d6a2-412e-8f9a-2ab41e8fd991/disk.config"/>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:     </disk>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:     <disk type="block" device="disk">
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:       <alias name="ua-79578bb5-fcb4-42d4-891a-524f17a519d9"/>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-10"/>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:       <serial>79578bb5-fcb4-42d4-891a-524f17a519d9</serial>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:       <encryption format="luks">
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:         <secret type="passphrase" uuid="0580f35c-d003-4b05-a4ec-9588d040573b"/>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:       </encryption>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:     </disk>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:1c:a0:9a"/>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:       <target dev="tap87489626-7d"/>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:     </interface>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/5b81046a-d6a2-412e-8f9a-2ab41e8fd991/console.log" append="off"/>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:     </serial>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:     <video>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:     </video>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:     </rng>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:     </memballoon>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:   </devices>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]: </domain>
May 28 02:07:39.442413 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 02:07:39.444681 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Preparing to wait for external event network-vif-plugged-87489626-7d65-4bc9-bd0e-300688717b63 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 02:07:39.444681 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Acquiring lock "5b81046a-d6a2-412e-8f9a-2ab41e8fd991-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:07:39.444681 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "5b81046a-d6a2-412e-8f9a-2ab41e8fd991-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:07:39.444681 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "5b81046a-d6a2-412e-8f9a-2ab41e8fd991-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:07:39.444681 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:07:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1761756426',display_name='tempest-TestEncryptedCinderVolumes-server-1761756426',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testencryptedcindervolumes-server-1761756426',id=68,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBvIuscC5Hl9LuYYLq2wWivaHaebRNHPQIeYgqv7q1vZGG0QAw9Hdt3V++LObVUv3gsFUugch3GmPHbbfwH6piykof8GCWeT2LLzcMRX5UhzJRQuWby1FNbyksEPsTs9eg==',key_name='tempest-TestEncryptedCinderVolumes-1555008274',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7ada2896b1043bfb246c28ad9d1e174',ramdisk_id='',reservation_id='r-cw18en14',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1693604386',owner_user_name='tempest-TestEncryptedCinderVolumes-1693604386-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:07:32Z,user_data=None,user_id='2b5bf0f126624ddab4bd36a1b707899e',uuid=5b81046a-d6a2-412e-8f9a-2ab41e8fd991,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87489626-7d65-4bc9-bd0e-300688717b63", "address": "fa:16:3e:1c:a0:9a", "network": {"id": "ef15cd88-386f-4fc6-8df0-74267f73d3fb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1804869041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b7ada2896b1043bfb246c28ad9d1e174", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap87489626-7d", "ovs_interfaceid": "87489626-7d65-4bc9-bd0e-300688717b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 02:07:39.444681 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Converting VIF {"id": "87489626-7d65-4bc9-bd0e-300688717b63", "address": "fa:16:3e:1c:a0:9a", "network": {"id": "ef15cd88-386f-4fc6-8df0-74267f73d3fb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1804869041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b7ada2896b1043bfb246c28ad9d1e174", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap87489626-7d", "ovs_interfaceid": "87489626-7d65-4bc9-bd0e-300688717b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:07:39.444681 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:a0:9a,bridge_name='br-int',has_traffic_filtering=True,id=87489626-7d65-4bc9-bd0e-300688717b63,network=Network(ef15cd88-386f-4fc6-8df0-74267f73d3fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87489626-7d') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:07:39.444681 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:a0:9a,bridge_name='br-int',has_traffic_filtering=True,id=87489626-7d65-4bc9-bd0e-300688717b63,network=Network(ef15cd88-386f-4fc6-8df0-74267f73d3fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87489626-7d') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 02:07:39.444681 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:39.445118 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:07:39.445118 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 02:07:39.445638 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:39.445807 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3291be8d-7bda-5488-bccf-6256d0572e20', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:07:39.446553 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:39.447350 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:07:39.451454 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:39.453124 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:39.453291 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap87489626-7d, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:07:39.453623 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap87489626-7d, col_values=(('qos', UUID('96b47862-e425-4ea9-84d0-775aaffc7abb')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:07:39.453800 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap87489626-7d, col_values=(('external_ids', {'iface-id': '87489626-7d65-4bc9-bd0e-300688717b63', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:a0:9a', 'vm-uuid': '5b81046a-d6a2-412e-8f9a-2ab41e8fd991'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:07:39.454516 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:39.456027 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:07:39.464798 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:39.465964 np0000001583 nova-compute[98241]: INFO os_vif [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:a0:9a,bridge_name='br-int',has_traffic_filtering=True,id=87489626-7d65-4bc9-bd0e-300688717b63,network=Network(ef15cd88-386f-4fc6-8df0-74267f73d3fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87489626-7d')
May 28 02:07:39.486250 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999589156000184 future=<Future at 0x7724f851d760 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:07:39.486769 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.99921993099997 future=<Future at 0x7724f851d760 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:07:39.486908 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.998874601999887 future=<Future at 0x7724f851d760 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:07:39.489297 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Instance destroyed successfully.
May 28 02:07:39.489913 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lazy-loading 'resources' on Instance uuid e8bc20b7-8f2f-4226-9fcd-63c123604535 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:07:39.554450 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-cf6ea26d-b5b6-49be-a2df-ebeffd1ba7bb req-5c075b01-c2db-4439-9ecb-1fe73ddbe34c service nova] Releasing lock "refresh_cache-e8bc20b7-8f2f-4226-9fcd-63c123604535" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:07:39.698906 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:07:39.699323 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:07:39.699323 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:07:39.699323 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] No VIF found with MAC fa:16:3e:e5:ab:c0, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:07:39.992299 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T02:06:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-36597890',display_name='tempest-TestVolumeBootPattern-server-36597890',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testvolumebootpattern-server-36597890',id=66,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwh6E4i05I/O8lsE0bUEzocgUz6EHWmEWnV87akBvJyUZCaSgScF6CqBqpI/yb99Eh4gFmhgnyBDUzlF9t565ox0untLBipqeePS0CqQE7tD/Pd6ddczsNL4V+3d8XsQw==',key_name='tempest-TestVolumeBootPattern-1374779836',keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:06:58Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='432aa1094ced436494def17a875aa8e1',ramdisk_id='',reservation_id='r-9p6bosr0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1031057169',owner_user_name='tempest-TestVolumeBootPattern-1031057169-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T02:06:58Z,user_data=None,user_id='6be314b4eed642c3b2c72fe115860220',uuid=e8bc20b7-8f2f-4226-9fcd-63c123604535,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0", "address": "fa:16:3e:7c:9a:06", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2ddd1f1-c8", "ovs_interfaceid": "b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:07:39.992511 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converting VIF {"id": "b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0", "address": "fa:16:3e:7c:9a:06", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2ddd1f1-c8", "ovs_interfaceid": "b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:07:39.992930 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:9a:06,bridge_name='br-int',has_traffic_filtering=True,id=b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2ddd1f1-c8') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:07:39.993135 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:9a:06,bridge_name='br-int',has_traffic_filtering=True,id=b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2ddd1f1-c8') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:07:39.994155 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:39.994446 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb2ddd1f1-c8, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:07:39.995482 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:39.996150 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:07:40.001348 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:40.002393 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:40.002546 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fa281f53-e4a3-410f-a7cb-b16b561681ef) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:07:40.003056 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:40.003593 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:07:40.008174 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:40.010053 np0000001583 nova-compute[98241]: INFO os_vif [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:9a:06,bridge_name='br-int',has_traffic_filtering=True,id=b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2ddd1f1-c8')
May 28 02:07:40.011868 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:07:40.012214 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145', 'iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8bbe457d-aa5f-4e82-95e0-29d1ffc48145', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:07:40.012474 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:07:40.012891 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:07:40.013251 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145', 'iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8bbe457d-aa5f-4e82-95e0-29d1ffc48145', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:07:40.013426 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:07:40.041484 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:40.041484 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:40.041484 np0000001583 nova-compute[98241]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:07:40.041484 np0000001583 nova-compute[98241]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:07:40.041484 np0000001583 nova-compute[98241]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:07:40.041484 np0000001583 nova-compute[98241]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:07:40.041484 np0000001583 nova-compute[98241]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551 (non-flash)
May 28 02:07:40.041484 np0000001583 nova-compute[98241]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551 (non-flash)
May 28 02:07:40.041484 np0000001583 nova-compute[98241]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:07:40.041484 np0000001583 nova-compute[98241]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:07:40.041484 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:07:40.041839 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:40.041839 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:40.041839 np0000001583 nova-compute[98241]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:07:40.041839 np0000001583 nova-compute[98241]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145 (non-flash)
May 28 02:07:40.041839 np0000001583 nova-compute[98241]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:07:40.041839 np0000001583 nova-compute[98241]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:07:40.041839 np0000001583 nova-compute[98241]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551 (non-flash)
May 28 02:07:40.041839 np0000001583 nova-compute[98241]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551 (non-flash)
May 28 02:07:40.041839 np0000001583 nova-compute[98241]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:07:40.041839 np0000001583 nova-compute[98241]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:07:40.041839 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:07:40.041839 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa', '141'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa', '142'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145', '151'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145', '152'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d', '155'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d', '156'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551', '160'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551', '161'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9', '162'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9', '163')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:07:40.041839 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145', '151')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:07:40.042792 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145', '152')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:07:40.043580 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724ec25ee80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145'): ({'sdi'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:07:40.043747 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Removing multipathed devices sdh, sdi {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:07:40.043971 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Flush multipath device 3300000006fea8150 {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:07:40.094415 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:07:40.146596 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:07:40.193759 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:07:40.193929 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:07:40.195193 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:07:40.206345 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:07:40.206778 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:07:40.218478 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:07:40.250939 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 151, target: iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145, portal: 192.168.40.100,3260]
May 28 02:07:40.250939 np0000001583 nova-compute[98241]: Logout of [sid: 151, target: iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145, portal: 192.168.40.100,3260] successful.
May 28 02:07:40.250939 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:07:40.268873 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:07:40.280203 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:07:40.313339 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 152, target: iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145, portal: 192.168.50.100,3260]
May 28 02:07:40.313339 np0000001583 nova-compute[98241]: Logout of [sid: 152, target: iqn.2023-03.storpool.com:os--volume-8bbe457d-aa5f-4e82-95e0-29d1ffc48145, portal: 192.168.50.100,3260] successful.
May 28 02:07:40.313339 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:07:40.330705 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:07:40.330934 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:07:40.331066 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] <== disconnect_volume: return (318ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:07:40.331234 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:07:40.331586 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Deleting instance files /opt/stack/data/nova/instances/e8bc20b7-8f2f-4226-9fcd-63c123604535_del
May 28 02:07:40.332060 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Deletion of /opt/stack/data/nova/instances/e8bc20b7-8f2f-4226-9fcd-63c123604535_del complete
May 28 02:07:40.838470 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Took 1.66 seconds to destroy the instance on the hypervisor.
May 28 02:07:40.839234 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 02:07:40.839411 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 02:07:40.839614 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 02:07:40.839740 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:07:40.897745 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:07:40.981979 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:07:40.982168 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:07:40.982328 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] No VIF found with MAC fa:16:3e:1c:a0:9a, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:07:40.982941 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Using config drive
May 28 02:07:41.245289 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-24c9787c-6b19-47b0-979c-8f1a9dd3eddb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "c9bfbfaa-4d10-4c18-8ad9-0f115a757b60" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.761s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:07:41.400743 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-6bcb8c3a-830c-46d2-a800-adcfa84a5c84 req-7c55decf-c27e-4fcd-b467-269a79c2f273 service nova] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Received event network-vif-unplugged-b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:07:41.401211 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-6bcb8c3a-830c-46d2-a800-adcfa84a5c84 req-7c55decf-c27e-4fcd-b467-269a79c2f273 service nova] Acquiring lock "e8bc20b7-8f2f-4226-9fcd-63c123604535-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:07:41.401356 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-6bcb8c3a-830c-46d2-a800-adcfa84a5c84 req-7c55decf-c27e-4fcd-b467-269a79c2f273 service nova] Lock "e8bc20b7-8f2f-4226-9fcd-63c123604535-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:07:41.401454 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-6bcb8c3a-830c-46d2-a800-adcfa84a5c84 req-7c55decf-c27e-4fcd-b467-269a79c2f273 service nova] Lock "e8bc20b7-8f2f-4226-9fcd-63c123604535-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:07:41.401560 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-6bcb8c3a-830c-46d2-a800-adcfa84a5c84 req-7c55decf-c27e-4fcd-b467-269a79c2f273 service nova] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] No waiting events found dispatching network-vif-unplugged-b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:07:41.401657 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-6bcb8c3a-830c-46d2-a800-adcfa84a5c84 req-7c55decf-c27e-4fcd-b467-269a79c2f273 service nova] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Received event network-vif-unplugged-b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:07:41.401767 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-6bcb8c3a-830c-46d2-a800-adcfa84a5c84 req-7c55decf-c27e-4fcd-b467-269a79c2f273 service nova] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Received event network-vif-deleted-b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:07:41.402032 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-6bcb8c3a-830c-46d2-a800-adcfa84a5c84 req-7c55decf-c27e-4fcd-b467-269a79c2f273 service nova] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Neutron deleted interface b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0; detaching it from the instance and deleting it from the info cache
May 28 02:07:41.404158 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-6bcb8c3a-830c-46d2-a800-adcfa84a5c84 req-7c55decf-c27e-4fcd-b467-269a79c2f273 service nova] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Detach interface failed, port_id=b2ddd1f1-c8f0-4c73-b626-b64fef78c5d0, reason: Instance e8bc20b7-8f2f-4226-9fcd-63c123604535 could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 02:07:41.488465 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:07:41.611555 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0a06484d-ee73-4ec8-ab7a-88c424bea86c tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "c9bfbfaa-4d10-4c18-8ad9-0f115a757b60" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:07:41.612032 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:07:41.613285 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0a06484d-ee73-4ec8-ab7a-88c424bea86c tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "c9bfbfaa-4d10-4c18-8ad9-0f115a757b60" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:07:41.619818 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Creating config drive at /opt/stack/data/nova/instances/5b81046a-d6a2-412e-8f9a-2ab41e8fd991/disk.config
May 28 02:07:41.624463 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5b81046a-d6a2-412e-8f9a-2ab41e8fd991/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzl0x8om4 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:07:41.681095 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5b81046a-d6a2-412e-8f9a-2ab41e8fd991/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzl0x8om4" returned: 0 in 0.056s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:07:42.068779 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:42.088280 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:42.089324 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:42.115420 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Took 1.28 seconds to deallocate network for instance.
May 28 02:07:42.118779 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-0a06484d-ee73-4ec8-ab7a-88c424bea86c tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Detaching volume 2d31cad7-323d-4fcb-bc86-dc315c46f551
May 28 02:07:42.171841 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-0a06484d-ee73-4ec8-ab7a-88c424bea86c tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Attempting to driver detach volume 2d31cad7-323d-4fcb-bc86-dc315c46f551 from mountpoint /dev/vdb
May 28 02:07:42.178374 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:42.209029 np0000001583 nova-compute[98241]: DEBUG os_brick.encryptors [None req-0a06484d-ee73-4ec8-ab7a-88c424bea86c tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551', 'iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2d31cad7-323d-4fcb-bc86-dc315c46f551', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-9'}, 'status': 'reserved', 'instance': 'c9bfbfaa-4d10-4c18-8ad9-0f115a757b60', 'attached_at': '', 'detached_at': '', 'volume_id': '2d31cad7-323d-4fcb-bc86-dc315c46f551', 'serial': '2d31cad7-323d-4fcb-bc86-dc315c46f551'} {{(pid=98241) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 02:07:42.216891 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0a06484d-ee73-4ec8-ab7a-88c424bea86c tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Found disk vdb by alias ua-2d31cad7-323d-4fcb-bc86-dc315c46f551 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:07:42.219362 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0a06484d-ee73-4ec8-ab7a-88c424bea86c tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Found disk vdb by alias ua-2d31cad7-323d-4fcb-bc86-dc315c46f551 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:07:42.219527 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0a06484d-ee73-4ec8-ab7a-88c424bea86c tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Attempting to detach device vdb from instance c9bfbfaa-4d10-4c18-8ad9-0f115a757b60 from the persistent domain config. {{(pid=98241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 02:07:42.219892 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-0a06484d-ee73-4ec8-ab7a-88c424bea86c tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:07:42.219892 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:07:42.219892 np0000001583 nova-compute[98241]:   <alias name="ua-2d31cad7-323d-4fcb-bc86-dc315c46f551"/>
May 28 02:07:42.219892 np0000001583 nova-compute[98241]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-9"/>
May 28 02:07:42.219892 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:07:42.219892 np0000001583 nova-compute[98241]:   <serial>2d31cad7-323d-4fcb-bc86-dc315c46f551</serial>
May 28 02:07:42.219892 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 02:07:42.219892 np0000001583 nova-compute[98241]:   <encryption format="luks">
May 28 02:07:42.219892 np0000001583 nova-compute[98241]:     <secret type="passphrase" uuid="d766071d-7f7a-43ed-8d1f-1ddd930fc62f"/>
May 28 02:07:42.219892 np0000001583 nova-compute[98241]:   </encryption>
May 28 02:07:42.219892 np0000001583 nova-compute[98241]: </disk>
May 28 02:07:42.219892 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:07:42.227102 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-0a06484d-ee73-4ec8-ab7a-88c424bea86c tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Successfully detached device vdb from instance c9bfbfaa-4d10-4c18-8ad9-0f115a757b60 from the persistent domain config.
May 28 02:07:42.227334 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0a06484d-ee73-4ec8-ab7a-88c424bea86c tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] (1/8): Attempting to detach device vdb with device alias ua-2d31cad7-323d-4fcb-bc86-dc315c46f551 from instance c9bfbfaa-4d10-4c18-8ad9-0f115a757b60 from the live domain config. {{(pid=98241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 02:07:42.227598 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-0a06484d-ee73-4ec8-ab7a-88c424bea86c tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:07:42.227598 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:07:42.227598 np0000001583 nova-compute[98241]:   <alias name="ua-2d31cad7-323d-4fcb-bc86-dc315c46f551"/>
May 28 02:07:42.227598 np0000001583 nova-compute[98241]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-9"/>
May 28 02:07:42.227598 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:07:42.227598 np0000001583 nova-compute[98241]:   <serial>2d31cad7-323d-4fcb-bc86-dc315c46f551</serial>
May 28 02:07:42.227598 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 02:07:42.227598 np0000001583 nova-compute[98241]:   <encryption format="luks">
May 28 02:07:42.227598 np0000001583 nova-compute[98241]:     <secret type="passphrase" uuid="d766071d-7f7a-43ed-8d1f-1ddd930fc62f"/>
May 28 02:07:42.227598 np0000001583 nova-compute[98241]:   </encryption>
May 28 02:07:42.227598 np0000001583 nova-compute[98241]: </disk>
May 28 02:07:42.227598 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:07:42.246691 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-551b5b31-02e7-49d7-88a1-880a9de9dc48 req-470c9bae-6836-44bd-8414-10cc12f2d233 service nova] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Received event network-vif-plugged-87489626-7d65-4bc9-bd0e-300688717b63 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:07:42.246970 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-551b5b31-02e7-49d7-88a1-880a9de9dc48 req-470c9bae-6836-44bd-8414-10cc12f2d233 service nova] Acquiring lock "5b81046a-d6a2-412e-8f9a-2ab41e8fd991-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:07:42.247203 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-551b5b31-02e7-49d7-88a1-880a9de9dc48 req-470c9bae-6836-44bd-8414-10cc12f2d233 service nova] Lock "5b81046a-d6a2-412e-8f9a-2ab41e8fd991-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:07:42.247402 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-551b5b31-02e7-49d7-88a1-880a9de9dc48 req-470c9bae-6836-44bd-8414-10cc12f2d233 service nova] Lock "5b81046a-d6a2-412e-8f9a-2ab41e8fd991-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:07:42.247563 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-551b5b31-02e7-49d7-88a1-880a9de9dc48 req-470c9bae-6836-44bd-8414-10cc12f2d233 service nova] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Processing event network-vif-plugged-87489626-7d65-4bc9-bd0e-300688717b63 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 02:07:42.394471 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:42.397251 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:42.401713 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:42.425943 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:42.678262 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Took 0.56 seconds to detach 1 volumes for instance.
May 28 02:07:42.696769 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Received event <DeviceRemovedEvent: 1779934062.6963959, c9bfbfaa-4d10-4c18-8ad9-0f115a757b60 => ua-2d31cad7-323d-4fcb-bc86-dc315c46f551> from libvirt while the driver is waiting for it; dispatched. {{(pid=98241) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 02:07:42.698666 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0a06484d-ee73-4ec8-ab7a-88c424bea86c tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-2d31cad7-323d-4fcb-bc86-dc315c46f551 for instance c9bfbfaa-4d10-4c18-8ad9-0f115a757b60 {{(pid=98241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 02:07:42.705197 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-0a06484d-ee73-4ec8-ab7a-88c424bea86c tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Successfully detached device vdb from instance c9bfbfaa-4d10-4c18-8ad9-0f115a757b60 from the live domain config.
May 28 02:07:42.713607 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a06484d-ee73-4ec8-ab7a-88c424bea86c tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:07:42.714059 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a06484d-ee73-4ec8-ab7a-88c424bea86c tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551', 'iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2d31cad7-323d-4fcb-bc86-dc315c46f551', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-9'}, None), 'kwargs': {'force': False}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:07:42.714270 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-0a06484d-ee73-4ec8-ab7a-88c424bea86c tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:07:42.714722 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-0a06484d-ee73-4ec8-ab7a-88c424bea86c tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:07:42.715159 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a06484d-ee73-4ec8-ab7a-88c424bea86c tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551', 'iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2d31cad7-323d-4fcb-bc86-dc315c46f551', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:07:42.716109 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a06484d-ee73-4ec8-ab7a-88c424bea86c tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:07:42.747375 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a06484d-ee73-4ec8-ab7a-88c424bea86c tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:42.747375 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:42.747375 np0000001583 nova-compute[98241]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:07:42.747375 np0000001583 nova-compute[98241]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:07:42.747375 np0000001583 nova-compute[98241]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551 (non-flash)
May 28 02:07:42.747375 np0000001583 nova-compute[98241]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551 (non-flash)
May 28 02:07:42.747375 np0000001583 nova-compute[98241]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:07:42.747375 np0000001583 nova-compute[98241]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:07:42.747375 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:07:42.747635 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a06484d-ee73-4ec8-ab7a-88c424bea86c tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsi session list stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:42.747635 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:42.747635 np0000001583 nova-compute[98241]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:07:42.747635 np0000001583 nova-compute[98241]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:07:42.747635 np0000001583 nova-compute[98241]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551 (non-flash)
May 28 02:07:42.747635 np0000001583 nova-compute[98241]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551 (non-flash)
May 28 02:07:42.747635 np0000001583 nova-compute[98241]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:07:42.747635 np0000001583 nova-compute[98241]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:07:42.747635 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:07:42.747895 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a06484d-ee73-4ec8-ab7a-88c424bea86c tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa', '141'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa', '142'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d', '155'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d', '156'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551', '160'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551', '161'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9', '162'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9', '163')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:07:42.747895 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a06484d-ee73-4ec8-ab7a-88c424bea86c tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551', '161')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:07:42.749039 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a06484d-ee73-4ec8-ab7a-88c424bea86c tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551', '160')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:07:42.749998 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a06484d-ee73-4ec8-ab7a-88c424bea86c tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f839aca0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551'): ({'sdf'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:07:42.750227 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-0a06484d-ee73-4ec8-ab7a-88c424bea86c tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Removing multipathed devices sdf, sdg {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:07:42.750488 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-0a06484d-ee73-4ec8-ab7a-88c424bea86c tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Flush multipath device 330000000a4273aff {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:07:42.790503 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-0a06484d-ee73-4ec8-ab7a-88c424bea86c tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:07:42.830896 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-0a06484d-ee73-4ec8-ab7a-88c424bea86c tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:07:42.888324 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-0a06484d-ee73-4ec8-ab7a-88c424bea86c tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:07:42.888455 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-0a06484d-ee73-4ec8-ab7a-88c424bea86c tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:07:42.889740 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-0a06484d-ee73-4ec8-ab7a-88c424bea86c tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:07:42.903681 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-0a06484d-ee73-4ec8-ab7a-88c424bea86c tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:07:42.903924 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a06484d-ee73-4ec8-ab7a-88c424bea86c tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:07:42.914737 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a06484d-ee73-4ec8-ab7a-88c424bea86c tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:07:42.947159 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a06484d-ee73-4ec8-ab7a-88c424bea86c tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 161, target: iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551, portal: 192.168.40.100,3260]
May 28 02:07:42.947159 np0000001583 nova-compute[98241]: Logout of [sid: 161, target: iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551, portal: 192.168.40.100,3260] successful.
May 28 02:07:42.947159 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:07:42.967299 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a06484d-ee73-4ec8-ab7a-88c424bea86c tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:07:42.980978 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a06484d-ee73-4ec8-ab7a-88c424bea86c tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:07:43.006414 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a06484d-ee73-4ec8-ab7a-88c424bea86c tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 160, target: iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551, portal: 192.168.50.100,3260]
May 28 02:07:43.006414 np0000001583 nova-compute[98241]: Logout of [sid: 160, target: iqn.2023-03.storpool.com:os--volume-2d31cad7-323d-4fcb-bc86-dc315c46f551, portal: 192.168.50.100,3260] successful.
May 28 02:07:43.006414 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:07:43.025722 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a06484d-ee73-4ec8-ab7a-88c424bea86c tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:07:43.026582 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-0a06484d-ee73-4ec8-ab7a-88c424bea86c tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:07:43.026687 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a06484d-ee73-4ec8-ab7a-88c424bea86c tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] <== disconnect_volume: return (312ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:07:43.026805 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a06484d-ee73-4ec8-ab7a-88c424bea86c tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:07:43.186197 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:07:43.186698 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:07:43.476407 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:07:43.476630 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:07:43.533089 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:43.571336 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-0a06484d-ee73-4ec8-ab7a-88c424bea86c tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lazy-loading 'flavor' on Instance uuid c9bfbfaa-4d10-4c18-8ad9-0f115a757b60 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:07:43.699368 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934063.698939, 5b81046a-d6a2-412e-8f9a-2ab41e8fd991 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:07:43.699655 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 02:07:43.699851 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] VM Started (Lifecycle Event)
May 28 02:07:43.704095 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 02:07:43.705392 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Instance spawned successfully.
May 28 02:07:43.705699 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 02:07:43.979623 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:07:44.202024 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:07:44.204294 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:07:44.214283 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:07:44.214283 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:07:44.214283 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:07:44.214873 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:07:44.215373 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:07:44.215876 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:07:44.328288 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-4c4cca92-3648-4cd5-848b-8fd8e240dd70 req-4350a84b-b0a5-427d-8b5a-b0809807a7ff service nova] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Received event network-vif-plugged-87489626-7d65-4bc9-bd0e-300688717b63 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:07:44.328505 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-4c4cca92-3648-4cd5-848b-8fd8e240dd70 req-4350a84b-b0a5-427d-8b5a-b0809807a7ff service nova] Acquiring lock "5b81046a-d6a2-412e-8f9a-2ab41e8fd991-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:07:44.328958 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-4c4cca92-3648-4cd5-848b-8fd8e240dd70 req-4350a84b-b0a5-427d-8b5a-b0809807a7ff service nova] Lock "5b81046a-d6a2-412e-8f9a-2ab41e8fd991-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:07:44.330148 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-4c4cca92-3648-4cd5-848b-8fd8e240dd70 req-4350a84b-b0a5-427d-8b5a-b0809807a7ff service nova] Lock "5b81046a-d6a2-412e-8f9a-2ab41e8fd991-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:07:44.330148 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-4c4cca92-3648-4cd5-848b-8fd8e240dd70 req-4350a84b-b0a5-427d-8b5a-b0809807a7ff service nova] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] No waiting events found dispatching network-vif-plugged-87489626-7d65-4bc9-bd0e-300688717b63 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:07:44.330148 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-4c4cca92-3648-4cd5-848b-8fd8e240dd70 req-4350a84b-b0a5-427d-8b5a-b0809807a7ff service nova] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Received unexpected event network-vif-plugged-87489626-7d65-4bc9-bd0e-300688717b63 for instance with vm_state building and task_state spawning.
May 28 02:07:44.485791 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.299s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:07:44.550487 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Deleted allocations for instance e8bc20b7-8f2f-4226-9fcd-63c123604535
May 28 02:07:44.578315 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0a06484d-ee73-4ec8-ab7a-88c424bea86c tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "c9bfbfaa-4d10-4c18-8ad9-0f115a757b60" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.966s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:07:44.706364 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 02:07:44.706574 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934064.7064233, 5b81046a-d6a2-412e-8f9a-2ab41e8fd991 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:07:44.706665 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] VM Paused (Lifecycle Event)
May 28 02:07:44.721561 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Took 9.63 seconds to spawn the instance on the hypervisor.
May 28 02:07:44.721731 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:07:44.934411 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0816934c-1a4d-4689-8ac2-1f82ff16b6af tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "c9bfbfaa-4d10-4c18-8ad9-0f115a757b60" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:07:44.934411 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0816934c-1a4d-4689-8ac2-1f82ff16b6af tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "c9bfbfaa-4d10-4c18-8ad9-0f115a757b60" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:07:44.934411 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0816934c-1a4d-4689-8ac2-1f82ff16b6af tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "c9bfbfaa-4d10-4c18-8ad9-0f115a757b60-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:07:44.934411 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0816934c-1a4d-4689-8ac2-1f82ff16b6af tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "c9bfbfaa-4d10-4c18-8ad9-0f115a757b60-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:07:44.934411 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0816934c-1a4d-4689-8ac2-1f82ff16b6af tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "c9bfbfaa-4d10-4c18-8ad9-0f115a757b60-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:07:44.936067 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-0816934c-1a4d-4689-8ac2-1f82ff16b6af tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Terminating instance
May 28 02:07:45.003633 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:45.210863 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:07:45.214686 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934065.2144835, 5b81046a-d6a2-412e-8f9a-2ab41e8fd991 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:07:45.214827 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] VM Resumed (Lifecycle Event)
May 28 02:07:45.230280 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Took 16.79 seconds to build instance.
May 28 02:07:45.440706 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-0816934c-1a4d-4689-8ac2-1f82ff16b6af tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 02:07:45.462197 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:45.479533 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:45.482856 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:45.507153 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:45.564973 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0b5864db-5a34-4d2f-a725-7ba9a5c9df30 tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "e8bc20b7-8f2f-4226-9fcd-63c123604535" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.897s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:07:45.717358 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:07:45.727552 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:07:45.731527 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "5b81046a-d6a2-412e-8f9a-2ab41e8fd991" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.298s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:07:45.752311 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:45.761264 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:45.786259 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Instance destroyed successfully.
May 28 02:07:45.786815 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-0816934c-1a4d-4689-8ac2-1f82ff16b6af tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lazy-loading 'resources' on Instance uuid c9bfbfaa-4d10-4c18-8ad9-0f115a757b60 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:07:46.230901 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.99970486400025 future=<Future at 0x7724f8724fe0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:07:46.294516 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-0816934c-1a4d-4689-8ac2-1f82ff16b6af tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T02:06:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1300175185',display_name='tempest-TestEncryptedCinderVolumes-server-1300175185',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testencryptedcindervolumes-server-1300175185',id=65,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9e7modxscTnBCqXHqkkmGwoeokYFlHeKUWFdzSHoD4fgXOAVTmmbP/yM1n7tCbsxammjaihp376sPCILbjop0hqjRnmPT5drh/c3gnmHwQQDNtSyIFY2rmYixFoKe3xg==',key_name='tempest-keypair-1897192669',keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:06:47Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d192b18567fd4735988dd19da06fb868',ramdisk_id='',reservation_id='r-qkeutkcn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-243696963',owner_user_name='tempest-TestEncryptedCinderVolumes-243696963-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T02:06:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f09c9f1da7e4d32979e47c96d41ae99',uuid=c9bfbfaa-4d10-4c18-8ad9-0f115a757b60,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69995ecd-0071-47d1-8844-2a23a5274ec6", "address": "fa:16:3e:e5:ab:c0", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap69995ecd-00", "ovs_interfaceid": "69995ecd-0071-47d1-8844-2a23a5274ec6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:07:46.294516 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-0816934c-1a4d-4689-8ac2-1f82ff16b6af tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Converting VIF {"id": "69995ecd-0071-47d1-8844-2a23a5274ec6", "address": "fa:16:3e:e5:ab:c0", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap69995ecd-00", "ovs_interfaceid": "69995ecd-0071-47d1-8844-2a23a5274ec6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:07:46.294516 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-0816934c-1a4d-4689-8ac2-1f82ff16b6af tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:ab:c0,bridge_name='br-int',has_traffic_filtering=True,id=69995ecd-0071-47d1-8844-2a23a5274ec6,network=Network(fccbc55c-a449-42c3-bf68-d3d337f7b0ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69995ecd-00') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:07:46.294516 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-0816934c-1a4d-4689-8ac2-1f82ff16b6af tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:ab:c0,bridge_name='br-int',has_traffic_filtering=True,id=69995ecd-0071-47d1-8844-2a23a5274ec6,network=Network(fccbc55c-a449-42c3-bf68-d3d337f7b0ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69995ecd-00') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:07:46.295365 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:46.295552 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69995ecd-00, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:07:46.300244 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:46.301089 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:07:46.301666 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:46.301797 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dddae1cf-dfd6-4415-b644-5bee79a02197) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:07:46.302334 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:46.302629 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:07:46.302959 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:46.308796 np0000001583 nova-compute[98241]: INFO os_vif [None req-0816934c-1a4d-4689-8ac2-1f82ff16b6af tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:ab:c0,bridge_name='br-int',has_traffic_filtering=True,id=69995ecd-0071-47d1-8844-2a23a5274ec6,network=Network(fccbc55c-a449-42c3-bf68-d3d337f7b0ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69995ecd-00')
May 28 02:07:46.308796 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-0816934c-1a4d-4689-8ac2-1f82ff16b6af tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Deleting instance files /opt/stack/data/nova/instances/c9bfbfaa-4d10-4c18-8ad9-0f115a757b60_del
May 28 02:07:46.308796 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-0816934c-1a4d-4689-8ac2-1f82ff16b6af tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Deletion of /opt/stack/data/nova/instances/c9bfbfaa-4d10-4c18-8ad9-0f115a757b60_del complete
May 28 02:07:46.396942 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-c7eb9f54-ca4a-494c-9c8b-3bc3133ff2ff req-918b703e-b398-425e-b145-fcc6de80c5ac service nova] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Received event network-vif-unplugged-69995ecd-0071-47d1-8844-2a23a5274ec6 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:07:46.397700 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c7eb9f54-ca4a-494c-9c8b-3bc3133ff2ff req-918b703e-b398-425e-b145-fcc6de80c5ac service nova] Acquiring lock "c9bfbfaa-4d10-4c18-8ad9-0f115a757b60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:07:46.397700 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c7eb9f54-ca4a-494c-9c8b-3bc3133ff2ff req-918b703e-b398-425e-b145-fcc6de80c5ac service nova] Lock "c9bfbfaa-4d10-4c18-8ad9-0f115a757b60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:07:46.399606 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c7eb9f54-ca4a-494c-9c8b-3bc3133ff2ff req-918b703e-b398-425e-b145-fcc6de80c5ac service nova] Lock "c9bfbfaa-4d10-4c18-8ad9-0f115a757b60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:07:46.399606 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-c7eb9f54-ca4a-494c-9c8b-3bc3133ff2ff req-918b703e-b398-425e-b145-fcc6de80c5ac service nova] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] No waiting events found dispatching network-vif-unplugged-69995ecd-0071-47d1-8844-2a23a5274ec6 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:07:46.399606 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-c7eb9f54-ca4a-494c-9c8b-3bc3133ff2ff req-918b703e-b398-425e-b145-fcc6de80c5ac service nova] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Received event network-vif-unplugged-69995ecd-0071-47d1-8844-2a23a5274ec6 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:07:46.399606 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-c7eb9f54-ca4a-494c-9c8b-3bc3133ff2ff req-918b703e-b398-425e-b145-fcc6de80c5ac service nova] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Received event network-vif-unplugged-69995ecd-0071-47d1-8844-2a23a5274ec6 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:07:46.399606 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c7eb9f54-ca4a-494c-9c8b-3bc3133ff2ff req-918b703e-b398-425e-b145-fcc6de80c5ac service nova] Acquiring lock "c9bfbfaa-4d10-4c18-8ad9-0f115a757b60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:07:46.399606 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c7eb9f54-ca4a-494c-9c8b-3bc3133ff2ff req-918b703e-b398-425e-b145-fcc6de80c5ac service nova] Lock "c9bfbfaa-4d10-4c18-8ad9-0f115a757b60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:07:46.399606 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c7eb9f54-ca4a-494c-9c8b-3bc3133ff2ff req-918b703e-b398-425e-b145-fcc6de80c5ac service nova] Lock "c9bfbfaa-4d10-4c18-8ad9-0f115a757b60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:07:46.399606 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-c7eb9f54-ca4a-494c-9c8b-3bc3133ff2ff req-918b703e-b398-425e-b145-fcc6de80c5ac service nova] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] No waiting events found dispatching network-vif-unplugged-69995ecd-0071-47d1-8844-2a23a5274ec6 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:07:46.399606 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-c7eb9f54-ca4a-494c-9c8b-3bc3133ff2ff req-918b703e-b398-425e-b145-fcc6de80c5ac service nova] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Received event network-vif-unplugged-69995ecd-0071-47d1-8844-2a23a5274ec6 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:07:46.813388 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-0816934c-1a4d-4689-8ac2-1f82ff16b6af tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Took 1.37 seconds to destroy the instance on the hypervisor.
May 28 02:07:46.813718 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-0816934c-1a4d-4689-8ac2-1f82ff16b6af tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 02:07:46.813967 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 02:07:46.814071 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 02:07:46.814328 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:07:46.901158 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:07:47.455853 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-15cdd413-0ff7-43f3-ae1d-abede8e6c0b7 req-99056a05-0127-4830-b1c8-60e796f91075 service nova] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Received event network-changed-87489626-7d65-4bc9-bd0e-300688717b63 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:07:47.456224 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-15cdd413-0ff7-43f3-ae1d-abede8e6c0b7 req-99056a05-0127-4830-b1c8-60e796f91075 service nova] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Refreshing instance network info cache due to event network-changed-87489626-7d65-4bc9-bd0e-300688717b63. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:07:47.456317 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-15cdd413-0ff7-43f3-ae1d-abede8e6c0b7 req-99056a05-0127-4830-b1c8-60e796f91075 service nova] Acquiring lock "refresh_cache-5b81046a-d6a2-412e-8f9a-2ab41e8fd991" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:07:47.456383 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-15cdd413-0ff7-43f3-ae1d-abede8e6c0b7 req-99056a05-0127-4830-b1c8-60e796f91075 service nova] Acquired lock "refresh_cache-5b81046a-d6a2-412e-8f9a-2ab41e8fd991" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:07:47.456493 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-15cdd413-0ff7-43f3-ae1d-abede8e6c0b7 req-99056a05-0127-4830-b1c8-60e796f91075 service nova] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Refreshing network info cache for port 87489626-7d65-4bc9-bd0e-300688717b63 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:07:47.910744 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:07:47.958337 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-15cdd413-0ff7-43f3-ae1d-abede8e6c0b7 req-99056a05-0127-4830-b1c8-60e796f91075 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:07:48.257003 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-15cdd413-0ff7-43f3-ae1d-abede8e6c0b7 req-99056a05-0127-4830-b1c8-60e796f91075 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:07:48.410258 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-15cdd413-0ff7-43f3-ae1d-abede8e6c0b7 req-99056a05-0127-4830-b1c8-60e796f91075 service nova] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Updated VIF entry in instance network info cache for port 87489626-7d65-4bc9-bd0e-300688717b63. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:07:48.410258 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-15cdd413-0ff7-43f3-ae1d-abede8e6c0b7 req-99056a05-0127-4830-b1c8-60e796f91075 service nova] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Updating instance_info_cache with network_info: [{"id": "87489626-7d65-4bc9-bd0e-300688717b63", "address": "fa:16:3e:1c:a0:9a", "network": {"id": "ef15cd88-386f-4fc6-8df0-74267f73d3fb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1804869041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b7ada2896b1043bfb246c28ad9d1e174", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap87489626-7d", "ovs_interfaceid": "87489626-7d65-4bc9-bd0e-300688717b63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:07:48.412645 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Took 1.60 seconds to deallocate network for instance.
May 28 02:07:48.491935 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-8bbcb3a4-2fc1-4cfe-8f7d-3206263eeb67 req-6706da59-9014-43f3-8c61-0a2a1b1568f8 service nova] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Received event network-vif-deleted-69995ecd-0071-47d1-8844-2a23a5274ec6 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:07:48.534977 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:48.912909 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-15cdd413-0ff7-43f3-ae1d-abede8e6c0b7 req-99056a05-0127-4830-b1c8-60e796f91075 service nova] Releasing lock "refresh_cache-5b81046a-d6a2-412e-8f9a-2ab41e8fd991" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:07:48.922106 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0816934c-1a4d-4689-8ac2-1f82ff16b6af tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:07:48.922390 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0816934c-1a4d-4689-8ac2-1f82ff16b6af tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:07:49.172338 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0816934c-1a4d-4689-8ac2-1f82ff16b6af tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:07:49.172509 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-0816934c-1a4d-4689-8ac2-1f82ff16b6af tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:07:49.206515 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "39ea2f26-6a01-4d24-a2b3-d681e0b22d80" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:07:49.206655 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "39ea2f26-6a01-4d24-a2b3-d681e0b22d80" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:07:49.207390 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "39ea2f26-6a01-4d24-a2b3-d681e0b22d80-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:07:49.207390 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "39ea2f26-6a01-4d24-a2b3-d681e0b22d80-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:07:49.207390 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "39ea2f26-6a01-4d24-a2b3-d681e0b22d80-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:07:49.210567 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Terminating instance
May 28 02:07:49.522318 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-1cb926e3-2252-49e4-9828-1d1626d3d900 req-cee175c0-04ac-436c-8042-59211457dd41 service nova] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Received event network-changed-0479db3d-2d90-4116-b8e7-b1282c111d9b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:07:49.522772 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-1cb926e3-2252-49e4-9828-1d1626d3d900 req-cee175c0-04ac-436c-8042-59211457dd41 service nova] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Refreshing instance network info cache due to event network-changed-0479db3d-2d90-4116-b8e7-b1282c111d9b. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:07:49.522772 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-1cb926e3-2252-49e4-9828-1d1626d3d900 req-cee175c0-04ac-436c-8042-59211457dd41 service nova] Acquiring lock "refresh_cache-39ea2f26-6a01-4d24-a2b3-d681e0b22d80" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:07:49.522888 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-1cb926e3-2252-49e4-9828-1d1626d3d900 req-cee175c0-04ac-436c-8042-59211457dd41 service nova] Acquired lock "refresh_cache-39ea2f26-6a01-4d24-a2b3-d681e0b22d80" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:07:49.522888 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-1cb926e3-2252-49e4-9828-1d1626d3d900 req-cee175c0-04ac-436c-8042-59211457dd41 service nova] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Refreshing network info cache for port 0479db3d-2d90-4116-b8e7-b1282c111d9b {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:07:49.674926 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-0816934c-1a4d-4689-8ac2-1f82ff16b6af tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:07:49.711782 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 02:07:49.729301 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:49.732793 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:49.748655 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:49.752032 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:49.776321 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:49.777329 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:49.896781 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-66eb3b97-4600-432b-b67f-a9b1169c3269 req-b2f00538-81a6-42a0-a111-539b62a04582 service nova] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Received event network-vif-unplugged-0479db3d-2d90-4116-b8e7-b1282c111d9b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:07:49.897273 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-66eb3b97-4600-432b-b67f-a9b1169c3269 req-b2f00538-81a6-42a0-a111-539b62a04582 service nova] Acquiring lock "39ea2f26-6a01-4d24-a2b3-d681e0b22d80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:07:49.897468 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-66eb3b97-4600-432b-b67f-a9b1169c3269 req-b2f00538-81a6-42a0-a111-539b62a04582 service nova] Lock "39ea2f26-6a01-4d24-a2b3-d681e0b22d80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:07:49.897614 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-66eb3b97-4600-432b-b67f-a9b1169c3269 req-b2f00538-81a6-42a0-a111-539b62a04582 service nova] Lock "39ea2f26-6a01-4d24-a2b3-d681e0b22d80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:07:49.897757 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-66eb3b97-4600-432b-b67f-a9b1169c3269 req-b2f00538-81a6-42a0-a111-539b62a04582 service nova] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] No waiting events found dispatching network-vif-unplugged-0479db3d-2d90-4116-b8e7-b1282c111d9b {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:07:49.897885 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-66eb3b97-4600-432b-b67f-a9b1169c3269 req-b2f00538-81a6-42a0-a111-539b62a04582 service nova] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Received event network-vif-unplugged-0479db3d-2d90-4116-b8e7-b1282c111d9b for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:07:50.020350 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:50.027839 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:50.032123 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-1cb926e3-2252-49e4-9828-1d1626d3d900 req-cee175c0-04ac-436c-8042-59211457dd41 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:07:50.045619 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.99942208199991 future=<Future at 0x7724f82bd130 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:07:50.050758 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Instance destroyed successfully.
May 28 02:07:50.051359 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lazy-loading 'resources' on Instance uuid 39ea2f26-6a01-4d24-a2b3-d681e0b22d80 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:07:50.185431 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0816934c-1a4d-4689-8ac2-1f82ff16b6af tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.263s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:07:50.248290 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-0816934c-1a4d-4689-8ac2-1f82ff16b6af tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Deleted allocations for instance c9bfbfaa-4d10-4c18-8ad9-0f115a757b60
May 28 02:07:50.361620 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-1cb926e3-2252-49e4-9828-1d1626d3d900 req-cee175c0-04ac-436c-8042-59211457dd41 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:07:50.495434 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-1cb926e3-2252-49e4-9828-1d1626d3d900 req-cee175c0-04ac-436c-8042-59211457dd41 service nova] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Updated VIF entry in instance network info cache for port 0479db3d-2d90-4116-b8e7-b1282c111d9b. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:07:50.495692 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-1cb926e3-2252-49e4-9828-1d1626d3d900 req-cee175c0-04ac-436c-8042-59211457dd41 service nova] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Updating instance_info_cache with network_info: [{"id": "0479db3d-2d90-4116-b8e7-b1282c111d9b", "address": "fa:16:3e:9c:a6:6d", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0479db3d-2d", "ovs_interfaceid": "0479db3d-2d90-4116-b8e7-b1282c111d9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:07:50.555444 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T02:05:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-801974265',display_name='tempest-TestVolumeBootPattern-server-801974265',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testvolumebootpattern-server-801974265',id=62,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwh6E4i05I/O8lsE0bUEzocgUz6EHWmEWnV87akBvJyUZCaSgScF6CqBqpI/yb99Eh4gFmhgnyBDUzlF9t565ox0untLBipqeePS0CqQE7tD/Pd6ddczsNL4V+3d8XsQw==',key_name='tempest-TestVolumeBootPattern-1374779836',keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:05:57Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='432aa1094ced436494def17a875aa8e1',ramdisk_id='',reservation_id='r-1uocswld',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1031057169',owner_user_name='tempest-TestVolumeBootPattern-1031057169-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T02:05:57Z,user_data=None,user_id='6be314b4eed642c3b2c72fe115860220',uuid=39ea2f26-6a01-4d24-a2b3-d681e0b22d80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0479db3d-2d90-4116-b8e7-b1282c111d9b", "address": "fa:16:3e:9c:a6:6d", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0479db3d-2d", "ovs_interfaceid": "0479db3d-2d90-4116-b8e7-b1282c111d9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:07:50.558863 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converting VIF {"id": "0479db3d-2d90-4116-b8e7-b1282c111d9b", "address": "fa:16:3e:9c:a6:6d", "network": {"id": "e05d2eb8-588f-4448-b95d-ac20e0e06e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1483116425-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "432aa1094ced436494def17a875aa8e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0479db3d-2d", "ovs_interfaceid": "0479db3d-2d90-4116-b8e7-b1282c111d9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:07:50.558863 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:a6:6d,bridge_name='br-int',has_traffic_filtering=True,id=0479db3d-2d90-4116-b8e7-b1282c111d9b,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0479db3d-2d') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:07:50.558863 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:a6:6d,bridge_name='br-int',has_traffic_filtering=True,id=0479db3d-2d90-4116-b8e7-b1282c111d9b,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0479db3d-2d') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:07:50.561134 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:50.561134 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0479db3d-2d, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:07:50.561490 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:50.562741 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:07:50.564221 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:50.564221 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=591faa3d-a918-4e84-812f-364dd27f0455) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:07:50.564941 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:50.565681 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:07:50.568318 np0000001583 nova-compute[98241]: INFO os_vif [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:a6:6d,bridge_name='br-int',has_traffic_filtering=True,id=0479db3d-2d90-4116-b8e7-b1282c111d9b,network=Network(e05d2eb8-588f-4448-b95d-ac20e0e06e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0479db3d-2d')
May 28 02:07:50.570043 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:07:50.570043 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa', 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '873f9b75-1314-4acd-9c69-c4ae877916aa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:07:50.570043 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:07:50.570572 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:07:50.571020 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa', 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '873f9b75-1314-4acd-9c69-c4ae877916aa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:07:50.571325 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:07:50.600632 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:50.600632 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:50.600632 np0000001583 nova-compute[98241]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:07:50.600632 np0000001583 nova-compute[98241]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:07:50.600632 np0000001583 nova-compute[98241]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:07:50.600632 np0000001583 nova-compute[98241]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:07:50.600632 np0000001583 nova-compute[98241]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d8033697-1174-4701-8e77-15e757743cf4 (non-flash)
May 28 02:07:50.600632 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:07:50.601396 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsi session list stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:50.601396 np0000001583 nova-compute[98241]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa (non-flash)
May 28 02:07:50.601396 np0000001583 nova-compute[98241]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:07:50.601396 np0000001583 nova-compute[98241]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:07:50.601396 np0000001583 nova-compute[98241]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:07:50.601396 np0000001583 nova-compute[98241]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:07:50.601396 np0000001583 nova-compute[98241]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d8033697-1174-4701-8e77-15e757743cf4 (non-flash)
May 28 02:07:50.601396 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:07:50.603960 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa', '141'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa', '142'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d', '155'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d', '156'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9', '162'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9', '163'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d8033697-1174-4701-8e77-15e757743cf4', '164')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:07:50.603960 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa', '142')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:07:50.603960 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa', '141')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:07:50.603960 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f83d60c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa'): ({'sdd'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:07:50.603960 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Removing multipathed devices sdd, sde {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:07:50.604484 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Flush multipath device 3300000009e23c2de {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:07:50.679593 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:07:50.733984 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:07:50.796698 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:07:50.796698 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:07:50.796698 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:07:50.809359 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:07:50.809811 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:07:50.821044 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:07:50.851389 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 142, target: iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa, portal: 192.168.40.100,3260]
May 28 02:07:50.851389 np0000001583 nova-compute[98241]: Logout of [sid: 142, target: iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa, portal: 192.168.40.100,3260] successful.
May 28 02:07:50.851389 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:07:50.867232 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:07:50.878314 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:07:50.911178 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 141, target: iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa, portal: 192.168.50.100,3260]
May 28 02:07:50.911178 np0000001583 nova-compute[98241]: Logout of [sid: 141, target: iqn.2023-03.storpool.com:os--volume-873f9b75-1314-4acd-9c69-c4ae877916aa, portal: 192.168.50.100,3260] successful.
May 28 02:07:50.911178 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:07:50.928800 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:07:50.931958 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:07:50.931958 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] <== disconnect_volume: return (359ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:07:50.931958 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:07:50.931958 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Deleting instance files /opt/stack/data/nova/instances/39ea2f26-6a01-4d24-a2b3-d681e0b22d80_del
May 28 02:07:50.931958 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Deletion of /opt/stack/data/nova/instances/39ea2f26-6a01-4d24-a2b3-d681e0b22d80_del complete
May 28 02:07:50.997719 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-1cb926e3-2252-49e4-9828-1d1626d3d900 req-cee175c0-04ac-436c-8042-59211457dd41 service nova] Releasing lock "refresh_cache-39ea2f26-6a01-4d24-a2b3-d681e0b22d80" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:07:51.257150 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0816934c-1a4d-4689-8ac2-1f82ff16b6af tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "c9bfbfaa-4d10-4c18-8ad9-0f115a757b60" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.324s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:07:51.436250 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Took 1.72 seconds to destroy the instance on the hypervisor.
May 28 02:07:51.436675 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 02:07:51.436877 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 02:07:51.436956 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 02:07:51.437187 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:07:51.504268 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:07:51.842281 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-cd92dd95-a800-4655-8633-5996ce70f222 req-7c3e84b3-f1dd-4fe5-baa7-b95d6b521d65 service nova] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Received event network-vif-deleted-0479db3d-2d90-4116-b8e7-b1282c111d9b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:07:51.842734 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-cd92dd95-a800-4655-8633-5996ce70f222 req-7c3e84b3-f1dd-4fe5-baa7-b95d6b521d65 service nova] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Neutron deleted interface 0479db3d-2d90-4116-b8e7-b1282c111d9b; detaching it from the instance and deleting it from the info cache
May 28 02:07:51.845242 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-cd92dd95-a800-4655-8633-5996ce70f222 req-7c3e84b3-f1dd-4fe5-baa7-b95d6b521d65 service nova] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Detach interface failed, port_id=0479db3d-2d90-4116-b8e7-b1282c111d9b, reason: Instance 39ea2f26-6a01-4d24-a2b3-d681e0b22d80 could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 02:07:51.989231 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-de649b5a-7ed2-4b78-9838-9039a0057e54 req-69dad9a0-566f-4ee0-bb2c-01fe2c4f72a5 service nova] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Received event network-vif-unplugged-0479db3d-2d90-4116-b8e7-b1282c111d9b {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:07:51.989479 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-de649b5a-7ed2-4b78-9838-9039a0057e54 req-69dad9a0-566f-4ee0-bb2c-01fe2c4f72a5 service nova] Acquiring lock "39ea2f26-6a01-4d24-a2b3-d681e0b22d80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:07:51.989847 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-de649b5a-7ed2-4b78-9838-9039a0057e54 req-69dad9a0-566f-4ee0-bb2c-01fe2c4f72a5 service nova] Lock "39ea2f26-6a01-4d24-a2b3-d681e0b22d80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:07:51.990096 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-de649b5a-7ed2-4b78-9838-9039a0057e54 req-69dad9a0-566f-4ee0-bb2c-01fe2c4f72a5 service nova] Lock "39ea2f26-6a01-4d24-a2b3-d681e0b22d80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:07:51.990210 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-de649b5a-7ed2-4b78-9838-9039a0057e54 req-69dad9a0-566f-4ee0-bb2c-01fe2c4f72a5 service nova] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] No waiting events found dispatching network-vif-unplugged-0479db3d-2d90-4116-b8e7-b1282c111d9b {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:07:51.990381 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-de649b5a-7ed2-4b78-9838-9039a0057e54 req-69dad9a0-566f-4ee0-bb2c-01fe2c4f72a5 service nova] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Received event network-vif-unplugged-0479db3d-2d90-4116-b8e7-b1282c111d9b for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:07:52.291420 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:07:52.795039 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Took 1.36 seconds to deallocate network for instance.
May 28 02:07:53.348331 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Took 0.55 seconds to detach 1 volumes for instance.
May 28 02:07:53.536773 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:53.853182 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:07:53.853341 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:07:54.093074 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:07:54.093392 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:07:54.486310 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0004561840000860684 future=<Future at 0x7724f851d760 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:07:54.487136 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] Emitting event <LifecycleEvent: 1779934059.485691, e8bc20b7-8f2f-4226-9fcd-63c123604535 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:07:54.487351 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:07:54.487571 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] VM Stopped (Lifecycle Event)
May 28 02:07:54.487701 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=6.742722942 future=<Future at 0x7724f8724fe0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:07:54.487818 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=6.74259139500009 future=<Future at 0x7724f8724fe0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:07:54.596811 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:07:54.990167 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-a6b2c690-b65e-4175-89b0-69c452067e74 tempest-VolumesExtendAttachedTest-1888616504 tempest-VolumesExtendAttachedTest-1888616504-project-member] [instance: e8bc20b7-8f2f-4226-9fcd-63c123604535] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:07:55.108106 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.252s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:07:55.175100 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Deleted allocations for instance 39ea2f26-6a01-4d24-a2b3-d681e0b22d80
May 28 02:07:55.565575 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:55.797440 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "08450cf0-e778-4831-82f9-bd268655c346" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:07:55.797706 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "08450cf0-e778-4831-82f9-bd268655c346" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:07:55.998437 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:56.182897 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e3d5e0f8-e89c-4297-94e0-0c694bbe0b2f tempest-TestVolumeBootPattern-1031057169 tempest-TestVolumeBootPattern-1031057169-project-member] Lock "39ea2f26-6a01-4d24-a2b3-d681e0b22d80" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.976s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:07:56.300068 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 02:07:56.867014 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:07:56.867367 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:07:56.874606 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 02:07:56.874776 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Claim successful on node np0000001583
May 28 02:07:57.998109 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Acquiring lock "a7b60291-5fd2-479e-9c9c-924b79f880a7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:07:57.998109 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lock "a7b60291-5fd2-479e-9c9c-924b79f880a7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:07:58.055305 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:07:58.055508 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:07:58.501635 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lazy-loading 'flavor' on Instance uuid a7b60291-5fd2-479e-9c9c-924b79f880a7 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:07:58.547307 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:58.560115 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:07:58.982558 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:07:59.065430 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.198s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:07:59.065826 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 02:07:59.506316 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lock "a7b60291-5fd2-479e-9c9c-924b79f880a7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:07:59.571634 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 02:07:59.574054 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 08450cf0-e778-4831-82f9-bd268655c346] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 02:07:59.574382 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:07:59.574638 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:07:59.650835 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0f09c9f1da7e4d32979e47c96d41ae99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd192b18567fd4735988dd19da06fb868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 02:08:00.074023 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 02:08:00.189724 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Successfully created port: a6321b66-3810-4403-b7e0-13cb406ba8d8 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 02:08:00.567005 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:00.576729 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 02:08:00.626738 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Acquiring lock "a7b60291-5fd2-479e-9c9c-924b79f880a7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:08:00.626919 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lock "a7b60291-5fd2-479e-9c9c-924b79f880a7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:08:00.627167 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Attaching volume 413c1626-029d-4661-adfe-35d7c499f90f to /dev/vdb
May 28 02:08:00.679392 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:08:00.695631 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 02:08:00.721463 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:08:00.778242 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 02:08:00.778718 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 02:08:00.794537 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 02:08:00.794537 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe63:3f3b', 'fe80::d807:fdff:fe71:abb9', 'fe80::fc16:3eff:fe1c:a09a', 'fe80::5461:55ff:fe41:c1b7'] 
May 28 02:08:00.794981 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 02:08:00.794981 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 02:08:00.794981 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:08:00.795358 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Updating existing volume attachment record: 59c00b1d-a93a-4c6e-bf06-badcb6aae8e2 {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 02:08:00.860037 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Successfully updated port: a6321b66-3810-4403-b7e0-13cb406ba8d8 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 02:08:00.899034 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:00.916818 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-33c5fa61-fc23-442a-9eb9-6a735ee81e62 req-10f61d48-dba0-49fd-a369-e2fab57e2c17 service nova] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Received event network-changed-a6321b66-3810-4403-b7e0-13cb406ba8d8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:08:00.916934 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-33c5fa61-fc23-442a-9eb9-6a735ee81e62 req-10f61d48-dba0-49fd-a369-e2fab57e2c17 service nova] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Refreshing instance network info cache due to event network-changed-a6321b66-3810-4403-b7e0-13cb406ba8d8. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:08:00.917204 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-33c5fa61-fc23-442a-9eb9-6a735ee81e62 req-10f61d48-dba0-49fd-a369-e2fab57e2c17 service nova] Acquiring lock "refresh_cache-08450cf0-e778-4831-82f9-bd268655c346" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:08:00.917328 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-33c5fa61-fc23-442a-9eb9-6a735ee81e62 req-10f61d48-dba0-49fd-a369-e2fab57e2c17 service nova] Acquired lock "refresh_cache-08450cf0-e778-4831-82f9-bd268655c346" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:08:00.918642 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-33c5fa61-fc23-442a-9eb9-6a735ee81e62 req-10f61d48-dba0-49fd-a369-e2fab57e2c17 service nova] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Refreshing network info cache for port a6321b66-3810-4403-b7e0-13cb406ba8d8 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:08:01.231142 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0005223260000093433 future=<Future at 0x7724f8724fe0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:08:01.231142 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:08:01.231642 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=3.8137718319999294 future=<Future at 0x7724f82bd130 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:08:01.231642 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=3.81364539399965 future=<Future at 0x7724f82bd130 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:08:01.231774 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Emitting event <LifecycleEvent: 1779934066.230346, c9bfbfaa-4d10-4c18-8ad9-0f115a757b60 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:08:01.231957 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] VM Stopped (Lifecycle Event)
May 28 02:08:01.364014 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 02:08:01.364014 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f', 'iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '413c1626-029d-4661-adfe-35d7c499f90f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:08:01.364014 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:08:01.364463 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:08:01.364764 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f', 'iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '413c1626-029d-4661-adfe-35d7c499f90f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 02:08:01.380680 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:08:01.381545 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:08:01.382906 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:08:01.383133 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:08:01.383586 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:08:01.383884 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:08:01.385119 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "refresh_cache-08450cf0-e778-4831-82f9-bd268655c346" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:08:01.395823 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:08:01.395823 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:01.404412 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:08:01.404412 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:01.414464 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f] added
May 28 02:08:01.414464 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:08:01.414464 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:08:01.414464 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:08:01.414464 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:08:01.414464 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:08:01.414464 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:01.414754 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:08:01.414897 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0317(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:08:01.415112 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:08:01.419400 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f] added
May 28 02:08:01.419400 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:08:01.419400 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:08:01.419400 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:08:01.419400 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:08:01.419400 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:08:01.419400 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:01.419684 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:08:01.419718 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0359(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:08:01.419903 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:08:01.422617 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-33c5fa61-fc23-442a-9eb9-6a735ee81e62 req-10f61d48-dba0-49fd-a369-e2fab57e2c17 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:08:01.489768 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-33c5fa61-fc23-442a-9eb9-6a735ee81e62 req-10f61d48-dba0-49fd-a369-e2fab57e2c17 service nova] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:08:01.595918 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 02:08:01.597127 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 02:08:01.597398 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Creating image(s)
May 28 02:08:01.598006 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "/opt/stack/data/nova/instances/08450cf0-e778-4831-82f9-bd268655c346/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:08:01.598221 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "/opt/stack/data/nova/instances/08450cf0-e778-4831-82f9-bd268655c346/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:08:01.598914 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "/opt/stack/data/nova/instances/08450cf0-e778-4831-82f9-bd268655c346/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:08:01.599794 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:08:01.602901 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:08:01.604750 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:08:01.701432 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-33c5fa61-fc23-442a-9eb9-6a735ee81e62 req-10f61d48-dba0-49fd-a369-e2fab57e2c17 service nova] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:08:01.710557 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.106s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:08:01.710736 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:08:01.711150 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:08:01.711669 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:08:01.717435 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:08:01.717610 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:08:01.737312 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: c9bfbfaa-4d10-4c18-8ad9-0f115a757b60] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:08:01.810410 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.093s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:08:01.810803 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/08450cf0-e778-4831-82f9-bd268655c346/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:08:01.873042 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/08450cf0-e778-4831-82f9-bd268655c346/disk 1073741824" returned: 0 in 0.062s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:08:01.873612 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.162s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:08:01.874027 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:08:01.976399 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.102s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:08:01.976719 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Checking if we can resize image /opt/stack/data/nova/instances/08450cf0-e778-4831-82f9-bd268655c346/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 02:08:01.977517 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08450cf0-e778-4831-82f9-bd268655c346/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:08:02.068923 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08450cf0-e778-4831-82f9-bd268655c346/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:08:02.068923 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Cannot resize image /opt/stack/data/nova/instances/08450cf0-e778-4831-82f9-bd268655c346/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 02:08:02.068923 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 02:08:02.068923 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Ensure instance console log exists: /opt/stack/data/nova/instances/08450cf0-e778-4831-82f9-bd268655c346/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 02:08:02.069205 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:08:02.069309 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:08:02.069425 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:08:02.207666 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-33c5fa61-fc23-442a-9eb9-6a735ee81e62 req-10f61d48-dba0-49fd-a369-e2fab57e2c17 service nova] Releasing lock "refresh_cache-08450cf0-e778-4831-82f9-bd268655c346" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:08:02.208491 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquired lock "refresh_cache-08450cf0-e778-4831-82f9-bd268655c346" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:08:02.208491 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:08:02.415707 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:08:02.420347 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:08:02.430804 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:08:02.430804 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:08:02.433816 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:08:02.433816 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:02.444428 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:02.450820 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:02.458174 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:08:02.458174 np0000001583 nova-compute[98241]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:08:02.458174 np0000001583 nova-compute[98241]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:08:02.458174 np0000001583 nova-compute[98241]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:08:02.458174 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:08:02.458511 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsi session list stdout=tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:08:02.458511 np0000001583 nova-compute[98241]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:08:02.458511 np0000001583 nova-compute[98241]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:08:02.458511 np0000001583 nova-compute[98241]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:08:02.458511 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:08:02.463740 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:08:02.463740 np0000001583 nova-compute[98241]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:08:02.463740 np0000001583 nova-compute[98241]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:08:02.463740 np0000001583 nova-compute[98241]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:08:02.463740 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:08:02.463932 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsi session list stdout=tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:08:02.463932 np0000001583 nova-compute[98241]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:08:02.463932 np0000001583 nova-compute[98241]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:08:02.463932 np0000001583 nova-compute[98241]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:08:02.463932 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:08:02.491165 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f, portal: 192.168.50.100,3260]
May 28 02:08:02.491165 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f, portal: 192.168.50.100,3260] successful.
May 28 02:08:02.491165 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:02.505211 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:02.512729 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f, portal: 192.168.40.100,3260]
May 28 02:08:02.512729 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f, portal: 192.168.40.100,3260] successful.
May 28 02:08:02.512729 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:02.520889 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:08:02.520889 np0000001583 nova-compute[98241]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:08:02.520889 np0000001583 nova-compute[98241]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:08:02.520889 np0000001583 nova-compute[98241]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:08:02.520889 np0000001583 nova-compute[98241]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f (non-flash)
May 28 02:08:02.520889 np0000001583 nova-compute[98241]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f (non-flash)
May 28 02:08:02.520889 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:08:02.521229 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsi session list stdout=tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:08:02.521229 np0000001583 nova-compute[98241]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:08:02.521229 np0000001583 nova-compute[98241]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:08:02.521229 np0000001583 nova-compute[98241]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:08:02.521229 np0000001583 nova-compute[98241]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f (non-flash)
May 28 02:08:02.521229 np0000001583 nova-compute[98241]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f (non-flash)
May 28 02:08:02.521229 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:08:02.521510 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.139s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:08:02.521676 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:08:02.522440 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] HCTL ('9', '-', '-', 0) found on session 165 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:08:02.523214 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:08:02.527867 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:02.540279 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Searching for a device in session 165 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:08:02.540279 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '413c1626-029d-4661-adfe-35d7c499f90f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:08:02.546582 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:08:02.546582 np0000001583 nova-compute[98241]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:08:02.546582 np0000001583 nova-compute[98241]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:08:02.546582 np0000001583 nova-compute[98241]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:08:02.546582 np0000001583 nova-compute[98241]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f (non-flash)
May 28 02:08:02.546582 np0000001583 nova-compute[98241]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f (non-flash)
May 28 02:08:02.546582 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:08:02.546811 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsi session list stdout=tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:08:02.546811 np0000001583 nova-compute[98241]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:08:02.546811 np0000001583 nova-compute[98241]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:08:02.546811 np0000001583 nova-compute[98241]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:08:02.546811 np0000001583 nova-compute[98241]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f (non-flash)
May 28 02:08:02.546811 np0000001583 nova-compute[98241]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f (non-flash)
May 28 02:08:02.546811 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:08:02.547136 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.164s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:08:02.547300 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:08:02.548221 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] HCTL ('10', '-', '-', 0) found on session 166 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:08:02.548382 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:08:02.563044 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Searching for a device in session 166 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:08:02.563044 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '413c1626-029d-4661-adfe-35d7c499f90f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:08:02.775199 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:08:02.931353 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:08:03.063552 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Updating instance_info_cache with network_info: [{"id": "a6321b66-3810-4403-b7e0-13cb406ba8d8", "address": "fa:16:3e:a3:78:a0", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6321b66-38", "ovs_interfaceid": "a6321b66-3810-4403-b7e0-13cb406ba8d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:08:03.382643 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 02:08:03.548303 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:03.565414 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Releasing lock "refresh_cache-08450cf0-e778-4831-82f9-bd268655c346" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:08:03.565710 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Instance network_info: |[{"id": "a6321b66-3810-4403-b7e0-13cb406ba8d8", "address": "fa:16:3e:a3:78:a0", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6321b66-38", "ovs_interfaceid": "a6321b66-3810-4403-b7e0-13cb406ba8d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 02:08:03.567594 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Start _get_guest_xml network_info=[{"id": "a6321b66-3810-4403-b7e0-13cb406ba8d8", "address": "fa:16:3e:a3:78:a0", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6321b66-38", "ovs_interfaceid": "a6321b66-3810-4403-b7e0-13cb406ba8d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 02:08:03.571617 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:08:03.572876 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1681469911', uuid='08450cf0-e778-4831-82f9-bd268655c346'), owner=OwnerMeta(userid='0f09c9f1da7e4d32979e47c96d41ae99', username='tempest-TestEncryptedCinderVolumes-243696963-project-member', projectid='d192b18567fd4735988dd19da06fb868', projectname='tempest-TestEncryptedCinderVolumes-243696963'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a6321b66-3810-4403-b7e0-13cb406ba8d8", "address": "fa:16:3e:a3:78:a0", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6321b66-38", "ovs_interfaceid": "a6321b66-3810-4403-b7e0-13cb406ba8d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779934083.5724912) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 02:08:03.574051 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 02:08:03.574436 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 02:08:03.575456 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 02:08:03.575610 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 02:08:03.576694 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 02:08:03.577119 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 02:08:03.577278 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 02:08:03.577372 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 02:08:03.577521 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 02:08:03.577614 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 02:08:03.577683 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 02:08:03.577836 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 02:08:03.577933 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 02:08:03.578047 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 02:08:03.578184 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 02:08:03.578337 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 02:08:03.588627 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:07:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1681469911',display_name='tempest-TestEncryptedCinderVolumes-server-1681469911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testencryptedcindervolumes-server-1681469911',id=69,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKruAhsDFw41p5AkbVktZHQsHB0jcs980kCUbm8EmTl3RpL/gW/8eMoKYZIVHlmODaKnhxXwVniP4cY3s3vTadl1QY6zpg/rbWfiKmt6HFaTz4zLFjP/s7Ec6/HNwrJaWg==',key_name='tempest-keypair-221617266',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d192b18567fd4735988dd19da06fb868',ramdisk_id='',reservation_id='r-ct53yoqk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-243696963',owner_user_name='tempest-TestEncryptedCinderVolumes-243696963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:08:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f09c9f1da7e4d32979e47c96d41ae99',uuid=08450cf0-e778-4831-82f9-bd268655c346,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6321b66-3810-4403-b7e0-13cb406ba8d8", "address": "fa:16:3e:a3:78:a0", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6321b66-38", "ovs_interfaceid": "a6321b66-3810-4403-b7e0-13cb406ba8d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 02:08:03.588834 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Converting VIF {"id": "a6321b66-3810-4403-b7e0-13cb406ba8d8", "address": "fa:16:3e:a3:78:a0", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6321b66-38", "ovs_interfaceid": "a6321b66-3810-4403-b7e0-13cb406ba8d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:08:03.589400 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:78:a0,bridge_name='br-int',has_traffic_filtering=True,id=a6321b66-3810-4403-b7e0-13cb406ba8d8,network=Network(fccbc55c-a449-42c3-bf68-d3d337f7b0ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6321b66-38') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:08:03.589917 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lazy-loading 'pci_devices' on Instance uuid 08450cf0-e778-4831-82f9-bd268655c346 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:08:04.092593 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 08450cf0-e778-4831-82f9-bd268655c346] End _get_guest_xml xml=<domain type="qemu">
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:   <uuid>08450cf0-e778-4831-82f9-bd268655c346</uuid>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:   <name>instance-00000045</name>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:   <metadata>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1681469911</nova:name>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 02:08:03</nova:creationTime>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:       </nova:image>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:         <nova:user uuid="0f09c9f1da7e4d32979e47c96d41ae99">tempest-TestEncryptedCinderVolumes-243696963-project-member</nova:user>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:         <nova:project uuid="d192b18567fd4735988dd19da06fb868">tempest-TestEncryptedCinderVolumes-243696963</nova:project>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:         <nova:port uuid="a6321b66-3810-4403-b7e0-13cb406ba8d8">
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:         </nova:port>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:   </metadata>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:     <system>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:       <entry name="serial">08450cf0-e778-4831-82f9-bd268655c346</entry>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:       <entry name="uuid">08450cf0-e778-4831-82f9-bd268655c346</entry>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:     </system>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:   <os>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:   </os>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:   <features>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:     <acpi/>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:     <tcg>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:     </tcg>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:   </features>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:   </cpu>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:   <devices>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/08450cf0-e778-4831-82f9-bd268655c346/disk"/>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:     </disk>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/08450cf0-e778-4831-82f9-bd268655c346/disk.config"/>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:     </disk>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:a3:78:a0"/>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:       <target dev="tapa6321b66-38"/>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:     </interface>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/08450cf0-e778-4831-82f9-bd268655c346/console.log" append="off"/>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:     </serial>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:     <video>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:     </video>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:     </rng>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:     </memballoon>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:   </devices>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]: </domain>
May 28 02:08:04.092593 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 02:08:04.096473 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Preparing to wait for external event network-vif-plugged-a6321b66-3810-4403-b7e0-13cb406ba8d8 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 02:08:04.096473 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "08450cf0-e778-4831-82f9-bd268655c346-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:08:04.096473 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "08450cf0-e778-4831-82f9-bd268655c346-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:08:04.096473 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "08450cf0-e778-4831-82f9-bd268655c346-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:08:04.096473 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:07:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1681469911',display_name='tempest-TestEncryptedCinderVolumes-server-1681469911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testencryptedcindervolumes-server-1681469911',id=69,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKruAhsDFw41p5AkbVktZHQsHB0jcs980kCUbm8EmTl3RpL/gW/8eMoKYZIVHlmODaKnhxXwVniP4cY3s3vTadl1QY6zpg/rbWfiKmt6HFaTz4zLFjP/s7Ec6/HNwrJaWg==',key_name='tempest-keypair-221617266',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d192b18567fd4735988dd19da06fb868',ramdisk_id='',reservation_id='r-ct53yoqk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-243696963',owner_user_name='tempest-TestEncryptedCinderVolumes-243696963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:08:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f09c9f1da7e4d32979e47c96d41ae99',uuid=08450cf0-e778-4831-82f9-bd268655c346,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6321b66-3810-4403-b7e0-13cb406ba8d8", "address": "fa:16:3e:a3:78:a0", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6321b66-38", "ovs_interfaceid": "a6321b66-3810-4403-b7e0-13cb406ba8d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 02:08:04.096473 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Converting VIF {"id": "a6321b66-3810-4403-b7e0-13cb406ba8d8", "address": "fa:16:3e:a3:78:a0", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6321b66-38", "ovs_interfaceid": "a6321b66-3810-4403-b7e0-13cb406ba8d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:08:04.096473 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:78:a0,bridge_name='br-int',has_traffic_filtering=True,id=a6321b66-3810-4403-b7e0-13cb406ba8d8,network=Network(fccbc55c-a449-42c3-bf68-d3d337f7b0ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6321b66-38') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:08:04.096473 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:78:a0,bridge_name='br-int',has_traffic_filtering=True,id=a6321b66-3810-4403-b7e0-13cb406ba8d8,network=Network(fccbc55c-a449-42c3-bf68-d3d337f7b0ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6321b66-38') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 02:08:04.096473 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:04.096473 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:08:04.096473 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 02:08:04.096473 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:04.096473 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fa8ba81c-097d-54fd-a7db-c09b988d1f89', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:08:04.097260 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:04.097737 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:08:04.098184 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:04.100037 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:04.100200 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa6321b66-38, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:08:04.100548 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa6321b66-38, col_values=(('qos', UUID('e6fb19f9-3cba-48a2-9baa-999db94b89dc')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:08:04.100735 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa6321b66-38, col_values=(('external_ids', {'iface-id': 'a6321b66-3810-4403-b7e0-13cb406ba8d8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:78:a0', 'vm-uuid': '08450cf0-e778-4831-82f9-bd268655c346'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:08:04.101498 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:04.103594 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:08:04.107020 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:04.107837 np0000001583 nova-compute[98241]: INFO os_vif [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:78:a0,bridge_name='br-int',has_traffic_filtering=True,id=a6321b66-3810-4403-b7e0-13cb406ba8d8,network=Network(fccbc55c-a449-42c3-bf68-d3d337f7b0ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6321b66-38')
May 28 02:08:04.398636 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Found WWN 330000000f66828ad for multipath device dm-1 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 02:08:04.398930 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:08:04.399213 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '330000000f66828ad', 'path': '/dev/dm-1', 'multipath_id': '330000000f66828ad'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:08:04.399410 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f66828ad', 'path': '/dev/dm-1', 'multipath_id': '330000000f66828ad'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 02:08:04.401997 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lazy-loading 'flavor' on Instance uuid a7b60291-5fd2-479e-9c9c-924b79f880a7 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:08:04.905330 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Attempting to attach volume 413c1626-029d-4661-adfe-35d7c499f90f with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98241) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 02:08:04.906864 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] attach device xml: <disk type="block" device="disk">
May 28 02:08:04.906864 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:08:04.906864 np0000001583 nova-compute[98241]:   <alias name="ua-413c1626-029d-4661-adfe-35d7c499f90f"/>
May 28 02:08:04.906864 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-1"/>
May 28 02:08:04.906864 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:08:04.906864 np0000001583 nova-compute[98241]:   <serial>413c1626-029d-4661-adfe-35d7c499f90f</serial>
May 28 02:08:04.906864 np0000001583 nova-compute[98241]: </disk>
May 28 02:08:04.906864 np0000001583 nova-compute[98241]:  {{(pid=98241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 02:08:05.045509 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0004582740002661012 future=<Future at 0x7724f82bd130 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:08:05.046055 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Emitting event <LifecycleEvent: 1779934070.044925, 39ea2f26-6a01-4d24-a2b3-d681e0b22d80 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:08:05.046242 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:08:05.046415 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] VM Stopped (Lifecycle Event)
May 28 02:08:05.548590 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: 39ea2f26-6a01-4d24-a2b3-d681e0b22d80] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:08:05.624523 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:08:05.624678 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:08:05.624787 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] No VIF found with MAC fa:16:3e:a3:78:a0, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:08:05.625273 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Using config drive
May 28 02:08:06.130273 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:08:06.243697 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Creating config drive at /opt/stack/data/nova/instances/08450cf0-e778-4831-82f9-bd268655c346/disk.config
May 28 02:08:06.247210 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/08450cf0-e778-4831-82f9-bd268655c346/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpy2u746h7 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:08:06.298683 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/08450cf0-e778-4831-82f9-bd268655c346/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpy2u746h7" returned: 0 in 0.051s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:08:06.571333 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:08:06.571512 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:08:06.571652 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:08:06.571740 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] No VIF found with MAC fa:16:3e:63:3f:3b, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:08:06.688719 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:06.708622 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:06.711815 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:06.811165 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:06.911954 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-8cbf5fe7-dc1f-41dc-9396-13b4ecede863 req-f4b0bfd4-0e60-4d54-b7e0-5e871b8551d1 service nova] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Received event network-vif-plugged-a6321b66-3810-4403-b7e0-13cb406ba8d8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:08:06.913780 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-8cbf5fe7-dc1f-41dc-9396-13b4ecede863 req-f4b0bfd4-0e60-4d54-b7e0-5e871b8551d1 service nova] Acquiring lock "08450cf0-e778-4831-82f9-bd268655c346-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:08:06.914099 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-8cbf5fe7-dc1f-41dc-9396-13b4ecede863 req-f4b0bfd4-0e60-4d54-b7e0-5e871b8551d1 service nova] Lock "08450cf0-e778-4831-82f9-bd268655c346-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:08:06.914330 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-8cbf5fe7-dc1f-41dc-9396-13b4ecede863 req-f4b0bfd4-0e60-4d54-b7e0-5e871b8551d1 service nova] Lock "08450cf0-e778-4831-82f9-bd268655c346-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:08:06.914617 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-8cbf5fe7-dc1f-41dc-9396-13b4ecede863 req-f4b0bfd4-0e60-4d54-b7e0-5e871b8551d1 service nova] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Processing event network-vif-plugged-a6321b66-3810-4403-b7e0-13cb406ba8d8 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 02:08:07.046727 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:07.048843 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:07.051935 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:07.069223 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:07.069825 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:07.460390 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934087.4599779, 08450cf0-e778-4831-82f9-bd268655c346 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:08:07.460813 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 02:08:07.461004 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 08450cf0-e778-4831-82f9-bd268655c346] VM Started (Lifecycle Event)
May 28 02:08:07.463312 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 02:08:07.467147 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Instance spawned successfully.
May 28 02:08:07.467521 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 02:08:07.963881 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:08:07.966302 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:08:07.979420 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:08:07.979718 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:08:07.979923 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:08:07.980190 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:08:07.980539 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:08:07.980840 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:08:08.127394 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ac03710e-37d1-4667-a9f8-1ff5fc5b36ff tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lock "a7b60291-5fd2-479e-9c9c-924b79f880a7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.500s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:08:08.470135 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 08450cf0-e778-4831-82f9-bd268655c346] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 02:08:08.470135 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934088.4687319, 08450cf0-e778-4831-82f9-bd268655c346 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:08:08.470135 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 08450cf0-e778-4831-82f9-bd268655c346] VM Paused (Lifecycle Event)
May 28 02:08:08.487254 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Took 6.89 seconds to spawn the instance on the hypervisor.
May 28 02:08:08.487254 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:08:08.549818 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:08.809118 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Acquiring lock "a7b60291-5fd2-479e-9c9c-924b79f880a7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:08:08.809302 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lock "a7b60291-5fd2-479e-9c9c-924b79f880a7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:08:08.969636 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-c934d1fb-791e-4243-a8cb-dddc0def51cb req-2cf10694-1191-4c19-9b5b-7bd94373bcf6 service nova] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Received event network-vif-plugged-a6321b66-3810-4403-b7e0-13cb406ba8d8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:08:08.969893 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c934d1fb-791e-4243-a8cb-dddc0def51cb req-2cf10694-1191-4c19-9b5b-7bd94373bcf6 service nova] Acquiring lock "08450cf0-e778-4831-82f9-bd268655c346-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:08:08.969952 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c934d1fb-791e-4243-a8cb-dddc0def51cb req-2cf10694-1191-4c19-9b5b-7bd94373bcf6 service nova] Lock "08450cf0-e778-4831-82f9-bd268655c346-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:08:08.970123 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c934d1fb-791e-4243-a8cb-dddc0def51cb req-2cf10694-1191-4c19-9b5b-7bd94373bcf6 service nova] Lock "08450cf0-e778-4831-82f9-bd268655c346-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:08:08.970254 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-c934d1fb-791e-4243-a8cb-dddc0def51cb req-2cf10694-1191-4c19-9b5b-7bd94373bcf6 service nova] [instance: 08450cf0-e778-4831-82f9-bd268655c346] No waiting events found dispatching network-vif-plugged-a6321b66-3810-4403-b7e0-13cb406ba8d8 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:08:08.970373 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-c934d1fb-791e-4243-a8cb-dddc0def51cb req-2cf10694-1191-4c19-9b5b-7bd94373bcf6 service nova] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Received unexpected event network-vif-plugged-a6321b66-3810-4403-b7e0-13cb406ba8d8 for instance with vm_state active and task_state None.
May 28 02:08:08.971496 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:08:08.977871 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934088.9776082, 08450cf0-e778-4831-82f9-bd268655c346 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:08:08.977989 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 08450cf0-e778-4831-82f9-bd268655c346] VM Resumed (Lifecycle Event)
May 28 02:08:09.004759 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Took 12.20 seconds to build instance.
May 28 02:08:09.112092 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:09.312965 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lazy-loading 'flavor' on Instance uuid a7b60291-5fd2-479e-9c9c-924b79f880a7 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:08:09.480333 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:08:09.483062 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:08:09.506472 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0ed7f132-aa6f-44b1-8151-6dfd8b788814 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "08450cf0-e778-4831-82f9-bd268655c346" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.708s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:08:10.317858 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lock "a7b60291-5fd2-479e-9c9c-924b79f880a7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:08:11.026537 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-02568902-e663-48c1-80aa-db7ba7b865e3 req-7cdccaad-3190-465d-b5ce-cfbc83a7e693 service nova] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Received event network-changed-a6321b66-3810-4403-b7e0-13cb406ba8d8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:08:11.026537 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-02568902-e663-48c1-80aa-db7ba7b865e3 req-7cdccaad-3190-465d-b5ce-cfbc83a7e693 service nova] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Refreshing instance network info cache due to event network-changed-a6321b66-3810-4403-b7e0-13cb406ba8d8. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:08:11.026829 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-02568902-e663-48c1-80aa-db7ba7b865e3 req-7cdccaad-3190-465d-b5ce-cfbc83a7e693 service nova] Acquiring lock "refresh_cache-08450cf0-e778-4831-82f9-bd268655c346" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:08:11.026829 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-02568902-e663-48c1-80aa-db7ba7b865e3 req-7cdccaad-3190-465d-b5ce-cfbc83a7e693 service nova] Acquired lock "refresh_cache-08450cf0-e778-4831-82f9-bd268655c346" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:08:11.026829 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-02568902-e663-48c1-80aa-db7ba7b865e3 req-7cdccaad-3190-465d-b5ce-cfbc83a7e693 service nova] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Refreshing network info cache for port a6321b66-3810-4403-b7e0-13cb406ba8d8 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:08:11.395582 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Acquiring lock "a7b60291-5fd2-479e-9c9c-924b79f880a7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:08:11.395791 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lock "a7b60291-5fd2-479e-9c9c-924b79f880a7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:08:11.395973 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Attaching volume dd760579-395a-4bce-8993-8f9791514907 to /dev/vdc
May 28 02:08:11.442421 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:08:11.453640 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 02:08:11.480594 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:08:11.530349 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-02568902-e663-48c1-80aa-db7ba7b865e3 req-7cdccaad-3190-465d-b5ce-cfbc83a7e693 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:08:11.535678 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 02:08:11.535678 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 02:08:11.544363 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 02:08:11.545477 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe63:3f3b', 'fe80::d807:fdff:fe71:abb9', 'fe80::fc16:3eff:fe1c:a09a', 'fe80::5461:55ff:fe41:c1b7', 'fe80::fc16:3eff:fea3:78a0', 'fe80::d05a:66ff:fe6d:1718'] 
May 28 02:08:11.545648 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 02:08:11.545730 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 02:08:11.545959 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] <== get_connector_properties: return (103ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:08:11.546179 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Updating existing volume attachment record: 79840d64-be01-43c3-9d4e-98af30e06a81 {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 02:08:11.885181 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-02568902-e663-48c1-80aa-db7ba7b865e3 req-7cdccaad-3190-465d-b5ce-cfbc83a7e693 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:08:12.006296 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-02568902-e663-48c1-80aa-db7ba7b865e3 req-7cdccaad-3190-465d-b5ce-cfbc83a7e693 service nova] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Updated VIF entry in instance network info cache for port a6321b66-3810-4403-b7e0-13cb406ba8d8. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:08:12.006571 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-02568902-e663-48c1-80aa-db7ba7b865e3 req-7cdccaad-3190-465d-b5ce-cfbc83a7e693 service nova] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Updating instance_info_cache with network_info: [{"id": "a6321b66-3810-4403-b7e0-13cb406ba8d8", "address": "fa:16:3e:a3:78:a0", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6321b66-38", "ovs_interfaceid": "a6321b66-3810-4403-b7e0-13cb406ba8d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:08:12.107893 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 02:08:12.108237 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907', 'iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dd760579-395a-4bce-8993-8f9791514907', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:08:12.108369 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:08:12.108795 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:08:12.108987 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907', 'iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dd760579-395a-4bce-8993-8f9791514907', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 02:08:12.122296 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:08:12.122975 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:08:12.123484 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:08:12.123716 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:08:12.124109 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:08:12.124304 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:08:12.137102 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:08:12.137102 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:12.141878 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:08:12.141878 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:12.146512 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907] added
May 28 02:08:12.146512 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:08:12.146512 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:08:12.146512 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:08:12.146512 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:08:12.146512 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:08:12.146512 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:12.146690 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:08:12.146829 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0231(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:08:12.146962 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:08:12.152243 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907] added
May 28 02:08:12.152243 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:08:12.152243 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:08:12.152243 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:08:12.152243 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:08:12.152243 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:08:12.152243 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:12.152423 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:08:12.152679 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0283(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:08:12.152850 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:08:12.509660 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-02568902-e663-48c1-80aa-db7ba7b865e3 req-7cdccaad-3190-465d-b5ce-cfbc83a7e693 service nova] Releasing lock "refresh_cache-08450cf0-e778-4831-82f9-bd268655c346" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:08:13.147488 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:08:13.153397 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:08:13.162205 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:08:13.162205 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:08:13.168564 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:08:13.168564 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:13.174215 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:13.180914 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:13.190062 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:08:13.190062 np0000001583 nova-compute[98241]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:08:13.190062 np0000001583 nova-compute[98241]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:08:13.190062 np0000001583 nova-compute[98241]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:08:13.190062 np0000001583 nova-compute[98241]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f (non-flash)
May 28 02:08:13.190062 np0000001583 nova-compute[98241]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f (non-flash)
May 28 02:08:13.190062 np0000001583 nova-compute[98241]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4095e7b4-59b5-441d-9212-678b15bc3160 (non-flash)
May 28 02:08:13.190062 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:08:13.190326 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsi session list stdout=tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:08:13.190326 np0000001583 nova-compute[98241]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:08:13.190326 np0000001583 nova-compute[98241]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:08:13.190326 np0000001583 nova-compute[98241]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:08:13.190326 np0000001583 nova-compute[98241]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f (non-flash)
May 28 02:08:13.190326 np0000001583 nova-compute[98241]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f (non-flash)
May 28 02:08:13.190326 np0000001583 nova-compute[98241]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4095e7b4-59b5-441d-9212-678b15bc3160 (non-flash)
May 28 02:08:13.190326 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:08:13.196410 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:08:13.196410 np0000001583 nova-compute[98241]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:08:13.196410 np0000001583 nova-compute[98241]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:08:13.196410 np0000001583 nova-compute[98241]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:08:13.196410 np0000001583 nova-compute[98241]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f (non-flash)
May 28 02:08:13.196410 np0000001583 nova-compute[98241]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f (non-flash)
May 28 02:08:13.196410 np0000001583 nova-compute[98241]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4095e7b4-59b5-441d-9212-678b15bc3160 (non-flash)
May 28 02:08:13.196410 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:08:13.196588 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsi session list stdout=tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:08:13.196588 np0000001583 nova-compute[98241]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:08:13.196588 np0000001583 nova-compute[98241]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:08:13.196588 np0000001583 nova-compute[98241]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:08:13.196588 np0000001583 nova-compute[98241]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f (non-flash)
May 28 02:08:13.196588 np0000001583 nova-compute[98241]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f (non-flash)
May 28 02:08:13.196588 np0000001583 nova-compute[98241]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4095e7b4-59b5-441d-9212-678b15bc3160 (non-flash)
May 28 02:08:13.196588 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:08:13.232693 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907, portal: 192.168.40.100,3260]
May 28 02:08:13.232693 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907, portal: 192.168.40.100,3260] successful.
May 28 02:08:13.232693 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:13.247331 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:13.254774 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907, portal: 192.168.50.100,3260]
May 28 02:08:13.254774 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907, portal: 192.168.50.100,3260] successful.
May 28 02:08:13.254774 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:13.264025 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:08:13.264025 np0000001583 nova-compute[98241]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:08:13.264025 np0000001583 nova-compute[98241]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:08:13.264025 np0000001583 nova-compute[98241]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:08:13.264025 np0000001583 nova-compute[98241]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f (non-flash)
May 28 02:08:13.264025 np0000001583 nova-compute[98241]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f (non-flash)
May 28 02:08:13.264025 np0000001583 nova-compute[98241]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4095e7b4-59b5-441d-9212-678b15bc3160 (non-flash)
May 28 02:08:13.264025 np0000001583 nova-compute[98241]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907 (non-flash)
May 28 02:08:13.264025 np0000001583 nova-compute[98241]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907 (non-flash)
May 28 02:08:13.264025 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:08:13.264329 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsi session list stdout=tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:08:13.264329 np0000001583 nova-compute[98241]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:08:13.264329 np0000001583 nova-compute[98241]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:08:13.264329 np0000001583 nova-compute[98241]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:08:13.264329 np0000001583 nova-compute[98241]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f (non-flash)
May 28 02:08:13.264329 np0000001583 nova-compute[98241]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f (non-flash)
May 28 02:08:13.264329 np0000001583 nova-compute[98241]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4095e7b4-59b5-441d-9212-678b15bc3160 (non-flash)
May 28 02:08:13.264329 np0000001583 nova-compute[98241]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907 (non-flash)
May 28 02:08:13.264329 np0000001583 nova-compute[98241]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907 (non-flash)
May 28 02:08:13.264329 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:08:13.264514 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.141s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:08:13.264584 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:08:13.265502 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] HCTL ('12', '-', '-', 0) found on session 168 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:08:13.265617 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:08:13.269677 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:13.280998 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Searching for a device in session 168 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:08:13.280998 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dd760579-395a-4bce-8993-8f9791514907', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:08:13.291943 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:08:13.291943 np0000001583 nova-compute[98241]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:08:13.291943 np0000001583 nova-compute[98241]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:08:13.291943 np0000001583 nova-compute[98241]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:08:13.291943 np0000001583 nova-compute[98241]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f (non-flash)
May 28 02:08:13.291943 np0000001583 nova-compute[98241]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f (non-flash)
May 28 02:08:13.291943 np0000001583 nova-compute[98241]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4095e7b4-59b5-441d-9212-678b15bc3160 (non-flash)
May 28 02:08:13.291943 np0000001583 nova-compute[98241]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907 (non-flash)
May 28 02:08:13.291943 np0000001583 nova-compute[98241]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907 (non-flash)
May 28 02:08:13.291943 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:08:13.292985 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsi session list stdout=tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:08:13.292985 np0000001583 nova-compute[98241]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:08:13.292985 np0000001583 nova-compute[98241]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:08:13.292985 np0000001583 nova-compute[98241]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:08:13.292985 np0000001583 nova-compute[98241]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f (non-flash)
May 28 02:08:13.292985 np0000001583 nova-compute[98241]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f (non-flash)
May 28 02:08:13.292985 np0000001583 nova-compute[98241]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4095e7b4-59b5-441d-9212-678b15bc3160 (non-flash)
May 28 02:08:13.292985 np0000001583 nova-compute[98241]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907 (non-flash)
May 28 02:08:13.292985 np0000001583 nova-compute[98241]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907 (non-flash)
May 28 02:08:13.292985 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:08:13.293329 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.169s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:08:13.293422 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:08:13.295825 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] HCTL ('13', '-', '-', 0) found on session 169 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:08:13.295956 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:08:13.324754 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Searching for a device in session 169 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:08:13.324754 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'dd760579-395a-4bce-8993-8f9791514907', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:08:13.551897 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:14.113618 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:14.124020 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 02:08:15.140634 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Found WWN 3300000005e7606f1 for multipath device dm-2 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 02:08:15.141179 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:08:15.141179 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] <== connect_volume: return (3032ms) {'type': 'block', 'scsi_wwn': '3300000005e7606f1', 'path': '/dev/dm-2', 'multipath_id': '3300000005e7606f1'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:08:15.141298 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000005e7606f1', 'path': '/dev/dm-2', 'multipath_id': '3300000005e7606f1'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 02:08:15.144184 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lazy-loading 'flavor' on Instance uuid a7b60291-5fd2-479e-9c9c-924b79f880a7 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:08:15.648339 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Attempting to attach volume dd760579-395a-4bce-8993-8f9791514907 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98241) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 02:08:15.650941 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] attach device xml: <disk type="block" device="disk">
May 28 02:08:15.650941 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:08:15.650941 np0000001583 nova-compute[98241]:   <alias name="ua-dd760579-395a-4bce-8993-8f9791514907"/>
May 28 02:08:15.650941 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-2"/>
May 28 02:08:15.650941 np0000001583 nova-compute[98241]:   <target dev="vdc" bus="virtio"/>
May 28 02:08:15.650941 np0000001583 nova-compute[98241]:   <serial>dd760579-395a-4bce-8993-8f9791514907</serial>
May 28 02:08:15.650941 np0000001583 nova-compute[98241]: </disk>
May 28 02:08:15.650941 np0000001583 nova-compute[98241]:  {{(pid=98241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 02:08:17.322340 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:08:17.322926 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:08:17.322926 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:08:17.322926 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:08:17.322926 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] No VIF found with MAC fa:16:3e:63:3f:3b, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:08:18.553839 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:18.884396 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-da362263-62d7-459f-a1bb-06c36681af8c tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lock "a7b60291-5fd2-479e-9c9c-924b79f880a7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.488s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:08:19.122568 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:20.193486 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:08:20.194025 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:08:22.193257 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:08:22.193520 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:08:22.193808 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:08:23.556890 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:23.901044 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-836f9770-9884-4184-b434-05c26e07c562 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Acquiring lock "a7b60291-5fd2-479e-9c9c-924b79f880a7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:08:23.901283 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-836f9770-9884-4184-b434-05c26e07c562 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lock "a7b60291-5fd2-479e-9c9c-924b79f880a7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:08:24.124141 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:24.404228 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-836f9770-9884-4184-b434-05c26e07c562 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Detaching volume 413c1626-029d-4661-adfe-35d7c499f90f
May 28 02:08:24.464375 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-836f9770-9884-4184-b434-05c26e07c562 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Attempting to driver detach volume 413c1626-029d-4661-adfe-35d7c499f90f from mountpoint /dev/vdb
May 28 02:08:24.471947 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-836f9770-9884-4184-b434-05c26e07c562 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Found disk vdb by alias ua-413c1626-029d-4661-adfe-35d7c499f90f {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:08:24.473924 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-836f9770-9884-4184-b434-05c26e07c562 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Found disk vdb by alias ua-413c1626-029d-4661-adfe-35d7c499f90f {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:08:24.473924 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-836f9770-9884-4184-b434-05c26e07c562 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Attempting to detach device vdb from instance a7b60291-5fd2-479e-9c9c-924b79f880a7 from the persistent domain config. {{(pid=98241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 02:08:24.474199 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-836f9770-9884-4184-b434-05c26e07c562 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:08:24.474199 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:08:24.474199 np0000001583 nova-compute[98241]:   <alias name="ua-413c1626-029d-4661-adfe-35d7c499f90f"/>
May 28 02:08:24.474199 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-1"/>
May 28 02:08:24.474199 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:08:24.474199 np0000001583 nova-compute[98241]:   <serial>413c1626-029d-4661-adfe-35d7c499f90f</serial>
May 28 02:08:24.474199 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 02:08:24.474199 np0000001583 nova-compute[98241]: </disk>
May 28 02:08:24.474199 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:08:24.482232 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-836f9770-9884-4184-b434-05c26e07c562 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Successfully detached device vdb from instance a7b60291-5fd2-479e-9c9c-924b79f880a7 from the persistent domain config.
May 28 02:08:24.482422 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-836f9770-9884-4184-b434-05c26e07c562 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] (1/8): Attempting to detach device vdb with device alias ua-413c1626-029d-4661-adfe-35d7c499f90f from instance a7b60291-5fd2-479e-9c9c-924b79f880a7 from the live domain config. {{(pid=98241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 02:08:24.482614 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-836f9770-9884-4184-b434-05c26e07c562 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:08:24.482614 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:08:24.482614 np0000001583 nova-compute[98241]:   <alias name="ua-413c1626-029d-4661-adfe-35d7c499f90f"/>
May 28 02:08:24.482614 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-1"/>
May 28 02:08:24.482614 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:08:24.482614 np0000001583 nova-compute[98241]:   <serial>413c1626-029d-4661-adfe-35d7c499f90f</serial>
May 28 02:08:24.482614 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 02:08:24.482614 np0000001583 nova-compute[98241]: </disk>
May 28 02:08:24.482614 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:08:25.053767 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Received event <DeviceRemovedEvent: 1779934105.0534203, a7b60291-5fd2-479e-9c9c-924b79f880a7 => ua-413c1626-029d-4661-adfe-35d7c499f90f> from libvirt while the driver is waiting for it; dispatched. {{(pid=98241) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 02:08:25.055068 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-836f9770-9884-4184-b434-05c26e07c562 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-413c1626-029d-4661-adfe-35d7c499f90f for instance a7b60291-5fd2-479e-9c9c-924b79f880a7 {{(pid=98241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 02:08:25.057785 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-836f9770-9884-4184-b434-05c26e07c562 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Successfully detached device vdb from instance a7b60291-5fd2-479e-9c9c-924b79f880a7 from the live domain config.
May 28 02:08:25.059007 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-836f9770-9884-4184-b434-05c26e07c562 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:08:25.059691 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-836f9770-9884-4184-b434-05c26e07c562 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f', 'iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '413c1626-029d-4661-adfe-35d7c499f90f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:08:25.059691 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-836f9770-9884-4184-b434-05c26e07c562 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:08:25.059945 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-836f9770-9884-4184-b434-05c26e07c562 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:08:25.060265 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-836f9770-9884-4184-b434-05c26e07c562 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f', 'iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '413c1626-029d-4661-adfe-35d7c499f90f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:08:25.060373 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-836f9770-9884-4184-b434-05c26e07c562 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:08:25.099597 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-836f9770-9884-4184-b434-05c26e07c562 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:08:25.099597 np0000001583 nova-compute[98241]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:08:25.099597 np0000001583 nova-compute[98241]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:08:25.099597 np0000001583 nova-compute[98241]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:08:25.099597 np0000001583 nova-compute[98241]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f (non-flash)
May 28 02:08:25.099597 np0000001583 nova-compute[98241]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f (non-flash)
May 28 02:08:25.099597 np0000001583 nova-compute[98241]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907 (non-flash)
May 28 02:08:25.099597 np0000001583 nova-compute[98241]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907 (non-flash)
May 28 02:08:25.099597 np0000001583 nova-compute[98241]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4095e7b4-59b5-441d-9212-678b15bc3160 (non-flash)
May 28 02:08:25.099597 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:08:25.099944 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-836f9770-9884-4184-b434-05c26e07c562 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsi session list stdout=tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:08:25.099944 np0000001583 nova-compute[98241]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:08:25.099944 np0000001583 nova-compute[98241]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:08:25.099944 np0000001583 nova-compute[98241]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:08:25.099944 np0000001583 nova-compute[98241]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f (non-flash)
May 28 02:08:25.099944 np0000001583 nova-compute[98241]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f (non-flash)
May 28 02:08:25.099944 np0000001583 nova-compute[98241]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907 (non-flash)
May 28 02:08:25.099944 np0000001583 nova-compute[98241]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907 (non-flash)
May 28 02:08:25.099944 np0000001583 nova-compute[98241]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4095e7b4-59b5-441d-9212-678b15bc3160 (non-flash)
May 28 02:08:25.099944 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:08:25.099944 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-836f9770-9884-4184-b434-05c26e07c562 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d', '155'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d', '156'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9', '162'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9', '163'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f', '165'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f', '166'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907', '168'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907', '169'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4095e7b4-59b5-441d-9212-678b15bc3160', '170')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:08:25.100316 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-836f9770-9884-4184-b434-05c26e07c562 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f', '166')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:08:25.101326 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-836f9770-9884-4184-b434-05c26e07c562 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f', '165')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:08:25.101696 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-836f9770-9884-4184-b434-05c26e07c562 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f81822a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f'): ({'sdd'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:08:25.101862 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-836f9770-9884-4184-b434-05c26e07c562 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Removing multipathed devices sdd, sde {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:08:25.102504 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-836f9770-9884-4184-b434-05c26e07c562 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Flush multipath device 330000000f66828ad {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:08:25.136266 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-836f9770-9884-4184-b434-05c26e07c562 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:08:25.163624 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Acquiring lock "5b81046a-d6a2-412e-8f9a-2ab41e8fd991" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:08:25.163804 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "5b81046a-d6a2-412e-8f9a-2ab41e8fd991" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:08:25.164269 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Acquiring lock "5b81046a-d6a2-412e-8f9a-2ab41e8fd991-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:08:25.164269 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "5b81046a-d6a2-412e-8f9a-2ab41e8fd991-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:08:25.164380 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "5b81046a-d6a2-412e-8f9a-2ab41e8fd991-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:08:25.169713 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Terminating instance
May 28 02:08:25.178140 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-836f9770-9884-4184-b434-05c26e07c562 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:08:25.195074 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:08:25.238009 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-836f9770-9884-4184-b434-05c26e07c562 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:08:25.238009 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-836f9770-9884-4184-b434-05c26e07c562 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:08:25.239501 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-836f9770-9884-4184-b434-05c26e07c562 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:08:25.253867 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-836f9770-9884-4184-b434-05c26e07c562 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:08:25.254049 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-836f9770-9884-4184-b434-05c26e07c562 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:08:25.265371 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-836f9770-9884-4184-b434-05c26e07c562 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:25.307469 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-836f9770-9884-4184-b434-05c26e07c562 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 166, target: iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f, portal: 192.168.40.100,3260]
May 28 02:08:25.307469 np0000001583 nova-compute[98241]: Logout of [sid: 166, target: iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f, portal: 192.168.40.100,3260] successful.
May 28 02:08:25.307469 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:25.324993 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-836f9770-9884-4184-b434-05c26e07c562 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:25.336565 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-836f9770-9884-4184-b434-05c26e07c562 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:25.370435 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-836f9770-9884-4184-b434-05c26e07c562 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 165, target: iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f, portal: 192.168.50.100,3260]
May 28 02:08:25.370435 np0000001583 nova-compute[98241]: Logout of [sid: 165, target: iqn.2023-03.storpool.com:os--volume-413c1626-029d-4661-adfe-35d7c499f90f, portal: 192.168.50.100,3260] successful.
May 28 02:08:25.370435 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:25.395109 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-836f9770-9884-4184-b434-05c26e07c562 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:25.395109 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-836f9770-9884-4184-b434-05c26e07c562 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:08:25.395109 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-836f9770-9884-4184-b434-05c26e07c562 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] <== disconnect_volume: return (333ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:08:25.395109 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-836f9770-9884-4184-b434-05c26e07c562 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:08:25.674846 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 02:08:25.691128 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:25.692673 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:25.706585 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:08:25.707824 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:08:25.707943 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:08:25.708631 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Auditing locally available compute resources for np0000001583 (node: np0000001583) {{(pid=98241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 02:08:25.714251 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:25.741861 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:25.915487 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a949366e-91cc-48a3-aa09-db534a696e70 req-3a3a0ad5-6a6e-413f-83c8-6bd63659b0f3 service nova] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Received event network-vif-unplugged-87489626-7d65-4bc9-bd0e-300688717b63 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:08:25.916367 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a949366e-91cc-48a3-aa09-db534a696e70 req-3a3a0ad5-6a6e-413f-83c8-6bd63659b0f3 service nova] Acquiring lock "5b81046a-d6a2-412e-8f9a-2ab41e8fd991-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:08:25.916518 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a949366e-91cc-48a3-aa09-db534a696e70 req-3a3a0ad5-6a6e-413f-83c8-6bd63659b0f3 service nova] Lock "5b81046a-d6a2-412e-8f9a-2ab41e8fd991-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:08:25.916637 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a949366e-91cc-48a3-aa09-db534a696e70 req-3a3a0ad5-6a6e-413f-83c8-6bd63659b0f3 service nova] Lock "5b81046a-d6a2-412e-8f9a-2ab41e8fd991-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:08:25.916782 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a949366e-91cc-48a3-aa09-db534a696e70 req-3a3a0ad5-6a6e-413f-83c8-6bd63659b0f3 service nova] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] No waiting events found dispatching network-vif-unplugged-87489626-7d65-4bc9-bd0e-300688717b63 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:08:25.916889 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a949366e-91cc-48a3-aa09-db534a696e70 req-3a3a0ad5-6a6e-413f-83c8-6bd63659b0f3 service nova] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Received event network-vif-unplugged-87489626-7d65-4bc9-bd0e-300688717b63 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:08:25.956678 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-836f9770-9884-4184-b434-05c26e07c562 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lazy-loading 'flavor' on Instance uuid a7b60291-5fd2-479e-9c9c-924b79f880a7 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:08:25.987148 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:25.995563 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:26.016947 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999616476000028 future=<Future at 0x7724ec4b0fb0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:08:26.016947 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999255105999964 future=<Future at 0x7724ec4b0fb0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:08:26.016947 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999090907000209 future=<Future at 0x7724ec4b0fb0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:08:26.024840 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Instance destroyed successfully.
May 28 02:08:26.026432 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lazy-loading 'resources' on Instance uuid 5b81046a-d6a2-412e-8f9a-2ab41e8fd991 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:08:26.526579 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:26.529545 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T02:07:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1761756426',display_name='tempest-TestEncryptedCinderVolumes-server-1761756426',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testencryptedcindervolumes-server-1761756426',id=68,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBvIuscC5Hl9LuYYLq2wWivaHaebRNHPQIeYgqv7q1vZGG0QAw9Hdt3V++LObVUv3gsFUugch3GmPHbbfwH6piykof8GCWeT2LLzcMRX5UhzJRQuWby1FNbyksEPsTs9eg==',key_name='tempest-TestEncryptedCinderVolumes-1555008274',keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:07:44Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b7ada2896b1043bfb246c28ad9d1e174',ramdisk_id='',reservation_id='r-cw18en14',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',owner_project_name='tempest-TestEncryptedCinderVolumes-1693604386',owner_user_name='tempest-TestEncryptedCinderVolumes-1693604386-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T02:07:45Z,user_data=None,user_id='2b5bf0f126624ddab4bd36a1b707899e',uuid=5b81046a-d6a2-412e-8f9a-2ab41e8fd991,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "87489626-7d65-4bc9-bd0e-300688717b63", "address": "fa:16:3e:1c:a0:9a", "network": {"id": "ef15cd88-386f-4fc6-8df0-74267f73d3fb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1804869041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b7ada2896b1043bfb246c28ad9d1e174", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap87489626-7d", "ovs_interfaceid": "87489626-7d65-4bc9-bd0e-300688717b63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:08:26.529545 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Converting VIF {"id": "87489626-7d65-4bc9-bd0e-300688717b63", "address": "fa:16:3e:1c:a0:9a", "network": {"id": "ef15cd88-386f-4fc6-8df0-74267f73d3fb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1804869041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b7ada2896b1043bfb246c28ad9d1e174", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap87489626-7d", "ovs_interfaceid": "87489626-7d65-4bc9-bd0e-300688717b63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:08:26.530037 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:a0:9a,bridge_name='br-int',has_traffic_filtering=True,id=87489626-7d65-4bc9-bd0e-300688717b63,network=Network(ef15cd88-386f-4fc6-8df0-74267f73d3fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87489626-7d') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:08:26.530323 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:a0:9a,bridge_name='br-int',has_traffic_filtering=True,id=87489626-7d65-4bc9-bd0e-300688717b63,network=Network(ef15cd88-386f-4fc6-8df0-74267f73d3fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87489626-7d') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:08:26.531798 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:26.532025 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap87489626-7d, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:08:26.536674 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:26.537534 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:08:26.541789 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:26.542001 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=96b47862-e425-4ea9-84d0-775aaffc7abb) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:08:26.546013 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:08:26.553013 np0000001583 nova-compute[98241]: INFO os_vif [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:a0:9a,bridge_name='br-int',has_traffic_filtering=True,id=87489626-7d65-4bc9-bd0e-300688717b63,network=Network(ef15cd88-386f-4fc6-8df0-74267f73d3fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87489626-7d')
May 28 02:08:26.561442 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:08:26.561821 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9', 'iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '79578bb5-fcb4-42d4-891a-524f17a519d9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-10'}, None), 'kwargs': {'force': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:08:26.562026 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:08:26.565465 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:08:26.565889 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9', 'iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '79578bb5-fcb4-42d4-891a-524f17a519d9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:08:26.566130 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:08:26.598889 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:08:26.598889 np0000001583 nova-compute[98241]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:08:26.598889 np0000001583 nova-compute[98241]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:08:26.598889 np0000001583 nova-compute[98241]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:08:26.598889 np0000001583 nova-compute[98241]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907 (non-flash)
May 28 02:08:26.598889 np0000001583 nova-compute[98241]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907 (non-flash)
May 28 02:08:26.598889 np0000001583 nova-compute[98241]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4095e7b4-59b5-441d-9212-678b15bc3160 (non-flash)
May 28 02:08:26.598889 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:08:26.599353 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsi session list stdout=tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:08:26.599353 np0000001583 nova-compute[98241]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:08:26.599353 np0000001583 nova-compute[98241]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:08:26.599353 np0000001583 nova-compute[98241]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9 (non-flash)
May 28 02:08:26.599353 np0000001583 nova-compute[98241]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907 (non-flash)
May 28 02:08:26.599353 np0000001583 nova-compute[98241]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907 (non-flash)
May 28 02:08:26.599353 np0000001583 nova-compute[98241]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4095e7b4-59b5-441d-9212-678b15bc3160 (non-flash)
May 28 02:08:26.599353 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:08:26.599353 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d', '155'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d', '156'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9', '162'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9', '163'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907', '168'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907', '169'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4095e7b4-59b5-441d-9212-678b15bc3160', '170')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:08:26.600021 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9', '162')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:08:26.600554 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9', '163')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:08:26.601334 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f84d8d60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9'): ({'sdl'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:08:26.601528 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Removing multipathed devices sdk, sdl {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:08:26.601726 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Flush multipath device 330000000db18e4eb {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:08:26.631112 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:08:26.674395 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:08:26.725031 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Checking to see if SCSI volumes sdk, sdl have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:08:26.725215 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] SCSI volumes sdk, sdl have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:08:26.726263 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Checking to see if device paths {'sdk', 'sdl'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:08:26.738504 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Device paths {'sdk', 'sdl'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:08:26.738797 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:08:26.751197 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:26.784560 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 162, target: iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9, portal: 192.168.40.100,3260]
May 28 02:08:26.784560 np0000001583 nova-compute[98241]: Logout of [sid: 162, target: iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9, portal: 192.168.40.100,3260] successful.
May 28 02:08:26.784560 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:26.800872 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:26.813122 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:26.854327 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 163, target: iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9, portal: 192.168.50.100,3260]
May 28 02:08:26.854327 np0000001583 nova-compute[98241]: Logout of [sid: 163, target: iqn.2023-03.storpool.com:os--volume-79578bb5-fcb4-42d4-891a-524f17a519d9, portal: 192.168.50.100,3260] successful.
May 28 02:08:26.854327 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:26.873676 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:26.875009 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:08:26.875210 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] <== disconnect_volume: return (313ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:08:26.875368 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:08:26.875682 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Deleting instance files /opt/stack/data/nova/instances/5b81046a-d6a2-412e-8f9a-2ab41e8fd991_del
May 28 02:08:26.876337 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Deletion of /opt/stack/data/nova/instances/5b81046a-d6a2-412e-8f9a-2ab41e8fd991_del complete
May 28 02:08:26.964788 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-836f9770-9884-4184-b434-05c26e07c562 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lock "a7b60291-5fd2-479e-9c9c-924b79f880a7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.063s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:08:27.050268 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08450cf0-e778-4831-82f9-bd268655c346/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:08:27.160789 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08450cf0-e778-4831-82f9-bd268655c346/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:08:27.161417 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08450cf0-e778-4831-82f9-bd268655c346/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:08:27.266993 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08450cf0-e778-4831-82f9-bd268655c346/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:08:27.272363 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Periodic task is updating the host stat, it is trying to get disk instance-00000044, but disk file was removed by concurrent operations such as resize.: FileNotFoundError: [Errno 2] No such file or directory: '/opt/stack/data/nova/instances/5b81046a-d6a2-412e-8f9a-2ab41e8fd991/disk.config'
May 28 02:08:27.274579 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 02:08:27.274679 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/dm-2 (vdc) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 02:08:27.277588 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:08:27.278559 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:08:27.325463 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.047s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:08:27.325838 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Hypervisor/Node resource view: name=np0000001583 free_ram=12929MB free_disk=72.7454605102539GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 02:08:27.326058 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:08:27.326360 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:08:27.383442 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Took 1.71 seconds to destroy the instance on the hypervisor.
May 28 02:08:27.387010 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 02:08:27.387596 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 02:08:27.387761 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 02:08:27.388190 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:08:27.451713 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:08:27.979293 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2173e993-2572-4b14-aa8f-af920b247956 req-704465aa-ced2-46fc-8cb2-c3eabc541dfb service nova] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Received event network-vif-unplugged-87489626-7d65-4bc9-bd0e-300688717b63 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:08:27.979637 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2173e993-2572-4b14-aa8f-af920b247956 req-704465aa-ced2-46fc-8cb2-c3eabc541dfb service nova] Acquiring lock "5b81046a-d6a2-412e-8f9a-2ab41e8fd991-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:08:27.980002 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2173e993-2572-4b14-aa8f-af920b247956 req-704465aa-ced2-46fc-8cb2-c3eabc541dfb service nova] Lock "5b81046a-d6a2-412e-8f9a-2ab41e8fd991-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:08:27.980195 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2173e993-2572-4b14-aa8f-af920b247956 req-704465aa-ced2-46fc-8cb2-c3eabc541dfb service nova] Lock "5b81046a-d6a2-412e-8f9a-2ab41e8fd991-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:08:27.980334 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2173e993-2572-4b14-aa8f-af920b247956 req-704465aa-ced2-46fc-8cb2-c3eabc541dfb service nova] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] No waiting events found dispatching network-vif-unplugged-87489626-7d65-4bc9-bd0e-300688717b63 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:08:27.981388 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2173e993-2572-4b14-aa8f-af920b247956 req-704465aa-ced2-46fc-8cb2-c3eabc541dfb service nova] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Received event network-vif-unplugged-87489626-7d65-4bc9-bd0e-300688717b63 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:08:27.981731 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2173e993-2572-4b14-aa8f-af920b247956 req-704465aa-ced2-46fc-8cb2-c3eabc541dfb service nova] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Received event network-vif-deleted-87489626-7d65-4bc9-bd0e-300688717b63 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:08:27.981885 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-2173e993-2572-4b14-aa8f-af920b247956 req-704465aa-ced2-46fc-8cb2-c3eabc541dfb service nova] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Neutron deleted interface 87489626-7d65-4bc9-bd0e-300688717b63; detaching it from the instance and deleting it from the info cache
May 28 02:08:27.983879 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2173e993-2572-4b14-aa8f-af920b247956 req-704465aa-ced2-46fc-8cb2-c3eabc541dfb service nova] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Detach interface failed, port_id=87489626-7d65-4bc9-bd0e-300688717b63, reason: Instance 5b81046a-d6a2-412e-8f9a-2ab41e8fd991 could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 02:08:28.396531 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance a7b60291-5fd2-479e-9c9c-924b79f880a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:08:28.396644 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 5b81046a-d6a2-412e-8f9a-2ab41e8fd991 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:08:28.396719 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 08450cf0-e778-4831-82f9-bd268655c346 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:08:28.396870 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 02:08:28.397020 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Final resource view: name=np0000001583 phys_ram=24030MB used_ram=1088MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:08:27 up 44 min,  2 users,  load average: 3.68, 5.54, 4.87\n', 'num_instances': '3', 'num_vm_active': '3', 'num_task_None': '2', 'num_os_type_None': '3', 'num_proj_359205e9f0214f1795234b72dbbf45c6': '1', 'io_workload': '0', 'num_proj_d192b18567fd4735988dd19da06fb868': '1', 'num_task_deleting': '1', 'num_proj_b7ada2896b1043bfb246c28ad9d1e174': '1'} {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 02:08:28.401695 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:08:28.556890 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:28.618370 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:08:28.618600 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:08:28.904246 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Took 1.52 seconds to deallocate network for instance.
May 28 02:08:29.124875 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:08:29.273112 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:29.460006 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Took 0.56 seconds to detach 1 volumes for instance.
May 28 02:08:29.633275 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Compute_service record updated for np0000001583:np0000001583 {{(pid=98241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 02:08:29.633606 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.307s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:08:29.633921 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.99 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:08:29.967200 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:08:29.967390 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:08:30.167541 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:08:30.167904 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:08:30.675044 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:08:31.184441 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.217s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:08:31.253819 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Deleted allocations for instance 5b81046a-d6a2-412e-8f9a-2ab41e8fd991
May 28 02:08:31.543645 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:31.627978 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:08:31.628329 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:08:31.628621 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:08:31.628923 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:08:31.629100 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 02:08:31.629260 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 49.56 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:08:32.041102 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-18f388d3-f452-4564-bf0a-9013c404bc3d tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Acquiring lock "a7b60291-5fd2-479e-9c9c-924b79f880a7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:08:32.041277 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-18f388d3-f452-4564-bf0a-9013c404bc3d tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lock "a7b60291-5fd2-479e-9c9c-924b79f880a7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:08:32.117694 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:32.263515 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-14a7c13d-643f-414b-a2f1-b6f4e81c9dc0 tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "5b81046a-d6a2-412e-8f9a-2ab41e8fd991" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.100s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:08:32.544648 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-18f388d3-f452-4564-bf0a-9013c404bc3d tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Detaching volume dd760579-395a-4bce-8993-8f9791514907
May 28 02:08:32.595933 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-18f388d3-f452-4564-bf0a-9013c404bc3d tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Attempting to driver detach volume dd760579-395a-4bce-8993-8f9791514907 from mountpoint /dev/vdc
May 28 02:08:32.603656 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-18f388d3-f452-4564-bf0a-9013c404bc3d tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Found disk vdc by alias ua-dd760579-395a-4bce-8993-8f9791514907 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:08:32.605369 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-18f388d3-f452-4564-bf0a-9013c404bc3d tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Found disk vdc by alias ua-dd760579-395a-4bce-8993-8f9791514907 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:08:32.605568 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-18f388d3-f452-4564-bf0a-9013c404bc3d tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Attempting to detach device vdc from instance a7b60291-5fd2-479e-9c9c-924b79f880a7 from the persistent domain config. {{(pid=98241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 02:08:32.605916 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-18f388d3-f452-4564-bf0a-9013c404bc3d tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:08:32.605916 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:08:32.605916 np0000001583 nova-compute[98241]:   <alias name="ua-dd760579-395a-4bce-8993-8f9791514907"/>
May 28 02:08:32.605916 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-2"/>
May 28 02:08:32.605916 np0000001583 nova-compute[98241]:   <target dev="vdc" bus="virtio"/>
May 28 02:08:32.605916 np0000001583 nova-compute[98241]:   <serial>dd760579-395a-4bce-8993-8f9791514907</serial>
May 28 02:08:32.605916 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 28 02:08:32.605916 np0000001583 nova-compute[98241]: </disk>
May 28 02:08:32.605916 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:08:32.619388 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-18f388d3-f452-4564-bf0a-9013c404bc3d tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Successfully detached device vdc from instance a7b60291-5fd2-479e-9c9c-924b79f880a7 from the persistent domain config.
May 28 02:08:32.619582 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-18f388d3-f452-4564-bf0a-9013c404bc3d tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] (1/8): Attempting to detach device vdc with device alias ua-dd760579-395a-4bce-8993-8f9791514907 from instance a7b60291-5fd2-479e-9c9c-924b79f880a7 from the live domain config. {{(pid=98241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 02:08:32.619803 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-18f388d3-f452-4564-bf0a-9013c404bc3d tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:08:32.619803 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:08:32.619803 np0000001583 nova-compute[98241]:   <alias name="ua-dd760579-395a-4bce-8993-8f9791514907"/>
May 28 02:08:32.619803 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-2"/>
May 28 02:08:32.619803 np0000001583 nova-compute[98241]:   <target dev="vdc" bus="virtio"/>
May 28 02:08:32.619803 np0000001583 nova-compute[98241]:   <serial>dd760579-395a-4bce-8993-8f9791514907</serial>
May 28 02:08:32.619803 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 28 02:08:32.619803 np0000001583 nova-compute[98241]: </disk>
May 28 02:08:32.619803 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:08:33.224333 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Received event <DeviceRemovedEvent: 1779934113.2238994, a7b60291-5fd2-479e-9c9c-924b79f880a7 => ua-dd760579-395a-4bce-8993-8f9791514907> from libvirt while the driver is waiting for it; dispatched. {{(pid=98241) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 02:08:33.225638 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-18f388d3-f452-4564-bf0a-9013c404bc3d tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-dd760579-395a-4bce-8993-8f9791514907 for instance a7b60291-5fd2-479e-9c9c-924b79f880a7 {{(pid=98241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 02:08:33.228582 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-18f388d3-f452-4564-bf0a-9013c404bc3d tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Successfully detached device vdc from instance a7b60291-5fd2-479e-9c9c-924b79f880a7 from the live domain config.
May 28 02:08:33.229840 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18f388d3-f452-4564-bf0a-9013c404bc3d tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:08:33.230235 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-18f388d3-f452-4564-bf0a-9013c404bc3d tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907', 'iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dd760579-395a-4bce-8993-8f9791514907', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:08:33.230405 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-18f388d3-f452-4564-bf0a-9013c404bc3d tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:08:33.565794 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:33.972246 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:35.488393 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-18f388d3-f452-4564-bf0a-9013c404bc3d tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.258s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:08:35.488844 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-18f388d3-f452-4564-bf0a-9013c404bc3d tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907', 'iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dd760579-395a-4bce-8993-8f9791514907', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:08:35.490413 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-18f388d3-f452-4564-bf0a-9013c404bc3d tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:08:35.522230 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-18f388d3-f452-4564-bf0a-9013c404bc3d tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:08:35.522230 np0000001583 nova-compute[98241]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:08:35.522230 np0000001583 nova-compute[98241]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907 (non-flash)
May 28 02:08:35.522230 np0000001583 nova-compute[98241]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907 (non-flash)
May 28 02:08:35.522230 np0000001583 nova-compute[98241]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4095e7b4-59b5-441d-9212-678b15bc3160 (non-flash)
May 28 02:08:35.522230 np0000001583 nova-compute[98241]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:08:35.522230 np0000001583 nova-compute[98241]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:08:35.522230 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:08:35.522545 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-18f388d3-f452-4564-bf0a-9013c404bc3d tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsi session list stdout=tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:08:35.522545 np0000001583 nova-compute[98241]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:08:35.522545 np0000001583 nova-compute[98241]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907 (non-flash)
May 28 02:08:35.522545 np0000001583 nova-compute[98241]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907 (non-flash)
May 28 02:08:35.522545 np0000001583 nova-compute[98241]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4095e7b4-59b5-441d-9212-678b15bc3160 (non-flash)
May 28 02:08:35.522545 np0000001583 nova-compute[98241]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:08:35.522545 np0000001583 nova-compute[98241]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:08:35.522545 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:08:35.522742 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-18f388d3-f452-4564-bf0a-9013c404bc3d tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d', '155'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d', '156'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907', '168'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907', '169'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4095e7b4-59b5-441d-9212-678b15bc3160', '170'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c', '171'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c', '172')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:08:35.522742 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-18f388d3-f452-4564-bf0a-9013c404bc3d tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907', '168')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:08:35.523972 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-18f388d3-f452-4564-bf0a-9013c404bc3d tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907', '169')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:08:35.525071 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-18f388d3-f452-4564-bf0a-9013c404bc3d tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f84d8cc0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907'): ({'sdh'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:08:35.525528 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-18f388d3-f452-4564-bf0a-9013c404bc3d tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Removing multipathed devices sdh, sdg {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:08:35.525648 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-18f388d3-f452-4564-bf0a-9013c404bc3d tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Flush multipath device 3300000005e7606f1 {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:08:35.565034 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-18f388d3-f452-4564-bf0a-9013c404bc3d tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:08:35.616967 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-18f388d3-f452-4564-bf0a-9013c404bc3d tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:08:35.659481 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-18f388d3-f452-4564-bf0a-9013c404bc3d tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Checking to see if SCSI volumes sdh, sdg have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:08:35.659790 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-18f388d3-f452-4564-bf0a-9013c404bc3d tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] SCSI volumes sdh, sdg have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:08:35.660841 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-18f388d3-f452-4564-bf0a-9013c404bc3d tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Checking to see if device paths {'sdh', 'sdg'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:08:35.682916 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-18f388d3-f452-4564-bf0a-9013c404bc3d tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Device paths {'sdh', 'sdg'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:08:35.683247 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-18f388d3-f452-4564-bf0a-9013c404bc3d tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:08:35.695969 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-18f388d3-f452-4564-bf0a-9013c404bc3d tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:35.732015 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-18f388d3-f452-4564-bf0a-9013c404bc3d tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 168, target: iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907, portal: 192.168.40.100,3260]
May 28 02:08:35.732015 np0000001583 nova-compute[98241]: Logout of [sid: 168, target: iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907, portal: 192.168.40.100,3260] successful.
May 28 02:08:35.732015 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:35.750273 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-18f388d3-f452-4564-bf0a-9013c404bc3d tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:35.762201 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-18f388d3-f452-4564-bf0a-9013c404bc3d tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:35.801277 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-18f388d3-f452-4564-bf0a-9013c404bc3d tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 169, target: iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907, portal: 192.168.50.100,3260]
May 28 02:08:35.801277 np0000001583 nova-compute[98241]: Logout of [sid: 169, target: iqn.2023-03.storpool.com:os--volume-dd760579-395a-4bce-8993-8f9791514907, portal: 192.168.50.100,3260] successful.
May 28 02:08:35.801277 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:35.816648 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-18f388d3-f452-4564-bf0a-9013c404bc3d tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:35.816985 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-18f388d3-f452-4564-bf0a-9013c404bc3d tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:08:35.817306 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-18f388d3-f452-4564-bf0a-9013c404bc3d tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] <== disconnect_volume: return (2586ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:08:35.817378 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18f388d3-f452-4564-bf0a-9013c404bc3d tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:08:36.370736 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-18f388d3-f452-4564-bf0a-9013c404bc3d tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lazy-loading 'flavor' on Instance uuid a7b60291-5fd2-479e-9c9c-924b79f880a7 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:08:36.545998 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:37.381974 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-18f388d3-f452-4564-bf0a-9013c404bc3d tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lock "a7b60291-5fd2-479e-9c9c-924b79f880a7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.341s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:08:37.886446 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Acquiring lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:08:37.886950 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:08:38.388306 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 02:08:38.567328 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:38.664249 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d8953289-0c6c-4fd2-acd6-7973e16f5984 req-955b5e49-3bf9-47cb-b2cb-42697a1bd7d1 service nova] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Received event network-changed-02f4d882-7b01-4a87-8666-10c3d4295a89 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:08:38.664452 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d8953289-0c6c-4fd2-acd6-7973e16f5984 req-955b5e49-3bf9-47cb-b2cb-42697a1bd7d1 service nova] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Refreshing instance network info cache due to event network-changed-02f4d882-7b01-4a87-8666-10c3d4295a89. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:08:38.664667 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d8953289-0c6c-4fd2-acd6-7973e16f5984 req-955b5e49-3bf9-47cb-b2cb-42697a1bd7d1 service nova] Acquiring lock "refresh_cache-a7b60291-5fd2-479e-9c9c-924b79f880a7" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:08:38.664805 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d8953289-0c6c-4fd2-acd6-7973e16f5984 req-955b5e49-3bf9-47cb-b2cb-42697a1bd7d1 service nova] Acquired lock "refresh_cache-a7b60291-5fd2-479e-9c9c-924b79f880a7" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:08:38.664994 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-d8953289-0c6c-4fd2-acd6-7973e16f5984 req-955b5e49-3bf9-47cb-b2cb-42697a1bd7d1 service nova] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Refreshing network info cache for port 02f4d882-7b01-4a87-8666-10c3d4295a89 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:08:38.938106 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:08:38.938581 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:08:38.942547 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 02:08:38.942702 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Claim successful on node np0000001583
May 28 02:08:39.146026 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-1d6945d1-fcdf-43d8-abc9-efe740e70419 req-166444e8-8167-4ebe-9e6a-e863f561ed1b service nova] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Received event network-changed-02f4d882-7b01-4a87-8666-10c3d4295a89 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:08:39.148133 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-1d6945d1-fcdf-43d8-abc9-efe740e70419 req-166444e8-8167-4ebe-9e6a-e863f561ed1b service nova] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Refreshing instance network info cache due to event network-changed-02f4d882-7b01-4a87-8666-10c3d4295a89. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:08:39.148459 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-1d6945d1-fcdf-43d8-abc9-efe740e70419 req-166444e8-8167-4ebe-9e6a-e863f561ed1b service nova] Acquiring lock "refresh_cache-a7b60291-5fd2-479e-9c9c-924b79f880a7" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:08:39.172596 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-d8953289-0c6c-4fd2-acd6-7973e16f5984 req-955b5e49-3bf9-47cb-b2cb-42697a1bd7d1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:08:39.518098 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-d8953289-0c6c-4fd2-acd6-7973e16f5984 req-955b5e49-3bf9-47cb-b2cb-42697a1bd7d1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:08:39.646173 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-d8953289-0c6c-4fd2-acd6-7973e16f5984 req-955b5e49-3bf9-47cb-b2cb-42697a1bd7d1 service nova] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Updated VIF entry in instance network info cache for port 02f4d882-7b01-4a87-8666-10c3d4295a89. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:08:39.646173 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-d8953289-0c6c-4fd2-acd6-7973e16f5984 req-955b5e49-3bf9-47cb-b2cb-42697a1bd7d1 service nova] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Updating instance_info_cache with network_info: [{"id": "02f4d882-7b01-4a87-8666-10c3d4295a89", "address": "fa:16:3e:63:3f:3b", "network": {"id": "716b3825-100d-45f0-8db3-3d2dc26813c4", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1126424154-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "359205e9f0214f1795234b72dbbf45c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap02f4d882-7b", "ovs_interfaceid": "02f4d882-7b01-4a87-8666-10c3d4295a89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:08:39.667404 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Acquiring lock "a7b60291-5fd2-479e-9c9c-924b79f880a7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:08:39.667404 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lock "a7b60291-5fd2-479e-9c9c-924b79f880a7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:08:39.667404 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Acquiring lock "a7b60291-5fd2-479e-9c9c-924b79f880a7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:08:39.667404 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lock "a7b60291-5fd2-479e-9c9c-924b79f880a7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:08:39.667404 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lock "a7b60291-5fd2-479e-9c9c-924b79f880a7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:08:39.669109 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Terminating instance
May 28 02:08:40.147688 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d8953289-0c6c-4fd2-acd6-7973e16f5984 req-955b5e49-3bf9-47cb-b2cb-42697a1bd7d1 service nova] Releasing lock "refresh_cache-a7b60291-5fd2-479e-9c9c-924b79f880a7" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:08:40.147688 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-1d6945d1-fcdf-43d8-abc9-efe740e70419 req-166444e8-8167-4ebe-9e6a-e863f561ed1b service nova] Acquired lock "refresh_cache-a7b60291-5fd2-479e-9c9c-924b79f880a7" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:08:40.148132 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-1d6945d1-fcdf-43d8-abc9-efe740e70419 req-166444e8-8167-4ebe-9e6a-e863f561ed1b service nova] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Refreshing network info cache for port 02f4d882-7b01-4a87-8666-10c3d4295a89 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:08:40.164479 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:08:40.164734 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:08:40.175057 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 02:08:40.193797 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:40.195064 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:40.214472 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:40.217536 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:40.236796 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:40.242990 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:40.525948 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999658997000097 future=<Future at 0x7724f83f1820 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:08:40.530034 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Instance destroyed successfully.
May 28 02:08:40.530034 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lazy-loading 'resources' on Instance uuid a7b60291-5fd2-479e-9c9c-924b79f880a7 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:08:40.651756 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-1d6945d1-fcdf-43d8-abc9-efe740e70419 req-166444e8-8167-4ebe-9e6a-e863f561ed1b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:08:40.668239 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:08:40.734109 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-c44b9815-83b9-4364-9d31-e82e5d8365ac req-c95b19ef-e797-4877-a5a6-89056c5e5436 service nova] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Received event network-vif-unplugged-02f4d882-7b01-4a87-8666-10c3d4295a89 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:08:40.734109 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c44b9815-83b9-4364-9d31-e82e5d8365ac req-c95b19ef-e797-4877-a5a6-89056c5e5436 service nova] Acquiring lock "a7b60291-5fd2-479e-9c9c-924b79f880a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:08:40.734982 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c44b9815-83b9-4364-9d31-e82e5d8365ac req-c95b19ef-e797-4877-a5a6-89056c5e5436 service nova] Lock "a7b60291-5fd2-479e-9c9c-924b79f880a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:08:40.735172 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c44b9815-83b9-4364-9d31-e82e5d8365ac req-c95b19ef-e797-4877-a5a6-89056c5e5436 service nova] Lock "a7b60291-5fd2-479e-9c9c-924b79f880a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:08:40.735394 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-c44b9815-83b9-4364-9d31-e82e5d8365ac req-c95b19ef-e797-4877-a5a6-89056c5e5436 service nova] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] No waiting events found dispatching network-vif-unplugged-02f4d882-7b01-4a87-8666-10c3d4295a89 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:08:40.735486 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-c44b9815-83b9-4364-9d31-e82e5d8365ac req-c95b19ef-e797-4877-a5a6-89056c5e5436 service nova] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Received event network-vif-unplugged-02f4d882-7b01-4a87-8666-10c3d4295a89 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:08:40.735583 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-c44b9815-83b9-4364-9d31-e82e5d8365ac req-c95b19ef-e797-4877-a5a6-89056c5e5436 service nova] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Received event network-vif-unplugged-02f4d882-7b01-4a87-8666-10c3d4295a89 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:08:40.735739 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c44b9815-83b9-4364-9d31-e82e5d8365ac req-c95b19ef-e797-4877-a5a6-89056c5e5436 service nova] Acquiring lock "a7b60291-5fd2-479e-9c9c-924b79f880a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:08:40.738994 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c44b9815-83b9-4364-9d31-e82e5d8365ac req-c95b19ef-e797-4877-a5a6-89056c5e5436 service nova] Lock "a7b60291-5fd2-479e-9c9c-924b79f880a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:08:40.740430 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-c44b9815-83b9-4364-9d31-e82e5d8365ac req-c95b19ef-e797-4877-a5a6-89056c5e5436 service nova] Lock "a7b60291-5fd2-479e-9c9c-924b79f880a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:08:40.740897 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-c44b9815-83b9-4364-9d31-e82e5d8365ac req-c95b19ef-e797-4877-a5a6-89056c5e5436 service nova] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] No waiting events found dispatching network-vif-unplugged-02f4d882-7b01-4a87-8666-10c3d4295a89 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:08:40.741057 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-c44b9815-83b9-4364-9d31-e82e5d8365ac req-c95b19ef-e797-4877-a5a6-89056c5e5436 service nova] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Received event network-vif-unplugged-02f4d882-7b01-4a87-8666-10c3d4295a89 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:08:41.016536 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0004998089998480282 future=<Future at 0x7724ec4b0fb0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:08:41.017186 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Emitting event <LifecycleEvent: 1779934106.015892, 5b81046a-d6a2-412e-8f9a-2ab41e8fd991 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:08:41.017437 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:08:41.017658 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] VM Stopped (Lifecycle Event)
May 28 02:08:41.019029 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.50648600400018 future=<Future at 0x7724f83f1820 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:08:41.019539 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.506267492000006 future=<Future at 0x7724f83f1820 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:08:41.032406 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T02:07:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-server-1520684336',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testinstanceswithcindervolumes-server-1520684336',id=67,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAOMO4z0Q1I2hlWqF86l1q6L1sJIZ+GdV9rU75w/a7dsdeBC24HI9zarZtxyVrEBincgWbi3ByTWpdtMEYvgfZfgn1Wtzm/PnUPbhKup63GrBsxHRchAd0CfA4sPdnQUEg==',key_name='tempest-TestInstancesWithCinderVolumes-1570564010',keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:07:17Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='359205e9f0214f1795234b72dbbf45c6',ramdisk_id='',reservation_id='r-bxu6x0nw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_signature_verified='False',owner_project_name='tempest-TestInstancesWithCinderVolumes-117749394',owner_user_name='tempest-TestInstancesWithCinderVolumes-117749394-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T02:07:18Z,user_data=None,user_id='76a39c8fe434421392f1276fcb452550',uuid=a7b60291-5fd2-479e-9c9c-924b79f880a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "02f4d882-7b01-4a87-8666-10c3d4295a89", "address": "fa:16:3e:63:3f:3b", "network": {"id": "716b3825-100d-45f0-8db3-3d2dc26813c4", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1126424154-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "359205e9f0214f1795234b72dbbf45c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap02f4d882-7b", "ovs_interfaceid": "02f4d882-7b01-4a87-8666-10c3d4295a89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:08:41.032723 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Converting VIF {"id": "02f4d882-7b01-4a87-8666-10c3d4295a89", "address": "fa:16:3e:63:3f:3b", "network": {"id": "716b3825-100d-45f0-8db3-3d2dc26813c4", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1126424154-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "359205e9f0214f1795234b72dbbf45c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap02f4d882-7b", "ovs_interfaceid": "02f4d882-7b01-4a87-8666-10c3d4295a89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:08:41.033531 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:3f:3b,bridge_name='br-int',has_traffic_filtering=True,id=02f4d882-7b01-4a87-8666-10c3d4295a89,network=Network(716b3825-100d-45f0-8db3-3d2dc26813c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02f4d882-7b') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:08:41.033867 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:3f:3b,bridge_name='br-int',has_traffic_filtering=True,id=02f4d882-7b01-4a87-8666-10c3d4295a89,network=Network(716b3825-100d-45f0-8db3-3d2dc26813c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02f4d882-7b') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:08:41.036096 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:41.036366 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap02f4d882-7b, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:08:41.037904 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:41.039837 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:08:41.040489 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:41.040723 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6047bccd-fed6-4b24-9720-2b5e3a9183c1) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:08:41.041686 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:41.042255 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:08:41.044368 np0000001583 nova-compute[98241]: INFO os_vif [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:3f:3b,bridge_name='br-int',has_traffic_filtering=True,id=02f4d882-7b01-4a87-8666-10c3d4295a89,network=Network(716b3825-100d-45f0-8db3-3d2dc26813c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02f4d882-7b')
May 28 02:08:41.046010 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:08:41.046425 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d', 'iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ca1813c1-91d2-4ccd-8d9a-0d07267db49d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:08:41.046607 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:08:41.178721 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.240s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:08:41.179379 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 02:08:41.452515 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-1d6945d1-fcdf-43d8-abc9-efe740e70419 req-166444e8-8167-4ebe-9e6a-e863f561ed1b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:08:41.498706 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.452s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:08:41.499249 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d', 'iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ca1813c1-91d2-4ccd-8d9a-0d07267db49d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:08:41.499505 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:08:41.520811 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: 5b81046a-d6a2-412e-8f9a-2ab41e8fd991] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:08:41.531419 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:08:41.531419 np0000001583 nova-compute[98241]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:08:41.531419 np0000001583 nova-compute[98241]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:08:41.531419 np0000001583 nova-compute[98241]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:08:41.531419 np0000001583 nova-compute[98241]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4095e7b4-59b5-441d-9212-678b15bc3160 (non-flash)
May 28 02:08:41.531419 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:08:41.531619 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsi session list stdout=tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:08:41.531619 np0000001583 nova-compute[98241]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d (non-flash)
May 28 02:08:41.531619 np0000001583 nova-compute[98241]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:08:41.531619 np0000001583 nova-compute[98241]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:08:41.531619 np0000001583 nova-compute[98241]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4095e7b4-59b5-441d-9212-678b15bc3160 (non-flash)
May 28 02:08:41.531619 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:08:41.531739 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d', '155'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d', '156'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c', '171'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c', '172'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4095e7b4-59b5-441d-9212-678b15bc3160', '173')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:08:41.531847 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d', '155')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:08:41.532794 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d', '156')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:08:41.533620 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f84d8f40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d'): ({'sdc'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:08:41.533817 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Removing multipathed devices sdc, sdb {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:08:41.534257 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Flush multipath device 330000000646e0a24 {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:08:41.598527 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:08:41.621230 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-1d6945d1-fcdf-43d8-abc9-efe740e70419 req-166444e8-8167-4ebe-9e6a-e863f561ed1b service nova] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Updated VIF entry in instance network info cache for port 02f4d882-7b01-4a87-8666-10c3d4295a89. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:08:41.621455 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-1d6945d1-fcdf-43d8-abc9-efe740e70419 req-166444e8-8167-4ebe-9e6a-e863f561ed1b service nova] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Updating instance_info_cache with network_info: [{"id": "02f4d882-7b01-4a87-8666-10c3d4295a89", "address": "fa:16:3e:63:3f:3b", "network": {"id": "716b3825-100d-45f0-8db3-3d2dc26813c4", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1126424154-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "359205e9f0214f1795234b72dbbf45c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap02f4d882-7b", "ovs_interfaceid": "02f4d882-7b01-4a87-8666-10c3d4295a89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:08:41.645619 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:08:41.685420 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 02:08:41.687535 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 02:08:41.687535 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:08:41.687535 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:08:41.695476 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:08:41.695676 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:08:41.696970 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:08:41.711739 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:08:41.712007 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:08:41.726667 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:41.762714 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 155, target: iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d, portal: 192.168.40.100,3260]
May 28 02:08:41.762714 np0000001583 nova-compute[98241]: Logout of [sid: 155, target: iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d, portal: 192.168.40.100,3260] successful.
May 28 02:08:41.762714 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:41.780258 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'af333dac9f9a4a6ab951ccb9c7f71e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3c7ad1bf6248aa8e7f10a9d2a212ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 02:08:41.782043 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:41.794548 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:41.832553 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 156, target: iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d, portal: 192.168.50.100,3260]
May 28 02:08:41.832553 np0000001583 nova-compute[98241]: Logout of [sid: 156, target: iqn.2023-03.storpool.com:os--volume-ca1813c1-91d2-4ccd-8d9a-0d07267db49d, portal: 192.168.50.100,3260] successful.
May 28 02:08:41.832553 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:41.847234 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:41.847512 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:08:41.847674 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] <== disconnect_volume: return (801ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:08:41.847809 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:08:41.848072 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Deleting instance files /opt/stack/data/nova/instances/a7b60291-5fd2-479e-9c9c-924b79f880a7_del
May 28 02:08:41.848594 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Deletion of /opt/stack/data/nova/instances/a7b60291-5fd2-479e-9c9c-924b79f880a7_del complete
May 28 02:08:42.123690 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-1d6945d1-fcdf-43d8-abc9-efe740e70419 req-166444e8-8167-4ebe-9e6a-e863f561ed1b service nova] Releasing lock "refresh_cache-a7b60291-5fd2-479e-9c9c-924b79f880a7" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:08:42.187625 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 02:08:42.342266 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Successfully created port: 367c4156-3d6b-42a4-960e-d17bbf5ffa36 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 02:08:42.355893 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Took 2.18 seconds to destroy the instance on the hypervisor.
May 28 02:08:42.356454 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 02:08:42.356649 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 02:08:42.356800 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 02:08:42.357067 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:08:42.439457 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:08:42.699014 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 02:08:42.759008 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-8818b7cd-0a7b-4f0a-8b2d-387481c72820 req-83d6077c-92c9-4c6a-8dfd-3a0c7f5d193e service nova] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Received event network-vif-deleted-02f4d882-7b01-4a87-8666-10c3d4295a89 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:08:42.759008 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-8818b7cd-0a7b-4f0a-8b2d-387481c72820 req-83d6077c-92c9-4c6a-8dfd-3a0c7f5d193e service nova] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Neutron deleted interface 02f4d882-7b01-4a87-8666-10c3d4295a89; detaching it from the instance and deleting it from the info cache
May 28 02:08:42.762256 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-8818b7cd-0a7b-4f0a-8b2d-387481c72820 req-83d6077c-92c9-4c6a-8dfd-3a0c7f5d193e service nova] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Detach interface failed, port_id=02f4d882-7b01-4a87-8666-10c3d4295a89, reason: Instance a7b60291-5fd2-479e-9c9c-924b79f880a7 could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 02:08:42.942785 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Successfully updated port: 367c4156-3d6b-42a4-960e-d17bbf5ffa36 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 02:08:42.991020 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-8ccee0bf-c8ca-48c4-9040-f9338047c759 req-857c734e-bc11-4593-a496-bad295995195 service nova] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Received event network-changed-367c4156-3d6b-42a4-960e-d17bbf5ffa36 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:08:42.992273 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-8ccee0bf-c8ca-48c4-9040-f9338047c759 req-857c734e-bc11-4593-a496-bad295995195 service nova] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Refreshing instance network info cache due to event network-changed-367c4156-3d6b-42a4-960e-d17bbf5ffa36. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:08:42.994198 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-8ccee0bf-c8ca-48c4-9040-f9338047c759 req-857c734e-bc11-4593-a496-bad295995195 service nova] Acquiring lock "refresh_cache-88e7dd8f-33f3-46e8-8d17-b9451bb627e5" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:08:42.994198 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-8ccee0bf-c8ca-48c4-9040-f9338047c759 req-857c734e-bc11-4593-a496-bad295995195 service nova] Acquired lock "refresh_cache-88e7dd8f-33f3-46e8-8d17-b9451bb627e5" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:08:42.994198 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-8ccee0bf-c8ca-48c4-9040-f9338047c759 req-857c734e-bc11-4593-a496-bad295995195 service nova] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Refreshing network info cache for port 367c4156-3d6b-42a4-960e-d17bbf5ffa36 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:08:43.196211 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:08:43.449945 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Acquiring lock "refresh_cache-88e7dd8f-33f3-46e8-8d17-b9451bb627e5" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:08:43.497116 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-8ccee0bf-c8ca-48c4-9040-f9338047c759 req-857c734e-bc11-4593-a496-bad295995195 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:08:43.563793 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-8ccee0bf-c8ca-48c4-9040-f9338047c759 req-857c734e-bc11-4593-a496-bad295995195 service nova] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:08:43.571436 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:43.699584 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Took 1.34 seconds to deallocate network for instance.
May 28 02:08:43.711502 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 02:08:43.714457 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-8ccee0bf-c8ca-48c4-9040-f9338047c759 req-857c734e-bc11-4593-a496-bad295995195 service nova] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:08:43.715547 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 02:08:43.716407 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Creating image(s)
May 28 02:08:43.717409 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Acquiring lock "/opt/stack/data/nova/instances/88e7dd8f-33f3-46e8-8d17-b9451bb627e5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:08:43.717622 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "/opt/stack/data/nova/instances/88e7dd8f-33f3-46e8-8d17-b9451bb627e5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:08:43.718138 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "/opt/stack/data/nova/instances/88e7dd8f-33f3-46e8-8d17-b9451bb627e5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:08:43.718716 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:08:43.724652 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:08:43.726504 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:08:43.825897 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.099s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:08:43.826415 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:08:43.826834 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:08:43.827287 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:08:43.829739 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:08:43.830002 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:08:43.944946 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.115s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:08:43.945581 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/88e7dd8f-33f3-46e8-8d17-b9451bb627e5/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:08:44.001472 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/88e7dd8f-33f3-46e8-8d17-b9451bb627e5/disk 1073741824" returned: 0 in 0.055s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:08:44.002039 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.175s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:08:44.002511 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:08:44.126577 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.124s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:08:44.127162 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Checking if we can resize image /opt/stack/data/nova/instances/88e7dd8f-33f3-46e8-8d17-b9451bb627e5/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 02:08:44.127453 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88e7dd8f-33f3-46e8-8d17-b9451bb627e5/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:08:44.219450 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-8ccee0bf-c8ca-48c4-9040-f9338047c759 req-857c734e-bc11-4593-a496-bad295995195 service nova] Releasing lock "refresh_cache-88e7dd8f-33f3-46e8-8d17-b9451bb627e5" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:08:44.220999 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Acquired lock "refresh_cache-88e7dd8f-33f3-46e8-8d17-b9451bb627e5" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:08:44.222006 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:08:44.240292 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88e7dd8f-33f3-46e8-8d17-b9451bb627e5/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:08:44.240682 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Cannot resize image /opt/stack/data/nova/instances/88e7dd8f-33f3-46e8-8d17-b9451bb627e5/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 02:08:44.241059 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 02:08:44.241287 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Ensure instance console log exists: /opt/stack/data/nova/instances/88e7dd8f-33f3-46e8-8d17-b9451bb627e5/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 02:08:44.241757 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:08:44.241845 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:08:44.242021 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:08:44.258386 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Took 0.56 seconds to detach 1 volumes for instance.
May 28 02:08:44.765227 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:08:44.765438 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:08:44.802208 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:08:44.993090 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:08:44.993338 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:08:45.002521 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:08:45.147104 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Updating instance_info_cache with network_info: [{"id": "367c4156-3d6b-42a4-960e-d17bbf5ffa36", "address": "fa:16:3e:28:6d:ad", "network": {"id": "b3baa185-7601-4866-99a0-be488d68a312", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-71067646-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aa3c7ad1bf6248aa8e7f10a9d2a212ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap367c4156-3d", "ovs_interfaceid": "367c4156-3d6b-42a4-960e-d17bbf5ffa36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:08:45.498280 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:08:45.650361 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Releasing lock "refresh_cache-88e7dd8f-33f3-46e8-8d17-b9451bb627e5" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:08:45.650682 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Instance network_info: |[{"id": "367c4156-3d6b-42a4-960e-d17bbf5ffa36", "address": "fa:16:3e:28:6d:ad", "network": {"id": "b3baa185-7601-4866-99a0-be488d68a312", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-71067646-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aa3c7ad1bf6248aa8e7f10a9d2a212ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap367c4156-3d", "ovs_interfaceid": "367c4156-3d6b-42a4-960e-d17bbf5ffa36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 02:08:45.652378 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Start _get_guest_xml network_info=[{"id": "367c4156-3d6b-42a4-960e-d17bbf5ffa36", "address": "fa:16:3e:28:6d:ad", "network": {"id": "b3baa185-7601-4866-99a0-be488d68a312", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-71067646-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aa3c7ad1bf6248aa8e7f10a9d2a212ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap367c4156-3d", "ovs_interfaceid": "367c4156-3d6b-42a4-960e-d17bbf5ffa36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 02:08:45.655220 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:08:45.656375 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-SnapshotDataIntegrityTests-server-2080038026', uuid='88e7dd8f-33f3-46e8-8d17-b9451bb627e5'), owner=OwnerMeta(userid='af333dac9f9a4a6ab951ccb9c7f71e3a', username='tempest-SnapshotDataIntegrityTests-432938357-project-member', projectid='aa3c7ad1bf6248aa8e7f10a9d2a212ce', projectname='tempest-SnapshotDataIntegrityTests-432938357'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "367c4156-3d6b-42a4-960e-d17bbf5ffa36", "address": "fa:16:3e:28:6d:ad", "network": {"id": "b3baa185-7601-4866-99a0-be488d68a312", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-71067646-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aa3c7ad1bf6248aa8e7f10a9d2a212ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap367c4156-3d", "ovs_interfaceid": "367c4156-3d6b-42a4-960e-d17bbf5ffa36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779934125.6560042) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 02:08:45.657529 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 02:08:45.657842 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 02:08:45.658821 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 02:08:45.658976 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 02:08:45.659784 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 02:08:45.660100 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 02:08:45.660628 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 02:08:45.660731 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 02:08:45.660855 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 02:08:45.660933 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 02:08:45.661025 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 02:08:45.661235 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 02:08:45.661401 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 02:08:45.661505 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 02:08:45.661603 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 02:08:45.661716 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 02:08:45.671651 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:08:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2080038026',display_name='tempest-SnapshotDataIntegrityTests-server-2080038026',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-snapshotdataintegritytests-server-2080038026',id=70,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzHCXg22jI1mZmPGwnfSzMcBQA6Tzgyr8oAE3SZ+9ERHxQNH5L2wFtREZ/1HgjI73AwG54nW5HKSey2EBYdrHtoL+2x5CaK5MOK3tOqjkKb5WL3FRnYsvH3axsOlCX6oA==',key_name='tempest-keypair-1804059331',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa3c7ad1bf6248aa8e7f10a9d2a212ce',ramdisk_id='',reservation_id='r-yz0xtw8v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-432938357',owner_user_name='tempest-SnapshotDataIntegrityTests-432938357-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:08:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='af333dac9f9a4a6ab951ccb9c7f71e3a',uuid=88e7dd8f-33f3-46e8-8d17-b9451bb627e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "367c4156-3d6b-42a4-960e-d17bbf5ffa36", "address": "fa:16:3e:28:6d:ad", "network": {"id": "b3baa185-7601-4866-99a0-be488d68a312", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-71067646-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aa3c7ad1bf6248aa8e7f10a9d2a212ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap367c4156-3d", "ovs_interfaceid": "367c4156-3d6b-42a4-960e-d17bbf5ffa36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 02:08:45.671941 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Converting VIF {"id": "367c4156-3d6b-42a4-960e-d17bbf5ffa36", "address": "fa:16:3e:28:6d:ad", "network": {"id": "b3baa185-7601-4866-99a0-be488d68a312", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-71067646-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aa3c7ad1bf6248aa8e7f10a9d2a212ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap367c4156-3d", "ovs_interfaceid": "367c4156-3d6b-42a4-960e-d17bbf5ffa36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:08:45.672442 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:6d:ad,bridge_name='br-int',has_traffic_filtering=True,id=367c4156-3d6b-42a4-960e-d17bbf5ffa36,network=Network(b3baa185-7601-4866-99a0-be488d68a312),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap367c4156-3d') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:08:45.672949 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lazy-loading 'pci_devices' on Instance uuid 88e7dd8f-33f3-46e8-8d17-b9451bb627e5 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:08:46.005776 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.240s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:08:46.028010 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Acquiring lock "aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:08:46.028215 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:08:46.042209 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:46.052250 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Deleted allocations for instance a7b60291-5fd2-479e-9c9c-924b79f880a7
May 28 02:08:46.180192 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] End _get_guest_xml xml=<domain type="qemu">
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:   <uuid>88e7dd8f-33f3-46e8-8d17-b9451bb627e5</uuid>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:   <name>instance-00000046</name>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:   <metadata>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-2080038026</nova:name>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 02:08:45</nova:creationTime>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:       </nova:image>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:         <nova:user uuid="af333dac9f9a4a6ab951ccb9c7f71e3a">tempest-SnapshotDataIntegrityTests-432938357-project-member</nova:user>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:         <nova:project uuid="aa3c7ad1bf6248aa8e7f10a9d2a212ce">tempest-SnapshotDataIntegrityTests-432938357</nova:project>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:         <nova:port uuid="367c4156-3d6b-42a4-960e-d17bbf5ffa36">
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:         </nova:port>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:   </metadata>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:     <system>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:       <entry name="serial">88e7dd8f-33f3-46e8-8d17-b9451bb627e5</entry>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:       <entry name="uuid">88e7dd8f-33f3-46e8-8d17-b9451bb627e5</entry>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:     </system>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:   <os>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:   </os>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:   <features>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:     <acpi/>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:     <tcg>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:     </tcg>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:   </features>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:   </cpu>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:   <devices>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/88e7dd8f-33f3-46e8-8d17-b9451bb627e5/disk"/>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:     </disk>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/88e7dd8f-33f3-46e8-8d17-b9451bb627e5/disk.config"/>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:     </disk>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:28:6d:ad"/>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:       <target dev="tap367c4156-3d"/>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:     </interface>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/88e7dd8f-33f3-46e8-8d17-b9451bb627e5/console.log" append="off"/>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:     </serial>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:     <video>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:     </video>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:     </rng>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:     </memballoon>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:   </devices>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]: </domain>
May 28 02:08:46.180192 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 02:08:46.182965 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Preparing to wait for external event network-vif-plugged-367c4156-3d6b-42a4-960e-d17bbf5ffa36 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 02:08:46.182965 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Acquiring lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:08:46.182965 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:08:46.182965 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:08:46.182965 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:08:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2080038026',display_name='tempest-SnapshotDataIntegrityTests-server-2080038026',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-snapshotdataintegritytests-server-2080038026',id=70,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzHCXg22jI1mZmPGwnfSzMcBQA6Tzgyr8oAE3SZ+9ERHxQNH5L2wFtREZ/1HgjI73AwG54nW5HKSey2EBYdrHtoL+2x5CaK5MOK3tOqjkKb5WL3FRnYsvH3axsOlCX6oA==',key_name='tempest-keypair-1804059331',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa3c7ad1bf6248aa8e7f10a9d2a212ce',ramdisk_id='',reservation_id='r-yz0xtw8v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-432938357',owner_user_name='tempest-SnapshotDataIntegrityTests-432938357-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:08:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='af333dac9f9a4a6ab951ccb9c7f71e3a',uuid=88e7dd8f-33f3-46e8-8d17-b9451bb627e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "367c4156-3d6b-42a4-960e-d17bbf5ffa36", "address": "fa:16:3e:28:6d:ad", "network": {"id": "b3baa185-7601-4866-99a0-be488d68a312", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-71067646-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aa3c7ad1bf6248aa8e7f10a9d2a212ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap367c4156-3d", "ovs_interfaceid": "367c4156-3d6b-42a4-960e-d17bbf5ffa36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 02:08:46.182965 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Converting VIF {"id": "367c4156-3d6b-42a4-960e-d17bbf5ffa36", "address": "fa:16:3e:28:6d:ad", "network": {"id": "b3baa185-7601-4866-99a0-be488d68a312", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-71067646-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aa3c7ad1bf6248aa8e7f10a9d2a212ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap367c4156-3d", "ovs_interfaceid": "367c4156-3d6b-42a4-960e-d17bbf5ffa36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:08:46.185006 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:6d:ad,bridge_name='br-int',has_traffic_filtering=True,id=367c4156-3d6b-42a4-960e-d17bbf5ffa36,network=Network(b3baa185-7601-4866-99a0-be488d68a312),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap367c4156-3d') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:08:46.185313 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:6d:ad,bridge_name='br-int',has_traffic_filtering=True,id=367c4156-3d6b-42a4-960e-d17bbf5ffa36,network=Network(b3baa185-7601-4866-99a0-be488d68a312),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap367c4156-3d') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 02:08:46.185696 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:46.186096 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:08:46.186567 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 02:08:46.186963 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:46.187231 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7442fc56-708c-559e-96cc-3600a079bc2e', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:08:46.187987 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:46.188921 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:08:46.189117 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:46.194360 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:46.194360 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap367c4156-3d, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:08:46.194360 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap367c4156-3d, col_values=(('qos', UUID('8f9866f8-37ba-484e-9526-68b178487643')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:08:46.194360 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap367c4156-3d, col_values=(('external_ids', {'iface-id': '367c4156-3d6b-42a4-960e-d17bbf5ffa36', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:6d:ad', 'vm-uuid': '88e7dd8f-33f3-46e8-8d17-b9451bb627e5'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:08:46.194360 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:46.194360 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:08:46.198612 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:46.199038 np0000001583 nova-compute[98241]: INFO os_vif [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:6d:ad,bridge_name='br-int',has_traffic_filtering=True,id=367c4156-3d6b-42a4-960e-d17bbf5ffa36,network=Network(b3baa185-7601-4866-99a0-be488d68a312),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap367c4156-3d')
May 28 02:08:46.530176 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 02:08:46.595019 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "08450cf0-e778-4831-82f9-bd268655c346" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:08:46.595232 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "08450cf0-e778-4831-82f9-bd268655c346" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:08:47.064805 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3442ee28-2122-4252-add9-d35ae98dcaa8 tempest-TestInstancesWithCinderVolumes-117749394 tempest-TestInstancesWithCinderVolumes-117749394-project-member] Lock "a7b60291-5fd2-479e-9c9c-924b79f880a7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.399s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:08:47.098596 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:08:47.100545 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lazy-loading 'flavor' on Instance uuid 08450cf0-e778-4831-82f9-bd268655c346 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:08:47.101661 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:08:47.107826 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 02:08:47.108054 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Claim successful on node np0000001583
May 28 02:08:47.719108 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:08:47.719507 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:08:47.719507 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] No VIF found with MAC fa:16:3e:28:6d:ad, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:08:47.719815 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Using config drive
May 28 02:08:48.105724 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "08450cf0-e778-4831-82f9-bd268655c346" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:08:48.224903 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:08:48.278041 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:08:48.278328 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:08:48.346541 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Creating config drive at /opt/stack/data/nova/instances/88e7dd8f-33f3-46e8-8d17-b9451bb627e5/disk.config
May 28 02:08:48.350586 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/88e7dd8f-33f3-46e8-8d17-b9451bb627e5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_d5x_t2s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:08:48.403554 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/88e7dd8f-33f3-46e8-8d17-b9451bb627e5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_d5x_t2s" returned: 0 in 0.053s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:08:48.572559 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:48.781097 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:08:48.828696 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:48.850963 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:48.850963 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:48.942776 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:49.016368 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a203ddfc-ea91-4464-8149-34f8c60225c0 req-8fc99baa-5a4d-4d51-8f30-04f0b025413d service nova] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Received event network-vif-plugged-367c4156-3d6b-42a4-960e-d17bbf5ffa36 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:08:49.016368 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a203ddfc-ea91-4464-8149-34f8c60225c0 req-8fc99baa-5a4d-4d51-8f30-04f0b025413d service nova] Acquiring lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:08:49.016368 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a203ddfc-ea91-4464-8149-34f8c60225c0 req-8fc99baa-5a4d-4d51-8f30-04f0b025413d service nova] Lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:08:49.016368 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a203ddfc-ea91-4464-8149-34f8c60225c0 req-8fc99baa-5a4d-4d51-8f30-04f0b025413d service nova] Lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:08:49.017093 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a203ddfc-ea91-4464-8149-34f8c60225c0 req-8fc99baa-5a4d-4d51-8f30-04f0b025413d service nova] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Processing event network-vif-plugged-367c4156-3d6b-42a4-960e-d17bbf5ffa36 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 02:08:49.177285 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "08450cf0-e778-4831-82f9-bd268655c346" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:08:49.177285 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "08450cf0-e778-4831-82f9-bd268655c346" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:08:49.177528 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Attaching volume 4dc373e5-9dbe-4a4d-8411-d218d711b7e8 to /dev/vdb
May 28 02:08:49.195645 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:49.214553 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:49.215424 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:49.234708 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:08:49.249685 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 02:08:49.271063 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:08:49.290802 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.189s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:08:49.291594 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 02:08:49.314154 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 02:08:49.315557 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 02:08:49.324457 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 02:08:49.325455 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fea3:78a0', 'fe80::d05a:66ff:fe6d:1718', 'fe80::fc16:3eff:fe28:6dad', 'fe80::98c1:6bff:fe22:4140'] 
May 28 02:08:49.325579 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 02:08:49.325694 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 02:08:49.325947 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] <== get_connector_properties: return (91ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:08:49.326159 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Updating existing volume attachment record: 8e3bd21e-0233-42cb-ad78-2247b45dd0d3 {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 02:08:49.610176 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934129.6096516, 88e7dd8f-33f3-46e8-8d17-b9451bb627e5 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:08:49.611023 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 02:08:49.611316 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] VM Started (Lifecycle Event)
May 28 02:08:49.616074 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 02:08:49.620928 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Instance spawned successfully.
May 28 02:08:49.621239 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 02:08:49.803305 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 02:08:49.803859 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 02:08:49.803926 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:08:49.804224 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:08:49.877016 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2b5bf0f126624ddab4bd36a1b707899e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2896b1043bfb246c28ad9d1e174', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 02:08:49.917927 np0000001583 nova-compute[98241]: DEBUG os_brick.encryptors [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8', 'iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4dc373e5-9dbe-4a4d-8411-d218d711b7e8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '08450cf0-e778-4831-82f9-bd268655c346', 'attached_at': '', 'detached_at': '', 'volume_id': '4dc373e5-9dbe-4a4d-8411-d218d711b7e8', 'serial': '4dc373e5-9dbe-4a4d-8411-d218d711b7e8'} {{(pid=98241) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 02:08:49.918587 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 02:08:49.918953 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8', 'iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4dc373e5-9dbe-4a4d-8411-d218d711b7e8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:08:49.919157 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:08:50.114816 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:08:50.118051 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:08:50.129287 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:08:50.129467 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:08:50.129953 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:08:50.130539 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:08:50.130760 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:08:50.131244 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:08:50.306603 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 02:08:50.330141 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Successfully created port: 256dd1c6-bc20-43f3-8364-3f70ab70799d {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 02:08:50.621733 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 02:08:50.622024 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934130.621848, 88e7dd8f-33f3-46e8-8d17-b9451bb627e5 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:08:50.622200 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] VM Paused (Lifecycle Event)
May 28 02:08:50.636920 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Took 6.93 seconds to spawn the instance on the hypervisor.
May 28 02:08:50.637369 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:08:50.771982 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Successfully updated port: 256dd1c6-bc20-43f3-8364-3f70ab70799d {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 02:08:50.810484 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 02:08:50.828278 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e80dd3c4-6b4e-44c3-a4f7-80f85819f60b req-f880222f-f64d-4fc8-9d5e-6ba4c6e7a0ab service nova] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Received event network-changed-256dd1c6-bc20-43f3-8364-3f70ab70799d {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:08:50.828278 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e80dd3c4-6b4e-44c3-a4f7-80f85819f60b req-f880222f-f64d-4fc8-9d5e-6ba4c6e7a0ab service nova] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Refreshing instance network info cache due to event network-changed-256dd1c6-bc20-43f3-8364-3f70ab70799d. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:08:50.828278 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e80dd3c4-6b4e-44c3-a4f7-80f85819f60b req-f880222f-f64d-4fc8-9d5e-6ba4c6e7a0ab service nova] Acquiring lock "refresh_cache-aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:08:50.828278 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e80dd3c4-6b4e-44c3-a4f7-80f85819f60b req-f880222f-f64d-4fc8-9d5e-6ba4c6e7a0ab service nova] Acquired lock "refresh_cache-aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:08:50.828278 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-e80dd3c4-6b4e-44c3-a4f7-80f85819f60b req-f880222f-f64d-4fc8-9d5e-6ba4c6e7a0ab service nova] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Refreshing network info cache for port 256dd1c6-bc20-43f3-8364-3f70ab70799d {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:08:51.106019 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-daa35af1-af73-4913-8bed-fde6ffd1c28c req-3b0e3587-4ece-4f9e-b998-fe8ac3042246 service nova] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Received event network-vif-plugged-367c4156-3d6b-42a4-960e-d17bbf5ffa36 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:08:51.106453 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-daa35af1-af73-4913-8bed-fde6ffd1c28c req-3b0e3587-4ece-4f9e-b998-fe8ac3042246 service nova] Acquiring lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:08:51.106693 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-daa35af1-af73-4913-8bed-fde6ffd1c28c req-3b0e3587-4ece-4f9e-b998-fe8ac3042246 service nova] Lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:08:51.106898 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-daa35af1-af73-4913-8bed-fde6ffd1c28c req-3b0e3587-4ece-4f9e-b998-fe8ac3042246 service nova] Lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:08:51.107004 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-daa35af1-af73-4913-8bed-fde6ffd1c28c req-3b0e3587-4ece-4f9e-b998-fe8ac3042246 service nova] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] No waiting events found dispatching network-vif-plugged-367c4156-3d6b-42a4-960e-d17bbf5ffa36 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:08:51.108575 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-daa35af1-af73-4913-8bed-fde6ffd1c28c req-3b0e3587-4ece-4f9e-b998-fe8ac3042246 service nova] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Received unexpected event network-vif-plugged-367c4156-3d6b-42a4-960e-d17bbf5ffa36 for instance with vm_state active and task_state None.
May 28 02:08:51.125205 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:08:51.128055 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934131.127823, 88e7dd8f-33f3-46e8-8d17-b9451bb627e5 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:08:51.128184 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] VM Resumed (Lifecycle Event)
May 28 02:08:51.146712 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Took 12.25 seconds to build instance.
May 28 02:08:51.193638 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:51.273442 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Acquiring lock "refresh_cache-aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:08:51.315831 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Booting with volume 5f799bc3-5b92-4dd1-9333-071bfdb25a3c at /dev/vda
May 28 02:08:51.329381 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-e80dd3c4-6b4e-44c3-a4f7-80f85819f60b req-f880222f-f64d-4fc8-9d5e-6ba4c6e7a0ab service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:08:51.355912 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:08:51.368207 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 02:08:51.390757 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:08:51.406417 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-e80dd3c4-6b4e-44c3-a4f7-80f85819f60b req-f880222f-f64d-4fc8-9d5e-6ba4c6e7a0ab service nova] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:08:51.434397 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 02:08:51.434702 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 02:08:51.445487 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 02:08:51.446397 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fea3:78a0', 'fe80::d05a:66ff:fe6d:1718', 'fe80::fc16:3eff:fe28:6dad', 'fe80::98c1:6bff:fe22:4140'] 
May 28 02:08:51.446503 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 02:08:51.446651 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 02:08:51.446866 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] <== get_connector_properties: return (91ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:08:51.447060 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Updating existing volume attachment record: 92c82cb5-f799-4d3b-8c4a-4903b476b1f1 {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 02:08:51.570017 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-e80dd3c4-6b4e-44c3-a4f7-80f85819f60b req-f880222f-f64d-4fc8-9d5e-6ba4c6e7a0ab service nova] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:08:51.630801 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:08:51.637052 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:08:51.648316 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1558651a-fd3e-4cda-a90b-fa0a0ac751cd tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.761s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:08:51.876244 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.957s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:08:51.876794 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8', 'iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4dc373e5-9dbe-4a4d-8411-d218d711b7e8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 02:08:51.892031 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:08:51.893120 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:08:51.893648 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:08:51.893882 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:08:51.894321 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:08:51.894510 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:08:51.909463 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:08:51.909463 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:51.914288 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:08:51.914288 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:51.923580 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8] added
May 28 02:08:51.923580 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:08:51.923580 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:08:51.923580 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:08:51.923580 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:08:51.923580 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:08:51.923580 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:51.923580 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:08:51.923580 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0283(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:08:51.923580 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:08:51.933250 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8] added
May 28 02:08:51.933250 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:08:51.933250 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:08:51.933250 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:08:51.933250 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:08:51.933250 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:08:51.933250 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:51.933589 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:08:51.933731 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0391(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:08:51.933925 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:08:52.072619 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e80dd3c4-6b4e-44c3-a4f7-80f85819f60b req-f880222f-f64d-4fc8-9d5e-6ba4c6e7a0ab service nova] Releasing lock "refresh_cache-aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:08:52.074659 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Acquired lock "refresh_cache-aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:08:52.074659 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:08:52.335428 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:52.410175 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-109754a3-4096-42b0-affb-0fbc5fd81b78 req-daeab0cd-1da2-4d8d-ad99-6201aa128e71 service nova] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Received event network-changed-367c4156-3d6b-42a4-960e-d17bbf5ffa36 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:08:52.410455 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-109754a3-4096-42b0-affb-0fbc5fd81b78 req-daeab0cd-1da2-4d8d-ad99-6201aa128e71 service nova] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Refreshing instance network info cache due to event network-changed-367c4156-3d6b-42a4-960e-d17bbf5ffa36. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:08:52.414056 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-109754a3-4096-42b0-affb-0fbc5fd81b78 req-daeab0cd-1da2-4d8d-ad99-6201aa128e71 service nova] Acquiring lock "refresh_cache-88e7dd8f-33f3-46e8-8d17-b9451bb627e5" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:08:52.414254 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-109754a3-4096-42b0-affb-0fbc5fd81b78 req-daeab0cd-1da2-4d8d-ad99-6201aa128e71 service nova] Acquired lock "refresh_cache-88e7dd8f-33f3-46e8-8d17-b9451bb627e5" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:08:52.414433 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-109754a3-4096-42b0-affb-0fbc5fd81b78 req-daeab0cd-1da2-4d8d-ad99-6201aa128e71 service nova] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Refreshing network info cache for port 367c4156-3d6b-42a4-960e-d17bbf5ffa36 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:08:52.673310 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:08:52.856240 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:08:52.917212 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-109754a3-4096-42b0-affb-0fbc5fd81b78 req-daeab0cd-1da2-4d8d-ad99-6201aa128e71 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:08:52.922812 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:08:52.934840 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:08:52.939618 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:08:52.939618 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:08:52.952703 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:08:52.952703 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:52.958346 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:52.964537 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:52.974372 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4095e7b4-59b5-441d-9212-678b15bc3160 (non-flash)
May 28 02:08:52.974372 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:08:52.974617 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsi session list stdout=tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4095e7b4-59b5-441d-9212-678b15bc3160 (non-flash)
May 28 02:08:52.974617 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:08:52.980038 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4095e7b4-59b5-441d-9212-678b15bc3160 (non-flash)
May 28 02:08:52.980038 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:08:52.980176 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsi session list stdout=tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4095e7b4-59b5-441d-9212-678b15bc3160 (non-flash)
May 28 02:08:52.980176 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:08:53.004289 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8, portal: 192.168.40.100,3260]
May 28 02:08:53.004289 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8, portal: 192.168.40.100,3260] successful.
May 28 02:08:53.004289 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:53.016222 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:53.029514 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8, portal: 192.168.50.100,3260]
May 28 02:08:53.029514 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8, portal: 192.168.50.100,3260] successful.
May 28 02:08:53.029514 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:53.036288 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Updating instance_info_cache with network_info: [{"id": "256dd1c6-bc20-43f3-8364-3f70ab70799d", "address": "fa:16:3e:4d:38:08", "network": {"id": "ef15cd88-386f-4fc6-8df0-74267f73d3fb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1804869041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b7ada2896b1043bfb246c28ad9d1e174", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap256dd1c6-bc", "ovs_interfaceid": "256dd1c6-bc20-43f3-8364-3f70ab70799d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:08:53.037644 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4095e7b4-59b5-441d-9212-678b15bc3160 (non-flash)
May 28 02:08:53.037644 np0000001583 nova-compute[98241]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8 (non-flash)
May 28 02:08:53.037644 np0000001583 nova-compute[98241]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8 (non-flash)
May 28 02:08:53.037644 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:08:53.037828 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsi session list stdout=tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4095e7b4-59b5-441d-9212-678b15bc3160 (non-flash)
May 28 02:08:53.037828 np0000001583 nova-compute[98241]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8 (non-flash)
May 28 02:08:53.037828 np0000001583 nova-compute[98241]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8 (non-flash)
May 28 02:08:53.037828 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:08:53.038162 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.145s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:08:53.038299 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:08:53.040049 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] HCTL ('8', '-', '-', 0) found on session 175 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:08:53.040599 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:08:53.045972 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:53.063888 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Searching for a device in session 175 and hctl ['8', '*', '*', 0] yield: None {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:08:53.064896 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4095e7b4-59b5-441d-9212-678b15bc3160 (non-flash)
May 28 02:08:53.064896 np0000001583 nova-compute[98241]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8 (non-flash)
May 28 02:08:53.064896 np0000001583 nova-compute[98241]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8 (non-flash)
May 28 02:08:53.064896 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:08:53.065113 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsi session list stdout=tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4095e7b4-59b5-441d-9212-678b15bc3160 (non-flash)
May 28 02:08:53.065113 np0000001583 nova-compute[98241]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8 (non-flash)
May 28 02:08:53.065113 np0000001583 nova-compute[98241]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8 (non-flash)
May 28 02:08:53.065113 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:08:53.065484 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.171s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:08:53.065650 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:08:53.066304 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] HCTL ('9', '-', '-', 0) found on session 176 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:08:53.066455 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:08:53.088159 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Searching for a device in session 176 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:08:53.088301 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '4dc373e5-9dbe-4a4d-8411-d218d711b7e8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:08:53.316382 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-109754a3-4096-42b0-affb-0fbc5fd81b78 req-daeab0cd-1da2-4d8d-ad99-6201aa128e71 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:08:53.502779 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-109754a3-4096-42b0-affb-0fbc5fd81b78 req-daeab0cd-1da2-4d8d-ad99-6201aa128e71 service nova] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Updated VIF entry in instance network info cache for port 367c4156-3d6b-42a4-960e-d17bbf5ffa36. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:08:53.503183 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-109754a3-4096-42b0-affb-0fbc5fd81b78 req-daeab0cd-1da2-4d8d-ad99-6201aa128e71 service nova] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Updating instance_info_cache with network_info: [{"id": "367c4156-3d6b-42a4-960e-d17bbf5ffa36", "address": "fa:16:3e:28:6d:ad", "network": {"id": "b3baa185-7601-4866-99a0-be488d68a312", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-71067646-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aa3c7ad1bf6248aa8e7f10a9d2a212ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap367c4156-3d", "ovs_interfaceid": "367c4156-3d6b-42a4-960e-d17bbf5ffa36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:08:53.539773 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Releasing lock "refresh_cache-aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:08:53.540062 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Instance network_info: |[{"id": "256dd1c6-bc20-43f3-8364-3f70ab70799d", "address": "fa:16:3e:4d:38:08", "network": {"id": "ef15cd88-386f-4fc6-8df0-74267f73d3fb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1804869041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b7ada2896b1043bfb246c28ad9d1e174", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap256dd1c6-bc", "ovs_interfaceid": "256dd1c6-bc20-43f3-8364-3f70ab70799d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 02:08:53.575830 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:53.592589 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 02:08:53.594226 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 02:08:53.594616 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Creating image(s)
May 28 02:08:53.595006 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Did not create local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 02:08:53.595212 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Ensure instance console log exists: /opt/stack/data/nova/instances/aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 02:08:53.595506 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:08:53.595782 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:08:53.595954 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:08:53.596631 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Start _get_guest_xml network_info=[{"id": "256dd1c6-bc20-43f3-8364-3f70ab70799d", "address": "fa:16:3e:4d:38:08", "network": {"id": "ef15cd88-386f-4fc6-8df0-74267f73d3fb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1804869041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b7ada2896b1043bfb246c28ad9d1e174", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap256dd1c6-bc", "ovs_interfaceid": "256dd1c6-bc20-43f3-8364-3f70ab70799d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c', 'iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5f799bc3-5b92-4dd1-9333-071bfdb25a3c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf', 'attached_at': '', 'detached_at': '', 'volume_id': '5f799bc3-5b92-4dd1-9333-071bfdb25a3c', 'serial': '5f799bc3-5b92-4dd1-9333-071bfdb25a3c'}, 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '92c82cb5-f799-4d3b-8c4a-4903b476b1f1', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 02:08:53.601829 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:08:53.603092 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-805175213', uuid='aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf'), owner=OwnerMeta(userid='2b5bf0f126624ddab4bd36a1b707899e', username='tempest-TestEncryptedCinderVolumes-1693604386-project-member', projectid='b7ada2896b1043bfb246c28ad9d1e174', projectname='tempest-TestEncryptedCinderVolumes-1693604386'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "256dd1c6-bc20-43f3-8364-3f70ab70799d", "address": "fa:16:3e:4d:38:08", "network": {"id": "ef15cd88-386f-4fc6-8df0-74267f73d3fb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1804869041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b7ada2896b1043bfb246c28ad9d1e174", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap256dd1c6-bc", "ovs_interfaceid": "256dd1c6-bc20-43f3-8364-3f70ab70799d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779934133.6026385) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 02:08:53.604351 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 02:08:53.608097 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 02:08:53.608097 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 02:08:53.608097 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 02:08:53.608097 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 02:08:53.608097 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 02:08:53.608097 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 02:08:53.608097 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 02:08:53.608097 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 02:08:53.608561 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 02:08:53.608561 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 02:08:53.608561 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 02:08:53.608773 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 02:08:53.609218 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 02:08:53.609218 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 02:08:53.609382 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 02:08:53.624803 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 02:08:53.625199 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c', 'iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5f799bc3-5b92-4dd1-9333-071bfdb25a3c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:08:53.625391 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:08:54.006573 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-109754a3-4096-42b0-affb-0fbc5fd81b78 req-daeab0cd-1da2-4d8d-ad99-6201aa128e71 service nova] Releasing lock "refresh_cache-88e7dd8f-33f3-46e8-8d17-b9451bb627e5" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:08:54.064680 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Searching for a device in session 175 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:08:54.065065 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4dc373e5-9dbe-4a4d-8411-d218d711b7e8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:08:54.466099 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:54.920488 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Found WWN 33000000008b565e5 for multipath device dm-0 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 02:08:54.920768 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.045s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:08:54.921543 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.296s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:08:54.921869 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c', 'iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5f799bc3-5b92-4dd1-9333-071bfdb25a3c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 02:08:54.925315 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] <== connect_volume: return (5005ms) {'type': 'block', 'scsi_wwn': '33000000008b565e5', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '33000000008b565e5'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:08:54.925315 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000008b565e5', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '33000000008b565e5'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 02:08:54.938563 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:08:54.938947 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:08:54.939175 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:08:54.940209 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:08:54.941709 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:08:54.942069 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:08:54.944201 np0000001583 nova-compute[98241]: WARNING stevedore.named [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 02:08:54.944201 np0000001583 nova-compute[98241]: WARNING castellan.key_manager [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 02:08:54.944201 np0000001583 nova-compute[98241]: WARNING nova.keymgr.conf_key_mgr [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 02:08:54.944765 np0000001583 nova-compute[98241]: DEBUG os_brick.encryptors [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x7724f87243e0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8', 'iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4dc373e5-9dbe-4a4d-8411-d218d711b7e8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': '08450cf0-e778-4831-82f9-bd268655c346', 'attached_at': '', 'detached_at': '', 'volume_id': '4dc373e5-9dbe-4a4d-8411-d218d711b7e8', 'serial': '4dc373e5-9dbe-4a4d-8411-d218d711b7e8'} {{(pid=98241) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 28 02:08:54.945064 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] os_brick.utils.get_passphrase_from_secret: the secret is not of type passphrase and will be converted using hex representation {{(pid=98241) get_passphrase_from_secret /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:486}}
May 28 02:08:54.945349 np0000001583 nova-compute[98241]: DEBUG os_brick.encryptors.luks [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] opening encrypted volume /dev/dm-0 {{(pid=98241) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 28 02:08:54.958993 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:08:54.958993 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:54.966178 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:08:54.966178 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:54.984354 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c] added
May 28 02:08:54.984354 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:08:54.984354 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:08:54.984354 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:08:54.984354 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:08:54.984354 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:08:54.984354 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:54.984585 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:08:54.984802 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0428(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:08:54.984971 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:08:54.988038 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c] added
May 28 02:08:54.988038 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:08:54.988038 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:08:54.988038 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:08:54.988038 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:08:54.988038 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:08:54.988038 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:54.988319 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:08:54.988420 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0492(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:08:54.988570 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:08:55.012866 np0000001583 nova-compute[98241]: WARNING os_brick.encryptors.luks [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 28 02:08:55.016854 np0000001583 nova-compute[98241]: INFO os_brick.encryptors.luks [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] /dev/dm-0 is not a valid LUKS device; formatting device for first use
May 28 02:08:55.016854 np0000001583 nova-compute[98241]: DEBUG os_brick.encryptors.luks [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] formatting encrypted volume /dev/dm-0 {{(pid=98241) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 28 02:08:55.526054 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.00048195099998338264 future=<Future at 0x7724f83f1820 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:08:55.526461 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Emitting event <LifecycleEvent: 1779934120.5254326, a7b60291-5fd2-479e-9c9c-924b79f880a7 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:08:55.526581 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:08:55.526849 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] VM Stopped (Lifecycle Event)
May 28 02:08:55.985450 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:08:55.989733 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:08:56.008318 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:08:56.008318 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:08:56.016448 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:08:56.016448 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:56.030636 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:56.031682 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: a7b60291-5fd2-479e-9c9c-924b79f880a7] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:08:56.044250 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:56.059595 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4095e7b4-59b5-441d-9212-678b15bc3160 (non-flash)
May 28 02:08:56.059595 np0000001583 nova-compute[98241]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8 (non-flash)
May 28 02:08:56.059595 np0000001583 nova-compute[98241]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8 (non-flash)
May 28 02:08:56.059595 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:08:56.059834 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsi session list stdout=tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4095e7b4-59b5-441d-9212-678b15bc3160 (non-flash)
May 28 02:08:56.059834 np0000001583 nova-compute[98241]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8 (non-flash)
May 28 02:08:56.059834 np0000001583 nova-compute[98241]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8 (non-flash)
May 28 02:08:56.059834 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:08:56.068311 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4095e7b4-59b5-441d-9212-678b15bc3160 (non-flash)
May 28 02:08:56.068311 np0000001583 nova-compute[98241]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8 (non-flash)
May 28 02:08:56.068311 np0000001583 nova-compute[98241]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8 (non-flash)
May 28 02:08:56.068311 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:08:56.068558 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsi session list stdout=tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4095e7b4-59b5-441d-9212-678b15bc3160 (non-flash)
May 28 02:08:56.068558 np0000001583 nova-compute[98241]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8 (non-flash)
May 28 02:08:56.068558 np0000001583 nova-compute[98241]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8 (non-flash)
May 28 02:08:56.068558 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:08:56.099493 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c, portal: 192.168.40.100,3260]
May 28 02:08:56.099493 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c, portal: 192.168.40.100,3260] successful.
May 28 02:08:56.099493 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:56.113042 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:56.133582 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4095e7b4-59b5-441d-9212-678b15bc3160 (non-flash)
May 28 02:08:56.133582 np0000001583 nova-compute[98241]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8 (non-flash)
May 28 02:08:56.133582 np0000001583 nova-compute[98241]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8 (non-flash)
May 28 02:08:56.133582 np0000001583 nova-compute[98241]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:08:56.133582 np0000001583 nova-compute[98241]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:08:56.133582 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:08:56.133959 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsi session list stdout=tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4095e7b4-59b5-441d-9212-678b15bc3160 (non-flash)
May 28 02:08:56.133959 np0000001583 nova-compute[98241]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8 (non-flash)
May 28 02:08:56.133959 np0000001583 nova-compute[98241]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8 (non-flash)
May 28 02:08:56.133959 np0000001583 nova-compute[98241]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:08:56.133959 np0000001583 nova-compute[98241]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:08:56.133959 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:08:56.134593 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c, portal: 192.168.50.100,3260]
May 28 02:08:56.134593 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c, portal: 192.168.50.100,3260] successful.
May 28 02:08:56.134593 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:56.135133 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.196s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:08:56.135352 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:08:56.136698 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] HCTL ('10', '-', '-', 0) found on session 177 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:08:56.136867 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:08:56.163179 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Searching for a device in session 177 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:08:56.163403 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5f799bc3-5b92-4dd1-9333-071bfdb25a3c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:08:56.170213 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:08:56.190598 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4095e7b4-59b5-441d-9212-678b15bc3160 (non-flash)
May 28 02:08:56.190598 np0000001583 nova-compute[98241]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8 (non-flash)
May 28 02:08:56.190598 np0000001583 nova-compute[98241]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8 (non-flash)
May 28 02:08:56.190598 np0000001583 nova-compute[98241]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:08:56.190598 np0000001583 nova-compute[98241]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:08:56.190598 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:08:56.190811 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsi session list stdout=tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4095e7b4-59b5-441d-9212-678b15bc3160 (non-flash)
May 28 02:08:56.190811 np0000001583 nova-compute[98241]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8 (non-flash)
May 28 02:08:56.190811 np0000001583 nova-compute[98241]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8 (non-flash)
May 28 02:08:56.190811 np0000001583 nova-compute[98241]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:08:56.190811 np0000001583 nova-compute[98241]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:08:56.190811 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:08:56.191189 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.250s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:08:56.191323 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:08:56.192926 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] HCTL ('11', '-', '-', 0) found on session 178 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:08:56.192926 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:08:56.196011 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:56.219279 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Searching for a device in session 178 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:08:56.219589 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '5f799bc3-5b92-4dd1-9333-071bfdb25a3c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:08:56.942306 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 02:08:57.490734 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:57.966835 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Found WWN 33000000088846b3e for multipath device dm-1 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 02:08:57.967415 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.046s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:08:57.972329 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] <== connect_volume: return (4346ms) {'type': 'block', 'scsi_wwn': '33000000088846b3e', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '33000000088846b3e'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:08:57.972489 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000088846b3e', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '33000000088846b3e'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 02:08:58.013608 np0000001583 nova-compute[98241]: DEBUG os_brick.encryptors [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c', 'iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5f799bc3-5b92-4dd1-9333-071bfdb25a3c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, 'status': 'reserved', 'instance': 'aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf', 'attached_at': '', 'detached_at': '', 'volume_id': '5f799bc3-5b92-4dd1-9333-071bfdb25a3c', 'serial': '5f799bc3-5b92-4dd1-9333-071bfdb25a3c'} {{(pid=98241) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 02:08:58.014039 np0000001583 nova-compute[98241]: WARNING stevedore.named [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 02:08:58.014248 np0000001583 nova-compute[98241]: WARNING castellan.key_manager [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 02:08:58.014371 np0000001583 nova-compute[98241]: WARNING nova.keymgr.conf_key_mgr [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 02:08:58.049310 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Secret XML: <secret ephemeral="no" private="no">
May 28 02:08:58.049310 np0000001583 nova-compute[98241]:   <usage type="volume">
May 28 02:08:58.049310 np0000001583 nova-compute[98241]:     <volume>5f799bc3-5b92-4dd1-9333-071bfdb25a3c</volume>
May 28 02:08:58.049310 np0000001583 nova-compute[98241]:   </usage>
May 28 02:08:58.049310 np0000001583 nova-compute[98241]: </secret>
May 28 02:08:58.049310 np0000001583 nova-compute[98241]:  {{(pid=98241) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 28 02:08:58.553024 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:08:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-805175213',display_name='tempest-TestEncryptedCinderVolumes-server-805175213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testencryptedcindervolumes-server-805175213',id=71,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBvIuscC5Hl9LuYYLq2wWivaHaebRNHPQIeYgqv7q1vZGG0QAw9Hdt3V++LObVUv3gsFUugch3GmPHbbfwH6piykof8GCWeT2LLzcMRX5UhzJRQuWby1FNbyksEPsTs9eg==',key_name='tempest-TestEncryptedCinderVolumes-1555008274',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7ada2896b1043bfb246c28ad9d1e174',ramdisk_id='',reservation_id='r-a0y0h5o9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1693604386',owner_user_name='tempest-TestEncryptedCinderVolumes-1693604386-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:08:51Z,user_data=None,user_id='2b5bf0f126624ddab4bd36a1b707899e',uuid=aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "256dd1c6-bc20-43f3-8364-3f70ab70799d", "address": "fa:16:3e:4d:38:08", "network": {"id": "ef15cd88-386f-4fc6-8df0-74267f73d3fb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1804869041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b7ada2896b1043bfb246c28ad9d1e174", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap256dd1c6-bc", "ovs_interfaceid": "256dd1c6-bc20-43f3-8364-3f70ab70799d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 02:08:58.553024 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Converting VIF {"id": "256dd1c6-bc20-43f3-8364-3f70ab70799d", "address": "fa:16:3e:4d:38:08", "network": {"id": "ef15cd88-386f-4fc6-8df0-74267f73d3fb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1804869041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b7ada2896b1043bfb246c28ad9d1e174", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap256dd1c6-bc", "ovs_interfaceid": "256dd1c6-bc20-43f3-8364-3f70ab70799d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:08:58.554151 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:38:08,bridge_name='br-int',has_traffic_filtering=True,id=256dd1c6-bc20-43f3-8364-3f70ab70799d,network=Network(ef15cd88-386f-4fc6-8df0-74267f73d3fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap256dd1c6-bc') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:08:58.556200 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lazy-loading 'pci_devices' on Instance uuid aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:08:58.577543 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:59.059752 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] End _get_guest_xml xml=<domain type="qemu">
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:   <uuid>aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf</uuid>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:   <name>instance-00000047</name>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:   <metadata>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-805175213</nova:name>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 02:08:53</nova:creationTime>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:       <nova:image uuid="">
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:       </nova:image>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:         <nova:user uuid="2b5bf0f126624ddab4bd36a1b707899e">tempest-TestEncryptedCinderVolumes-1693604386-project-member</nova:user>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:         <nova:project uuid="b7ada2896b1043bfb246c28ad9d1e174">tempest-TestEncryptedCinderVolumes-1693604386</nova:project>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:       <nova:root type="volume" uuid=""/>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:         <nova:port uuid="256dd1c6-bc20-43f3-8364-3f70ab70799d">
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:         </nova:port>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:   </metadata>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:     <system>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:       <entry name="serial">aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf</entry>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:       <entry name="uuid">aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf</entry>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:     </system>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:   <os>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:   </os>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:   <features>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:     <acpi/>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:     <tcg>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:     </tcg>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:   </features>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:   </cpu>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:   <devices>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf/disk.config"/>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:     </disk>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:     <disk type="block" device="disk">
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:       <alias name="ua-5f799bc3-5b92-4dd1-9333-071bfdb25a3c"/>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:       <serial>5f799bc3-5b92-4dd1-9333-071bfdb25a3c</serial>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:       <encryption format="luks">
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:         <secret type="passphrase" uuid="38646a1b-eece-41c9-a3c7-b2717e76ede0"/>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:       </encryption>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:     </disk>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:4d:38:08"/>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:       <target dev="tap256dd1c6-bc"/>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:     </interface>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf/console.log" append="off"/>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:     </serial>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:     <video>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:     </video>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:     </rng>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:     </memballoon>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:   </devices>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]: </domain>
May 28 02:08:59.059752 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 02:08:59.061724 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Preparing to wait for external event network-vif-plugged-256dd1c6-bc20-43f3-8364-3f70ab70799d {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 02:08:59.061724 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Acquiring lock "aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:08:59.061724 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:08:59.061724 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:08:59.061724 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:08:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-805175213',display_name='tempest-TestEncryptedCinderVolumes-server-805175213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testencryptedcindervolumes-server-805175213',id=71,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBvIuscC5Hl9LuYYLq2wWivaHaebRNHPQIeYgqv7q1vZGG0QAw9Hdt3V++LObVUv3gsFUugch3GmPHbbfwH6piykof8GCWeT2LLzcMRX5UhzJRQuWby1FNbyksEPsTs9eg==',key_name='tempest-TestEncryptedCinderVolumes-1555008274',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7ada2896b1043bfb246c28ad9d1e174',ramdisk_id='',reservation_id='r-a0y0h5o9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1693604386',owner_user_name='tempest-TestEncryptedCinderVolumes-1693604386-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:08:51Z,user_data=None,user_id='2b5bf0f126624ddab4bd36a1b707899e',uuid=aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "256dd1c6-bc20-43f3-8364-3f70ab70799d", "address": "fa:16:3e:4d:38:08", "network": {"id": "ef15cd88-386f-4fc6-8df0-74267f73d3fb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1804869041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b7ada2896b1043bfb246c28ad9d1e174", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap256dd1c6-bc", "ovs_interfaceid": "256dd1c6-bc20-43f3-8364-3f70ab70799d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 02:08:59.061724 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Converting VIF {"id": "256dd1c6-bc20-43f3-8364-3f70ab70799d", "address": "fa:16:3e:4d:38:08", "network": {"id": "ef15cd88-386f-4fc6-8df0-74267f73d3fb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1804869041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b7ada2896b1043bfb246c28ad9d1e174", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap256dd1c6-bc", "ovs_interfaceid": "256dd1c6-bc20-43f3-8364-3f70ab70799d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:08:59.061724 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:38:08,bridge_name='br-int',has_traffic_filtering=True,id=256dd1c6-bc20-43f3-8364-3f70ab70799d,network=Network(ef15cd88-386f-4fc6-8df0-74267f73d3fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap256dd1c6-bc') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:08:59.062028 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:38:08,bridge_name='br-int',has_traffic_filtering=True,id=256dd1c6-bc20-43f3-8364-3f70ab70799d,network=Network(ef15cd88-386f-4fc6-8df0-74267f73d3fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap256dd1c6-bc') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 02:08:59.064019 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:59.064916 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:08:59.065264 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 02:08:59.067885 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:59.068122 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0e6cf945-c79b-509e-b492-c30bdc385ba1', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:08:59.079244 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:59.081426 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:59.081878 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:08:59.085693 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:59.085816 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap256dd1c6-bc, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:08:59.086341 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap256dd1c6-bc, col_values=(('qos', UUID('aaa87acc-d82e-41af-af0a-f35c9cd3bcd3')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:08:59.086341 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap256dd1c6-bc, col_values=(('external_ids', {'iface-id': '256dd1c6-bc20-43f3-8364-3f70ab70799d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:38:08', 'vm-uuid': 'aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:08:59.087215 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:59.089459 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:08:59.094866 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:08:59.095796 np0000001583 nova-compute[98241]: INFO os_vif [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:38:08,bridge_name='br-int',has_traffic_filtering=True,id=256dd1c6-bc20-43f3-8364-3f70ab70799d,network=Network(ef15cd88-386f-4fc6-8df0-74267f73d3fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap256dd1c6-bc')
May 28 02:08:59.646061 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:00.649568 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:09:00.652632 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:09:00.652632 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] No VIF found with MAC fa:16:3e:4d:38:08, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:09:00.652632 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Using config drive
May 28 02:09:01.158515 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:09:01.345487 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Creating config drive at /opt/stack/data/nova/instances/aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf/disk.config
May 28 02:09:01.349216 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpekimviyo {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:09:01.423484 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpekimviyo" returned: 0 in 0.074s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:09:01.861677 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:01.981219 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:02.004727 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:02.126099 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:02.262622 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-215d6e6f-54e8-4712-a9a3-5db918808c4c req-2fb163b6-6234-40af-9fd7-0daab5d9a9dd service nova] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Received event network-vif-plugged-256dd1c6-bc20-43f3-8364-3f70ab70799d {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:09:02.262622 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-215d6e6f-54e8-4712-a9a3-5db918808c4c req-2fb163b6-6234-40af-9fd7-0daab5d9a9dd service nova] Acquiring lock "aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:09:02.262622 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-215d6e6f-54e8-4712-a9a3-5db918808c4c req-2fb163b6-6234-40af-9fd7-0daab5d9a9dd service nova] Lock "aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:09:02.262622 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-215d6e6f-54e8-4712-a9a3-5db918808c4c req-2fb163b6-6234-40af-9fd7-0daab5d9a9dd service nova] Lock "aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:09:02.262622 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-215d6e6f-54e8-4712-a9a3-5db918808c4c req-2fb163b6-6234-40af-9fd7-0daab5d9a9dd service nova] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Processing event network-vif-plugged-256dd1c6-bc20-43f3-8364-3f70ab70799d {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 02:09:02.432982 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:02.434503 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:02.439916 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:02.459850 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:02.560868 np0000001583 nova-compute[98241]: DEBUG os_brick.encryptors.luks [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] opening encrypted volume /dev/dm-0 {{(pid=98241) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 28 02:09:03.577128 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:03.903150 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 02:09:03.903748 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934143.9033632, aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:09:03.904241 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] VM Started (Lifecycle Event)
May 28 02:09:03.906827 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 02:09:03.910235 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Instance spawned successfully.
May 28 02:09:03.911092 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 02:09:04.089036 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:04.327880 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-4f94e00f-19f2-40bc-9fe5-2b04db33e974 req-272a5dd4-e1ed-4eef-837c-81007b0e42ef service nova] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Received event network-vif-plugged-256dd1c6-bc20-43f3-8364-3f70ab70799d {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:09:04.328131 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-4f94e00f-19f2-40bc-9fe5-2b04db33e974 req-272a5dd4-e1ed-4eef-837c-81007b0e42ef service nova] Acquiring lock "aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:09:04.328392 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-4f94e00f-19f2-40bc-9fe5-2b04db33e974 req-272a5dd4-e1ed-4eef-837c-81007b0e42ef service nova] Lock "aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:09:04.328533 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-4f94e00f-19f2-40bc-9fe5-2b04db33e974 req-272a5dd4-e1ed-4eef-837c-81007b0e42ef service nova] Lock "aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:09:04.330502 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-4f94e00f-19f2-40bc-9fe5-2b04db33e974 req-272a5dd4-e1ed-4eef-837c-81007b0e42ef service nova] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] No waiting events found dispatching network-vif-plugged-256dd1c6-bc20-43f3-8364-3f70ab70799d {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:09:04.330502 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-4f94e00f-19f2-40bc-9fe5-2b04db33e974 req-272a5dd4-e1ed-4eef-837c-81007b0e42ef service nova] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Received unexpected event network-vif-plugged-256dd1c6-bc20-43f3-8364-3f70ab70799d for instance with vm_state building and task_state spawning.
May 28 02:09:04.410203 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:09:04.412905 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:09:04.422448 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:09:04.422643 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:09:04.423160 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:09:04.423550 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:09:04.423910 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:09:04.424244 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:09:04.708928 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lazy-loading 'flavor' on Instance uuid 08450cf0-e778-4831-82f9-bd268655c346 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:09:04.918068 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 02:09:04.918239 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934144.918042, aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:09:04.918400 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] VM Paused (Lifecycle Event)
May 28 02:09:04.931104 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Took 11.34 seconds to spawn the instance on the hypervisor.
May 28 02:09:04.931364 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:09:05.212146 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Attempting to attach volume 4dc373e5-9dbe-4a4d-8411-d218d711b7e8 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98241) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 02:09:05.213904 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] attach device xml: <disk type="block" device="disk">
May 28 02:09:05.213904 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:09:05.213904 np0000001583 nova-compute[98241]:   <alias name="ua-4dc373e5-9dbe-4a4d-8411-d218d711b7e8"/>
May 28 02:09:05.213904 np0000001583 nova-compute[98241]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 28 02:09:05.213904 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:09:05.213904 np0000001583 nova-compute[98241]:   <serial>4dc373e5-9dbe-4a4d-8411-d218d711b7e8</serial>
May 28 02:09:05.213904 np0000001583 nova-compute[98241]: </disk>
May 28 02:09:05.213904 np0000001583 nova-compute[98241]:  {{(pid=98241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 02:09:05.417286 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:05.421250 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:09:05.429002 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934145.4286556, aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:09:05.429137 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] VM Resumed (Lifecycle Event)
May 28 02:09:05.445534 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Took 18.41 seconds to build instance.
May 28 02:09:05.931474 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:09:05.934681 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:09:05.948473 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8a8a1013-0491-4e68-89be-bf7b8e2e3f3e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.920s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:09:06.891685 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:09:06.891769 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:09:06.892485 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:09:06.892485 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] No VIF found with MAC fa:16:3e:a3:78:a0, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:09:07.045964 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5c6f036c-cdfb-4a90-94bc-1d86afb0b33e req-8f7c9660-94b4-49c6-a04a-22149757155e service nova] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Received event network-changed-256dd1c6-bc20-43f3-8364-3f70ab70799d {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:09:07.045964 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5c6f036c-cdfb-4a90-94bc-1d86afb0b33e req-8f7c9660-94b4-49c6-a04a-22149757155e service nova] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Refreshing instance network info cache due to event network-changed-256dd1c6-bc20-43f3-8364-3f70ab70799d. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:09:07.045964 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5c6f036c-cdfb-4a90-94bc-1d86afb0b33e req-8f7c9660-94b4-49c6-a04a-22149757155e service nova] Acquiring lock "refresh_cache-aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:09:07.046777 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5c6f036c-cdfb-4a90-94bc-1d86afb0b33e req-8f7c9660-94b4-49c6-a04a-22149757155e service nova] Acquired lock "refresh_cache-aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:09:07.046777 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-5c6f036c-cdfb-4a90-94bc-1d86afb0b33e req-8f7c9660-94b4-49c6-a04a-22149757155e service nova] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Refreshing network info cache for port 256dd1c6-bc20-43f3-8364-3f70ab70799d {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:09:07.057423 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-5c6f036c-cdfb-4a90-94bc-1d86afb0b33e req-8f7c9660-94b4-49c6-a04a-22149757155e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:09:07.093216 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:07.433377 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-5c6f036c-cdfb-4a90-94bc-1d86afb0b33e req-8f7c9660-94b4-49c6-a04a-22149757155e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:09:07.600791 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-5c6f036c-cdfb-4a90-94bc-1d86afb0b33e req-8f7c9660-94b4-49c6-a04a-22149757155e service nova] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Updated VIF entry in instance network info cache for port 256dd1c6-bc20-43f3-8364-3f70ab70799d. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:09:07.600791 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-5c6f036c-cdfb-4a90-94bc-1d86afb0b33e req-8f7c9660-94b4-49c6-a04a-22149757155e service nova] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Updating instance_info_cache with network_info: [{"id": "256dd1c6-bc20-43f3-8364-3f70ab70799d", "address": "fa:16:3e:4d:38:08", "network": {"id": "ef15cd88-386f-4fc6-8df0-74267f73d3fb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1804869041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b7ada2896b1043bfb246c28ad9d1e174", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap256dd1c6-bc", "ovs_interfaceid": "256dd1c6-bc20-43f3-8364-3f70ab70799d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:09:08.103932 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5c6f036c-cdfb-4a90-94bc-1d86afb0b33e req-8f7c9660-94b4-49c6-a04a-22149757155e service nova] Releasing lock "refresh_cache-aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:09:08.452532 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-17c254b2-d944-443c-b346-bccd20626e07 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "08450cf0-e778-4831-82f9-bd268655c346" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.275s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:09:08.580211 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:08.772056 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a085a321-f754-4dd0-80a4-7010a23a0dcb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "08450cf0-e778-4831-82f9-bd268655c346" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:09:08.772346 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a085a321-f754-4dd0-80a4-7010a23a0dcb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "08450cf0-e778-4831-82f9-bd268655c346" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:09:09.090308 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:09.275095 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-a085a321-f754-4dd0-80a4-7010a23a0dcb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Detaching volume 4dc373e5-9dbe-4a4d-8411-d218d711b7e8
May 28 02:09:09.320510 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-a085a321-f754-4dd0-80a4-7010a23a0dcb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Attempting to driver detach volume 4dc373e5-9dbe-4a4d-8411-d218d711b7e8 from mountpoint /dev/vdb
May 28 02:09:09.365292 np0000001583 nova-compute[98241]: DEBUG os_brick.encryptors [None req-a085a321-f754-4dd0-80a4-7010a23a0dcb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8', 'iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4dc373e5-9dbe-4a4d-8411-d218d711b7e8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': '08450cf0-e778-4831-82f9-bd268655c346', 'attached_at': '', 'detached_at': '', 'volume_id': '4dc373e5-9dbe-4a4d-8411-d218d711b7e8', 'serial': '4dc373e5-9dbe-4a4d-8411-d218d711b7e8'} {{(pid=98241) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 02:09:09.369865 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a085a321-f754-4dd0-80a4-7010a23a0dcb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Found disk vdb by alias ua-4dc373e5-9dbe-4a4d-8411-d218d711b7e8 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:09:09.371488 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a085a321-f754-4dd0-80a4-7010a23a0dcb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Found disk vdb by alias ua-4dc373e5-9dbe-4a4d-8411-d218d711b7e8 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:09:09.371659 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a085a321-f754-4dd0-80a4-7010a23a0dcb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Attempting to detach device vdb from instance 08450cf0-e778-4831-82f9-bd268655c346 from the persistent domain config. {{(pid=98241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 02:09:09.372012 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-a085a321-f754-4dd0-80a4-7010a23a0dcb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:09:09.372012 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:09:09.372012 np0000001583 nova-compute[98241]:   <alias name="ua-4dc373e5-9dbe-4a4d-8411-d218d711b7e8"/>
May 28 02:09:09.372012 np0000001583 nova-compute[98241]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 28 02:09:09.372012 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:09:09.372012 np0000001583 nova-compute[98241]:   <serial>4dc373e5-9dbe-4a4d-8411-d218d711b7e8</serial>
May 28 02:09:09.372012 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 02:09:09.372012 np0000001583 nova-compute[98241]: </disk>
May 28 02:09:09.372012 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:09:09.380688 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-a085a321-f754-4dd0-80a4-7010a23a0dcb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Successfully detached device vdb from instance 08450cf0-e778-4831-82f9-bd268655c346 from the persistent domain config.
May 28 02:09:09.380920 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a085a321-f754-4dd0-80a4-7010a23a0dcb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] (1/8): Attempting to detach device vdb with device alias ua-4dc373e5-9dbe-4a4d-8411-d218d711b7e8 from instance 08450cf0-e778-4831-82f9-bd268655c346 from the live domain config. {{(pid=98241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 02:09:09.381297 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-a085a321-f754-4dd0-80a4-7010a23a0dcb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:09:09.381297 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:09:09.381297 np0000001583 nova-compute[98241]:   <alias name="ua-4dc373e5-9dbe-4a4d-8411-d218d711b7e8"/>
May 28 02:09:09.381297 np0000001583 nova-compute[98241]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 28 02:09:09.381297 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:09:09.381297 np0000001583 nova-compute[98241]:   <serial>4dc373e5-9dbe-4a4d-8411-d218d711b7e8</serial>
May 28 02:09:09.381297 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 02:09:09.381297 np0000001583 nova-compute[98241]: </disk>
May 28 02:09:09.381297 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:09:09.913643 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Received event <DeviceRemovedEvent: 1779934149.9132628, 08450cf0-e778-4831-82f9-bd268655c346 => ua-4dc373e5-9dbe-4a4d-8411-d218d711b7e8> from libvirt while the driver is waiting for it; dispatched. {{(pid=98241) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 02:09:09.914849 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a085a321-f754-4dd0-80a4-7010a23a0dcb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-4dc373e5-9dbe-4a4d-8411-d218d711b7e8 for instance 08450cf0-e778-4831-82f9-bd268655c346 {{(pid=98241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 02:09:09.918557 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-a085a321-f754-4dd0-80a4-7010a23a0dcb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Successfully detached device vdb from instance 08450cf0-e778-4831-82f9-bd268655c346 from the live domain config.
May 28 02:09:09.923762 np0000001583 nova-compute[98241]: WARNING stevedore.named [None req-a085a321-f754-4dd0-80a4-7010a23a0dcb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 02:09:09.923762 np0000001583 nova-compute[98241]: WARNING castellan.key_manager [None req-a085a321-f754-4dd0-80a4-7010a23a0dcb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 02:09:09.923762 np0000001583 nova-compute[98241]: WARNING nova.keymgr.conf_key_mgr [None req-a085a321-f754-4dd0-80a4-7010a23a0dcb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 02:09:09.924034 np0000001583 nova-compute[98241]: DEBUG os_brick.encryptors [None req-a085a321-f754-4dd0-80a4-7010a23a0dcb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x7724f8538110>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8', 'iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4dc373e5-9dbe-4a4d-8411-d218d711b7e8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': '08450cf0-e778-4831-82f9-bd268655c346', 'attached_at': '', 'detached_at': '', 'volume_id': '4dc373e5-9dbe-4a4d-8411-d218d711b7e8', 'serial': '4dc373e5-9dbe-4a4d-8411-d218d711b7e8'} {{(pid=98241) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 28 02:09:09.924197 np0000001583 nova-compute[98241]: DEBUG os_brick.encryptors.luks [None req-a085a321-f754-4dd0-80a4-7010a23a0dcb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] closing encrypted volume /dev/dm-2 {{(pid=98241) _close_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:207}}
May 28 02:09:09.950453 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a085a321-f754-4dd0-80a4-7010a23a0dcb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 08450cf0-e778-4831-82f9-bd268655c346] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:09:09.950799 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a085a321-f754-4dd0-80a4-7010a23a0dcb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8', 'iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4dc373e5-9dbe-4a4d-8411-d218d711b7e8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:09:09.951187 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a085a321-f754-4dd0-80a4-7010a23a0dcb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:09:09.951435 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a085a321-f754-4dd0-80a4-7010a23a0dcb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:09:09.951739 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a085a321-f754-4dd0-80a4-7010a23a0dcb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8', 'iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4dc373e5-9dbe-4a4d-8411-d218d711b7e8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:09:09.951881 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a085a321-f754-4dd0-80a4-7010a23a0dcb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:09:09.975936 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a085a321-f754-4dd0-80a4-7010a23a0dcb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8 (non-flash)
May 28 02:09:09.975936 np0000001583 nova-compute[98241]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8 (non-flash)
May 28 02:09:09.975936 np0000001583 nova-compute[98241]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:09:09.975936 np0000001583 nova-compute[98241]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:09:09.975936 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:09:09.976192 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a085a321-f754-4dd0-80a4-7010a23a0dcb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8 (non-flash)
May 28 02:09:09.976192 np0000001583 nova-compute[98241]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8 (non-flash)
May 28 02:09:09.976192 np0000001583 nova-compute[98241]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:09:09.976192 np0000001583 nova-compute[98241]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:09:09.976192 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:09:09.976300 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a085a321-f754-4dd0-80a4-7010a23a0dcb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8', '175'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8', '176'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c', '177'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c', '178')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:09:09.976300 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a085a321-f754-4dd0-80a4-7010a23a0dcb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8', '175')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:09:09.977243 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a085a321-f754-4dd0-80a4-7010a23a0dcb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8', '176')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:09:09.977869 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a085a321-f754-4dd0-80a4-7010a23a0dcb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f839ad40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8'): ({'sdd'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:09:09.978117 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a085a321-f754-4dd0-80a4-7010a23a0dcb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Removing multipathed devices sdc, sdd {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:09:09.978333 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a085a321-f754-4dd0-80a4-7010a23a0dcb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Flush multipath device 33000000008b565e5 {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:09:10.018208 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a085a321-f754-4dd0-80a4-7010a23a0dcb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:09:10.064481 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a085a321-f754-4dd0-80a4-7010a23a0dcb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:09:10.124317 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a085a321-f754-4dd0-80a4-7010a23a0dcb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Checking to see if SCSI volumes sdc, sdd have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:09:10.124479 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a085a321-f754-4dd0-80a4-7010a23a0dcb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] SCSI volumes sdc, sdd have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:09:10.125582 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a085a321-f754-4dd0-80a4-7010a23a0dcb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Checking to see if device paths {'sdc', 'sdd'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:09:10.141585 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a085a321-f754-4dd0-80a4-7010a23a0dcb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Device paths {'sdc', 'sdd'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:09:10.141776 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a085a321-f754-4dd0-80a4-7010a23a0dcb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:09:10.154518 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a085a321-f754-4dd0-80a4-7010a23a0dcb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:09:10.185927 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a085a321-f754-4dd0-80a4-7010a23a0dcb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 175, target: iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8, portal: 192.168.40.100,3260]
May 28 02:09:10.185927 np0000001583 nova-compute[98241]: Logout of [sid: 175, target: iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8, portal: 192.168.40.100,3260] successful.
May 28 02:09:10.185927 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:09:10.203877 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a085a321-f754-4dd0-80a4-7010a23a0dcb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:09:10.217174 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a085a321-f754-4dd0-80a4-7010a23a0dcb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:09:10.247622 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a085a321-f754-4dd0-80a4-7010a23a0dcb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 176, target: iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8, portal: 192.168.50.100,3260]
May 28 02:09:10.247622 np0000001583 nova-compute[98241]: Logout of [sid: 176, target: iqn.2023-03.storpool.com:os--volume-4dc373e5-9dbe-4a4d-8411-d218d711b7e8, portal: 192.168.50.100,3260] successful.
May 28 02:09:10.247622 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:09:10.260742 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a085a321-f754-4dd0-80a4-7010a23a0dcb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:09:10.261695 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a085a321-f754-4dd0-80a4-7010a23a0dcb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:09:10.261850 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a085a321-f754-4dd0-80a4-7010a23a0dcb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] <== disconnect_volume: return (311ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:09:10.262012 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a085a321-f754-4dd0-80a4-7010a23a0dcb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:09:10.818727 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-a085a321-f754-4dd0-80a4-7010a23a0dcb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lazy-loading 'flavor' on Instance uuid 08450cf0-e778-4831-82f9-bd268655c346 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:09:11.578521 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Acquiring lock "e7554a11-146b-416b-8121-b7e6773b8dab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:09:11.578694 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "e7554a11-146b-416b-8121-b7e6773b8dab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:09:11.824958 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a085a321-f754-4dd0-80a4-7010a23a0dcb tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "08450cf0-e778-4831-82f9-bd268655c346" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.052s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:09:12.082058 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 02:09:12.120001 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-50a6e206-c7b3-4e78-8519-2d89ed46f97e tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "08450cf0-e778-4831-82f9-bd268655c346" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:09:12.120307 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-50a6e206-c7b3-4e78-8519-2d89ed46f97e tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "08450cf0-e778-4831-82f9-bd268655c346" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:09:12.120486 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-50a6e206-c7b3-4e78-8519-2d89ed46f97e tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "08450cf0-e778-4831-82f9-bd268655c346-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:09:12.120712 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-50a6e206-c7b3-4e78-8519-2d89ed46f97e tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "08450cf0-e778-4831-82f9-bd268655c346-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:09:12.120855 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-50a6e206-c7b3-4e78-8519-2d89ed46f97e tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "08450cf0-e778-4831-82f9-bd268655c346-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:09:12.123262 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-50a6e206-c7b3-4e78-8519-2d89ed46f97e tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Terminating instance
May 28 02:09:12.626610 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-50a6e206-c7b3-4e78-8519-2d89ed46f97e tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 02:09:12.637247 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:09:12.637448 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:09:12.641977 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 02:09:12.642174 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Claim successful on node np0000001583
May 28 02:09:12.646172 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:12.650097 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:12.669712 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:12.671312 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:12.694436 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:12.695372 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:12.803052 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5523d74f-0d12-4120-bf6f-1ceffe3cee76 req-d54bc2e6-51ad-45cf-a34f-91c2a18dae9b service nova] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Received event network-vif-unplugged-a6321b66-3810-4403-b7e0-13cb406ba8d8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:09:12.803576 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5523d74f-0d12-4120-bf6f-1ceffe3cee76 req-d54bc2e6-51ad-45cf-a34f-91c2a18dae9b service nova] Acquiring lock "08450cf0-e778-4831-82f9-bd268655c346-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:09:12.803757 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5523d74f-0d12-4120-bf6f-1ceffe3cee76 req-d54bc2e6-51ad-45cf-a34f-91c2a18dae9b service nova] Lock "08450cf0-e778-4831-82f9-bd268655c346-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:09:12.803967 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5523d74f-0d12-4120-bf6f-1ceffe3cee76 req-d54bc2e6-51ad-45cf-a34f-91c2a18dae9b service nova] Lock "08450cf0-e778-4831-82f9-bd268655c346-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:09:12.804012 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5523d74f-0d12-4120-bf6f-1ceffe3cee76 req-d54bc2e6-51ad-45cf-a34f-91c2a18dae9b service nova] [instance: 08450cf0-e778-4831-82f9-bd268655c346] No waiting events found dispatching network-vif-unplugged-a6321b66-3810-4403-b7e0-13cb406ba8d8 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:09:12.804245 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5523d74f-0d12-4120-bf6f-1ceffe3cee76 req-d54bc2e6-51ad-45cf-a34f-91c2a18dae9b service nova] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Received event network-vif-unplugged-a6321b66-3810-4403-b7e0-13cb406ba8d8 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:09:12.933299 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:12.940695 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:12.965259 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999665979999918 future=<Future at 0x7724ec4e2690 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:09:12.965565 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999355573999765 future=<Future at 0x7724ec4e2690 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:09:12.965671 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999200191 future=<Future at 0x7724ec4e2690 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:09:12.968020 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Instance destroyed successfully.
May 28 02:09:12.969777 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-50a6e206-c7b3-4e78-8519-2d89ed46f97e tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lazy-loading 'resources' on Instance uuid 08450cf0-e778-4831-82f9-bd268655c346 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:09:13.474195 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-50a6e206-c7b3-4e78-8519-2d89ed46f97e tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T02:07:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1681469911',display_name='tempest-TestEncryptedCinderVolumes-server-1681469911',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testencryptedcindervolumes-server-1681469911',id=69,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKruAhsDFw41p5AkbVktZHQsHB0jcs980kCUbm8EmTl3RpL/gW/8eMoKYZIVHlmODaKnhxXwVniP4cY3s3vTadl1QY6zpg/rbWfiKmt6HFaTz4zLFjP/s7Ec6/HNwrJaWg==',key_name='tempest-keypair-221617266',keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:08:08Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d192b18567fd4735988dd19da06fb868',ramdisk_id='',reservation_id='r-ct53yoqk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-243696963',owner_user_name='tempest-TestEncryptedCinderVolumes-243696963-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T02:08:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f09c9f1da7e4d32979e47c96d41ae99',uuid=08450cf0-e778-4831-82f9-bd268655c346,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a6321b66-3810-4403-b7e0-13cb406ba8d8", "address": "fa:16:3e:a3:78:a0", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6321b66-38", "ovs_interfaceid": "a6321b66-3810-4403-b7e0-13cb406ba8d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:09:13.474195 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-50a6e206-c7b3-4e78-8519-2d89ed46f97e tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Converting VIF {"id": "a6321b66-3810-4403-b7e0-13cb406ba8d8", "address": "fa:16:3e:a3:78:a0", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6321b66-38", "ovs_interfaceid": "a6321b66-3810-4403-b7e0-13cb406ba8d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:09:13.474195 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-50a6e206-c7b3-4e78-8519-2d89ed46f97e tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a3:78:a0,bridge_name='br-int',has_traffic_filtering=True,id=a6321b66-3810-4403-b7e0-13cb406ba8d8,network=Network(fccbc55c-a449-42c3-bf68-d3d337f7b0ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6321b66-38') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:09:13.474195 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-50a6e206-c7b3-4e78-8519-2d89ed46f97e tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:78:a0,bridge_name='br-int',has_traffic_filtering=True,id=a6321b66-3810-4403-b7e0-13cb406ba8d8,network=Network(fccbc55c-a449-42c3-bf68-d3d337f7b0ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6321b66-38') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:09:13.475928 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:13.476190 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa6321b66-38, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:09:13.478898 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:13.479866 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:09:13.480440 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:13.480621 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e6fb19f9-3cba-48a2-9baa-999db94b89dc) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:09:13.481323 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:13.482120 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:09:13.482209 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:13.484976 np0000001583 nova-compute[98241]: INFO os_vif [None req-50a6e206-c7b3-4e78-8519-2d89ed46f97e tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:78:a0,bridge_name='br-int',has_traffic_filtering=True,id=a6321b66-3810-4403-b7e0-13cb406ba8d8,network=Network(fccbc55c-a449-42c3-bf68-d3d337f7b0ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6321b66-38')
May 28 02:09:13.488110 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-50a6e206-c7b3-4e78-8519-2d89ed46f97e tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Deleting instance files /opt/stack/data/nova/instances/08450cf0-e778-4831-82f9-bd268655c346_del
May 28 02:09:13.488110 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-50a6e206-c7b3-4e78-8519-2d89ed46f97e tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Deletion of /opt/stack/data/nova/instances/08450cf0-e778-4831-82f9-bd268655c346_del complete
May 28 02:09:13.581302 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:13.940938 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:09:13.940938 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:09:13.993598 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-50a6e206-c7b3-4e78-8519-2d89ed46f97e tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Took 1.37 seconds to destroy the instance on the hypervisor.
May 28 02:09:13.994241 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-50a6e206-c7b3-4e78-8519-2d89ed46f97e tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 02:09:13.994297 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 02:09:13.994394 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 08450cf0-e778-4831-82f9-bd268655c346] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 02:09:13.994795 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:09:14.062732 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:09:14.444048 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:09:14.561662 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e1d34c54-6ddd-4fe9-aefb-e364a5d71fa6 req-457ad7b9-39ba-4fde-a513-02e6de4c6587 service nova] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Received event network-vif-deleted-a6321b66-3810-4403-b7e0-13cb406ba8d8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:09:14.561866 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-e1d34c54-6ddd-4fe9-aefb-e364a5d71fa6 req-457ad7b9-39ba-4fde-a513-02e6de4c6587 service nova] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Neutron deleted interface a6321b66-3810-4403-b7e0-13cb406ba8d8; detaching it from the instance and deleting it from the info cache
May 28 02:09:14.563729 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e1d34c54-6ddd-4fe9-aefb-e364a5d71fa6 req-457ad7b9-39ba-4fde-a513-02e6de4c6587 service nova] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Detach interface failed, port_id=a6321b66-3810-4403-b7e0-13cb406ba8d8, reason: Instance 08450cf0-e778-4831-82f9-bd268655c346 could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 02:09:14.859461 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-6bef4385-6523-431e-980d-dc92e2469e1b req-4183bf0f-986d-44c4-aa02-ea1c76155337 service nova] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Received event network-vif-unplugged-a6321b66-3810-4403-b7e0-13cb406ba8d8 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:09:14.860148 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-6bef4385-6523-431e-980d-dc92e2469e1b req-4183bf0f-986d-44c4-aa02-ea1c76155337 service nova] Acquiring lock "08450cf0-e778-4831-82f9-bd268655c346-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:09:14.860450 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-6bef4385-6523-431e-980d-dc92e2469e1b req-4183bf0f-986d-44c4-aa02-ea1c76155337 service nova] Lock "08450cf0-e778-4831-82f9-bd268655c346-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:09:14.860689 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-6bef4385-6523-431e-980d-dc92e2469e1b req-4183bf0f-986d-44c4-aa02-ea1c76155337 service nova] Lock "08450cf0-e778-4831-82f9-bd268655c346-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:09:14.860937 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-6bef4385-6523-431e-980d-dc92e2469e1b req-4183bf0f-986d-44c4-aa02-ea1c76155337 service nova] [instance: 08450cf0-e778-4831-82f9-bd268655c346] No waiting events found dispatching network-vif-unplugged-a6321b66-3810-4403-b7e0-13cb406ba8d8 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:09:14.861145 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-6bef4385-6523-431e-980d-dc92e2469e1b req-4183bf0f-986d-44c4-aa02-ea1c76155337 service nova] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Received event network-vif-unplugged-a6321b66-3810-4403-b7e0-13cb406ba8d8 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:09:14.952004 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.314s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:09:14.952444 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 02:09:15.020095 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:09:15.459736 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 02:09:15.459736 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 02:09:15.459736 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:09:15.459736 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:09:15.522478 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Took 1.53 seconds to deallocate network for instance.
May 28 02:09:15.548585 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c8ce004361ad4602a6f330506184114b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b5c56c77c64b318056094f7fa5861d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 02:09:15.961555 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 02:09:16.028891 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-50a6e206-c7b3-4e78-8519-2d89ed46f97e tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:09:16.029055 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-50a6e206-c7b3-4e78-8519-2d89ed46f97e tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:09:16.034459 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Successfully created port: ec4997ed-eb88-422c-a1f5-0a9bcccaa71a {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 02:09:16.279028 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-50a6e206-c7b3-4e78-8519-2d89ed46f97e tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:09:16.279279 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-50a6e206-c7b3-4e78-8519-2d89ed46f97e tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:09:16.465705 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 02:09:16.525849 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Successfully updated port: ec4997ed-eb88-422c-a1f5-0a9bcccaa71a {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 02:09:16.626384 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-56f9fa3b-a784-4b52-84d4-59b247782c72 req-9b751028-c185-476d-a4b6-1cb96a2c8d53 service nova] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Received event network-changed-ec4997ed-eb88-422c-a1f5-0a9bcccaa71a {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:09:16.626712 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-56f9fa3b-a784-4b52-84d4-59b247782c72 req-9b751028-c185-476d-a4b6-1cb96a2c8d53 service nova] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Refreshing instance network info cache due to event network-changed-ec4997ed-eb88-422c-a1f5-0a9bcccaa71a. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:09:16.627097 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-56f9fa3b-a784-4b52-84d4-59b247782c72 req-9b751028-c185-476d-a4b6-1cb96a2c8d53 service nova] Acquiring lock "refresh_cache-e7554a11-146b-416b-8121-b7e6773b8dab" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:09:16.628971 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-56f9fa3b-a784-4b52-84d4-59b247782c72 req-9b751028-c185-476d-a4b6-1cb96a2c8d53 service nova] Acquired lock "refresh_cache-e7554a11-146b-416b-8121-b7e6773b8dab" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:09:16.628971 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-56f9fa3b-a784-4b52-84d4-59b247782c72 req-9b751028-c185-476d-a4b6-1cb96a2c8d53 service nova] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Refreshing network info cache for port ec4997ed-eb88-422c-a1f5-0a9bcccaa71a {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:09:16.782189 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-50a6e206-c7b3-4e78-8519-2d89ed46f97e tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:09:16.971105 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Booting with volume 50b4ab79-6825-49a1-92c3-c4ec0d47aecb at /dev/vda
May 28 02:09:17.019170 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:09:17.027978 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Acquiring lock "refresh_cache-e7554a11-146b-416b-8121-b7e6773b8dab" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:09:17.031525 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 02:09:17.052910 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:09:17.095134 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 02:09:17.095544 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 02:09:17.104446 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 02:09:17.105438 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe28:6dad', 'fe80::98c1:6bff:fe22:4140', 'fe80::fc16:3eff:fe4d:3808', 'fe80::5461:55ff:fe41:c1b7'] 
May 28 02:09:17.105569 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 02:09:17.105676 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 02:09:17.106074 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] <== get_connector_properties: return (86ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:09:17.106318 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Updating existing volume attachment record: 01d52d51-ec08-4c47-9f9c-148633ed1a0f {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 02:09:17.134162 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-56f9fa3b-a784-4b52-84d4-59b247782c72 req-9b751028-c185-476d-a4b6-1cb96a2c8d53 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:09:17.202237 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-56f9fa3b-a784-4b52-84d4-59b247782c72 req-9b751028-c185-476d-a4b6-1cb96a2c8d53 service nova] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:09:17.290450 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-50a6e206-c7b3-4e78-8519-2d89ed46f97e tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.261s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:09:17.355384 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-56f9fa3b-a784-4b52-84d4-59b247782c72 req-9b751028-c185-476d-a4b6-1cb96a2c8d53 service nova] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:09:17.357250 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-50a6e206-c7b3-4e78-8519-2d89ed46f97e tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Deleted allocations for instance 08450cf0-e778-4831-82f9-bd268655c346
May 28 02:09:17.860263 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-56f9fa3b-a784-4b52-84d4-59b247782c72 req-9b751028-c185-476d-a4b6-1cb96a2c8d53 service nova] Releasing lock "refresh_cache-e7554a11-146b-416b-8121-b7e6773b8dab" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:09:17.861097 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Acquired lock "refresh_cache-e7554a11-146b-416b-8121-b7e6773b8dab" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:09:17.861305 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:09:18.369390 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-50a6e206-c7b3-4e78-8519-2d89ed46f97e tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "08450cf0-e778-4831-82f9-bd268655c346" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.249s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:09:18.432846 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:09:18.481738 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:18.585363 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:18.601315 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:09:18.745440 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Updating instance_info_cache with network_info: [{"id": "ec4997ed-eb88-422c-a1f5-0a9bcccaa71a", "address": "fa:16:3e:e4:70:4e", "network": {"id": "a349b3ac-cae9-4909-b273-8409a97fbe5c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-810622904-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60b5c56c77c64b318056094f7fa5861d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4997ed-eb", "ovs_interfaceid": "ec4997ed-eb88-422c-a1f5-0a9bcccaa71a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:09:19.208312 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 02:09:19.209431 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 02:09:19.209700 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Creating image(s)
May 28 02:09:19.210049 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Did not create local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 02:09:19.210515 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Ensure instance console log exists: /opt/stack/data/nova/instances/e7554a11-146b-416b-8121-b7e6773b8dab/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 02:09:19.210797 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:09:19.211042 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:09:19.211312 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:09:19.249632 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Releasing lock "refresh_cache-e7554a11-146b-416b-8121-b7e6773b8dab" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:09:19.249880 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Instance network_info: |[{"id": "ec4997ed-eb88-422c-a1f5-0a9bcccaa71a", "address": "fa:16:3e:e4:70:4e", "network": {"id": "a349b3ac-cae9-4909-b273-8409a97fbe5c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-810622904-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60b5c56c77c64b318056094f7fa5861d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4997ed-eb", "ovs_interfaceid": "ec4997ed-eb88-422c-a1f5-0a9bcccaa71a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 02:09:19.250916 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Start _get_guest_xml network_info=[{"id": "ec4997ed-eb88-422c-a1f5-0a9bcccaa71a", "address": "fa:16:3e:e4:70:4e", "network": {"id": "a349b3ac-cae9-4909-b273-8409a97fbe5c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-810622904-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60b5c56c77c64b318056094f7fa5861d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4997ed-eb", "ovs_interfaceid": "ec4997ed-eb88-422c-a1f5-0a9bcccaa71a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb', 'iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '50b4ab79-6825-49a1-92c3-c4ec0d47aecb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'e7554a11-146b-416b-8121-b7e6773b8dab', 'attached_at': '', 'detached_at': '', 'volume_id': '50b4ab79-6825-49a1-92c3-c4ec0d47aecb', 'serial': '50b4ab79-6825-49a1-92c3-c4ec0d47aecb'}, 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '01d52d51-ec08-4c47-9f9c-148633ed1a0f', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 02:09:19.257324 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:09:19.259018 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPatternV346-server-1188082680', uuid='e7554a11-146b-416b-8121-b7e6773b8dab'), owner=OwnerMeta(userid='c8ce004361ad4602a6f330506184114b', username='tempest-TestVolumeBootPatternV346-884356236-project-member', projectid='60b5c56c77c64b318056094f7fa5861d', projectname='tempest-TestVolumeBootPatternV346-884356236'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ec4997ed-eb88-422c-a1f5-0a9bcccaa71a", "address": "fa:16:3e:e4:70:4e", "network": {"id": "a349b3ac-cae9-4909-b273-8409a97fbe5c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-810622904-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60b5c56c77c64b318056094f7fa5861d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4997ed-eb", "ovs_interfaceid": "ec4997ed-eb88-422c-a1f5-0a9bcccaa71a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779934159.2585483) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 02:09:19.261110 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 02:09:19.262569 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 02:09:19.264815 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 02:09:19.266426 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 02:09:19.267875 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 02:09:19.268267 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 02:09:19.268504 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 02:09:19.268575 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 02:09:19.268742 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 02:09:19.268849 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 02:09:19.268975 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 02:09:19.272253 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 02:09:19.272671 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 02:09:19.272940 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 02:09:19.274206 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 02:09:19.275374 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 02:09:19.295061 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 02:09:19.295750 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb', 'iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '50b4ab79-6825-49a1-92c3-c4ec0d47aecb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:09:19.296123 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:09:19.296654 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:09:19.297016 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb', 'iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '50b4ab79-6825-49a1-92c3-c4ec0d47aecb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 02:09:19.313743 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:09:19.314826 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:09:19.315739 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:09:19.315845 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:09:19.316608 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:09:19.316862 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:09:19.331979 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:09:19.331979 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:09:19.335461 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:09:19.335461 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:09:19.346877 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb] added
May 28 02:09:19.346877 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:09:19.346877 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:09:19.346877 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:09:19.346877 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:09:19.346877 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:09:19.346877 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:09:19.347265 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:09:19.347265 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0313(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:09:19.347367 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:09:19.350808 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb] added
May 28 02:09:19.350808 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:09:19.350808 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:09:19.350808 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:09:19.350808 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:09:19.350808 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:09:19.350808 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:09:19.351053 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:09:19.351196 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0343(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:09:19.351388 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:09:20.347832 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:09:20.351875 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:09:20.362566 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:09:20.362566 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:09:20.375202 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:09:20.375202 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:09:20.379929 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:09:20.391308 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:09:20.401837 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:09:20.401837 np0000001583 nova-compute[98241]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:09:20.401837 np0000001583 nova-compute[98241]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3daf7e89-44e4-4bdb-a6e1-20277ae4f726 (non-flash)
May 28 02:09:20.401837 np0000001583 nova-compute[98241]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3daf7e89-44e4-4bdb-a6e1-20277ae4f726 (non-flash)
May 28 02:09:20.401837 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:09:20.402325 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsi session list stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:09:20.402325 np0000001583 nova-compute[98241]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:09:20.402325 np0000001583 nova-compute[98241]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3daf7e89-44e4-4bdb-a6e1-20277ae4f726 (non-flash)
May 28 02:09:20.402325 np0000001583 nova-compute[98241]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3daf7e89-44e4-4bdb-a6e1-20277ae4f726 (non-flash)
May 28 02:09:20.402325 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:09:20.411224 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:09:20.411224 np0000001583 nova-compute[98241]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:09:20.411224 np0000001583 nova-compute[98241]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3daf7e89-44e4-4bdb-a6e1-20277ae4f726 (non-flash)
May 28 02:09:20.411224 np0000001583 nova-compute[98241]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3daf7e89-44e4-4bdb-a6e1-20277ae4f726 (non-flash)
May 28 02:09:20.411224 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:09:20.411224 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsi session list stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:09:20.411224 np0000001583 nova-compute[98241]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:09:20.411224 np0000001583 nova-compute[98241]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3daf7e89-44e4-4bdb-a6e1-20277ae4f726 (non-flash)
May 28 02:09:20.411224 np0000001583 nova-compute[98241]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3daf7e89-44e4-4bdb-a6e1-20277ae4f726 (non-flash)
May 28 02:09:20.411224 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:09:20.455959 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb, portal: 192.168.40.100,3260]
May 28 02:09:20.455959 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb, portal: 192.168.40.100,3260] successful.
May 28 02:09:20.455959 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:09:20.465836 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb, portal: 192.168.50.100,3260]
May 28 02:09:20.465836 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb, portal: 192.168.50.100,3260] successful.
May 28 02:09:20.465836 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:09:20.474301 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:09:20.482514 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:09:20.497355 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:09:20.497355 np0000001583 nova-compute[98241]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:09:20.497355 np0000001583 nova-compute[98241]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3daf7e89-44e4-4bdb-a6e1-20277ae4f726 (non-flash)
May 28 02:09:20.497355 np0000001583 nova-compute[98241]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3daf7e89-44e4-4bdb-a6e1-20277ae4f726 (non-flash)
May 28 02:09:20.497355 np0000001583 nova-compute[98241]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:09:20.497355 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:09:20.497355 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:09:20.497789 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsi session list stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:09:20.497789 np0000001583 nova-compute[98241]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:09:20.497789 np0000001583 nova-compute[98241]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3daf7e89-44e4-4bdb-a6e1-20277ae4f726 (non-flash)
May 28 02:09:20.497789 np0000001583 nova-compute[98241]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3daf7e89-44e4-4bdb-a6e1-20277ae4f726 (non-flash)
May 28 02:09:20.497789 np0000001583 nova-compute[98241]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:09:20.497789 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:09:20.497789 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:09:20.497951 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.182s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:09:20.498173 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:09:20.499307 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] HCTL ('9', '-', '-', 0) found on session 181 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:09:20.499412 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:09:20.507425 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:09:20.507425 np0000001583 nova-compute[98241]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:09:20.507425 np0000001583 nova-compute[98241]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3daf7e89-44e4-4bdb-a6e1-20277ae4f726 (non-flash)
May 28 02:09:20.507425 np0000001583 nova-compute[98241]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3daf7e89-44e4-4bdb-a6e1-20277ae4f726 (non-flash)
May 28 02:09:20.507425 np0000001583 nova-compute[98241]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:09:20.507425 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:09:20.507425 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:09:20.507640 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsi session list stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:09:20.507640 np0000001583 nova-compute[98241]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:09:20.507640 np0000001583 nova-compute[98241]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3daf7e89-44e4-4bdb-a6e1-20277ae4f726 (non-flash)
May 28 02:09:20.507640 np0000001583 nova-compute[98241]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3daf7e89-44e4-4bdb-a6e1-20277ae4f726 (non-flash)
May 28 02:09:20.507640 np0000001583 nova-compute[98241]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:09:20.507640 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:09:20.507640 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:09:20.507812 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.191s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:09:20.507958 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:09:20.508812 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] HCTL ('12', '-', '-', 0) found on session 182 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:09:20.509514 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:09:20.525854 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Searching for a device in session 181 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:09:20.525854 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '50b4ab79-6825-49a1-92c3-c4ec0d47aecb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:09:20.530163 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Searching for a device in session 182 and hctl ['12', '*', '*', 0] yield: None {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:09:21.193896 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:09:21.194442 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:09:21.531759 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Searching for a device in session 182 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:09:21.532330 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '50b4ab79-6825-49a1-92c3-c4ec0d47aecb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:09:22.193826 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:09:22.194183 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:09:22.331270 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Found WWN 33000000064ca37b4 for multipath device dm-2 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 02:09:22.331674 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:09:22.331943 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] <== connect_volume: return (3036ms) {'type': 'block', 'scsi_wwn': '33000000064ca37b4', 'path': '/dev/dm-2', 'multipath_id': '33000000064ca37b4'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:09:22.332166 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000064ca37b4', 'path': '/dev/dm-2', 'multipath_id': '33000000064ca37b4'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 02:09:22.838444 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:09:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1188082680',display_name='tempest-TestVolumeBootPatternV346-server-1188082680',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testvolumebootpatternv346-server-1188082680',id=72,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCX0yMP8i6nBj1+RANIo+QRZE8WT/Obll/ENVwOiSPazwBcRR0Pfr9evlfuVjkxzJhaxppC4MDYBJwjftjTp/GHQDQ9Yx1BmAoo1aj5gXO5QjoX1tFlBW7KYV0aAzSCVaA==',key_name='tempest-keypair-580717331',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60b5c56c77c64b318056094f7fa5861d',ramdisk_id='',reservation_id='r-00srh294',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-884356236',owner_user_name='tempest-TestVolumeBootPatternV346-884356236-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:09:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8ce004361ad4602a6f330506184114b',uuid=e7554a11-146b-416b-8121-b7e6773b8dab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec4997ed-eb88-422c-a1f5-0a9bcccaa71a", "address": "fa:16:3e:e4:70:4e", "network": {"id": "a349b3ac-cae9-4909-b273-8409a97fbe5c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-810622904-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60b5c56c77c64b318056094f7fa5861d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4997ed-eb", "ovs_interfaceid": "ec4997ed-eb88-422c-a1f5-0a9bcccaa71a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 02:09:22.838903 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Converting VIF {"id": "ec4997ed-eb88-422c-a1f5-0a9bcccaa71a", "address": "fa:16:3e:e4:70:4e", "network": {"id": "a349b3ac-cae9-4909-b273-8409a97fbe5c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-810622904-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60b5c56c77c64b318056094f7fa5861d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4997ed-eb", "ovs_interfaceid": "ec4997ed-eb88-422c-a1f5-0a9bcccaa71a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:09:22.839166 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:70:4e,bridge_name='br-int',has_traffic_filtering=True,id=ec4997ed-eb88-422c-a1f5-0a9bcccaa71a,network=Network(a349b3ac-cae9-4909-b273-8409a97fbe5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec4997ed-eb') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:09:22.839899 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lazy-loading 'pci_devices' on Instance uuid e7554a11-146b-416b-8121-b7e6773b8dab {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:09:23.133560 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "5f8cf96c-2c00-493d-afe2-2ea77a834767" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:09:23.133819 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "5f8cf96c-2c00-493d-afe2-2ea77a834767" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:09:23.193278 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:09:23.193720 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:09:23.343200 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] End _get_guest_xml xml=<domain type="qemu">
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:   <uuid>e7554a11-146b-416b-8121-b7e6773b8dab</uuid>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:   <name>instance-00000048</name>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:   <metadata>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:       <nova:name>tempest-TestVolumeBootPatternV346-server-1188082680</nova:name>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 02:09:19</nova:creationTime>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:       <nova:image uuid="">
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:       </nova:image>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:         <nova:user uuid="c8ce004361ad4602a6f330506184114b">tempest-TestVolumeBootPatternV346-884356236-project-member</nova:user>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:         <nova:project uuid="60b5c56c77c64b318056094f7fa5861d">tempest-TestVolumeBootPatternV346-884356236</nova:project>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:       <nova:root type="volume" uuid=""/>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:         <nova:port uuid="ec4997ed-eb88-422c-a1f5-0a9bcccaa71a">
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:         </nova:port>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:   </metadata>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:     <system>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:       <entry name="serial">e7554a11-146b-416b-8121-b7e6773b8dab</entry>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:       <entry name="uuid">e7554a11-146b-416b-8121-b7e6773b8dab</entry>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:     </system>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:   <os>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:   </os>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:   <features>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:     <acpi/>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:     <tcg>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:     </tcg>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:   </features>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:   </cpu>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:   <devices>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/e7554a11-146b-416b-8121-b7e6773b8dab/disk.config"/>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:     </disk>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:     <disk type="block" device="disk">
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:       <alias name="ua-50b4ab79-6825-49a1-92c3-c4ec0d47aecb"/>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:       <source dev="/dev/dm-2"/>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:       <serial>50b4ab79-6825-49a1-92c3-c4ec0d47aecb</serial>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:     </disk>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:e4:70:4e"/>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:       <target dev="tapec4997ed-eb"/>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:     </interface>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/e7554a11-146b-416b-8121-b7e6773b8dab/console.log" append="off"/>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:     </serial>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:     <video>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:     </video>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:     </rng>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:     </memballoon>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:   </devices>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]: </domain>
May 28 02:09:23.343200 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 02:09:23.345602 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Preparing to wait for external event network-vif-plugged-ec4997ed-eb88-422c-a1f5-0a9bcccaa71a {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 02:09:23.345602 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Acquiring lock "e7554a11-146b-416b-8121-b7e6773b8dab-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:09:23.345602 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "e7554a11-146b-416b-8121-b7e6773b8dab-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:09:23.345602 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "e7554a11-146b-416b-8121-b7e6773b8dab-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:09:23.345602 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:09:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1188082680',display_name='tempest-TestVolumeBootPatternV346-server-1188082680',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testvolumebootpatternv346-server-1188082680',id=72,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCX0yMP8i6nBj1+RANIo+QRZE8WT/Obll/ENVwOiSPazwBcRR0Pfr9evlfuVjkxzJhaxppC4MDYBJwjftjTp/GHQDQ9Yx1BmAoo1aj5gXO5QjoX1tFlBW7KYV0aAzSCVaA==',key_name='tempest-keypair-580717331',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60b5c56c77c64b318056094f7fa5861d',ramdisk_id='',reservation_id='r-00srh294',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-884356236',owner_user_name='tempest-TestVolumeBootPatternV346-884356236-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:09:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8ce004361ad4602a6f330506184114b',uuid=e7554a11-146b-416b-8121-b7e6773b8dab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec4997ed-eb88-422c-a1f5-0a9bcccaa71a", "address": "fa:16:3e:e4:70:4e", "network": {"id": "a349b3ac-cae9-4909-b273-8409a97fbe5c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-810622904-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60b5c56c77c64b318056094f7fa5861d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4997ed-eb", "ovs_interfaceid": "ec4997ed-eb88-422c-a1f5-0a9bcccaa71a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 02:09:23.345602 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Converting VIF {"id": "ec4997ed-eb88-422c-a1f5-0a9bcccaa71a", "address": "fa:16:3e:e4:70:4e", "network": {"id": "a349b3ac-cae9-4909-b273-8409a97fbe5c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-810622904-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60b5c56c77c64b318056094f7fa5861d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4997ed-eb", "ovs_interfaceid": "ec4997ed-eb88-422c-a1f5-0a9bcccaa71a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:09:23.345602 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:70:4e,bridge_name='br-int',has_traffic_filtering=True,id=ec4997ed-eb88-422c-a1f5-0a9bcccaa71a,network=Network(a349b3ac-cae9-4909-b273-8409a97fbe5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec4997ed-eb') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:09:23.345947 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:70:4e,bridge_name='br-int',has_traffic_filtering=True,id=ec4997ed-eb88-422c-a1f5-0a9bcccaa71a,network=Network(a349b3ac-cae9-4909-b273-8409a97fbe5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec4997ed-eb') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 02:09:23.346496 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:23.346839 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:09:23.347180 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 02:09:23.348132 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:23.348357 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '428aeea0-6b61-5eec-944a-51b683b0ffd2', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:09:23.349253 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:23.349889 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:09:23.350225 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:23.351852 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:23.352006 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec4997ed-eb, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:09:23.352314 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapec4997ed-eb, col_values=(('qos', UUID('ec53e224-012b-4004-b507-f7cbc9dbbe96')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:09:23.352493 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapec4997ed-eb, col_values=(('external_ids', {'iface-id': 'ec4997ed-eb88-422c-a1f5-0a9bcccaa71a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:70:4e', 'vm-uuid': 'e7554a11-146b-416b-8121-b7e6773b8dab'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:09:23.353302 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:23.354321 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:09:23.358411 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:23.359135 np0000001583 nova-compute[98241]: INFO os_vif [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:70:4e,bridge_name='br-int',has_traffic_filtering=True,id=ec4997ed-eb88-422c-a1f5-0a9bcccaa71a,network=Network(a349b3ac-cae9-4909-b273-8409a97fbe5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec4997ed-eb')
May 28 02:09:23.583840 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:23.635753 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 02:09:24.179685 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:09:24.180751 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:09:24.183212 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 02:09:24.183417 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Claim successful on node np0000001583
May 28 02:09:24.873959 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:09:24.874124 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:09:24.874200 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] No VIF found with MAC fa:16:3e:e4:70:4e, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:09:24.874504 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Using config drive
May 28 02:09:25.193554 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:09:25.193972 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Cleaning up deleted instances {{(pid=98241) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}}
May 28 02:09:25.379021 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:09:25.387447 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:09:25.387653 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:09:25.481046 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Creating config drive at /opt/stack/data/nova/instances/e7554a11-146b-416b-8121-b7e6773b8dab/disk.config
May 28 02:09:25.484374 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e7554a11-146b-416b-8121-b7e6773b8dab/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5mnz1v9_ {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:09:25.537359 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e7554a11-146b-416b-8121-b7e6773b8dab/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5mnz1v9_" returned: 0 in 0.053s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:09:25.697123 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] There are 0 instances to clean {{(pid=98241) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}}
May 28 02:09:25.697513 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.50 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:09:25.890450 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:09:25.919703 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:25.942332 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:25.945308 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:26.034601 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:26.092496 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-1e8b2263-20bd-46d8-bd2d-a92988db1b87 req-e4b681af-7b01-409c-9523-188eff069ffc service nova] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Received event network-vif-plugged-ec4997ed-eb88-422c-a1f5-0a9bcccaa71a {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:09:26.093003 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-1e8b2263-20bd-46d8-bd2d-a92988db1b87 req-e4b681af-7b01-409c-9523-188eff069ffc service nova] Acquiring lock "e7554a11-146b-416b-8121-b7e6773b8dab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:09:26.093247 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-1e8b2263-20bd-46d8-bd2d-a92988db1b87 req-e4b681af-7b01-409c-9523-188eff069ffc service nova] Lock "e7554a11-146b-416b-8121-b7e6773b8dab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:09:26.093412 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-1e8b2263-20bd-46d8-bd2d-a92988db1b87 req-e4b681af-7b01-409c-9523-188eff069ffc service nova] Lock "e7554a11-146b-416b-8121-b7e6773b8dab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:09:26.093588 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-1e8b2263-20bd-46d8-bd2d-a92988db1b87 req-e4b681af-7b01-409c-9523-188eff069ffc service nova] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Processing event network-vif-plugged-ec4997ed-eb88-422c-a1f5-0a9bcccaa71a {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 02:09:26.233188 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:26.235674 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:26.237579 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:26.258049 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:26.398096 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.218s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:09:26.398645 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 02:09:26.674418 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934166.673989, e7554a11-146b-416b-8121-b7e6773b8dab => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:09:26.674796 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] VM Started (Lifecycle Event)
May 28 02:09:26.675746 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 02:09:26.679712 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 02:09:26.682816 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Instance spawned successfully.
May 28 02:09:26.683440 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 02:09:26.908106 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 02:09:26.908106 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 02:09:26.908106 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:09:26.908106 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:09:27.007728 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0f09c9f1da7e4d32979e47c96d41ae99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd192b18567fd4735988dd19da06fb868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 02:09:27.177956 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:09:27.181089 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:09:27.194008 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:09:27.194587 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:09:27.196775 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:09:27.198900 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:09:27.200030 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:09:27.200381 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:09:27.200668 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:09:27.201751 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:09:27.410919 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 02:09:27.529532 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Successfully created port: fe49fa27-da6a-4d8f-ab1e-bb280d24658c {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 02:09:27.684484 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 02:09:27.684754 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934167.6845028, e7554a11-146b-416b-8121-b7e6773b8dab => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:09:27.684989 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] VM Paused (Lifecycle Event)
May 28 02:09:27.701279 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:09:27.701540 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:09:27.701746 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:09:27.701952 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Auditing locally available compute resources for np0000001583 (node: np0000001583) {{(pid=98241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 02:09:27.707931 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Took 8.50 seconds to spawn the instance on the hypervisor.
May 28 02:09:27.710506 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:09:27.917881 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 02:09:27.965329 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.00042381000002933433 future=<Future at 0x7724ec4e2690 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:09:27.966213 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Emitting event <LifecycleEvent: 1779934152.9648156, 08450cf0-e778-4831-82f9-bd268655c346 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:09:27.966651 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: 08450cf0-e778-4831-82f9-bd268655c346] VM Stopped (Lifecycle Event)
May 28 02:09:27.968138 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:09:28.136067 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Successfully updated port: fe49fa27-da6a-4d8f-ab1e-bb280d24658c {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 02:09:28.162930 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d3e7287d-f6a7-4f05-8030-6f1632b6fc26 req-c27c0583-fe11-41e7-9793-9d32b88b3bb1 service nova] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Received event network-vif-plugged-ec4997ed-eb88-422c-a1f5-0a9bcccaa71a {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:09:28.162930 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d3e7287d-f6a7-4f05-8030-6f1632b6fc26 req-c27c0583-fe11-41e7-9793-9d32b88b3bb1 service nova] Acquiring lock "e7554a11-146b-416b-8121-b7e6773b8dab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:09:28.162930 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d3e7287d-f6a7-4f05-8030-6f1632b6fc26 req-c27c0583-fe11-41e7-9793-9d32b88b3bb1 service nova] Lock "e7554a11-146b-416b-8121-b7e6773b8dab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:09:28.162930 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d3e7287d-f6a7-4f05-8030-6f1632b6fc26 req-c27c0583-fe11-41e7-9793-9d32b88b3bb1 service nova] Lock "e7554a11-146b-416b-8121-b7e6773b8dab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:09:28.162930 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d3e7287d-f6a7-4f05-8030-6f1632b6fc26 req-c27c0583-fe11-41e7-9793-9d32b88b3bb1 service nova] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] No waiting events found dispatching network-vif-plugged-ec4997ed-eb88-422c-a1f5-0a9bcccaa71a {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:09:28.162930 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-d3e7287d-f6a7-4f05-8030-6f1632b6fc26 req-c27c0583-fe11-41e7-9793-9d32b88b3bb1 service nova] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Received unexpected event network-vif-plugged-ec4997ed-eb88-422c-a1f5-0a9bcccaa71a for instance with vm_state active and task_state None.
May 28 02:09:28.189589 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:09:28.192389 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934168.1920083, e7554a11-146b-416b-8121-b7e6773b8dab => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:09:28.192510 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] VM Resumed (Lifecycle Event)
May 28 02:09:28.197625 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-60f28f37-7b79-4af7-9f0e-37f12b330f46 req-0dc43876-8d5a-491f-8073-450d58c633e0 service nova] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Received event network-changed-fe49fa27-da6a-4d8f-ab1e-bb280d24658c {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:09:28.197804 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-60f28f37-7b79-4af7-9f0e-37f12b330f46 req-0dc43876-8d5a-491f-8073-450d58c633e0 service nova] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Refreshing instance network info cache due to event network-changed-fe49fa27-da6a-4d8f-ab1e-bb280d24658c. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:09:28.198020 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-60f28f37-7b79-4af7-9f0e-37f12b330f46 req-0dc43876-8d5a-491f-8073-450d58c633e0 service nova] Acquiring lock "refresh_cache-5f8cf96c-2c00-493d-afe2-2ea77a834767" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:09:28.198117 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-60f28f37-7b79-4af7-9f0e-37f12b330f46 req-0dc43876-8d5a-491f-8073-450d58c633e0 service nova] Acquired lock "refresh_cache-5f8cf96c-2c00-493d-afe2-2ea77a834767" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:09:28.198208 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-60f28f37-7b79-4af7-9f0e-37f12b330f46 req-0dc43876-8d5a-491f-8073-450d58c633e0 service nova] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Refreshing network info cache for port fe49fa27-da6a-4d8f-ab1e-bb280d24658c {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:09:28.227021 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Took 15.64 seconds to build instance.
May 28 02:09:28.353612 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:28.470371 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-045f5de3-0e25-4035-8adb-9ac76bf3957e tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: 08450cf0-e778-4831-82f9-bd268655c346] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:09:28.585224 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:28.638606 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "refresh_cache-5f8cf96c-2c00-493d-afe2-2ea77a834767" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:09:28.695220 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:09:28.700350 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:09:28.703136 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-60f28f37-7b79-4af7-9f0e-37f12b330f46 req-0dc43876-8d5a-491f-8073-450d58c633e0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:09:28.728806 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5e5a675f-efe7-43a4-843c-706caca96f5d tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "e7554a11-146b-416b-8121-b7e6773b8dab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.150s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:09:28.752767 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 02:09:28.754468 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-1 (vda) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 02:09:28.755970 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88e7dd8f-33f3-46e8-8d17-b9451bb627e5/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:09:28.784710 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-60f28f37-7b79-4af7-9f0e-37f12b330f46 req-0dc43876-8d5a-491f-8073-450d58c633e0 service nova] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:09:28.864285 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88e7dd8f-33f3-46e8-8d17-b9451bb627e5/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:09:28.864733 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88e7dd8f-33f3-46e8-8d17-b9451bb627e5/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:09:28.929018 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 02:09:28.930293 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 02:09:28.930588 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Creating image(s)
May 28 02:09:28.931135 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "/opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:09:28.931346 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "/opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:09:28.931840 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "/opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:09:28.932587 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:09:28.935494 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:09:28.936622 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:09:28.960279 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88e7dd8f-33f3-46e8-8d17-b9451bb627e5/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:09:28.971469 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:09:28.974158 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:09:29.015766 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-60f28f37-7b79-4af7-9f0e-37f12b330f46 req-0dc43876-8d5a-491f-8073-450d58c633e0 service nova] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:09:29.037993 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.065s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:09:29.040853 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Hypervisor/Node resource view: name=np0000001583 free_ram=13059MB free_disk=72.72237014770508GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 02:09:29.040853 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:09:29.040853 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:09:29.047789 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.111s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:09:29.048443 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:09:29.049191 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:09:29.050323 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:09:29.054276 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:09:29.054615 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:09:29.160577 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.106s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:09:29.161909 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:09:29.216582 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767/disk 1073741824" returned: 0 in 0.055s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:09:29.217056 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.168s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:09:29.217444 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:09:29.329066 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.111s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:09:29.329593 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 02:09:29.329882 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:09:29.436799 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:09:29.437236 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Cannot resize image /opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 02:09:29.437634 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 02:09:29.437813 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Ensure instance console log exists: /opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 02:09:29.438088 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:09:29.438325 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:09:29.438458 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:09:29.519791 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-60f28f37-7b79-4af7-9f0e-37f12b330f46 req-0dc43876-8d5a-491f-8073-450d58c633e0 service nova] Releasing lock "refresh_cache-5f8cf96c-2c00-493d-afe2-2ea77a834767" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:09:29.520488 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquired lock "refresh_cache-5f8cf96c-2c00-493d-afe2-2ea77a834767" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:09:29.520619 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:09:30.105601 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:09:30.132105 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 88e7dd8f-33f3-46e8-8d17-b9451bb627e5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:09:30.132105 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:09:30.132105 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance e7554a11-146b-416b-8121-b7e6773b8dab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:09:30.132105 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 5f8cf96c-2c00-493d-afe2-2ea77a834767 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:09:30.132105 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 02:09:30.132105 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Final resource view: name=np0000001583 phys_ram=24030MB used_ram=1280MB phys_disk=95GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:09:29 up 45 min,  2 users,  load average: 4.27, 5.42, 4.88\n', 'num_instances': '4', 'num_vm_active': '3', 'num_task_None': '3', 'num_os_type_None': '4', 'num_proj_aa3c7ad1bf6248aa8e7f10a9d2a212ce': '1', 'io_workload': '1', 'num_proj_b7ada2896b1043bfb246c28ad9d1e174': '1', 'num_proj_60b5c56c77c64b318056094f7fa5861d': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_d192b18567fd4735988dd19da06fb868': '1'} {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 02:09:30.236416 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0e396fe6-4a2f-4bf9-98a4-f2db2d1bf001 req-293ad354-a37b-4542-98e2-718b5d42f620 service nova] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Received event network-changed-ec4997ed-eb88-422c-a1f5-0a9bcccaa71a {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:09:30.236643 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0e396fe6-4a2f-4bf9-98a4-f2db2d1bf001 req-293ad354-a37b-4542-98e2-718b5d42f620 service nova] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Refreshing instance network info cache due to event network-changed-ec4997ed-eb88-422c-a1f5-0a9bcccaa71a. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:09:30.236826 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0e396fe6-4a2f-4bf9-98a4-f2db2d1bf001 req-293ad354-a37b-4542-98e2-718b5d42f620 service nova] Acquiring lock "refresh_cache-e7554a11-146b-416b-8121-b7e6773b8dab" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:09:30.236935 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0e396fe6-4a2f-4bf9-98a4-f2db2d1bf001 req-293ad354-a37b-4542-98e2-718b5d42f620 service nova] Acquired lock "refresh_cache-e7554a11-146b-416b-8121-b7e6773b8dab" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:09:30.237061 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-0e396fe6-4a2f-4bf9-98a4-f2db2d1bf001 req-293ad354-a37b-4542-98e2-718b5d42f620 service nova] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Refreshing network info cache for port ec4997ed-eb88-422c-a1f5-0a9bcccaa71a {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:09:30.293245 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:09:30.425319 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:09:30.425977 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:09:30.457146 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Updating instance_info_cache with network_info: [{"id": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "address": "fa:16:3e:1d:39:9a", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe49fa27-da", "ovs_interfaceid": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:09:30.574396 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Acquiring lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:09:30.574722 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:09:30.739018 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-0e396fe6-4a2f-4bf9-98a4-f2db2d1bf001 req-293ad354-a37b-4542-98e2-718b5d42f620 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:09:30.928067 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:09:30.960220 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Releasing lock "refresh_cache-5f8cf96c-2c00-493d-afe2-2ea77a834767" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:09:30.960690 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Instance network_info: |[{"id": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "address": "fa:16:3e:1d:39:9a", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe49fa27-da", "ovs_interfaceid": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 02:09:30.962393 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Start _get_guest_xml network_info=[{"id": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "address": "fa:16:3e:1d:39:9a", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe49fa27-da", "ovs_interfaceid": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 02:09:30.965849 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:09:30.967492 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1932077210', uuid='5f8cf96c-2c00-493d-afe2-2ea77a834767'), owner=OwnerMeta(userid='0f09c9f1da7e4d32979e47c96d41ae99', username='tempest-TestEncryptedCinderVolumes-243696963-project-member', projectid='d192b18567fd4735988dd19da06fb868', projectname='tempest-TestEncryptedCinderVolumes-243696963'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "address": "fa:16:3e:1d:39:9a", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe49fa27-da", "ovs_interfaceid": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779934170.9671483) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 02:09:30.968625 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 02:09:30.968951 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 02:09:30.969941 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 02:09:30.970160 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 02:09:30.971575 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 02:09:30.971871 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 02:09:30.972029 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 02:09:30.972150 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 02:09:30.972268 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 02:09:30.972350 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 02:09:30.972438 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 02:09:30.972588 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 02:09:30.972684 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 02:09:30.972825 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 02:09:30.972954 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 02:09:30.973116 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 02:09:30.985096 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:09:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1932077210',display_name='tempest-TestEncryptedCinderVolumes-server-1932077210',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testencryptedcindervolumes-server-1932077210',id=73,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBun1fK3bqFH0DwFCe64dJxsemPDLJQjBBUXpAYHHMZ5VrGdrQWiAi1CAoY21xUJOnjgSHF/PvTCHsItl5nChH/jKvFpUNNLQ2Rj7QdmnLJ1lKVepbjJh5mCh3vTGal8fA==',key_name='tempest-keypair-1273682795',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d192b18567fd4735988dd19da06fb868',ramdisk_id='',reservation_id='r-w015fch7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-243696963',owner_user_name='tempest-TestEncryptedCinderVolumes-243696963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:09:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f09c9f1da7e4d32979e47c96d41ae99',uuid=5f8cf96c-2c00-493d-afe2-2ea77a834767,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "address": "fa:16:3e:1d:39:9a", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe49fa27-da", "ovs_interfaceid": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 02:09:30.985290 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Converting VIF {"id": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "address": "fa:16:3e:1d:39:9a", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe49fa27-da", "ovs_interfaceid": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:09:30.985893 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:39:9a,bridge_name='br-int',has_traffic_filtering=True,id=fe49fa27-da6a-4d8f-ab1e-bb280d24658c,network=Network(fccbc55c-a449-42c3-bf68-d3d337f7b0ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe49fa27-da') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:09:30.986479 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lazy-loading 'pci_devices' on Instance uuid 5f8cf96c-2c00-493d-afe2-2ea77a834767 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:09:31.078362 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lazy-loading 'flavor' on Instance uuid 88e7dd8f-33f3-46e8-8d17-b9451bb627e5 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:09:31.101791 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-0e396fe6-4a2f-4bf9-98a4-f2db2d1bf001 req-293ad354-a37b-4542-98e2-718b5d42f620 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:09:31.248650 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-0e396fe6-4a2f-4bf9-98a4-f2db2d1bf001 req-293ad354-a37b-4542-98e2-718b5d42f620 service nova] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Updated VIF entry in instance network info cache for port ec4997ed-eb88-422c-a1f5-0a9bcccaa71a. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:09:31.248873 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-0e396fe6-4a2f-4bf9-98a4-f2db2d1bf001 req-293ad354-a37b-4542-98e2-718b5d42f620 service nova] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Updating instance_info_cache with network_info: [{"id": "ec4997ed-eb88-422c-a1f5-0a9bcccaa71a", "address": "fa:16:3e:e4:70:4e", "network": {"id": "a349b3ac-cae9-4909-b273-8409a97fbe5c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-810622904-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60b5c56c77c64b318056094f7fa5861d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4997ed-eb", "ovs_interfaceid": "ec4997ed-eb88-422c-a1f5-0a9bcccaa71a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:09:31.434065 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Compute_service record updated for np0000001583:np0000001583 {{(pid=98241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 02:09:31.434226 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.395s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:09:31.434431 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:09:31.434558 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98241) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}}
May 28 02:09:31.492330 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] End _get_guest_xml xml=<domain type="qemu">
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:   <uuid>5f8cf96c-2c00-493d-afe2-2ea77a834767</uuid>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:   <name>instance-00000049</name>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:   <metadata>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1932077210</nova:name>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 02:09:30</nova:creationTime>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:       </nova:image>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:         <nova:user uuid="0f09c9f1da7e4d32979e47c96d41ae99">tempest-TestEncryptedCinderVolumes-243696963-project-member</nova:user>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:         <nova:project uuid="d192b18567fd4735988dd19da06fb868">tempest-TestEncryptedCinderVolumes-243696963</nova:project>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:         <nova:port uuid="fe49fa27-da6a-4d8f-ab1e-bb280d24658c">
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:         </nova:port>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:   </metadata>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:     <system>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:       <entry name="serial">5f8cf96c-2c00-493d-afe2-2ea77a834767</entry>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:       <entry name="uuid">5f8cf96c-2c00-493d-afe2-2ea77a834767</entry>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:     </system>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:   <os>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:   </os>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:   <features>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:     <acpi/>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:     <tcg>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:     </tcg>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:   </features>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:   </cpu>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:   <devices>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767/disk"/>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:     </disk>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767/disk.config"/>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:     </disk>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:1d:39:9a"/>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:       <target dev="tapfe49fa27-da"/>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:     </interface>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767/console.log" append="off"/>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:     </serial>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:     <video>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:     </video>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:     </rng>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:     </memballoon>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:   </devices>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]: </domain>
May 28 02:09:31.492330 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 02:09:31.494588 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Preparing to wait for external event network-vif-plugged-fe49fa27-da6a-4d8f-ab1e-bb280d24658c {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 02:09:31.494588 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "5f8cf96c-2c00-493d-afe2-2ea77a834767-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:09:31.494588 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "5f8cf96c-2c00-493d-afe2-2ea77a834767-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:09:31.494588 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "5f8cf96c-2c00-493d-afe2-2ea77a834767-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:09:31.494588 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:09:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1932077210',display_name='tempest-TestEncryptedCinderVolumes-server-1932077210',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testencryptedcindervolumes-server-1932077210',id=73,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBun1fK3bqFH0DwFCe64dJxsemPDLJQjBBUXpAYHHMZ5VrGdrQWiAi1CAoY21xUJOnjgSHF/PvTCHsItl5nChH/jKvFpUNNLQ2Rj7QdmnLJ1lKVepbjJh5mCh3vTGal8fA==',key_name='tempest-keypair-1273682795',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d192b18567fd4735988dd19da06fb868',ramdisk_id='',reservation_id='r-w015fch7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-243696963',owner_user_name='tempest-TestEncryptedCinderVolumes-243696963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:09:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f09c9f1da7e4d32979e47c96d41ae99',uuid=5f8cf96c-2c00-493d-afe2-2ea77a834767,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "address": "fa:16:3e:1d:39:9a", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe49fa27-da", "ovs_interfaceid": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 02:09:31.494588 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Converting VIF {"id": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "address": "fa:16:3e:1d:39:9a", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe49fa27-da", "ovs_interfaceid": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:09:31.494588 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:39:9a,bridge_name='br-int',has_traffic_filtering=True,id=fe49fa27-da6a-4d8f-ab1e-bb280d24658c,network=Network(fccbc55c-a449-42c3-bf68-d3d337f7b0ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe49fa27-da') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:09:31.494892 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:39:9a,bridge_name='br-int',has_traffic_filtering=True,id=fe49fa27-da6a-4d8f-ab1e-bb280d24658c,network=Network(fccbc55c-a449-42c3-bf68-d3d337f7b0ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe49fa27-da') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 02:09:31.495344 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:31.495728 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:09:31.496028 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 02:09:31.496849 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:31.497105 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c0fcca29-8d7d-56b4-8e39-2947409ce806', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:09:31.497957 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:31.499242 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:09:31.499427 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:31.501641 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:31.501832 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe49fa27-da, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:09:31.502162 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe49fa27-da, col_values=(('qos', UUID('c3d4808d-7dd4-43b7-98a8-1f863c6a4b85')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:09:31.502360 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe49fa27-da, col_values=(('external_ids', {'iface-id': 'fe49fa27-da6a-4d8f-ab1e-bb280d24658c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:39:9a', 'vm-uuid': '5f8cf96c-2c00-493d-afe2-2ea77a834767'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:09:31.503086 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:31.504687 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:09:31.509691 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:31.510498 np0000001583 nova-compute[98241]: INFO os_vif [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:39:9a,bridge_name='br-int',has_traffic_filtering=True,id=fe49fa27-da6a-4d8f-ab1e-bb280d24658c,network=Network(fccbc55c-a449-42c3-bf68-d3d337f7b0ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe49fa27-da')
May 28 02:09:31.750784 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0e396fe6-4a2f-4bf9-98a4-f2db2d1bf001 req-293ad354-a37b-4542-98e2-718b5d42f620 service nova] Releasing lock "refresh_cache-e7554a11-146b-416b-8121-b7e6773b8dab" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:09:31.936433 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:09:32.084512 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:09:32.935057 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:09:32.935456 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:09:32.935677 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:09:32.935790 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 02:09:32.936061 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.25 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:09:33.031741 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:09:33.031885 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:09:33.031981 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] No VIF found with MAC fa:16:3e:1d:39:9a, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:09:33.032443 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Using config drive
May 28 02:09:33.194369 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Acquiring lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:09:33.194600 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:09:33.194867 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Attaching volume a63e8964-41dc-4252-95e4-27580fd17e77 to /dev/vdb
May 28 02:09:33.236323 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:09:33.248642 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 02:09:33.272161 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:09:33.314879 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 02:09:33.315332 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 02:09:33.325056 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 02:09:33.326403 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe28:6dad', 'fe80::98c1:6bff:fe22:4140', 'fe80::fc16:3eff:fe4d:3808', 'fe80::5461:55ff:fe41:c1b7', 'fe80::fc16:3eff:fee4:704e', 'fe80::d4e0:76ff:fe99:10f4'] 
May 28 02:09:33.326564 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 02:09:33.326708 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 02:09:33.326998 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] <== get_connector_properties: return (90ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:09:33.327413 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Updating existing volume attachment record: d4f851a0-aa66-465f-8aa8-ee84c04dc12b {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 02:09:33.541439 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:09:33.587546 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:33.662740 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Creating config drive at /opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767/disk.config
May 28 02:09:33.667382 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpz8yagen_ {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:09:33.737123 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpz8yagen_" returned: 0 in 0.070s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:09:33.883253 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 02:09:33.883774 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77', 'iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a63e8964-41dc-4252-95e4-27580fd17e77', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:09:33.884011 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:09:33.884534 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:09:33.884827 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77', 'iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a63e8964-41dc-4252-95e4-27580fd17e77', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 02:09:33.900413 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:09:33.901198 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:09:33.901691 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:09:33.901872 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:09:33.902519 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:09:33.902824 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:09:33.915273 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:09:33.915273 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:09:33.920233 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:09:33.920233 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:09:33.927450 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77] added
May 28 02:09:33.927450 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:09:33.927450 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:09:33.927450 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:09:33.927450 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:09:33.927450 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:09:33.927450 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:09:33.927654 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:09:33.927860 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.025(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:09:33.928012 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:09:33.934143 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77] added
May 28 02:09:33.934143 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:09:33.934143 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:09:33.934143 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:09:33.934143 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:09:33.934143 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:09:33.934143 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:09:33.934290 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:09:33.934409 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0325(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:09:33.934531 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:09:34.208722 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:34.237191 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:34.328803 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:34.332101 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:09:34.470975 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d1aef5af-f820-490d-b994-5f94ed04ef7e req-691dac05-350b-4c81-9e62-a8bbbdeea90f service nova] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Received event network-vif-plugged-fe49fa27-da6a-4d8f-ab1e-bb280d24658c {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:09:34.470975 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d1aef5af-f820-490d-b994-5f94ed04ef7e req-691dac05-350b-4c81-9e62-a8bbbdeea90f service nova] Acquiring lock "5f8cf96c-2c00-493d-afe2-2ea77a834767-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:09:34.471168 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d1aef5af-f820-490d-b994-5f94ed04ef7e req-691dac05-350b-4c81-9e62-a8bbbdeea90f service nova] Lock "5f8cf96c-2c00-493d-afe2-2ea77a834767-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:09:34.471337 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d1aef5af-f820-490d-b994-5f94ed04ef7e req-691dac05-350b-4c81-9e62-a8bbbdeea90f service nova] Lock "5f8cf96c-2c00-493d-afe2-2ea77a834767-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:09:34.471923 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d1aef5af-f820-490d-b994-5f94ed04ef7e req-691dac05-350b-4c81-9e62-a8bbbdeea90f service nova] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Processing event network-vif-plugged-fe49fa27-da6a-4d8f-ab1e-bb280d24658c {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 02:09:34.632351 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:34.635833 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:34.639642 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:34.666495 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:34.928388 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:09:34.937381 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:09:34.941345 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:09:34.941345 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:09:34.952900 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:09:34.952900 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:09:34.960865 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:09:34.969617 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:09:34.979319 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:09:34.979319 np0000001583 nova-compute[98241]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:09:34.979319 np0000001583 nova-compute[98241]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:09:34.979319 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:09:34.979319 np0000001583 nova-compute[98241]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0dbf736-caff-4d77-934d-718486c8c27d (non-flash)
May 28 02:09:34.979319 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:09:34.979550 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsi session list stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:09:34.979550 np0000001583 nova-compute[98241]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:09:34.979550 np0000001583 nova-compute[98241]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:09:34.979550 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:09:34.979550 np0000001583 nova-compute[98241]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0dbf736-caff-4d77-934d-718486c8c27d (non-flash)
May 28 02:09:34.979550 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:09:34.993376 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:09:34.993376 np0000001583 nova-compute[98241]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:09:34.993376 np0000001583 nova-compute[98241]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:09:34.993376 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:09:34.993376 np0000001583 nova-compute[98241]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0dbf736-caff-4d77-934d-718486c8c27d (non-flash)
May 28 02:09:34.993376 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:09:34.993376 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsi session list stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:09:34.993376 np0000001583 nova-compute[98241]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:09:34.993376 np0000001583 nova-compute[98241]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:09:34.993376 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:09:34.993376 np0000001583 nova-compute[98241]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0dbf736-caff-4d77-934d-718486c8c27d (non-flash)
May 28 02:09:34.993376 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:09:35.021824 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77, portal: 192.168.40.100,3260]
May 28 02:09:35.021824 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77, portal: 192.168.40.100,3260] successful.
May 28 02:09:35.021824 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:09:35.039805 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:09:35.050436 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77, portal: 192.168.50.100,3260]
May 28 02:09:35.050436 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77, portal: 192.168.50.100,3260] successful.
May 28 02:09:35.050436 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:09:35.056954 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:09:35.056954 np0000001583 nova-compute[98241]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:09:35.056954 np0000001583 nova-compute[98241]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:09:35.056954 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:09:35.056954 np0000001583 nova-compute[98241]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0dbf736-caff-4d77-934d-718486c8c27d (non-flash)
May 28 02:09:35.056954 np0000001583 nova-compute[98241]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77 (non-flash)
May 28 02:09:35.056954 np0000001583 nova-compute[98241]: tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77 (non-flash)
May 28 02:09:35.056954 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:09:35.057241 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsi session list stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:09:35.057241 np0000001583 nova-compute[98241]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:09:35.057241 np0000001583 nova-compute[98241]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:09:35.057241 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:09:35.057241 np0000001583 nova-compute[98241]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0dbf736-caff-4d77-934d-718486c8c27d (non-flash)
May 28 02:09:35.057241 np0000001583 nova-compute[98241]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77 (non-flash)
May 28 02:09:35.057241 np0000001583 nova-compute[98241]: tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77 (non-flash)
May 28 02:09:35.057241 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:09:35.057511 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.155s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:09:35.057648 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:09:35.058836 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] HCTL ('8', '-', '-', 0) found on session 184 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:09:35.059096 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:09:35.065910 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:09:35.083823 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:09:35.083823 np0000001583 nova-compute[98241]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:09:35.083823 np0000001583 nova-compute[98241]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:09:35.083823 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:09:35.083823 np0000001583 nova-compute[98241]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0dbf736-caff-4d77-934d-718486c8c27d (non-flash)
May 28 02:09:35.083823 np0000001583 nova-compute[98241]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77 (non-flash)
May 28 02:09:35.083823 np0000001583 nova-compute[98241]: tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77 (non-flash)
May 28 02:09:35.083823 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:09:35.084811 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsi session list stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:09:35.084811 np0000001583 nova-compute[98241]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:09:35.084811 np0000001583 nova-compute[98241]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:09:35.084811 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:09:35.084811 np0000001583 nova-compute[98241]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0dbf736-caff-4d77-934d-718486c8c27d (non-flash)
May 28 02:09:35.084811 np0000001583 nova-compute[98241]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77 (non-flash)
May 28 02:09:35.084811 np0000001583 nova-compute[98241]: tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77 (non-flash)
May 28 02:09:35.084811 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:09:35.086532 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.183s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:09:35.086532 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:09:35.086532 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] HCTL ('13', '-', '-', 0) found on session 185 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:09:35.086532 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:09:35.092887 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Searching for a device in session 184 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:09:35.093054 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a63e8964-41dc-4252-95e4-27580fd17e77', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:09:35.107744 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Searching for a device in session 185 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:09:35.107934 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a63e8964-41dc-4252-95e4-27580fd17e77', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:09:35.189336 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 02:09:35.190366 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934175.1896877, 5f8cf96c-2c00-493d-afe2-2ea77a834767 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:09:35.193346 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:09:35.193827 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 8.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:09:35.194202 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] VM Started (Lifecycle Event)
May 28 02:09:35.196270 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 02:09:35.201298 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Instance spawned successfully.
May 28 02:09:35.201569 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 02:09:35.701189 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:09:35.710769 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:09:35.717293 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:09:35.717293 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:09:35.717540 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:09:35.717963 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:09:35.718779 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:09:35.719819 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:09:35.903116 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 02:09:36.218870 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 02:09:36.219256 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934176.2189972, 5f8cf96c-2c00-493d-afe2-2ea77a834767 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:09:36.219414 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] VM Paused (Lifecycle Event)
May 28 02:09:36.232496 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Took 7.30 seconds to spawn the instance on the hypervisor.
May 28 02:09:36.232780 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:09:36.516875 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:36.553725 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d68d2538-f2ab-4cbb-b540-14f0ffecb805 req-ff956e7b-cc96-4e0d-8c04-d858bb289e78 service nova] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Received event network-vif-plugged-fe49fa27-da6a-4d8f-ab1e-bb280d24658c {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:09:36.555360 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d68d2538-f2ab-4cbb-b540-14f0ffecb805 req-ff956e7b-cc96-4e0d-8c04-d858bb289e78 service nova] Acquiring lock "5f8cf96c-2c00-493d-afe2-2ea77a834767-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:09:36.555360 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d68d2538-f2ab-4cbb-b540-14f0ffecb805 req-ff956e7b-cc96-4e0d-8c04-d858bb289e78 service nova] Lock "5f8cf96c-2c00-493d-afe2-2ea77a834767-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:09:36.555360 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d68d2538-f2ab-4cbb-b540-14f0ffecb805 req-ff956e7b-cc96-4e0d-8c04-d858bb289e78 service nova] Lock "5f8cf96c-2c00-493d-afe2-2ea77a834767-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:09:36.555360 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d68d2538-f2ab-4cbb-b540-14f0ffecb805 req-ff956e7b-cc96-4e0d-8c04-d858bb289e78 service nova] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] No waiting events found dispatching network-vif-plugged-fe49fa27-da6a-4d8f-ab1e-bb280d24658c {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:09:36.555360 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-d68d2538-f2ab-4cbb-b540-14f0ffecb805 req-ff956e7b-cc96-4e0d-8c04-d858bb289e78 service nova] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Received unexpected event network-vif-plugged-fe49fa27-da6a-4d8f-ab1e-bb280d24658c for instance with vm_state active and task_state None.
May 28 02:09:36.722021 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:09:36.724484 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934176.724189, 5f8cf96c-2c00-493d-afe2-2ea77a834767 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:09:36.724586 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] VM Resumed (Lifecycle Event)
May 28 02:09:36.748181 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Took 12.61 seconds to build instance.
May 28 02:09:36.919730 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Found WWN 330000000e8672526 for multipath device dm-0 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 02:09:36.920195 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:09:36.920388 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] <== connect_volume: return (3036ms) {'type': 'block', 'scsi_wwn': '330000000e8672526', 'path': '/dev/dm-0', 'multipath_id': '330000000e8672526'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:09:36.920520 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e8672526', 'path': '/dev/dm-0', 'multipath_id': '330000000e8672526'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 02:09:36.929553 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lazy-loading 'flavor' on Instance uuid 88e7dd8f-33f3-46e8-8d17-b9451bb627e5 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:09:37.226939 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:09:37.230038 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:09:37.249823 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "5f8cf96c-2c00-493d-afe2-2ea77a834767" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.116s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:09:37.432819 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Attempting to attach volume a63e8964-41dc-4252-95e4-27580fd17e77 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98241) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 02:09:37.435285 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] attach device xml: <disk type="block" device="disk">
May 28 02:09:37.435285 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:09:37.435285 np0000001583 nova-compute[98241]:   <alias name="ua-a63e8964-41dc-4252-95e4-27580fd17e77"/>
May 28 02:09:37.435285 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-0"/>
May 28 02:09:37.435285 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:09:37.435285 np0000001583 nova-compute[98241]:   <serial>a63e8964-41dc-4252-95e4-27580fd17e77</serial>
May 28 02:09:37.435285 np0000001583 nova-compute[98241]: </disk>
May 28 02:09:37.435285 np0000001583 nova-compute[98241]:  {{(pid=98241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 02:09:37.878262 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d78b48e9-e721-4b34-b237-65bec3b855b0 req-491cdbc0-746b-4022-b97d-81ae906dcad2 service nova] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Received event network-changed-fe49fa27-da6a-4d8f-ab1e-bb280d24658c {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:09:37.878689 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d78b48e9-e721-4b34-b237-65bec3b855b0 req-491cdbc0-746b-4022-b97d-81ae906dcad2 service nova] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Refreshing instance network info cache due to event network-changed-fe49fa27-da6a-4d8f-ab1e-bb280d24658c. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:09:37.878689 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d78b48e9-e721-4b34-b237-65bec3b855b0 req-491cdbc0-746b-4022-b97d-81ae906dcad2 service nova] Acquiring lock "refresh_cache-5f8cf96c-2c00-493d-afe2-2ea77a834767" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:09:37.878689 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d78b48e9-e721-4b34-b237-65bec3b855b0 req-491cdbc0-746b-4022-b97d-81ae906dcad2 service nova] Acquired lock "refresh_cache-5f8cf96c-2c00-493d-afe2-2ea77a834767" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:09:37.878998 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-d78b48e9-e721-4b34-b237-65bec3b855b0 req-491cdbc0-746b-4022-b97d-81ae906dcad2 service nova] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Refreshing network info cache for port fe49fa27-da6a-4d8f-ab1e-bb280d24658c {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:09:38.380984 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-d78b48e9-e721-4b34-b237-65bec3b855b0 req-491cdbc0-746b-4022-b97d-81ae906dcad2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:09:38.590594 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:38.786529 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-d78b48e9-e721-4b34-b237-65bec3b855b0 req-491cdbc0-746b-4022-b97d-81ae906dcad2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:09:38.931832 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-d78b48e9-e721-4b34-b237-65bec3b855b0 req-491cdbc0-746b-4022-b97d-81ae906dcad2 service nova] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Updated VIF entry in instance network info cache for port fe49fa27-da6a-4d8f-ab1e-bb280d24658c. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:09:38.932513 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-d78b48e9-e721-4b34-b237-65bec3b855b0 req-491cdbc0-746b-4022-b97d-81ae906dcad2 service nova] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Updating instance_info_cache with network_info: [{"id": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "address": "fa:16:3e:1d:39:9a", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe49fa27-da", "ovs_interfaceid": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:09:39.130270 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:09:39.131249 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:09:39.131249 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:09:39.131249 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] No VIF found with MAC fa:16:3e:28:6d:ad, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:09:39.435797 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d78b48e9-e721-4b34-b237-65bec3b855b0 req-491cdbc0-746b-4022-b97d-81ae906dcad2 service nova] Releasing lock "refresh_cache-5f8cf96c-2c00-493d-afe2-2ea77a834767" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:09:40.691161 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-5b0a2e50-3813-4d0b-9024-dddd2f44807d tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.496s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:09:41.529631 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:43.193711 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:09:43.591379 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:43.697847 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 26.61 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:09:44.202518 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Acquiring lock "aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:09:44.203211 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:09:44.203211 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Acquiring lock "aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:09:44.203344 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:09:44.203821 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:09:44.207475 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Terminating instance
May 28 02:09:44.714980 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 02:09:44.748313 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:44.769344 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:44.792483 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:44.936842 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ed0163ab-996a-448e-b16b-663d7b9c0338 req-24bb48e3-9ee3-4dd0-b763-a638f1ec693e service nova] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Received event network-vif-unplugged-256dd1c6-bc20-43f3-8364-3f70ab70799d {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:09:44.937349 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ed0163ab-996a-448e-b16b-663d7b9c0338 req-24bb48e3-9ee3-4dd0-b763-a638f1ec693e service nova] Acquiring lock "aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:09:44.937702 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ed0163ab-996a-448e-b16b-663d7b9c0338 req-24bb48e3-9ee3-4dd0-b763-a638f1ec693e service nova] Lock "aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:09:44.937702 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ed0163ab-996a-448e-b16b-663d7b9c0338 req-24bb48e3-9ee3-4dd0-b763-a638f1ec693e service nova] Lock "aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:09:44.937969 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ed0163ab-996a-448e-b16b-663d7b9c0338 req-24bb48e3-9ee3-4dd0-b763-a638f1ec693e service nova] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] No waiting events found dispatching network-vif-unplugged-256dd1c6-bc20-43f3-8364-3f70ab70799d {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:09:44.938069 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ed0163ab-996a-448e-b16b-663d7b9c0338 req-24bb48e3-9ee3-4dd0-b763-a638f1ec693e service nova] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Received event network-vif-unplugged-256dd1c6-bc20-43f3-8364-3f70ab70799d for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:09:45.056886 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.99964589000001 future=<Future at 0x7724ec4e3bf0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:09:45.057196 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999284087999968 future=<Future at 0x7724ec4e3bf0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:09:45.057335 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.99913708999975 future=<Future at 0x7724ec4e3bf0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:09:45.057705 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Instance destroyed successfully.
May 28 02:09:45.058120 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lazy-loading 'resources' on Instance uuid aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:09:45.440545 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Acquiring lock "2e42be01-bc16-4fa6-9a95-698204b5e592" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:09:45.441052 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "2e42be01-bc16-4fa6-9a95-698204b5e592" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:09:45.561155 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T02:08:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-805175213',display_name='tempest-TestEncryptedCinderVolumes-server-805175213',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testencryptedcindervolumes-server-805175213',id=71,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBvIuscC5Hl9LuYYLq2wWivaHaebRNHPQIeYgqv7q1vZGG0QAw9Hdt3V++LObVUv3gsFUugch3GmPHbbfwH6piykof8GCWeT2LLzcMRX5UhzJRQuWby1FNbyksEPsTs9eg==',key_name='tempest-TestEncryptedCinderVolumes-1555008274',keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:09:04Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b7ada2896b1043bfb246c28ad9d1e174',ramdisk_id='',reservation_id='r-a0y0h5o9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',owner_project_name='tempest-TestEncryptedCinderVolumes-1693604386',owner_user_name='tempest-TestEncryptedCinderVolumes-1693604386-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T02:09:05Z,user_data=None,user_id='2b5bf0f126624ddab4bd36a1b707899e',uuid=aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "256dd1c6-bc20-43f3-8364-3f70ab70799d", "address": "fa:16:3e:4d:38:08", "network": {"id": "ef15cd88-386f-4fc6-8df0-74267f73d3fb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1804869041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b7ada2896b1043bfb246c28ad9d1e174", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap256dd1c6-bc", "ovs_interfaceid": "256dd1c6-bc20-43f3-8364-3f70ab70799d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:09:45.561395 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Converting VIF {"id": "256dd1c6-bc20-43f3-8364-3f70ab70799d", "address": "fa:16:3e:4d:38:08", "network": {"id": "ef15cd88-386f-4fc6-8df0-74267f73d3fb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1804869041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b7ada2896b1043bfb246c28ad9d1e174", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap256dd1c6-bc", "ovs_interfaceid": "256dd1c6-bc20-43f3-8364-3f70ab70799d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:09:45.561998 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:38:08,bridge_name='br-int',has_traffic_filtering=True,id=256dd1c6-bc20-43f3-8364-3f70ab70799d,network=Network(ef15cd88-386f-4fc6-8df0-74267f73d3fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap256dd1c6-bc') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:09:45.562287 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:38:08,bridge_name='br-int',has_traffic_filtering=True,id=256dd1c6-bc20-43f3-8364-3f70ab70799d,network=Network(ef15cd88-386f-4fc6-8df0-74267f73d3fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap256dd1c6-bc') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:09:45.567694 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:45.567694 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap256dd1c6-bc, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:09:45.569185 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:45.569185 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:09:45.570265 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:45.571095 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:45.571355 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aaa87acc-d82e-41af-af0a-f35c9cd3bcd3) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:09:45.572980 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:45.572980 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:09:45.573232 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:45.575452 np0000001583 nova-compute[98241]: INFO os_vif [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:38:08,bridge_name='br-int',has_traffic_filtering=True,id=256dd1c6-bc20-43f3-8364-3f70ab70799d,network=Network(ef15cd88-386f-4fc6-8df0-74267f73d3fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap256dd1c6-bc')
May 28 02:09:45.578629 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:09:45.578999 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c', 'iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5f799bc3-5b92-4dd1-9333-071bfdb25a3c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:09:45.579202 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:09:45.579574 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:09:45.579952 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c', 'iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5f799bc3-5b92-4dd1-9333-071bfdb25a3c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:09:45.580361 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:09:45.606383 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:09:45.606383 np0000001583 nova-compute[98241]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:09:45.606383 np0000001583 nova-compute[98241]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:09:45.606383 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:09:45.606383 np0000001583 nova-compute[98241]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0dbf736-caff-4d77-934d-718486c8c27d (non-flash)
May 28 02:09:45.606383 np0000001583 nova-compute[98241]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77 (non-flash)
May 28 02:09:45.606383 np0000001583 nova-compute[98241]: tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77 (non-flash)
May 28 02:09:45.606383 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:09:45.606719 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsi session list stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:09:45.606719 np0000001583 nova-compute[98241]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c (non-flash)
May 28 02:09:45.606719 np0000001583 nova-compute[98241]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:09:45.606719 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:09:45.606719 np0000001583 nova-compute[98241]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0dbf736-caff-4d77-934d-718486c8c27d (non-flash)
May 28 02:09:45.606719 np0000001583 nova-compute[98241]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77 (non-flash)
May 28 02:09:45.606719 np0000001583 nova-compute[98241]: tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77 (non-flash)
May 28 02:09:45.606719 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:09:45.606719 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c', '177'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c', '178'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb', '181'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb', '182'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0dbf736-caff-4d77-934d-718486c8c27d', '183'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77', '184'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77', '185')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:09:45.607066 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c', '177')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:09:45.608312 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c', '178')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:09:45.608999 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724ec1f4900>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c'): ({'sdf'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:09:45.609238 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Removing multipathed devices sdf, sde {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:09:45.609474 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Flush multipath device 33000000088846b3e {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:09:45.639518 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:09:45.696676 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:09:45.744313 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Checking to see if SCSI volumes sdf, sde have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:09:45.744468 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] SCSI volumes sdf, sde have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:09:45.745558 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Checking to see if device paths {'sdf', 'sde'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:09:45.757987 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Device paths {'sdf', 'sde'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:09:45.758216 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:09:45.770049 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:09:45.801200 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 177, target: iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c, portal: 192.168.40.100,3260]
May 28 02:09:45.801200 np0000001583 nova-compute[98241]: Logout of [sid: 177, target: iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c, portal: 192.168.40.100,3260] successful.
May 28 02:09:45.801200 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:09:45.817283 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:09:45.828566 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:09:45.865266 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 178, target: iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c, portal: 192.168.50.100,3260]
May 28 02:09:45.865266 np0000001583 nova-compute[98241]: Logout of [sid: 178, target: iqn.2023-03.storpool.com:os--volume-5f799bc3-5b92-4dd1-9333-071bfdb25a3c, portal: 192.168.50.100,3260] successful.
May 28 02:09:45.865266 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:09:45.883256 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:09:45.884293 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:09:45.884410 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] <== disconnect_volume: return (305ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:09:45.884556 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:09:45.884817 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Deleting instance files /opt/stack/data/nova/instances/aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf_del
May 28 02:09:45.885301 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Deletion of /opt/stack/data/nova/instances/aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf_del complete
May 28 02:09:45.942169 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 02:09:46.393040 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Took 1.68 seconds to destroy the instance on the hypervisor.
May 28 02:09:46.393374 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 02:09:46.393798 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 02:09:46.393980 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 02:09:46.394200 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:09:46.497775 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:09:46.500657 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:09:46.502211 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 02:09:46.502290 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Claim successful on node np0000001583
May 28 02:09:46.530430 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:09:47.002550 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-1246016c-6b16-4f1e-b644-9ac620ec3889 req-6b3e6a08-38c7-467a-8cad-9fa6bb7780ac service nova] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Received event network-vif-unplugged-256dd1c6-bc20-43f3-8364-3f70ab70799d {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:09:47.004577 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-1246016c-6b16-4f1e-b644-9ac620ec3889 req-6b3e6a08-38c7-467a-8cad-9fa6bb7780ac service nova] Acquiring lock "aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:09:47.004757 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-1246016c-6b16-4f1e-b644-9ac620ec3889 req-6b3e6a08-38c7-467a-8cad-9fa6bb7780ac service nova] Lock "aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:09:47.004909 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-1246016c-6b16-4f1e-b644-9ac620ec3889 req-6b3e6a08-38c7-467a-8cad-9fa6bb7780ac service nova] Lock "aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:09:47.005039 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-1246016c-6b16-4f1e-b644-9ac620ec3889 req-6b3e6a08-38c7-467a-8cad-9fa6bb7780ac service nova] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] No waiting events found dispatching network-vif-unplugged-256dd1c6-bc20-43f3-8364-3f70ab70799d {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:09:47.005174 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-1246016c-6b16-4f1e-b644-9ac620ec3889 req-6b3e6a08-38c7-467a-8cad-9fa6bb7780ac service nova] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Received event network-vif-unplugged-256dd1c6-bc20-43f3-8364-3f70ab70799d for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:09:47.005292 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-1246016c-6b16-4f1e-b644-9ac620ec3889 req-6b3e6a08-38c7-467a-8cad-9fa6bb7780ac service nova] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Received event network-vif-deleted-256dd1c6-bc20-43f3-8364-3f70ab70799d {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:09:47.005404 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-1246016c-6b16-4f1e-b644-9ac620ec3889 req-6b3e6a08-38c7-467a-8cad-9fa6bb7780ac service nova] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Neutron deleted interface 256dd1c6-bc20-43f3-8364-3f70ab70799d; detaching it from the instance and deleting it from the info cache
May 28 02:09:47.008597 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-1246016c-6b16-4f1e-b644-9ac620ec3889 req-6b3e6a08-38c7-467a-8cad-9fa6bb7780ac service nova] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Detach interface failed, port_id=256dd1c6-bc20-43f3-8364-3f70ab70799d, reason: Instance aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 02:09:47.441608 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:09:47.793071 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:09:47.793583 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:09:47.943475 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Took 1.55 seconds to deallocate network for instance.
May 28 02:09:48.298885 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:09:48.510663 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Took 0.57 seconds to detach 1 volumes for instance.
May 28 02:09:48.592631 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:48.805563 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.307s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:09:48.806130 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 02:09:49.018308 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:09:49.018531 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:09:49.311597 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 02:09:49.311766 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 02:09:49.311979 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:09:49.312250 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:09:49.349197 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:09:49.349444 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:09:49.422938 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd6c21669663a49f39202d3ca89337d19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20805bca06645eabf880bb71e4b69e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 02:09:49.815760 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 02:09:49.853879 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:09:49.913491 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Successfully created port: 97e5b1a2-6c38-42c4-a740-4eb055fb7bb6 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 02:09:50.320325 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 02:09:50.366153 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.347s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:09:50.437095 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Successfully updated port: 97e5b1a2-6c38-42c4-a740-4eb055fb7bb6 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 02:09:50.485994 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e3775c45-b6b3-4b49-b469-a32f1ddaa9b4 req-a9f2b16b-6eaf-45c7-99dc-474d8b4f563c service nova] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Received event network-changed-97e5b1a2-6c38-42c4-a740-4eb055fb7bb6 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:09:50.485994 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e3775c45-b6b3-4b49-b469-a32f1ddaa9b4 req-a9f2b16b-6eaf-45c7-99dc-474d8b4f563c service nova] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Refreshing instance network info cache due to event network-changed-97e5b1a2-6c38-42c4-a740-4eb055fb7bb6. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:09:50.485994 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e3775c45-b6b3-4b49-b469-a32f1ddaa9b4 req-a9f2b16b-6eaf-45c7-99dc-474d8b4f563c service nova] Acquiring lock "refresh_cache-2e42be01-bc16-4fa6-9a95-698204b5e592" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:09:50.485994 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e3775c45-b6b3-4b49-b469-a32f1ddaa9b4 req-a9f2b16b-6eaf-45c7-99dc-474d8b4f563c service nova] Acquired lock "refresh_cache-2e42be01-bc16-4fa6-9a95-698204b5e592" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:09:50.485994 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-e3775c45-b6b3-4b49-b469-a32f1ddaa9b4 req-a9f2b16b-6eaf-45c7-99dc-474d8b4f563c service nova] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Refreshing network info cache for port 97e5b1a2-6c38-42c4-a740-4eb055fb7bb6 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:09:50.572796 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:50.576852 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Deleted allocations for instance aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf
May 28 02:09:50.939536 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Acquiring lock "refresh_cache-2e42be01-bc16-4fa6-9a95-698204b5e592" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:09:50.988641 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-e3775c45-b6b3-4b49-b469-a32f1ddaa9b4 req-a9f2b16b-6eaf-45c7-99dc-474d8b4f563c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:09:51.052209 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-e3775c45-b6b3-4b49-b469-a32f1ddaa9b4 req-a9f2b16b-6eaf-45c7-99dc-474d8b4f563c service nova] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:09:51.173473 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f6400575-2879-4680-b985-70d85c8ba02a tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Acquiring lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:09:51.173669 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f6400575-2879-4680-b985-70d85c8ba02a tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:09:51.229683 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-e3775c45-b6b3-4b49-b469-a32f1ddaa9b4 req-a9f2b16b-6eaf-45c7-99dc-474d8b4f563c service nova] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:09:51.328062 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 02:09:51.329116 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 02:09:51.329368 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Creating image(s)
May 28 02:09:51.329810 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Acquiring lock "/opt/stack/data/nova/instances/2e42be01-bc16-4fa6-9a95-698204b5e592/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:09:51.330010 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "/opt/stack/data/nova/instances/2e42be01-bc16-4fa6-9a95-698204b5e592/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:09:51.330449 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "/opt/stack/data/nova/instances/2e42be01-bc16-4fa6-9a95-698204b5e592/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:09:51.331106 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:09:51.333961 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:09:51.335291 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:09:51.430823 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.095s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:09:51.431359 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:09:51.431859 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:09:51.432410 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:09:51.435149 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:09:51.435618 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:09:51.530647 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.095s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:09:51.531348 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/2e42be01-bc16-4fa6-9a95-698204b5e592/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:09:51.591691 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ac5aeede-0e44-4bd5-a133-ce5f4671247c tempest-TestEncryptedCinderVolumes-1693604386 tempest-TestEncryptedCinderVolumes-1693604386-project-member] Lock "aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.389s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:09:51.606069 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/2e42be01-bc16-4fa6-9a95-698204b5e592/disk 1073741824" returned: 0 in 0.075s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:09:51.606969 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.175s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:09:51.607600 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:09:51.677857 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-f6400575-2879-4680-b985-70d85c8ba02a tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Detaching volume a63e8964-41dc-4252-95e4-27580fd17e77
May 28 02:09:51.718192 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.109s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:09:51.718192 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2e42be01-bc16-4fa6-9a95-698204b5e592/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 02:09:51.718192 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e42be01-bc16-4fa6-9a95-698204b5e592/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:09:51.736837 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e3775c45-b6b3-4b49-b469-a32f1ddaa9b4 req-a9f2b16b-6eaf-45c7-99dc-474d8b4f563c service nova] Releasing lock "refresh_cache-2e42be01-bc16-4fa6-9a95-698204b5e592" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:09:51.738723 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Acquired lock "refresh_cache-2e42be01-bc16-4fa6-9a95-698204b5e592" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:09:51.739358 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:09:51.748150 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-f6400575-2879-4680-b985-70d85c8ba02a tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Attempting to driver detach volume a63e8964-41dc-4252-95e4-27580fd17e77 from mountpoint /dev/vdb
May 28 02:09:51.765959 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f6400575-2879-4680-b985-70d85c8ba02a tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Found disk vdb by alias ua-a63e8964-41dc-4252-95e4-27580fd17e77 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:09:51.767602 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f6400575-2879-4680-b985-70d85c8ba02a tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Found disk vdb by alias ua-a63e8964-41dc-4252-95e4-27580fd17e77 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:09:51.767741 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f6400575-2879-4680-b985-70d85c8ba02a tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Attempting to detach device vdb from instance 88e7dd8f-33f3-46e8-8d17-b9451bb627e5 from the persistent domain config. {{(pid=98241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 02:09:51.768129 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-f6400575-2879-4680-b985-70d85c8ba02a tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:09:51.768129 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:09:51.768129 np0000001583 nova-compute[98241]:   <alias name="ua-a63e8964-41dc-4252-95e4-27580fd17e77"/>
May 28 02:09:51.768129 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-0"/>
May 28 02:09:51.768129 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:09:51.768129 np0000001583 nova-compute[98241]:   <serial>a63e8964-41dc-4252-95e4-27580fd17e77</serial>
May 28 02:09:51.768129 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 02:09:51.768129 np0000001583 nova-compute[98241]: </disk>
May 28 02:09:51.768129 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:09:51.776310 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-f6400575-2879-4680-b985-70d85c8ba02a tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Successfully detached device vdb from instance 88e7dd8f-33f3-46e8-8d17-b9451bb627e5 from the persistent domain config.
May 28 02:09:51.776653 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f6400575-2879-4680-b985-70d85c8ba02a tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] (1/8): Attempting to detach device vdb with device alias ua-a63e8964-41dc-4252-95e4-27580fd17e77 from instance 88e7dd8f-33f3-46e8-8d17-b9451bb627e5 from the live domain config. {{(pid=98241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 02:09:51.776964 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-f6400575-2879-4680-b985-70d85c8ba02a tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:09:51.776964 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:09:51.776964 np0000001583 nova-compute[98241]:   <alias name="ua-a63e8964-41dc-4252-95e4-27580fd17e77"/>
May 28 02:09:51.776964 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-0"/>
May 28 02:09:51.776964 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:09:51.776964 np0000001583 nova-compute[98241]:   <serial>a63e8964-41dc-4252-95e4-27580fd17e77</serial>
May 28 02:09:51.776964 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 02:09:51.776964 np0000001583 nova-compute[98241]: </disk>
May 28 02:09:51.776964 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:09:51.826578 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e42be01-bc16-4fa6-9a95-698204b5e592/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:09:51.826944 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Cannot resize image /opt/stack/data/nova/instances/2e42be01-bc16-4fa6-9a95-698204b5e592/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 02:09:51.827308 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 02:09:51.827479 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Ensure instance console log exists: /opt/stack/data/nova/instances/2e42be01-bc16-4fa6-9a95-698204b5e592/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 02:09:51.827752 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:09:51.828019 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:09:51.828214 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:09:52.301875 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Received event <DeviceRemovedEvent: 1779934192.3013668, 88e7dd8f-33f3-46e8-8d17-b9451bb627e5 => ua-a63e8964-41dc-4252-95e4-27580fd17e77> from libvirt while the driver is waiting for it; dispatched. {{(pid=98241) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 02:09:52.303640 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f6400575-2879-4680-b985-70d85c8ba02a tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-a63e8964-41dc-4252-95e4-27580fd17e77 for instance 88e7dd8f-33f3-46e8-8d17-b9451bb627e5 {{(pid=98241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 02:09:52.307185 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-f6400575-2879-4680-b985-70d85c8ba02a tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Successfully detached device vdb from instance 88e7dd8f-33f3-46e8-8d17-b9451bb627e5 from the live domain config.
May 28 02:09:52.308035 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6400575-2879-4680-b985-70d85c8ba02a tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:09:52.308620 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6400575-2879-4680-b985-70d85c8ba02a tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77', 'iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a63e8964-41dc-4252-95e4-27580fd17e77', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:09:52.309023 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-f6400575-2879-4680-b985-70d85c8ba02a tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:09:52.310384 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-f6400575-2879-4680-b985-70d85c8ba02a tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:09:52.310384 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6400575-2879-4680-b985-70d85c8ba02a tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77', 'iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a63e8964-41dc-4252-95e4-27580fd17e77', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:09:52.310384 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6400575-2879-4680-b985-70d85c8ba02a tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:09:52.323971 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:09:52.340544 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6400575-2879-4680-b985-70d85c8ba02a tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:09:52.340544 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:09:52.340544 np0000001583 nova-compute[98241]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77 (non-flash)
May 28 02:09:52.340544 np0000001583 nova-compute[98241]: tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77 (non-flash)
May 28 02:09:52.340544 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:09:52.342156 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6400575-2879-4680-b985-70d85c8ba02a tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:09:52.342156 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:09:52.342156 np0000001583 nova-compute[98241]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77 (non-flash)
May 28 02:09:52.342156 np0000001583 nova-compute[98241]: tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77 (non-flash)
May 28 02:09:52.342156 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:09:52.342156 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6400575-2879-4680-b985-70d85c8ba02a tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb', '181'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb', '182'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77', '184'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77', '185')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:09:52.342156 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6400575-2879-4680-b985-70d85c8ba02a tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77', '184')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:09:52.342521 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6400575-2879-4680-b985-70d85c8ba02a tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77', '185')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:09:52.343095 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6400575-2879-4680-b985-70d85c8ba02a tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724ec1f5ee0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77'): ({'sdh'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:09:52.343334 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-f6400575-2879-4680-b985-70d85c8ba02a tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Removing multipathed devices sdc, sdh {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:09:52.343557 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-f6400575-2879-4680-b985-70d85c8ba02a tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Flush multipath device 330000000e8672526 {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:09:52.378685 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-f6400575-2879-4680-b985-70d85c8ba02a tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:09:52.427797 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-f6400575-2879-4680-b985-70d85c8ba02a tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:09:52.475956 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-f6400575-2879-4680-b985-70d85c8ba02a tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Checking to see if SCSI volumes sdc, sdh have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:09:52.476596 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-f6400575-2879-4680-b985-70d85c8ba02a tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] SCSI volumes sdc, sdh have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:09:52.477812 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-f6400575-2879-4680-b985-70d85c8ba02a tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Checking to see if device paths {'sdc', 'sdh'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:09:52.493725 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-f6400575-2879-4680-b985-70d85c8ba02a tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Device paths {'sdc', 'sdh'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:09:52.494052 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6400575-2879-4680-b985-70d85c8ba02a tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:09:52.509672 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6400575-2879-4680-b985-70d85c8ba02a tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:09:52.521705 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:09:52.551461 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6400575-2879-4680-b985-70d85c8ba02a tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 184, target: iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77, portal: 192.168.40.100,3260]
May 28 02:09:52.551461 np0000001583 nova-compute[98241]: Logout of [sid: 184, target: iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77, portal: 192.168.40.100,3260] successful.
May 28 02:09:52.551461 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:09:52.567302 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6400575-2879-4680-b985-70d85c8ba02a tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:09:52.580272 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6400575-2879-4680-b985-70d85c8ba02a tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:09:52.612609 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6400575-2879-4680-b985-70d85c8ba02a tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 185, target: iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77, portal: 192.168.50.100,3260]
May 28 02:09:52.612609 np0000001583 nova-compute[98241]: Logout of [sid: 185, target: iqn.2023-03.storpool.com:os--volume-a63e8964-41dc-4252-95e4-27580fd17e77, portal: 192.168.50.100,3260] successful.
May 28 02:09:52.612609 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:09:52.625773 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6400575-2879-4680-b985-70d85c8ba02a tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:09:52.626003 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-f6400575-2879-4680-b985-70d85c8ba02a tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:09:52.626226 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6400575-2879-4680-b985-70d85c8ba02a tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] <== disconnect_volume: return (317ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:09:52.626391 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6400575-2879-4680-b985-70d85c8ba02a tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:09:52.696852 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Updating instance_info_cache with network_info: [{"id": "97e5b1a2-6c38-42c4-a740-4eb055fb7bb6", "address": "fa:16:3e:32:79:c4", "network": {"id": "ff6dd0d5-1bec-49e1-b85f-c4257cd37d52", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-230174350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a20805bca06645eabf880bb71e4b69e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap97e5b1a2-6c", "ovs_interfaceid": "97e5b1a2-6c38-42c4-a740-4eb055fb7bb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:09:53.189339 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-f6400575-2879-4680-b985-70d85c8ba02a tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lazy-loading 'flavor' on Instance uuid 88e7dd8f-33f3-46e8-8d17-b9451bb627e5 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:09:53.199398 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Releasing lock "refresh_cache-2e42be01-bc16-4fa6-9a95-698204b5e592" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:09:53.199398 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Instance network_info: |[{"id": "97e5b1a2-6c38-42c4-a740-4eb055fb7bb6", "address": "fa:16:3e:32:79:c4", "network": {"id": "ff6dd0d5-1bec-49e1-b85f-c4257cd37d52", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-230174350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a20805bca06645eabf880bb71e4b69e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap97e5b1a2-6c", "ovs_interfaceid": "97e5b1a2-6c38-42c4-a740-4eb055fb7bb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 02:09:53.201923 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Start _get_guest_xml network_info=[{"id": "97e5b1a2-6c38-42c4-a740-4eb055fb7bb6", "address": "fa:16:3e:32:79:c4", "network": {"id": "ff6dd0d5-1bec-49e1-b85f-c4257cd37d52", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-230174350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a20805bca06645eabf880bb71e4b69e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap97e5b1a2-6c", "ovs_interfaceid": "97e5b1a2-6c38-42c4-a740-4eb055fb7bb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 02:09:53.205607 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:09:53.207506 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-VolumesSnapshotTestJSON-instance-1158891721', uuid='2e42be01-bc16-4fa6-9a95-698204b5e592'), owner=OwnerMeta(userid='d6c21669663a49f39202d3ca89337d19', username='tempest-VolumesSnapshotTestJSON-1803039293-project-member', projectid='a20805bca06645eabf880bb71e4b69e3', projectname='tempest-VolumesSnapshotTestJSON-1803039293'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "97e5b1a2-6c38-42c4-a740-4eb055fb7bb6", "address": "fa:16:3e:32:79:c4", "network": {"id": "ff6dd0d5-1bec-49e1-b85f-c4257cd37d52", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-230174350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a20805bca06645eabf880bb71e4b69e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap97e5b1a2-6c", "ovs_interfaceid": "97e5b1a2-6c38-42c4-a740-4eb055fb7bb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779934193.2069528) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 02:09:53.210102 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 02:09:53.210521 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 02:09:53.211905 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 02:09:53.212484 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 02:09:53.213951 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 02:09:53.214554 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 02:09:53.214826 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 02:09:53.215095 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 02:09:53.215370 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 02:09:53.215564 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 02:09:53.215777 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 02:09:53.216043 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 02:09:53.216300 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 02:09:53.216519 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 02:09:53.216889 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 02:09:53.217073 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 02:09:53.235208 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:09:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1158891721',display_name='tempest-VolumesSnapshotTestJSON-instance-1158891721',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-volumessnapshottestjson-instance-1158891721',id=74,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNxx9PUHaA4lcd4FwZEhZdIBGK8kWO8s3FO84I3EGjNS25jXq0dzSw2nBnLrJsGG88mX3NBcBgO8x0fBt53LyGA/3QhGyVhUAzOa1meCE/+ubzppt9X+gdBUxeLhr2Fe6g==',key_name='tempest-keypair-262036541',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a20805bca06645eabf880bb71e4b69e3',ramdisk_id='',reservation_id='r-w4qrokgg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1803039293',owner_user_name='tempest-VolumesSnapshotTestJSON-1803039293-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:09:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6c21669663a49f39202d3ca89337d19',uuid=2e42be01-bc16-4fa6-9a95-698204b5e592,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97e5b1a2-6c38-42c4-a740-4eb055fb7bb6", "address": "fa:16:3e:32:79:c4", "network": {"id": "ff6dd0d5-1bec-49e1-b85f-c4257cd37d52", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-230174350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a20805bca06645eabf880bb71e4b69e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap97e5b1a2-6c", "ovs_interfaceid": "97e5b1a2-6c38-42c4-a740-4eb055fb7bb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 02:09:53.235613 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Converting VIF {"id": "97e5b1a2-6c38-42c4-a740-4eb055fb7bb6", "address": "fa:16:3e:32:79:c4", "network": {"id": "ff6dd0d5-1bec-49e1-b85f-c4257cd37d52", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-230174350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a20805bca06645eabf880bb71e4b69e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap97e5b1a2-6c", "ovs_interfaceid": "97e5b1a2-6c38-42c4-a740-4eb055fb7bb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:09:53.236504 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:79:c4,bridge_name='br-int',has_traffic_filtering=True,id=97e5b1a2-6c38-42c4-a740-4eb055fb7bb6,network=Network(ff6dd0d5-1bec-49e1-b85f-c4257cd37d52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97e5b1a2-6c') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:09:53.237393 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lazy-loading 'pci_devices' on Instance uuid 2e42be01-bc16-4fa6-9a95-698204b5e592 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:09:53.596037 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:53.740317 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] End _get_guest_xml xml=<domain type="qemu">
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:   <uuid>2e42be01-bc16-4fa6-9a95-698204b5e592</uuid>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:   <name>instance-0000004a</name>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:   <metadata>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1158891721</nova:name>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 02:09:53</nova:creationTime>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:       </nova:image>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:         <nova:user uuid="d6c21669663a49f39202d3ca89337d19">tempest-VolumesSnapshotTestJSON-1803039293-project-member</nova:user>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:         <nova:project uuid="a20805bca06645eabf880bb71e4b69e3">tempest-VolumesSnapshotTestJSON-1803039293</nova:project>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:         <nova:port uuid="97e5b1a2-6c38-42c4-a740-4eb055fb7bb6">
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:         </nova:port>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:   </metadata>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:     <system>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:       <entry name="serial">2e42be01-bc16-4fa6-9a95-698204b5e592</entry>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:       <entry name="uuid">2e42be01-bc16-4fa6-9a95-698204b5e592</entry>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:     </system>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:   <os>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:   </os>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:   <features>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:     <acpi/>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:     <tcg>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:     </tcg>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:   </features>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:   </cpu>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:   <devices>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/2e42be01-bc16-4fa6-9a95-698204b5e592/disk"/>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:     </disk>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/2e42be01-bc16-4fa6-9a95-698204b5e592/disk.config"/>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:     </disk>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:32:79:c4"/>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:       <target dev="tap97e5b1a2-6c"/>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:     </interface>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/2e42be01-bc16-4fa6-9a95-698204b5e592/console.log" append="off"/>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:     </serial>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:     <video>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:     </video>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:     </rng>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:     </memballoon>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:   </devices>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]: </domain>
May 28 02:09:53.740317 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 02:09:53.743365 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Preparing to wait for external event network-vif-plugged-97e5b1a2-6c38-42c4-a740-4eb055fb7bb6 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 02:09:53.743365 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Acquiring lock "2e42be01-bc16-4fa6-9a95-698204b5e592-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:09:53.743365 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "2e42be01-bc16-4fa6-9a95-698204b5e592-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:09:53.743365 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "2e42be01-bc16-4fa6-9a95-698204b5e592-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:09:53.743365 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:09:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1158891721',display_name='tempest-VolumesSnapshotTestJSON-instance-1158891721',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-volumessnapshottestjson-instance-1158891721',id=74,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNxx9PUHaA4lcd4FwZEhZdIBGK8kWO8s3FO84I3EGjNS25jXq0dzSw2nBnLrJsGG88mX3NBcBgO8x0fBt53LyGA/3QhGyVhUAzOa1meCE/+ubzppt9X+gdBUxeLhr2Fe6g==',key_name='tempest-keypair-262036541',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a20805bca06645eabf880bb71e4b69e3',ramdisk_id='',reservation_id='r-w4qrokgg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1803039293',owner_user_name='tempest-VolumesSnapshotTestJSON-1803039293-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:09:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6c21669663a49f39202d3ca89337d19',uuid=2e42be01-bc16-4fa6-9a95-698204b5e592,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97e5b1a2-6c38-42c4-a740-4eb055fb7bb6", "address": "fa:16:3e:32:79:c4", "network": {"id": "ff6dd0d5-1bec-49e1-b85f-c4257cd37d52", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-230174350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a20805bca06645eabf880bb71e4b69e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap97e5b1a2-6c", "ovs_interfaceid": "97e5b1a2-6c38-42c4-a740-4eb055fb7bb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 02:09:53.743365 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Converting VIF {"id": "97e5b1a2-6c38-42c4-a740-4eb055fb7bb6", "address": "fa:16:3e:32:79:c4", "network": {"id": "ff6dd0d5-1bec-49e1-b85f-c4257cd37d52", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-230174350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a20805bca06645eabf880bb71e4b69e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap97e5b1a2-6c", "ovs_interfaceid": "97e5b1a2-6c38-42c4-a740-4eb055fb7bb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:09:53.743365 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:79:c4,bridge_name='br-int',has_traffic_filtering=True,id=97e5b1a2-6c38-42c4-a740-4eb055fb7bb6,network=Network(ff6dd0d5-1bec-49e1-b85f-c4257cd37d52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97e5b1a2-6c') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:09:53.743365 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:79:c4,bridge_name='br-int',has_traffic_filtering=True,id=97e5b1a2-6c38-42c4-a740-4eb055fb7bb6,network=Network(ff6dd0d5-1bec-49e1-b85f-c4257cd37d52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97e5b1a2-6c') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 02:09:53.743365 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:53.743365 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:09:53.744267 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 02:09:53.744945 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:53.745194 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '302a5736-f67a-51b8-96a7-9dbc02ec9d54', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:09:53.746265 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:53.748620 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:53.749199 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:09:53.751349 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:53.751551 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap97e5b1a2-6c, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:09:53.751851 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap97e5b1a2-6c, col_values=(('qos', UUID('76e445f4-ed6d-47c6-9696-15c42e8efef5')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:09:53.752027 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap97e5b1a2-6c, col_values=(('external_ids', {'iface-id': '97e5b1a2-6c38-42c4-a740-4eb055fb7bb6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:79:c4', 'vm-uuid': '2e42be01-bc16-4fa6-9a95-698204b5e592'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:09:53.755097 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:09:53.759852 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:53.760989 np0000001583 nova-compute[98241]: INFO os_vif [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:79:c4,bridge_name='br-int',has_traffic_filtering=True,id=97e5b1a2-6c38-42c4-a740-4eb055fb7bb6,network=Network(ff6dd0d5-1bec-49e1-b85f-c4257cd37d52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97e5b1a2-6c')
May 28 02:09:54.199178 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f6400575-2879-4680-b985-70d85c8ba02a tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.025s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:09:55.283322 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:09:55.283732 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:09:55.283732 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] No VIF found with MAC fa:16:3e:32:79:c4, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:09:55.284130 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Using config drive
May 28 02:09:56.542632 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:09:56.542632 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Acquiring lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:09:56.542632 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:09:56.542632 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Creating config drive at /opt/stack/data/nova/instances/2e42be01-bc16-4fa6-9a95-698204b5e592/disk.config
May 28 02:09:56.542632 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2e42be01-bc16-4fa6-9a95-698204b5e592/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7zps3b4i {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:09:56.542632 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2e42be01-bc16-4fa6-9a95-698204b5e592/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7zps3b4i" returned: 0 in 0.079s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:09:56.542632 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lazy-loading 'flavor' on Instance uuid 88e7dd8f-33f3-46e8-8d17-b9451bb627e5 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:09:56.542632 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:56.542632 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:56.542632 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:56.644493 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:56.735770 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b7a45a83-d531-48bf-b6f6-800926ea4df5 req-6aa04c5c-6ee2-41e8-b32b-a05545506a53 service nova] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Received event network-vif-plugged-97e5b1a2-6c38-42c4-a740-4eb055fb7bb6 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:09:56.736402 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b7a45a83-d531-48bf-b6f6-800926ea4df5 req-6aa04c5c-6ee2-41e8-b32b-a05545506a53 service nova] Acquiring lock "2e42be01-bc16-4fa6-9a95-698204b5e592-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:09:56.736644 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b7a45a83-d531-48bf-b6f6-800926ea4df5 req-6aa04c5c-6ee2-41e8-b32b-a05545506a53 service nova] Lock "2e42be01-bc16-4fa6-9a95-698204b5e592-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:09:56.736789 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b7a45a83-d531-48bf-b6f6-800926ea4df5 req-6aa04c5c-6ee2-41e8-b32b-a05545506a53 service nova] Lock "2e42be01-bc16-4fa6-9a95-698204b5e592-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:09:56.736916 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b7a45a83-d531-48bf-b6f6-800926ea4df5 req-6aa04c5c-6ee2-41e8-b32b-a05545506a53 service nova] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Processing event network-vif-plugged-97e5b1a2-6c38-42c4-a740-4eb055fb7bb6 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 02:09:56.913861 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:56.954439 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:56.958342 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:56.960890 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:56.978611 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:57.330178 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.514s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:09:57.386842 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934197.386493, 2e42be01-bc16-4fa6-9a95-698204b5e592 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:09:57.386988 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] VM Started (Lifecycle Event)
May 28 02:09:57.388163 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 02:09:57.393012 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 02:09:57.399396 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Instance spawned successfully.
May 28 02:09:57.399821 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 02:09:57.716493 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:57.890539 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:09:57.893033 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:09:57.915817 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:09:57.915817 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:09:57.915817 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:09:57.916007 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:09:57.916350 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:09:57.916649 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:09:58.395983 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 02:09:58.396354 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934198.3961084, 2e42be01-bc16-4fa6-9a95-698204b5e592 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:09:58.396535 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] VM Paused (Lifecycle Event)
May 28 02:09:58.410421 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Acquiring lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:09:58.410560 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:09:58.410732 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Attaching volume 4f8bb99a-ba62-404c-b8c0-b24e8fa7a555 to /dev/vdb
May 28 02:09:58.422436 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Took 7.09 seconds to spawn the instance on the hypervisor.
May 28 02:09:58.422800 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:09:58.466971 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:09:58.483785 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 02:09:58.517019 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:09:58.580706 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 02:09:58.581067 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 02:09:58.593460 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 02:09:58.596967 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe28:6dad', 'fe80::98c1:6bff:fe22:4140', 'fe80::fc16:3eff:fee4:704e', 'fe80::d4e0:76ff:fe99:10f4', 'fe80::fc16:3eff:fe1d:399a', 'fe80::d05a:66ff:fe6d:1718', 'fe80::fc16:3eff:fe32:79c4', 'fe80::2c76:91ff:fee7:3598'] 
May 28 02:09:58.598249 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 02:09:58.598249 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 02:09:58.598249 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:09:58.598249 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Updating existing volume attachment record: d4a06fc9-2c04-42b0-a47e-068f3a1c9c29 {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 02:09:58.600614 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:58.753703 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:58.813773 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-1ca6399d-a8c5-4053-af28-ff0a30867457 req-3b6af730-3f86-4953-9cc6-27112c029633 service nova] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Received event network-vif-plugged-97e5b1a2-6c38-42c4-a740-4eb055fb7bb6 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:09:58.814042 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-1ca6399d-a8c5-4053-af28-ff0a30867457 req-3b6af730-3f86-4953-9cc6-27112c029633 service nova] Acquiring lock "2e42be01-bc16-4fa6-9a95-698204b5e592-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:09:58.814226 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-1ca6399d-a8c5-4053-af28-ff0a30867457 req-3b6af730-3f86-4953-9cc6-27112c029633 service nova] Lock "2e42be01-bc16-4fa6-9a95-698204b5e592-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:09:58.814796 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-1ca6399d-a8c5-4053-af28-ff0a30867457 req-3b6af730-3f86-4953-9cc6-27112c029633 service nova] Lock "2e42be01-bc16-4fa6-9a95-698204b5e592-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:09:58.814931 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-1ca6399d-a8c5-4053-af28-ff0a30867457 req-3b6af730-3f86-4953-9cc6-27112c029633 service nova] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] No waiting events found dispatching network-vif-plugged-97e5b1a2-6c38-42c4-a740-4eb055fb7bb6 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:09:58.815053 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-1ca6399d-a8c5-4053-af28-ff0a30867457 req-3b6af730-3f86-4953-9cc6-27112c029633 service nova] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Received unexpected event network-vif-plugged-97e5b1a2-6c38-42c4-a740-4eb055fb7bb6 for instance with vm_state active and task_state None.
May 28 02:09:58.899929 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:09:58.904729 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934198.9044073, 2e42be01-bc16-4fa6-9a95-698204b5e592 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:09:58.904926 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] VM Resumed (Lifecycle Event)
May 28 02:09:58.936116 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Took 12.49 seconds to build instance.
May 28 02:09:59.063067 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:09:59.167906 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 02:09:59.168546 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555', 'iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4f8bb99a-ba62-404c-b8c0-b24e8fa7a555', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:09:59.168739 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:09:59.169234 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:09:59.172360 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555', 'iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4f8bb99a-ba62-404c-b8c0-b24e8fa7a555', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 02:09:59.191103 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:09:59.191103 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:09:59.191103 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:09:59.191103 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:09:59.191103 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:09:59.191103 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:09:59.206205 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:09:59.206205 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:09:59.212566 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:09:59.212566 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:09:59.222925 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555] added
May 28 02:09:59.222925 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:09:59.222925 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:09:59.222925 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:09:59.222925 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:09:59.222925 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:09:59.222925 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:09:59.223553 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:09:59.223852 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0341(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:09:59.224107 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:09:59.228229 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555] added
May 28 02:09:59.228229 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:09:59.228229 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:09:59.228229 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:09:59.228229 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:09:59.228229 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:09:59.228229 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:09:59.228616 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:09:59.228855 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0377(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:09:59.228996 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:09:59.407910 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:09:59.411827 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:09:59.440364 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "2e42be01-bc16-4fa6-9a95-698204b5e592" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.999s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:10:00.057067 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0004419710003276123 future=<Future at 0x7724ec4e3bf0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:10:00.057573 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:10:00.057870 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Emitting event <LifecycleEvent: 1779934185.0564, aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:10:00.058032 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] VM Stopped (Lifecycle Event)
May 28 02:10:00.115906 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7c2d6449-6306-49a3-b929-b83ab43210c4 req-2abb221c-c016-4d9d-8e00-5e80b180d4cf service nova] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Received event network-changed-97e5b1a2-6c38-42c4-a740-4eb055fb7bb6 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:10:00.117698 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7c2d6449-6306-49a3-b929-b83ab43210c4 req-2abb221c-c016-4d9d-8e00-5e80b180d4cf service nova] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Refreshing instance network info cache due to event network-changed-97e5b1a2-6c38-42c4-a740-4eb055fb7bb6. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:10:00.117911 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7c2d6449-6306-49a3-b929-b83ab43210c4 req-2abb221c-c016-4d9d-8e00-5e80b180d4cf service nova] Acquiring lock "refresh_cache-2e42be01-bc16-4fa6-9a95-698204b5e592" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:10:00.118032 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7c2d6449-6306-49a3-b929-b83ab43210c4 req-2abb221c-c016-4d9d-8e00-5e80b180d4cf service nova] Acquired lock "refresh_cache-2e42be01-bc16-4fa6-9a95-698204b5e592" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:10:00.118378 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-7c2d6449-6306-49a3-b929-b83ab43210c4 req-2abb221c-c016-4d9d-8e00-5e80b180d4cf service nova] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Refreshing network info cache for port 97e5b1a2-6c38-42c4-a740-4eb055fb7bb6 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:10:00.224667 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:10:00.231216 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:10:00.241422 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:10:00.241422 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:10:00.253213 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:10:00.253213 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:00.259528 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:00.266848 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:00.277534 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:00.277534 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:00.277534 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:10:00.277845 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:00.277845 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:00.277845 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:10:00.284704 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:00.284704 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:00.284704 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:10:00.284971 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:00.284971 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:00.284971 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:10:00.313060 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555, portal: 192.168.40.100,3260]
May 28 02:10:00.313060 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555, portal: 192.168.40.100,3260] successful.
May 28 02:10:00.313060 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:00.326908 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:00.335544 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555, portal: 192.168.50.100,3260]
May 28 02:10:00.335544 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555, portal: 192.168.50.100,3260] successful.
May 28 02:10:00.335544 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:00.344740 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:00.344740 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:00.344740 np0000001583 nova-compute[98241]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555 (non-flash)
May 28 02:10:00.344740 np0000001583 nova-compute[98241]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555 (non-flash)
May 28 02:10:00.344740 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:10:00.344740 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:00.344740 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:00.344740 np0000001583 nova-compute[98241]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555 (non-flash)
May 28 02:10:00.344740 np0000001583 nova-compute[98241]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555 (non-flash)
May 28 02:10:00.344740 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:10:00.344740 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.155s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:10:00.344740 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:10:00.344740 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] HCTL ('7', '-', '-', 0) found on session 186 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:10:00.344740 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:10:00.353472 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:00.366186 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Searching for a device in session 186 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:10:00.366671 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4f8bb99a-ba62-404c-b8c0-b24e8fa7a555', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:10:00.372663 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:00.372663 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:00.372663 np0000001583 nova-compute[98241]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555 (non-flash)
May 28 02:10:00.372663 np0000001583 nova-compute[98241]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555 (non-flash)
May 28 02:10:00.372663 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:10:00.372931 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:00.372931 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:00.372931 np0000001583 nova-compute[98241]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555 (non-flash)
May 28 02:10:00.372931 np0000001583 nova-compute[98241]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555 (non-flash)
May 28 02:10:00.372931 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:10:00.373252 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.182s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:10:00.373358 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:10:00.373870 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] HCTL ('8', '-', '-', 0) found on session 187 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:10:00.373949 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:10:00.391995 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Searching for a device in session 187 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:10:00.392174 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '4f8bb99a-ba62-404c-b8c0-b24e8fa7a555', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:10:00.561843 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: aa1ddbe8-ff98-46c8-ada9-a2990dda9bcf] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:10:00.621139 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-7c2d6449-6306-49a3-b929-b83ab43210c4 req-2abb221c-c016-4d9d-8e00-5e80b180d4cf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:10:00.902598 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-7c2d6449-6306-49a3-b929-b83ab43210c4 req-2abb221c-c016-4d9d-8e00-5e80b180d4cf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:10:01.020670 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-7c2d6449-6306-49a3-b929-b83ab43210c4 req-2abb221c-c016-4d9d-8e00-5e80b180d4cf service nova] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Updated VIF entry in instance network info cache for port 97e5b1a2-6c38-42c4-a740-4eb055fb7bb6. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:10:01.021037 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-7c2d6449-6306-49a3-b929-b83ab43210c4 req-2abb221c-c016-4d9d-8e00-5e80b180d4cf service nova] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Updating instance_info_cache with network_info: [{"id": "97e5b1a2-6c38-42c4-a740-4eb055fb7bb6", "address": "fa:16:3e:32:79:c4", "network": {"id": "ff6dd0d5-1bec-49e1-b85f-c4257cd37d52", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-230174350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a20805bca06645eabf880bb71e4b69e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap97e5b1a2-6c", "ovs_interfaceid": "97e5b1a2-6c38-42c4-a740-4eb055fb7bb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:10:01.190714 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 02:10:01.522966 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7c2d6449-6306-49a3-b929-b83ab43210c4 req-2abb221c-c016-4d9d-8e00-5e80b180d4cf service nova] Releasing lock "refresh_cache-2e42be01-bc16-4fa6-9a95-698204b5e592" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:10:02.206349 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Found WWN 3300000007987dcf9 for multipath device dm-0 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 02:10:02.207969 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:10:02.207969 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] <== connect_volume: return (3038ms) {'type': 'block', 'scsi_wwn': '3300000007987dcf9', 'path': '/dev/dm-0', 'multipath_id': '3300000007987dcf9'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:10:02.207969 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007987dcf9', 'path': '/dev/dm-0', 'multipath_id': '3300000007987dcf9'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 02:10:02.210960 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lazy-loading 'flavor' on Instance uuid 88e7dd8f-33f3-46e8-8d17-b9451bb627e5 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:10:02.713608 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Attempting to attach volume 4f8bb99a-ba62-404c-b8c0-b24e8fa7a555 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98241) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 02:10:02.715165 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] attach device xml: <disk type="block" device="disk">
May 28 02:10:02.715165 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:10:02.715165 np0000001583 nova-compute[98241]:   <alias name="ua-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555"/>
May 28 02:10:02.715165 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-0"/>
May 28 02:10:02.715165 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:10:02.715165 np0000001583 nova-compute[98241]:   <serial>4f8bb99a-ba62-404c-b8c0-b24e8fa7a555</serial>
May 28 02:10:02.715165 np0000001583 nova-compute[98241]: </disk>
May 28 02:10:02.715165 np0000001583 nova-compute[98241]:  {{(pid=98241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 02:10:03.598982 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:03.754527 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:04.356713 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:10:04.356713 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:10:04.356713 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:10:04.356713 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] No VIF found with MAC fa:16:3e:28:6d:ad, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:10:05.910974 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6753ce0d-ccbf-477f-a854-4992aa197150 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.500s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:10:08.602063 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:08.755600 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:09.632994 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3c8e5444-71f5-4c8f-8c75-7b5d94eff8ba tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Acquiring lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:10:09.633518 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3c8e5444-71f5-4c8f-8c75-7b5d94eff8ba tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:10:10.142270 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-3c8e5444-71f5-4c8f-8c75-7b5d94eff8ba tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Detaching volume 4f8bb99a-ba62-404c-b8c0-b24e8fa7a555
May 28 02:10:10.187846 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-3c8e5444-71f5-4c8f-8c75-7b5d94eff8ba tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Attempting to driver detach volume 4f8bb99a-ba62-404c-b8c0-b24e8fa7a555 from mountpoint /dev/vdb
May 28 02:10:10.192647 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3c8e5444-71f5-4c8f-8c75-7b5d94eff8ba tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Found disk vdb by alias ua-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:10:10.193772 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3c8e5444-71f5-4c8f-8c75-7b5d94eff8ba tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Found disk vdb by alias ua-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:10:10.193921 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3c8e5444-71f5-4c8f-8c75-7b5d94eff8ba tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Attempting to detach device vdb from instance 88e7dd8f-33f3-46e8-8d17-b9451bb627e5 from the persistent domain config. {{(pid=98241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 02:10:10.194158 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-3c8e5444-71f5-4c8f-8c75-7b5d94eff8ba tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:10:10.194158 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:10:10.194158 np0000001583 nova-compute[98241]:   <alias name="ua-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555"/>
May 28 02:10:10.194158 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-0"/>
May 28 02:10:10.194158 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:10:10.194158 np0000001583 nova-compute[98241]:   <serial>4f8bb99a-ba62-404c-b8c0-b24e8fa7a555</serial>
May 28 02:10:10.194158 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 02:10:10.194158 np0000001583 nova-compute[98241]: </disk>
May 28 02:10:10.194158 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:10:10.200006 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-3c8e5444-71f5-4c8f-8c75-7b5d94eff8ba tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Successfully detached device vdb from instance 88e7dd8f-33f3-46e8-8d17-b9451bb627e5 from the persistent domain config.
May 28 02:10:10.200175 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3c8e5444-71f5-4c8f-8c75-7b5d94eff8ba tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] (1/8): Attempting to detach device vdb with device alias ua-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555 from instance 88e7dd8f-33f3-46e8-8d17-b9451bb627e5 from the live domain config. {{(pid=98241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 02:10:10.200386 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-3c8e5444-71f5-4c8f-8c75-7b5d94eff8ba tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:10:10.200386 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:10:10.200386 np0000001583 nova-compute[98241]:   <alias name="ua-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555"/>
May 28 02:10:10.200386 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-0"/>
May 28 02:10:10.200386 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:10:10.200386 np0000001583 nova-compute[98241]:   <serial>4f8bb99a-ba62-404c-b8c0-b24e8fa7a555</serial>
May 28 02:10:10.200386 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 02:10:10.200386 np0000001583 nova-compute[98241]: </disk>
May 28 02:10:10.200386 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:10:10.305897 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:10:10.684536 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Received event <DeviceRemovedEvent: 1779934210.6840515, 88e7dd8f-33f3-46e8-8d17-b9451bb627e5 => ua-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555> from libvirt while the driver is waiting for it; dispatched. {{(pid=98241) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 02:10:10.685316 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3c8e5444-71f5-4c8f-8c75-7b5d94eff8ba tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555 for instance 88e7dd8f-33f3-46e8-8d17-b9451bb627e5 {{(pid=98241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 02:10:10.687686 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-3c8e5444-71f5-4c8f-8c75-7b5d94eff8ba tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Successfully detached device vdb from instance 88e7dd8f-33f3-46e8-8d17-b9451bb627e5 from the live domain config.
May 28 02:10:10.688992 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c8e5444-71f5-4c8f-8c75-7b5d94eff8ba tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:10:10.689425 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8e5444-71f5-4c8f-8c75-7b5d94eff8ba tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555', 'iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4f8bb99a-ba62-404c-b8c0-b24e8fa7a555', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:10:10.689633 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-3c8e5444-71f5-4c8f-8c75-7b5d94eff8ba tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:10:10.811097 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Triggering sync for uuid 88e7dd8f-33f3-46e8-8d17-b9451bb627e5 {{(pid=98241) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 02:10:10.811361 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Triggering sync for uuid e7554a11-146b-416b-8121-b7e6773b8dab {{(pid=98241) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 02:10:10.811540 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Triggering sync for uuid 5f8cf96c-2c00-493d-afe2-2ea77a834767 {{(pid=98241) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 02:10:10.811725 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Triggering sync for uuid 2e42be01-bc16-4fa6-9a95-698204b5e592 {{(pid=98241) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 02:10:10.812343 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:10:10.813042 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "e7554a11-146b-416b-8121-b7e6773b8dab" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:10:10.813392 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "5f8cf96c-2c00-493d-afe2-2ea77a834767" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:10:10.815087 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "2e42be01-bc16-4fa6-9a95-698204b5e592" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:10:10.815365 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 10.89 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:10:10.815520 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "e7554a11-146b-416b-8121-b7e6773b8dab" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:10:10.815695 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "5f8cf96c-2c00-493d-afe2-2ea77a834767" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:10:10.816242 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "2e42be01-bc16-4fa6-9a95-698204b5e592" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.003s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:10:11.322924 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "5f8cf96c-2c00-493d-afe2-2ea77a834767" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.507s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:10:11.323307 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "e7554a11-146b-416b-8121-b7e6773b8dab" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.510s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:10:11.323736 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "2e42be01-bc16-4fa6-9a95-698204b5e592" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.508s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:10:12.179600 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Acquiring lock "1c600f44-79c3-4d3f-ad07-0f09ad498836" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:10:12.180000 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "1c600f44-79c3-4d3f-ad07-0f09ad498836" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:10:12.681402 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 02:10:12.948415 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-3c8e5444-71f5-4c8f-8c75-7b5d94eff8ba tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.259s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:10:12.948699 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8e5444-71f5-4c8f-8c75-7b5d94eff8ba tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555', 'iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4f8bb99a-ba62-404c-b8c0-b24e8fa7a555', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:10:12.948855 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8e5444-71f5-4c8f-8c75-7b5d94eff8ba tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:10:12.976781 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8e5444-71f5-4c8f-8c75-7b5d94eff8ba tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:12.976781 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:12.976781 np0000001583 nova-compute[98241]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555 (non-flash)
May 28 02:10:12.976781 np0000001583 nova-compute[98241]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555 (non-flash)
May 28 02:10:12.976781 np0000001583 nova-compute[98241]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-56319df5-f317-45c2-8ff3-b3dd6005c9e5 (non-flash)
May 28 02:10:12.976781 np0000001583 nova-compute[98241]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-56319df5-f317-45c2-8ff3-b3dd6005c9e5 (non-flash)
May 28 02:10:12.976781 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:10:12.977044 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8e5444-71f5-4c8f-8c75-7b5d94eff8ba tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:12.977044 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:12.977044 np0000001583 nova-compute[98241]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555 (non-flash)
May 28 02:10:12.977044 np0000001583 nova-compute[98241]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555 (non-flash)
May 28 02:10:12.977044 np0000001583 nova-compute[98241]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-56319df5-f317-45c2-8ff3-b3dd6005c9e5 (non-flash)
May 28 02:10:12.977044 np0000001583 nova-compute[98241]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-56319df5-f317-45c2-8ff3-b3dd6005c9e5 (non-flash)
May 28 02:10:12.977044 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:10:12.977284 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8e5444-71f5-4c8f-8c75-7b5d94eff8ba tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb', '181'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb', '182'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555', '186'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555', '187'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-56319df5-f317-45c2-8ff3-b3dd6005c9e5', '188'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-56319df5-f317-45c2-8ff3-b3dd6005c9e5', '189')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:10:12.977390 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8e5444-71f5-4c8f-8c75-7b5d94eff8ba tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555', '186')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:10:12.979099 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8e5444-71f5-4c8f-8c75-7b5d94eff8ba tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555', '187')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:10:12.980173 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8e5444-71f5-4c8f-8c75-7b5d94eff8ba tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724ec2c42c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555'): ({'sdc'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:10:12.980424 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3c8e5444-71f5-4c8f-8c75-7b5d94eff8ba tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Removing multipathed devices sdc, sdb {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:10:12.980702 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3c8e5444-71f5-4c8f-8c75-7b5d94eff8ba tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Flush multipath device 3300000007987dcf9 {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:10:13.012406 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3c8e5444-71f5-4c8f-8c75-7b5d94eff8ba tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:10:13.069519 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3c8e5444-71f5-4c8f-8c75-7b5d94eff8ba tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:10:13.119569 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3c8e5444-71f5-4c8f-8c75-7b5d94eff8ba tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:10:13.119799 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3c8e5444-71f5-4c8f-8c75-7b5d94eff8ba tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:10:13.120652 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3c8e5444-71f5-4c8f-8c75-7b5d94eff8ba tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:10:13.132969 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-3c8e5444-71f5-4c8f-8c75-7b5d94eff8ba tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:10:13.133468 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8e5444-71f5-4c8f-8c75-7b5d94eff8ba tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:10:13.144781 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8e5444-71f5-4c8f-8c75-7b5d94eff8ba tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:13.175951 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8e5444-71f5-4c8f-8c75-7b5d94eff8ba tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 186, target: iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555, portal: 192.168.40.100,3260]
May 28 02:10:13.175951 np0000001583 nova-compute[98241]: Logout of [sid: 186, target: iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555, portal: 192.168.40.100,3260] successful.
May 28 02:10:13.175951 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:13.195917 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8e5444-71f5-4c8f-8c75-7b5d94eff8ba tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:13.206436 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8e5444-71f5-4c8f-8c75-7b5d94eff8ba tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:13.236358 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8e5444-71f5-4c8f-8c75-7b5d94eff8ba tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 187, target: iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555, portal: 192.168.50.100,3260]
May 28 02:10:13.236358 np0000001583 nova-compute[98241]: Logout of [sid: 187, target: iqn.2023-03.storpool.com:os--volume-4f8bb99a-ba62-404c-b8c0-b24e8fa7a555, portal: 192.168.50.100,3260] successful.
May 28 02:10:13.236358 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:13.242217 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:10:13.242447 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:10:13.246750 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 02:10:13.246913 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Claim successful on node np0000001583
May 28 02:10:13.257891 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8e5444-71f5-4c8f-8c75-7b5d94eff8ba tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:13.258146 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-3c8e5444-71f5-4c8f-8c75-7b5d94eff8ba tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:10:13.258270 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8e5444-71f5-4c8f-8c75-7b5d94eff8ba tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] <== disconnect_volume: return (2568ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:10:13.258385 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c8e5444-71f5-4c8f-8c75-7b5d94eff8ba tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:10:13.603833 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:13.756247 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:13.839448 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-3c8e5444-71f5-4c8f-8c75-7b5d94eff8ba tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lazy-loading 'flavor' on Instance uuid 88e7dd8f-33f3-46e8-8d17-b9451bb627e5 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:10:14.310899 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Refreshing inventories for resource provider cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 28 02:10:14.362031 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "5f8cf96c-2c00-493d-afe2-2ea77a834767" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:10:14.362655 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "5f8cf96c-2c00-493d-afe2-2ea77a834767" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:10:14.387042 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Updating ProviderTree inventory for provider cfa1af79-477d-460a-869d-84a19fa91765 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 28 02:10:14.387571 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Updating inventory in ProviderTree for provider cfa1af79-477d-460a-869d-84a19fa91765 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 28 02:10:14.428938 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Refreshing aggregate associations for resource provider cfa1af79-477d-460a-869d-84a19fa91765, aggregates: None {{(pid=98241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 28 02:10:14.486425 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Refreshing trait associations for resource provider cfa1af79-477d-460a-869d-84a19fa91765, traits: COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_NET_VIF_MODEL_IGB,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_ARCH_AARCH64,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_ARCH_S390X,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ARCH_MIPSEL,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,COMPUTE_SOUND_MODEL_USB,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ARCH_X86_64,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ARCH_RISCV64,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ARCH_PPC64LE,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_SOUND_MODEL_SB16,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_SOUND_MODEL_AC97,COMPUTE_RESCUE_BFV,HW_ARCH_X86_64,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=98241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 28 02:10:14.751399 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:10:14.751598 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:10:14.849732 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3c8e5444-71f5-4c8f-8c75-7b5d94eff8ba tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.216s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:10:14.850039 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 4.038s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:10:14.866370 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lazy-loading 'flavor' on Instance uuid 5f8cf96c-2c00-493d-afe2-2ea77a834767 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:10:15.254483 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:10:15.354300 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.504s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:10:15.760767 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.518s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:10:15.761052 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 02:10:15.871615 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "5f8cf96c-2c00-493d-afe2-2ea77a834767" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:10:16.196018 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Acquiring lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:10:16.197354 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:10:16.266297 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 02:10:16.266461 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 02:10:16.266833 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:10:16.267146 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:10:16.338475 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c8ce004361ad4602a6f330506184114b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b5c56c77c64b318056094f7fa5861d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 02:10:16.700568 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lazy-loading 'flavor' on Instance uuid 88e7dd8f-33f3-46e8-8d17-b9451bb627e5 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:10:16.742758 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Successfully created port: 297624aa-10d3-472b-99eb-50d74b733edc {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 02:10:16.769581 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 02:10:16.989662 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "5f8cf96c-2c00-493d-afe2-2ea77a834767" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:10:16.989915 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "5f8cf96c-2c00-493d-afe2-2ea77a834767" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:10:16.990178 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Attaching volume 2ca44659-a2eb-4952-8736-4ccf8052ec61 to /dev/vdb
May 28 02:10:17.029023 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:10:17.040137 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 02:10:17.061360 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:10:17.117180 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 02:10:17.117983 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 02:10:17.128771 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 02:10:17.130639 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe28:6dad', 'fe80::98c1:6bff:fe22:4140', 'fe80::fc16:3eff:fee4:704e', 'fe80::d4e0:76ff:fe99:10f4', 'fe80::fc16:3eff:fe1d:399a', 'fe80::d05a:66ff:fe6d:1718', 'fe80::fc16:3eff:fe32:79c4', 'fe80::2c76:91ff:fee7:3598'] 
May 28 02:10:17.131107 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 02:10:17.131107 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 02:10:17.131472 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] <== get_connector_properties: return (101ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:10:17.132330 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Updating existing volume attachment record: 3ee642a3-e38e-4c01-9fc6-9484f5cee2ea {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 02:10:17.203874 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Successfully updated port: 297624aa-10d3-472b-99eb-50d74b733edc {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 02:10:17.261921 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7536953d-ca6b-4e31-80ac-9721a551495e req-5c530776-7b40-4696-bd0d-54f1ff1e131d service nova] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Received event network-changed-297624aa-10d3-472b-99eb-50d74b733edc {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:10:17.262164 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7536953d-ca6b-4e31-80ac-9721a551495e req-5c530776-7b40-4696-bd0d-54f1ff1e131d service nova] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Refreshing instance network info cache due to event network-changed-297624aa-10d3-472b-99eb-50d74b733edc. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:10:17.262463 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7536953d-ca6b-4e31-80ac-9721a551495e req-5c530776-7b40-4696-bd0d-54f1ff1e131d service nova] Acquiring lock "refresh_cache-1c600f44-79c3-4d3f-ad07-0f09ad498836" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:10:17.262699 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7536953d-ca6b-4e31-80ac-9721a551495e req-5c530776-7b40-4696-bd0d-54f1ff1e131d service nova] Acquired lock "refresh_cache-1c600f44-79c3-4d3f-ad07-0f09ad498836" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:10:17.262761 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-7536953d-ca6b-4e31-80ac-9721a551495e req-5c530776-7b40-4696-bd0d-54f1ff1e131d service nova] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Refreshing network info cache for port 297624aa-10d3-472b-99eb-50d74b733edc {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:10:17.273355 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 02:10:17.706283 np0000001583 nova-compute[98241]: DEBUG os_brick.encryptors [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2ca44659-a2eb-4952-8736-4ccf8052ec61', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '5f8cf96c-2c00-493d-afe2-2ea77a834767', 'attached_at': '', 'detached_at': '', 'volume_id': '2ca44659-a2eb-4952-8736-4ccf8052ec61', 'serial': '2ca44659-a2eb-4952-8736-4ccf8052ec61'} {{(pid=98241) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 02:10:17.709304 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 02:10:17.710642 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Acquiring lock "refresh_cache-1c600f44-79c3-4d3f-ad07-0f09ad498836" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:10:17.710857 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.513s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:10:17.711419 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2ca44659-a2eb-4952-8736-4ccf8052ec61', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:10:17.711568 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:10:17.712602 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:10:17.712817 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2ca44659-a2eb-4952-8736-4ccf8052ec61', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 02:10:17.727356 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:10:17.728093 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:10:17.728594 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:10:17.728840 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:10:17.729238 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:10:17.729394 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:10:17.741754 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:10:17.741754 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:17.746333 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:10:17.746333 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:17.753932 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61] added
May 28 02:10:17.753932 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:10:17.753932 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:10:17.753932 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:10:17.753932 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:10:17.753932 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:10:17.753932 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:17.754151 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:10:17.754288 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0255(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:10:17.754452 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:10:17.757305 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61] added
May 28 02:10:17.757305 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:10:17.757305 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:10:17.757305 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:10:17.757305 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:10:17.757305 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:10:17.757305 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:17.757513 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:10:17.757754 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0283(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:10:17.757950 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:10:17.767458 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-7536953d-ca6b-4e31-80ac-9721a551495e req-5c530776-7b40-4696-bd0d-54f1ff1e131d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:10:17.778844 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Booting with volume ea37bb85-4c2e-4a41-817e-51d00727a7d0 at /dev/vda
May 28 02:10:17.823503 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:10:17.825826 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-7536953d-ca6b-4e31-80ac-9721a551495e req-5c530776-7b40-4696-bd0d-54f1ff1e131d service nova] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:10:17.836929 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 02:10:17.856627 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:10:17.898018 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 02:10:17.898247 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 02:10:17.908047 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 02:10:17.909119 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe28:6dad', 'fe80::98c1:6bff:fe22:4140', 'fe80::fc16:3eff:fee4:704e', 'fe80::d4e0:76ff:fe99:10f4', 'fe80::fc16:3eff:fe1d:399a', 'fe80::d05a:66ff:fe6d:1718', 'fe80::fc16:3eff:fe32:79c4', 'fe80::2c76:91ff:fee7:3598'] 
May 28 02:10:17.909215 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 02:10:17.909323 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 02:10:17.909551 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] <== get_connector_properties: return (84ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:10:17.909743 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Updating existing volume attachment record: 6cb3adc6-b6ae-46a2-a0bd-317a96134b55 {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 02:10:17.952487 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-7536953d-ca6b-4e31-80ac-9721a551495e req-5c530776-7b40-4696-bd0d-54f1ff1e131d service nova] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:10:18.455274 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7536953d-ca6b-4e31-80ac-9721a551495e req-5c530776-7b40-4696-bd0d-54f1ff1e131d service nova] Releasing lock "refresh_cache-1c600f44-79c3-4d3f-ad07-0f09ad498836" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:10:18.455977 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Acquired lock "refresh_cache-1c600f44-79c3-4d3f-ad07-0f09ad498836" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:10:18.456247 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:10:18.606330 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:18.755110 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:10:18.757684 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:18.758440 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:10:18.768418 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:10:18.768418 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:10:18.774991 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:10:18.774991 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:18.776910 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Acquiring lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:10:18.776910 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:10:18.776910 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Attaching volume d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2 to /dev/vdb
May 28 02:10:18.782885 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:18.788935 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:18.796326 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:18.796326 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:18.796326 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:10:18.796512 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:18.796512 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:18.796512 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:10:18.802283 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:18.802283 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:18.802283 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:10:18.802595 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:18.802595 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:18.802595 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:10:18.815724 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:10:18.823353 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61, portal: 192.168.40.100,3260]
May 28 02:10:18.823353 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61, portal: 192.168.40.100,3260] successful.
May 28 02:10:18.823353 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:18.831610 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 02:10:18.839494 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:18.841485 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61, portal: 192.168.50.100,3260]
May 28 02:10:18.841485 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61, portal: 192.168.50.100,3260] successful.
May 28 02:10:18.841485 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:18.858760 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:18.858760 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:18.858760 np0000001583 nova-compute[98241]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:18.858760 np0000001583 nova-compute[98241]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:18.858760 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:10:18.858996 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:18.858996 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:18.858996 np0000001583 nova-compute[98241]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:18.858996 np0000001583 nova-compute[98241]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:18.858996 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:10:18.859425 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.131s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:10:18.859552 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:10:18.860169 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] HCTL ('7', '-', '-', 0) found on session 190 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:10:18.860277 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:10:18.860853 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:18.874766 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:10:18.891912 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:18.891912 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:18.891912 np0000001583 nova-compute[98241]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:18.891912 np0000001583 nova-compute[98241]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:18.891912 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:10:18.892462 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:18.892462 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:18.892462 np0000001583 nova-compute[98241]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:18.892462 np0000001583 nova-compute[98241]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:18.892462 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:10:18.893474 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.164s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:10:18.893707 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:10:18.895342 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Searching for a device in session 190 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:10:18.895342 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2ca44659-a2eb-4952-8736-4ccf8052ec61', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:10:18.896638 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] HCTL ('8', '-', '-', 0) found on session 191 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:10:18.896832 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:10:18.911546 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Searching for a device in session 191 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:10:18.911546 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2ca44659-a2eb-4952-8736-4ccf8052ec61', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:10:18.930315 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 02:10:18.930561 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 02:10:18.940580 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 02:10:18.942800 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe28:6dad', 'fe80::98c1:6bff:fe22:4140', 'fe80::fc16:3eff:fee4:704e', 'fe80::d4e0:76ff:fe99:10f4', 'fe80::fc16:3eff:fe1d:399a', 'fe80::d05a:66ff:fe6d:1718', 'fe80::fc16:3eff:fe32:79c4', 'fe80::2c76:91ff:fee7:3598'] 
May 28 02:10:18.943018 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 02:10:18.943788 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 02:10:18.943788 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:10:18.944024 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Updating existing volume attachment record: 490e3202-ec03-435b-9a83-7b2cfb2beb92 {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 02:10:19.032983 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:10:19.178321 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:10:19.295165 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Updating instance_info_cache with network_info: [{"id": "297624aa-10d3-472b-99eb-50d74b733edc", "address": "fa:16:3e:ef:e0:2d", "network": {"id": "a349b3ac-cae9-4909-b273-8409a97fbe5c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-810622904-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60b5c56c77c64b318056094f7fa5861d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap297624aa-10", "ovs_interfaceid": "297624aa-10d3-472b-99eb-50d74b733edc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:10:19.501903 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 02:10:19.502331 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2', 'iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:10:19.502485 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:10:19.729204 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 02:10:19.797777 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Releasing lock "refresh_cache-1c600f44-79c3-4d3f-ad07-0f09ad498836" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:10:19.797777 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Instance network_info: |[{"id": "297624aa-10d3-472b-99eb-50d74b733edc", "address": "fa:16:3e:ef:e0:2d", "network": {"id": "a349b3ac-cae9-4909-b273-8409a97fbe5c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-810622904-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60b5c56c77c64b318056094f7fa5861d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap297624aa-10", "ovs_interfaceid": "297624aa-10d3-472b-99eb-50d74b733edc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 02:10:20.019902 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 02:10:20.021462 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 02:10:20.021771 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Creating image(s)
May 28 02:10:20.022191 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Did not create local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 02:10:20.022367 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Ensure instance console log exists: /opt/stack/data/nova/instances/1c600f44-79c3-4d3f-ad07-0f09ad498836/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 02:10:20.022703 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:10:20.022959 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:10:20.023151 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:10:20.023770 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Start _get_guest_xml network_info=[{"id": "297624aa-10d3-472b-99eb-50d74b733edc", "address": "fa:16:3e:ef:e0:2d", "network": {"id": "a349b3ac-cae9-4909-b273-8409a97fbe5c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-810622904-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60b5c56c77c64b318056094f7fa5861d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap297624aa-10", "ovs_interfaceid": "297624aa-10d3-472b-99eb-50d74b733edc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0', 'iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ea37bb85-4c2e-4a41-817e-51d00727a7d0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '1c600f44-79c3-4d3f-ad07-0f09ad498836', 'attached_at': '', 'detached_at': '', 'volume_id': 'ea37bb85-4c2e-4a41-817e-51d00727a7d0', 'serial': 'ea37bb85-4c2e-4a41-817e-51d00727a7d0'}, 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '6cb3adc6-b6ae-46a2-a0bd-317a96134b55', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 02:10:20.027630 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:10:20.028891 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPatternV346-server-1874038485', uuid='1c600f44-79c3-4d3f-ad07-0f09ad498836'), owner=OwnerMeta(userid='c8ce004361ad4602a6f330506184114b', username='tempest-TestVolumeBootPatternV346-884356236-project-member', projectid='60b5c56c77c64b318056094f7fa5861d', projectname='tempest-TestVolumeBootPatternV346-884356236'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "297624aa-10d3-472b-99eb-50d74b733edc", "address": "fa:16:3e:ef:e0:2d", "network": {"id": "a349b3ac-cae9-4909-b273-8409a97fbe5c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-810622904-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60b5c56c77c64b318056094f7fa5861d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap297624aa-10", "ovs_interfaceid": "297624aa-10d3-472b-99eb-50d74b733edc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779934220.028466) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 02:10:20.030626 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 02:10:20.031045 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 02:10:20.032042 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 02:10:20.032241 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 02:10:20.033168 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 02:10:20.033426 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 02:10:20.033551 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 02:10:20.033631 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 02:10:20.033759 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 02:10:20.033808 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 02:10:20.033915 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 02:10:20.034096 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 02:10:20.034187 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 02:10:20.034295 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 02:10:20.034386 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 02:10:20.034493 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 02:10:20.045897 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 02:10:20.046224 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0', 'iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ea37bb85-4c2e-4a41-817e-51d00727a7d0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:10:20.046346 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:10:20.752184 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Found WWN 3300000002d77a713 for multipath device dm-0 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 02:10:20.752184 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:10:20.752750 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.250s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:10:20.753047 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2', 'iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 02:10:20.754686 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] <== connect_volume: return (3041ms) {'type': 'block', 'scsi_wwn': '3300000002d77a713', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '3300000002d77a713'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:10:20.754686 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002d77a713', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '3300000002d77a713'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 02:10:20.757298 np0000001583 nova-compute[98241]: WARNING stevedore.named [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 02:10:20.757298 np0000001583 nova-compute[98241]: WARNING castellan.key_manager [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 02:10:20.757298 np0000001583 nova-compute[98241]: WARNING nova.keymgr.conf_key_mgr [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 02:10:20.774532 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:10:20.777132 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:10:20.777573 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:10:20.777900 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:10:20.778923 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.006s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:10:20.779168 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:10:20.797588 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:10:20.797588 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:20.801113 np0000001583 nova-compute[98241]: WARNING os_brick.encryptors.luks [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 28 02:10:20.801113 np0000001583 nova-compute[98241]: WARNING stevedore.named [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 02:10:20.801113 np0000001583 nova-compute[98241]: WARNING castellan.key_manager [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 02:10:20.801113 np0000001583 nova-compute[98241]: WARNING nova.keymgr.conf_key_mgr [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 02:10:20.801113 np0000001583 nova-compute[98241]: DEBUG os_brick.encryptors [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x7724ec263320>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2ca44659-a2eb-4952-8736-4ccf8052ec61', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': '5f8cf96c-2c00-493d-afe2-2ea77a834767', 'attached_at': '', 'detached_at': '', 'volume_id': '2ca44659-a2eb-4952-8736-4ccf8052ec61', 'serial': '2ca44659-a2eb-4952-8736-4ccf8052ec61'} {{(pid=98241) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 28 02:10:20.801113 np0000001583 nova-compute[98241]: DEBUG os_brick.encryptors.luks [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] formatting encrypted volume /dev/dm-0 {{(pid=98241) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 28 02:10:20.812552 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:10:20.812552 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:20.816326 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2] added
May 28 02:10:20.816326 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:10:20.816326 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:10:20.816326 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:10:20.816326 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:10:20.816326 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:10:20.816326 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:20.816326 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:10:20.816493 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0385(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:10:20.816529 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:10:20.828387 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2] added
May 28 02:10:20.828387 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:10:20.828387 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:10:20.828387 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:10:20.828387 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:10:20.828387 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:10:20.828387 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:20.828655 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:10:20.828834 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0497(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:10:20.829027 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:10:21.703111 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:10:21.703519 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.49 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:10:21.817008 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:10:21.829404 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:10:21.836587 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:10:21.836587 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:10:21.851375 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:10:21.851375 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:21.861049 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:21.867211 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:21.875015 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:21.875015 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:21.875015 np0000001583 nova-compute[98241]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:21.875015 np0000001583 nova-compute[98241]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:21.875015 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:10:21.875232 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:21.875232 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:21.875232 np0000001583 nova-compute[98241]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:21.875232 np0000001583 nova-compute[98241]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:21.875232 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:10:21.884680 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:21.884680 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:21.884680 np0000001583 nova-compute[98241]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:21.884680 np0000001583 nova-compute[98241]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:21.884680 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:10:21.884867 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:21.884867 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:21.884867 np0000001583 nova-compute[98241]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:21.884867 np0000001583 nova-compute[98241]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:21.884867 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:10:21.924449 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2, portal: 192.168.50.100,3260]
May 28 02:10:21.924449 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2, portal: 192.168.50.100,3260] successful.
May 28 02:10:21.924449 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:21.936206 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:21.941053 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2, portal: 192.168.40.100,3260]
May 28 02:10:21.941053 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2, portal: 192.168.40.100,3260] successful.
May 28 02:10:21.941053 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:21.954151 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:21.955528 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:21.955528 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:21.955528 np0000001583 nova-compute[98241]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:21.955528 np0000001583 nova-compute[98241]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:21.955528 np0000001583 nova-compute[98241]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2 (non-flash)
May 28 02:10:21.955528 np0000001583 nova-compute[98241]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2 (non-flash)
May 28 02:10:21.955528 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:10:21.955674 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:21.955674 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:21.955674 np0000001583 nova-compute[98241]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:21.955674 np0000001583 nova-compute[98241]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:21.955674 np0000001583 nova-compute[98241]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2 (non-flash)
May 28 02:10:21.955674 np0000001583 nova-compute[98241]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2 (non-flash)
May 28 02:10:21.955674 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:10:21.955928 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.179s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:10:21.956065 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:10:21.956859 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] HCTL ('10', '-', '-', 0) found on session 192 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:10:21.956985 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:10:21.973243 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:21.973243 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:21.973243 np0000001583 nova-compute[98241]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:21.973243 np0000001583 nova-compute[98241]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:21.973243 np0000001583 nova-compute[98241]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2 (non-flash)
May 28 02:10:21.973243 np0000001583 nova-compute[98241]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2 (non-flash)
May 28 02:10:21.973243 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:10:21.973420 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:21.973420 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:21.973420 np0000001583 nova-compute[98241]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:21.973420 np0000001583 nova-compute[98241]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:21.973420 np0000001583 nova-compute[98241]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2 (non-flash)
May 28 02:10:21.973420 np0000001583 nova-compute[98241]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2 (non-flash)
May 28 02:10:21.973420 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:10:21.973595 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.195s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:10:21.973683 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:10:21.976597 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] HCTL ('11', '-', '-', 0) found on session 193 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:10:21.976597 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:10:21.978459 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Searching for a device in session 192 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:10:21.979157 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:10:21.991268 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Searching for a device in session 193 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:10:21.991268 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:10:22.777342 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 02:10:23.193856 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:10:23.194376 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:10:23.609102 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:23.759412 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:23.793215 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Found WWN 330000000a89b792a for multipath device dm-1 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 02:10:23.793486 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:10:23.793665 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] <== connect_volume: return (4290ms) {'type': 'block', 'scsi_wwn': '330000000a89b792a', 'path': '/dev/dm-1', 'multipath_id': '330000000a89b792a'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:10:23.793842 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a89b792a', 'path': '/dev/dm-1', 'multipath_id': '330000000a89b792a'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 02:10:23.794742 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 3.748s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:10:23.794742 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0', 'iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ea37bb85-4c2e-4a41-817e-51d00727a7d0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 02:10:23.796737 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lazy-loading 'flavor' on Instance uuid 88e7dd8f-33f3-46e8-8d17-b9451bb627e5 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:10:23.807773 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:10:23.808523 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:10:23.809001 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:10:23.809297 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:10:23.809869 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:10:23.809869 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:10:23.823206 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:10:23.823206 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:23.829564 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:10:23.829564 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:23.835281 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0] added
May 28 02:10:23.835281 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:10:23.835281 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:10:23.835281 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:10:23.835281 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:10:23.835281 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:10:23.835281 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:23.835562 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:10:23.835681 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0264(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:10:23.835857 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:10:23.839094 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0] added
May 28 02:10:23.839094 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:10:23.839094 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:10:23.839094 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:10:23.839094 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:10:23.839094 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:10:23.839094 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:23.839250 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:10:23.839398 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0295(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:10:23.839557 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:10:24.299823 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Attempting to attach volume d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98241) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 02:10:24.301098 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] attach device xml: <disk type="block" device="disk">
May 28 02:10:24.301098 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:10:24.301098 np0000001583 nova-compute[98241]:   <alias name="ua-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2"/>
May 28 02:10:24.301098 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-1"/>
May 28 02:10:24.301098 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:10:24.301098 np0000001583 nova-compute[98241]:   <serial>d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2</serial>
May 28 02:10:24.301098 np0000001583 nova-compute[98241]: </disk>
May 28 02:10:24.301098 np0000001583 nova-compute[98241]:  {{(pid=98241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 02:10:24.769689 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Secret XML: <secret ephemeral="no" private="no">
May 28 02:10:24.769689 np0000001583 nova-compute[98241]:   <usage type="volume">
May 28 02:10:24.769689 np0000001583 nova-compute[98241]:     <volume>2ca44659-a2eb-4952-8736-4ccf8052ec61</volume>
May 28 02:10:24.769689 np0000001583 nova-compute[98241]:   </usage>
May 28 02:10:24.769689 np0000001583 nova-compute[98241]: </secret>
May 28 02:10:24.769689 np0000001583 nova-compute[98241]:  {{(pid=98241) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 28 02:10:24.782859 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lazy-loading 'flavor' on Instance uuid 5f8cf96c-2c00-493d-afe2-2ea77a834767 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:10:24.836602 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:10:24.839901 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:10:24.848579 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:10:24.848579 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:10:24.851126 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:10:24.851126 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:24.864630 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:24.871768 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:24.883698 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:24.883698 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:24.883698 np0000001583 nova-compute[98241]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:24.883698 np0000001583 nova-compute[98241]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:24.883698 np0000001583 nova-compute[98241]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2 (non-flash)
May 28 02:10:24.883698 np0000001583 nova-compute[98241]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2 (non-flash)
May 28 02:10:24.883698 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:10:24.883886 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:24.883886 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:24.883886 np0000001583 nova-compute[98241]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:24.883886 np0000001583 nova-compute[98241]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:24.883886 np0000001583 nova-compute[98241]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2 (non-flash)
May 28 02:10:24.883886 np0000001583 nova-compute[98241]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2 (non-flash)
May 28 02:10:24.883886 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:10:24.890905 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:24.890905 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:24.890905 np0000001583 nova-compute[98241]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:24.890905 np0000001583 nova-compute[98241]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:24.890905 np0000001583 nova-compute[98241]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2 (non-flash)
May 28 02:10:24.890905 np0000001583 nova-compute[98241]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2 (non-flash)
May 28 02:10:24.890905 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:10:24.891114 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:24.891114 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:24.891114 np0000001583 nova-compute[98241]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:24.891114 np0000001583 nova-compute[98241]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:24.891114 np0000001583 nova-compute[98241]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2 (non-flash)
May 28 02:10:24.891114 np0000001583 nova-compute[98241]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2 (non-flash)
May 28 02:10:24.891114 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:10:24.919469 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0, portal: 192.168.40.100,3260]
May 28 02:10:24.919469 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0, portal: 192.168.40.100,3260] successful.
May 28 02:10:24.919469 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:24.928425 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0, portal: 192.168.50.100,3260]
May 28 02:10:24.928425 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0, portal: 192.168.50.100,3260] successful.
May 28 02:10:24.928425 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:24.936456 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:24.943043 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:24.959923 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:24.959923 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:24.959923 np0000001583 nova-compute[98241]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:24.959923 np0000001583 nova-compute[98241]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:24.959923 np0000001583 nova-compute[98241]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2 (non-flash)
May 28 02:10:24.959923 np0000001583 nova-compute[98241]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2 (non-flash)
May 28 02:10:24.959923 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:24.959923 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:24.959923 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:10:24.961133 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:24.961133 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:24.961133 np0000001583 nova-compute[98241]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:24.961133 np0000001583 nova-compute[98241]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:24.961133 np0000001583 nova-compute[98241]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2 (non-flash)
May 28 02:10:24.961133 np0000001583 nova-compute[98241]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2 (non-flash)
May 28 02:10:24.961133 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:24.961133 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:24.961133 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:10:24.961133 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.151s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:10:24.961133 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:10:24.962279 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:24.962279 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:24.962279 np0000001583 nova-compute[98241]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:24.962279 np0000001583 nova-compute[98241]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:24.962279 np0000001583 nova-compute[98241]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2 (non-flash)
May 28 02:10:24.962279 np0000001583 nova-compute[98241]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2 (non-flash)
May 28 02:10:24.962279 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:24.962279 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:24.962279 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:10:24.962831 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:24.962831 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:24.962831 np0000001583 nova-compute[98241]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:24.962831 np0000001583 nova-compute[98241]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:24.962831 np0000001583 nova-compute[98241]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2 (non-flash)
May 28 02:10:24.962831 np0000001583 nova-compute[98241]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2 (non-flash)
May 28 02:10:24.962831 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:24.962831 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:24.962831 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:10:24.962831 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.153s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:10:24.962831 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:10:24.963938 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] HCTL ('13', '-', '-', 0) found on session 194 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:10:24.964062 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:10:24.965553 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] HCTL ('14', '-', '-', 0) found on session 195 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:10:24.965657 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:10:25.003152 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Searching for a device in session 194 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:10:25.003152 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ea37bb85-4c2e-4a41-817e-51d00727a7d0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:10:25.003152 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Searching for a device in session 195 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:10:25.003152 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ea37bb85-4c2e-4a41-817e-51d00727a7d0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:10:25.194649 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:10:25.194649 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:10:25.285845 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Attempting to attach volume 2ca44659-a2eb-4952-8736-4ccf8052ec61 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98241) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 02:10:25.287132 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] attach device xml: <disk type="block" device="disk">
May 28 02:10:25.287132 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:10:25.287132 np0000001583 nova-compute[98241]:   <alias name="ua-2ca44659-a2eb-4952-8736-4ccf8052ec61"/>
May 28 02:10:25.287132 np0000001583 nova-compute[98241]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 28 02:10:25.287132 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:10:25.287132 np0000001583 nova-compute[98241]:   <serial>2ca44659-a2eb-4952-8736-4ccf8052ec61</serial>
May 28 02:10:25.287132 np0000001583 nova-compute[98241]:   <encryption format="luks">
May 28 02:10:25.287132 np0000001583 nova-compute[98241]:     <secret type="passphrase" uuid="c8c4dc3e-d739-40ec-87db-ccbf5263d561"/>
May 28 02:10:25.287132 np0000001583 nova-compute[98241]:   </encryption>
May 28 02:10:25.287132 np0000001583 nova-compute[98241]: </disk>
May 28 02:10:25.287132 np0000001583 nova-compute[98241]:  {{(pid=98241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 02:10:25.810221 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 02:10:25.938366 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:10:25.938562 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:10:25.938623 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:10:25.938667 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] No VIF found with MAC fa:16:3e:28:6d:ad, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:10:26.231907 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Acquiring lock "2e42be01-bc16-4fa6-9a95-698204b5e592" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:10:26.232185 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "2e42be01-bc16-4fa6-9a95-698204b5e592" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:10:26.735239 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lazy-loading 'flavor' on Instance uuid 2e42be01-bc16-4fa6-9a95-698204b5e592 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:10:26.825931 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Found WWN 330000000260d40a0 for multipath device dm-5 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 02:10:26.827581 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:10:26.827581 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] <== connect_volume: return (6780ms) {'type': 'block', 'scsi_wwn': '330000000260d40a0', 'path': '/dev/dm-5', 'multipath_id': '330000000260d40a0'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:10:26.827581 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000260d40a0', 'path': '/dev/dm-5', 'multipath_id': '330000000260d40a0'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 02:10:27.193661 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:10:27.238907 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Ignoring supplied device name: /dev/vdb
May 28 02:10:27.332021 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:10:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1874038485',display_name='tempest-TestVolumeBootPatternV346-server-1874038485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testvolumebootpatternv346-server-1874038485',id=75,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8PllKdqBzlf40vcCKWVOqAG4NjEl0S74b/w9Oy/Sl6P8nIxEi012FULeJLB/74V6fjCn61X6LaOPD/ZP/lpdkQpbqsZJFbLCrBC37bMXW3Q8Rh2FtYBEt1JdGgq3onAw==',key_name='tempest-keypair-1704877857',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60b5c56c77c64b318056094f7fa5861d',ramdisk_id='',reservation_id='r-vj164gdr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-884356236',owner_user_name='tempest-TestVolumeBootPatternV346-884356236-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:10:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8ce004361ad4602a6f330506184114b',uuid=1c600f44-79c3-4d3f-ad07-0f09ad498836,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "297624aa-10d3-472b-99eb-50d74b733edc", "address": "fa:16:3e:ef:e0:2d", "network": {"id": "a349b3ac-cae9-4909-b273-8409a97fbe5c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-810622904-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60b5c56c77c64b318056094f7fa5861d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap297624aa-10", "ovs_interfaceid": "297624aa-10d3-472b-99eb-50d74b733edc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 02:10:27.332274 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Converting VIF {"id": "297624aa-10d3-472b-99eb-50d74b733edc", "address": "fa:16:3e:ef:e0:2d", "network": {"id": "a349b3ac-cae9-4909-b273-8409a97fbe5c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-810622904-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60b5c56c77c64b318056094f7fa5861d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap297624aa-10", "ovs_interfaceid": "297624aa-10d3-472b-99eb-50d74b733edc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:10:27.332728 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:e0:2d,bridge_name='br-int',has_traffic_filtering=True,id=297624aa-10d3-472b-99eb-50d74b733edc,network=Network(a349b3ac-cae9-4909-b273-8409a97fbe5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap297624aa-10') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:10:27.333578 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c600f44-79c3-4d3f-ad07-0f09ad498836 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:10:27.479031 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-a470c27d-a5c4-4692-8c04-2f9d16665a2e tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.703s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:10:27.699879 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:10:27.700000 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:10:27.700163 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:10:27.700302 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Auditing locally available compute resources for np0000001583 (node: np0000001583) {{(pid=98241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 02:10:27.741720 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "2e42be01-bc16-4fa6-9a95-698204b5e592" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:10:27.836132 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] End _get_guest_xml xml=<domain type="qemu">
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:   <uuid>1c600f44-79c3-4d3f-ad07-0f09ad498836</uuid>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:   <name>instance-0000004b</name>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:   <metadata>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:       <nova:name>tempest-TestVolumeBootPatternV346-server-1874038485</nova:name>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 02:10:20</nova:creationTime>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:       <nova:image uuid="">
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:       </nova:image>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:         <nova:user uuid="c8ce004361ad4602a6f330506184114b">tempest-TestVolumeBootPatternV346-884356236-project-member</nova:user>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:         <nova:project uuid="60b5c56c77c64b318056094f7fa5861d">tempest-TestVolumeBootPatternV346-884356236</nova:project>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:       <nova:root type="volume" uuid=""/>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:         <nova:port uuid="297624aa-10d3-472b-99eb-50d74b733edc">
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:         </nova:port>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:   </metadata>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:     <system>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:       <entry name="serial">1c600f44-79c3-4d3f-ad07-0f09ad498836</entry>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:       <entry name="uuid">1c600f44-79c3-4d3f-ad07-0f09ad498836</entry>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:     </system>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:   <os>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:   </os>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:   <features>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:     <acpi/>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:     <tcg>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:     </tcg>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:   </features>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:   </cpu>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:   <devices>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/1c600f44-79c3-4d3f-ad07-0f09ad498836/disk.config"/>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:     </disk>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:     <disk type="block" device="disk">
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:       <alias name="ua-ea37bb85-4c2e-4a41-817e-51d00727a7d0"/>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:       <source dev="/dev/dm-5"/>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:       <serial>ea37bb85-4c2e-4a41-817e-51d00727a7d0</serial>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:     </disk>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:ef:e0:2d"/>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:       <target dev="tap297624aa-10"/>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:     </interface>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/1c600f44-79c3-4d3f-ad07-0f09ad498836/console.log" append="off"/>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:     </serial>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:     <video>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:     </video>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:     </rng>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:     </memballoon>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:   </devices>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]: </domain>
May 28 02:10:27.836132 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 02:10:27.838393 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Preparing to wait for external event network-vif-plugged-297624aa-10d3-472b-99eb-50d74b733edc {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 02:10:27.838393 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Acquiring lock "1c600f44-79c3-4d3f-ad07-0f09ad498836-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:10:27.838393 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "1c600f44-79c3-4d3f-ad07-0f09ad498836-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:10:27.838393 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "1c600f44-79c3-4d3f-ad07-0f09ad498836-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:10:27.838393 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:10:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1874038485',display_name='tempest-TestVolumeBootPatternV346-server-1874038485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testvolumebootpatternv346-server-1874038485',id=75,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8PllKdqBzlf40vcCKWVOqAG4NjEl0S74b/w9Oy/Sl6P8nIxEi012FULeJLB/74V6fjCn61X6LaOPD/ZP/lpdkQpbqsZJFbLCrBC37bMXW3Q8Rh2FtYBEt1JdGgq3onAw==',key_name='tempest-keypair-1704877857',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60b5c56c77c64b318056094f7fa5861d',ramdisk_id='',reservation_id='r-vj164gdr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-884356236',owner_user_name='tempest-TestVolumeBootPatternV346-884356236-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:10:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8ce004361ad4602a6f330506184114b',uuid=1c600f44-79c3-4d3f-ad07-0f09ad498836,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "297624aa-10d3-472b-99eb-50d74b733edc", "address": "fa:16:3e:ef:e0:2d", "network": {"id": "a349b3ac-cae9-4909-b273-8409a97fbe5c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-810622904-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60b5c56c77c64b318056094f7fa5861d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap297624aa-10", "ovs_interfaceid": "297624aa-10d3-472b-99eb-50d74b733edc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 02:10:27.838393 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Converting VIF {"id": "297624aa-10d3-472b-99eb-50d74b733edc", "address": "fa:16:3e:ef:e0:2d", "network": {"id": "a349b3ac-cae9-4909-b273-8409a97fbe5c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-810622904-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60b5c56c77c64b318056094f7fa5861d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap297624aa-10", "ovs_interfaceid": "297624aa-10d3-472b-99eb-50d74b733edc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:10:27.838393 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:e0:2d,bridge_name='br-int',has_traffic_filtering=True,id=297624aa-10d3-472b-99eb-50d74b733edc,network=Network(a349b3ac-cae9-4909-b273-8409a97fbe5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap297624aa-10') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:10:27.838393 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:e0:2d,bridge_name='br-int',has_traffic_filtering=True,id=297624aa-10d3-472b-99eb-50d74b733edc,network=Network(a349b3ac-cae9-4909-b273-8409a97fbe5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap297624aa-10') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 02:10:27.838746 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:27.838746 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:10:27.838944 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 02:10:27.839624 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:27.839785 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '13f15399-1ddb-5614-be21-cb1ac8047343', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:10:27.840471 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:27.841241 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:10:27.841655 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:27.843625 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:27.843782 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap297624aa-10, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:10:27.844029 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap297624aa-10, col_values=(('qos', UUID('d4475fc5-9406-4c05-8ade-a35eca27f911')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:10:27.844223 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap297624aa-10, col_values=(('external_ids', {'iface-id': '297624aa-10d3-472b-99eb-50d74b733edc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:e0:2d', 'vm-uuid': '1c600f44-79c3-4d3f-ad07-0f09ad498836'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:10:27.844993 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:27.846378 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:10:27.850447 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:27.851490 np0000001583 nova-compute[98241]: INFO os_vif [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:e0:2d,bridge_name='br-int',has_traffic_filtering=True,id=297624aa-10d3-472b-99eb-50d74b733edc,network=Network(a349b3ac-cae9-4909-b273-8409a97fbe5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap297624aa-10')
May 28 02:10:27.901185 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:10:27.901185 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:10:27.901343 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:10:27.901343 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] No VIF found with MAC fa:16:3e:1d:39:9a, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:10:28.610843 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:28.723026 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 02:10:28.724455 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:10:28.796595 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Acquiring lock "2e42be01-bc16-4fa6-9a95-698204b5e592" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:10:28.796804 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "2e42be01-bc16-4fa6-9a95-698204b5e592" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:10:28.797050 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Attaching volume f4addb7d-0ef0-476c-aecf-4d36ab500da2 to /dev/vdb
May 28 02:10:28.810909 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:10:28.811318 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:10:28.853717 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:10:28.865410 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 02:10:28.885170 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:10:28.897480 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:10:28.898195 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-0 (vdb) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 02:10:28.906013 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e42be01-bc16-4fa6-9a95-698204b5e592/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:10:28.930266 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 02:10:28.930730 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 02:10:28.941443 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 02:10:28.942624 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe28:6dad', 'fe80::98c1:6bff:fe22:4140', 'fe80::fc16:3eff:fee4:704e', 'fe80::d4e0:76ff:fe99:10f4', 'fe80::fc16:3eff:fe1d:399a', 'fe80::d05a:66ff:fe6d:1718', 'fe80::fc16:3eff:fe32:79c4', 'fe80::2c76:91ff:fee7:3598'] 
May 28 02:10:28.942865 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 02:10:28.942936 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 02:10:28.943240 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] <== get_connector_properties: return (89ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:10:28.943827 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Updating existing volume attachment record: 4e1d4197-14d4-4158-b708-b3ad2ddfbe9e {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 02:10:28.993196 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e42be01-bc16-4fa6-9a95-698204b5e592/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:10:28.993658 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e42be01-bc16-4fa6-9a95-698204b5e592/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:10:29.080629 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e42be01-bc16-4fa6-9a95-698204b5e592/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:10:29.086121 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88e7dd8f-33f3-46e8-8d17-b9451bb627e5/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:10:29.175924 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88e7dd8f-33f3-46e8-8d17-b9451bb627e5/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:10:29.176557 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88e7dd8f-33f3-46e8-8d17-b9451bb627e5/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:10:29.265645 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88e7dd8f-33f3-46e8-8d17-b9451bb627e5/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:10:29.266015 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 02:10:29.270018 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:10:29.271058 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:10:29.316267 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.045s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:10:29.316667 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Hypervisor/Node resource view: name=np0000001583 free_ram=12473MB free_disk=72.64945602416992GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 02:10:29.316938 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:10:29.317231 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:10:29.367752 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:10:29.367951 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:10:29.368114 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] No VIF found with MAC fa:16:3e:ef:e0:2d, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:10:29.368860 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Using config drive
May 28 02:10:29.462058 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6a29b6d3-e377-4d1d-8ebd-a728569c3523 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "5f8cf96c-2c00-493d-afe2-2ea77a834767" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.472s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:10:29.490960 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 02:10:29.491429 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2', 'iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4addb7d-0ef0-476c-aecf-4d36ab500da2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:10:29.491591 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:10:29.876957 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:10:29.944441 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.453s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:10:29.944683 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2', 'iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4addb7d-0ef0-476c-aecf-4d36ab500da2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 02:10:29.958680 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:10:29.959250 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:10:29.959487 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:10:29.959996 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:10:29.960445 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:10:29.960630 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:10:29.971769 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:10:29.971769 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:29.977902 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:10:29.977902 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:29.987222 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2] added
May 28 02:10:29.987222 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:10:29.987222 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:10:29.987222 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:10:29.987222 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:10:29.987222 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:10:29.987222 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:29.987222 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:10:29.987222 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0272(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:10:29.987222 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:10:29.990477 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2] added
May 28 02:10:29.990477 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:10:29.990477 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:10:29.990477 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:10:29.990477 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:10:29.990477 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:10:29.990477 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:29.990647 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:10:29.990769 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0301(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:10:29.990922 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:10:30.002066 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Creating config drive at /opt/stack/data/nova/instances/1c600f44-79c3-4d3f-ad07-0f09ad498836/disk.config
May 28 02:10:30.010105 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1c600f44-79c3-4d3f-ad07-0f09ad498836/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpy4w861ii {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:10:30.072408 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1c600f44-79c3-4d3f-ad07-0f09ad498836/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpy4w861ii" returned: 0 in 0.063s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:10:30.331383 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Skipping migration as instance is neither resizing nor live-migrating. {{(pid=98241) _update_usage_from_migrations /opt/stack/nova/nova/compute/resource_tracker.py:1596}}
May 28 02:10:30.375363 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 88e7dd8f-33f3-46e8-8d17-b9451bb627e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:10:30.375501 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance e7554a11-146b-416b-8121-b7e6773b8dab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:10:30.375588 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 2e42be01-bc16-4fa6-9a95-698204b5e592 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:10:30.376280 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 1c600f44-79c3-4d3f-ad07-0f09ad498836 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:10:30.376280 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Migration 131957dd-9295-4b04-9a1d-515e3dba179d is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}}
May 28 02:10:30.376280 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 02:10:30.376280 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Final resource view: name=np0000001583 phys_ram=24030MB used_ram=1472MB phys_disk=95GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:10:29 up 46 min,  2 users,  load average: 4.41, 5.26, 4.86\n', 'num_instances': '5', 'num_vm_active': '4', 'num_task_None': '4', 'num_os_type_None': '5', 'num_proj_aa3c7ad1bf6248aa8e7f10a9d2a212ce': '1', 'io_workload': '1', 'num_proj_60b5c56c77c64b318056094f7fa5861d': '2', 'num_proj_d192b18567fd4735988dd19da06fb868': '1', 'num_proj_a20805bca06645eabf880bb71e4b69e3': '1', 'num_vm_building': '1', 'num_task_spawning': '1'} {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 02:10:30.491401 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:30.518634 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:30.600614 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-82d7e47d-75e0-43c0-8b4c-4a25cc2ccf55 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Acquiring lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:10:30.600791 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-82d7e47d-75e0-43c0-8b4c-4a25cc2ccf55 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:10:30.615290 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:30.670395 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:10:30.670548 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:10:30.681300 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:30.688580 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:30.691992 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-396ee052-6156-4d27-8f8c-5c6fb9d53a11 req-342482c2-0f9d-4ad3-91aa-396ad199500c service nova] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Received event network-vif-plugged-297624aa-10d3-472b-99eb-50d74b733edc {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:10:30.692351 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-396ee052-6156-4d27-8f8c-5c6fb9d53a11 req-342482c2-0f9d-4ad3-91aa-396ad199500c service nova] Acquiring lock "1c600f44-79c3-4d3f-ad07-0f09ad498836-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:10:30.692452 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-396ee052-6156-4d27-8f8c-5c6fb9d53a11 req-342482c2-0f9d-4ad3-91aa-396ad199500c service nova] Lock "1c600f44-79c3-4d3f-ad07-0f09ad498836-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:10:30.692592 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-396ee052-6156-4d27-8f8c-5c6fb9d53a11 req-342482c2-0f9d-4ad3-91aa-396ad199500c service nova] Lock "1c600f44-79c3-4d3f-ad07-0f09ad498836-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:10:30.692730 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-396ee052-6156-4d27-8f8c-5c6fb9d53a11 req-342482c2-0f9d-4ad3-91aa-396ad199500c service nova] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Processing event network-vif-plugged-297624aa-10d3-472b-99eb-50d74b733edc {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 02:10:30.987498 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:10:30.991403 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:10:31.000998 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:10:31.000998 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:10:31.007091 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:10:31.007091 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:31.014797 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:31.020820 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:31.036699 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:31.036699 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:31.036699 np0000001583 nova-compute[98241]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:31.036699 np0000001583 nova-compute[98241]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:31.036699 np0000001583 nova-compute[98241]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2 (non-flash)
May 28 02:10:31.036699 np0000001583 nova-compute[98241]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2 (non-flash)
May 28 02:10:31.036699 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:31.036699 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:31.036699 np0000001583 nova-compute[98241]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-414d1767-ba80-4940-994c-8a6e586405cc (non-flash)
May 28 02:10:31.036699 np0000001583 nova-compute[98241]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-414d1767-ba80-4940-994c-8a6e586405cc (non-flash)
May 28 02:10:31.036699 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:10:31.036973 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:31.036973 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:31.036973 np0000001583 nova-compute[98241]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:31.036973 np0000001583 nova-compute[98241]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:31.036973 np0000001583 nova-compute[98241]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2 (non-flash)
May 28 02:10:31.036973 np0000001583 nova-compute[98241]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2 (non-flash)
May 28 02:10:31.036973 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:31.036973 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:31.036973 np0000001583 nova-compute[98241]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-414d1767-ba80-4940-994c-8a6e586405cc (non-flash)
May 28 02:10:31.036973 np0000001583 nova-compute[98241]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-414d1767-ba80-4940-994c-8a6e586405cc (non-flash)
May 28 02:10:31.036973 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:10:31.043167 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:31.043167 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:31.043167 np0000001583 nova-compute[98241]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:31.043167 np0000001583 nova-compute[98241]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:31.043167 np0000001583 nova-compute[98241]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2 (non-flash)
May 28 02:10:31.043167 np0000001583 nova-compute[98241]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2 (non-flash)
May 28 02:10:31.043167 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:31.043167 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:31.043167 np0000001583 nova-compute[98241]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-414d1767-ba80-4940-994c-8a6e586405cc (non-flash)
May 28 02:10:31.043167 np0000001583 nova-compute[98241]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-414d1767-ba80-4940-994c-8a6e586405cc (non-flash)
May 28 02:10:31.043167 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:10:31.043515 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:31.043515 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:31.043515 np0000001583 nova-compute[98241]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:31.043515 np0000001583 nova-compute[98241]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:31.043515 np0000001583 nova-compute[98241]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2 (non-flash)
May 28 02:10:31.043515 np0000001583 nova-compute[98241]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2 (non-flash)
May 28 02:10:31.043515 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:31.043515 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:31.043515 np0000001583 nova-compute[98241]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-414d1767-ba80-4940-994c-8a6e586405cc (non-flash)
May 28 02:10:31.043515 np0000001583 nova-compute[98241]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-414d1767-ba80-4940-994c-8a6e586405cc (non-flash)
May 28 02:10:31.043515 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:10:31.083030 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2, portal: 192.168.40.100,3260]
May 28 02:10:31.083030 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2, portal: 192.168.40.100,3260] successful.
May 28 02:10:31.083030 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:31.090806 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2, portal: 192.168.50.100,3260]
May 28 02:10:31.090806 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2, portal: 192.168.50.100,3260] successful.
May 28 02:10:31.090806 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:31.095464 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:31.102766 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:31.106091 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-82d7e47d-75e0-43c0-8b4c-4a25cc2ccf55 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Detaching volume d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2
May 28 02:10:31.114591 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:31.114591 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:31.114591 np0000001583 nova-compute[98241]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:31.114591 np0000001583 nova-compute[98241]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:31.114591 np0000001583 nova-compute[98241]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2 (non-flash)
May 28 02:10:31.114591 np0000001583 nova-compute[98241]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2 (non-flash)
May 28 02:10:31.114591 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:31.114591 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:31.114591 np0000001583 nova-compute[98241]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-414d1767-ba80-4940-994c-8a6e586405cc (non-flash)
May 28 02:10:31.114591 np0000001583 nova-compute[98241]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-414d1767-ba80-4940-994c-8a6e586405cc (non-flash)
May 28 02:10:31.114591 np0000001583 nova-compute[98241]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2 (non-flash)
May 28 02:10:31.114591 np0000001583 nova-compute[98241]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2 (non-flash)
May 28 02:10:31.114591 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:10:31.114891 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:31.114891 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:31.114891 np0000001583 nova-compute[98241]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:31.114891 np0000001583 nova-compute[98241]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:31.114891 np0000001583 nova-compute[98241]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2 (non-flash)
May 28 02:10:31.114891 np0000001583 nova-compute[98241]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2 (non-flash)
May 28 02:10:31.114891 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:31.114891 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:31.114891 np0000001583 nova-compute[98241]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-414d1767-ba80-4940-994c-8a6e586405cc (non-flash)
May 28 02:10:31.114891 np0000001583 nova-compute[98241]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-414d1767-ba80-4940-994c-8a6e586405cc (non-flash)
May 28 02:10:31.114891 np0000001583 nova-compute[98241]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2 (non-flash)
May 28 02:10:31.114891 np0000001583 nova-compute[98241]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2 (non-flash)
May 28 02:10:31.114891 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:10:31.115211 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.156s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:10:31.115211 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:10:31.119237 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] HCTL ('17', '-', '-', 0) found on session 198 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:10:31.119330 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:10:31.130255 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:31.130255 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:31.130255 np0000001583 nova-compute[98241]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:31.130255 np0000001583 nova-compute[98241]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:31.130255 np0000001583 nova-compute[98241]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2 (non-flash)
May 28 02:10:31.130255 np0000001583 nova-compute[98241]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2 (non-flash)
May 28 02:10:31.130255 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:31.130255 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:31.130255 np0000001583 nova-compute[98241]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-414d1767-ba80-4940-994c-8a6e586405cc (non-flash)
May 28 02:10:31.130255 np0000001583 nova-compute[98241]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-414d1767-ba80-4940-994c-8a6e586405cc (non-flash)
May 28 02:10:31.130255 np0000001583 nova-compute[98241]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2 (non-flash)
May 28 02:10:31.130255 np0000001583 nova-compute[98241]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2 (non-flash)
May 28 02:10:31.130255 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:10:31.130489 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:31.130489 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:31.130489 np0000001583 nova-compute[98241]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:31.130489 np0000001583 nova-compute[98241]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:31.130489 np0000001583 nova-compute[98241]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2 (non-flash)
May 28 02:10:31.130489 np0000001583 nova-compute[98241]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2 (non-flash)
May 28 02:10:31.130489 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:31.130489 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:31.130489 np0000001583 nova-compute[98241]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-414d1767-ba80-4940-994c-8a6e586405cc (non-flash)
May 28 02:10:31.130489 np0000001583 nova-compute[98241]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-414d1767-ba80-4940-994c-8a6e586405cc (non-flash)
May 28 02:10:31.130489 np0000001583 nova-compute[98241]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2 (non-flash)
May 28 02:10:31.130489 np0000001583 nova-compute[98241]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2 (non-flash)
May 28 02:10:31.130489 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:10:31.130744 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.170s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:10:31.130797 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:10:31.132065 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] HCTL ('18', '-', '-', 0) found on session 199 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:10:31.132213 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:10:31.139452 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Searching for a device in session 198 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:10:31.139683 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4addb7d-0ef0-476c-aecf-4d36ab500da2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:10:31.150722 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Searching for a device in session 199 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:10:31.150722 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f4addb7d-0ef0-476c-aecf-4d36ab500da2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:10:31.153881 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-82d7e47d-75e0-43c0-8b4c-4a25cc2ccf55 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Attempting to driver detach volume d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2 from mountpoint /dev/vdb
May 28 02:10:31.155108 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Stashing vm_state: active {{(pid=98241) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 28 02:10:31.167069 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-82d7e47d-75e0-43c0-8b4c-4a25cc2ccf55 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Found disk vdb by alias ua-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:10:31.168395 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-82d7e47d-75e0-43c0-8b4c-4a25cc2ccf55 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Found disk vdb by alias ua-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:10:31.168517 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-82d7e47d-75e0-43c0-8b4c-4a25cc2ccf55 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Attempting to detach device vdb from instance 88e7dd8f-33f3-46e8-8d17-b9451bb627e5 from the persistent domain config. {{(pid=98241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 02:10:31.168745 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-82d7e47d-75e0-43c0-8b4c-4a25cc2ccf55 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:10:31.168745 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:10:31.168745 np0000001583 nova-compute[98241]:   <alias name="ua-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2"/>
May 28 02:10:31.168745 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-1"/>
May 28 02:10:31.168745 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:10:31.168745 np0000001583 nova-compute[98241]:   <serial>d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2</serial>
May 28 02:10:31.168745 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 02:10:31.168745 np0000001583 nova-compute[98241]: </disk>
May 28 02:10:31.168745 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:10:31.172943 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:10:31.182936 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-82d7e47d-75e0-43c0-8b4c-4a25cc2ccf55 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Successfully detached device vdb from instance 88e7dd8f-33f3-46e8-8d17-b9451bb627e5 from the persistent domain config.
May 28 02:10:31.183526 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-82d7e47d-75e0-43c0-8b4c-4a25cc2ccf55 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] (1/8): Attempting to detach device vdb with device alias ua-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2 from instance 88e7dd8f-33f3-46e8-8d17-b9451bb627e5 from the live domain config. {{(pid=98241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 02:10:31.183618 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-82d7e47d-75e0-43c0-8b4c-4a25cc2ccf55 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:10:31.183618 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:10:31.183618 np0000001583 nova-compute[98241]:   <alias name="ua-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2"/>
May 28 02:10:31.183618 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-1"/>
May 28 02:10:31.183618 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:10:31.183618 np0000001583 nova-compute[98241]:   <serial>d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2</serial>
May 28 02:10:31.183618 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 02:10:31.183618 np0000001583 nova-compute[98241]: </disk>
May 28 02:10:31.183618 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:10:31.281004 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934231.2799218, 1c600f44-79c3-4d3f-ad07-0f09ad498836 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:10:31.281004 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] VM Started (Lifecycle Event)
May 28 02:10:31.282584 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 02:10:31.289101 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 02:10:31.293306 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Instance spawned successfully.
May 28 02:10:31.294742 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 02:10:31.680424 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Compute_service record updated for np0000001583:np0000001583 {{(pid=98241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 02:10:31.680910 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.364s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:10:31.681306 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:10:31.702961 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:10:31.703219 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:10:31.704028 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-82d7e47d-75e0-43c0-8b4c-4a25cc2ccf55 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2 for instance 88e7dd8f-33f3-46e8-8d17-b9451bb627e5 {{(pid=98241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 02:10:31.784130 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:10:31.786095 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:10:31.804711 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:10:31.804817 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:10:31.805049 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:10:31.805269 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:10:31.805527 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:10:31.805730 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:10:31.961248 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 02:10:32.209409 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 02:10:32.209724 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Claim successful on node np0000001583
May 28 02:10:32.288334 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 02:10:32.288678 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934232.2884524, 1c600f44-79c3-4d3f-ad07-0f09ad498836 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:10:32.288836 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] VM Paused (Lifecycle Event)
May 28 02:10:32.310994 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Took 12.29 seconds to spawn the instance on the hypervisor.
May 28 02:10:32.311236 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:10:32.677020 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:10:32.677453 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:10:32.677800 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:10:32.678073 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:10:32.678318 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 02:10:32.678569 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 49.51 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:10:32.717408 np0000001583 nova-compute[98241]: INFO nova.compute.resource_tracker [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Updating resource usage from migration 131957dd-9295-4b04-9a1d-515e3dba179d
May 28 02:10:32.756186 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-bb38ccd7-44dc-48ae-a92e-ca9f2a97577a req-b1a474da-009c-496d-9991-ab87d490bec5 service nova] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Received event network-vif-plugged-297624aa-10d3-472b-99eb-50d74b733edc {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:10:32.756709 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bb38ccd7-44dc-48ae-a92e-ca9f2a97577a req-b1a474da-009c-496d-9991-ab87d490bec5 service nova] Acquiring lock "1c600f44-79c3-4d3f-ad07-0f09ad498836-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:10:32.756984 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bb38ccd7-44dc-48ae-a92e-ca9f2a97577a req-b1a474da-009c-496d-9991-ab87d490bec5 service nova] Lock "1c600f44-79c3-4d3f-ad07-0f09ad498836-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:10:32.757440 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-bb38ccd7-44dc-48ae-a92e-ca9f2a97577a req-b1a474da-009c-496d-9991-ab87d490bec5 service nova] Lock "1c600f44-79c3-4d3f-ad07-0f09ad498836-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:10:32.757672 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-bb38ccd7-44dc-48ae-a92e-ca9f2a97577a req-b1a474da-009c-496d-9991-ab87d490bec5 service nova] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] No waiting events found dispatching network-vif-plugged-297624aa-10d3-472b-99eb-50d74b733edc {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:10:32.757963 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-bb38ccd7-44dc-48ae-a92e-ca9f2a97577a req-b1a474da-009c-496d-9991-ab87d490bec5 service nova] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Received unexpected event network-vif-plugged-297624aa-10d3-472b-99eb-50d74b733edc for instance with vm_state active and task_state None.
May 28 02:10:32.794064 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:10:32.799895 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934232.7992275, 1c600f44-79c3-4d3f-ad07-0f09ad498836 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:10:32.800025 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] VM Resumed (Lifecycle Event)
May 28 02:10:32.831336 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Took 19.64 seconds to build instance.
May 28 02:10:32.845814 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:32.985716 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Found WWN 3300000003bba159e for multipath device dm-9 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 02:10:32.985993 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:10:32.986271 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] <== connect_volume: return (3494ms) {'type': 'block', 'scsi_wwn': '3300000003bba159e', 'path': '/dev/dm-9', 'multipath_id': '3300000003bba159e'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:10:32.986408 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000003bba159e', 'path': '/dev/dm-9', 'multipath_id': '3300000003bba159e'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 02:10:32.990997 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lazy-loading 'flavor' on Instance uuid 2e42be01-bc16-4fa6-9a95-698204b5e592 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:10:33.067112 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:10:33.067352 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:10:33.305340 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:10:33.313819 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:10:33.337129 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "1c600f44-79c3-4d3f-ad07-0f09ad498836" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.157s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:10:33.493670 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Attempting to attach volume f4addb7d-0ef0-476c-aecf-4d36ab500da2 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98241) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 02:10:33.495002 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] attach device xml: <disk type="block" device="disk">
May 28 02:10:33.495002 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:10:33.495002 np0000001583 nova-compute[98241]:   <alias name="ua-f4addb7d-0ef0-476c-aecf-4d36ab500da2"/>
May 28 02:10:33.495002 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-9"/>
May 28 02:10:33.495002 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:10:33.495002 np0000001583 nova-compute[98241]:   <serial>f4addb7d-0ef0-476c-aecf-4d36ab500da2</serial>
May 28 02:10:33.495002 np0000001583 nova-compute[98241]: </disk>
May 28 02:10:33.495002 np0000001583 nova-compute[98241]:  {{(pid=98241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 02:10:33.570109 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:10:33.611778 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:33.671224 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b8d566b3-4d3b-4aff-8a84-df703a6ecd11 req-b3869dd1-c0ee-4cd5-a898-d478c57d3670 service nova] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Received event network-changed-297624aa-10d3-472b-99eb-50d74b733edc {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:10:33.671728 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b8d566b3-4d3b-4aff-8a84-df703a6ecd11 req-b3869dd1-c0ee-4cd5-a898-d478c57d3670 service nova] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Refreshing instance network info cache due to event network-changed-297624aa-10d3-472b-99eb-50d74b733edc. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:10:33.671966 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b8d566b3-4d3b-4aff-8a84-df703a6ecd11 req-b3869dd1-c0ee-4cd5-a898-d478c57d3670 service nova] Acquiring lock "refresh_cache-1c600f44-79c3-4d3f-ad07-0f09ad498836" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:10:33.672133 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b8d566b3-4d3b-4aff-8a84-df703a6ecd11 req-b3869dd1-c0ee-4cd5-a898-d478c57d3670 service nova] Acquired lock "refresh_cache-1c600f44-79c3-4d3f-ad07-0f09ad498836" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:10:33.672420 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-b8d566b3-4d3b-4aff-8a84-df703a6ecd11 req-b3869dd1-c0ee-4cd5-a898-d478c57d3670 service nova] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Refreshing network info cache for port 297624aa-10d3-472b-99eb-50d74b733edc {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:10:33.819865 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Received event <DeviceRemovedEvent: 1779934233.8186464, 88e7dd8f-33f3-46e8-8d17-b9451bb627e5 => ua-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2> from libvirt while the driver is waiting for it; dispatched. {{(pid=98241) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 02:10:33.821863 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-82d7e47d-75e0-43c0-8b4c-4a25cc2ccf55 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Successfully detached device vdb from instance 88e7dd8f-33f3-46e8-8d17-b9451bb627e5 from the live domain config.
May 28 02:10:33.823039 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82d7e47d-75e0-43c0-8b4c-4a25cc2ccf55 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:10:33.823375 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d7e47d-75e0-43c0-8b4c-4a25cc2ccf55 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2', 'iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:10:33.823500 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-82d7e47d-75e0-43c0-8b4c-4a25cc2ccf55 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:10:33.823828 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-82d7e47d-75e0-43c0-8b4c-4a25cc2ccf55 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:10:33.824141 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d7e47d-75e0-43c0-8b4c-4a25cc2ccf55 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2', 'iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:10:33.824250 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d7e47d-75e0-43c0-8b4c-4a25cc2ccf55 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:10:33.854676 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d7e47d-75e0-43c0-8b4c-4a25cc2ccf55 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:33.854676 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:33.854676 np0000001583 nova-compute[98241]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:33.854676 np0000001583 nova-compute[98241]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:33.854676 np0000001583 nova-compute[98241]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2 (non-flash)
May 28 02:10:33.854676 np0000001583 nova-compute[98241]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2 (non-flash)
May 28 02:10:33.854676 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:33.854676 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:33.854676 np0000001583 nova-compute[98241]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2 (non-flash)
May 28 02:10:33.854676 np0000001583 nova-compute[98241]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2 (non-flash)
May 28 02:10:33.854676 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:10:33.855193 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d7e47d-75e0-43c0-8b4c-4a25cc2ccf55 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:33.855193 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:33.855193 np0000001583 nova-compute[98241]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:33.855193 np0000001583 nova-compute[98241]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:33.855193 np0000001583 nova-compute[98241]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2 (non-flash)
May 28 02:10:33.855193 np0000001583 nova-compute[98241]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2 (non-flash)
May 28 02:10:33.855193 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:33.855193 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:33.855193 np0000001583 nova-compute[98241]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2 (non-flash)
May 28 02:10:33.855193 np0000001583 nova-compute[98241]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2 (non-flash)
May 28 02:10:33.855193 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:10:33.855193 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d7e47d-75e0-43c0-8b4c-4a25cc2ccf55 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb', '181'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb', '182'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', '190'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', '191'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2', '192'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2', '193'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0', '194'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0', '195'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2', '198'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2', '199')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:10:33.855626 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d7e47d-75e0-43c0-8b4c-4a25cc2ccf55 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2', '193')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:10:33.856695 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d7e47d-75e0-43c0-8b4c-4a25cc2ccf55 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2', '192')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:10:33.857822 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d7e47d-75e0-43c0-8b4c-4a25cc2ccf55 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f82e8ea0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2'): ({'sde'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:10:33.858045 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-82d7e47d-75e0-43c0-8b4c-4a25cc2ccf55 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Removing multipathed devices sdf, sde {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:10:33.858663 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-82d7e47d-75e0-43c0-8b4c-4a25cc2ccf55 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Flush multipath device 330000000a89b792a {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:10:33.894687 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-82d7e47d-75e0-43c0-8b4c-4a25cc2ccf55 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:10:33.946786 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-82d7e47d-75e0-43c0-8b4c-4a25cc2ccf55 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:10:33.985567 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-82d7e47d-75e0-43c0-8b4c-4a25cc2ccf55 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Checking to see if SCSI volumes sdf, sde have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:10:33.985705 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-82d7e47d-75e0-43c0-8b4c-4a25cc2ccf55 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] SCSI volumes sdf, sde have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:10:33.986856 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-82d7e47d-75e0-43c0-8b4c-4a25cc2ccf55 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Checking to see if device paths {'sdf', 'sde'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:10:33.998989 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-82d7e47d-75e0-43c0-8b4c-4a25cc2ccf55 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Device paths {'sdf', 'sde'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:10:33.998989 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d7e47d-75e0-43c0-8b4c-4a25cc2ccf55 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:10:34.010944 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d7e47d-75e0-43c0-8b4c-4a25cc2ccf55 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:34.047381 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d7e47d-75e0-43c0-8b4c-4a25cc2ccf55 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 193, target: iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2, portal: 192.168.40.100,3260]
May 28 02:10:34.047381 np0000001583 nova-compute[98241]: Logout of [sid: 193, target: iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2, portal: 192.168.40.100,3260] successful.
May 28 02:10:34.047381 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:34.071034 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d7e47d-75e0-43c0-8b4c-4a25cc2ccf55 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:34.078368 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.375s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:10:34.078563 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Migrating
May 28 02:10:34.078830 np0000001583 nova-compute[98241]: DEBUG nova.compute.rpcapi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98241) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 02:10:34.086691 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d7e47d-75e0-43c0-8b4c-4a25cc2ccf55 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:34.128040 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d7e47d-75e0-43c0-8b4c-4a25cc2ccf55 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 192, target: iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2, portal: 192.168.50.100,3260]
May 28 02:10:34.128040 np0000001583 nova-compute[98241]: Logout of [sid: 192, target: iqn.2023-03.storpool.com:os--volume-d0f9cee1-e0f7-46af-85b5-ef8b3e0c24a2, portal: 192.168.50.100,3260] successful.
May 28 02:10:34.128040 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:34.145416 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d7e47d-75e0-43c0-8b4c-4a25cc2ccf55 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:34.145706 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-82d7e47d-75e0-43c0-8b4c-4a25cc2ccf55 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:10:34.145878 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d7e47d-75e0-43c0-8b4c-4a25cc2ccf55 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] <== disconnect_volume: return (322ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:10:34.146046 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82d7e47d-75e0-43c0-8b4c-4a25cc2ccf55 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:10:34.175758 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-b8d566b3-4d3b-4aff-8a84-df703a6ecd11 req-b3869dd1-c0ee-4cd5-a898-d478c57d3670 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:10:34.515553 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-b8d566b3-4d3b-4aff-8a84-df703a6ecd11 req-b3869dd1-c0ee-4cd5-a898-d478c57d3670 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:10:34.597686 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "refresh_cache-5f8cf96c-2c00-493d-afe2-2ea77a834767" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:10:34.597880 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquired lock "refresh_cache-5f8cf96c-2c00-493d-afe2-2ea77a834767" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:10:34.598154 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:10:34.681276 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-b8d566b3-4d3b-4aff-8a84-df703a6ecd11 req-b3869dd1-c0ee-4cd5-a898-d478c57d3670 service nova] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Updated VIF entry in instance network info cache for port 297624aa-10d3-472b-99eb-50d74b733edc. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:10:34.681585 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-b8d566b3-4d3b-4aff-8a84-df703a6ecd11 req-b3869dd1-c0ee-4cd5-a898-d478c57d3670 service nova] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Updating instance_info_cache with network_info: [{"id": "297624aa-10d3-472b-99eb-50d74b733edc", "address": "fa:16:3e:ef:e0:2d", "network": {"id": "a349b3ac-cae9-4909-b273-8409a97fbe5c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-810622904-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60b5c56c77c64b318056094f7fa5861d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap297624aa-10", "ovs_interfaceid": "297624aa-10d3-472b-99eb-50d74b733edc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:10:34.707894 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-82d7e47d-75e0-43c0-8b4c-4a25cc2ccf55 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lazy-loading 'flavor' on Instance uuid 88e7dd8f-33f3-46e8-8d17-b9451bb627e5 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:10:35.100326 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:10:35.149944 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:10:35.150105 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:10:35.150209 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:10:35.150335 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] No VIF found with MAC fa:16:3e:32:79:c4, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:10:35.184283 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b8d566b3-4d3b-4aff-8a84-df703a6ecd11 req-b3869dd1-c0ee-4cd5-a898-d478c57d3670 service nova] Releasing lock "refresh_cache-1c600f44-79c3-4d3f-ad07-0f09ad498836" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:10:35.407384 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:10:35.564145 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Updating instance_info_cache with network_info: [{"id": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "address": "fa:16:3e:1d:39:9a", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe49fa27-da", "ovs_interfaceid": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:10:35.719431 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-82d7e47d-75e0-43c0-8b4c-4a25cc2ccf55 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.118s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:10:36.066013 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Releasing lock "refresh_cache-5f8cf96c-2c00-493d-afe2-2ea77a834767" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:10:36.695463 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9b7fbedd-dc1c-4393-b853-f25e153aae4b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "2e42be01-bc16-4fa6-9a95-698204b5e592" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.898s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:10:37.132655 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Acquiring lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:10:37.132655 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:10:37.578616 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Starting migrate_disk_and_power_off {{(pid=98241) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 28 02:10:37.598361 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:37.603235 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:37.622098 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:37.626984 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:37.636824 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lazy-loading 'flavor' on Instance uuid 88e7dd8f-33f3-46e8-8d17-b9451bb627e5 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:10:37.652462 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:37.768908 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9f5ea534-8669-4186-b729-8e89aefef777 req-c66f54ed-1918-4f65-bba2-d3ae9162b524 service nova] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Received event network-vif-unplugged-fe49fa27-da6a-4d8f-ab1e-bb280d24658c {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:10:37.769344 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9f5ea534-8669-4186-b729-8e89aefef777 req-c66f54ed-1918-4f65-bba2-d3ae9162b524 service nova] Acquiring lock "5f8cf96c-2c00-493d-afe2-2ea77a834767-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:10:37.769344 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9f5ea534-8669-4186-b729-8e89aefef777 req-c66f54ed-1918-4f65-bba2-d3ae9162b524 service nova] Lock "5f8cf96c-2c00-493d-afe2-2ea77a834767-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:10:37.769460 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9f5ea534-8669-4186-b729-8e89aefef777 req-c66f54ed-1918-4f65-bba2-d3ae9162b524 service nova] Lock "5f8cf96c-2c00-493d-afe2-2ea77a834767-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:10:37.769494 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9f5ea534-8669-4186-b729-8e89aefef777 req-c66f54ed-1918-4f65-bba2-d3ae9162b524 service nova] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] No waiting events found dispatching network-vif-unplugged-fe49fa27-da6a-4d8f-ab1e-bb280d24658c {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:10:37.769608 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-9f5ea534-8669-4186-b729-8e89aefef777 req-c66f54ed-1918-4f65-bba2-d3ae9162b524 service nova] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Received unexpected event network-vif-unplugged-fe49fa27-da6a-4d8f-ab1e-bb280d24658c for instance with vm_state active and task_state resize_migrating.
May 28 02:10:37.842164 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:37.847102 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:37.870119 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:37.877368 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:37.901497 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999722115000168 future=<Future at 0x7724ec070380 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:10:37.901820 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999411938000321 future=<Future at 0x7724ec070380 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:10:37.901868 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999315304999982 future=<Future at 0x7724ec070380 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:10:37.903822 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Instance destroyed successfully.
May 28 02:10:37.904206 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T02:09:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1932077210',display_name='tempest-TestEncryptedCinderVolumes-server-1932077210',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testencryptedcindervolumes-server-1932077210',id=73,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBun1fK3bqFH0DwFCe64dJxsemPDLJQjBBUXpAYHHMZ5VrGdrQWiAi1CAoY21xUJOnjgSHF/PvTCHsItl5nChH/jKvFpUNNLQ2Rj7QdmnLJ1lKVepbjJh5mCh3vTGal8fA==',key_name='tempest-keypair-1273682795',keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:09:36Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(13),node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d192b18567fd4735988dd19da06fb868',ramdisk_id='',reservation_id='r-w015fch7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-TestEncryptedCinderVolumes-243696963',owner_user_name='tempest-TestEncryptedCinderVolumes-243696963-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:10:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f09c9f1da7e4d32979e47c96d41ae99',uuid=5f8cf96c-2c00-493d-afe2-2ea77a834767,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "address": "fa:16:3e:1d:39:9a", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.212", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "vif_mac": "fa:16:3e:1d:39:9a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe49fa27-da", "ovs_interfaceid": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:10:37.904365 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Converting VIF {"id": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "address": "fa:16:3e:1d:39:9a", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.212", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "vif_mac": "fa:16:3e:1d:39:9a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe49fa27-da", "ovs_interfaceid": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:10:37.905104 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:39:9a,bridge_name='br-int',has_traffic_filtering=True,id=fe49fa27-da6a-4d8f-ab1e-bb280d24658c,network=Network(fccbc55c-a449-42c3-bf68-d3d337f7b0ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe49fa27-da') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:10:37.905229 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:39:9a,bridge_name='br-int',has_traffic_filtering=True,id=fe49fa27-da6a-4d8f-ab1e-bb280d24658c,network=Network(fccbc55c-a449-42c3-bf68-d3d337f7b0ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe49fa27-da') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:10:37.906906 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:37.907128 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe49fa27-da, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:10:37.908506 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:37.909727 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:10:37.909979 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:37.910580 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:37.910703 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c3d4808d-7dd4-43b7-98a8-1f863c6a4b85) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:10:37.911698 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:37.912641 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:10:37.915179 np0000001583 nova-compute[98241]: INFO os_vif [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:39:9a,bridge_name='br-int',has_traffic_filtering=True,id=fe49fa27-da6a-4d8f-ab1e-bb280d24658c,network=Network(fccbc55c-a449-42c3-bf68-d3d337f7b0ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe49fa27-da')
May 28 02:10:37.917634 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:10:37.920096 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2ca44659-a2eb-4952-8736-4ccf8052ec61', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:10:37.920096 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:10:37.920096 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:10:37.920096 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2ca44659-a2eb-4952-8736-4ccf8052ec61', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:10:37.920096 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:10:37.947334 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:37.947334 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:37.947334 np0000001583 nova-compute[98241]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:37.947334 np0000001583 nova-compute[98241]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:37.947334 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:37.947334 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:37.947334 np0000001583 nova-compute[98241]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2 (non-flash)
May 28 02:10:37.947334 np0000001583 nova-compute[98241]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2 (non-flash)
May 28 02:10:37.947334 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:10:37.947664 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:37.947664 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:37.947664 np0000001583 nova-compute[98241]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:37.947664 np0000001583 nova-compute[98241]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:37.947664 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:37.947664 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:37.947664 np0000001583 nova-compute[98241]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2 (non-flash)
May 28 02:10:37.947664 np0000001583 nova-compute[98241]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2 (non-flash)
May 28 02:10:37.947664 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:10:37.947664 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb', '181'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb', '182'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', '190'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', '191'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0', '194'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0', '195'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2', '198'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2', '199')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:10:37.947664 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', '190')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:10:37.948665 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', '191')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:10:37.949395 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f82aa340>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61'): ({'sdc'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:10:37.949626 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Removing multipathed devices sdc, sdb {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:10:37.949823 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Flush multipath device 3300000002d77a713 {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:10:37.983783 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:10:38.026370 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:10:38.071093 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:10:38.071234 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:10:38.072982 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:10:38.085787 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:10:38.085956 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:10:38.097619 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:38.139104 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 190, target: iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61, portal: 192.168.40.100,3260]
May 28 02:10:38.139104 np0000001583 nova-compute[98241]: Logout of [sid: 190, target: iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61, portal: 192.168.40.100,3260] successful.
May 28 02:10:38.139104 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:38.159157 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:38.171287 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:38.210355 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 191, target: iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61, portal: 192.168.50.100,3260]
May 28 02:10:38.210355 np0000001583 nova-compute[98241]: Logout of [sid: 191, target: iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61, portal: 192.168.50.100,3260] successful.
May 28 02:10:38.210355 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:38.226853 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:38.228147 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:10:38.228697 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] <== disconnect_volume: return (310ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:10:38.228697 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:10:38.234938 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:10:38.334751 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:10:38.334948 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:10:38.438110 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:10:38.438110 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] skipping disk /dev/disk/by-id/os-brick+dev+dm-0 (vdb) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 02:10:38.438110 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767_resize/disk /opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767/disk {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:10:38.558879 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] CMD "cp -r /opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767_resize/disk /opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767/disk" returned: 0 in 0.121s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:10:38.559350 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767_resize/disk.config /opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767/disk.config {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:10:38.604485 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] CMD "cp -r /opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767_resize/disk.config /opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767/disk.config" returned: 0 in 0.045s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:10:38.604992 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767_resize/disk.info /opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767/disk.info {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:10:38.622351 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:38.650182 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.519s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:10:38.659917 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] CMD "cp -r /opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767_resize/disk.info /opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767/disk.info" returned: 0 in 0.055s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:10:39.702391 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Acquiring lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:10:39.707256 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:10:39.707256 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Attaching volume 0388423c-1a4a-42db-9584-326075201643 to /dev/vdb
May 28 02:10:39.765506 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:10:39.765846 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:10:39.774733 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:10:39.788981 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 02:10:39.818936 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:10:39.847851 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Port fe49fa27-da6a-4d8f-ab1e-bb280d24658c binding to destination host np0000001583 is already ACTIVE {{(pid=98241) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 28 02:10:39.861862 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-95c0394a-9dee-4bad-8d0b-64b060cc45fd req-ed56b50b-2698-4759-9376-a0a4128d4077 service nova] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Received event network-vif-unplugged-fe49fa27-da6a-4d8f-ab1e-bb280d24658c {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:10:39.862254 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-95c0394a-9dee-4bad-8d0b-64b060cc45fd req-ed56b50b-2698-4759-9376-a0a4128d4077 service nova] Acquiring lock "5f8cf96c-2c00-493d-afe2-2ea77a834767-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:10:39.862676 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-95c0394a-9dee-4bad-8d0b-64b060cc45fd req-ed56b50b-2698-4759-9376-a0a4128d4077 service nova] Lock "5f8cf96c-2c00-493d-afe2-2ea77a834767-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:10:39.863518 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-95c0394a-9dee-4bad-8d0b-64b060cc45fd req-ed56b50b-2698-4759-9376-a0a4128d4077 service nova] Lock "5f8cf96c-2c00-493d-afe2-2ea77a834767-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:10:39.863518 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-95c0394a-9dee-4bad-8d0b-64b060cc45fd req-ed56b50b-2698-4759-9376-a0a4128d4077 service nova] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] No waiting events found dispatching network-vif-unplugged-fe49fa27-da6a-4d8f-ab1e-bb280d24658c {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:10:39.863518 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-95c0394a-9dee-4bad-8d0b-64b060cc45fd req-ed56b50b-2698-4759-9376-a0a4128d4077 service nova] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Received unexpected event network-vif-unplugged-fe49fa27-da6a-4d8f-ab1e-bb280d24658c for instance with vm_state active and task_state resize_migrating.
May 28 02:10:39.873885 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 02:10:39.874110 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 02:10:39.884153 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 02:10:39.885129 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe28:6dad', 'fe80::98c1:6bff:fe22:4140', 'fe80::fc16:3eff:fee4:704e', 'fe80::d4e0:76ff:fe99:10f4', 'fe80::fc16:3eff:fe32:79c4', 'fe80::2c76:91ff:fee7:3598', 'fe80::fc16:3eff:feef:e02d'] 
May 28 02:10:39.885244 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 02:10:39.885366 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 02:10:39.885584 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:10:39.886093 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Updating existing volume attachment record: 7322c354-3b6f-423f-bf36-03d28ce942b4 {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 02:10:40.445484 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 02:10:40.445870 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643', 'iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0388423c-1a4a-42db-9584-326075201643', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:10:40.446023 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:10:40.446430 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:10:40.446638 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643', 'iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0388423c-1a4a-42db-9584-326075201643', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 02:10:40.459748 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:10:40.460534 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:10:40.461019 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:10:40.461252 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:10:40.461653 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:10:40.461813 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:10:40.474581 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:10:40.474581 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:40.481474 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:10:40.481474 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:40.488687 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643] added
May 28 02:10:40.488687 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:10:40.488687 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:10:40.488687 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:10:40.488687 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:10:40.488687 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:10:40.488687 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:40.488687 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:10:40.488891 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0277(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:10:40.489045 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:10:40.495246 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643] added
May 28 02:10:40.495246 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:10:40.495246 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:10:40.495246 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:10:40.495246 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:10:40.495246 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:10:40.495246 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:40.495460 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:10:40.495614 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0337(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:10:40.495791 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:10:40.871306 np0000001583 nova-compute[98241]: DEBUG nova.compute.rpcapi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98241) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 02:10:40.880296 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "5f8cf96c-2c00-493d-afe2-2ea77a834767-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:10:40.880577 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "5f8cf96c-2c00-493d-afe2-2ea77a834767-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:10:40.880776 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "5f8cf96c-2c00-493d-afe2-2ea77a834767-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:10:41.489469 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:10:41.496320 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:10:41.502793 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:10:41.502793 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:10:41.509121 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:10:41.509121 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:41.514820 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:41.522557 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:41.529323 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:41.529323 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:41.529323 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:41.529323 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:41.529323 np0000001583 nova-compute[98241]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2 (non-flash)
May 28 02:10:41.529323 np0000001583 nova-compute[98241]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2 (non-flash)
May 28 02:10:41.529323 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:10:41.529510 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:41.529510 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:41.529510 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:41.529510 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:41.529510 np0000001583 nova-compute[98241]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2 (non-flash)
May 28 02:10:41.529510 np0000001583 nova-compute[98241]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2 (non-flash)
May 28 02:10:41.529510 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:10:41.537147 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:41.537147 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:41.537147 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:41.537147 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:41.537147 np0000001583 nova-compute[98241]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2 (non-flash)
May 28 02:10:41.537147 np0000001583 nova-compute[98241]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2 (non-flash)
May 28 02:10:41.537147 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:10:41.537349 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:41.537349 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:41.537349 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:41.537349 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:41.537349 np0000001583 nova-compute[98241]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2 (non-flash)
May 28 02:10:41.537349 np0000001583 nova-compute[98241]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2 (non-flash)
May 28 02:10:41.537349 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:10:41.566455 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643, portal: 192.168.40.100,3260]
May 28 02:10:41.566455 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643, portal: 192.168.40.100,3260] successful.
May 28 02:10:41.566455 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:41.581463 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:41.594456 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643, portal: 192.168.50.100,3260]
May 28 02:10:41.594456 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643, portal: 192.168.50.100,3260] successful.
May 28 02:10:41.594456 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:41.599058 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:41.599058 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:41.599058 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:41.599058 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:41.599058 np0000001583 nova-compute[98241]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2 (non-flash)
May 28 02:10:41.599058 np0000001583 nova-compute[98241]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2 (non-flash)
May 28 02:10:41.599058 np0000001583 nova-compute[98241]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643 (non-flash)
May 28 02:10:41.599058 np0000001583 nova-compute[98241]: tcp: [201] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643 (non-flash)
May 28 02:10:41.599058 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:10:41.599267 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:41.599267 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:41.599267 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:41.599267 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:41.599267 np0000001583 nova-compute[98241]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2 (non-flash)
May 28 02:10:41.599267 np0000001583 nova-compute[98241]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2 (non-flash)
May 28 02:10:41.599267 np0000001583 nova-compute[98241]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643 (non-flash)
May 28 02:10:41.599267 np0000001583 nova-compute[98241]: tcp: [201] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643 (non-flash)
May 28 02:10:41.599267 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:10:41.599540 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.139s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:10:41.599650 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:10:41.603493 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] HCTL ('7', '-', '-', 0) found on session 200 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:10:41.603608 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:10:41.608534 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:41.621214 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Searching for a device in session 200 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:10:41.621214 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0388423c-1a4a-42db-9584-326075201643', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:10:41.629142 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:41.629142 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:41.629142 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:41.629142 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:41.629142 np0000001583 nova-compute[98241]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2 (non-flash)
May 28 02:10:41.629142 np0000001583 nova-compute[98241]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2 (non-flash)
May 28 02:10:41.629142 np0000001583 nova-compute[98241]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643 (non-flash)
May 28 02:10:41.629142 np0000001583 nova-compute[98241]: tcp: [201] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643 (non-flash)
May 28 02:10:41.629142 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:10:41.629142 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:41.629142 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:41.629142 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:41.629142 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:41.629142 np0000001583 nova-compute[98241]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2 (non-flash)
May 28 02:10:41.629142 np0000001583 nova-compute[98241]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2 (non-flash)
May 28 02:10:41.629142 np0000001583 nova-compute[98241]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643 (non-flash)
May 28 02:10:41.629142 np0000001583 nova-compute[98241]: tcp: [201] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643 (non-flash)
May 28 02:10:41.629142 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:10:41.629578 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.168s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:10:41.629578 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:10:41.630230 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] HCTL ('8', '-', '-', 0) found on session 201 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:10:41.630279 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:10:41.646778 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Searching for a device in session 201 and hctl ['8', '*', '*', 0] yield: None {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:10:41.892270 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:10:41.947287 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "refresh_cache-5f8cf96c-2c00-493d-afe2-2ea77a834767" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:10:41.947431 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquired lock "refresh_cache-5f8cf96c-2c00-493d-afe2-2ea77a834767" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:10:41.947540 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:10:42.451690 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:10:42.647376 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Searching for a device in session 201 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:10:42.647555 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0388423c-1a4a-42db-9584-326075201643', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:10:42.730264 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:10:42.877474 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Updating instance_info_cache with network_info: [{"id": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "address": "fa:16:3e:1d:39:9a", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe49fa27-da", "ovs_interfaceid": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:10:42.911621 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:43.379405 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Releasing lock "refresh_cache-5f8cf96c-2c00-493d-afe2-2ea77a834767" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:10:43.479935 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Found WWN 330000000e6212d4c for multipath device dm-0 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 02:10:43.480215 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:10:43.480375 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] <== connect_volume: return (3034ms) {'type': 'block', 'scsi_wwn': '330000000e6212d4c', 'path': '/dev/dm-0', 'multipath_id': '330000000e6212d4c'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:10:43.480491 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e6212d4c', 'path': '/dev/dm-0', 'multipath_id': '330000000e6212d4c'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 02:10:43.483450 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lazy-loading 'flavor' on Instance uuid 88e7dd8f-33f3-46e8-8d17-b9451bb627e5 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:10:43.616935 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:43.887643 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:10:43.899532 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 02:10:43.922527 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:10:43.967631 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 02:10:43.967976 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 02:10:43.977541 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 02:10:43.978603 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe28:6dad', 'fe80::98c1:6bff:fe22:4140', 'fe80::fc16:3eff:fee4:704e', 'fe80::d4e0:76ff:fe99:10f4', 'fe80::fc16:3eff:fe32:79c4', 'fe80::2c76:91ff:fee7:3598', 'fe80::fc16:3eff:feef:e02d'] 
May 28 02:10:43.978733 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 02:10:43.978831 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 02:10:43.979036 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] <== get_connector_properties: return (91ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:10:43.987306 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Attempting to attach volume 0388423c-1a4a-42db-9584-326075201643 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98241) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 02:10:43.996930 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] attach device xml: <disk type="block" device="disk">
May 28 02:10:43.996930 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:10:43.996930 np0000001583 nova-compute[98241]:   <alias name="ua-0388423c-1a4a-42db-9584-326075201643"/>
May 28 02:10:43.996930 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-0"/>
May 28 02:10:43.996930 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:10:43.996930 np0000001583 nova-compute[98241]:   <serial>0388423c-1a4a-42db-9584-326075201643</serial>
May 28 02:10:43.996930 np0000001583 nova-compute[98241]: </disk>
May 28 02:10:43.996930 np0000001583 nova-compute[98241]:  {{(pid=98241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 02:10:44.446583 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b7f050a0-11be-4038-a210-f056f5909992 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Acquiring lock "2e42be01-bc16-4fa6-9a95-698204b5e592" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:10:44.446842 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b7f050a0-11be-4038-a210-f056f5909992 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "2e42be01-bc16-4fa6-9a95-698204b5e592" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:10:44.533713 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-201bf4c6-f98e-40e3-b59c-4c1d0e8b16c7 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Acquiring lock "2e42be01-bc16-4fa6-9a95-698204b5e592" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:10:44.949329 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-b7f050a0-11be-4038-a210-f056f5909992 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Detaching volume f4addb7d-0ef0-476c-aecf-4d36ab500da2
May 28 02:10:44.988543 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-b7f050a0-11be-4038-a210-f056f5909992 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Attempting to driver detach volume f4addb7d-0ef0-476c-aecf-4d36ab500da2 from mountpoint /dev/vdb
May 28 02:10:44.993046 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b7f050a0-11be-4038-a210-f056f5909992 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Found disk vdb by alias ua-f4addb7d-0ef0-476c-aecf-4d36ab500da2 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:10:44.994194 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b7f050a0-11be-4038-a210-f056f5909992 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Found disk vdb by alias ua-f4addb7d-0ef0-476c-aecf-4d36ab500da2 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:10:44.994327 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b7f050a0-11be-4038-a210-f056f5909992 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Attempting to detach device vdb from instance 2e42be01-bc16-4fa6-9a95-698204b5e592 from the persistent domain config. {{(pid=98241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 02:10:44.994520 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-b7f050a0-11be-4038-a210-f056f5909992 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:10:44.994520 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:10:44.994520 np0000001583 nova-compute[98241]:   <alias name="ua-f4addb7d-0ef0-476c-aecf-4d36ab500da2"/>
May 28 02:10:44.994520 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-9"/>
May 28 02:10:44.994520 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:10:44.994520 np0000001583 nova-compute[98241]:   <serial>f4addb7d-0ef0-476c-aecf-4d36ab500da2</serial>
May 28 02:10:44.994520 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 02:10:44.994520 np0000001583 nova-compute[98241]: </disk>
May 28 02:10:44.994520 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:10:45.000625 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-b7f050a0-11be-4038-a210-f056f5909992 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Successfully detached device vdb from instance 2e42be01-bc16-4fa6-9a95-698204b5e592 from the persistent domain config.
May 28 02:10:45.000774 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b7f050a0-11be-4038-a210-f056f5909992 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] (1/8): Attempting to detach device vdb with device alias ua-f4addb7d-0ef0-476c-aecf-4d36ab500da2 from instance 2e42be01-bc16-4fa6-9a95-698204b5e592 from the live domain config. {{(pid=98241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 02:10:45.001008 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-b7f050a0-11be-4038-a210-f056f5909992 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:10:45.001008 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:10:45.001008 np0000001583 nova-compute[98241]:   <alias name="ua-f4addb7d-0ef0-476c-aecf-4d36ab500da2"/>
May 28 02:10:45.001008 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-9"/>
May 28 02:10:45.001008 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:10:45.001008 np0000001583 nova-compute[98241]:   <serial>f4addb7d-0ef0-476c-aecf-4d36ab500da2</serial>
May 28 02:10:45.001008 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 02:10:45.001008 np0000001583 nova-compute[98241]: </disk>
May 28 02:10:45.001008 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:10:45.106092 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Starting finish_migration {{(pid=98241) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 28 02:10:45.107251 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Instance directory exists: not creating {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 02:10:45.107358 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Creating image(s)
May 28 02:10:45.108238 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:10:45.196023 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.088s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:10:45.196508 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 02:10:45.196745 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:10:45.289107 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:10:45.289739 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Cannot resize image /opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 02:10:45.514297 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Received event <DeviceRemovedEvent: 1779934245.5138445, 2e42be01-bc16-4fa6-9a95-698204b5e592 => ua-f4addb7d-0ef0-476c-aecf-4d36ab500da2> from libvirt while the driver is waiting for it; dispatched. {{(pid=98241) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 02:10:45.514785 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b7f050a0-11be-4038-a210-f056f5909992 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-f4addb7d-0ef0-476c-aecf-4d36ab500da2 for instance 2e42be01-bc16-4fa6-9a95-698204b5e592 {{(pid=98241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 02:10:45.517704 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-b7f050a0-11be-4038-a210-f056f5909992 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Successfully detached device vdb from instance 2e42be01-bc16-4fa6-9a95-698204b5e592 from the live domain config.
May 28 02:10:45.518954 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7f050a0-11be-4038-a210-f056f5909992 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:10:45.519498 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f050a0-11be-4038-a210-f056f5909992 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2', 'iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4addb7d-0ef0-476c-aecf-4d36ab500da2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': False}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:10:45.519746 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-b7f050a0-11be-4038-a210-f056f5909992 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:10:45.679188 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:10:45.679322 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:10:45.679546 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:10:45.679738 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] No VIF found with MAC fa:16:3e:28:6d:ad, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:10:45.793852 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Did not create local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 02:10:45.794054 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Ensure instance console log exists: /opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 02:10:45.794395 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:10:45.794602 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:10:45.794811 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:10:45.797072 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Start _get_guest_xml network_info=[{"id": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "address": "fa:16:3e:1d:39:9a", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.212", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "vif_mac": "fa:16:3e:1d:39:9a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe49fa27-da", "ovs_interfaceid": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2ca44659-a2eb-4952-8736-4ccf8052ec61', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '5f8cf96c-2c00-493d-afe2-2ea77a834767', 'attached_at': '2026-05-28T02:10:44.000000', 'detached_at': '', 'volume_id': '2ca44659-a2eb-4952-8736-4ccf8052ec61', 'serial': '2ca44659-a2eb-4952-8736-4ccf8052ec61'}, 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'attachment_id': '7c1d6699-652f-4bca-bdb6-8c911758806c', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 02:10:45.799654 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:10:45.800737 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1932077210', uuid='5f8cf96c-2c00-493d-afe2-2ea77a834767'), owner=OwnerMeta(userid='0f09c9f1da7e4d32979e47c96d41ae99', username='tempest-TestEncryptedCinderVolumes-243696963-project-member', projectid='d192b18567fd4735988dd19da06fb868', projectname='tempest-TestEncryptedCinderVolumes-243696963'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='tempest-1618752310', flavorid='0a8a1c8f-51ff-45e6-ab47-64ae96704fba', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={}, swap=0), network_info=[{"id": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "address": "fa:16:3e:1d:39:9a", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.212", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "vif_mac": "fa:16:3e:1d:39:9a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe49fa27-da", "ovs_interfaceid": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779934245.8004227) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 02:10:45.801881 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 02:10:45.802234 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 02:10:45.803148 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 02:10:45.803345 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 02:10:45.804398 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 02:10:45.804767 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:10:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={},flavorid='0a8a1c8f-51ff-45e6-ab47-64ae96704fba',id=13,is_public=True,memory_mb=192,name='tempest-1618752310',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 02:10:45.804953 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 02:10:45.805115 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 02:10:45.805304 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 02:10:45.805432 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 02:10:45.805585 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 02:10:45.805810 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 02:10:45.805929 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 02:10:45.806041 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 02:10:45.806152 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 02:10:45.806260 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 02:10:45.816354 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767/disk.config --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:10:45.906257 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767/disk.config --force-share --output=json" returned: 0 in 0.090s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:10:45.906758 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "/opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:10:45.907010 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "/opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:10:45.907607 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "/opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:10:45.908048 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 02:10:45.908448 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2ca44659-a2eb-4952-8736-4ccf8052ec61', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:10:45.908592 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:10:46.679553 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-b7f050a0-11be-4038-a210-f056f5909992 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.160s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:10:46.680054 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f050a0-11be-4038-a210-f056f5909992 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2', 'iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4addb7d-0ef0-476c-aecf-4d36ab500da2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:10:46.680255 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f050a0-11be-4038-a210-f056f5909992 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:10:46.722568 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f050a0-11be-4038-a210-f056f5909992 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:46.722568 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:46.722568 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:46.722568 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:46.722568 np0000001583 nova-compute[98241]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2 (non-flash)
May 28 02:10:46.722568 np0000001583 nova-compute[98241]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2 (non-flash)
May 28 02:10:46.722568 np0000001583 nova-compute[98241]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643 (non-flash)
May 28 02:10:46.722568 np0000001583 nova-compute[98241]: tcp: [201] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643 (non-flash)
May 28 02:10:46.722568 np0000001583 nova-compute[98241]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8208e604-df71-44a3-ae9f-ece00511dc20 (non-flash)
May 28 02:10:46.722568 np0000001583 nova-compute[98241]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8208e604-df71-44a3-ae9f-ece00511dc20 (non-flash)
May 28 02:10:46.722568 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:10:46.722990 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f050a0-11be-4038-a210-f056f5909992 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:46.722990 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:46.722990 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:46.722990 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:46.722990 np0000001583 nova-compute[98241]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2 (non-flash)
May 28 02:10:46.722990 np0000001583 nova-compute[98241]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2 (non-flash)
May 28 02:10:46.722990 np0000001583 nova-compute[98241]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643 (non-flash)
May 28 02:10:46.722990 np0000001583 nova-compute[98241]: tcp: [201] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643 (non-flash)
May 28 02:10:46.722990 np0000001583 nova-compute[98241]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8208e604-df71-44a3-ae9f-ece00511dc20 (non-flash)
May 28 02:10:46.722990 np0000001583 nova-compute[98241]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8208e604-df71-44a3-ae9f-ece00511dc20 (non-flash)
May 28 02:10:46.722990 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:10:46.723198 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f050a0-11be-4038-a210-f056f5909992 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb', '181'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb', '182'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0', '194'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0', '195'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2', '198'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2', '199'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643', '200'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643', '201'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8208e604-df71-44a3-ae9f-ece00511dc20', '202'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8208e604-df71-44a3-ae9f-ece00511dc20', '203')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:10:46.725100 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f050a0-11be-4038-a210-f056f5909992 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2', '198')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:10:46.725100 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f050a0-11be-4038-a210-f056f5909992 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2', '199')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:10:46.726000 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f050a0-11be-4038-a210-f056f5909992 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724ec1f6e80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2'): ({'sdm'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:10:46.726477 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-b7f050a0-11be-4038-a210-f056f5909992 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Removing multipathed devices sdl, sdm {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:10:46.726743 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-b7f050a0-11be-4038-a210-f056f5909992 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Flush multipath device 3300000003bba159e {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:10:46.774908 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-b7f050a0-11be-4038-a210-f056f5909992 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:10:46.816528 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-b7f050a0-11be-4038-a210-f056f5909992 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:10:46.867538 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-b7f050a0-11be-4038-a210-f056f5909992 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Checking to see if SCSI volumes sdl, sdm have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:10:46.867846 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-b7f050a0-11be-4038-a210-f056f5909992 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] SCSI volumes sdl, sdm have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:10:46.869579 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-b7f050a0-11be-4038-a210-f056f5909992 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Checking to see if device paths {'sdl', 'sdm'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:10:46.880320 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-b7f050a0-11be-4038-a210-f056f5909992 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Device paths {'sdl', 'sdm'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:10:46.880620 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f050a0-11be-4038-a210-f056f5909992 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:10:46.893512 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f050a0-11be-4038-a210-f056f5909992 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:46.933995 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f050a0-11be-4038-a210-f056f5909992 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 198, target: iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2, portal: 192.168.40.100,3260]
May 28 02:10:46.933995 np0000001583 nova-compute[98241]: Logout of [sid: 198, target: iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2, portal: 192.168.40.100,3260] successful.
May 28 02:10:46.933995 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:46.952611 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f050a0-11be-4038-a210-f056f5909992 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:46.965385 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f050a0-11be-4038-a210-f056f5909992 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:46.998998 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f050a0-11be-4038-a210-f056f5909992 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 199, target: iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2, portal: 192.168.50.100,3260]
May 28 02:10:46.998998 np0000001583 nova-compute[98241]: Logout of [sid: 199, target: iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2, portal: 192.168.50.100,3260] successful.
May 28 02:10:46.998998 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:47.016129 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f050a0-11be-4038-a210-f056f5909992 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:47.016353 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-b7f050a0-11be-4038-a210-f056f5909992 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:10:47.016474 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f050a0-11be-4038-a210-f056f5909992 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] <== disconnect_volume: return (1496ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:10:47.016615 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7f050a0-11be-4038-a210-f056f5909992 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:10:47.018552 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.110s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:10:47.018866 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2ca44659-a2eb-4952-8736-4ccf8052ec61', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 02:10:47.033708 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:10:47.034249 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:10:47.034732 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:10:47.035109 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:10:47.035267 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:10:47.035679 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:10:47.047157 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:10:47.047157 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:47.052114 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:10:47.052114 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:47.059562 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61] added
May 28 02:10:47.059562 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:10:47.059562 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:10:47.059562 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:10:47.059562 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:10:47.059562 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:10:47.059562 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:47.059851 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:10:47.059888 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0249(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:10:47.060022 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:10:47.063776 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61] added
May 28 02:10:47.063776 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:10:47.063776 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:10:47.063776 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:10:47.063776 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:10:47.063776 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:10:47.063776 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:47.063959 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:10:47.064127 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0286(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:10:47.064188 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:10:47.255793 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2c167873-6476-4ca7-bd19-a287fdb08c0f tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.550s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:10:47.572512 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-b7f050a0-11be-4038-a210-f056f5909992 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lazy-loading 'flavor' on Instance uuid 2e42be01-bc16-4fa6-9a95-698204b5e592 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:10:47.911775 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:48.060406 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:10:48.064561 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:10:48.072210 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:10:48.072210 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:10:48.078885 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:10:48.078885 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:48.086021 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:48.095699 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:48.104175 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:48.104175 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:48.104175 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:48.104175 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:48.104175 np0000001583 nova-compute[98241]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643 (non-flash)
May 28 02:10:48.104175 np0000001583 nova-compute[98241]: tcp: [201] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643 (non-flash)
May 28 02:10:48.104175 np0000001583 nova-compute[98241]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8208e604-df71-44a3-ae9f-ece00511dc20 (non-flash)
May 28 02:10:48.104175 np0000001583 nova-compute[98241]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8208e604-df71-44a3-ae9f-ece00511dc20 (non-flash)
May 28 02:10:48.104175 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:10:48.104612 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:48.104612 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:48.104612 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:48.104612 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:48.104612 np0000001583 nova-compute[98241]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643 (non-flash)
May 28 02:10:48.104612 np0000001583 nova-compute[98241]: tcp: [201] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643 (non-flash)
May 28 02:10:48.104612 np0000001583 nova-compute[98241]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8208e604-df71-44a3-ae9f-ece00511dc20 (non-flash)
May 28 02:10:48.104612 np0000001583 nova-compute[98241]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8208e604-df71-44a3-ae9f-ece00511dc20 (non-flash)
May 28 02:10:48.104612 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:10:48.111889 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:48.111889 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:48.111889 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:48.111889 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:48.111889 np0000001583 nova-compute[98241]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643 (non-flash)
May 28 02:10:48.111889 np0000001583 nova-compute[98241]: tcp: [201] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643 (non-flash)
May 28 02:10:48.111889 np0000001583 nova-compute[98241]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8208e604-df71-44a3-ae9f-ece00511dc20 (non-flash)
May 28 02:10:48.111889 np0000001583 nova-compute[98241]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8208e604-df71-44a3-ae9f-ece00511dc20 (non-flash)
May 28 02:10:48.111889 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:10:48.112426 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:48.112426 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:48.112426 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:48.112426 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:48.112426 np0000001583 nova-compute[98241]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643 (non-flash)
May 28 02:10:48.112426 np0000001583 nova-compute[98241]: tcp: [201] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643 (non-flash)
May 28 02:10:48.112426 np0000001583 nova-compute[98241]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8208e604-df71-44a3-ae9f-ece00511dc20 (non-flash)
May 28 02:10:48.112426 np0000001583 nova-compute[98241]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8208e604-df71-44a3-ae9f-ece00511dc20 (non-flash)
May 28 02:10:48.112426 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:10:48.144936 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61, portal: 192.168.40.100,3260]
May 28 02:10:48.144936 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61, portal: 192.168.40.100,3260] successful.
May 28 02:10:48.144936 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:48.156254 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:48.160975 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61, portal: 192.168.50.100,3260]
May 28 02:10:48.160975 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61, portal: 192.168.50.100,3260] successful.
May 28 02:10:48.160975 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:48.171778 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:48.171778 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:48.171778 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:48.171778 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:48.171778 np0000001583 nova-compute[98241]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643 (non-flash)
May 28 02:10:48.171778 np0000001583 nova-compute[98241]: tcp: [201] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643 (non-flash)
May 28 02:10:48.171778 np0000001583 nova-compute[98241]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8208e604-df71-44a3-ae9f-ece00511dc20 (non-flash)
May 28 02:10:48.171778 np0000001583 nova-compute[98241]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8208e604-df71-44a3-ae9f-ece00511dc20 (non-flash)
May 28 02:10:48.171778 np0000001583 nova-compute[98241]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:48.171778 np0000001583 nova-compute[98241]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:48.171778 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:10:48.172308 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:48.172308 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:48.172308 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:48.172308 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:48.172308 np0000001583 nova-compute[98241]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643 (non-flash)
May 28 02:10:48.172308 np0000001583 nova-compute[98241]: tcp: [201] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643 (non-flash)
May 28 02:10:48.172308 np0000001583 nova-compute[98241]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8208e604-df71-44a3-ae9f-ece00511dc20 (non-flash)
May 28 02:10:48.172308 np0000001583 nova-compute[98241]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8208e604-df71-44a3-ae9f-ece00511dc20 (non-flash)
May 28 02:10:48.172308 np0000001583 nova-compute[98241]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:48.172308 np0000001583 nova-compute[98241]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:48.172308 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:10:48.172308 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.138s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:10:48.172308 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:10:48.172878 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:48.174731 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] HCTL ('15', '-', '-', 0) found on session 204 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:10:48.174731 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:10:48.191556 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Searching for a device in session 204 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:10:48.191556 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2ca44659-a2eb-4952-8736-4ccf8052ec61', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:10:48.193120 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:48.193120 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:48.193120 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:48.193120 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:48.193120 np0000001583 nova-compute[98241]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643 (non-flash)
May 28 02:10:48.193120 np0000001583 nova-compute[98241]: tcp: [201] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643 (non-flash)
May 28 02:10:48.193120 np0000001583 nova-compute[98241]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8208e604-df71-44a3-ae9f-ece00511dc20 (non-flash)
May 28 02:10:48.193120 np0000001583 nova-compute[98241]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8208e604-df71-44a3-ae9f-ece00511dc20 (non-flash)
May 28 02:10:48.193120 np0000001583 nova-compute[98241]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:48.193120 np0000001583 nova-compute[98241]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:48.193120 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:10:48.193120 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:48.193120 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:48.193120 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:48.193120 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:48.193120 np0000001583 nova-compute[98241]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643 (non-flash)
May 28 02:10:48.193120 np0000001583 nova-compute[98241]: tcp: [201] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643 (non-flash)
May 28 02:10:48.193120 np0000001583 nova-compute[98241]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8208e604-df71-44a3-ae9f-ece00511dc20 (non-flash)
May 28 02:10:48.193120 np0000001583 nova-compute[98241]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8208e604-df71-44a3-ae9f-ece00511dc20 (non-flash)
May 28 02:10:48.193120 np0000001583 nova-compute[98241]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:48.193120 np0000001583 nova-compute[98241]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:48.193120 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:10:48.193120 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.158s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:10:48.193120 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:10:48.195319 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] HCTL ('16', '-', '-', 0) found on session 205 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:10:48.195319 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:10:48.210276 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Searching for a device in session 205 and hctl ['16', '*', '*', 0] yield: None {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:10:48.580218 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b7f050a0-11be-4038-a210-f056f5909992 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "2e42be01-bc16-4fa6-9a95-698204b5e592" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.133s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:10:48.580750 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-201bf4c6-f98e-40e3-b59c-4c1d0e8b16c7 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "2e42be01-bc16-4fa6-9a95-698204b5e592" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 4.047s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:10:48.581207 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-201bf4c6-f98e-40e3-b59c-4c1d0e8b16c7 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Acquiring lock "2e42be01-bc16-4fa6-9a95-698204b5e592-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:10:48.581473 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-201bf4c6-f98e-40e3-b59c-4c1d0e8b16c7 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "2e42be01-bc16-4fa6-9a95-698204b5e592-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:10:48.581676 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-201bf4c6-f98e-40e3-b59c-4c1d0e8b16c7 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "2e42be01-bc16-4fa6-9a95-698204b5e592-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:10:48.585324 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-201bf4c6-f98e-40e3-b59c-4c1d0e8b16c7 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Terminating instance
May 28 02:10:48.618486 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:49.089127 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-201bf4c6-f98e-40e3-b59c-4c1d0e8b16c7 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 02:10:49.116876 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:49.118897 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:49.139613 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:49.143473 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:49.160221 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:49.164742 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:49.212135 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Searching for a device in session 205 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:10:49.212135 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2ca44659-a2eb-4952-8736-4ccf8052ec61', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:10:49.250787 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b1a671ef-119c-498c-ab2c-d83fa0753667 req-a722f6dc-3db6-464b-b31b-85b16164b697 service nova] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Received event network-vif-unplugged-97e5b1a2-6c38-42c4-a740-4eb055fb7bb6 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:10:49.250946 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b1a671ef-119c-498c-ab2c-d83fa0753667 req-a722f6dc-3db6-464b-b31b-85b16164b697 service nova] Acquiring lock "2e42be01-bc16-4fa6-9a95-698204b5e592-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:10:49.251307 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b1a671ef-119c-498c-ab2c-d83fa0753667 req-a722f6dc-3db6-464b-b31b-85b16164b697 service nova] Lock "2e42be01-bc16-4fa6-9a95-698204b5e592-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:10:49.251476 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b1a671ef-119c-498c-ab2c-d83fa0753667 req-a722f6dc-3db6-464b-b31b-85b16164b697 service nova] Lock "2e42be01-bc16-4fa6-9a95-698204b5e592-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:10:49.251527 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b1a671ef-119c-498c-ab2c-d83fa0753667 req-a722f6dc-3db6-464b-b31b-85b16164b697 service nova] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] No waiting events found dispatching network-vif-unplugged-97e5b1a2-6c38-42c4-a740-4eb055fb7bb6 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:10:49.251632 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b1a671ef-119c-498c-ab2c-d83fa0753667 req-a722f6dc-3db6-464b-b31b-85b16164b697 service nova] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Received event network-vif-unplugged-97e5b1a2-6c38-42c4-a740-4eb055fb7bb6 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:10:49.380446 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:49.386730 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:49.412409 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999718338000093 future=<Future at 0x7724ec24b2c0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:10:49.413540 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Instance destroyed successfully.
May 28 02:10:49.413854 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-201bf4c6-f98e-40e3-b59c-4c1d0e8b16c7 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lazy-loading 'resources' on Instance uuid 2e42be01-bc16-4fa6-9a95-698204b5e592 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:10:49.916512 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-201bf4c6-f98e-40e3-b59c-4c1d0e8b16c7 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T02:09:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1158891721',display_name='tempest-VolumesSnapshotTestJSON-instance-1158891721',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-volumessnapshottestjson-instance-1158891721',id=74,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNxx9PUHaA4lcd4FwZEhZdIBGK8kWO8s3FO84I3EGjNS25jXq0dzSw2nBnLrJsGG88mX3NBcBgO8x0fBt53LyGA/3QhGyVhUAzOa1meCE/+ubzppt9X+gdBUxeLhr2Fe6g==',key_name='tempest-keypair-262036541',keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:09:58Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a20805bca06645eabf880bb71e4b69e3',ramdisk_id='',reservation_id='r-w4qrokgg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1803039293',owner_user_name='tempest-VolumesSnapshotTestJSON-1803039293-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T02:09:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6c21669663a49f39202d3ca89337d19',uuid=2e42be01-bc16-4fa6-9a95-698204b5e592,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "97e5b1a2-6c38-42c4-a740-4eb055fb7bb6", "address": "fa:16:3e:32:79:c4", "network": {"id": "ff6dd0d5-1bec-49e1-b85f-c4257cd37d52", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-230174350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a20805bca06645eabf880bb71e4b69e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap97e5b1a2-6c", "ovs_interfaceid": "97e5b1a2-6c38-42c4-a740-4eb055fb7bb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:10:49.916812 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-201bf4c6-f98e-40e3-b59c-4c1d0e8b16c7 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Converting VIF {"id": "97e5b1a2-6c38-42c4-a740-4eb055fb7bb6", "address": "fa:16:3e:32:79:c4", "network": {"id": "ff6dd0d5-1bec-49e1-b85f-c4257cd37d52", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-230174350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a20805bca06645eabf880bb71e4b69e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap97e5b1a2-6c", "ovs_interfaceid": "97e5b1a2-6c38-42c4-a740-4eb055fb7bb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:10:49.917746 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-201bf4c6-f98e-40e3-b59c-4c1d0e8b16c7 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:79:c4,bridge_name='br-int',has_traffic_filtering=True,id=97e5b1a2-6c38-42c4-a740-4eb055fb7bb6,network=Network(ff6dd0d5-1bec-49e1-b85f-c4257cd37d52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97e5b1a2-6c') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:10:49.918088 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-201bf4c6-f98e-40e3-b59c-4c1d0e8b16c7 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:79:c4,bridge_name='br-int',has_traffic_filtering=True,id=97e5b1a2-6c38-42c4-a740-4eb055fb7bb6,network=Network(ff6dd0d5-1bec-49e1-b85f-c4257cd37d52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97e5b1a2-6c') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:10:49.919826 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:49.920087 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap97e5b1a2-6c, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:10:49.921056 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:49.922023 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:10:49.922684 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:49.923573 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:49.923708 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=76e445f4-ed6d-47c6-9696-15c42e8efef5) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:10:49.924268 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:49.924944 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:10:49.925251 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:49.927373 np0000001583 nova-compute[98241]: INFO os_vif [None req-201bf4c6-f98e-40e3-b59c-4c1d0e8b16c7 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:79:c4,bridge_name='br-int',has_traffic_filtering=True,id=97e5b1a2-6c38-42c4-a740-4eb055fb7bb6,network=Network(ff6dd0d5-1bec-49e1-b85f-c4257cd37d52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97e5b1a2-6c')
May 28 02:10:49.929319 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-201bf4c6-f98e-40e3-b59c-4c1d0e8b16c7 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:10:49.929832 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-201bf4c6-f98e-40e3-b59c-4c1d0e8b16c7 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2', 'iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4addb7d-0ef0-476c-aecf-4d36ab500da2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:10:49.929951 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-201bf4c6-f98e-40e3-b59c-4c1d0e8b16c7 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:10:50.050222 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Found WWN 3300000002d77a713 for multipath device dm-8 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 02:10:50.050426 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:10:50.050881 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-201bf4c6-f98e-40e3-b59c-4c1d0e8b16c7 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.121s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:10:50.051195 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-201bf4c6-f98e-40e3-b59c-4c1d0e8b16c7 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2', 'iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4addb7d-0ef0-476c-aecf-4d36ab500da2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:10:50.051356 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-201bf4c6-f98e-40e3-b59c-4c1d0e8b16c7 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:10:50.053264 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] <== connect_volume: return (4143ms) {'type': 'block', 'scsi_wwn': '3300000002d77a713', 'path': '/dev/disk/by-id/os-brick+dev+dm-8', 'multipath_id': '3300000002d77a713'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:10:50.053264 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002d77a713', 'path': '/dev/disk/by-id/os-brick+dev+dm-8', 'multipath_id': '3300000002d77a713'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 02:10:50.080152 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-201bf4c6-f98e-40e3-b59c-4c1d0e8b16c7 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:50.080152 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:50.080152 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:50.080152 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:50.080152 np0000001583 nova-compute[98241]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643 (non-flash)
May 28 02:10:50.080152 np0000001583 nova-compute[98241]: tcp: [201] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643 (non-flash)
May 28 02:10:50.080152 np0000001583 nova-compute[98241]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8208e604-df71-44a3-ae9f-ece00511dc20 (non-flash)
May 28 02:10:50.080152 np0000001583 nova-compute[98241]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8208e604-df71-44a3-ae9f-ece00511dc20 (non-flash)
May 28 02:10:50.080152 np0000001583 nova-compute[98241]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:50.080152 np0000001583 nova-compute[98241]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:50.080152 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:10:50.080393 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-201bf4c6-f98e-40e3-b59c-4c1d0e8b16c7 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:50.080393 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:50.080393 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:50.080393 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:50.080393 np0000001583 nova-compute[98241]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643 (non-flash)
May 28 02:10:50.080393 np0000001583 nova-compute[98241]: tcp: [201] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643 (non-flash)
May 28 02:10:50.080393 np0000001583 nova-compute[98241]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8208e604-df71-44a3-ae9f-ece00511dc20 (non-flash)
May 28 02:10:50.080393 np0000001583 nova-compute[98241]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8208e604-df71-44a3-ae9f-ece00511dc20 (non-flash)
May 28 02:10:50.080393 np0000001583 nova-compute[98241]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:50.080393 np0000001583 nova-compute[98241]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:50.080393 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:10:50.080556 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-201bf4c6-f98e-40e3-b59c-4c1d0e8b16c7 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb', '181'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb', '182'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0', '194'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0', '195'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643', '200'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643', '201'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8208e604-df71-44a3-ae9f-ece00511dc20', '202'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8208e604-df71-44a3-ae9f-ece00511dc20', '203'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', '204'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', '205')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:10:50.080556 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-201bf4c6-f98e-40e3-b59c-4c1d0e8b16c7 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2, 0): [] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:10:50.080715 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-201bf4c6-f98e-40e3-b59c-4c1d0e8b16c7 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2') {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 28 02:10:50.080866 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-201bf4c6-f98e-40e3-b59c-4c1d0e8b16c7 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2, 0): [] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:10:50.080992 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-201bf4c6-f98e-40e3-b59c-4c1d0e8b16c7 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4addb7d-0ef0-476c-aecf-4d36ab500da2') {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 28 02:10:50.081133 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-201bf4c6-f98e-40e3-b59c-4c1d0e8b16c7 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f81828e0>, {}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:10:50.081274 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-201bf4c6-f98e-40e3-b59c-4c1d0e8b16c7 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Disconnecting from: [] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:10:50.081500 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-201bf4c6-f98e-40e3-b59c-4c1d0e8b16c7 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.031s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:10:50.081625 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-201bf4c6-f98e-40e3-b59c-4c1d0e8b16c7 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] <== disconnect_volume: return (151ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:10:50.081777 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-201bf4c6-f98e-40e3-b59c-4c1d0e8b16c7 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:10:50.082140 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-201bf4c6-f98e-40e3-b59c-4c1d0e8b16c7 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Deleting instance files /opt/stack/data/nova/instances/2e42be01-bc16-4fa6-9a95-698204b5e592_del
May 28 02:10:50.083199 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-201bf4c6-f98e-40e3-b59c-4c1d0e8b16c7 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Deletion of /opt/stack/data/nova/instances/2e42be01-bc16-4fa6-9a95-698204b5e592_del complete
May 28 02:10:50.086867 np0000001583 nova-compute[98241]: DEBUG os_brick.encryptors [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2ca44659-a2eb-4952-8736-4ccf8052ec61', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-8'}, 'status': 'attaching', 'instance': '5f8cf96c-2c00-493d-afe2-2ea77a834767', 'attached_at': '2026-05-28T02:10:44.000000', 'detached_at': '', 'volume_id': '2ca44659-a2eb-4952-8736-4ccf8052ec61', 'serial': '2ca44659-a2eb-4952-8736-4ccf8052ec61'} {{(pid=98241) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 02:10:50.087414 np0000001583 nova-compute[98241]: WARNING stevedore.named [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 02:10:50.087624 np0000001583 nova-compute[98241]: WARNING castellan.key_manager [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 02:10:50.087778 np0000001583 nova-compute[98241]: WARNING nova.keymgr.conf_key_mgr [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 02:10:50.105687 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Secret XML: <secret ephemeral="no" private="no">
May 28 02:10:50.105687 np0000001583 nova-compute[98241]:   <usage type="volume">
May 28 02:10:50.105687 np0000001583 nova-compute[98241]:     <volume>2ca44659-a2eb-4952-8736-4ccf8052ec61</volume>
May 28 02:10:50.105687 np0000001583 nova-compute[98241]:   </usage>
May 28 02:10:50.105687 np0000001583 nova-compute[98241]: </secret>
May 28 02:10:50.105687 np0000001583 nova-compute[98241]:  {{(pid=98241) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 28 02:10:50.591859 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-201bf4c6-f98e-40e3-b59c-4c1d0e8b16c7 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Took 1.50 seconds to destroy the instance on the hypervisor.
May 28 02:10:50.592581 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-201bf4c6-f98e-40e3-b59c-4c1d0e8b16c7 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 02:10:50.593283 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 02:10:50.593433 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 02:10:50.594011 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:10:50.616281 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T02:09:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1932077210',display_name='tempest-TestEncryptedCinderVolumes-server-1932077210',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(13),hidden=False,host='np0000001583',hostname='tempest-testencryptedcindervolumes-server-1932077210',id=73,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=13,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBun1fK3bqFH0DwFCe64dJxsemPDLJQjBBUXpAYHHMZ5VrGdrQWiAi1CAoY21xUJOnjgSHF/PvTCHsItl5nChH/jKvFpUNNLQ2Rj7QdmnLJ1lKVepbjJh5mCh3vTGal8fA==',key_name='tempest-keypair-1273682795',keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:09:36Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(13),node='np0000001583',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d192b18567fd4735988dd19da06fb868',ramdisk_id='',reservation_id='r-w015fch7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-TestEncryptedCinderVolumes-243696963',owner_user_name='tempest-TestEncryptedCinderVolumes-243696963-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:10:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f09c9f1da7e4d32979e47c96d41ae99',uuid=5f8cf96c-2c00-493d-afe2-2ea77a834767,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "address": "fa:16:3e:1d:39:9a", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.212", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "vif_mac": "fa:16:3e:1d:39:9a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe49fa27-da", "ovs_interfaceid": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 02:10:50.616522 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Converting VIF {"id": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "address": "fa:16:3e:1d:39:9a", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.212", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "vif_mac": "fa:16:3e:1d:39:9a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe49fa27-da", "ovs_interfaceid": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:10:50.617026 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:39:9a,bridge_name='br-int',has_traffic_filtering=True,id=fe49fa27-da6a-4d8f-ab1e-bb280d24658c,network=Network(fccbc55c-a449-42c3-bf68-d3d337f7b0ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe49fa27-da') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:10:50.619223 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] End _get_guest_xml xml=<domain type="qemu">
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:   <uuid>5f8cf96c-2c00-493d-afe2-2ea77a834767</uuid>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:   <name>instance-00000049</name>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:   <metadata>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1932077210</nova:name>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 02:10:45</nova:creationTime>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:       <nova:flavor name="tempest-1618752310" id="0a8a1c8f-51ff-45e6-ab47-64ae96704fba">
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:         <nova:extraSpecs/>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:       </nova:image>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:         <nova:user uuid="0f09c9f1da7e4d32979e47c96d41ae99">tempest-TestEncryptedCinderVolumes-243696963-project-member</nova:user>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:         <nova:project uuid="d192b18567fd4735988dd19da06fb868">tempest-TestEncryptedCinderVolumes-243696963</nova:project>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:         <nova:port uuid="fe49fa27-da6a-4d8f-ab1e-bb280d24658c">
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:         </nova:port>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:   </metadata>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:     <system>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:       <entry name="serial">5f8cf96c-2c00-493d-afe2-2ea77a834767</entry>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:       <entry name="uuid">5f8cf96c-2c00-493d-afe2-2ea77a834767</entry>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:     </system>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:   <os>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:   </os>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:   <features>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:     <acpi/>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:     <tcg>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:     </tcg>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:   </features>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:   </cpu>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:   <devices>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767/disk"/>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:     </disk>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767/disk.config"/>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:     </disk>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:     <disk type="block" device="disk">
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:       <alias name="ua-2ca44659-a2eb-4952-8736-4ccf8052ec61"/>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-8"/>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:       <target dev="vdb" bus="virtio"/>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:       <serial>2ca44659-a2eb-4952-8736-4ccf8052ec61</serial>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:       <encryption format="luks">
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:         <secret type="passphrase" uuid="5163e6d1-9e4c-4623-8f3b-bc39349bef34"/>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:       </encryption>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:     </disk>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:1d:39:9a"/>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:       <target dev="tapfe49fa27-da"/>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:     </interface>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767/console.log" append="off"/>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:     </serial>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:     <video>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:     </video>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:     </rng>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:     </memballoon>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:   </devices>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]: </domain>
May 28 02:10:50.619223 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 02:10:50.621847 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T02:09:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1932077210',display_name='tempest-TestEncryptedCinderVolumes-server-1932077210',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(13),hidden=False,host='np0000001583',hostname='tempest-testencryptedcindervolumes-server-1932077210',id=73,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=13,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBun1fK3bqFH0DwFCe64dJxsemPDLJQjBBUXpAYHHMZ5VrGdrQWiAi1CAoY21xUJOnjgSHF/PvTCHsItl5nChH/jKvFpUNNLQ2Rj7QdmnLJ1lKVepbjJh5mCh3vTGal8fA==',key_name='tempest-keypair-1273682795',keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:09:36Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(13),node='np0000001583',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d192b18567fd4735988dd19da06fb868',ramdisk_id='',reservation_id='r-w015fch7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-TestEncryptedCinderVolumes-243696963',owner_user_name='tempest-TestEncryptedCinderVolumes-243696963-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:10:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f09c9f1da7e4d32979e47c96d41ae99',uuid=5f8cf96c-2c00-493d-afe2-2ea77a834767,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "address": "fa:16:3e:1d:39:9a", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.212", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "vif_mac": "fa:16:3e:1d:39:9a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe49fa27-da", "ovs_interfaceid": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 02:10:50.621847 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Converting VIF {"id": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "address": "fa:16:3e:1d:39:9a", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.212", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "vif_mac": "fa:16:3e:1d:39:9a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe49fa27-da", "ovs_interfaceid": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:10:50.621847 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:39:9a,bridge_name='br-int',has_traffic_filtering=True,id=fe49fa27-da6a-4d8f-ab1e-bb280d24658c,network=Network(fccbc55c-a449-42c3-bf68-d3d337f7b0ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe49fa27-da') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:10:50.621847 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:39:9a,bridge_name='br-int',has_traffic_filtering=True,id=fe49fa27-da6a-4d8f-ab1e-bb280d24658c,network=Network(fccbc55c-a449-42c3-bf68-d3d337f7b0ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe49fa27-da') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 02:10:50.621847 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:50.621847 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:10:50.621847 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 02:10:50.622402 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:50.622629 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c0fcca29-8d7d-56b4-8e39-2947409ce806', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:10:50.623431 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:50.623980 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:10:50.625593 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:50.627568 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:50.627835 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe49fa27-da, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:10:50.628188 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe49fa27-da, col_values=(('qos', UUID('d27982af-6eb9-43b1-bb24-df4d19e3e222')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:10:50.628351 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe49fa27-da, col_values=(('external_ids', {'iface-id': 'fe49fa27-da6a-4d8f-ab1e-bb280d24658c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:39:9a', 'vm-uuid': '5f8cf96c-2c00-493d-afe2-2ea77a834767'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:10:50.629195 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:50.630259 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:10:50.635971 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:50.637403 np0000001583 nova-compute[98241]: INFO os_vif [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:39:9a,bridge_name='br-int',has_traffic_filtering=True,id=fe49fa27-da6a-4d8f-ab1e-bb280d24658c,network=Network(fccbc55c-a449-42c3-bf68-d3d337f7b0ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe49fa27-da')
May 28 02:10:50.690860 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:10:50.809486 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d4ac5d48-516c-4d3f-84f0-72597e3eab38 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Acquiring lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:10:50.809717 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d4ac5d48-516c-4d3f-84f0-72597e3eab38 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:10:51.115404 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ac3bc6b5-fa4b-4809-9175-24466394beb0 req-13d76087-0995-4975-b5a3-b4ebbeb1563d service nova] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Received event network-vif-deleted-97e5b1a2-6c38-42c4-a740-4eb055fb7bb6 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:10:51.115798 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-ac3bc6b5-fa4b-4809-9175-24466394beb0 req-13d76087-0995-4975-b5a3-b4ebbeb1563d service nova] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Neutron deleted interface 97e5b1a2-6c38-42c4-a740-4eb055fb7bb6; detaching it from the instance and deleting it from the info cache
May 28 02:10:51.117636 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ac3bc6b5-fa4b-4809-9175-24466394beb0 req-13d76087-0995-4975-b5a3-b4ebbeb1563d service nova] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Detach interface failed, port_id=97e5b1a2-6c38-42c4-a740-4eb055fb7bb6, reason: Instance 2e42be01-bc16-4fa6-9a95-698204b5e592 could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 02:10:51.310343 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-17b5fa2b-a0eb-4eed-87e5-a6792de364ba req-e73a71b5-5847-480b-b0fd-6125c9ad381e service nova] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Received event network-vif-unplugged-97e5b1a2-6c38-42c4-a740-4eb055fb7bb6 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:10:51.310504 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-17b5fa2b-a0eb-4eed-87e5-a6792de364ba req-e73a71b5-5847-480b-b0fd-6125c9ad381e service nova] Acquiring lock "2e42be01-bc16-4fa6-9a95-698204b5e592-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:10:51.310654 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-17b5fa2b-a0eb-4eed-87e5-a6792de364ba req-e73a71b5-5847-480b-b0fd-6125c9ad381e service nova] Lock "2e42be01-bc16-4fa6-9a95-698204b5e592-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:10:51.310778 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-17b5fa2b-a0eb-4eed-87e5-a6792de364ba req-e73a71b5-5847-480b-b0fd-6125c9ad381e service nova] Lock "2e42be01-bc16-4fa6-9a95-698204b5e592-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:10:51.310930 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-17b5fa2b-a0eb-4eed-87e5-a6792de364ba req-e73a71b5-5847-480b-b0fd-6125c9ad381e service nova] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] No waiting events found dispatching network-vif-unplugged-97e5b1a2-6c38-42c4-a740-4eb055fb7bb6 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:10:51.311033 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-17b5fa2b-a0eb-4eed-87e5-a6792de364ba req-e73a71b5-5847-480b-b0fd-6125c9ad381e service nova] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Received event network-vif-unplugged-97e5b1a2-6c38-42c4-a740-4eb055fb7bb6 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:10:51.313359 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-d4ac5d48-516c-4d3f-84f0-72597e3eab38 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Detaching volume 0388423c-1a4a-42db-9584-326075201643
May 28 02:10:51.350278 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-d4ac5d48-516c-4d3f-84f0-72597e3eab38 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Attempting to driver detach volume 0388423c-1a4a-42db-9584-326075201643 from mountpoint /dev/vdb
May 28 02:10:51.355445 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-d4ac5d48-516c-4d3f-84f0-72597e3eab38 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Found disk vdb by alias ua-0388423c-1a4a-42db-9584-326075201643 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:10:51.356881 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-d4ac5d48-516c-4d3f-84f0-72597e3eab38 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Found disk vdb by alias ua-0388423c-1a4a-42db-9584-326075201643 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:10:51.356881 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-d4ac5d48-516c-4d3f-84f0-72597e3eab38 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Attempting to detach device vdb from instance 88e7dd8f-33f3-46e8-8d17-b9451bb627e5 from the persistent domain config. {{(pid=98241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 02:10:51.357138 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-d4ac5d48-516c-4d3f-84f0-72597e3eab38 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:10:51.357138 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:10:51.357138 np0000001583 nova-compute[98241]:   <alias name="ua-0388423c-1a4a-42db-9584-326075201643"/>
May 28 02:10:51.357138 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-0"/>
May 28 02:10:51.357138 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:10:51.357138 np0000001583 nova-compute[98241]:   <serial>0388423c-1a4a-42db-9584-326075201643</serial>
May 28 02:10:51.357138 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 02:10:51.357138 np0000001583 nova-compute[98241]: </disk>
May 28 02:10:51.357138 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:10:51.363535 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-d4ac5d48-516c-4d3f-84f0-72597e3eab38 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Successfully detached device vdb from instance 88e7dd8f-33f3-46e8-8d17-b9451bb627e5 from the persistent domain config.
May 28 02:10:51.363841 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-d4ac5d48-516c-4d3f-84f0-72597e3eab38 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] (1/8): Attempting to detach device vdb with device alias ua-0388423c-1a4a-42db-9584-326075201643 from instance 88e7dd8f-33f3-46e8-8d17-b9451bb627e5 from the live domain config. {{(pid=98241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 02:10:51.364055 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-d4ac5d48-516c-4d3f-84f0-72597e3eab38 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:10:51.364055 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:10:51.364055 np0000001583 nova-compute[98241]:   <alias name="ua-0388423c-1a4a-42db-9584-326075201643"/>
May 28 02:10:51.364055 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-0"/>
May 28 02:10:51.364055 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:10:51.364055 np0000001583 nova-compute[98241]:   <serial>0388423c-1a4a-42db-9584-326075201643</serial>
May 28 02:10:51.364055 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 02:10:51.364055 np0000001583 nova-compute[98241]: </disk>
May 28 02:10:51.364055 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:10:51.558389 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:10:51.862278 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Received event <DeviceRemovedEvent: 1779934251.861928, 88e7dd8f-33f3-46e8-8d17-b9451bb627e5 => ua-0388423c-1a4a-42db-9584-326075201643> from libvirt while the driver is waiting for it; dispatched. {{(pid=98241) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 02:10:51.863142 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-d4ac5d48-516c-4d3f-84f0-72597e3eab38 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-0388423c-1a4a-42db-9584-326075201643 for instance 88e7dd8f-33f3-46e8-8d17-b9451bb627e5 {{(pid=98241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 02:10:51.865223 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-d4ac5d48-516c-4d3f-84f0-72597e3eab38 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Successfully detached device vdb from instance 88e7dd8f-33f3-46e8-8d17-b9451bb627e5 from the live domain config.
May 28 02:10:51.866264 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4ac5d48-516c-4d3f-84f0-72597e3eab38 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:10:51.866547 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ac5d48-516c-4d3f-84f0-72597e3eab38 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643', 'iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0388423c-1a4a-42db-9584-326075201643', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:10:51.866724 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-d4ac5d48-516c-4d3f-84f0-72597e3eab38 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:10:51.867057 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-d4ac5d48-516c-4d3f-84f0-72597e3eab38 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:10:51.867304 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ac5d48-516c-4d3f-84f0-72597e3eab38 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643', 'iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0388423c-1a4a-42db-9584-326075201643', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:10:51.867419 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ac5d48-516c-4d3f-84f0-72597e3eab38 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:10:51.895296 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ac5d48-516c-4d3f-84f0-72597e3eab38 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:51.895296 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:51.895296 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:51.895296 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:51.895296 np0000001583 nova-compute[98241]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643 (non-flash)
May 28 02:10:51.895296 np0000001583 nova-compute[98241]: tcp: [201] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643 (non-flash)
May 28 02:10:51.895296 np0000001583 nova-compute[98241]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:51.895296 np0000001583 nova-compute[98241]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:51.895296 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:10:51.895546 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ac5d48-516c-4d3f-84f0-72597e3eab38 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:51.895546 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:51.895546 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:51.895546 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:51.895546 np0000001583 nova-compute[98241]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643 (non-flash)
May 28 02:10:51.895546 np0000001583 nova-compute[98241]: tcp: [201] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643 (non-flash)
May 28 02:10:51.895546 np0000001583 nova-compute[98241]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:51.895546 np0000001583 nova-compute[98241]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:51.895546 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:10:51.895546 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ac5d48-516c-4d3f-84f0-72597e3eab38 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb', '181'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb', '182'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0', '194'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0', '195'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643', '200'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643', '201'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', '204'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', '205')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:10:51.895801 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ac5d48-516c-4d3f-84f0-72597e3eab38 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643', '200')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:10:51.896647 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ac5d48-516c-4d3f-84f0-72597e3eab38 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643', '201')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:10:51.897470 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ac5d48-516c-4d3f-84f0-72597e3eab38 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f8305b20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643'): ({'sdc'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:10:51.897630 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-d4ac5d48-516c-4d3f-84f0-72597e3eab38 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Removing multipathed devices sdc, sdb {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:10:51.897888 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-d4ac5d48-516c-4d3f-84f0-72597e3eab38 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Flush multipath device 330000000e6212d4c {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:10:51.938435 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-d4ac5d48-516c-4d3f-84f0-72597e3eab38 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:10:51.985908 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-d4ac5d48-516c-4d3f-84f0-72597e3eab38 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:10:52.031295 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-d4ac5d48-516c-4d3f-84f0-72597e3eab38 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:10:52.031453 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-d4ac5d48-516c-4d3f-84f0-72597e3eab38 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:10:52.032417 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-d4ac5d48-516c-4d3f-84f0-72597e3eab38 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:10:52.043404 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-d4ac5d48-516c-4d3f-84f0-72597e3eab38 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:10:52.043586 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ac5d48-516c-4d3f-84f0-72597e3eab38 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:10:52.054350 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ac5d48-516c-4d3f-84f0-72597e3eab38 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:52.060335 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Took 1.47 seconds to deallocate network for instance.
May 28 02:10:52.075324 np0000001583 nova-compute[98241]: WARNING nova.volume.cinder [None req-201bf4c6-f98e-40e3-b59c-4c1d0e8b16c7 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Attachment 4e1d4197-14d4-4158-b708-b3ad2ddfbe9e does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 4e1d4197-14d4-4158-b708-b3ad2ddfbe9e. (HTTP 404) (Request-ID: req-51e09ffd-b041-4ad4-bc8d-6dc8e775d379)
May 28 02:10:52.075558 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-201bf4c6-f98e-40e3-b59c-4c1d0e8b16c7 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Took 0.01 seconds to detach 1 volumes for instance.
May 28 02:10:52.091981 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ac5d48-516c-4d3f-84f0-72597e3eab38 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 200, target: iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643, portal: 192.168.40.100,3260]
May 28 02:10:52.091981 np0000001583 nova-compute[98241]: Logout of [sid: 200, target: iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643, portal: 192.168.40.100,3260] successful.
May 28 02:10:52.091981 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:52.109044 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ac5d48-516c-4d3f-84f0-72597e3eab38 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:52.120104 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ac5d48-516c-4d3f-84f0-72597e3eab38 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:52.146978 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ac5d48-516c-4d3f-84f0-72597e3eab38 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 201, target: iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643, portal: 192.168.50.100,3260]
May 28 02:10:52.146978 np0000001583 nova-compute[98241]: Logout of [sid: 201, target: iqn.2023-03.storpool.com:os--volume-0388423c-1a4a-42db-9584-326075201643, portal: 192.168.50.100,3260] successful.
May 28 02:10:52.146978 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:52.154148 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:10:52.154292 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:10:52.154563 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:10:52.154563 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] No VIF found with MAC fa:16:3e:1d:39:9a, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:10:52.155056 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Using config drive
May 28 02:10:52.163150 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ac5d48-516c-4d3f-84f0-72597e3eab38 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:52.163349 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-d4ac5d48-516c-4d3f-84f0-72597e3eab38 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:10:52.163543 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ac5d48-516c-4d3f-84f0-72597e3eab38 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] <== disconnect_volume: return (296ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:10:52.163697 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4ac5d48-516c-4d3f-84f0-72597e3eab38 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:10:52.576129 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:52.581216 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-201bf4c6-f98e-40e3-b59c-4c1d0e8b16c7 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:10:52.581450 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-201bf4c6-f98e-40e3-b59c-4c1d0e8b16c7 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:10:52.596636 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:52.693783 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:52.726913 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-d4ac5d48-516c-4d3f-84f0-72597e3eab38 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lazy-loading 'flavor' on Instance uuid 88e7dd8f-33f3-46e8-8d17-b9451bb627e5 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:10:52.901988 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.00031596700000591227 future=<Future at 0x7724ec070380 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:10:52.901988 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:10:52.901988 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=11.510370323000188 future=<Future at 0x7724ec24b2c0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:10:52.901988 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=11.510290862000147 future=<Future at 0x7724ec24b2c0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:10:52.902416 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Emitting event <LifecycleEvent: 1779934237.9011188, 5f8cf96c-2c00-493d-afe2-2ea77a834767 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:10:52.902641 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] VM Stopped (Lifecycle Event)
May 28 02:10:52.918438 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:52.921522 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:52.924400 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:52.932352 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-201bf4c6-f98e-40e3-b59c-4c1d0e8b16c7 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:10:52.932600 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-201bf4c6-f98e-40e3-b59c-4c1d0e8b16c7 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:10:52.941945 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:53.179593 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d299baea-68cb-4bfd-ac7d-f7f057585931 req-4e75dfd7-0ec6-4067-ba1f-923ab76feaed service nova] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Received event network-vif-plugged-fe49fa27-da6a-4d8f-ab1e-bb280d24658c {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:10:53.180101 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d299baea-68cb-4bfd-ac7d-f7f057585931 req-4e75dfd7-0ec6-4067-ba1f-923ab76feaed service nova] Acquiring lock "5f8cf96c-2c00-493d-afe2-2ea77a834767-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:10:53.180101 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d299baea-68cb-4bfd-ac7d-f7f057585931 req-4e75dfd7-0ec6-4067-ba1f-923ab76feaed service nova] Lock "5f8cf96c-2c00-493d-afe2-2ea77a834767-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:10:53.180270 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d299baea-68cb-4bfd-ac7d-f7f057585931 req-4e75dfd7-0ec6-4067-ba1f-923ab76feaed service nova] Lock "5f8cf96c-2c00-493d-afe2-2ea77a834767-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:10:53.180358 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d299baea-68cb-4bfd-ac7d-f7f057585931 req-4e75dfd7-0ec6-4067-ba1f-923ab76feaed service nova] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] No waiting events found dispatching network-vif-plugged-fe49fa27-da6a-4d8f-ab1e-bb280d24658c {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:10:53.180444 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-d299baea-68cb-4bfd-ac7d-f7f057585931 req-4e75dfd7-0ec6-4067-ba1f-923ab76feaed service nova] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Received unexpected event network-vif-plugged-fe49fa27-da6a-4d8f-ab1e-bb280d24658c for instance with vm_state active and task_state resize_finish.
May 28 02:10:53.180556 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d299baea-68cb-4bfd-ac7d-f7f057585931 req-4e75dfd7-0ec6-4067-ba1f-923ab76feaed service nova] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Received event network-vif-plugged-fe49fa27-da6a-4d8f-ab1e-bb280d24658c {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:10:53.184103 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d299baea-68cb-4bfd-ac7d-f7f057585931 req-4e75dfd7-0ec6-4067-ba1f-923ab76feaed service nova] Acquiring lock "5f8cf96c-2c00-493d-afe2-2ea77a834767-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:10:53.184103 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d299baea-68cb-4bfd-ac7d-f7f057585931 req-4e75dfd7-0ec6-4067-ba1f-923ab76feaed service nova] Lock "5f8cf96c-2c00-493d-afe2-2ea77a834767-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:10:53.184103 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d299baea-68cb-4bfd-ac7d-f7f057585931 req-4e75dfd7-0ec6-4067-ba1f-923ab76feaed service nova] Lock "5f8cf96c-2c00-493d-afe2-2ea77a834767-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:10:53.184103 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d299baea-68cb-4bfd-ac7d-f7f057585931 req-4e75dfd7-0ec6-4067-ba1f-923ab76feaed service nova] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] No waiting events found dispatching network-vif-plugged-fe49fa27-da6a-4d8f-ab1e-bb280d24658c {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:10:53.184103 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-d299baea-68cb-4bfd-ac7d-f7f057585931 req-4e75dfd7-0ec6-4067-ba1f-923ab76feaed service nova] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Received unexpected event network-vif-plugged-fe49fa27-da6a-4d8f-ab1e-bb280d24658c for instance with vm_state active and task_state resize_finish.
May 28 02:10:53.405251 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-397bf368-5ba4-4017-87fa-00091bb16e66 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:10:53.450256 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-201bf4c6-f98e-40e3-b59c-4c1d0e8b16c7 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:10:53.631614 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:53.736626 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-d4ac5d48-516c-4d3f-84f0-72597e3eab38 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.926s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:10:53.960334 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-201bf4c6-f98e-40e3-b59c-4c1d0e8b16c7 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.379s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:10:54.023611 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-201bf4c6-f98e-40e3-b59c-4c1d0e8b16c7 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Deleted allocations for instance 2e42be01-bc16-4fa6-9a95-698204b5e592
May 28 02:10:54.304698 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934254.304287, 5f8cf96c-2c00-493d-afe2-2ea77a834767 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:10:54.305771 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] VM Resumed (Lifecycle Event)
May 28 02:10:54.305771 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Instance event wait completed in 0 seconds for  {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 02:10:54.308571 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Instance running successfully.
May 28 02:10:54.309514 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Failed to set time: agent not configured {{(pid=98241) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 28 02:10:54.309653 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-309d0fb3-3381-481b-8689-9407e6a8a8fd tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] finish_migration finished successfully. {{(pid=98241) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 28 02:10:54.807807 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:10:54.810282 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:10:55.032866 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-201bf4c6-f98e-40e3-b59c-4c1d0e8b16c7 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "2e42be01-bc16-4fa6-9a95-698204b5e592" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.452s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:10:55.312826 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 28 02:10:55.313250 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934255.312903, 5f8cf96c-2c00-493d-afe2-2ea77a834767 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:10:55.313250 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] VM Started (Lifecycle Event)
May 28 02:10:55.629142 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:55.815876 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:10:55.820223 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:10:55.834074 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:10:55.921707 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:10:55.922194 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:10:55.922565 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:10:55.998553 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Port fe49fa27-da6a-4d8f-ab1e-bb280d24658c binding to destination host np0000001583 is already ACTIVE {{(pid=98241) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 28 02:10:55.998861 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "refresh_cache-5f8cf96c-2c00-493d-afe2-2ea77a834767" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:10:55.998861 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquired lock "refresh_cache-5f8cf96c-2c00-493d-afe2-2ea77a834767" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:10:55.999041 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:10:56.322422 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] During sync_power_state the instance has a pending task (resize_reverting). Skip.
May 28 02:10:56.502569 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:10:56.830248 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:10:56.943021 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Updating instance_info_cache with network_info: [{"id": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "address": "fa:16:3e:1d:39:9a", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe49fa27-da", "ovs_interfaceid": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:10:57.444757 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Releasing lock "refresh_cache-5f8cf96c-2c00-493d-afe2-2ea77a834767" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:10:57.948153 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Creating tmpfile /opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767/tmpl4erzet5 to verify with other compute node that the instance is on the same shared storage. {{(pid=98241) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:10552}}
May 28 02:10:57.948368 np0000001583 nova-compute[98241]: DEBUG nova.compute.rpcapi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98241) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 02:10:58.467086 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:58.469515 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:58.487487 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:58.490934 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:58.511661 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:58.519309 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:58.633671 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:58.649743 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d44c56f8-0b0e-4ad7-a9d8-49bcc8c6f58c req-2f709260-ae58-4636-b0d7-acce664b9a01 service nova] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Received event network-vif-unplugged-fe49fa27-da6a-4d8f-ab1e-bb280d24658c {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:10:58.649743 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d44c56f8-0b0e-4ad7-a9d8-49bcc8c6f58c req-2f709260-ae58-4636-b0d7-acce664b9a01 service nova] Acquiring lock "5f8cf96c-2c00-493d-afe2-2ea77a834767-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:10:58.650623 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d44c56f8-0b0e-4ad7-a9d8-49bcc8c6f58c req-2f709260-ae58-4636-b0d7-acce664b9a01 service nova] Lock "5f8cf96c-2c00-493d-afe2-2ea77a834767-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:10:58.650623 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d44c56f8-0b0e-4ad7-a9d8-49bcc8c6f58c req-2f709260-ae58-4636-b0d7-acce664b9a01 service nova] Lock "5f8cf96c-2c00-493d-afe2-2ea77a834767-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:10:58.650623 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d44c56f8-0b0e-4ad7-a9d8-49bcc8c6f58c req-2f709260-ae58-4636-b0d7-acce664b9a01 service nova] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] No waiting events found dispatching network-vif-unplugged-fe49fa27-da6a-4d8f-ab1e-bb280d24658c {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:10:58.650769 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-d44c56f8-0b0e-4ad7-a9d8-49bcc8c6f58c req-2f709260-ae58-4636-b0d7-acce664b9a01 service nova] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Received unexpected event network-vif-unplugged-fe49fa27-da6a-4d8f-ab1e-bb280d24658c for instance with vm_state resized and task_state resize_reverting.
May 28 02:10:58.751192 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:58.759424 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:58.783324 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.99966158899997 future=<Future at 0x7724ec1f22a0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:10:58.785739 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Instance destroyed successfully.
May 28 02:10:58.786203 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lazy-loading 'resources' on Instance uuid 5f8cf96c-2c00-493d-afe2-2ea77a834767 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:10:59.288457 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T02:09:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1932077210',display_name='tempest-TestEncryptedCinderVolumes-server-1932077210',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(13),hidden=False,host='np0000001583',hostname='tempest-testencryptedcindervolumes-server-1932077210',id=73,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=13,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBun1fK3bqFH0DwFCe64dJxsemPDLJQjBBUXpAYHHMZ5VrGdrQWiAi1CAoY21xUJOnjgSHF/PvTCHsItl5nChH/jKvFpUNNLQ2Rj7QdmnLJ1lKVepbjJh5mCh3vTGal8fA==',key_name='tempest-keypair-1273682795',keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:10:54Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=Flavor(13),node='np0000001583',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d192b18567fd4735988dd19da06fb868',ramdisk_id='',reservation_id='r-w015fch7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-TestEncryptedCinderVolumes-243696963',owner_user_name='tempest-TestEncryptedCinderVolumes-243696963-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T02:10:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f09c9f1da7e4d32979e47c96d41ae99',uuid=5f8cf96c-2c00-493d-afe2-2ea77a834767,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "address": "fa:16:3e:1d:39:9a", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe49fa27-da", "ovs_interfaceid": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:10:59.288681 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Converting VIF {"id": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "address": "fa:16:3e:1d:39:9a", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe49fa27-da", "ovs_interfaceid": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:10:59.289168 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:39:9a,bridge_name='br-int',has_traffic_filtering=True,id=fe49fa27-da6a-4d8f-ab1e-bb280d24658c,network=Network(fccbc55c-a449-42c3-bf68-d3d337f7b0ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe49fa27-da') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:10:59.289445 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:39:9a,bridge_name='br-int',has_traffic_filtering=True,id=fe49fa27-da6a-4d8f-ab1e-bb280d24658c,network=Network(fccbc55c-a449-42c3-bf68-d3d337f7b0ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe49fa27-da') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:10:59.291284 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:59.291613 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe49fa27-da, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:10:59.293018 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:59.293962 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:10:59.294896 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:59.295150 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d27982af-6eb9-43b1-bb24-df4d19e3e222) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:10:59.295605 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:10:59.296295 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:10:59.298193 np0000001583 nova-compute[98241]: INFO os_vif [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:39:9a,bridge_name='br-int',has_traffic_filtering=True,id=fe49fa27-da6a-4d8f-ab1e-bb280d24658c,network=Network(fccbc55c-a449-42c3-bf68-d3d337f7b0ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe49fa27-da')
May 28 02:10:59.301540 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:10:59.301889 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2ca44659-a2eb-4952-8736-4ccf8052ec61', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-8'}, None), 'kwargs': {'force': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:10:59.302075 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:10:59.302448 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:10:59.302732 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2ca44659-a2eb-4952-8736-4ccf8052ec61', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:10:59.302897 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:10:59.325801 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:59.325801 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:59.325801 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:59.325801 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:59.325801 np0000001583 nova-compute[98241]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:59.325801 np0000001583 nova-compute[98241]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:59.325801 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:10:59.326188 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:59.326188 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:10:59.326188 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:59.326188 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:10:59.326188 np0000001583 nova-compute[98241]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:59.326188 np0000001583 nova-compute[98241]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:10:59.326188 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:10:59.326188 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb', '181'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb', '182'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0', '194'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0', '195'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', '204'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', '205')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:10:59.326415 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', '204')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:10:59.327422 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', '205')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:10:59.328512 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724ec2c4d60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61'): ({'sdk'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:10:59.328772 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Removing multipathed devices sdk, sdj {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:10:59.329130 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Flush multipath device 3300000002d77a713 {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:10:59.360635 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:10:59.400533 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:10:59.441619 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Checking to see if SCSI volumes sdk, sdj have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:10:59.441773 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] SCSI volumes sdk, sdj have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:10:59.442799 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Checking to see if device paths {'sdk', 'sdj'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:10:59.454620 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Device paths {'sdk', 'sdj'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:10:59.454620 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:10:59.465024 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:59.503042 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 204, target: iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61, portal: 192.168.40.100,3260]
May 28 02:10:59.503042 np0000001583 nova-compute[98241]: Logout of [sid: 204, target: iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61, portal: 192.168.40.100,3260] successful.
May 28 02:10:59.503042 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:59.518255 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:59.528492 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:59.555003 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 205, target: iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61, portal: 192.168.50.100,3260]
May 28 02:10:59.555003 np0000001583 nova-compute[98241]: Logout of [sid: 205, target: iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61, portal: 192.168.50.100,3260] successful.
May 28 02:10:59.555003 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:59.568763 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:10:59.569697 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.267s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:10:59.569848 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] <== disconnect_volume: return (268ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:10:59.570121 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:11:00.679995 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:11:00.679995 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:11:00.731492 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-38767e1f-8ad1-4b6b-ab59-11f2d7caef25 req-26823924-c132-41d3-9a52-49d22e3176d5 service nova] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Received event network-vif-unplugged-fe49fa27-da6a-4d8f-ab1e-bb280d24658c {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:11:00.732573 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-38767e1f-8ad1-4b6b-ab59-11f2d7caef25 req-26823924-c132-41d3-9a52-49d22e3176d5 service nova] Acquiring lock "5f8cf96c-2c00-493d-afe2-2ea77a834767-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:11:00.732823 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-38767e1f-8ad1-4b6b-ab59-11f2d7caef25 req-26823924-c132-41d3-9a52-49d22e3176d5 service nova] Lock "5f8cf96c-2c00-493d-afe2-2ea77a834767-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:11:00.732987 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-38767e1f-8ad1-4b6b-ab59-11f2d7caef25 req-26823924-c132-41d3-9a52-49d22e3176d5 service nova] Lock "5f8cf96c-2c00-493d-afe2-2ea77a834767-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:11:00.733190 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-38767e1f-8ad1-4b6b-ab59-11f2d7caef25 req-26823924-c132-41d3-9a52-49d22e3176d5 service nova] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] No waiting events found dispatching network-vif-unplugged-fe49fa27-da6a-4d8f-ab1e-bb280d24658c {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:11:00.733358 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-38767e1f-8ad1-4b6b-ab59-11f2d7caef25 req-26823924-c132-41d3-9a52-49d22e3176d5 service nova] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Received unexpected event network-vif-unplugged-fe49fa27-da6a-4d8f-ab1e-bb280d24658c for instance with vm_state resized and task_state resize_reverting.
May 28 02:11:01.181682 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lazy-loading 'migration_context' on Instance uuid 5f8cf96c-2c00-493d-afe2-2ea77a834767 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:11:01.683698 np0000001583 nova-compute[98241]: DEBUG nova.objects.base [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Object Instance<5f8cf96c-2c00-493d-afe2-2ea77a834767> lazy-loaded attributes: resources,migration_context {{(pid=98241) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 02:11:01.914945 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Acquiring lock "3ce63103-8c3e-4a5b-a2fb-d90055411d08" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:11:01.915139 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "3ce63103-8c3e-4a5b-a2fb-d90055411d08" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:11:01.964138 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2badef5b-f3bd-44f1-9b39-775f996d02c0 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Acquiring lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:11:01.964138 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2badef5b-f3bd-44f1-9b39-775f996d02c0 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:11:01.964138 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2badef5b-f3bd-44f1-9b39-775f996d02c0 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Acquiring lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:11:01.964138 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2badef5b-f3bd-44f1-9b39-775f996d02c0 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:11:01.964138 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2badef5b-f3bd-44f1-9b39-775f996d02c0 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:11:01.965593 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-2badef5b-f3bd-44f1-9b39-775f996d02c0 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Terminating instance
May 28 02:11:01.996487 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:11:01.996686 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:11:02.417068 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 02:11:02.468018 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-2badef5b-f3bd-44f1-9b39-775f996d02c0 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 02:11:02.494403 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:02.499453 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:02.499701 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:11:02.523229 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:02.524950 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:02.548194 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:02.669068 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0a584d61-338b-4fc7-9f47-c037b1701c99 req-496fbde5-3132-4411-928b-4fd70b8c2eba service nova] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Received event network-vif-unplugged-367c4156-3d6b-42a4-960e-d17bbf5ffa36 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:11:02.669629 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0a584d61-338b-4fc7-9f47-c037b1701c99 req-496fbde5-3132-4411-928b-4fd70b8c2eba service nova] Acquiring lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:11:02.669901 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0a584d61-338b-4fc7-9f47-c037b1701c99 req-496fbde5-3132-4411-928b-4fd70b8c2eba service nova] Lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:11:02.670153 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0a584d61-338b-4fc7-9f47-c037b1701c99 req-496fbde5-3132-4411-928b-4fd70b8c2eba service nova] Lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:11:02.670476 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0a584d61-338b-4fc7-9f47-c037b1701c99 req-496fbde5-3132-4411-928b-4fd70b8c2eba service nova] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] No waiting events found dispatching network-vif-unplugged-367c4156-3d6b-42a4-960e-d17bbf5ffa36 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:11:02.673025 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0a584d61-338b-4fc7-9f47-c037b1701c99 req-496fbde5-3132-4411-928b-4fd70b8c2eba service nova] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Received event network-vif-unplugged-367c4156-3d6b-42a4-960e-d17bbf5ffa36 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:11:02.802565 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999721493999914 future=<Future at 0x7724f851e240 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:11:02.803873 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Instance destroyed successfully.
May 28 02:11:02.804357 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-2badef5b-f3bd-44f1-9b39-775f996d02c0 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lazy-loading 'resources' on Instance uuid 88e7dd8f-33f3-46e8-8d17-b9451bb627e5 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:11:02.968591 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:11:03.306618 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-2badef5b-f3bd-44f1-9b39-775f996d02c0 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T02:08:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2080038026',display_name='tempest-SnapshotDataIntegrityTests-server-2080038026',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-snapshotdataintegritytests-server-2080038026',id=70,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzHCXg22jI1mZmPGwnfSzMcBQA6Tzgyr8oAE3SZ+9ERHxQNH5L2wFtREZ/1HgjI73AwG54nW5HKSey2EBYdrHtoL+2x5CaK5MOK3tOqjkKb5WL3FRnYsvH3axsOlCX6oA==',key_name='tempest-keypair-1804059331',keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:08:50Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa3c7ad1bf6248aa8e7f10a9d2a212ce',ramdisk_id='',reservation_id='r-yz0xtw8v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-432938357',owner_user_name='tempest-SnapshotDataIntegrityTests-432938357-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T02:08:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='af333dac9f9a4a6ab951ccb9c7f71e3a',uuid=88e7dd8f-33f3-46e8-8d17-b9451bb627e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "367c4156-3d6b-42a4-960e-d17bbf5ffa36", "address": "fa:16:3e:28:6d:ad", "network": {"id": "b3baa185-7601-4866-99a0-be488d68a312", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-71067646-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aa3c7ad1bf6248aa8e7f10a9d2a212ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap367c4156-3d", "ovs_interfaceid": "367c4156-3d6b-42a4-960e-d17bbf5ffa36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:11:03.306842 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-2badef5b-f3bd-44f1-9b39-775f996d02c0 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Converting VIF {"id": "367c4156-3d6b-42a4-960e-d17bbf5ffa36", "address": "fa:16:3e:28:6d:ad", "network": {"id": "b3baa185-7601-4866-99a0-be488d68a312", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-71067646-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aa3c7ad1bf6248aa8e7f10a9d2a212ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap367c4156-3d", "ovs_interfaceid": "367c4156-3d6b-42a4-960e-d17bbf5ffa36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:11:03.307210 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-2badef5b-f3bd-44f1-9b39-775f996d02c0 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:6d:ad,bridge_name='br-int',has_traffic_filtering=True,id=367c4156-3d6b-42a4-960e-d17bbf5ffa36,network=Network(b3baa185-7601-4866-99a0-be488d68a312),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap367c4156-3d') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:11:03.307412 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-2badef5b-f3bd-44f1-9b39-775f996d02c0 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:6d:ad,bridge_name='br-int',has_traffic_filtering=True,id=367c4156-3d6b-42a4-960e-d17bbf5ffa36,network=Network(b3baa185-7601-4866-99a0-be488d68a312),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap367c4156-3d') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:11:03.308328 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:03.308552 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap367c4156-3d, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:11:03.309556 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:03.310195 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:11:03.310575 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:03.311176 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:03.311305 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8f9866f8-37ba-484e-9526-68b178487643) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:11:03.311914 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:03.312058 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:11:03.312556 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:03.315412 np0000001583 nova-compute[98241]: INFO os_vif [None req-2badef5b-f3bd-44f1-9b39-775f996d02c0 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:6d:ad,bridge_name='br-int',has_traffic_filtering=True,id=367c4156-3d6b-42a4-960e-d17bbf5ffa36,network=Network(b3baa185-7601-4866-99a0-be488d68a312),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap367c4156-3d')
May 28 02:11:03.315769 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-2badef5b-f3bd-44f1-9b39-775f996d02c0 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Deleting instance files /opt/stack/data/nova/instances/88e7dd8f-33f3-46e8-8d17-b9451bb627e5_del
May 28 02:11:03.316480 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-2badef5b-f3bd-44f1-9b39-775f996d02c0 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Deletion of /opt/stack/data/nova/instances/88e7dd8f-33f3-46e8-8d17-b9451bb627e5_del complete
May 28 02:11:03.511729 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 2.832s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:11:03.511962 np0000001583 nova-compute[98241]: DEBUG nova.compute.rpcapi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98241) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 02:11:03.516876 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.544s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:11:03.525346 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 02:11:03.530782 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Claim successful on node np0000001583
May 28 02:11:03.633937 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:03.823531 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-2badef5b-f3bd-44f1-9b39-775f996d02c0 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Took 1.35 seconds to destroy the instance on the hypervisor.
May 28 02:11:03.824021 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-2badef5b-f3bd-44f1-9b39-775f996d02c0 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 02:11:03.824240 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 02:11:03.824325 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 02:11:03.824514 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:11:03.876755 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:11:04.345357 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-826cf128-7320-48d6-9869-78a089d19fbf req-ffe33c1e-2d50-4e29-a79b-011146157970 service nova] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Received event network-vif-deleted-367c4156-3d6b-42a4-960e-d17bbf5ffa36 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:11:04.345727 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-826cf128-7320-48d6-9869-78a089d19fbf req-ffe33c1e-2d50-4e29-a79b-011146157970 service nova] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Neutron deleted interface 367c4156-3d6b-42a4-960e-d17bbf5ffa36; detaching it from the instance and deleting it from the info cache
May 28 02:11:04.347600 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-826cf128-7320-48d6-9869-78a089d19fbf req-ffe33c1e-2d50-4e29-a79b-011146157970 service nova] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Detach interface failed, port_id=367c4156-3d6b-42a4-960e-d17bbf5ffa36, reason: Instance 88e7dd8f-33f3-46e8-8d17-b9451bb627e5 could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 02:11:04.412603 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.00037771799998154165 future=<Future at 0x7724ec24b2c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:11:04.413190 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Emitting event <LifecycleEvent: 1779934249.412019, 2e42be01-bc16-4fa6-9a95-698204b5e592 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:11:04.413437 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:11:04.413786 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] VM Stopped (Lifecycle Event)
May 28 02:11:04.414379 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=9.368605934000243 future=<Future at 0x7724ec1f22a0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:11:04.415096 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=9.36790202300017 future=<Future at 0x7724ec1f22a0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:11:04.727465 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7ee9549f-5110-4d48-ae71-7962e1bf68f5 req-431e42bb-ce4f-40ce-97e6-49ac074e2a3a service nova] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Received event network-vif-unplugged-367c4156-3d6b-42a4-960e-d17bbf5ffa36 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:11:04.727465 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7ee9549f-5110-4d48-ae71-7962e1bf68f5 req-431e42bb-ce4f-40ce-97e6-49ac074e2a3a service nova] Acquiring lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:11:04.727465 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7ee9549f-5110-4d48-ae71-7962e1bf68f5 req-431e42bb-ce4f-40ce-97e6-49ac074e2a3a service nova] Lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:11:04.727696 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7ee9549f-5110-4d48-ae71-7962e1bf68f5 req-431e42bb-ce4f-40ce-97e6-49ac074e2a3a service nova] Lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:11:04.727696 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7ee9549f-5110-4d48-ae71-7962e1bf68f5 req-431e42bb-ce4f-40ce-97e6-49ac074e2a3a service nova] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] No waiting events found dispatching network-vif-unplugged-367c4156-3d6b-42a4-960e-d17bbf5ffa36 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:11:04.727781 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7ee9549f-5110-4d48-ae71-7962e1bf68f5 req-431e42bb-ce4f-40ce-97e6-49ac074e2a3a service nova] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Received event network-vif-unplugged-367c4156-3d6b-42a4-960e-d17bbf5ffa36 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:11:04.797971 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:11:04.861983 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:11:04.862477 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:11:04.916608 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 2e42be01-bc16-4fa6-9a95-698204b5e592] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:11:05.091325 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Swapping old allocation on dict_keys(['cfa1af79-477d-460a-869d-84a19fa91765']) held by migration 131957dd-9295-4b04-9a1d-515e3dba179d for instance
May 28 02:11:05.197745 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Overwriting current allocation {'allocations': {'cfa1af79-477d-460a-869d-84a19fa91765': {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}, 'generation': 95}}, 'project_id': 'd192b18567fd4735988dd19da06fb868', 'user_id': '0f09c9f1da7e4d32979e47c96d41ae99', 'consumer_generation': 1} on consumer 5f8cf96c-2c00-493d-afe2-2ea77a834767 {{(pid=98241) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2036}}
May 28 02:11:05.271539 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:11:05.299932 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Took 1.48 seconds to deallocate network for instance.
May 28 02:11:05.334290 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "refresh_cache-5f8cf96c-2c00-493d-afe2-2ea77a834767" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:11:05.334444 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquired lock "refresh_cache-5f8cf96c-2c00-493d-afe2-2ea77a834767" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:11:05.334705 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:11:05.366872 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:11:05.805203 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2badef5b-f3bd-44f1-9b39-775f996d02c0 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:11:05.836724 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:11:05.873385 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.361s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:11:05.875491 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2badef5b-f3bd-44f1-9b39-775f996d02c0 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.068s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:11:05.875665 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 02:11:06.168960 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:11:06.178927 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2badef5b-f3bd-44f1-9b39-775f996d02c0 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:11:06.179147 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-2badef5b-f3bd-44f1-9b39-775f996d02c0 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:11:06.315774 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Updating instance_info_cache with network_info: [{"id": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "address": "fa:16:3e:1d:39:9a", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe49fa27-da", "ovs_interfaceid": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:11:06.381707 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 02:11:06.383989 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 02:11:06.383989 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:11:06.383989 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:11:06.451441 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd6c21669663a49f39202d3ca89337d19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20805bca06645eabf880bb71e4b69e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 02:11:06.681665 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-2badef5b-f3bd-44f1-9b39-775f996d02c0 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:11:06.817593 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Releasing lock "refresh_cache-5f8cf96c-2c00-493d-afe2-2ea77a834767" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:11:06.818090 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:11:06.828648 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 02:11:06.850988 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:11:06.876308 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Successfully created port: af3509df-12e0-45a5-89d5-8b4aba6b5ca4 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 02:11:06.886890 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 02:11:06.896580 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 02:11:06.896580 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 02:11:06.904986 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 02:11:06.905935 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fee4:704e', 'fe80::d4e0:76ff:fe99:10f4', 'fe80::fc16:3eff:feef:e02d'] 
May 28 02:11:06.906109 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 02:11:06.906244 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 02:11:06.906494 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] <== get_connector_properties: return (87ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:11:07.190336 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2badef5b-f3bd-44f1-9b39-775f996d02c0 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.317s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:11:07.235841 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-2badef5b-f3bd-44f1-9b39-775f996d02c0 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Deleted allocations for instance 88e7dd8f-33f3-46e8-8d17-b9451bb627e5
May 28 02:11:07.385262 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Successfully updated port: af3509df-12e0-45a5-89d5-8b4aba6b5ca4 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 02:11:07.395919 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 02:11:07.431398 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b5ab0ea2-507c-409c-8f0f-664f8a88dadc req-2b55eb92-fad9-4f49-88cc-33b26b8d8741 service nova] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Received event network-changed-af3509df-12e0-45a5-89d5-8b4aba6b5ca4 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:11:07.431507 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-b5ab0ea2-507c-409c-8f0f-664f8a88dadc req-2b55eb92-fad9-4f49-88cc-33b26b8d8741 service nova] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Refreshing instance network info cache due to event network-changed-af3509df-12e0-45a5-89d5-8b4aba6b5ca4. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:11:07.431744 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b5ab0ea2-507c-409c-8f0f-664f8a88dadc req-2b55eb92-fad9-4f49-88cc-33b26b8d8741 service nova] Acquiring lock "refresh_cache-3ce63103-8c3e-4a5b-a2fb-d90055411d08" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:11:07.431832 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b5ab0ea2-507c-409c-8f0f-664f8a88dadc req-2b55eb92-fad9-4f49-88cc-33b26b8d8741 service nova] Acquired lock "refresh_cache-3ce63103-8c3e-4a5b-a2fb-d90055411d08" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:11:07.431941 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-b5ab0ea2-507c-409c-8f0f-664f8a88dadc req-2b55eb92-fad9-4f49-88cc-33b26b8d8741 service nova] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Refreshing network info cache for port af3509df-12e0-45a5-89d5-8b4aba6b5ca4 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:11:07.887435 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Acquiring lock "refresh_cache-3ce63103-8c3e-4a5b-a2fb-d90055411d08" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:11:07.933882 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-b5ab0ea2-507c-409c-8f0f-664f8a88dadc req-2b55eb92-fad9-4f49-88cc-33b26b8d8741 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:11:07.989274 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-b5ab0ea2-507c-409c-8f0f-664f8a88dadc req-2b55eb92-fad9-4f49-88cc-33b26b8d8741 service nova] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:11:07.991747 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Starting finish_revert_migration {{(pid=98241) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12932}}
May 28 02:11:08.005972 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Start _get_guest_xml network_info=[{"id": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "address": "fa:16:3e:1d:39:9a", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe49fa27-da", "ovs_interfaceid": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2ca44659-a2eb-4952-8736-4ccf8052ec61', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '5f8cf96c-2c00-493d-afe2-2ea77a834767', 'attached_at': '2026-05-28T02:11:07.000000', 'detached_at': '', 'volume_id': '2ca44659-a2eb-4952-8736-4ccf8052ec61', 'serial': '2ca44659-a2eb-4952-8736-4ccf8052ec61'}, 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'attachment_id': '66f6b5f5-af22-4658-ba8e-7646191bb71d', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 02:11:08.008236 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:11:08.009307 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1932077210', uuid='5f8cf96c-2c00-493d-afe2-2ea77a834767'), owner=OwnerMeta(userid='0f09c9f1da7e4d32979e47c96d41ae99', username='tempest-TestEncryptedCinderVolumes-243696963-project-member', projectid='d192b18567fd4735988dd19da06fb868', projectname='tempest-TestEncryptedCinderVolumes-243696963'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "address": "fa:16:3e:1d:39:9a", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe49fa27-da", "ovs_interfaceid": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779934268.0089648) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 02:11:08.010354 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 02:11:08.010677 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 02:11:08.011722 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 02:11:08.011877 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 02:11:08.012914 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 02:11:08.013249 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 02:11:08.013450 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 02:11:08.013593 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 02:11:08.013764 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 02:11:08.013885 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 02:11:08.014036 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 02:11:08.014282 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 02:11:08.014515 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 02:11:08.014679 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 02:11:08.014989 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 02:11:08.015133 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 02:11:08.015336 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5f8cf96c-2c00-493d-afe2-2ea77a834767 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:11:08.140717 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-b5ab0ea2-507c-409c-8f0f-664f8a88dadc req-2b55eb92-fad9-4f49-88cc-33b26b8d8741 service nova] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:11:08.245366 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2badef5b-f3bd-44f1-9b39-775f996d02c0 tempest-SnapshotDataIntegrityTests-432938357 tempest-SnapshotDataIntegrityTests-432938357-project-member] Lock "88e7dd8f-33f3-46e8-8d17-b9451bb627e5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.283s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:11:08.312718 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:08.405927 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 02:11:08.406686 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 02:11:08.406889 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Creating image(s)
May 28 02:11:08.407317 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Acquiring lock "/opt/stack/data/nova/instances/3ce63103-8c3e-4a5b-a2fb-d90055411d08/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:11:08.407459 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "/opt/stack/data/nova/instances/3ce63103-8c3e-4a5b-a2fb-d90055411d08/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:11:08.407867 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "/opt/stack/data/nova/instances/3ce63103-8c3e-4a5b-a2fb-d90055411d08/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:11:08.408455 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:11:08.410915 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:11:08.411988 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:11:08.500097 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.088s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:11:08.500595 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:11:08.501137 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:11:08.501611 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:11:08.504212 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:11:08.504571 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:11:08.537157 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767/disk.config --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:11:08.603011 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.098s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:11:08.604002 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/3ce63103-8c3e-4a5b-a2fb-d90055411d08/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:11:08.644792 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-b5ab0ea2-507c-409c-8f0f-664f8a88dadc req-2b55eb92-fad9-4f49-88cc-33b26b8d8741 service nova] Releasing lock "refresh_cache-3ce63103-8c3e-4a5b-a2fb-d90055411d08" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:11:08.646124 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Acquired lock "refresh_cache-3ce63103-8c3e-4a5b-a2fb-d90055411d08" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:11:08.646259 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:11:08.648700 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:08.651510 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767/disk.config --force-share --output=json" returned: 0 in 0.115s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:11:08.652219 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "/opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:11:08.652636 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "/opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:11:08.653344 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "/opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:11:08.653860 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 02:11:08.654521 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2ca44659-a2eb-4952-8736-4ccf8052ec61', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:11:08.654747 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:11:08.656055 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:11:08.656650 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2ca44659-a2eb-4952-8736-4ccf8052ec61', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 02:11:08.669100 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:11:08.670034 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:11:08.670511 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:11:08.670760 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:11:08.671106 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:11:08.671341 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:11:08.675909 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/3ce63103-8c3e-4a5b-a2fb-d90055411d08/disk 1073741824" returned: 0 in 0.072s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:11:08.676788 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.175s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:11:08.676788 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:11:08.692027 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:11:08.692027 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:11:08.693634 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:11:08.693634 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:11:08.704188 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61] added
May 28 02:11:08.704188 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:11:08.704188 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:11:08.704188 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:11:08.704188 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:11:08.704188 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:11:08.704188 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:11:08.704502 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:11:08.705052 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.034(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:11:08.705387 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:11:08.710179 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61] added
May 28 02:11:08.710179 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:11:08.710179 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:11:08.710179 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:11:08.710179 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:11:08.710179 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:11:08.710179 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:11:08.710391 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:11:08.710587 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0393(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:11:08.710722 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:11:08.771116 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.094s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:11:08.771276 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3ce63103-8c3e-4a5b-a2fb-d90055411d08/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 02:11:08.771649 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ce63103-8c3e-4a5b-a2fb-d90055411d08/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:11:08.864249 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ce63103-8c3e-4a5b-a2fb-d90055411d08/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:11:08.864647 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Cannot resize image /opt/stack/data/nova/instances/3ce63103-8c3e-4a5b-a2fb-d90055411d08/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 02:11:08.865248 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 02:11:08.865408 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Ensure instance console log exists: /opt/stack/data/nova/instances/3ce63103-8c3e-4a5b-a2fb-d90055411d08/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 02:11:08.865651 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:11:08.865867 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:11:08.865989 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:11:09.210157 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:11:09.344535 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:11:09.473344 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Updating instance_info_cache with network_info: [{"id": "af3509df-12e0-45a5-89d5-8b4aba6b5ca4", "address": "fa:16:3e:9c:50:c4", "network": {"id": "ff6dd0d5-1bec-49e1-b85f-c4257cd37d52", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-230174350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a20805bca06645eabf880bb71e4b69e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3509df-12", "ovs_interfaceid": "af3509df-12e0-45a5-89d5-8b4aba6b5ca4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:11:09.706013 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:11:09.711296 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:11:09.718642 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:11:09.718642 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:11:09.725833 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:11:09.725833 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:11:09.732116 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:11:09.739103 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:11:09.751051 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:11:09.751051 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:11:09.751051 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:11:09.751051 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:11:09.751051 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:11:09.751051 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:11:09.751051 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:11:09.751051 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:11:09.751051 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:11:09.751051 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:11:09.752838 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:11:09.752838 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:11:09.752838 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:11:09.752838 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:11:09.752838 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:11:09.752999 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:11:09.752999 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:11:09.752999 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:11:09.752999 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:11:09.752999 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:11:09.782407 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61, portal: 192.168.40.100,3260]
May 28 02:11:09.782407 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61, portal: 192.168.40.100,3260] successful.
May 28 02:11:09.782407 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:11:09.791964 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61, portal: 192.168.50.100,3260]
May 28 02:11:09.791964 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61, portal: 192.168.50.100,3260] successful.
May 28 02:11:09.791964 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:11:09.796676 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:11:09.803235 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:11:09.811883 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:11:09.811883 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:11:09.811883 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:11:09.811883 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:11:09.811883 np0000001583 nova-compute[98241]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:11:09.811883 np0000001583 nova-compute[98241]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:11:09.811883 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:11:09.812151 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:11:09.812151 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:11:09.812151 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:11:09.812151 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:11:09.812151 np0000001583 nova-compute[98241]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:11:09.812151 np0000001583 nova-compute[98241]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:11:09.812151 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:11:09.813029 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.142s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:11:09.813029 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:11:09.813771 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] HCTL ('7', '-', '-', 0) found on session 206 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:11:09.813883 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:11:09.819049 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:11:09.819049 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:11:09.819049 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:11:09.819049 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:11:09.819049 np0000001583 nova-compute[98241]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:11:09.819049 np0000001583 nova-compute[98241]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:11:09.819049 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:11:09.819273 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:11:09.819273 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:11:09.819273 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:11:09.819273 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:11:09.819273 np0000001583 nova-compute[98241]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:11:09.819273 np0000001583 nova-compute[98241]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:11:09.819273 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:11:09.820898 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.148s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:11:09.820898 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:11:09.820898 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] HCTL ('8', '-', '-', 0) found on session 207 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:11:09.820898 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:11:09.829585 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Searching for a device in session 206 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:11:09.829585 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2ca44659-a2eb-4952-8736-4ccf8052ec61', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:11:09.837250 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Searching for a device in session 207 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:11:09.837250 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2ca44659-a2eb-4952-8736-4ccf8052ec61', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:11:09.976997 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Releasing lock "refresh_cache-3ce63103-8c3e-4a5b-a2fb-d90055411d08" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:11:09.976997 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Instance network_info: |[{"id": "af3509df-12e0-45a5-89d5-8b4aba6b5ca4", "address": "fa:16:3e:9c:50:c4", "network": {"id": "ff6dd0d5-1bec-49e1-b85f-c4257cd37d52", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-230174350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a20805bca06645eabf880bb71e4b69e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3509df-12", "ovs_interfaceid": "af3509df-12e0-45a5-89d5-8b4aba6b5ca4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 02:11:09.978988 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Start _get_guest_xml network_info=[{"id": "af3509df-12e0-45a5-89d5-8b4aba6b5ca4", "address": "fa:16:3e:9c:50:c4", "network": {"id": "ff6dd0d5-1bec-49e1-b85f-c4257cd37d52", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-230174350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a20805bca06645eabf880bb71e4b69e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3509df-12", "ovs_interfaceid": "af3509df-12e0-45a5-89d5-8b4aba6b5ca4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 02:11:09.985952 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:11:09.987918 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-VolumesSnapshotTestJSON-instance-384843707', uuid='3ce63103-8c3e-4a5b-a2fb-d90055411d08'), owner=OwnerMeta(userid='d6c21669663a49f39202d3ca89337d19', username='tempest-VolumesSnapshotTestJSON-1803039293-project-member', projectid='a20805bca06645eabf880bb71e4b69e3', projectname='tempest-VolumesSnapshotTestJSON-1803039293'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "af3509df-12e0-45a5-89d5-8b4aba6b5ca4", "address": "fa:16:3e:9c:50:c4", "network": {"id": "ff6dd0d5-1bec-49e1-b85f-c4257cd37d52", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-230174350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a20805bca06645eabf880bb71e4b69e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3509df-12", "ovs_interfaceid": "af3509df-12e0-45a5-89d5-8b4aba6b5ca4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779934269.9874249) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 02:11:09.989399 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 02:11:09.989773 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 02:11:09.990770 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 02:11:09.990933 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 02:11:09.994546 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 02:11:09.994951 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 02:11:09.996352 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 02:11:09.996352 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 02:11:09.996352 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 02:11:09.996352 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 02:11:09.996352 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 02:11:09.996352 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 02:11:09.996352 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 02:11:09.996352 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 02:11:09.996352 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 02:11:09.996352 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 02:11:10.010600 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:11:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-384843707',display_name='tempest-VolumesSnapshotTestJSON-instance-384843707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-volumessnapshottestjson-instance-384843707',id=76,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxNe0MYeOzu1rv+GQ0lcSCtUe9pRSrf8tzXRp1HxeWRfhyyQci9mgcUsHtuCDVK8RCfQ1YYBEXvfX2IFzb+2gmqrdP7ptO2XA/8IakPZC0ldBQRbJtwxZcRcpwFzEsYQg==',key_name='tempest-keypair-327744188',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a20805bca06645eabf880bb71e4b69e3',ramdisk_id='',reservation_id='r-4uw8ma5o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1803039293',owner_user_name='tempest-VolumesSnapshotTestJSON-1803039293-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:11:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6c21669663a49f39202d3ca89337d19',uuid=3ce63103-8c3e-4a5b-a2fb-d90055411d08,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af3509df-12e0-45a5-89d5-8b4aba6b5ca4", "address": "fa:16:3e:9c:50:c4", "network": {"id": "ff6dd0d5-1bec-49e1-b85f-c4257cd37d52", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-230174350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a20805bca06645eabf880bb71e4b69e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3509df-12", "ovs_interfaceid": "af3509df-12e0-45a5-89d5-8b4aba6b5ca4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 02:11:10.010600 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Converting VIF {"id": "af3509df-12e0-45a5-89d5-8b4aba6b5ca4", "address": "fa:16:3e:9c:50:c4", "network": {"id": "ff6dd0d5-1bec-49e1-b85f-c4257cd37d52", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-230174350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a20805bca06645eabf880bb71e4b69e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3509df-12", "ovs_interfaceid": "af3509df-12e0-45a5-89d5-8b4aba6b5ca4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:11:10.010600 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:50:c4,bridge_name='br-int',has_traffic_filtering=True,id=af3509df-12e0-45a5-89d5-8b4aba6b5ca4,network=Network(ff6dd0d5-1bec-49e1-b85f-c4257cd37d52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf3509df-12') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:11:10.010600 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lazy-loading 'pci_devices' on Instance uuid 3ce63103-8c3e-4a5b-a2fb-d90055411d08 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:11:10.314744 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:10.513058 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] End _get_guest_xml xml=<domain type="qemu">
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:   <uuid>3ce63103-8c3e-4a5b-a2fb-d90055411d08</uuid>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:   <name>instance-0000004c</name>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:   <metadata>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-384843707</nova:name>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 02:11:09</nova:creationTime>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:       </nova:image>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:         <nova:user uuid="d6c21669663a49f39202d3ca89337d19">tempest-VolumesSnapshotTestJSON-1803039293-project-member</nova:user>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:         <nova:project uuid="a20805bca06645eabf880bb71e4b69e3">tempest-VolumesSnapshotTestJSON-1803039293</nova:project>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:         <nova:port uuid="af3509df-12e0-45a5-89d5-8b4aba6b5ca4">
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:         </nova:port>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:   </metadata>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:     <system>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:       <entry name="serial">3ce63103-8c3e-4a5b-a2fb-d90055411d08</entry>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:       <entry name="uuid">3ce63103-8c3e-4a5b-a2fb-d90055411d08</entry>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:     </system>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:   <os>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:   </os>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:   <features>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:     <acpi/>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:     <tcg>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:     </tcg>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:   </features>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:   </cpu>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:   <devices>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/3ce63103-8c3e-4a5b-a2fb-d90055411d08/disk"/>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:     </disk>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/3ce63103-8c3e-4a5b-a2fb-d90055411d08/disk.config"/>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:     </disk>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:9c:50:c4"/>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:       <target dev="tapaf3509df-12"/>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:     </interface>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/3ce63103-8c3e-4a5b-a2fb-d90055411d08/console.log" append="off"/>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:     </serial>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:     <video>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:     </video>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:     </rng>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:     </memballoon>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:   </devices>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]: </domain>
May 28 02:11:10.513058 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 02:11:10.514917 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Preparing to wait for external event network-vif-plugged-af3509df-12e0-45a5-89d5-8b4aba6b5ca4 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 02:11:10.514917 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Acquiring lock "3ce63103-8c3e-4a5b-a2fb-d90055411d08-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:11:10.514917 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "3ce63103-8c3e-4a5b-a2fb-d90055411d08-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:11:10.514917 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "3ce63103-8c3e-4a5b-a2fb-d90055411d08-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:11:10.514917 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:11:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-384843707',display_name='tempest-VolumesSnapshotTestJSON-instance-384843707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-volumessnapshottestjson-instance-384843707',id=76,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxNe0MYeOzu1rv+GQ0lcSCtUe9pRSrf8tzXRp1HxeWRfhyyQci9mgcUsHtuCDVK8RCfQ1YYBEXvfX2IFzb+2gmqrdP7ptO2XA/8IakPZC0ldBQRbJtwxZcRcpwFzEsYQg==',key_name='tempest-keypair-327744188',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a20805bca06645eabf880bb71e4b69e3',ramdisk_id='',reservation_id='r-4uw8ma5o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1803039293',owner_user_name='tempest-VolumesSnapshotTestJSON-1803039293-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:11:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6c21669663a49f39202d3ca89337d19',uuid=3ce63103-8c3e-4a5b-a2fb-d90055411d08,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af3509df-12e0-45a5-89d5-8b4aba6b5ca4", "address": "fa:16:3e:9c:50:c4", "network": {"id": "ff6dd0d5-1bec-49e1-b85f-c4257cd37d52", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-230174350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a20805bca06645eabf880bb71e4b69e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3509df-12", "ovs_interfaceid": "af3509df-12e0-45a5-89d5-8b4aba6b5ca4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 02:11:10.514917 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Converting VIF {"id": "af3509df-12e0-45a5-89d5-8b4aba6b5ca4", "address": "fa:16:3e:9c:50:c4", "network": {"id": "ff6dd0d5-1bec-49e1-b85f-c4257cd37d52", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-230174350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a20805bca06645eabf880bb71e4b69e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3509df-12", "ovs_interfaceid": "af3509df-12e0-45a5-89d5-8b4aba6b5ca4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:11:10.514917 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:50:c4,bridge_name='br-int',has_traffic_filtering=True,id=af3509df-12e0-45a5-89d5-8b4aba6b5ca4,network=Network(ff6dd0d5-1bec-49e1-b85f-c4257cd37d52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf3509df-12') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:11:10.515297 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:50:c4,bridge_name='br-int',has_traffic_filtering=True,id=af3509df-12e0-45a5-89d5-8b4aba6b5ca4,network=Network(ff6dd0d5-1bec-49e1-b85f-c4257cd37d52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf3509df-12') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 02:11:10.515464 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:10.515767 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:11:10.516034 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 02:11:10.517454 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:10.517673 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5402bae3-97a0-5bd6-a14b-23a97db9a2bc', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:11:10.518477 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:10.519255 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:11:10.521613 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:10.521807 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf3509df-12, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:11:10.522255 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaf3509df-12, col_values=(('qos', UUID('f3bdcb4e-a534-4fff-be67-fe7795db09f2')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:11:10.522479 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaf3509df-12, col_values=(('external_ids', {'iface-id': 'af3509df-12e0-45a5-89d5-8b4aba6b5ca4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:50:c4', 'vm-uuid': '3ce63103-8c3e-4a5b-a2fb-d90055411d08'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:11:10.523344 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:10.524387 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:11:10.528561 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:10.529325 np0000001583 nova-compute[98241]: INFO os_vif [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:50:c4,bridge_name='br-int',has_traffic_filtering=True,id=af3509df-12e0-45a5-89d5-8b4aba6b5ca4,network=Network(ff6dd0d5-1bec-49e1-b85f-c4257cd37d52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf3509df-12')
May 28 02:11:10.670598 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 02:11:11.688907 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Found WWN 3300000002d77a713 for multipath device dm-0 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 02:11:11.689394 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:11:11.690418 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '3300000002d77a713', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '3300000002d77a713'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:11:11.690721 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002d77a713', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '3300000002d77a713'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 02:11:11.725857 np0000001583 nova-compute[98241]: DEBUG os_brick.encryptors [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2ca44659-a2eb-4952-8736-4ccf8052ec61', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'attaching', 'instance': '5f8cf96c-2c00-493d-afe2-2ea77a834767', 'attached_at': '2026-05-28T02:11:07.000000', 'detached_at': '', 'volume_id': '2ca44659-a2eb-4952-8736-4ccf8052ec61', 'serial': '2ca44659-a2eb-4952-8736-4ccf8052ec61'} {{(pid=98241) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 02:11:11.726327 np0000001583 nova-compute[98241]: WARNING stevedore.named [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 02:11:11.727097 np0000001583 nova-compute[98241]: WARNING castellan.key_manager [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 02:11:11.727097 np0000001583 nova-compute[98241]: WARNING nova.keymgr.conf_key_mgr [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 02:11:11.745025 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Secret XML: <secret ephemeral="no" private="no">
May 28 02:11:11.745025 np0000001583 nova-compute[98241]:   <usage type="volume">
May 28 02:11:11.745025 np0000001583 nova-compute[98241]:     <volume>2ca44659-a2eb-4952-8736-4ccf8052ec61</volume>
May 28 02:11:11.745025 np0000001583 nova-compute[98241]:   </usage>
May 28 02:11:11.745025 np0000001583 nova-compute[98241]: </secret>
May 28 02:11:11.745025 np0000001583 nova-compute[98241]:  {{(pid=98241) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 28 02:11:11.979882 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:12.044612 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:11:12.044872 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:11:12.044872 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] No VIF found with MAC fa:16:3e:9c:50:c4, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:11:12.045388 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Using config drive
May 28 02:11:12.253774 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T02:09:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1932077210',display_name='tempest-TestEncryptedCinderVolumes-server-1932077210',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testencryptedcindervolumes-server-1932077210',id=73,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBun1fK3bqFH0DwFCe64dJxsemPDLJQjBBUXpAYHHMZ5VrGdrQWiAi1CAoY21xUJOnjgSHF/PvTCHsItl5nChH/jKvFpUNNLQ2Rj7QdmnLJ1lKVepbjJh5mCh3vTGal8fA==',key_name='tempest-keypair-1273682795',keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:10:54Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(13),node='np0000001583',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d192b18567fd4735988dd19da06fb868',ramdisk_id='',reservation_id='r-w015fch7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-TestEncryptedCinderVolumes-243696963',owner_user_name='tempest-TestEncryptedCinderVolumes-243696963-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T02:10:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f09c9f1da7e4d32979e47c96d41ae99',uuid=5f8cf96c-2c00-493d-afe2-2ea77a834767,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "address": "fa:16:3e:1d:39:9a", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe49fa27-da", "ovs_interfaceid": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 02:11:12.253961 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Converting VIF {"id": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "address": "fa:16:3e:1d:39:9a", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe49fa27-da", "ovs_interfaceid": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:11:12.254498 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:39:9a,bridge_name='br-int',has_traffic_filtering=True,id=fe49fa27-da6a-4d8f-ab1e-bb280d24658c,network=Network(fccbc55c-a449-42c3-bf68-d3d337f7b0ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe49fa27-da') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:11:12.256071 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] End _get_guest_xml xml=<domain type="qemu">
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:   <uuid>5f8cf96c-2c00-493d-afe2-2ea77a834767</uuid>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:   <name>instance-00000049</name>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:   <metadata>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1932077210</nova:name>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 02:11:08</nova:creationTime>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:       </nova:image>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:         <nova:user uuid="0f09c9f1da7e4d32979e47c96d41ae99">tempest-TestEncryptedCinderVolumes-243696963-project-member</nova:user>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:         <nova:project uuid="d192b18567fd4735988dd19da06fb868">tempest-TestEncryptedCinderVolumes-243696963</nova:project>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:         <nova:port uuid="fe49fa27-da6a-4d8f-ab1e-bb280d24658c">
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:         </nova:port>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:   </metadata>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:     <system>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:       <entry name="serial">5f8cf96c-2c00-493d-afe2-2ea77a834767</entry>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:       <entry name="uuid">5f8cf96c-2c00-493d-afe2-2ea77a834767</entry>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:     </system>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:   <os>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:   </os>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:   <features>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:     <acpi/>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:     <tcg>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:     </tcg>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:   </features>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:   </cpu>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:   <devices>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767/disk"/>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:     </disk>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767/disk.config"/>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:     </disk>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:     <disk type="block" device="disk">
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:       <alias name="ua-2ca44659-a2eb-4952-8736-4ccf8052ec61"/>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:       <target dev="vdb" bus="virtio"/>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:       <serial>2ca44659-a2eb-4952-8736-4ccf8052ec61</serial>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:       <encryption format="luks">
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:         <secret type="passphrase" uuid="71b42b19-1186-49d5-bb92-67517395a6b6"/>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:       </encryption>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:     </disk>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:1d:39:9a"/>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:       <target dev="tapfe49fa27-da"/>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:     </interface>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767/console.log" append="off"/>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:     </serial>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:     <video>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:     </video>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:     </rng>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:     </memballoon>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:   </devices>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]: </domain>
May 28 02:11:12.256071 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 02:11:12.258021 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Preparing to wait for external event network-vif-plugged-fe49fa27-da6a-4d8f-ab1e-bb280d24658c {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 02:11:12.258021 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "5f8cf96c-2c00-493d-afe2-2ea77a834767-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:11:12.258021 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "5f8cf96c-2c00-493d-afe2-2ea77a834767-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:11:12.258021 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "5f8cf96c-2c00-493d-afe2-2ea77a834767-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:11:12.258021 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T02:09:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1932077210',display_name='tempest-TestEncryptedCinderVolumes-server-1932077210',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testencryptedcindervolumes-server-1932077210',id=73,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBun1fK3bqFH0DwFCe64dJxsemPDLJQjBBUXpAYHHMZ5VrGdrQWiAi1CAoY21xUJOnjgSHF/PvTCHsItl5nChH/jKvFpUNNLQ2Rj7QdmnLJ1lKVepbjJh5mCh3vTGal8fA==',key_name='tempest-keypair-1273682795',keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:10:54Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(13),node='np0000001583',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d192b18567fd4735988dd19da06fb868',ramdisk_id='',reservation_id='r-w015fch7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-TestEncryptedCinderVolumes-243696963',owner_user_name='tempest-TestEncryptedCinderVolumes-243696963-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T02:10:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f09c9f1da7e4d32979e47c96d41ae99',uuid=5f8cf96c-2c00-493d-afe2-2ea77a834767,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "address": "fa:16:3e:1d:39:9a", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe49fa27-da", "ovs_interfaceid": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 02:11:12.258021 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Converting VIF {"id": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "address": "fa:16:3e:1d:39:9a", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe49fa27-da", "ovs_interfaceid": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:11:12.258021 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:39:9a,bridge_name='br-int',has_traffic_filtering=True,id=fe49fa27-da6a-4d8f-ab1e-bb280d24658c,network=Network(fccbc55c-a449-42c3-bf68-d3d337f7b0ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe49fa27-da') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:11:12.258021 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:39:9a,bridge_name='br-int',has_traffic_filtering=True,id=fe49fa27-da6a-4d8f-ab1e-bb280d24658c,network=Network(fccbc55c-a449-42c3-bf68-d3d337f7b0ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe49fa27-da') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 02:11:12.258398 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:12.258541 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:11:12.258753 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 02:11:12.259902 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:12.260151 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c0fcca29-8d7d-56b4-8e39-2947409ce806', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:11:12.261179 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:12.261919 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:11:12.267645 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:12.269579 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:12.269788 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe49fa27-da, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:11:12.270121 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe49fa27-da, col_values=(('qos', UUID('2b7c6b62-4b2c-487b-b181-1b0cd369649a')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:11:12.270256 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe49fa27-da, col_values=(('external_ids', {'iface-id': 'fe49fa27-da6a-4d8f-ab1e-bb280d24658c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:39:9a', 'vm-uuid': '5f8cf96c-2c00-493d-afe2-2ea77a834767'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:11:12.271324 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:12.272686 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:11:12.280736 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:12.281941 np0000001583 nova-compute[98241]: INFO os_vif [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:39:9a,bridge_name='br-int',has_traffic_filtering=True,id=fe49fa27-da6a-4d8f-ab1e-bb280d24658c,network=Network(fccbc55c-a449-42c3-bf68-d3d337f7b0ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe49fa27-da')
May 28 02:11:12.551568 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:11:12.702788 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Creating config drive at /opt/stack/data/nova/instances/3ce63103-8c3e-4a5b-a2fb-d90055411d08/disk.config
May 28 02:11:12.706841 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3ce63103-8c3e-4a5b-a2fb-d90055411d08/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpx4zekb15 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:11:12.728333 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:12.756970 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:12.768319 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3ce63103-8c3e-4a5b-a2fb-d90055411d08/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpx4zekb15" returned: 0 in 0.061s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:11:12.858850 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:12.964744 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-73383420-7958-43a8-a64c-e875f22e8832 req-63fcc2be-8d94-4a0f-bca7-f6768a077cb7 service nova] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Received event network-vif-plugged-fe49fa27-da6a-4d8f-ab1e-bb280d24658c {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:11:12.965224 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-73383420-7958-43a8-a64c-e875f22e8832 req-63fcc2be-8d94-4a0f-bca7-f6768a077cb7 service nova] Acquiring lock "5f8cf96c-2c00-493d-afe2-2ea77a834767-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:11:12.965224 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-73383420-7958-43a8-a64c-e875f22e8832 req-63fcc2be-8d94-4a0f-bca7-f6768a077cb7 service nova] Lock "5f8cf96c-2c00-493d-afe2-2ea77a834767-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:11:12.965360 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-73383420-7958-43a8-a64c-e875f22e8832 req-63fcc2be-8d94-4a0f-bca7-f6768a077cb7 service nova] Lock "5f8cf96c-2c00-493d-afe2-2ea77a834767-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:11:12.965530 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-73383420-7958-43a8-a64c-e875f22e8832 req-63fcc2be-8d94-4a0f-bca7-f6768a077cb7 service nova] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Processing event network-vif-plugged-fe49fa27-da6a-4d8f-ab1e-bb280d24658c {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 02:11:13.094283 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:13.101103 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:13.107763 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:13.126524 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:13.133934 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:13.327657 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:13.344953 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:13.440902 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:13.539210 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-abeb96c1-c0e1-444e-9113-ac8477ce9599 req-280407e8-b913-44fa-b231-5b9a15117423 service nova] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Received event network-vif-plugged-af3509df-12e0-45a5-89d5-8b4aba6b5ca4 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:11:13.539523 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-abeb96c1-c0e1-444e-9113-ac8477ce9599 req-280407e8-b913-44fa-b231-5b9a15117423 service nova] Acquiring lock "3ce63103-8c3e-4a5b-a2fb-d90055411d08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:11:13.539737 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-abeb96c1-c0e1-444e-9113-ac8477ce9599 req-280407e8-b913-44fa-b231-5b9a15117423 service nova] Lock "3ce63103-8c3e-4a5b-a2fb-d90055411d08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:11:13.539917 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-abeb96c1-c0e1-444e-9113-ac8477ce9599 req-280407e8-b913-44fa-b231-5b9a15117423 service nova] Lock "3ce63103-8c3e-4a5b-a2fb-d90055411d08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:11:13.540133 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-abeb96c1-c0e1-444e-9113-ac8477ce9599 req-280407e8-b913-44fa-b231-5b9a15117423 service nova] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Processing event network-vif-plugged-af3509df-12e0-45a5-89d5-8b4aba6b5ca4 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 02:11:13.648919 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:13.710780 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:13.712447 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:13.715001 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:13.734408 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:13.783479 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.00043944600020040525 future=<Future at 0x7724ec1f22a0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:11:13.784005 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Emitting event <LifecycleEvent: 1779934258.7829108, 5f8cf96c-2c00-493d-afe2-2ea77a834767 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:11:13.784168 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:11:13.784534 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] VM Stopped (Lifecycle Event)
May 28 02:11:13.784639 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=4.017625932000101 future=<Future at 0x7724f851e240 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:11:13.784737 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=4.0175119059999815 future=<Future at 0x7724f851e240 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:11:14.184594 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934274.1842127, 3ce63103-8c3e-4a5b-a2fb-d90055411d08 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:11:14.184781 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] VM Started (Lifecycle Event)
May 28 02:11:14.185758 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 02:11:14.188013 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 02:11:14.190645 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Instance spawned successfully.
May 28 02:11:14.190936 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 02:11:14.289197 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:11:14.692177 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:11:14.707253 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:11:14.707253 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:11:14.707435 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:11:14.708662 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:11:14.708662 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:11:14.708662 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:11:14.712536 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:11:14.968008 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 02:11:14.977249 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Instance running successfully.
May 28 02:11:14.977506 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] finish_revert_migration finished successfully. {{(pid=98241) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12978}}
May 28 02:11:15.038740 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-3285eea0-8513-46fc-8261-70ac551a9830 req-a7aaa1b0-ce22-45ac-8e93-c3798142016a service nova] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Received event network-vif-plugged-fe49fa27-da6a-4d8f-ab1e-bb280d24658c {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:11:15.038740 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-3285eea0-8513-46fc-8261-70ac551a9830 req-a7aaa1b0-ce22-45ac-8e93-c3798142016a service nova] Acquiring lock "5f8cf96c-2c00-493d-afe2-2ea77a834767-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:11:15.038740 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-3285eea0-8513-46fc-8261-70ac551a9830 req-a7aaa1b0-ce22-45ac-8e93-c3798142016a service nova] Lock "5f8cf96c-2c00-493d-afe2-2ea77a834767-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:11:15.038740 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-3285eea0-8513-46fc-8261-70ac551a9830 req-a7aaa1b0-ce22-45ac-8e93-c3798142016a service nova] Lock "5f8cf96c-2c00-493d-afe2-2ea77a834767-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:11:15.038740 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-3285eea0-8513-46fc-8261-70ac551a9830 req-a7aaa1b0-ce22-45ac-8e93-c3798142016a service nova] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] No waiting events found dispatching network-vif-plugged-fe49fa27-da6a-4d8f-ab1e-bb280d24658c {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:11:15.038740 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-3285eea0-8513-46fc-8261-70ac551a9830 req-a7aaa1b0-ce22-45ac-8e93-c3798142016a service nova] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Received unexpected event network-vif-plugged-fe49fa27-da6a-4d8f-ab1e-bb280d24658c for instance with vm_state resized and task_state resize_reverting.
May 28 02:11:15.214734 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Took 6.81 seconds to spawn the instance on the hypervisor.
May 28 02:11:15.215412 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 02:11:15.215679 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:11:15.215945 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934275.2157655, 3ce63103-8c3e-4a5b-a2fb-d90055411d08 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:11:15.216104 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] VM Paused (Lifecycle Event)
May 28 02:11:15.621013 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-49612e5d-99f9-4694-855a-046d5b3dffd3 req-2ceec1d2-72ff-49ec-89f8-bb3750e48590 service nova] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Received event network-vif-plugged-af3509df-12e0-45a5-89d5-8b4aba6b5ca4 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:11:15.621227 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-49612e5d-99f9-4694-855a-046d5b3dffd3 req-2ceec1d2-72ff-49ec-89f8-bb3750e48590 service nova] Acquiring lock "3ce63103-8c3e-4a5b-a2fb-d90055411d08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:11:15.621398 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-49612e5d-99f9-4694-855a-046d5b3dffd3 req-2ceec1d2-72ff-49ec-89f8-bb3750e48590 service nova] Lock "3ce63103-8c3e-4a5b-a2fb-d90055411d08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:11:15.621559 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-49612e5d-99f9-4694-855a-046d5b3dffd3 req-2ceec1d2-72ff-49ec-89f8-bb3750e48590 service nova] Lock "3ce63103-8c3e-4a5b-a2fb-d90055411d08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:11:15.621671 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-49612e5d-99f9-4694-855a-046d5b3dffd3 req-2ceec1d2-72ff-49ec-89f8-bb3750e48590 service nova] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] No waiting events found dispatching network-vif-plugged-af3509df-12e0-45a5-89d5-8b4aba6b5ca4 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:11:15.621792 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-49612e5d-99f9-4694-855a-046d5b3dffd3 req-2ceec1d2-72ff-49ec-89f8-bb3750e48590 service nova] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Received unexpected event network-vif-plugged-af3509df-12e0-45a5-89d5-8b4aba6b5ca4 for instance with vm_state active and task_state None.
May 28 02:11:15.718735 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:11:15.723257 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934275.7229323, 3ce63103-8c3e-4a5b-a2fb-d90055411d08 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:11:15.723419 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] VM Resumed (Lifecycle Event)
May 28 02:11:15.728272 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Took 12.81 seconds to build instance.
May 28 02:11:16.051283 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-ebc56a5a-7f79-4129-a714-c440e33b5652 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Updating instance to original state: 'active'
May 28 02:11:16.228440 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:11:16.230063 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f7fbd4f7-758d-4c22-be05-78d82936528b tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "3ce63103-8c3e-4a5b-a2fb-d90055411d08" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.314s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:11:16.232572 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:11:16.273993 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:16.513537 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Acquiring lock "4d069122-da2e-445e-8ce3-377692925d87" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:11:16.513537 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "4d069122-da2e-445e-8ce3-377692925d87" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:11:16.736216 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934276.735876, 5f8cf96c-2c00-493d-afe2-2ea77a834767 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:11:16.736636 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] VM Started (Lifecycle Event)
May 28 02:11:17.016338 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 02:11:17.239742 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:11:17.242474 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:11:17.271949 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:17.568206 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:11:17.568527 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:11:17.574541 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 02:11:17.574749 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Claim successful on node np0000001583
May 28 02:11:17.684096 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0f3a07d3-024c-4b29-870c-3e2588d1c055 req-18914708-d3e1-4163-a515-4d51ddd37778 service nova] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Received event network-changed-af3509df-12e0-45a5-89d5-8b4aba6b5ca4 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:11:17.684301 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0f3a07d3-024c-4b29-870c-3e2588d1c055 req-18914708-d3e1-4163-a515-4d51ddd37778 service nova] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Refreshing instance network info cache due to event network-changed-af3509df-12e0-45a5-89d5-8b4aba6b5ca4. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:11:17.684521 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0f3a07d3-024c-4b29-870c-3e2588d1c055 req-18914708-d3e1-4163-a515-4d51ddd37778 service nova] Acquiring lock "refresh_cache-3ce63103-8c3e-4a5b-a2fb-d90055411d08" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:11:17.684721 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0f3a07d3-024c-4b29-870c-3e2588d1c055 req-18914708-d3e1-4163-a515-4d51ddd37778 service nova] Acquired lock "refresh_cache-3ce63103-8c3e-4a5b-a2fb-d90055411d08" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:11:17.684932 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-0f3a07d3-024c-4b29-870c-3e2588d1c055 req-18914708-d3e1-4163-a515-4d51ddd37778 service nova] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Refreshing network info cache for port af3509df-12e0-45a5-89d5-8b4aba6b5ca4 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:11:17.744775 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934277.7443974, 5f8cf96c-2c00-493d-afe2-2ea77a834767 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:11:17.745292 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] VM Paused (Lifecycle Event)
May 28 02:11:17.803024 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0006962560000829399 future=<Future at 0x7724f851e240 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:11:17.803506 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Emitting event <LifecycleEvent: 1779934262.8021874, 88e7dd8f-33f3-46e8-8d17-b9451bb627e5 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:11:17.803667 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:11:17.803807 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] VM Stopped (Lifecycle Event)
May 28 02:11:17.928346 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:17.998490 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c8ac6b1c-59b8-4763-9539-ed4ec5f17e35 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "5f8cf96c-2c00-493d-afe2-2ea77a834767" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:11:17.998726 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c8ac6b1c-59b8-4763-9539-ed4ec5f17e35 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "5f8cf96c-2c00-493d-afe2-2ea77a834767" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:11:18.188486 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-0f3a07d3-024c-4b29-870c-3e2588d1c055 req-18914708-d3e1-4163-a515-4d51ddd37778 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:11:18.247412 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:11:18.250139 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934278.2498064, 5f8cf96c-2c00-493d-afe2-2ea77a834767 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:11:18.252198 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] VM Resumed (Lifecycle Event)
May 28 02:11:18.306971 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 88e7dd8f-33f3-46e8-8d17-b9451bb627e5] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:11:18.501626 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-c8ac6b1c-59b8-4763-9539-ed4ec5f17e35 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Detaching volume 2ca44659-a2eb-4952-8736-4ccf8052ec61
May 28 02:11:18.529714 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-0f3a07d3-024c-4b29-870c-3e2588d1c055 req-18914708-d3e1-4163-a515-4d51ddd37778 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:11:18.544885 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-c8ac6b1c-59b8-4763-9539-ed4ec5f17e35 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Attempting to driver detach volume 2ca44659-a2eb-4952-8736-4ccf8052ec61 from mountpoint /dev/vdb
May 28 02:11:18.586236 np0000001583 nova-compute[98241]: DEBUG os_brick.encryptors [None req-c8ac6b1c-59b8-4763-9539-ed4ec5f17e35 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2ca44659-a2eb-4952-8736-4ccf8052ec61', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'attaching', 'instance': '5f8cf96c-2c00-493d-afe2-2ea77a834767', 'attached_at': '2026-05-28T02:11:07.000000', 'detached_at': '', 'volume_id': '2ca44659-a2eb-4952-8736-4ccf8052ec61', 'serial': '2ca44659-a2eb-4952-8736-4ccf8052ec61'} {{(pid=98241) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 02:11:18.589775 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-c8ac6b1c-59b8-4763-9539-ed4ec5f17e35 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Found disk vdb by alias ua-2ca44659-a2eb-4952-8736-4ccf8052ec61 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:11:18.590980 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-c8ac6b1c-59b8-4763-9539-ed4ec5f17e35 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Found disk vdb by alias ua-2ca44659-a2eb-4952-8736-4ccf8052ec61 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:11:18.591099 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-c8ac6b1c-59b8-4763-9539-ed4ec5f17e35 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Attempting to detach device vdb from instance 5f8cf96c-2c00-493d-afe2-2ea77a834767 from the persistent domain config. {{(pid=98241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 02:11:18.591368 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-c8ac6b1c-59b8-4763-9539-ed4ec5f17e35 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:11:18.591368 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:11:18.591368 np0000001583 nova-compute[98241]:   <alias name="ua-2ca44659-a2eb-4952-8736-4ccf8052ec61"/>
May 28 02:11:18.591368 np0000001583 nova-compute[98241]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 28 02:11:18.591368 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:11:18.591368 np0000001583 nova-compute[98241]:   <serial>2ca44659-a2eb-4952-8736-4ccf8052ec61</serial>
May 28 02:11:18.591368 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 02:11:18.591368 np0000001583 nova-compute[98241]:   <encryption format="luks">
May 28 02:11:18.591368 np0000001583 nova-compute[98241]:     <secret type="passphrase" uuid="71b42b19-1186-49d5-bb92-67517395a6b6"/>
May 28 02:11:18.591368 np0000001583 nova-compute[98241]:   </encryption>
May 28 02:11:18.591368 np0000001583 nova-compute[98241]: </disk>
May 28 02:11:18.591368 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:11:18.597707 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-c8ac6b1c-59b8-4763-9539-ed4ec5f17e35 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Successfully detached device vdb from instance 5f8cf96c-2c00-493d-afe2-2ea77a834767 from the persistent domain config.
May 28 02:11:18.597923 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-c8ac6b1c-59b8-4763-9539-ed4ec5f17e35 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] (1/8): Attempting to detach device vdb with device alias ua-2ca44659-a2eb-4952-8736-4ccf8052ec61 from instance 5f8cf96c-2c00-493d-afe2-2ea77a834767 from the live domain config. {{(pid=98241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 02:11:18.598267 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-c8ac6b1c-59b8-4763-9539-ed4ec5f17e35 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:11:18.598267 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:11:18.598267 np0000001583 nova-compute[98241]:   <alias name="ua-2ca44659-a2eb-4952-8736-4ccf8052ec61"/>
May 28 02:11:18.598267 np0000001583 nova-compute[98241]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 28 02:11:18.598267 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:11:18.598267 np0000001583 nova-compute[98241]:   <serial>2ca44659-a2eb-4952-8736-4ccf8052ec61</serial>
May 28 02:11:18.598267 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 02:11:18.598267 np0000001583 nova-compute[98241]:   <encryption format="luks">
May 28 02:11:18.598267 np0000001583 nova-compute[98241]:     <secret type="passphrase" uuid="71b42b19-1186-49d5-bb92-67517395a6b6"/>
May 28 02:11:18.598267 np0000001583 nova-compute[98241]:   </encryption>
May 28 02:11:18.598267 np0000001583 nova-compute[98241]: </disk>
May 28 02:11:18.598267 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:11:18.651287 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:18.704589 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-0f3a07d3-024c-4b29-870c-3e2588d1c055 req-18914708-d3e1-4163-a515-4d51ddd37778 service nova] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Updated VIF entry in instance network info cache for port af3509df-12e0-45a5-89d5-8b4aba6b5ca4. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:11:18.704895 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-0f3a07d3-024c-4b29-870c-3e2588d1c055 req-18914708-d3e1-4163-a515-4d51ddd37778 service nova] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Updating instance_info_cache with network_info: [{"id": "af3509df-12e0-45a5-89d5-8b4aba6b5ca4", "address": "fa:16:3e:9c:50:c4", "network": {"id": "ff6dd0d5-1bec-49e1-b85f-c4257cd37d52", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-230174350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a20805bca06645eabf880bb71e4b69e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3509df-12", "ovs_interfaceid": "af3509df-12e0-45a5-89d5-8b4aba6b5ca4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:11:18.753242 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:11:18.759179 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:11:18.905618 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:11:18.905618 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:11:18.924825 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-c8ac6b1c-59b8-4763-9539-ed4ec5f17e35 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-2ca44659-a2eb-4952-8736-4ccf8052ec61 for instance 5f8cf96c-2c00-493d-afe2-2ea77a834767 {{(pid=98241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 02:11:19.206787 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0f3a07d3-024c-4b29-870c-3e2588d1c055 req-18914708-d3e1-4163-a515-4d51ddd37778 service nova] Releasing lock "refresh_cache-3ce63103-8c3e-4a5b-a2fb-d90055411d08" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:11:19.262507 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Received event <DeviceRemovedEvent: 1779934279.2620666, 5f8cf96c-2c00-493d-afe2-2ea77a834767 => ua-2ca44659-a2eb-4952-8736-4ccf8052ec61> from libvirt while the driver is waiting for it; dispatched. {{(pid=98241) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 02:11:19.265345 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-c8ac6b1c-59b8-4763-9539-ed4ec5f17e35 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Successfully detached device vdb from instance 5f8cf96c-2c00-493d-afe2-2ea77a834767 from the live domain config.
May 28 02:11:19.268220 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8ac6b1c-59b8-4763-9539-ed4ec5f17e35 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:11:19.268563 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ac6b1c-59b8-4763-9539-ed4ec5f17e35 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2ca44659-a2eb-4952-8736-4ccf8052ec61', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:11:19.268860 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-c8ac6b1c-59b8-4763-9539-ed4ec5f17e35 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:11:19.269259 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-c8ac6b1c-59b8-4763-9539-ed4ec5f17e35 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:11:19.269575 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ac6b1c-59b8-4763-9539-ed4ec5f17e35 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2ca44659-a2eb-4952-8736-4ccf8052ec61', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:11:19.269720 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ac6b1c-59b8-4763-9539-ed4ec5f17e35 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:11:19.308954 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ac6b1c-59b8-4763-9539-ed4ec5f17e35 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:11:19.308954 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:11:19.308954 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:11:19.308954 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:11:19.308954 np0000001583 nova-compute[98241]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:11:19.308954 np0000001583 nova-compute[98241]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:11:19.308954 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:11:19.310447 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ac6b1c-59b8-4763-9539-ed4ec5f17e35 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:11:19.310447 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:11:19.310447 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:11:19.310447 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:11:19.310447 np0000001583 nova-compute[98241]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:11:19.310447 np0000001583 nova-compute[98241]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61 (non-flash)
May 28 02:11:19.310447 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:11:19.312168 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ac6b1c-59b8-4763-9539-ed4ec5f17e35 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb', '181'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb', '182'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0', '194'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0', '195'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', '206'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', '207')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:11:19.312506 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ac6b1c-59b8-4763-9539-ed4ec5f17e35 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', '206')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:11:19.315032 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ac6b1c-59b8-4763-9539-ed4ec5f17e35 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61', '207')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:11:19.316129 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ac6b1c-59b8-4763-9539-ed4ec5f17e35 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724ec2c54e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61'): ({'sdc'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:11:19.316461 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-c8ac6b1c-59b8-4763-9539-ed4ec5f17e35 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Removing multipathed devices sdc, sdb {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:11:19.316822 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-c8ac6b1c-59b8-4763-9539-ed4ec5f17e35 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Flush multipath device 3300000002d77a713 {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:11:19.355287 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-c8ac6b1c-59b8-4763-9539-ed4ec5f17e35 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:11:19.407582 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-c8ac6b1c-59b8-4763-9539-ed4ec5f17e35 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:11:19.408754 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:11:19.458887 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-c8ac6b1c-59b8-4763-9539-ed4ec5f17e35 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:11:19.459162 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-c8ac6b1c-59b8-4763-9539-ed4ec5f17e35 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:11:19.460578 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-c8ac6b1c-59b8-4763-9539-ed4ec5f17e35 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:11:19.472803 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-c8ac6b1c-59b8-4763-9539-ed4ec5f17e35 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:11:19.473073 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ac6b1c-59b8-4763-9539-ed4ec5f17e35 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:11:19.485026 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ac6b1c-59b8-4763-9539-ed4ec5f17e35 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:11:19.518336 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ac6b1c-59b8-4763-9539-ed4ec5f17e35 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 206, target: iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61, portal: 192.168.40.100,3260]
May 28 02:11:19.518336 np0000001583 nova-compute[98241]: Logout of [sid: 206, target: iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61, portal: 192.168.40.100,3260] successful.
May 28 02:11:19.518336 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:11:19.533440 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ac6b1c-59b8-4763-9539-ed4ec5f17e35 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:11:19.545377 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ac6b1c-59b8-4763-9539-ed4ec5f17e35 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:11:19.576224 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ac6b1c-59b8-4763-9539-ed4ec5f17e35 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 207, target: iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61, portal: 192.168.50.100,3260]
May 28 02:11:19.576224 np0000001583 nova-compute[98241]: Logout of [sid: 207, target: iqn.2023-03.storpool.com:os--volume-2ca44659-a2eb-4952-8736-4ccf8052ec61, portal: 192.168.50.100,3260] successful.
May 28 02:11:19.576224 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:11:19.593431 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ac6b1c-59b8-4763-9539-ed4ec5f17e35 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:11:19.594450 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-c8ac6b1c-59b8-4763-9539-ed4ec5f17e35 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:11:19.594616 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ac6b1c-59b8-4763-9539-ed4ec5f17e35 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] <== disconnect_volume: return (325ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:11:19.594753 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8ac6b1c-59b8-4763-9539-ed4ec5f17e35 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:11:19.915759 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.347s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:11:19.916221 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 02:11:20.147589 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-c8ac6b1c-59b8-4763-9539-ed4ec5f17e35 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lazy-loading 'flavor' on Instance uuid 5f8cf96c-2c00-493d-afe2-2ea77a834767 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:11:20.421928 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 02:11:20.423997 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 4d069122-da2e-445e-8ce3-377692925d87] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 02:11:20.424521 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:11:20.425752 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:11:20.501052 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c8ce004361ad4602a6f330506184114b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b5c56c77c64b318056094f7fa5861d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 02:11:20.926317 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 02:11:21.038567 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Successfully created port: cec7eafb-605b-44cc-ab7c-fb748c33f63e {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 02:11:21.152760 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c8ac6b1c-59b8-4763-9539-ed4ec5f17e35 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "5f8cf96c-2c00-493d-afe2-2ea77a834767" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.154s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:11:21.154467 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:21.350301 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2e61b7fc-e9f0-47f0-bf90-82e893ac6170 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "5f8cf96c-2c00-493d-afe2-2ea77a834767" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:11:21.350301 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2e61b7fc-e9f0-47f0-bf90-82e893ac6170 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "5f8cf96c-2c00-493d-afe2-2ea77a834767" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:11:21.350301 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2e61b7fc-e9f0-47f0-bf90-82e893ac6170 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "5f8cf96c-2c00-493d-afe2-2ea77a834767-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:11:21.350301 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2e61b7fc-e9f0-47f0-bf90-82e893ac6170 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "5f8cf96c-2c00-493d-afe2-2ea77a834767-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:11:21.350301 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2e61b7fc-e9f0-47f0-bf90-82e893ac6170 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "5f8cf96c-2c00-493d-afe2-2ea77a834767-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:11:21.351433 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-2e61b7fc-e9f0-47f0-bf90-82e893ac6170 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Terminating instance
May 28 02:11:21.429866 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 02:11:21.613353 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Successfully updated port: cec7eafb-605b-44cc-ab7c-fb748c33f63e {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 02:11:21.677064 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7a208095-27a0-43cd-b02a-ea6c27000fc5 req-a78645af-619b-4a02-8bf0-42060cd00c22 service nova] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Received event network-changed-cec7eafb-605b-44cc-ab7c-fb748c33f63e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:11:21.677211 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7a208095-27a0-43cd-b02a-ea6c27000fc5 req-a78645af-619b-4a02-8bf0-42060cd00c22 service nova] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Refreshing instance network info cache due to event network-changed-cec7eafb-605b-44cc-ab7c-fb748c33f63e. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:11:21.677400 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7a208095-27a0-43cd-b02a-ea6c27000fc5 req-a78645af-619b-4a02-8bf0-42060cd00c22 service nova] Acquiring lock "refresh_cache-4d069122-da2e-445e-8ce3-377692925d87" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:11:21.677517 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7a208095-27a0-43cd-b02a-ea6c27000fc5 req-a78645af-619b-4a02-8bf0-42060cd00c22 service nova] Acquired lock "refresh_cache-4d069122-da2e-445e-8ce3-377692925d87" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:11:21.677644 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-7a208095-27a0-43cd-b02a-ea6c27000fc5 req-a78645af-619b-4a02-8bf0-42060cd00c22 service nova] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Refreshing network info cache for port cec7eafb-605b-44cc-ab7c-fb748c33f63e {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:11:21.859215 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-2e61b7fc-e9f0-47f0-bf90-82e893ac6170 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 02:11:21.884945 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:21.908481 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:21.931983 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:21.934666 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:21.935367 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Booting with volume 5566f652-d0df-45d4-b7e0-0aac4c7371c0 at /dev/vda
May 28 02:11:21.988631 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:11:22.000651 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 02:11:22.026173 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:11:22.080047 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 02:11:22.080370 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 02:11:22.090510 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 02:11:22.091569 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fee4:704e', 'fe80::d4e0:76ff:fe99:10f4', 'fe80::fc16:3eff:feef:e02d', 'fe80::fc16:3eff:fe9c:50c4', 'fe80::2c76:91ff:fee7:3598'] 
May 28 02:11:22.091722 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 02:11:22.091880 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 02:11:22.092157 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] <== get_connector_properties: return (105ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:11:22.092431 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Updating existing volume attachment record: 73ddb2b3-f719-40a7-9489-2a4580bdac3d {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 02:11:22.117594 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Acquiring lock "refresh_cache-4d069122-da2e-445e-8ce3-377692925d87" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:11:22.143852 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-cff99e41-3714-4f0a-8565-c18c03114739 req-944e6933-7956-4dc7-963a-98f8a469422f service nova] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Received event network-vif-unplugged-fe49fa27-da6a-4d8f-ab1e-bb280d24658c {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:11:22.145394 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-cff99e41-3714-4f0a-8565-c18c03114739 req-944e6933-7956-4dc7-963a-98f8a469422f service nova] Acquiring lock "5f8cf96c-2c00-493d-afe2-2ea77a834767-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:11:22.145688 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-cff99e41-3714-4f0a-8565-c18c03114739 req-944e6933-7956-4dc7-963a-98f8a469422f service nova] Lock "5f8cf96c-2c00-493d-afe2-2ea77a834767-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:11:22.145913 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-cff99e41-3714-4f0a-8565-c18c03114739 req-944e6933-7956-4dc7-963a-98f8a469422f service nova] Lock "5f8cf96c-2c00-493d-afe2-2ea77a834767-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:11:22.146106 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-cff99e41-3714-4f0a-8565-c18c03114739 req-944e6933-7956-4dc7-963a-98f8a469422f service nova] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] No waiting events found dispatching network-vif-unplugged-fe49fa27-da6a-4d8f-ab1e-bb280d24658c {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:11:22.146308 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-cff99e41-3714-4f0a-8565-c18c03114739 req-944e6933-7956-4dc7-963a-98f8a469422f service nova] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Received event network-vif-unplugged-fe49fa27-da6a-4d8f-ab1e-bb280d24658c for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:11:22.181003 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-7a208095-27a0-43cd-b02a-ea6c27000fc5 req-a78645af-619b-4a02-8bf0-42060cd00c22 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:11:22.194034 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:11:22.194601 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:11:22.225434 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.998898477000239 future=<Future at 0x7724ec2ad2b0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:11:22.227492 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.997564411999974 future=<Future at 0x7724ec2ad2b0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:11:22.227492 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.99729440200008 future=<Future at 0x7724ec2ad2b0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:11:22.228281 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Instance destroyed successfully.
May 28 02:11:22.228961 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-2e61b7fc-e9f0-47f0-bf90-82e893ac6170 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lazy-loading 'resources' on Instance uuid 5f8cf96c-2c00-493d-afe2-2ea77a834767 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:11:22.274300 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:22.279153 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-7a208095-27a0-43cd-b02a-ea6c27000fc5 req-a78645af-619b-4a02-8bf0-42060cd00c22 service nova] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:11:22.447665 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-7a208095-27a0-43cd-b02a-ea6c27000fc5 req-a78645af-619b-4a02-8bf0-42060cd00c22 service nova] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:11:22.733093 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-2e61b7fc-e9f0-47f0-bf90-82e893ac6170 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T02:09:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1932077210',display_name='tempest-TestEncryptedCinderVolumes-server-1932077210',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testencryptedcindervolumes-server-1932077210',id=73,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBun1fK3bqFH0DwFCe64dJxsemPDLJQjBBUXpAYHHMZ5VrGdrQWiAi1CAoY21xUJOnjgSHF/PvTCHsItl5nChH/jKvFpUNNLQ2Rj7QdmnLJ1lKVepbjJh5mCh3vTGal8fA==',key_name='tempest-keypair-1273682795',keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:11:15Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d192b18567fd4735988dd19da06fb868',ramdisk_id='',reservation_id='r-w015fch7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-243696963',owner_user_name='tempest-TestEncryptedCinderVolumes-243696963-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T02:11:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f09c9f1da7e4d32979e47c96d41ae99',uuid=5f8cf96c-2c00-493d-afe2-2ea77a834767,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "address": "fa:16:3e:1d:39:9a", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe49fa27-da", "ovs_interfaceid": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:11:22.733287 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-2e61b7fc-e9f0-47f0-bf90-82e893ac6170 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Converting VIF {"id": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "address": "fa:16:3e:1d:39:9a", "network": {"id": "fccbc55c-a449-42c3-bf68-d3d337f7b0ed", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1586410659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d192b18567fd4735988dd19da06fb868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe49fa27-da", "ovs_interfaceid": "fe49fa27-da6a-4d8f-ab1e-bb280d24658c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:11:22.734277 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-2e61b7fc-e9f0-47f0-bf90-82e893ac6170 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:39:9a,bridge_name='br-int',has_traffic_filtering=True,id=fe49fa27-da6a-4d8f-ab1e-bb280d24658c,network=Network(fccbc55c-a449-42c3-bf68-d3d337f7b0ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe49fa27-da') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:11:22.734679 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-2e61b7fc-e9f0-47f0-bf90-82e893ac6170 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:39:9a,bridge_name='br-int',has_traffic_filtering=True,id=fe49fa27-da6a-4d8f-ab1e-bb280d24658c,network=Network(fccbc55c-a449-42c3-bf68-d3d337f7b0ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe49fa27-da') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:11:22.737398 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:22.737398 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe49fa27-da, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:11:22.738838 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:22.738838 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:11:22.739764 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:22.740804 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:22.740804 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2b7c6b62-4b2c-487b-b181-1b0cd369649a) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:11:22.741067 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:22.741588 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:11:22.741834 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:22.744750 np0000001583 nova-compute[98241]: INFO os_vif [None req-2e61b7fc-e9f0-47f0-bf90-82e893ac6170 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:39:9a,bridge_name='br-int',has_traffic_filtering=True,id=fe49fa27-da6a-4d8f-ab1e-bb280d24658c,network=Network(fccbc55c-a449-42c3-bf68-d3d337f7b0ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe49fa27-da')
May 28 02:11:22.745099 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-2e61b7fc-e9f0-47f0-bf90-82e893ac6170 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Deleting instance files /opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767_del
May 28 02:11:22.750623 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-2e61b7fc-e9f0-47f0-bf90-82e893ac6170 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Deletion of /opt/stack/data/nova/instances/5f8cf96c-2c00-493d-afe2-2ea77a834767_del complete
May 28 02:11:22.950802 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7a208095-27a0-43cd-b02a-ea6c27000fc5 req-a78645af-619b-4a02-8bf0-42060cd00c22 service nova] Releasing lock "refresh_cache-4d069122-da2e-445e-8ce3-377692925d87" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:11:22.954120 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Acquired lock "refresh_cache-4d069122-da2e-445e-8ce3-377692925d87" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:11:22.954352 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:11:22.990976 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:23.257282 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-2e61b7fc-e9f0-47f0-bf90-82e893ac6170 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Took 1.40 seconds to destroy the instance on the hypervisor.
May 28 02:11:23.258022 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-2e61b7fc-e9f0-47f0-bf90-82e893ac6170 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 02:11:23.258230 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 02:11:23.258330 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 02:11:23.258565 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:11:23.362480 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:11:23.524307 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:11:23.656540 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:23.714867 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:11:23.862423 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Updating instance_info_cache with network_info: [{"id": "cec7eafb-605b-44cc-ab7c-fb748c33f63e", "address": "fa:16:3e:1e:6f:c0", "network": {"id": "a349b3ac-cae9-4909-b273-8409a97fbe5c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-810622904-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60b5c56c77c64b318056094f7fa5861d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec7eafb-60", "ovs_interfaceid": "cec7eafb-605b-44cc-ab7c-fb748c33f63e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:11:24.206259 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a84a892a-e6bf-4262-8b49-45d9e23495f2 req-63acaa96-5512-41e1-b6ca-c0379dc951f6 service nova] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Received event network-vif-unplugged-fe49fa27-da6a-4d8f-ab1e-bb280d24658c {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:11:24.206685 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a84a892a-e6bf-4262-8b49-45d9e23495f2 req-63acaa96-5512-41e1-b6ca-c0379dc951f6 service nova] Acquiring lock "5f8cf96c-2c00-493d-afe2-2ea77a834767-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:11:24.206685 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a84a892a-e6bf-4262-8b49-45d9e23495f2 req-63acaa96-5512-41e1-b6ca-c0379dc951f6 service nova] Lock "5f8cf96c-2c00-493d-afe2-2ea77a834767-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:11:24.206815 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a84a892a-e6bf-4262-8b49-45d9e23495f2 req-63acaa96-5512-41e1-b6ca-c0379dc951f6 service nova] Lock "5f8cf96c-2c00-493d-afe2-2ea77a834767-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:11:24.206850 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a84a892a-e6bf-4262-8b49-45d9e23495f2 req-63acaa96-5512-41e1-b6ca-c0379dc951f6 service nova] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] No waiting events found dispatching network-vif-unplugged-fe49fa27-da6a-4d8f-ab1e-bb280d24658c {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:11:24.206983 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a84a892a-e6bf-4262-8b49-45d9e23495f2 req-63acaa96-5512-41e1-b6ca-c0379dc951f6 service nova] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Received event network-vif-unplugged-fe49fa27-da6a-4d8f-ab1e-bb280d24658c for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:11:24.207156 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a84a892a-e6bf-4262-8b49-45d9e23495f2 req-63acaa96-5512-41e1-b6ca-c0379dc951f6 service nova] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Received event network-vif-deleted-fe49fa27-da6a-4d8f-ab1e-bb280d24658c {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:11:24.207772 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-a84a892a-e6bf-4262-8b49-45d9e23495f2 req-63acaa96-5512-41e1-b6ca-c0379dc951f6 service nova] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Neutron deleted interface fe49fa27-da6a-4d8f-ab1e-bb280d24658c; detaching it from the instance and deleting it from the info cache
May 28 02:11:24.210527 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a84a892a-e6bf-4262-8b49-45d9e23495f2 req-63acaa96-5512-41e1-b6ca-c0379dc951f6 service nova] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Detach interface failed, port_id=fe49fa27-da6a-4d8f-ab1e-bb280d24658c, reason: Instance 5f8cf96c-2c00-493d-afe2-2ea77a834767 could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 02:11:24.218677 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 02:11:24.219667 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 02:11:24.219881 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Creating image(s)
May 28 02:11:24.221617 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Did not create local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 02:11:24.221803 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Ensure instance console log exists: /opt/stack/data/nova/instances/4d069122-da2e-445e-8ce3-377692925d87/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 02:11:24.221996 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:11:24.222164 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:11:24.222281 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:11:24.300139 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:11:24.364926 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Releasing lock "refresh_cache-4d069122-da2e-445e-8ce3-377692925d87" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:11:24.365112 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Instance network_info: |[{"id": "cec7eafb-605b-44cc-ab7c-fb748c33f63e", "address": "fa:16:3e:1e:6f:c0", "network": {"id": "a349b3ac-cae9-4909-b273-8409a97fbe5c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-810622904-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60b5c56c77c64b318056094f7fa5861d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec7eafb-60", "ovs_interfaceid": "cec7eafb-605b-44cc-ab7c-fb748c33f63e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 02:11:24.370111 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Start _get_guest_xml network_info=[{"id": "cec7eafb-605b-44cc-ab7c-fb748c33f63e", "address": "fa:16:3e:1e:6f:c0", "network": {"id": "a349b3ac-cae9-4909-b273-8409a97fbe5c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-810622904-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60b5c56c77c64b318056094f7fa5861d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec7eafb-60", "ovs_interfaceid": "cec7eafb-605b-44cc-ab7c-fb748c33f63e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0', 'iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5566f652-d0df-45d4-b7e0-0aac4c7371c0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '4d069122-da2e-445e-8ce3-377692925d87', 'attached_at': '', 'detached_at': '', 'volume_id': '5566f652-d0df-45d4-b7e0-0aac4c7371c0', 'serial': '5566f652-d0df-45d4-b7e0-0aac4c7371c0'}, 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '73ddb2b3-f719-40a7-9489-2a4580bdac3d', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 02:11:24.370111 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:11:24.370600 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPatternV346-server-1382185505', uuid='4d069122-da2e-445e-8ce3-377692925d87'), owner=OwnerMeta(userid='c8ce004361ad4602a6f330506184114b', username='tempest-TestVolumeBootPatternV346-884356236-project-member', projectid='60b5c56c77c64b318056094f7fa5861d', projectname='tempest-TestVolumeBootPatternV346-884356236'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "cec7eafb-605b-44cc-ab7c-fb748c33f63e", "address": "fa:16:3e:1e:6f:c0", "network": {"id": "a349b3ac-cae9-4909-b273-8409a97fbe5c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-810622904-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60b5c56c77c64b318056094f7fa5861d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec7eafb-60", "ovs_interfaceid": "cec7eafb-605b-44cc-ab7c-fb748c33f63e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779934284.37027) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 02:11:24.371982 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 02:11:24.372394 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 02:11:24.374343 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 02:11:24.375401 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 02:11:24.376103 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 02:11:24.376461 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 02:11:24.376621 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 02:11:24.376716 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 02:11:24.376868 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 02:11:24.376994 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 02:11:24.377153 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 02:11:24.377370 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 02:11:24.377520 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 02:11:24.377727 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 02:11:24.378357 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 02:11:24.378489 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 02:11:24.390353 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 02:11:24.390691 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0', 'iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5566f652-d0df-45d4-b7e0-0aac4c7371c0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:11:24.391618 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:11:24.391618 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:11:24.391618 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0', 'iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5566f652-d0df-45d4-b7e0-0aac4c7371c0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 02:11:24.406627 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:11:24.407397 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:11:24.407917 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:11:24.408147 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:11:24.409213 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:11:24.409213 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:11:24.422165 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:11:24.422165 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:11:24.427552 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:11:24.427552 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:11:24.439355 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0] added
May 28 02:11:24.439355 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:11:24.439355 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:11:24.439355 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:11:24.439355 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:11:24.439355 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:11:24.439355 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:11:24.439673 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:11:24.439874 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0316(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:11:24.441356 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0] added
May 28 02:11:24.441356 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:11:24.441356 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:11:24.441356 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:11:24.441356 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:11:24.441356 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:11:24.441356 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:11:24.441741 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:11:24.441966 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:11:24.442149 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0331(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:11:24.442319 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:11:24.804557 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Took 1.55 seconds to deallocate network for instance.
May 28 02:11:25.193795 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:11:25.194200 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:11:25.312733 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2e61b7fc-e9f0-47f0-bf90-82e893ac6170 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:11:25.313238 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2e61b7fc-e9f0-47f0-bf90-82e893ac6170 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:11:25.314572 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2e61b7fc-e9f0-47f0-bf90-82e893ac6170 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:11:25.381868 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-2e61b7fc-e9f0-47f0-bf90-82e893ac6170 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Deleted allocations for instance 5f8cf96c-2c00-493d-afe2-2ea77a834767
May 28 02:11:25.442165 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:11:25.442617 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:11:25.460875 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:11:25.460875 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:11:25.465496 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:11:25.465496 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:11:25.472641 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:11:25.478591 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:11:25.489381 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:11:25.489381 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:11:25.489381 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:11:25.489381 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:11:25.489381 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:11:25.489576 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:11:25.489576 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:11:25.489576 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:11:25.489576 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:11:25.489576 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:11:25.494707 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:11:25.494707 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:11:25.494707 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:11:25.494707 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:11:25.494707 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:11:25.494896 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:11:25.494896 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:11:25.494896 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:11:25.494896 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:11:25.494896 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:11:25.528657 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0, portal: 192.168.40.100,3260]
May 28 02:11:25.528657 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0, portal: 192.168.40.100,3260] successful.
May 28 02:11:25.528657 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:11:25.533850 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0, portal: 192.168.50.100,3260]
May 28 02:11:25.533850 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0, portal: 192.168.50.100,3260] successful.
May 28 02:11:25.533850 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:11:25.541399 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:11:25.546576 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:11:25.558094 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:11:25.558094 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:11:25.558094 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:11:25.558094 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:11:25.558094 np0000001583 nova-compute[98241]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0 (non-flash)
May 28 02:11:25.558094 np0000001583 nova-compute[98241]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0 (non-flash)
May 28 02:11:25.558094 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:11:25.558375 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:11:25.558375 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:11:25.558375 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:11:25.558375 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:11:25.558375 np0000001583 nova-compute[98241]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0 (non-flash)
May 28 02:11:25.558375 np0000001583 nova-compute[98241]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0 (non-flash)
May 28 02:11:25.558375 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:11:25.558579 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.151s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:11:25.558675 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:11:25.559897 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] HCTL ('7', '-', '-', 0) found on session 208 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:11:25.560025 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:11:25.566053 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:11:25.566053 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:11:25.566053 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:11:25.566053 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:11:25.566053 np0000001583 nova-compute[98241]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0 (non-flash)
May 28 02:11:25.566053 np0000001583 nova-compute[98241]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0 (non-flash)
May 28 02:11:25.566053 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:11:25.566254 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:11:25.566254 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:11:25.566254 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:11:25.566254 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:11:25.566254 np0000001583 nova-compute[98241]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0 (non-flash)
May 28 02:11:25.566254 np0000001583 nova-compute[98241]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0 (non-flash)
May 28 02:11:25.566254 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:11:25.566494 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.158s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:11:25.566632 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:11:25.567591 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] HCTL ('8', '-', '-', 0) found on session 209 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:11:25.567743 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:11:25.579177 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Searching for a device in session 208 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:11:25.579177 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5566f652-d0df-45d4-b7e0-0aac4c7371c0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:11:25.585919 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Searching for a device in session 209 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:11:25.585919 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '5566f652-d0df-45d4-b7e0-0aac4c7371c0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:11:26.193249 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:11:26.193694 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:11:26.389827 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2e61b7fc-e9f0-47f0-bf90-82e893ac6170 tempest-TestEncryptedCinderVolumes-243696963 tempest-TestEncryptedCinderVolumes-243696963-project-member] Lock "5f8cf96c-2c00-493d-afe2-2ea77a834767" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.042s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:11:26.408684 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 02:11:27.179273 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "769d888e-505f-49eb-b3d8-9f9e8c7f0aab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:11:27.179450 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "769d888e-505f-49eb-b3d8-9f9e8c7f0aab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:11:27.193933 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:11:27.424315 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Found WWN 330000000a000920c for multipath device dm-0 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 02:11:27.424643 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:11:27.424709 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] <== connect_volume: return (3034ms) {'type': 'block', 'scsi_wwn': '330000000a000920c', 'path': '/dev/dm-0', 'multipath_id': '330000000a000920c'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:11:27.424782 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a000920c', 'path': '/dev/dm-0', 'multipath_id': '330000000a000920c'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 02:11:27.681042 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 02:11:27.697752 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:11:27.698196 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:11:27.698425 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:11:27.698729 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Auditing locally available compute resources for np0000001583 (node: np0000001583) {{(pid=98241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 02:11:27.741824 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:27.930060 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:11:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1382185505',display_name='tempest-TestVolumeBootPatternV346-server-1382185505',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testvolumebootpatternv346-server-1382185505',id=77,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ/lnetI19trduK+u/OFeU6Vl1vJl5sGiPvYb+vIHSNO35lHiQOiuS2yGR6fR7Jaaz2jdkTZJrQykDoFtoS8yzSrcVHMR2Wu4wVJFy+2O3rVKo5dqMhPgY3jU0Bqhpdkaw==',key_name='tempest-keypair-138520030',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60b5c56c77c64b318056094f7fa5861d',ramdisk_id='',reservation_id='r-jgbn1n0b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-884356236',owner_user_name='tempest-TestVolumeBootPatternV346-884356236-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:11:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8ce004361ad4602a6f330506184114b',uuid=4d069122-da2e-445e-8ce3-377692925d87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cec7eafb-605b-44cc-ab7c-fb748c33f63e", "address": "fa:16:3e:1e:6f:c0", "network": {"id": "a349b3ac-cae9-4909-b273-8409a97fbe5c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-810622904-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60b5c56c77c64b318056094f7fa5861d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec7eafb-60", "ovs_interfaceid": "cec7eafb-605b-44cc-ab7c-fb748c33f63e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 02:11:27.930309 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Converting VIF {"id": "cec7eafb-605b-44cc-ab7c-fb748c33f63e", "address": "fa:16:3e:1e:6f:c0", "network": {"id": "a349b3ac-cae9-4909-b273-8409a97fbe5c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-810622904-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60b5c56c77c64b318056094f7fa5861d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec7eafb-60", "ovs_interfaceid": "cec7eafb-605b-44cc-ab7c-fb748c33f63e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:11:27.931003 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:6f:c0,bridge_name='br-int',has_traffic_filtering=True,id=cec7eafb-605b-44cc-ab7c-fb748c33f63e,network=Network(a349b3ac-cae9-4909-b273-8409a97fbe5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcec7eafb-60') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:11:27.931718 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lazy-loading 'pci_devices' on Instance uuid 4d069122-da2e-445e-8ce3-377692925d87 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:11:28.233830 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:11:28.234417 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:11:28.238812 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 02:11:28.239651 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Claim successful on node np0000001583
May 28 02:11:28.435672 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 4d069122-da2e-445e-8ce3-377692925d87] End _get_guest_xml xml=<domain type="qemu">
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:   <uuid>4d069122-da2e-445e-8ce3-377692925d87</uuid>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:   <name>instance-0000004d</name>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:   <metadata>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:       <nova:name>tempest-TestVolumeBootPatternV346-server-1382185505</nova:name>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 02:11:24</nova:creationTime>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:       <nova:image uuid="">
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:       </nova:image>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:         <nova:user uuid="c8ce004361ad4602a6f330506184114b">tempest-TestVolumeBootPatternV346-884356236-project-member</nova:user>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:         <nova:project uuid="60b5c56c77c64b318056094f7fa5861d">tempest-TestVolumeBootPatternV346-884356236</nova:project>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:       <nova:root type="volume" uuid=""/>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:         <nova:port uuid="cec7eafb-605b-44cc-ab7c-fb748c33f63e">
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:         </nova:port>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:   </metadata>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:     <system>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:       <entry name="serial">4d069122-da2e-445e-8ce3-377692925d87</entry>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:       <entry name="uuid">4d069122-da2e-445e-8ce3-377692925d87</entry>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:     </system>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:   <os>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:   </os>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:   <features>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:     <acpi/>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:     <tcg>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:     </tcg>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:   </features>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:   </cpu>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:   <devices>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/4d069122-da2e-445e-8ce3-377692925d87/disk.config"/>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:     </disk>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:     <disk type="block" device="disk">
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:       <alias name="ua-5566f652-d0df-45d4-b7e0-0aac4c7371c0"/>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:       <source dev="/dev/dm-0"/>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:       <serial>5566f652-d0df-45d4-b7e0-0aac4c7371c0</serial>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:     </disk>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:1e:6f:c0"/>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:       <target dev="tapcec7eafb-60"/>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:     </interface>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/4d069122-da2e-445e-8ce3-377692925d87/console.log" append="off"/>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:     </serial>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:     <video>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:     </video>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:     </rng>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:     </memballoon>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:   </devices>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]: </domain>
May 28 02:11:28.435672 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 02:11:28.440332 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Preparing to wait for external event network-vif-plugged-cec7eafb-605b-44cc-ab7c-fb748c33f63e {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 02:11:28.440332 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Acquiring lock "4d069122-da2e-445e-8ce3-377692925d87-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:11:28.440332 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "4d069122-da2e-445e-8ce3-377692925d87-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:11:28.440332 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "4d069122-da2e-445e-8ce3-377692925d87-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:11:28.440332 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:11:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1382185505',display_name='tempest-TestVolumeBootPatternV346-server-1382185505',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testvolumebootpatternv346-server-1382185505',id=77,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ/lnetI19trduK+u/OFeU6Vl1vJl5sGiPvYb+vIHSNO35lHiQOiuS2yGR6fR7Jaaz2jdkTZJrQykDoFtoS8yzSrcVHMR2Wu4wVJFy+2O3rVKo5dqMhPgY3jU0Bqhpdkaw==',key_name='tempest-keypair-138520030',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60b5c56c77c64b318056094f7fa5861d',ramdisk_id='',reservation_id='r-jgbn1n0b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-884356236',owner_user_name='tempest-TestVolumeBootPatternV346-884356236-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:11:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8ce004361ad4602a6f330506184114b',uuid=4d069122-da2e-445e-8ce3-377692925d87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cec7eafb-605b-44cc-ab7c-fb748c33f63e", "address": "fa:16:3e:1e:6f:c0", "network": {"id": "a349b3ac-cae9-4909-b273-8409a97fbe5c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-810622904-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60b5c56c77c64b318056094f7fa5861d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec7eafb-60", "ovs_interfaceid": "cec7eafb-605b-44cc-ab7c-fb748c33f63e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 02:11:28.440332 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Converting VIF {"id": "cec7eafb-605b-44cc-ab7c-fb748c33f63e", "address": "fa:16:3e:1e:6f:c0", "network": {"id": "a349b3ac-cae9-4909-b273-8409a97fbe5c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-810622904-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60b5c56c77c64b318056094f7fa5861d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec7eafb-60", "ovs_interfaceid": "cec7eafb-605b-44cc-ab7c-fb748c33f63e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:11:28.440332 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:6f:c0,bridge_name='br-int',has_traffic_filtering=True,id=cec7eafb-605b-44cc-ab7c-fb748c33f63e,network=Network(a349b3ac-cae9-4909-b273-8409a97fbe5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcec7eafb-60') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:11:28.440332 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:6f:c0,bridge_name='br-int',has_traffic_filtering=True,id=cec7eafb-605b-44cc-ab7c-fb748c33f63e,network=Network(a349b3ac-cae9-4909-b273-8409a97fbe5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcec7eafb-60') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 02:11:28.440332 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:28.440332 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:11:28.440332 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 02:11:28.441101 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:28.441101 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '384475ee-94d6-5c12-a571-f1419cbf0f23', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:11:28.442208 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:11:28.442892 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:28.446690 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:28.446690 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcec7eafb-60, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:11:28.446690 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcec7eafb-60, col_values=(('qos', UUID('1f715a4d-d036-40cf-9ee4-bc7c290aea76')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:11:28.446690 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcec7eafb-60, col_values=(('external_ids', {'iface-id': 'cec7eafb-605b-44cc-ab7c-fb748c33f63e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:6f:c0', 'vm-uuid': '4d069122-da2e-445e-8ce3-377692925d87'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:11:28.449053 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:11:28.453591 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:28.454313 np0000001583 nova-compute[98241]: INFO os_vif [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:6f:c0,bridge_name='br-int',has_traffic_filtering=True,id=cec7eafb-605b-44cc-ab7c-fb748c33f63e,network=Network(a349b3ac-cae9-4909-b273-8409a97fbe5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcec7eafb-60')
May 28 02:11:28.654501 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:28.728141 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 02:11:28.730110 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ce63103-8c3e-4a5b-a2fb-d90055411d08/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:11:28.844405 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ce63103-8c3e-4a5b-a2fb-d90055411d08/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:11:28.844978 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ce63103-8c3e-4a5b-a2fb-d90055411d08/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:11:28.958246 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ce63103-8c3e-4a5b-a2fb-d90055411d08/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:11:28.963815 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/dm-5 (vda) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 02:11:28.971434 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:11:28.972466 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:11:29.031773 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.059s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:11:29.032273 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Hypervisor/Node resource view: name=np0000001583 free_ram=12850MB free_disk=72.67761993408203GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 02:11:29.032449 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:11:29.524839 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:11:29.525359 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:11:29.993874 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:11:29.994246 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:11:29.994246 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] No VIF found with MAC fa:16:3e:1e:6f:c0, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:11:29.994716 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Using config drive
May 28 02:11:30.013790 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:30.027729 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:11:30.501683 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:11:30.536271 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.302s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:11:30.536997 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 1.504s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:11:30.537722 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 02:11:30.620199 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Creating config drive at /opt/stack/data/nova/instances/4d069122-da2e-445e-8ce3-377692925d87/disk.config
May 28 02:11:30.623675 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4d069122-da2e-445e-8ce3-377692925d87/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpk3m2d74p {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:11:30.678484 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4d069122-da2e-445e-8ce3-377692925d87/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpk3m2d74p" returned: 0 in 0.054s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:11:31.048117 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 02:11:31.055661 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 02:11:31.056096 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:11:31.056391 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:11:31.118011 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:31.140614 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:31.141533 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:31.172578 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a89bef00d8034a63ac07ef521be03355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b993c740f0114a22b4ec01fd0172dc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 02:11:31.230463 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:31.312556 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:31.438433 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e998fd81-1fef-426c-8717-fc5454094c85 req-bd4d35bd-35a3-4304-8b07-d9f55a76d5c6 service nova] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Received event network-vif-plugged-cec7eafb-605b-44cc-ab7c-fb748c33f63e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:11:31.439973 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e998fd81-1fef-426c-8717-fc5454094c85 req-bd4d35bd-35a3-4304-8b07-d9f55a76d5c6 service nova] Acquiring lock "4d069122-da2e-445e-8ce3-377692925d87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:11:31.439973 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e998fd81-1fef-426c-8717-fc5454094c85 req-bd4d35bd-35a3-4304-8b07-d9f55a76d5c6 service nova] Lock "4d069122-da2e-445e-8ce3-377692925d87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:11:31.439973 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e998fd81-1fef-426c-8717-fc5454094c85 req-bd4d35bd-35a3-4304-8b07-d9f55a76d5c6 service nova] Lock "4d069122-da2e-445e-8ce3-377692925d87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:11:31.439973 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e998fd81-1fef-426c-8717-fc5454094c85 req-bd4d35bd-35a3-4304-8b07-d9f55a76d5c6 service nova] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Processing event network-vif-plugged-cec7eafb-605b-44cc-ab7c-fb748c33f63e {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 02:11:31.559431 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 02:11:31.653447 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance e7554a11-146b-416b-8121-b7e6773b8dab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:11:31.654185 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 1c600f44-79c3-4d3f-ad07-0f09ad498836 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:11:31.654185 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 3ce63103-8c3e-4a5b-a2fb-d90055411d08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:11:31.654185 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 4d069122-da2e-445e-8ce3-377692925d87 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:11:31.655909 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 769d888e-505f-49eb-b3d8-9f9e8c7f0aab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:11:31.657133 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 02:11:31.657241 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Final resource view: name=np0000001583 phys_ram=24030MB used_ram=1472MB phys_disk=95GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:11:29 up 47 min,  2 users,  load average: 4.84, 5.16, 4.84\n', 'num_instances': '5', 'num_vm_active': '3', 'num_task_None': '4', 'num_os_type_None': '5', 'num_proj_60b5c56c77c64b318056094f7fa5861d': '3', 'io_workload': '2', 'num_proj_a20805bca06645eabf880bb71e4b69e3': '1', 'num_vm_building': '2', 'num_task_spawning': '1', 'num_proj_b993c740f0114a22b4ec01fd0172dc89': '1'} {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 02:11:31.846177 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Successfully created port: 43226b3b-c629-47bd-b874-28fc2f7defc5 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 02:11:31.918886 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934291.9184687, 4d069122-da2e-445e-8ce3-377692925d87 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:11:31.919036 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 4d069122-da2e-445e-8ce3-377692925d87] VM Started (Lifecycle Event)
May 28 02:11:31.920194 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 02:11:31.924949 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 02:11:31.933780 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Instance spawned successfully.
May 28 02:11:31.934183 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 02:11:31.993607 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:11:31.993822 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:11:32.067053 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 02:11:32.087243 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:32.423067 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:11:32.425391 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:11:32.428379 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Successfully updated port: 43226b3b-c629-47bd-b874-28fc2f7defc5 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 02:11:32.440100 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:11:32.440515 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:11:32.440796 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:11:32.440985 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:11:32.441273 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:11:32.441630 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:11:32.483847 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-845cabac-6479-4789-9059-895db3a0d4be req-838f60d1-d32a-402e-b4ad-070651dca431 service nova] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Received event network-changed-43226b3b-c629-47bd-b874-28fc2f7defc5 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:11:32.483979 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-845cabac-6479-4789-9059-895db3a0d4be req-838f60d1-d32a-402e-b4ad-070651dca431 service nova] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Refreshing instance network info cache due to event network-changed-43226b3b-c629-47bd-b874-28fc2f7defc5. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:11:32.484166 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-845cabac-6479-4789-9059-895db3a0d4be req-838f60d1-d32a-402e-b4ad-070651dca431 service nova] Acquiring lock "refresh_cache-769d888e-505f-49eb-b3d8-9f9e8c7f0aab" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:11:32.484255 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-845cabac-6479-4789-9059-895db3a0d4be req-838f60d1-d32a-402e-b4ad-070651dca431 service nova] Acquired lock "refresh_cache-769d888e-505f-49eb-b3d8-9f9e8c7f0aab" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:11:32.484842 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-845cabac-6479-4789-9059-895db3a0d4be req-838f60d1-d32a-402e-b4ad-070651dca431 service nova] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Refreshing network info cache for port 43226b3b-c629-47bd-b874-28fc2f7defc5 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:11:32.496432 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:11:32.930519 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "refresh_cache-769d888e-505f-49eb-b3d8-9f9e8c7f0aab" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:11:32.931112 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 4d069122-da2e-445e-8ce3-377692925d87] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 02:11:32.931474 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934292.9311929, 4d069122-da2e-445e-8ce3-377692925d87 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:11:32.931601 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 4d069122-da2e-445e-8ce3-377692925d87] VM Paused (Lifecycle Event)
May 28 02:11:32.946451 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Took 8.73 seconds to spawn the instance on the hypervisor.
May 28 02:11:32.946623 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:11:32.987020 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-845cabac-6479-4789-9059-895db3a0d4be req-838f60d1-d32a-402e-b4ad-070651dca431 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:11:33.003594 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Compute_service record updated for np0000001583:np0000001583 {{(pid=98241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 02:11:33.004116 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.468s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:11:33.004440 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:11:33.047941 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-845cabac-6479-4789-9059-895db3a0d4be req-838f60d1-d32a-402e-b4ad-070651dca431 service nova] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:11:33.077313 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 02:11:33.078973 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 02:11:33.079275 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Creating image(s)
May 28 02:11:33.080163 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "/opt/stack/data/nova/instances/769d888e-505f-49eb-b3d8-9f9e8c7f0aab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:11:33.080476 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "/opt/stack/data/nova/instances/769d888e-505f-49eb-b3d8-9f9e8c7f0aab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:11:33.083797 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "/opt/stack/data/nova/instances/769d888e-505f-49eb-b3d8-9f9e8c7f0aab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:11:33.084678 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:11:33.088106 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:11:33.089634 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:11:33.183706 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.094s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:11:33.184487 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:11:33.184861 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:11:33.187106 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:11:33.193232 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:11:33.193686 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:11:33.219465 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-845cabac-6479-4789-9059-895db3a0d4be req-838f60d1-d32a-402e-b4ad-070651dca431 service nova] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:11:33.287377 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.094s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:11:33.287774 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/769d888e-505f-49eb-b3d8-9f9e8c7f0aab/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:11:33.343067 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/769d888e-505f-49eb-b3d8-9f9e8c7f0aab/disk 1073741824" returned: 0 in 0.055s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:11:33.343628 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.159s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:11:33.343961 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:11:33.435405 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:11:33.438203 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.094s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:11:33.438562 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Checking if we can resize image /opt/stack/data/nova/instances/769d888e-505f-49eb-b3d8-9f9e8c7f0aab/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 02:11:33.438909 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769d888e-505f-49eb-b3d8-9f9e8c7f0aab/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:11:33.462053 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:33.463783 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Took 15.94 seconds to build instance.
May 28 02:11:33.465012 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934293.4628823, 4d069122-da2e-445e-8ce3-377692925d87 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:11:33.465187 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 4d069122-da2e-445e-8ce3-377692925d87] VM Resumed (Lifecycle Event)
May 28 02:11:33.512285 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9d8fb7d3-1cc6-4b58-9dfc-a2fd59433c67 req-6799ee36-ea36-423c-9dbc-57ab73b2b461 service nova] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Received event network-vif-plugged-cec7eafb-605b-44cc-ab7c-fb748c33f63e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:11:33.513479 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9d8fb7d3-1cc6-4b58-9dfc-a2fd59433c67 req-6799ee36-ea36-423c-9dbc-57ab73b2b461 service nova] Acquiring lock "4d069122-da2e-445e-8ce3-377692925d87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:11:33.513747 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9d8fb7d3-1cc6-4b58-9dfc-a2fd59433c67 req-6799ee36-ea36-423c-9dbc-57ab73b2b461 service nova] Lock "4d069122-da2e-445e-8ce3-377692925d87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:11:33.513928 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-9d8fb7d3-1cc6-4b58-9dfc-a2fd59433c67 req-6799ee36-ea36-423c-9dbc-57ab73b2b461 service nova] Lock "4d069122-da2e-445e-8ce3-377692925d87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:11:33.514117 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-9d8fb7d3-1cc6-4b58-9dfc-a2fd59433c67 req-6799ee36-ea36-423c-9dbc-57ab73b2b461 service nova] [instance: 4d069122-da2e-445e-8ce3-377692925d87] No waiting events found dispatching network-vif-plugged-cec7eafb-605b-44cc-ab7c-fb748c33f63e {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:11:33.514297 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-9d8fb7d3-1cc6-4b58-9dfc-a2fd59433c67 req-6799ee36-ea36-423c-9dbc-57ab73b2b461 service nova] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Received unexpected event network-vif-plugged-cec7eafb-605b-44cc-ab7c-fb748c33f63e for instance with vm_state active and task_state None.
May 28 02:11:33.535435 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769d888e-505f-49eb-b3d8-9f9e8c7f0aab/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:11:33.537123 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Cannot resize image /opt/stack/data/nova/instances/769d888e-505f-49eb-b3d8-9f9e8c7f0aab/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 02:11:33.537123 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 02:11:33.537123 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Ensure instance console log exists: /opt/stack/data/nova/instances/769d888e-505f-49eb-b3d8-9f9e8c7f0aab/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 02:11:33.537123 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:11:33.537123 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:11:33.537123 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:11:33.657535 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:33.723069 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-845cabac-6479-4789-9059-895db3a0d4be req-838f60d1-d32a-402e-b4ad-070651dca431 service nova] Releasing lock "refresh_cache-769d888e-505f-49eb-b3d8-9f9e8c7f0aab" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:11:33.723700 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquired lock "refresh_cache-769d888e-505f-49eb-b3d8-9f9e8c7f0aab" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:11:33.723870 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:11:33.967470 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "4d069122-da2e-445e-8ce3-377692925d87" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.455s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:11:33.968322 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:11:33.971994 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:11:34.000223 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:11:34.004326 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:11:34.004954 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:11:34.005201 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:11:34.005311 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 02:11:34.005545 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.19 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:11:34.303630 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:11:34.335003 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:11:34.467956 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:11:34.604603 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Updating instance_info_cache with network_info: [{"id": "43226b3b-c629-47bd-b874-28fc2f7defc5", "address": "fa:16:3e:13:4c:d8", "network": {"id": "3b938343-a65c-4ea6-9c96-be377e9fe646", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-19450663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b993c740f0114a22b4ec01fd0172dc89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43226b3b-c6", "ovs_interfaceid": "43226b3b-c629-47bd-b874-28fc2f7defc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:11:35.106659 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Releasing lock "refresh_cache-769d888e-505f-49eb-b3d8-9f9e8c7f0aab" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:11:35.107043 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Instance network_info: |[{"id": "43226b3b-c629-47bd-b874-28fc2f7defc5", "address": "fa:16:3e:13:4c:d8", "network": {"id": "3b938343-a65c-4ea6-9c96-be377e9fe646", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-19450663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b993c740f0114a22b4ec01fd0172dc89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43226b3b-c6", "ovs_interfaceid": "43226b3b-c629-47bd-b874-28fc2f7defc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 02:11:35.108766 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Start _get_guest_xml network_info=[{"id": "43226b3b-c629-47bd-b874-28fc2f7defc5", "address": "fa:16:3e:13:4c:d8", "network": {"id": "3b938343-a65c-4ea6-9c96-be377e9fe646", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-19450663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b993c740f0114a22b4ec01fd0172dc89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43226b3b-c6", "ovs_interfaceid": "43226b3b-c629-47bd-b874-28fc2f7defc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 02:11:35.112067 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:11:35.113226 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-VolumeMultiattachTests-server-1121346609', uuid='769d888e-505f-49eb-b3d8-9f9e8c7f0aab'), owner=OwnerMeta(userid='a89bef00d8034a63ac07ef521be03355', username='tempest-VolumeMultiattachTests-562724558-project-member', projectid='b993c740f0114a22b4ec01fd0172dc89', projectname='tempest-VolumeMultiattachTests-562724558'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "43226b3b-c629-47bd-b874-28fc2f7defc5", "address": "fa:16:3e:13:4c:d8", "network": {"id": "3b938343-a65c-4ea6-9c96-be377e9fe646", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-19450663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b993c740f0114a22b4ec01fd0172dc89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43226b3b-c6", "ovs_interfaceid": "43226b3b-c629-47bd-b874-28fc2f7defc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779934295.1128378) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 02:11:35.114619 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 02:11:35.114935 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 02:11:35.116115 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 02:11:35.116286 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 02:11:35.117143 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 02:11:35.117417 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 02:11:35.117550 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 02:11:35.117639 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 02:11:35.117754 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 02:11:35.117835 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 02:11:35.117942 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 02:11:35.118179 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 02:11:35.118278 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 02:11:35.118382 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 02:11:35.118478 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 02:11:35.118585 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 02:11:35.128499 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:11:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1121346609',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-volumemultiattachtests-server-1121346609',id=78,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCw6mfS2UYDP9PgoI2ARsl9ucPnOUIdVENs+bIGUR2pJqKYe9J5WuC1571kjjgpZpiCNiKuxg+RnaT2NiKlIqk+HjAvm/MD3/Wxke+V2cXkupwN0eLhzgarMMyq4yLY9EA==',key_name='tempest-keypair-805647940',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b993c740f0114a22b4ec01fd0172dc89',ramdisk_id='',reservation_id='r-4ampdxqi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-562724558',owner_user_name='tempest-VolumeMultiattachTests-562724558-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:11:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a89bef00d8034a63ac07ef521be03355',uuid=769d888e-505f-49eb-b3d8-9f9e8c7f0aab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43226b3b-c629-47bd-b874-28fc2f7defc5", "address": "fa:16:3e:13:4c:d8", "network": {"id": "3b938343-a65c-4ea6-9c96-be377e9fe646", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-19450663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b993c740f0114a22b4ec01fd0172dc89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43226b3b-c6", "ovs_interfaceid": "43226b3b-c629-47bd-b874-28fc2f7defc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 02:11:35.128709 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Converting VIF {"id": "43226b3b-c629-47bd-b874-28fc2f7defc5", "address": "fa:16:3e:13:4c:d8", "network": {"id": "3b938343-a65c-4ea6-9c96-be377e9fe646", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-19450663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b993c740f0114a22b4ec01fd0172dc89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43226b3b-c6", "ovs_interfaceid": "43226b3b-c629-47bd-b874-28fc2f7defc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:11:35.129498 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:4c:d8,bridge_name='br-int',has_traffic_filtering=True,id=43226b3b-c629-47bd-b874-28fc2f7defc5,network=Network(3b938343-a65c-4ea6-9c96-be377e9fe646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43226b3b-c6') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:11:35.130279 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lazy-loading 'pci_devices' on Instance uuid 769d888e-505f-49eb-b3d8-9f9e8c7f0aab {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:11:35.193766 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:11:35.194735 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 47.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:11:35.568449 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-40663eed-fbe4-4dfe-8096-00ebf5866041 req-400f031f-0cd3-4d7e-ac4d-bdf164242225 service nova] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Received event network-changed-cec7eafb-605b-44cc-ab7c-fb748c33f63e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:11:35.568594 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-40663eed-fbe4-4dfe-8096-00ebf5866041 req-400f031f-0cd3-4d7e-ac4d-bdf164242225 service nova] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Refreshing instance network info cache due to event network-changed-cec7eafb-605b-44cc-ab7c-fb748c33f63e. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:11:35.568764 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-40663eed-fbe4-4dfe-8096-00ebf5866041 req-400f031f-0cd3-4d7e-ac4d-bdf164242225 service nova] Acquiring lock "refresh_cache-4d069122-da2e-445e-8ce3-377692925d87" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:11:35.568876 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-40663eed-fbe4-4dfe-8096-00ebf5866041 req-400f031f-0cd3-4d7e-ac4d-bdf164242225 service nova] Acquired lock "refresh_cache-4d069122-da2e-445e-8ce3-377692925d87" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:11:35.569056 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-40663eed-fbe4-4dfe-8096-00ebf5866041 req-400f031f-0cd3-4d7e-ac4d-bdf164242225 service nova] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Refreshing network info cache for port cec7eafb-605b-44cc-ab7c-fb748c33f63e {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:11:35.633542 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] End _get_guest_xml xml=<domain type="qemu">
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:   <uuid>769d888e-505f-49eb-b3d8-9f9e8c7f0aab</uuid>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:   <name>instance-0000004e</name>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:   <metadata>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:       <nova:name>tempest-VolumeMultiattachTests-server-1121346609</nova:name>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 02:11:35</nova:creationTime>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:       </nova:image>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:         <nova:user uuid="a89bef00d8034a63ac07ef521be03355">tempest-VolumeMultiattachTests-562724558-project-member</nova:user>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:         <nova:project uuid="b993c740f0114a22b4ec01fd0172dc89">tempest-VolumeMultiattachTests-562724558</nova:project>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:         <nova:port uuid="43226b3b-c629-47bd-b874-28fc2f7defc5">
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:         </nova:port>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:   </metadata>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:     <system>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:       <entry name="serial">769d888e-505f-49eb-b3d8-9f9e8c7f0aab</entry>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:       <entry name="uuid">769d888e-505f-49eb-b3d8-9f9e8c7f0aab</entry>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:     </system>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:   <os>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:   </os>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:   <features>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:     <acpi/>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:     <tcg>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:     </tcg>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:   </features>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:   </cpu>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:   <devices>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/769d888e-505f-49eb-b3d8-9f9e8c7f0aab/disk"/>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:     </disk>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/769d888e-505f-49eb-b3d8-9f9e8c7f0aab/disk.config"/>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:     </disk>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:13:4c:d8"/>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:       <target dev="tap43226b3b-c6"/>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:     </interface>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/769d888e-505f-49eb-b3d8-9f9e8c7f0aab/console.log" append="off"/>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:     </serial>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:     <video>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:     </video>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:     </rng>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:     </memballoon>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:   </devices>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]: </domain>
May 28 02:11:35.633542 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 02:11:35.636804 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Preparing to wait for external event network-vif-plugged-43226b3b-c629-47bd-b874-28fc2f7defc5 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 02:11:35.636804 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "769d888e-505f-49eb-b3d8-9f9e8c7f0aab-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:11:35.636804 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "769d888e-505f-49eb-b3d8-9f9e8c7f0aab-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:11:35.636804 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "769d888e-505f-49eb-b3d8-9f9e8c7f0aab-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:11:35.636804 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:11:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1121346609',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-volumemultiattachtests-server-1121346609',id=78,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCw6mfS2UYDP9PgoI2ARsl9ucPnOUIdVENs+bIGUR2pJqKYe9J5WuC1571kjjgpZpiCNiKuxg+RnaT2NiKlIqk+HjAvm/MD3/Wxke+V2cXkupwN0eLhzgarMMyq4yLY9EA==',key_name='tempest-keypair-805647940',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b993c740f0114a22b4ec01fd0172dc89',ramdisk_id='',reservation_id='r-4ampdxqi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-562724558',owner_user_name='tempest-VolumeMultiattachTests-562724558-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:11:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a89bef00d8034a63ac07ef521be03355',uuid=769d888e-505f-49eb-b3d8-9f9e8c7f0aab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43226b3b-c629-47bd-b874-28fc2f7defc5", "address": "fa:16:3e:13:4c:d8", "network": {"id": "3b938343-a65c-4ea6-9c96-be377e9fe646", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-19450663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b993c740f0114a22b4ec01fd0172dc89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43226b3b-c6", "ovs_interfaceid": "43226b3b-c629-47bd-b874-28fc2f7defc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 02:11:35.636804 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Converting VIF {"id": "43226b3b-c629-47bd-b874-28fc2f7defc5", "address": "fa:16:3e:13:4c:d8", "network": {"id": "3b938343-a65c-4ea6-9c96-be377e9fe646", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-19450663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b993c740f0114a22b4ec01fd0172dc89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43226b3b-c6", "ovs_interfaceid": "43226b3b-c629-47bd-b874-28fc2f7defc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:11:35.636804 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:4c:d8,bridge_name='br-int',has_traffic_filtering=True,id=43226b3b-c629-47bd-b874-28fc2f7defc5,network=Network(3b938343-a65c-4ea6-9c96-be377e9fe646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43226b3b-c6') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:11:35.636804 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:4c:d8,bridge_name='br-int',has_traffic_filtering=True,id=43226b3b-c629-47bd-b874-28fc2f7defc5,network=Network(3b938343-a65c-4ea6-9c96-be377e9fe646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43226b3b-c6') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 02:11:35.638874 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:35.638874 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:11:35.638874 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 02:11:35.639933 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:35.639933 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '39eb1acb-73fd-5054-83cd-4e3ec127c4de', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:11:35.640789 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:11:35.641549 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:35.645586 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:35.645586 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap43226b3b-c6, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:11:35.645586 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap43226b3b-c6, col_values=(('qos', UUID('2875ee9c-85c6-4c6e-b836-b03cc2ff400c')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:11:35.645586 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap43226b3b-c6, col_values=(('external_ids', {'iface-id': '43226b3b-c629-47bd-b874-28fc2f7defc5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:4c:d8', 'vm-uuid': '769d888e-505f-49eb-b3d8-9f9e8c7f0aab'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:11:35.647679 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:11:35.650943 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:35.652056 np0000001583 nova-compute[98241]: INFO os_vif [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:4c:d8,bridge_name='br-int',has_traffic_filtering=True,id=43226b3b-c629-47bd-b874-28fc2f7defc5,network=Network(3b938343-a65c-4ea6-9c96-be377e9fe646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43226b3b-c6')
May 28 02:11:35.864377 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:36.071054 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-40663eed-fbe4-4dfe-8096-00ebf5866041 req-400f031f-0cd3-4d7e-ac4d-bdf164242225 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:11:36.427796 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-40663eed-fbe4-4dfe-8096-00ebf5866041 req-400f031f-0cd3-4d7e-ac4d-bdf164242225 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:11:36.646523 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-40663eed-fbe4-4dfe-8096-00ebf5866041 req-400f031f-0cd3-4d7e-ac4d-bdf164242225 service nova] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Updated VIF entry in instance network info cache for port cec7eafb-605b-44cc-ab7c-fb748c33f63e. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:11:36.646737 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-40663eed-fbe4-4dfe-8096-00ebf5866041 req-400f031f-0cd3-4d7e-ac4d-bdf164242225 service nova] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Updating instance_info_cache with network_info: [{"id": "cec7eafb-605b-44cc-ab7c-fb748c33f63e", "address": "fa:16:3e:1e:6f:c0", "network": {"id": "a349b3ac-cae9-4909-b273-8409a97fbe5c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-810622904-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60b5c56c77c64b318056094f7fa5861d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec7eafb-60", "ovs_interfaceid": "cec7eafb-605b-44cc-ab7c-fb748c33f63e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:11:37.148706 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-40663eed-fbe4-4dfe-8096-00ebf5866041 req-400f031f-0cd3-4d7e-ac4d-bdf164242225 service nova] Releasing lock "refresh_cache-4d069122-da2e-445e-8ce3-377692925d87" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:11:37.171722 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:11:37.171912 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:11:37.171959 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] No VIF found with MAC fa:16:3e:13:4c:d8, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:11:37.172946 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Using config drive
May 28 02:11:37.224875 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0004036400000586582 future=<Future at 0x7724ec2ad2b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:11:37.225041 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:11:37.226660 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Emitting event <LifecycleEvent: 1779934282.2241895, 5f8cf96c-2c00-493d-afe2-2ea77a834767 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:11:37.226660 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] VM Stopped (Lifecycle Event)
May 28 02:11:37.467834 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:37.682520 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:11:37.731840 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 5f8cf96c-2c00-493d-afe2-2ea77a834767] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:11:37.805050 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Creating config drive at /opt/stack/data/nova/instances/769d888e-505f-49eb-b3d8-9f9e8c7f0aab/disk.config
May 28 02:11:37.808480 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/769d888e-505f-49eb-b3d8-9f9e8c7f0aab/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpaiwx41xv {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:11:37.866337 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/769d888e-505f-49eb-b3d8-9f9e8c7f0aab/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpaiwx41xv" returned: 0 in 0.057s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:11:37.980327 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:38.342710 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:38.363357 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:38.364854 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:38.474595 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:38.659241 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:38.707329 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:38.737751 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:39.176322 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934299.1743557, 769d888e-505f-49eb-b3d8-9f9e8c7f0aab => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:11:39.176322 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] VM Started (Lifecycle Event)
May 28 02:11:39.678630 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:11:39.682116 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934299.6809318, 769d888e-505f-49eb-b3d8-9f9e8c7f0aab => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:11:39.682116 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] VM Paused (Lifecycle Event)
May 28 02:11:39.963404 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:40.183888 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:11:40.188106 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:11:40.645125 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:40.689921 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 02:11:41.395632 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:42.858873 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-8be40460-c940-4d00-b691-ed0546146915 req-ac8fe189-125a-4b6e-9972-4344ce47d488 service nova] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Received event network-vif-plugged-43226b3b-c629-47bd-b874-28fc2f7defc5 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:11:42.861256 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-8be40460-c940-4d00-b691-ed0546146915 req-ac8fe189-125a-4b6e-9972-4344ce47d488 service nova] Acquiring lock "769d888e-505f-49eb-b3d8-9f9e8c7f0aab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:11:42.862471 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-8be40460-c940-4d00-b691-ed0546146915 req-ac8fe189-125a-4b6e-9972-4344ce47d488 service nova] Lock "769d888e-505f-49eb-b3d8-9f9e8c7f0aab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:11:42.862471 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-8be40460-c940-4d00-b691-ed0546146915 req-ac8fe189-125a-4b6e-9972-4344ce47d488 service nova] Lock "769d888e-505f-49eb-b3d8-9f9e8c7f0aab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:11:42.862471 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-8be40460-c940-4d00-b691-ed0546146915 req-ac8fe189-125a-4b6e-9972-4344ce47d488 service nova] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Processing event network-vif-plugged-43226b3b-c629-47bd-b874-28fc2f7defc5 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 02:11:42.863468 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Instance event wait completed in 3 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 02:11:42.866718 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934302.8664293, 769d888e-505f-49eb-b3d8-9f9e8c7f0aab => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:11:42.867625 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 02:11:42.868472 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] VM Resumed (Lifecycle Event)
May 28 02:11:42.871454 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Instance spawned successfully.
May 28 02:11:42.871941 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 02:11:43.371393 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:11:43.377965 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:11:43.382750 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:11:43.382750 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:11:43.382750 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:11:43.382750 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:11:43.383007 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:11:43.386170 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:11:43.663110 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:43.880875 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 02:11:43.890869 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Took 10.81 seconds to spawn the instance on the hypervisor.
May 28 02:11:43.891025 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:11:44.402872 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Took 16.22 seconds to build instance.
May 28 02:11:44.711764 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Acquiring lock "3d3cb2ab-e6f7-4700-9599-1d42b17b2c48" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:11:44.712170 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Lock "3d3cb2ab-e6f7-4700-9599-1d42b17b2c48" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:11:44.904324 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3130e142-bdc1-419f-bb52-bde49524b668 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "769d888e-505f-49eb-b3d8-9f9e8c7f0aab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.725s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:11:44.920899 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-21b360cf-1b4f-4dab-993a-1ec822b3578e req-fc893d0a-a2de-447b-9a65-38f44bb9a548 service nova] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Received event network-vif-plugged-43226b3b-c629-47bd-b874-28fc2f7defc5 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:11:44.921073 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-21b360cf-1b4f-4dab-993a-1ec822b3578e req-fc893d0a-a2de-447b-9a65-38f44bb9a548 service nova] Acquiring lock "769d888e-505f-49eb-b3d8-9f9e8c7f0aab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:11:44.924419 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-21b360cf-1b4f-4dab-993a-1ec822b3578e req-fc893d0a-a2de-447b-9a65-38f44bb9a548 service nova] Lock "769d888e-505f-49eb-b3d8-9f9e8c7f0aab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:11:44.924579 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-21b360cf-1b4f-4dab-993a-1ec822b3578e req-fc893d0a-a2de-447b-9a65-38f44bb9a548 service nova] Lock "769d888e-505f-49eb-b3d8-9f9e8c7f0aab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:11:44.924750 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-21b360cf-1b4f-4dab-993a-1ec822b3578e req-fc893d0a-a2de-447b-9a65-38f44bb9a548 service nova] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] No waiting events found dispatching network-vif-plugged-43226b3b-c629-47bd-b874-28fc2f7defc5 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:11:44.924914 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-21b360cf-1b4f-4dab-993a-1ec822b3578e req-fc893d0a-a2de-447b-9a65-38f44bb9a548 service nova] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Received unexpected event network-vif-plugged-43226b3b-c629-47bd-b874-28fc2f7defc5 for instance with vm_state active and task_state None.
May 28 02:11:45.216434 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 02:11:45.389243 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-cad5e42d-7453-4da2-89fd-a4e84922f13b req-651d8bdf-080f-4d86-9215-44a683f1e6bf service nova] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Received event network-changed-43226b3b-c629-47bd-b874-28fc2f7defc5 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:11:45.389396 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-cad5e42d-7453-4da2-89fd-a4e84922f13b req-651d8bdf-080f-4d86-9215-44a683f1e6bf service nova] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Refreshing instance network info cache due to event network-changed-43226b3b-c629-47bd-b874-28fc2f7defc5. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:11:45.389596 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-cad5e42d-7453-4da2-89fd-a4e84922f13b req-651d8bdf-080f-4d86-9215-44a683f1e6bf service nova] Acquiring lock "refresh_cache-769d888e-505f-49eb-b3d8-9f9e8c7f0aab" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:11:45.389706 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-cad5e42d-7453-4da2-89fd-a4e84922f13b req-651d8bdf-080f-4d86-9215-44a683f1e6bf service nova] Acquired lock "refresh_cache-769d888e-505f-49eb-b3d8-9f9e8c7f0aab" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:11:45.389861 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-cad5e42d-7453-4da2-89fd-a4e84922f13b req-651d8bdf-080f-4d86-9215-44a683f1e6bf service nova] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Refreshing network info cache for port 43226b3b-c629-47bd-b874-28fc2f7defc5 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:11:45.646460 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:45.762758 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:11:45.762960 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:11:45.765917 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 02:11:45.766019 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Claim successful on node np0000001583
May 28 02:11:45.892972 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-cad5e42d-7453-4da2-89fd-a4e84922f13b req-651d8bdf-080f-4d86-9215-44a683f1e6bf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:11:46.158503 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-cad5e42d-7453-4da2-89fd-a4e84922f13b req-651d8bdf-080f-4d86-9215-44a683f1e6bf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:11:46.268698 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-cad5e42d-7453-4da2-89fd-a4e84922f13b req-651d8bdf-080f-4d86-9215-44a683f1e6bf service nova] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Updated VIF entry in instance network info cache for port 43226b3b-c629-47bd-b874-28fc2f7defc5. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:11:46.270709 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-cad5e42d-7453-4da2-89fd-a4e84922f13b req-651d8bdf-080f-4d86-9215-44a683f1e6bf service nova] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Updating instance_info_cache with network_info: [{"id": "43226b3b-c629-47bd-b874-28fc2f7defc5", "address": "fa:16:3e:13:4c:d8", "network": {"id": "3b938343-a65c-4ea6-9c96-be377e9fe646", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-19450663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b993c740f0114a22b4ec01fd0172dc89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43226b3b-c6", "ovs_interfaceid": "43226b3b-c629-47bd-b874-28fc2f7defc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:11:46.772878 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-cad5e42d-7453-4da2-89fd-a4e84922f13b req-651d8bdf-080f-4d86-9215-44a683f1e6bf service nova] Releasing lock "refresh_cache-769d888e-505f-49eb-b3d8-9f9e8c7f0aab" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:11:47.050842 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:11:47.051018 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:11:47.553539 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:11:48.059669 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.297s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:11:48.059926 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 02:11:48.564962 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 02:11:48.565396 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 02:11:48.565593 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:11:48.565697 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:11:48.663011 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:48.692160 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c90a2da7d9f4fbc9993789800a47d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a074e5b5a0c04c93a93cf6a066856ad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 02:11:49.067686 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 02:11:49.124123 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Successfully created port: de3e5796-e5a7-4bac-9a3f-cc12d3d45282 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 02:11:49.562255 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Successfully updated port: de3e5796-e5a7-4bac-9a3f-cc12d3d45282 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 02:11:49.571094 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 02:11:49.613900 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ab1cb994-bc48-4a3d-b516-2262ea5e6d0c req-f6af3fd0-2ec5-4745-b890-3ce764655af9 service nova] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Received event network-changed-de3e5796-e5a7-4bac-9a3f-cc12d3d45282 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:11:49.616147 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ab1cb994-bc48-4a3d-b516-2262ea5e6d0c req-f6af3fd0-2ec5-4745-b890-3ce764655af9 service nova] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Refreshing instance network info cache due to event network-changed-de3e5796-e5a7-4bac-9a3f-cc12d3d45282. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:11:49.616147 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ab1cb994-bc48-4a3d-b516-2262ea5e6d0c req-f6af3fd0-2ec5-4745-b890-3ce764655af9 service nova] Acquiring lock "refresh_cache-3d3cb2ab-e6f7-4700-9599-1d42b17b2c48" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:11:49.616147 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ab1cb994-bc48-4a3d-b516-2262ea5e6d0c req-f6af3fd0-2ec5-4745-b890-3ce764655af9 service nova] Acquired lock "refresh_cache-3d3cb2ab-e6f7-4700-9599-1d42b17b2c48" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:11:49.616147 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-ab1cb994-bc48-4a3d-b516-2262ea5e6d0c req-f6af3fd0-2ec5-4745-b890-3ce764655af9 service nova] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Refreshing network info cache for port de3e5796-e5a7-4bac-9a3f-cc12d3d45282 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:11:49.940066 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ab26abd4-e348-4aef-b4f5-22e069aeadee req-8b2a2e84-1594-44a8-90dc-792d85df66eb service nova] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Received event network-vif-unplugged-de3e5796-e5a7-4bac-9a3f-cc12d3d45282 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:11:49.940066 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ab26abd4-e348-4aef-b4f5-22e069aeadee req-8b2a2e84-1594-44a8-90dc-792d85df66eb service nova] Acquiring lock "3d3cb2ab-e6f7-4700-9599-1d42b17b2c48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:11:49.940066 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ab26abd4-e348-4aef-b4f5-22e069aeadee req-8b2a2e84-1594-44a8-90dc-792d85df66eb service nova] Lock "3d3cb2ab-e6f7-4700-9599-1d42b17b2c48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:11:49.940066 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ab26abd4-e348-4aef-b4f5-22e069aeadee req-8b2a2e84-1594-44a8-90dc-792d85df66eb service nova] Lock "3d3cb2ab-e6f7-4700-9599-1d42b17b2c48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:11:49.940066 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ab26abd4-e348-4aef-b4f5-22e069aeadee req-8b2a2e84-1594-44a8-90dc-792d85df66eb service nova] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] No waiting events found dispatching network-vif-unplugged-de3e5796-e5a7-4bac-9a3f-cc12d3d45282 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:11:49.940066 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-ab26abd4-e348-4aef-b4f5-22e069aeadee req-8b2a2e84-1594-44a8-90dc-792d85df66eb service nova] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Received unexpected event network-vif-unplugged-de3e5796-e5a7-4bac-9a3f-cc12d3d45282 for instance with vm_state building and task_state block_device_mapping.
May 28 02:11:50.064536 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Acquiring lock "refresh_cache-3d3cb2ab-e6f7-4700-9599-1d42b17b2c48" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:11:50.119388 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-ab1cb994-bc48-4a3d-b516-2262ea5e6d0c req-f6af3fd0-2ec5-4745-b890-3ce764655af9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:11:50.190258 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-ab1cb994-bc48-4a3d-b516-2262ea5e6d0c req-f6af3fd0-2ec5-4745-b890-3ce764655af9 service nova] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:11:50.315724 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-ab1cb994-bc48-4a3d-b516-2262ea5e6d0c req-f6af3fd0-2ec5-4745-b890-3ce764655af9 service nova] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:11:50.578912 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 02:11:50.579895 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 02:11:50.580241 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Creating image(s)
May 28 02:11:50.580728 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Acquiring lock "/opt/stack/data/nova/instances/3d3cb2ab-e6f7-4700-9599-1d42b17b2c48/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:11:50.580872 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Lock "/opt/stack/data/nova/instances/3d3cb2ab-e6f7-4700-9599-1d42b17b2c48/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:11:50.581620 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Lock "/opt/stack/data/nova/instances/3d3cb2ab-e6f7-4700-9599-1d42b17b2c48/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:11:50.582067 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:11:50.584714 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:11:50.585770 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:11:50.648301 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:50.678311 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.092s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:11:50.678845 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:11:50.679361 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:11:50.679778 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:11:50.683096 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:11:50.683565 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:11:50.779637 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.096s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:11:50.780102 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/3d3cb2ab-e6f7-4700-9599-1d42b17b2c48/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:11:50.818647 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ab1cb994-bc48-4a3d-b516-2262ea5e6d0c req-f6af3fd0-2ec5-4745-b890-3ce764655af9 service nova] Releasing lock "refresh_cache-3d3cb2ab-e6f7-4700-9599-1d42b17b2c48" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:11:50.819163 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Acquired lock "refresh_cache-3d3cb2ab-e6f7-4700-9599-1d42b17b2c48" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:11:50.819492 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:11:50.834097 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/3d3cb2ab-e6f7-4700-9599-1d42b17b2c48/disk 1073741824" returned: 0 in 0.054s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:11:50.834560 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.155s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:11:50.834854 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:11:50.945102 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.110s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:11:50.945573 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3d3cb2ab-e6f7-4700-9599-1d42b17b2c48/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 02:11:50.945915 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3cb2ab-e6f7-4700-9599-1d42b17b2c48/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:11:51.042877 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3cb2ab-e6f7-4700-9599-1d42b17b2c48/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:11:51.043359 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Cannot resize image /opt/stack/data/nova/instances/3d3cb2ab-e6f7-4700-9599-1d42b17b2c48/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 02:11:51.043740 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 02:11:51.043945 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Ensure instance console log exists: /opt/stack/data/nova/instances/3d3cb2ab-e6f7-4700-9599-1d42b17b2c48/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 02:11:51.044226 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:11:51.044435 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:11:51.044590 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:11:51.388075 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:11:51.538295 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:11:51.703155 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Updating instance_info_cache with network_info: [{"id": "de3e5796-e5a7-4bac-9a3f-cc12d3d45282", "address": "fa:16:3e:32:90:44", "network": {"id": "6ef77fc7-70af-4b8b-a202-b78eed6d619f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1127154808-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a074e5b5a0c04c93a93cf6a066856ad3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3e5796-e5", "ovs_interfaceid": "de3e5796-e5a7-4bac-9a3f-cc12d3d45282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:11:52.205708 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Releasing lock "refresh_cache-3d3cb2ab-e6f7-4700-9599-1d42b17b2c48" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:11:52.206100 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Instance network_info: |[{"id": "de3e5796-e5a7-4bac-9a3f-cc12d3d45282", "address": "fa:16:3e:32:90:44", "network": {"id": "6ef77fc7-70af-4b8b-a202-b78eed6d619f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1127154808-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a074e5b5a0c04c93a93cf6a066856ad3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3e5796-e5", "ovs_interfaceid": "de3e5796-e5a7-4bac-9a3f-cc12d3d45282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 02:11:52.208283 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Start _get_guest_xml network_info=[{"id": "de3e5796-e5a7-4bac-9a3f-cc12d3d45282", "address": "fa:16:3e:32:90:44", "network": {"id": "6ef77fc7-70af-4b8b-a202-b78eed6d619f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1127154808-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a074e5b5a0c04c93a93cf6a066856ad3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3e5796-e5", "ovs_interfaceid": "de3e5796-e5a7-4bac-9a3f-cc12d3d45282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 02:11:52.212383 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:11:52.213503 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-TestServerVolumeAttachmentScenario-server-2038882305', uuid='3d3cb2ab-e6f7-4700-9599-1d42b17b2c48'), owner=OwnerMeta(userid='0c90a2da7d9f4fbc9993789800a47d06', username='tempest-TestServerVolumeAttachmentScenario-1455437119-project-member', projectid='a074e5b5a0c04c93a93cf6a066856ad3', projectname='tempest-TestServerVolumeAttachmentScenario-1455437119'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "de3e5796-e5a7-4bac-9a3f-cc12d3d45282", "address": "fa:16:3e:32:90:44", "network": {"id": "6ef77fc7-70af-4b8b-a202-b78eed6d619f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1127154808-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a074e5b5a0c04c93a93cf6a066856ad3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3e5796-e5", "ovs_interfaceid": "de3e5796-e5a7-4bac-9a3f-cc12d3d45282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779934312.2131932) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 02:11:52.214670 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 02:11:52.214987 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 02:11:52.215928 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 02:11:52.216107 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 02:11:52.216957 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 02:11:52.217316 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 02:11:52.217546 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 02:11:52.217648 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 02:11:52.217826 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 02:11:52.217968 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 02:11:52.218123 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 02:11:52.218335 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 02:11:52.218489 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 02:11:52.218663 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 02:11:52.218825 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 02:11:52.219000 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 02:11:52.229479 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:11:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2038882305',display_name='tempest-TestServerVolumeAttachmentScenario-server-2038882305',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testservervolumeattachmentscenario-server-2038882305',id=79,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZJ/h5hJi0FfW5EOIhbaBmM1xTGUjJQOAHhcWja+bB3cVb5l0NSXmcrNiuqd3GX8Nt0leLxyEKN+qXMfXDOm8HpYAFiE7CQlz+G50B5ZeCM5U26f6dw5GQFKnLrqXDULg==',key_name='tempest-keypair-762686630',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a074e5b5a0c04c93a93cf6a066856ad3',ramdisk_id='',reservation_id='r-wpwb3c96',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1455437119',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1455437119-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:11:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c90a2da7d9f4fbc9993789800a47d06',uuid=3d3cb2ab-e6f7-4700-9599-1d42b17b2c48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de3e5796-e5a7-4bac-9a3f-cc12d3d45282", "address": "fa:16:3e:32:90:44", "network": {"id": "6ef77fc7-70af-4b8b-a202-b78eed6d619f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1127154808-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a074e5b5a0c04c93a93cf6a066856ad3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3e5796-e5", "ovs_interfaceid": "de3e5796-e5a7-4bac-9a3f-cc12d3d45282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 02:11:52.229802 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Converting VIF {"id": "de3e5796-e5a7-4bac-9a3f-cc12d3d45282", "address": "fa:16:3e:32:90:44", "network": {"id": "6ef77fc7-70af-4b8b-a202-b78eed6d619f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1127154808-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a074e5b5a0c04c93a93cf6a066856ad3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3e5796-e5", "ovs_interfaceid": "de3e5796-e5a7-4bac-9a3f-cc12d3d45282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:11:52.230425 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:90:44,bridge_name='br-int',has_traffic_filtering=True,id=de3e5796-e5a7-4bac-9a3f-cc12d3d45282,network=Network(6ef77fc7-70af-4b8b-a202-b78eed6d619f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde3e5796-e5') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:11:52.231397 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:11:52.734792 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] End _get_guest_xml xml=<domain type="qemu">
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:   <uuid>3d3cb2ab-e6f7-4700-9599-1d42b17b2c48</uuid>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:   <name>instance-0000004f</name>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:   <metadata>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-2038882305</nova:name>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 02:11:52</nova:creationTime>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:       </nova:image>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:         <nova:user uuid="0c90a2da7d9f4fbc9993789800a47d06">tempest-TestServerVolumeAttachmentScenario-1455437119-project-member</nova:user>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:         <nova:project uuid="a074e5b5a0c04c93a93cf6a066856ad3">tempest-TestServerVolumeAttachmentScenario-1455437119</nova:project>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:         <nova:port uuid="de3e5796-e5a7-4bac-9a3f-cc12d3d45282">
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:         </nova:port>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:   </metadata>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:     <system>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:       <entry name="serial">3d3cb2ab-e6f7-4700-9599-1d42b17b2c48</entry>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:       <entry name="uuid">3d3cb2ab-e6f7-4700-9599-1d42b17b2c48</entry>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:     </system>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:   <os>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:   </os>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:   <features>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:     <acpi/>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:     <tcg>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:     </tcg>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:   </features>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:   </cpu>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:   <devices>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/3d3cb2ab-e6f7-4700-9599-1d42b17b2c48/disk"/>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:     </disk>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/3d3cb2ab-e6f7-4700-9599-1d42b17b2c48/disk.config"/>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:     </disk>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:32:90:44"/>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:       <target dev="tapde3e5796-e5"/>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:     </interface>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/3d3cb2ab-e6f7-4700-9599-1d42b17b2c48/console.log" append="off"/>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:     </serial>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:     <video>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:     </video>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:     </rng>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:     </memballoon>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:   </devices>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]: </domain>
May 28 02:11:52.734792 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 02:11:52.736972 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Preparing to wait for external event network-vif-plugged-de3e5796-e5a7-4bac-9a3f-cc12d3d45282 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 02:11:52.736972 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Acquiring lock "3d3cb2ab-e6f7-4700-9599-1d42b17b2c48-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:11:52.736972 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Lock "3d3cb2ab-e6f7-4700-9599-1d42b17b2c48-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:11:52.736972 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Lock "3d3cb2ab-e6f7-4700-9599-1d42b17b2c48-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:11:52.736972 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:11:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2038882305',display_name='tempest-TestServerVolumeAttachmentScenario-server-2038882305',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testservervolumeattachmentscenario-server-2038882305',id=79,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZJ/h5hJi0FfW5EOIhbaBmM1xTGUjJQOAHhcWja+bB3cVb5l0NSXmcrNiuqd3GX8Nt0leLxyEKN+qXMfXDOm8HpYAFiE7CQlz+G50B5ZeCM5U26f6dw5GQFKnLrqXDULg==',key_name='tempest-keypair-762686630',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a074e5b5a0c04c93a93cf6a066856ad3',ramdisk_id='',reservation_id='r-wpwb3c96',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1455437119',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1455437119-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:11:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c90a2da7d9f4fbc9993789800a47d06',uuid=3d3cb2ab-e6f7-4700-9599-1d42b17b2c48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de3e5796-e5a7-4bac-9a3f-cc12d3d45282", "address": "fa:16:3e:32:90:44", "network": {"id": "6ef77fc7-70af-4b8b-a202-b78eed6d619f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1127154808-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a074e5b5a0c04c93a93cf6a066856ad3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3e5796-e5", "ovs_interfaceid": "de3e5796-e5a7-4bac-9a3f-cc12d3d45282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 02:11:52.736972 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Converting VIF {"id": "de3e5796-e5a7-4bac-9a3f-cc12d3d45282", "address": "fa:16:3e:32:90:44", "network": {"id": "6ef77fc7-70af-4b8b-a202-b78eed6d619f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1127154808-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a074e5b5a0c04c93a93cf6a066856ad3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3e5796-e5", "ovs_interfaceid": "de3e5796-e5a7-4bac-9a3f-cc12d3d45282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:11:52.736972 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:90:44,bridge_name='br-int',has_traffic_filtering=True,id=de3e5796-e5a7-4bac-9a3f-cc12d3d45282,network=Network(6ef77fc7-70af-4b8b-a202-b78eed6d619f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde3e5796-e5') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:11:52.736972 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:90:44,bridge_name='br-int',has_traffic_filtering=True,id=de3e5796-e5a7-4bac-9a3f-cc12d3d45282,network=Network(6ef77fc7-70af-4b8b-a202-b78eed6d619f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde3e5796-e5') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 02:11:52.738809 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:52.738809 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:11:52.738809 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 02:11:52.747691 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:52.747691 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a5e954de-d9a2-5973-8b6f-fa772feee936', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:11:52.747691 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Acquiring lock "3ce63103-8c3e-4a5b-a2fb-d90055411d08" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:11:52.747691 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "3ce63103-8c3e-4a5b-a2fb-d90055411d08" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:11:52.748997 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:52.750469 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:11:52.753371 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:52.753609 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde3e5796-e5, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:11:52.754064 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapde3e5796-e5, col_values=(('qos', UUID('30f573d3-2d94-4ffc-b13b-6ba0b75ea462')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:11:52.754448 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapde3e5796-e5, col_values=(('external_ids', {'iface-id': 'de3e5796-e5a7-4bac-9a3f-cc12d3d45282', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:90:44', 'vm-uuid': '3d3cb2ab-e6f7-4700-9599-1d42b17b2c48'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:11:52.756577 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:11:52.761940 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:52.762917 np0000001583 nova-compute[98241]: INFO os_vif [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:90:44,bridge_name='br-int',has_traffic_filtering=True,id=de3e5796-e5a7-4bac-9a3f-cc12d3d45282,network=Network(6ef77fc7-70af-4b8b-a202-b78eed6d619f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde3e5796-e5')
May 28 02:11:53.247494 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lazy-loading 'flavor' on Instance uuid 3ce63103-8c3e-4a5b-a2fb-d90055411d08 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:11:53.664885 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:53.750449 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Ignoring supplied device name: /dev/vdb
May 28 02:11:54.252761 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "3ce63103-8c3e-4a5b-a2fb-d90055411d08" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:11:54.283422 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:11:54.283547 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:11:54.283720 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] No VIF found with MAC fa:16:3e:32:90:44, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:11:54.284268 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Using config drive
May 28 02:11:54.791033 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:11:54.943067 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Creating config drive at /opt/stack/data/nova/instances/3d3cb2ab-e6f7-4700-9599-1d42b17b2c48/disk.config
May 28 02:11:54.946876 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3d3cb2ab-e6f7-4700-9599-1d42b17b2c48/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpj930hwr7 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:11:54.998946 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3d3cb2ab-e6f7-4700-9599-1d42b17b2c48/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpj930hwr7" returned: 0 in 0.052s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:11:55.328465 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Acquiring lock "3ce63103-8c3e-4a5b-a2fb-d90055411d08" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:11:55.328634 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "3ce63103-8c3e-4a5b-a2fb-d90055411d08" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:11:55.328926 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Attaching volume add3647f-0794-4876-8ae4-b009ad81a8b7 to /dev/vdb
May 28 02:11:55.393137 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:11:55.396187 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:55.406395 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 02:11:55.427405 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:55.434881 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:11:55.505793 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 02:11:55.506179 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 02:11:55.516126 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 02:11:55.517768 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fee4:704e', 'fe80::d4e0:76ff:fe99:10f4', 'fe80::fc16:3eff:feef:e02d', 'fe80::fc16:3eff:fe9c:50c4', 'fe80::2c76:91ff:fee7:3598', 'fe80::fc16:3eff:fe1e:6fc0', 'fe80::fc16:3eff:fe13:4cd8', 'fe80::d05c:d0ff:fe98:b4ef', 'fe80::fc16:3eff:fe32:9044'] 
May 28 02:11:55.517936 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 02:11:55.518071 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 02:11:55.519357 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:11:55.519757 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Updating existing volume attachment record: 7d92cba3-7c3f-476e-a652-3aa6dc58ecf9 {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 02:11:55.542663 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:55.588829 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-66efe7b4-539a-4a57-ae9b-7b2f11de7d9c req-0229fde3-d79e-4f61-b9ea-15e3ab0f86f3 service nova] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Received event network-vif-plugged-de3e5796-e5a7-4bac-9a3f-cc12d3d45282 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:11:55.588829 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-66efe7b4-539a-4a57-ae9b-7b2f11de7d9c req-0229fde3-d79e-4f61-b9ea-15e3ab0f86f3 service nova] Acquiring lock "3d3cb2ab-e6f7-4700-9599-1d42b17b2c48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:11:55.588829 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-66efe7b4-539a-4a57-ae9b-7b2f11de7d9c req-0229fde3-d79e-4f61-b9ea-15e3ab0f86f3 service nova] Lock "3d3cb2ab-e6f7-4700-9599-1d42b17b2c48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:11:55.589391 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-66efe7b4-539a-4a57-ae9b-7b2f11de7d9c req-0229fde3-d79e-4f61-b9ea-15e3ab0f86f3 service nova] Lock "3d3cb2ab-e6f7-4700-9599-1d42b17b2c48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:11:55.589509 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-66efe7b4-539a-4a57-ae9b-7b2f11de7d9c req-0229fde3-d79e-4f61-b9ea-15e3ab0f86f3 service nova] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Processing event network-vif-plugged-de3e5796-e5a7-4bac-9a3f-cc12d3d45282 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 02:11:55.761260 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:55.765754 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:55.784416 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:56.091266 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 02:11:56.091702 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7', 'iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'add3647f-0794-4876-8ae4-b009ad81a8b7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:11:56.091824 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:11:56.092284 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:11:56.092537 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7', 'iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'add3647f-0794-4876-8ae4-b009ad81a8b7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 02:11:56.106387 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:11:56.107018 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:11:56.107569 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:11:56.107877 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:11:56.108336 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:11:56.108513 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:11:56.121594 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:11:56.121594 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:11:56.123324 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:11:56.123324 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:11:56.134738 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7] added
May 28 02:11:56.134738 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:11:56.134738 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:11:56.134738 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:11:56.134738 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:11:56.134738 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:11:56.134738 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:11:56.134946 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:11:56.135072 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0273(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:11:56.135226 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:11:56.138012 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7] added
May 28 02:11:56.138012 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:11:56.138012 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:11:56.138012 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:11:56.138012 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:11:56.138012 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:11:56.138012 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:11:56.138258 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:11:56.138297 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0298(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:11:56.138503 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:11:56.186817 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934316.186421, 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48 => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:11:56.187444 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 02:11:56.192179 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] VM Started (Lifecycle Event)
May 28 02:11:56.192785 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 02:11:56.195798 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Instance spawned successfully.
May 28 02:11:56.196185 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 02:11:56.694783 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:11:56.703588 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:11:56.705990 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:11:56.706272 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:11:56.706832 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:11:56.707636 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:11:56.708065 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:11:56.708852 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:11:57.135626 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:11:57.138763 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:11:57.149859 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:11:57.149859 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:11:57.155187 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:11:57.155187 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:11:57.164818 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:11:57.171374 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:11:57.180263 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:11:57.180263 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:11:57.180263 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:11:57.180263 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:11:57.180263 np0000001583 nova-compute[98241]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0 (non-flash)
May 28 02:11:57.180263 np0000001583 nova-compute[98241]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0 (non-flash)
May 28 02:11:57.180263 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:11:57.180516 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:11:57.180516 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:11:57.180516 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:11:57.180516 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:11:57.180516 np0000001583 nova-compute[98241]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0 (non-flash)
May 28 02:11:57.180516 np0000001583 nova-compute[98241]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0 (non-flash)
May 28 02:11:57.180516 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:11:57.188929 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:11:57.188929 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:11:57.188929 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:11:57.188929 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:11:57.188929 np0000001583 nova-compute[98241]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0 (non-flash)
May 28 02:11:57.188929 np0000001583 nova-compute[98241]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0 (non-flash)
May 28 02:11:57.188929 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:11:57.189151 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:11:57.189151 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:11:57.189151 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:11:57.189151 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:11:57.189151 np0000001583 nova-compute[98241]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0 (non-flash)
May 28 02:11:57.189151 np0000001583 nova-compute[98241]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0 (non-flash)
May 28 02:11:57.189151 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:11:57.206102 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 02:11:57.206102 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934317.204825, 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48 => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:11:57.206102 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] VM Paused (Lifecycle Event)
May 28 02:11:57.214134 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Took 6.63 seconds to spawn the instance on the hypervisor.
May 28 02:11:57.214247 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:11:57.234165 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7, portal: 192.168.40.100,3260]
May 28 02:11:57.234165 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7, portal: 192.168.40.100,3260] successful.
May 28 02:11:57.234165 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:11:57.240814 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7, portal: 192.168.50.100,3260]
May 28 02:11:57.240814 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7, portal: 192.168.50.100,3260] successful.
May 28 02:11:57.240814 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:11:57.249131 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:11:57.254688 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:11:57.266804 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:11:57.266804 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:11:57.266804 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:11:57.266804 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:11:57.266804 np0000001583 nova-compute[98241]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0 (non-flash)
May 28 02:11:57.266804 np0000001583 nova-compute[98241]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0 (non-flash)
May 28 02:11:57.266804 np0000001583 nova-compute[98241]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7 (non-flash)
May 28 02:11:57.266804 np0000001583 nova-compute[98241]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7 (non-flash)
May 28 02:11:57.266804 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:11:57.267488 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:11:57.267488 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:11:57.267488 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:11:57.267488 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:11:57.267488 np0000001583 nova-compute[98241]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0 (non-flash)
May 28 02:11:57.267488 np0000001583 nova-compute[98241]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0 (non-flash)
May 28 02:11:57.267488 np0000001583 nova-compute[98241]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7 (non-flash)
May 28 02:11:57.267488 np0000001583 nova-compute[98241]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7 (non-flash)
May 28 02:11:57.267488 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:11:57.267488 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.160s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:11:57.268142 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:11:57.269018 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] HCTL ('10', '-', '-', 0) found on session 210 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:11:57.269190 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:11:57.274680 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:11:57.274680 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:11:57.274680 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:11:57.274680 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:11:57.274680 np0000001583 nova-compute[98241]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0 (non-flash)
May 28 02:11:57.274680 np0000001583 nova-compute[98241]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0 (non-flash)
May 28 02:11:57.274680 np0000001583 nova-compute[98241]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7 (non-flash)
May 28 02:11:57.274680 np0000001583 nova-compute[98241]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7 (non-flash)
May 28 02:11:57.274680 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:11:57.275015 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:11:57.275015 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:11:57.275015 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:11:57.275015 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:11:57.275015 np0000001583 nova-compute[98241]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0 (non-flash)
May 28 02:11:57.275015 np0000001583 nova-compute[98241]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0 (non-flash)
May 28 02:11:57.275015 np0000001583 nova-compute[98241]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7 (non-flash)
May 28 02:11:57.275015 np0000001583 nova-compute[98241]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7 (non-flash)
May 28 02:11:57.275015 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:11:57.275321 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.167s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:11:57.275321 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:11:57.275886 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] HCTL ('11', '-', '-', 0) found on session 211 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:11:57.275977 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:11:57.288530 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Searching for a device in session 210 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:11:57.289015 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'add3647f-0794-4876-8ae4-b009ad81a8b7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:11:57.295089 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Searching for a device in session 211 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:11:57.295089 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'add3647f-0794-4876-8ae4-b009ad81a8b7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:11:57.648373 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0a529d33-34f0-4d41-8d7c-3c0336bd8692 req-cdc97944-18b5-4a0d-b541-aa211c813a4a service nova] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Received event network-vif-plugged-de3e5796-e5a7-4bac-9a3f-cc12d3d45282 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:11:57.648851 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0a529d33-34f0-4d41-8d7c-3c0336bd8692 req-cdc97944-18b5-4a0d-b541-aa211c813a4a service nova] Acquiring lock "3d3cb2ab-e6f7-4700-9599-1d42b17b2c48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:11:57.649045 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0a529d33-34f0-4d41-8d7c-3c0336bd8692 req-cdc97944-18b5-4a0d-b541-aa211c813a4a service nova] Lock "3d3cb2ab-e6f7-4700-9599-1d42b17b2c48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:11:57.649219 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-0a529d33-34f0-4d41-8d7c-3c0336bd8692 req-cdc97944-18b5-4a0d-b541-aa211c813a4a service nova] Lock "3d3cb2ab-e6f7-4700-9599-1d42b17b2c48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:11:57.649411 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-0a529d33-34f0-4d41-8d7c-3c0336bd8692 req-cdc97944-18b5-4a0d-b541-aa211c813a4a service nova] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] No waiting events found dispatching network-vif-plugged-de3e5796-e5a7-4bac-9a3f-cc12d3d45282 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:11:57.649525 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-0a529d33-34f0-4d41-8d7c-3c0336bd8692 req-cdc97944-18b5-4a0d-b541-aa211c813a4a service nova] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Received unexpected event network-vif-plugged-de3e5796-e5a7-4bac-9a3f-cc12d3d45282 for instance with vm_state active and task_state None.
May 28 02:11:57.707416 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:11:57.709790 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934317.70955, 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48 => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:11:57.710883 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] VM Resumed (Lifecycle Event)
May 28 02:11:57.727884 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Took 12.01 seconds to build instance.
May 28 02:11:57.766462 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:58.109503 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 02:11:58.212173 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:11:58.214303 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:11:58.231672 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c1abd85b-7fa7-4a30-b754-28c2ee48298d tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Lock "3d3cb2ab-e6f7-4700-9599-1d42b17b2c48" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.520s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:11:58.665747 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:11:58.967706 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f3ebd465-eb54-4148-9d1b-a907d32a55cc req-99c4b486-ec90-43c8-b83b-b5f4a1083360 service nova] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Received event network-changed-de3e5796-e5a7-4bac-9a3f-cc12d3d45282 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:11:58.967706 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f3ebd465-eb54-4148-9d1b-a907d32a55cc req-99c4b486-ec90-43c8-b83b-b5f4a1083360 service nova] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Refreshing instance network info cache due to event network-changed-de3e5796-e5a7-4bac-9a3f-cc12d3d45282. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:11:58.968043 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f3ebd465-eb54-4148-9d1b-a907d32a55cc req-99c4b486-ec90-43c8-b83b-b5f4a1083360 service nova] Acquiring lock "refresh_cache-3d3cb2ab-e6f7-4700-9599-1d42b17b2c48" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:11:58.968043 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f3ebd465-eb54-4148-9d1b-a907d32a55cc req-99c4b486-ec90-43c8-b83b-b5f4a1083360 service nova] Acquired lock "refresh_cache-3d3cb2ab-e6f7-4700-9599-1d42b17b2c48" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:11:58.968108 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-f3ebd465-eb54-4148-9d1b-a907d32a55cc req-99c4b486-ec90-43c8-b83b-b5f4a1083360 service nova] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Refreshing network info cache for port de3e5796-e5a7-4bac-9a3f-cc12d3d45282 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:11:59.125431 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Found WWN 330000000ee17c9ad for multipath device dm-9 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 02:11:59.125431 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:11:59.125431 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] <== connect_volume: return (3033ms) {'type': 'block', 'scsi_wwn': '330000000ee17c9ad', 'path': '/dev/dm-9', 'multipath_id': '330000000ee17c9ad'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:11:59.125431 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ee17c9ad', 'path': '/dev/dm-9', 'multipath_id': '330000000ee17c9ad'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 02:11:59.127745 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lazy-loading 'flavor' on Instance uuid 3ce63103-8c3e-4a5b-a2fb-d90055411d08 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:11:59.469989 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-f3ebd465-eb54-4148-9d1b-a907d32a55cc req-99c4b486-ec90-43c8-b83b-b5f4a1083360 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:11:59.632016 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Attempting to attach volume add3647f-0794-4876-8ae4-b009ad81a8b7 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98241) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 02:11:59.633207 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] attach device xml: <disk type="block" device="disk">
May 28 02:11:59.633207 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:11:59.633207 np0000001583 nova-compute[98241]:   <alias name="ua-add3647f-0794-4876-8ae4-b009ad81a8b7"/>
May 28 02:11:59.633207 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-9"/>
May 28 02:11:59.633207 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:11:59.633207 np0000001583 nova-compute[98241]:   <serial>add3647f-0794-4876-8ae4-b009ad81a8b7</serial>
May 28 02:11:59.633207 np0000001583 nova-compute[98241]: </disk>
May 28 02:11:59.633207 np0000001583 nova-compute[98241]:  {{(pid=98241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 02:11:59.800441 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-f3ebd465-eb54-4148-9d1b-a907d32a55cc req-99c4b486-ec90-43c8-b83b-b5f4a1083360 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:11:59.935977 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-f3ebd465-eb54-4148-9d1b-a907d32a55cc req-99c4b486-ec90-43c8-b83b-b5f4a1083360 service nova] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Updated VIF entry in instance network info cache for port de3e5796-e5a7-4bac-9a3f-cc12d3d45282. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:11:59.936283 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-f3ebd465-eb54-4148-9d1b-a907d32a55cc req-99c4b486-ec90-43c8-b83b-b5f4a1083360 service nova] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Updating instance_info_cache with network_info: [{"id": "de3e5796-e5a7-4bac-9a3f-cc12d3d45282", "address": "fa:16:3e:32:90:44", "network": {"id": "6ef77fc7-70af-4b8b-a202-b78eed6d619f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1127154808-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a074e5b5a0c04c93a93cf6a066856ad3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3e5796-e5", "ovs_interfaceid": "de3e5796-e5a7-4bac-9a3f-cc12d3d45282", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:12:00.438270 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f3ebd465-eb54-4148-9d1b-a907d32a55cc req-99c4b486-ec90-43c8-b83b-b5f4a1083360 service nova] Releasing lock "refresh_cache-3d3cb2ab-e6f7-4700-9599-1d42b17b2c48" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:12:01.291109 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:12:01.291109 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:12:01.291109 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:12:01.291109 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] No VIF found with MAC fa:16:3e:9c:50:c4, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:12:02.778637 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:02.838116 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-46547df7-a575-4d5f-b34a-00504d137fe9 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "3ce63103-8c3e-4a5b-a2fb-d90055411d08" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.509s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:12:03.667724 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:07.789715 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:08.623323 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-041bd9d4-5608-4d09-8925-247ea4c1b40c tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Acquiring lock "3ce63103-8c3e-4a5b-a2fb-d90055411d08" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:12:08.623499 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-041bd9d4-5608-4d09-8925-247ea4c1b40c tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "3ce63103-8c3e-4a5b-a2fb-d90055411d08" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:12:08.669501 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:08.701826 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4a5045ad-60fa-41ba-af23-a9f24cca9a1a tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Acquiring lock "3ce63103-8c3e-4a5b-a2fb-d90055411d08" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:12:09.125879 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-041bd9d4-5608-4d09-8925-247ea4c1b40c tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Detaching volume add3647f-0794-4876-8ae4-b009ad81a8b7
May 28 02:12:09.169929 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-041bd9d4-5608-4d09-8925-247ea4c1b40c tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Attempting to driver detach volume add3647f-0794-4876-8ae4-b009ad81a8b7 from mountpoint /dev/vdb
May 28 02:12:09.174811 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-041bd9d4-5608-4d09-8925-247ea4c1b40c tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Found disk vdb by alias ua-add3647f-0794-4876-8ae4-b009ad81a8b7 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:12:09.176189 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-041bd9d4-5608-4d09-8925-247ea4c1b40c tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Found disk vdb by alias ua-add3647f-0794-4876-8ae4-b009ad81a8b7 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:12:09.176339 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-041bd9d4-5608-4d09-8925-247ea4c1b40c tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Attempting to detach device vdb from instance 3ce63103-8c3e-4a5b-a2fb-d90055411d08 from the persistent domain config. {{(pid=98241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 02:12:09.176639 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-041bd9d4-5608-4d09-8925-247ea4c1b40c tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:12:09.176639 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:12:09.176639 np0000001583 nova-compute[98241]:   <alias name="ua-add3647f-0794-4876-8ae4-b009ad81a8b7"/>
May 28 02:12:09.176639 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-9"/>
May 28 02:12:09.176639 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:12:09.176639 np0000001583 nova-compute[98241]:   <serial>add3647f-0794-4876-8ae4-b009ad81a8b7</serial>
May 28 02:12:09.176639 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 02:12:09.176639 np0000001583 nova-compute[98241]: </disk>
May 28 02:12:09.176639 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:12:09.183038 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-041bd9d4-5608-4d09-8925-247ea4c1b40c tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Successfully detached device vdb from instance 3ce63103-8c3e-4a5b-a2fb-d90055411d08 from the persistent domain config.
May 28 02:12:09.183253 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-041bd9d4-5608-4d09-8925-247ea4c1b40c tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] (1/8): Attempting to detach device vdb with device alias ua-add3647f-0794-4876-8ae4-b009ad81a8b7 from instance 3ce63103-8c3e-4a5b-a2fb-d90055411d08 from the live domain config. {{(pid=98241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 02:12:09.183556 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-041bd9d4-5608-4d09-8925-247ea4c1b40c tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:12:09.183556 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:12:09.183556 np0000001583 nova-compute[98241]:   <alias name="ua-add3647f-0794-4876-8ae4-b009ad81a8b7"/>
May 28 02:12:09.183556 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-9"/>
May 28 02:12:09.183556 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:12:09.183556 np0000001583 nova-compute[98241]:   <serial>add3647f-0794-4876-8ae4-b009ad81a8b7</serial>
May 28 02:12:09.183556 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 02:12:09.183556 np0000001583 nova-compute[98241]: </disk>
May 28 02:12:09.183556 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:12:09.662681 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Received event <DeviceRemovedEvent: 1779934329.6623077, 3ce63103-8c3e-4a5b-a2fb-d90055411d08 => ua-add3647f-0794-4876-8ae4-b009ad81a8b7> from libvirt while the driver is waiting for it; dispatched. {{(pid=98241) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 02:12:09.663127 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-041bd9d4-5608-4d09-8925-247ea4c1b40c tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-add3647f-0794-4876-8ae4-b009ad81a8b7 for instance 3ce63103-8c3e-4a5b-a2fb-d90055411d08 {{(pid=98241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 02:12:09.665295 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-041bd9d4-5608-4d09-8925-247ea4c1b40c tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Successfully detached device vdb from instance 3ce63103-8c3e-4a5b-a2fb-d90055411d08 from the live domain config.
May 28 02:12:09.666339 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-041bd9d4-5608-4d09-8925-247ea4c1b40c tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:12:09.666591 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-041bd9d4-5608-4d09-8925-247ea4c1b40c tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7', 'iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'add3647f-0794-4876-8ae4-b009ad81a8b7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': False}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:12:09.666710 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-041bd9d4-5608-4d09-8925-247ea4c1b40c tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:12:09.667006 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-041bd9d4-5608-4d09-8925-247ea4c1b40c tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:12:09.667277 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-041bd9d4-5608-4d09-8925-247ea4c1b40c tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7', 'iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'add3647f-0794-4876-8ae4-b009ad81a8b7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:12:09.667394 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-041bd9d4-5608-4d09-8925-247ea4c1b40c tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:12:09.695435 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-041bd9d4-5608-4d09-8925-247ea4c1b40c tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:12:09.695435 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:12:09.695435 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:12:09.695435 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:12:09.695435 np0000001583 nova-compute[98241]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0 (non-flash)
May 28 02:12:09.695435 np0000001583 nova-compute[98241]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0 (non-flash)
May 28 02:12:09.695435 np0000001583 nova-compute[98241]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7 (non-flash)
May 28 02:12:09.695435 np0000001583 nova-compute[98241]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7 (non-flash)
May 28 02:12:09.695435 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:12:09.695862 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-041bd9d4-5608-4d09-8925-247ea4c1b40c tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:12:09.695862 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:12:09.695862 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:12:09.695862 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:12:09.695862 np0000001583 nova-compute[98241]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0 (non-flash)
May 28 02:12:09.695862 np0000001583 nova-compute[98241]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0 (non-flash)
May 28 02:12:09.695862 np0000001583 nova-compute[98241]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7 (non-flash)
May 28 02:12:09.695862 np0000001583 nova-compute[98241]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7 (non-flash)
May 28 02:12:09.695862 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:12:09.695862 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-041bd9d4-5608-4d09-8925-247ea4c1b40c tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb', '181'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb', '182'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0', '194'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0', '195'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0', '208'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0', '209'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7', '210'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7', '211')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:12:09.696294 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-041bd9d4-5608-4d09-8925-247ea4c1b40c tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7', '210')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:12:09.697169 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-041bd9d4-5608-4d09-8925-247ea4c1b40c tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7', '211')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:12:09.698106 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-041bd9d4-5608-4d09-8925-247ea4c1b40c tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724ec1aed40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7'): ({'sdf'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:12:09.698428 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-041bd9d4-5608-4d09-8925-247ea4c1b40c tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Removing multipathed devices sdf, sde {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:12:09.698879 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-041bd9d4-5608-4d09-8925-247ea4c1b40c tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Flush multipath device 330000000ee17c9ad {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:12:09.731695 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-041bd9d4-5608-4d09-8925-247ea4c1b40c tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:12:09.771635 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-041bd9d4-5608-4d09-8925-247ea4c1b40c tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:12:09.822866 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-041bd9d4-5608-4d09-8925-247ea4c1b40c tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Checking to see if SCSI volumes sdf, sde have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:12:09.823066 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-041bd9d4-5608-4d09-8925-247ea4c1b40c tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] SCSI volumes sdf, sde have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:12:09.824643 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-041bd9d4-5608-4d09-8925-247ea4c1b40c tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Checking to see if device paths {'sdf', 'sde'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:12:09.836833 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-041bd9d4-5608-4d09-8925-247ea4c1b40c tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Device paths {'sdf', 'sde'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:12:09.837062 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-041bd9d4-5608-4d09-8925-247ea4c1b40c tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:12:09.849519 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-041bd9d4-5608-4d09-8925-247ea4c1b40c tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:09.881844 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-041bd9d4-5608-4d09-8925-247ea4c1b40c tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 210, target: iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7, portal: 192.168.40.100,3260]
May 28 02:12:09.881844 np0000001583 nova-compute[98241]: Logout of [sid: 210, target: iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7, portal: 192.168.40.100,3260] successful.
May 28 02:12:09.881844 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:09.903463 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-041bd9d4-5608-4d09-8925-247ea4c1b40c tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:09.914644 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-041bd9d4-5608-4d09-8925-247ea4c1b40c tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:09.944047 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-041bd9d4-5608-4d09-8925-247ea4c1b40c tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 211, target: iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7, portal: 192.168.50.100,3260]
May 28 02:12:09.944047 np0000001583 nova-compute[98241]: Logout of [sid: 211, target: iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7, portal: 192.168.50.100,3260] successful.
May 28 02:12:09.944047 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:09.963427 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-041bd9d4-5608-4d09-8925-247ea4c1b40c tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:09.963657 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-041bd9d4-5608-4d09-8925-247ea4c1b40c tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:12:09.963782 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-041bd9d4-5608-4d09-8925-247ea4c1b40c tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] <== disconnect_volume: return (297ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:12:09.963890 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-041bd9d4-5608-4d09-8925-247ea4c1b40c tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:12:10.514329 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-041bd9d4-5608-4d09-8925-247ea4c1b40c tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lazy-loading 'flavor' on Instance uuid 3ce63103-8c3e-4a5b-a2fb-d90055411d08 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:12:11.519499 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-041bd9d4-5608-4d09-8925-247ea4c1b40c tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "3ce63103-8c3e-4a5b-a2fb-d90055411d08" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.896s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:12:11.520396 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4a5045ad-60fa-41ba-af23-a9f24cca9a1a tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "3ce63103-8c3e-4a5b-a2fb-d90055411d08" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 2.818s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:12:11.520649 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4a5045ad-60fa-41ba-af23-a9f24cca9a1a tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Acquiring lock "3ce63103-8c3e-4a5b-a2fb-d90055411d08-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:12:11.520805 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4a5045ad-60fa-41ba-af23-a9f24cca9a1a tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "3ce63103-8c3e-4a5b-a2fb-d90055411d08-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:12:11.520995 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4a5045ad-60fa-41ba-af23-a9f24cca9a1a tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "3ce63103-8c3e-4a5b-a2fb-d90055411d08-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:12:11.523222 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-4a5045ad-60fa-41ba-af23-a9f24cca9a1a tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Terminating instance
May 28 02:12:11.822273 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Acquiring lock "4d069122-da2e-445e-8ce3-377692925d87" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:12:11.822273 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "4d069122-da2e-445e-8ce3-377692925d87" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:12:11.822273 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Acquiring lock "4d069122-da2e-445e-8ce3-377692925d87-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:12:11.822273 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "4d069122-da2e-445e-8ce3-377692925d87-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:12:11.822273 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "4d069122-da2e-445e-8ce3-377692925d87-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:12:11.823172 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Terminating instance
May 28 02:12:12.025863 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-4a5045ad-60fa-41ba-af23-a9f24cca9a1a tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 02:12:12.042517 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:12.044401 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:12.065963 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:12.068611 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:12.088804 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:12.089326 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:12.175476 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5c264d38-aec3-47bb-a91f-b08e31a25968 req-d1ea0d57-bb1e-4b6d-ac62-016ac63b26e3 service nova] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Received event network-vif-unplugged-af3509df-12e0-45a5-89d5-8b4aba6b5ca4 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:12:12.175677 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5c264d38-aec3-47bb-a91f-b08e31a25968 req-d1ea0d57-bb1e-4b6d-ac62-016ac63b26e3 service nova] Acquiring lock "3ce63103-8c3e-4a5b-a2fb-d90055411d08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:12:12.176201 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5c264d38-aec3-47bb-a91f-b08e31a25968 req-d1ea0d57-bb1e-4b6d-ac62-016ac63b26e3 service nova] Lock "3ce63103-8c3e-4a5b-a2fb-d90055411d08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:12:12.176344 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5c264d38-aec3-47bb-a91f-b08e31a25968 req-d1ea0d57-bb1e-4b6d-ac62-016ac63b26e3 service nova] Lock "3ce63103-8c3e-4a5b-a2fb-d90055411d08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:12:12.176488 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5c264d38-aec3-47bb-a91f-b08e31a25968 req-d1ea0d57-bb1e-4b6d-ac62-016ac63b26e3 service nova] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] No waiting events found dispatching network-vif-unplugged-af3509df-12e0-45a5-89d5-8b4aba6b5ca4 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:12:12.176612 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5c264d38-aec3-47bb-a91f-b08e31a25968 req-d1ea0d57-bb1e-4b6d-ac62-016ac63b26e3 service nova] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Received event network-vif-unplugged-af3509df-12e0-45a5-89d5-8b4aba6b5ca4 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:12:12.314541 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:12.321476 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:12.326357 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 02:12:12.344586 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999697466999805 future=<Future at 0x7724f87e63c0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:12:12.345566 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.998684871000023 future=<Future at 0x7724f87e63c0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:12:12.345929 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.998345788999814 future=<Future at 0x7724f87e63c0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:12:12.347367 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Instance destroyed successfully.
May 28 02:12:12.349754 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-4a5045ad-60fa-41ba-af23-a9f24cca9a1a tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lazy-loading 'resources' on Instance uuid 3ce63103-8c3e-4a5b-a2fb-d90055411d08 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:12:12.354196 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:12.356142 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:12.373139 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:12.486923 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ef3ef31b-a375-40ed-a891-d549ef6def3a req-e2035a8f-6532-4235-936f-7dee2c382d00 service nova] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Received event network-vif-unplugged-cec7eafb-605b-44cc-ab7c-fb748c33f63e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:12:12.487370 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ef3ef31b-a375-40ed-a891-d549ef6def3a req-e2035a8f-6532-4235-936f-7dee2c382d00 service nova] Acquiring lock "4d069122-da2e-445e-8ce3-377692925d87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:12:12.487623 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ef3ef31b-a375-40ed-a891-d549ef6def3a req-e2035a8f-6532-4235-936f-7dee2c382d00 service nova] Lock "4d069122-da2e-445e-8ce3-377692925d87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:12:12.487985 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ef3ef31b-a375-40ed-a891-d549ef6def3a req-e2035a8f-6532-4235-936f-7dee2c382d00 service nova] Lock "4d069122-da2e-445e-8ce3-377692925d87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:12:12.488243 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ef3ef31b-a375-40ed-a891-d549ef6def3a req-e2035a8f-6532-4235-936f-7dee2c382d00 service nova] [instance: 4d069122-da2e-445e-8ce3-377692925d87] No waiting events found dispatching network-vif-unplugged-cec7eafb-605b-44cc-ab7c-fb748c33f63e {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:12:12.488476 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ef3ef31b-a375-40ed-a891-d549ef6def3a req-e2035a8f-6532-4235-936f-7dee2c382d00 service nova] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Received event network-vif-unplugged-cec7eafb-605b-44cc-ab7c-fb748c33f63e for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:12:12.500285 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:12.509662 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:12.660453 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.99969083399992 future=<Future at 0x7724ec2af740 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:12:12.665152 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Instance destroyed successfully.
May 28 02:12:12.665272 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lazy-loading 'resources' on Instance uuid 4d069122-da2e-445e-8ce3-377692925d87 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:12:12.791299 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:12.850320 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-4a5045ad-60fa-41ba-af23-a9f24cca9a1a tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T02:11:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-384843707',display_name='tempest-VolumesSnapshotTestJSON-instance-384843707',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-volumessnapshottestjson-instance-384843707',id=76,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxNe0MYeOzu1rv+GQ0lcSCtUe9pRSrf8tzXRp1HxeWRfhyyQci9mgcUsHtuCDVK8RCfQ1YYBEXvfX2IFzb+2gmqrdP7ptO2XA/8IakPZC0ldBQRbJtwxZcRcpwFzEsYQg==',key_name='tempest-keypair-327744188',keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:11:15Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a20805bca06645eabf880bb71e4b69e3',ramdisk_id='',reservation_id='r-4uw8ma5o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1803039293',owner_user_name='tempest-VolumesSnapshotTestJSON-1803039293-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T02:11:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6c21669663a49f39202d3ca89337d19',uuid=3ce63103-8c3e-4a5b-a2fb-d90055411d08,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af3509df-12e0-45a5-89d5-8b4aba6b5ca4", "address": "fa:16:3e:9c:50:c4", "network": {"id": "ff6dd0d5-1bec-49e1-b85f-c4257cd37d52", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-230174350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a20805bca06645eabf880bb71e4b69e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3509df-12", "ovs_interfaceid": "af3509df-12e0-45a5-89d5-8b4aba6b5ca4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:12:12.850534 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-4a5045ad-60fa-41ba-af23-a9f24cca9a1a tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Converting VIF {"id": "af3509df-12e0-45a5-89d5-8b4aba6b5ca4", "address": "fa:16:3e:9c:50:c4", "network": {"id": "ff6dd0d5-1bec-49e1-b85f-c4257cd37d52", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-230174350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a20805bca06645eabf880bb71e4b69e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3509df-12", "ovs_interfaceid": "af3509df-12e0-45a5-89d5-8b4aba6b5ca4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:12:12.851172 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-4a5045ad-60fa-41ba-af23-a9f24cca9a1a tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:50:c4,bridge_name='br-int',has_traffic_filtering=True,id=af3509df-12e0-45a5-89d5-8b4aba6b5ca4,network=Network(ff6dd0d5-1bec-49e1-b85f-c4257cd37d52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf3509df-12') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:12:12.851452 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-4a5045ad-60fa-41ba-af23-a9f24cca9a1a tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:50:c4,bridge_name='br-int',has_traffic_filtering=True,id=af3509df-12e0-45a5-89d5-8b4aba6b5ca4,network=Network(ff6dd0d5-1bec-49e1-b85f-c4257cd37d52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf3509df-12') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:12:12.852721 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:12.852938 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf3509df-12, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:12:12.853935 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:12.854976 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:12:12.860612 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:12.861723 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:12.861943 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f3bdcb4e-a534-4fff-be67-fe7795db09f2) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:12:12.862519 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:12.863260 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:12:12.867776 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:12.869765 np0000001583 nova-compute[98241]: INFO os_vif [None req-4a5045ad-60fa-41ba-af23-a9f24cca9a1a tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:50:c4,bridge_name='br-int',has_traffic_filtering=True,id=af3509df-12e0-45a5-89d5-8b4aba6b5ca4,network=Network(ff6dd0d5-1bec-49e1-b85f-c4257cd37d52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf3509df-12')
May 28 02:12:12.871598 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a5045ad-60fa-41ba-af23-a9f24cca9a1a tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:12:12.871951 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5045ad-60fa-41ba-af23-a9f24cca9a1a tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7', 'iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'add3647f-0794-4876-8ae4-b009ad81a8b7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:12:12.872120 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-4a5045ad-60fa-41ba-af23-a9f24cca9a1a tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:12:12.872563 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-4a5045ad-60fa-41ba-af23-a9f24cca9a1a tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:12:12.872903 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5045ad-60fa-41ba-af23-a9f24cca9a1a tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7', 'iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'add3647f-0794-4876-8ae4-b009ad81a8b7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:12:12.873052 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5045ad-60fa-41ba-af23-a9f24cca9a1a tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:12:12.902773 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5045ad-60fa-41ba-af23-a9f24cca9a1a tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:12:12.902773 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:12:12.902773 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:12:12.902773 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:12:12.902773 np0000001583 nova-compute[98241]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0 (non-flash)
May 28 02:12:12.902773 np0000001583 nova-compute[98241]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0 (non-flash)
May 28 02:12:12.902773 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:12:12.902990 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5045ad-60fa-41ba-af23-a9f24cca9a1a tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:12:12.902990 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:12:12.902990 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:12:12.902990 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:12:12.902990 np0000001583 nova-compute[98241]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0 (non-flash)
May 28 02:12:12.902990 np0000001583 nova-compute[98241]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0 (non-flash)
May 28 02:12:12.902990 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:12:12.903148 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5045ad-60fa-41ba-af23-a9f24cca9a1a tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb', '181'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb', '182'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0', '194'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0', '195'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0', '208'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0', '209')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:12:12.903273 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5045ad-60fa-41ba-af23-a9f24cca9a1a tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7, 0): [] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:12:12.903407 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5045ad-60fa-41ba-af23-a9f24cca9a1a tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7') {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 28 02:12:12.903525 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5045ad-60fa-41ba-af23-a9f24cca9a1a tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7, 0): [] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:12:12.903650 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5045ad-60fa-41ba-af23-a9f24cca9a1a tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-add3647f-0794-4876-8ae4-b009ad81a8b7') {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 28 02:12:12.903767 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5045ad-60fa-41ba-af23-a9f24cca9a1a tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724ec25f240>, {}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:12:12.903894 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5045ad-60fa-41ba-af23-a9f24cca9a1a tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Disconnecting from: [] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:12:12.904112 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-4a5045ad-60fa-41ba-af23-a9f24cca9a1a tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.032s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:12:12.904250 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5045ad-60fa-41ba-af23-a9f24cca9a1a tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] <== disconnect_volume: return (32ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:12:12.904384 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a5045ad-60fa-41ba-af23-a9f24cca9a1a tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:12:12.904685 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-4a5045ad-60fa-41ba-af23-a9f24cca9a1a tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Deleting instance files /opt/stack/data/nova/instances/3ce63103-8c3e-4a5b-a2fb-d90055411d08_del
May 28 02:12:12.905587 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-4a5045ad-60fa-41ba-af23-a9f24cca9a1a tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Deletion of /opt/stack/data/nova/instances/3ce63103-8c3e-4a5b-a2fb-d90055411d08_del complete
May 28 02:12:13.167855 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T02:11:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1382185505',display_name='tempest-TestVolumeBootPatternV346-server-1382185505',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testvolumebootpatternv346-server-1382185505',id=77,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ/lnetI19trduK+u/OFeU6Vl1vJl5sGiPvYb+vIHSNO35lHiQOiuS2yGR6fR7Jaaz2jdkTZJrQykDoFtoS8yzSrcVHMR2Wu4wVJFy+2O3rVKo5dqMhPgY3jU0Bqhpdkaw==',key_name='tempest-keypair-138520030',keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:11:32Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60b5c56c77c64b318056094f7fa5861d',ramdisk_id='',reservation_id='r-jgbn1n0b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPatternV346-884356236',owner_user_name='tempest-TestVolumeBootPatternV346-884356236-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T02:11:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8ce004361ad4602a6f330506184114b',uuid=4d069122-da2e-445e-8ce3-377692925d87,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cec7eafb-605b-44cc-ab7c-fb748c33f63e", "address": "fa:16:3e:1e:6f:c0", "network": {"id": "a349b3ac-cae9-4909-b273-8409a97fbe5c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-810622904-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60b5c56c77c64b318056094f7fa5861d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec7eafb-60", "ovs_interfaceid": "cec7eafb-605b-44cc-ab7c-fb748c33f63e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:12:13.168039 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Converting VIF {"id": "cec7eafb-605b-44cc-ab7c-fb748c33f63e", "address": "fa:16:3e:1e:6f:c0", "network": {"id": "a349b3ac-cae9-4909-b273-8409a97fbe5c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-810622904-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60b5c56c77c64b318056094f7fa5861d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec7eafb-60", "ovs_interfaceid": "cec7eafb-605b-44cc-ab7c-fb748c33f63e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:12:13.168628 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:6f:c0,bridge_name='br-int',has_traffic_filtering=True,id=cec7eafb-605b-44cc-ab7c-fb748c33f63e,network=Network(a349b3ac-cae9-4909-b273-8409a97fbe5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcec7eafb-60') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:12:13.168877 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:6f:c0,bridge_name='br-int',has_traffic_filtering=True,id=cec7eafb-605b-44cc-ab7c-fb748c33f63e,network=Network(a349b3ac-cae9-4909-b273-8409a97fbe5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcec7eafb-60') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:12:13.169802 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:13.169979 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcec7eafb-60, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:12:13.170869 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:13.171975 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:12:13.172162 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:13.172803 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:13.172918 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1f715a4d-d036-40cf-9ee4-bc7c290aea76) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:12:13.173331 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:13.174001 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:12:13.175832 np0000001583 nova-compute[98241]: INFO os_vif [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:6f:c0,bridge_name='br-int',has_traffic_filtering=True,id=cec7eafb-605b-44cc-ab7c-fb748c33f63e,network=Network(a349b3ac-cae9-4909-b273-8409a97fbe5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcec7eafb-60')
May 28 02:12:13.177472 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 4d069122-da2e-445e-8ce3-377692925d87] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:12:13.177746 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0', 'iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5566f652-d0df-45d4-b7e0-0aac4c7371c0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:12:13.177880 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:12:13.178194 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:12:13.178484 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0', 'iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5566f652-d0df-45d4-b7e0-0aac4c7371c0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:12:13.178612 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:12:13.204614 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:12:13.204614 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:12:13.204614 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:12:13.204614 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:12:13.204614 np0000001583 nova-compute[98241]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0 (non-flash)
May 28 02:12:13.204614 np0000001583 nova-compute[98241]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0 (non-flash)
May 28 02:12:13.204614 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:12:13.204928 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:12:13.204928 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:12:13.204928 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:12:13.204928 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:12:13.204928 np0000001583 nova-compute[98241]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0 (non-flash)
May 28 02:12:13.204928 np0000001583 nova-compute[98241]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0 (non-flash)
May 28 02:12:13.204928 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:12:13.204928 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb', '181'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb', '182'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0', '194'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0', '195'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0', '208'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0', '209')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:12:13.205213 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0', '208')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:12:13.206060 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0', '209')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:12:13.206974 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724ec326b60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0'): ({'sdc'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:12:13.207624 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Removing multipathed devices sdc, sdb {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:12:13.207988 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Flush multipath device 330000000a000920c {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:12:13.258845 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:12:13.303526 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:12:13.340713 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:12:13.341009 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:12:13.341920 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:12:13.353766 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:12:13.354026 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:12:13.367733 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:13.393152 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 208, target: iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0, portal: 192.168.40.100,3260]
May 28 02:12:13.393152 np0000001583 nova-compute[98241]: Logout of [sid: 208, target: iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0, portal: 192.168.40.100,3260] successful.
May 28 02:12:13.393152 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:13.408264 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:13.411692 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-4a5045ad-60fa-41ba-af23-a9f24cca9a1a tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Took 1.39 seconds to destroy the instance on the hypervisor.
May 28 02:12:13.412308 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-4a5045ad-60fa-41ba-af23-a9f24cca9a1a tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 02:12:13.414358 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 02:12:13.414358 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 02:12:13.414358 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:12:13.421101 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:13.449561 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 209, target: iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0, portal: 192.168.50.100,3260]
May 28 02:12:13.449561 np0000001583 nova-compute[98241]: Logout of [sid: 209, target: iqn.2023-03.storpool.com:os--volume-5566f652-d0df-45d4-b7e0-0aac4c7371c0, portal: 192.168.50.100,3260] successful.
May 28 02:12:13.449561 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:13.465439 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:13.465755 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:12:13.465918 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] <== disconnect_volume: return (288ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:12:13.466091 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:12:13.466434 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Deleting instance files /opt/stack/data/nova/instances/4d069122-da2e-445e-8ce3-377692925d87_del
May 28 02:12:13.466914 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Deletion of /opt/stack/data/nova/instances/4d069122-da2e-445e-8ce3-377692925d87_del complete
May 28 02:12:13.475894 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:12:13.671230 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:13.973535 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Took 1.65 seconds to destroy the instance on the hypervisor.
May 28 02:12:13.974018 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 02:12:13.974317 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 02:12:13.974454 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 4d069122-da2e-445e-8ce3-377692925d87] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 02:12:13.974644 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:12:14.033380 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:12:14.251273 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-6bf3dea3-af25-43be-9f24-83f0949e60da req-381dfe2a-c468-467f-8c41-89b89da7f26e service nova] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Received event network-vif-unplugged-af3509df-12e0-45a5-89d5-8b4aba6b5ca4 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:12:14.253464 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-6bf3dea3-af25-43be-9f24-83f0949e60da req-381dfe2a-c468-467f-8c41-89b89da7f26e service nova] Acquiring lock "3ce63103-8c3e-4a5b-a2fb-d90055411d08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:12:14.253677 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-6bf3dea3-af25-43be-9f24-83f0949e60da req-381dfe2a-c468-467f-8c41-89b89da7f26e service nova] Lock "3ce63103-8c3e-4a5b-a2fb-d90055411d08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:12:14.253830 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-6bf3dea3-af25-43be-9f24-83f0949e60da req-381dfe2a-c468-467f-8c41-89b89da7f26e service nova] Lock "3ce63103-8c3e-4a5b-a2fb-d90055411d08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:12:14.253988 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-6bf3dea3-af25-43be-9f24-83f0949e60da req-381dfe2a-c468-467f-8c41-89b89da7f26e service nova] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] No waiting events found dispatching network-vif-unplugged-af3509df-12e0-45a5-89d5-8b4aba6b5ca4 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:12:14.254142 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-6bf3dea3-af25-43be-9f24-83f0949e60da req-381dfe2a-c468-467f-8c41-89b89da7f26e service nova] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Received event network-vif-unplugged-af3509df-12e0-45a5-89d5-8b4aba6b5ca4 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:12:14.328169 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:12:14.561015 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-8cbb4fdf-98f0-408d-adb4-ea3f6a138e8f req-7dc813c6-168a-4926-a48c-a21f6cf07322 service nova] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Received event network-vif-unplugged-cec7eafb-605b-44cc-ab7c-fb748c33f63e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:12:14.561489 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-8cbb4fdf-98f0-408d-adb4-ea3f6a138e8f req-7dc813c6-168a-4926-a48c-a21f6cf07322 service nova] Acquiring lock "4d069122-da2e-445e-8ce3-377692925d87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:12:14.561769 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-8cbb4fdf-98f0-408d-adb4-ea3f6a138e8f req-7dc813c6-168a-4926-a48c-a21f6cf07322 service nova] Lock "4d069122-da2e-445e-8ce3-377692925d87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:12:14.561769 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-8cbb4fdf-98f0-408d-adb4-ea3f6a138e8f req-7dc813c6-168a-4926-a48c-a21f6cf07322 service nova] Lock "4d069122-da2e-445e-8ce3-377692925d87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:12:14.561930 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-8cbb4fdf-98f0-408d-adb4-ea3f6a138e8f req-7dc813c6-168a-4926-a48c-a21f6cf07322 service nova] [instance: 4d069122-da2e-445e-8ce3-377692925d87] No waiting events found dispatching network-vif-unplugged-cec7eafb-605b-44cc-ab7c-fb748c33f63e {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:12:14.561988 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-8cbb4fdf-98f0-408d-adb4-ea3f6a138e8f req-7dc813c6-168a-4926-a48c-a21f6cf07322 service nova] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Received event network-vif-unplugged-cec7eafb-605b-44cc-ab7c-fb748c33f63e for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:12:14.562101 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-8cbb4fdf-98f0-408d-adb4-ea3f6a138e8f req-7dc813c6-168a-4926-a48c-a21f6cf07322 service nova] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Received event network-vif-deleted-af3509df-12e0-45a5-89d5-8b4aba6b5ca4 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:12:14.562222 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-8cbb4fdf-98f0-408d-adb4-ea3f6a138e8f req-7dc813c6-168a-4926-a48c-a21f6cf07322 service nova] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Received event network-vif-deleted-cec7eafb-605b-44cc-ab7c-fb748c33f63e {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:12:14.562339 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-8cbb4fdf-98f0-408d-adb4-ea3f6a138e8f req-7dc813c6-168a-4926-a48c-a21f6cf07322 service nova] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Neutron deleted interface cec7eafb-605b-44cc-ab7c-fb748c33f63e; detaching it from the instance and deleting it from the info cache
May 28 02:12:14.564307 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-8cbb4fdf-98f0-408d-adb4-ea3f6a138e8f req-7dc813c6-168a-4926-a48c-a21f6cf07322 service nova] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Detach interface failed, port_id=cec7eafb-605b-44cc-ab7c-fb748c33f63e, reason: Instance 4d069122-da2e-445e-8ce3-377692925d87 could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 02:12:14.827652 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Took 1.41 seconds to deallocate network for instance.
May 28 02:12:14.842622 np0000001583 nova-compute[98241]: WARNING nova.volume.cinder [None req-4a5045ad-60fa-41ba-af23-a9f24cca9a1a tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Attachment 7d92cba3-7c3f-476e-a652-3aa6dc58ecf9 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 7d92cba3-7c3f-476e-a652-3aa6dc58ecf9. (HTTP 404) (Request-ID: req-5403a942-5e8c-4fc5-9686-45b9beec0757)
May 28 02:12:14.842891 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-4a5045ad-60fa-41ba-af23-a9f24cca9a1a tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Took 0.02 seconds to detach 1 volumes for instance.
May 28 02:12:14.871750 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:12:15.348927 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4a5045ad-60fa-41ba-af23-a9f24cca9a1a tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:12:15.349209 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4a5045ad-60fa-41ba-af23-a9f24cca9a1a tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:12:15.373737 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Took 1.40 seconds to deallocate network for instance.
May 28 02:12:15.652241 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-4a5045ad-60fa-41ba-af23-a9f24cca9a1a tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:12:15.652516 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-4a5045ad-60fa-41ba-af23-a9f24cca9a1a tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:12:15.922564 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Took 0.55 seconds to detach 1 volumes for instance.
May 28 02:12:16.157105 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-4a5045ad-60fa-41ba-af23-a9f24cca9a1a tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:12:16.427698 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:12:16.664806 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4a5045ad-60fa-41ba-af23-a9f24cca9a1a tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.316s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:12:16.666451 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.237s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:12:16.726630 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-4a5045ad-60fa-41ba-af23-a9f24cca9a1a tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Deleted allocations for instance 3ce63103-8c3e-4a5b-a2fb-d90055411d08
May 28 02:12:16.976013 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:12:16.976575 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:12:17.478763 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:12:17.738155 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-4a5045ad-60fa-41ba-af23-a9f24cca9a1a tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Lock "3ce63103-8c3e-4a5b-a2fb-d90055411d08" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.218s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:12:17.984811 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.319s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:12:18.045094 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Deleted allocations for instance 4d069122-da2e-445e-8ce3-377692925d87
May 28 02:12:18.174601 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:18.672846 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:19.052737 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2ac14ff0-c46e-4836-987e-5d87159bfaa4 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "4d069122-da2e-445e-8ce3-377692925d87" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.232s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:12:22.193306 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:12:22.193777 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:12:22.733179 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Acquiring lock "1c600f44-79c3-4d3f-ad07-0f09ad498836" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:12:22.733370 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "1c600f44-79c3-4d3f-ad07-0f09ad498836" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:12:22.733560 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Acquiring lock "1c600f44-79c3-4d3f-ad07-0f09ad498836-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:12:22.733724 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "1c600f44-79c3-4d3f-ad07-0f09ad498836-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:12:22.733829 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "1c600f44-79c3-4d3f-ad07-0f09ad498836-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:12:22.735904 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Terminating instance
May 28 02:12:23.175605 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:23.239405 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 02:12:23.256305 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:23.259068 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:23.281447 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:23.393327 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:23.399386 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:23.432587 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-366c1a51-fc19-45ce-a11f-6fc75281d680 req-188770e2-e965-40fc-8d11-0ae5546f4430 service nova] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Received event network-vif-unplugged-297624aa-10d3-472b-99eb-50d74b733edc {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:12:23.432742 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-366c1a51-fc19-45ce-a11f-6fc75281d680 req-188770e2-e965-40fc-8d11-0ae5546f4430 service nova] Acquiring lock "1c600f44-79c3-4d3f-ad07-0f09ad498836-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:12:23.432898 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-366c1a51-fc19-45ce-a11f-6fc75281d680 req-188770e2-e965-40fc-8d11-0ae5546f4430 service nova] Lock "1c600f44-79c3-4d3f-ad07-0f09ad498836-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:12:23.432998 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-366c1a51-fc19-45ce-a11f-6fc75281d680 req-188770e2-e965-40fc-8d11-0ae5546f4430 service nova] Lock "1c600f44-79c3-4d3f-ad07-0f09ad498836-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:12:23.434517 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-366c1a51-fc19-45ce-a11f-6fc75281d680 req-188770e2-e965-40fc-8d11-0ae5546f4430 service nova] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] No waiting events found dispatching network-vif-unplugged-297624aa-10d3-472b-99eb-50d74b733edc {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:12:23.434517 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-366c1a51-fc19-45ce-a11f-6fc75281d680 req-188770e2-e965-40fc-8d11-0ae5546f4430 service nova] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Received event network-vif-unplugged-297624aa-10d3-472b-99eb-50d74b733edc for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:12:23.559592 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:23.584622 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:23.589914 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999619840999912 future=<Future at 0x7724ec064140 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:12:23.591782 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Instance destroyed successfully.
May 28 02:12:23.592372 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lazy-loading 'resources' on Instance uuid 1c600f44-79c3-4d3f-ad07-0f09ad498836 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:12:23.673788 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:23.725191 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:23.730683 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:23.842130 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:23.846774 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:24.094731 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T02:10:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1874038485',display_name='tempest-TestVolumeBootPatternV346-server-1874038485',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testvolumebootpatternv346-server-1874038485',id=75,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8PllKdqBzlf40vcCKWVOqAG4NjEl0S74b/w9Oy/Sl6P8nIxEi012FULeJLB/74V6fjCn61X6LaOPD/ZP/lpdkQpbqsZJFbLCrBC37bMXW3Q8Rh2FtYBEt1JdGgq3onAw==',key_name='tempest-keypair-1704877857',keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:10:32Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60b5c56c77c64b318056094f7fa5861d',ramdisk_id='',reservation_id='r-vj164gdr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPatternV346-884356236',owner_user_name='tempest-TestVolumeBootPatternV346-884356236-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T02:10:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8ce004361ad4602a6f330506184114b',uuid=1c600f44-79c3-4d3f-ad07-0f09ad498836,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "297624aa-10d3-472b-99eb-50d74b733edc", "address": "fa:16:3e:ef:e0:2d", "network": {"id": "a349b3ac-cae9-4909-b273-8409a97fbe5c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-810622904-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60b5c56c77c64b318056094f7fa5861d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap297624aa-10", "ovs_interfaceid": "297624aa-10d3-472b-99eb-50d74b733edc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:12:24.094947 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Converting VIF {"id": "297624aa-10d3-472b-99eb-50d74b733edc", "address": "fa:16:3e:ef:e0:2d", "network": {"id": "a349b3ac-cae9-4909-b273-8409a97fbe5c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-810622904-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60b5c56c77c64b318056094f7fa5861d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap297624aa-10", "ovs_interfaceid": "297624aa-10d3-472b-99eb-50d74b733edc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:12:24.095390 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:e0:2d,bridge_name='br-int',has_traffic_filtering=True,id=297624aa-10d3-472b-99eb-50d74b733edc,network=Network(a349b3ac-cae9-4909-b273-8409a97fbe5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap297624aa-10') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:12:24.095583 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:e0:2d,bridge_name='br-int',has_traffic_filtering=True,id=297624aa-10d3-472b-99eb-50d74b733edc,network=Network(a349b3ac-cae9-4909-b273-8409a97fbe5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap297624aa-10') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:12:24.096341 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:24.096540 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap297624aa-10, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:12:24.097601 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:24.098531 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:12:24.098902 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:24.099570 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:24.099830 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d4475fc5-9406-4c05-8ade-a35eca27f911) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:12:24.100258 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:24.100832 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:12:24.101056 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:24.104124 np0000001583 nova-compute[98241]: INFO os_vif [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:e0:2d,bridge_name='br-int',has_traffic_filtering=True,id=297624aa-10d3-472b-99eb-50d74b733edc,network=Network(a349b3ac-cae9-4909-b273-8409a97fbe5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap297624aa-10')
May 28 02:12:24.105658 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:12:24.105975 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0', 'iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ea37bb85-4c2e-4a41-817e-51d00727a7d0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:12:24.106164 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:12:24.106476 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:12:24.106767 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0', 'iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ea37bb85-4c2e-4a41-817e-51d00727a7d0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:12:24.106944 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:12:24.133509 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:12:24.133509 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:12:24.133509 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:12:24.133509 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:12:24.133509 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:12:24.133746 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:12:24.133746 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:12:24.133746 np0000001583 nova-compute[98241]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:12:24.133746 np0000001583 nova-compute[98241]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0 (non-flash)
May 28 02:12:24.133746 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:12:24.133879 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb', '181'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb', '182'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0', '194'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0', '195')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:12:24.134020 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0', '194')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:12:24.135057 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0', '195')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:12:24.135973 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724ec1e9260>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0'): ({'sdi'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:12:24.136265 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Removing multipathed devices sdh, sdi {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:12:24.136527 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Flush multipath device 330000000260d40a0 {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:12:24.204913 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:12:24.254438 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:12:24.315715 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:12:24.316253 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:12:24.317070 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:12:24.329172 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:12:24.329466 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:12:24.340564 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:24.378744 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 194, target: iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0, portal: 192.168.40.100,3260]
May 28 02:12:24.378744 np0000001583 nova-compute[98241]: Logout of [sid: 194, target: iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0, portal: 192.168.40.100,3260] successful.
May 28 02:12:24.378744 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:24.392425 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:24.404891 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:24.430771 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 195, target: iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0, portal: 192.168.50.100,3260]
May 28 02:12:24.430771 np0000001583 nova-compute[98241]: Logout of [sid: 195, target: iqn.2023-03.storpool.com:os--volume-ea37bb85-4c2e-4a41-817e-51d00727a7d0, portal: 192.168.50.100,3260] successful.
May 28 02:12:24.430771 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:24.446131 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:24.446131 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:12:24.446131 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] <== disconnect_volume: return (339ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:12:24.446131 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:12:24.446131 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Deleting instance files /opt/stack/data/nova/instances/1c600f44-79c3-4d3f-ad07-0f09ad498836_del
May 28 02:12:24.446131 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Deletion of /opt/stack/data/nova/instances/1c600f44-79c3-4d3f-ad07-0f09ad498836_del complete
May 28 02:12:24.951895 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Took 1.71 seconds to destroy the instance on the hypervisor.
May 28 02:12:24.952326 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 02:12:24.952677 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 02:12:24.952772 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 02:12:24.952984 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:12:25.012882 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:12:25.381217 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Acquiring lock "3d3cb2ab-e6f7-4700-9599-1d42b17b2c48" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:12:25.381217 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Lock "3d3cb2ab-e6f7-4700-9599-1d42b17b2c48" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:12:25.495790 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-fecb4fcc-50c0-41c9-98db-ef4bdb6c6f9a req-af10a7fc-1334-4f35-9956-c42c0848c73c service nova] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Received event network-vif-unplugged-297624aa-10d3-472b-99eb-50d74b733edc {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:12:25.496115 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-fecb4fcc-50c0-41c9-98db-ef4bdb6c6f9a req-af10a7fc-1334-4f35-9956-c42c0848c73c service nova] Acquiring lock "1c600f44-79c3-4d3f-ad07-0f09ad498836-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:12:25.496254 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-fecb4fcc-50c0-41c9-98db-ef4bdb6c6f9a req-af10a7fc-1334-4f35-9956-c42c0848c73c service nova] Lock "1c600f44-79c3-4d3f-ad07-0f09ad498836-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:12:25.496363 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-fecb4fcc-50c0-41c9-98db-ef4bdb6c6f9a req-af10a7fc-1334-4f35-9956-c42c0848c73c service nova] Lock "1c600f44-79c3-4d3f-ad07-0f09ad498836-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:12:25.496493 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-fecb4fcc-50c0-41c9-98db-ef4bdb6c6f9a req-af10a7fc-1334-4f35-9956-c42c0848c73c service nova] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] No waiting events found dispatching network-vif-unplugged-297624aa-10d3-472b-99eb-50d74b733edc {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:12:25.496589 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-fecb4fcc-50c0-41c9-98db-ef4bdb6c6f9a req-af10a7fc-1334-4f35-9956-c42c0848c73c service nova] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Received event network-vif-unplugged-297624aa-10d3-472b-99eb-50d74b733edc for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:12:25.543369 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "769d888e-505f-49eb-b3d8-9f9e8c7f0aab" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:12:25.543580 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "769d888e-505f-49eb-b3d8-9f9e8c7f0aab" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:12:25.554040 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e53bf940-0c9f-4f4c-8e89-8ae3f1932b3b req-9ff02fdc-237a-4fee-af31-0febb61fd183 service nova] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Received event network-vif-deleted-297624aa-10d3-472b-99eb-50d74b733edc {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:12:25.555135 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-e53bf940-0c9f-4f4c-8e89-8ae3f1932b3b req-9ff02fdc-237a-4fee-af31-0febb61fd183 service nova] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Neutron deleted interface 297624aa-10d3-472b-99eb-50d74b733edc; detaching it from the instance and deleting it from the info cache
May 28 02:12:25.556153 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e53bf940-0c9f-4f4c-8e89-8ae3f1932b3b req-9ff02fdc-237a-4fee-af31-0febb61fd183 service nova] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Detach interface failed, port_id=297624aa-10d3-472b-99eb-50d74b733edc, reason: Instance 1c600f44-79c3-4d3f-ad07-0f09ad498836 could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 02:12:25.884248 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Lazy-loading 'flavor' on Instance uuid 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:12:25.967192 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:12:26.046784 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lazy-loading 'flavor' on Instance uuid 769d888e-505f-49eb-b3d8-9f9e8c7f0aab {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:12:26.193311 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:12:26.193446 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:12:26.193673 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:12:26.469438 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Took 1.52 seconds to deallocate network for instance.
May 28 02:12:26.889100 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Lock "3d3cb2ab-e6f7-4700-9599-1d42b17b2c48" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:12:27.010949 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Took 0.54 seconds to detach 1 volumes for instance.
May 28 02:12:27.051479 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "769d888e-505f-49eb-b3d8-9f9e8c7f0aab" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:12:27.344610 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0003268119999120245 future=<Future at 0x7724f87e63c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:12:27.344936 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Emitting event <LifecycleEvent: 1779934332.3441832, 3ce63103-8c3e-4a5b-a2fb-d90055411d08 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:12:27.345042 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:12:27.345209 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] VM Stopped (Lifecycle Event)
May 28 02:12:27.346709 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=0.31341627299980246 future=<Future at 0x7724ec2af740 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:12:27.346781 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=0.3133162240001184 future=<Future at 0x7724ec2af740 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:12:27.515512 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:12:27.515883 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:12:27.660420 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0002816420001181541 future=<Future at 0x7724ec2af740 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:12:27.660505 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:12:27.660581 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=10.928897098000107 future=<Future at 0x7724ec064140 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:12:27.660647 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=10.928823339000246 future=<Future at 0x7724ec064140 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:12:27.660931 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] Emitting event <LifecycleEvent: 1779934332.660044, 4d069122-da2e-445e-8ce3-377692925d87 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:12:27.661071 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 4d069122-da2e-445e-8ce3-377692925d87] VM Stopped (Lifecycle Event)
May 28 02:12:27.732336 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:12:27.732521 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:12:27.848518 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 3ce63103-8c3e-4a5b-a2fb-d90055411d08] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:12:27.969745 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Acquiring lock "3d3cb2ab-e6f7-4700-9599-1d42b17b2c48" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:12:27.969907 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Lock "3d3cb2ab-e6f7-4700-9599-1d42b17b2c48" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:12:27.970050 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Attaching volume bdf0a8cd-977b-4d68-96f5-27255b1012d1 to /dev/vdb
May 28 02:12:28.002552 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:12:28.013010 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 02:12:28.034041 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:12:28.080894 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 02:12:28.081165 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 02:12:28.090584 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 02:12:28.091928 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fee4:704e', 'fe80::d4e0:76ff:fe99:10f4', 'fe80::fc16:3eff:fe13:4cd8', 'fe80::d05c:d0ff:fe98:b4ef', 'fe80::fc16:3eff:fe32:9044', 'fe80::1c28:99ff:fe15:1c08'] 
May 28 02:12:28.092124 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 02:12:28.092264 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 02:12:28.092558 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] <== get_connector_properties: return (89ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:12:28.092841 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Updating existing volume attachment record: 8c5b73db-4766-4b77-8ba1-93fc67356aa5 {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 02:12:28.143103 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "769d888e-505f-49eb-b3d8-9f9e8c7f0aab" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:12:28.143219 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "769d888e-505f-49eb-b3d8-9f9e8c7f0aab" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:12:28.143454 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Attaching volume 22b04366-97bc-4f2b-836a-d5da4169ae96 to /dev/vdb
May 28 02:12:28.163979 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-ea32cd41-3ce9-43d3-b718-ad54f90fe923 tempest-TestStampPattern-897366137 tempest-TestStampPattern-897366137-project-member] [instance: 4d069122-da2e-445e-8ce3-377692925d87] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:12:28.186026 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:12:28.197989 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 02:12:28.218642 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:12:28.237241 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:12:28.262252 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 02:12:28.262702 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 02:12:28.273358 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 02:12:28.274394 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fee4:704e', 'fe80::d4e0:76ff:fe99:10f4', 'fe80::fc16:3eff:fe13:4cd8', 'fe80::d05c:d0ff:fe98:b4ef', 'fe80::fc16:3eff:fe32:9044', 'fe80::1c28:99ff:fe15:1c08'] 
May 28 02:12:28.274545 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 02:12:28.274665 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 02:12:28.275202 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] <== get_connector_properties: return (88ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:12:28.275405 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Updating existing volume attachment record: 4d312f88-bb2d-4868-98ff-cfbfd7710aaa {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 02:12:28.639810 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 02:12:28.640145 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1', 'iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bdf0a8cd-977b-4d68-96f5-27255b1012d1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:12:28.640283 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:12:28.640699 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:12:28.640858 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1', 'iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bdf0a8cd-977b-4d68-96f5-27255b1012d1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 02:12:28.652812 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:12:28.653233 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:12:28.653406 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:12:28.653946 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:12:28.654503 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:12:28.654701 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:12:28.663933 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:12:28.663933 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:28.669692 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:12:28.669692 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:28.675319 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:28.677236 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1] added
May 28 02:12:28.677236 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:12:28.677236 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:12:28.677236 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:12:28.677236 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:12:28.677236 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:12:28.677236 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:28.677430 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:12:28.677632 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0242(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:12:28.677797 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:12:28.680777 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1] added
May 28 02:12:28.680777 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:12:28.680777 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:12:28.680777 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:12:28.680777 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:12:28.680777 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:12:28.680777 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:28.681159 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:12:28.681207 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0264(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:12:28.681380 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:12:28.748316 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.232s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:12:28.793214 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Deleted allocations for instance 1c600f44-79c3-4d3f-ad07-0f09ad498836
May 28 02:12:28.820462 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 02:12:28.820726 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96', 'iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '22b04366-97bc-4f2b-836a-d5da4169ae96', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:12:28.820878 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:12:29.106310 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:29.193316 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:12:29.678439 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:12:29.681706 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:12:29.690964 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:12:29.690964 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:12:29.696275 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:12:29.696275 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:29.700213 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:12:29.700433 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:12:29.700597 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:12:29.700762 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Auditing locally available compute resources for np0000001583 (node: np0000001583) {{(pid=98241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 02:12:29.703139 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:29.708867 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:29.715667 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:12:29.715667 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:12:29.715667 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:12:29.716031 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:12:29.716031 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:12:29.716031 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:12:29.724763 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:12:29.724763 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:12:29.724763 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:12:29.724943 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:12:29.724943 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:12:29.724943 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:12:29.744653 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1, portal: 192.168.40.100,3260]
May 28 02:12:29.744653 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1, portal: 192.168.40.100,3260] successful.
May 28 02:12:29.744653 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:29.760782 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:29.762866 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1, portal: 192.168.50.100,3260]
May 28 02:12:29.762866 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1, portal: 192.168.50.100,3260] successful.
May 28 02:12:29.762866 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:29.777374 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:12:29.777374 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:12:29.777374 np0000001583 nova-compute[98241]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:29.777374 np0000001583 nova-compute[98241]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:29.777374 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:12:29.777531 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:12:29.777531 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:12:29.777531 np0000001583 nova-compute[98241]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:29.777531 np0000001583 nova-compute[98241]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:29.777531 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:12:29.777783 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.125s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:12:29.777908 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:12:29.778904 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] HCTL ('7', '-', '-', 0) found on session 212 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:12:29.779012 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:12:29.779500 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:29.792791 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:12:29.792791 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:12:29.792791 np0000001583 nova-compute[98241]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:29.792791 np0000001583 nova-compute[98241]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:29.792791 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:12:29.792995 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:12:29.792995 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:12:29.792995 np0000001583 nova-compute[98241]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:29.792995 np0000001583 nova-compute[98241]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:29.792995 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:12:29.793322 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.139s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:12:29.793322 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:12:29.793903 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] HCTL ('8', '-', '-', 0) found on session 213 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:12:29.794017 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:12:29.802985 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Searching for a device in session 212 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:12:29.803139 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bdf0a8cd-977b-4d68-96f5-27255b1012d1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:12:29.803841 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-168434d2-b877-484b-b860-c604f99cc998 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "1c600f44-79c3-4d3f-ad07-0f09ad498836" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.070s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:12:29.809633 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Searching for a device in session 213 and hctl ['8', '*', '*', 0] yield: None {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:12:30.731641 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 02:12:30.734014 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3cb2ab-e6f7-4700-9599-1d42b17b2c48/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:12:30.811152 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Searching for a device in session 213 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:12:30.811359 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'bdf0a8cd-977b-4d68-96f5-27255b1012d1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:12:30.833207 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3cb2ab-e6f7-4700-9599-1d42b17b2c48/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:12:30.833781 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3cb2ab-e6f7-4700-9599-1d42b17b2c48/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:12:30.928850 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3cb2ab-e6f7-4700-9599-1d42b17b2c48/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:12:30.934378 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769d888e-505f-49eb-b3d8-9f9e8c7f0aab/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:12:31.037905 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769d888e-505f-49eb-b3d8-9f9e8c7f0aab/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:12:31.038460 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769d888e-505f-49eb-b3d8-9f9e8c7f0aab/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:12:31.139349 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769d888e-505f-49eb-b3d8-9f9e8c7f0aab/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:12:31.144661 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:12:31.146294 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:12:31.195015 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.048s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:12:31.195418 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Hypervisor/Node resource view: name=np0000001583 free_ram=12798MB free_disk=72.62719345092773GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 02:12:31.195686 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:12:31.195857 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:12:31.672050 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Found WWN 330000000d23587a8 for multipath device dm-0 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 02:12:31.672605 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:12:31.673024 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] <== connect_volume: return (3032ms) {'type': 'block', 'scsi_wwn': '330000000d23587a8', 'path': '/dev/dm-0', 'multipath_id': '330000000d23587a8'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:12:31.673269 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d23587a8', 'path': '/dev/dm-0', 'multipath_id': '330000000d23587a8'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 02:12:31.673800 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.853s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:12:31.674128 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96', 'iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '22b04366-97bc-4f2b-836a-d5da4169ae96', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 02:12:31.677132 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Lazy-loading 'flavor' on Instance uuid 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:12:31.687701 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:12:31.688379 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:12:31.689037 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:12:31.689263 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:12:31.690289 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:12:31.690513 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:12:31.699761 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:12:31.699761 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:31.705534 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:12:31.705534 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:31.711863 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96] added
May 28 02:12:31.711863 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:12:31.711863 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:12:31.711863 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:12:31.711863 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:12:31.711863 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:12:31.711863 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:31.712216 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:12:31.712216 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0229(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:12:31.712335 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:12:31.717267 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96] added
May 28 02:12:31.717267 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:12:31.717267 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:12:31.717267 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:12:31.717267 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:12:31.717267 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:12:31.717267 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:31.717503 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:12:31.717558 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0271(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:12:31.717688 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:12:32.179193 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Attempting to attach volume bdf0a8cd-977b-4d68-96f5-27255b1012d1 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98241) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 02:12:32.180593 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] attach device xml: <disk type="block" device="disk">
May 28 02:12:32.180593 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:12:32.180593 np0000001583 nova-compute[98241]:   <alias name="ua-bdf0a8cd-977b-4d68-96f5-27255b1012d1"/>
May 28 02:12:32.180593 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-0"/>
May 28 02:12:32.180593 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:12:32.180593 np0000001583 nova-compute[98241]:   <serial>bdf0a8cd-977b-4d68-96f5-27255b1012d1</serial>
May 28 02:12:32.180593 np0000001583 nova-compute[98241]: </disk>
May 28 02:12:32.180593 np0000001583 nova-compute[98241]:  {{(pid=98241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 02:12:32.267443 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance e7554a11-146b-416b-8121-b7e6773b8dab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:12:32.267443 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 769d888e-505f-49eb-b3d8-9f9e8c7f0aab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:12:32.267604 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:12:32.267855 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 02:12:32.268097 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Final resource view: name=np0000001583 phys_ram=24030MB used_ram=1088MB phys_disk=95GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:12:31 up 48 min,  2 users,  load average: 3.51, 4.76, 4.73\n', 'num_instances': '3', 'num_vm_active': '3', 'num_task_None': '3', 'num_os_type_None': '3', 'num_proj_60b5c56c77c64b318056094f7fa5861d': '1', 'io_workload': '0', 'num_proj_b993c740f0114a22b4ec01fd0172dc89': '1', 'num_proj_a074e5b5a0c04c93a93cf6a066856ad3': '1'} {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 02:12:32.474316 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:12:32.474649 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:12:32.712826 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:12:32.718303 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:12:32.726941 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:12:32.726941 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:12:32.732696 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:12:32.732696 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:32.739958 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:32.745339 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:32.752750 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:12:32.752750 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:12:32.752750 np0000001583 nova-compute[98241]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:32.752750 np0000001583 nova-compute[98241]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:32.752750 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:12:32.752925 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:12:32.752925 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:12:32.752925 np0000001583 nova-compute[98241]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:32.752925 np0000001583 nova-compute[98241]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:32.752925 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:12:32.759283 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:12:32.759283 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:12:32.759283 np0000001583 nova-compute[98241]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:32.759283 np0000001583 nova-compute[98241]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:32.759283 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:12:32.759744 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:12:32.759744 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:12:32.759744 np0000001583 nova-compute[98241]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:32.759744 np0000001583 nova-compute[98241]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:32.759744 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:12:32.790626 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96, portal: 192.168.40.100,3260]
May 28 02:12:32.790626 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96, portal: 192.168.40.100,3260] successful.
May 28 02:12:32.790626 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:32.796628 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96, portal: 192.168.50.100,3260]
May 28 02:12:32.796628 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96, portal: 192.168.50.100,3260] successful.
May 28 02:12:32.796628 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:32.805781 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:32.814235 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:32.823157 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:12:32.823157 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:12:32.823157 np0000001583 nova-compute[98241]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:32.823157 np0000001583 nova-compute[98241]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:32.823157 np0000001583 nova-compute[98241]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:32.823157 np0000001583 nova-compute[98241]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:32.823157 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:12:32.823157 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:12:32.823157 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:12:32.823157 np0000001583 nova-compute[98241]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:32.823157 np0000001583 nova-compute[98241]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:32.823157 np0000001583 nova-compute[98241]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:32.823157 np0000001583 nova-compute[98241]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:32.823157 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:12:32.823157 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.134s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:12:32.823157 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:12:32.823969 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] HCTL ('10', '-', '-', 0) found on session 214 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:12:32.824110 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:12:32.831453 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:12:32.831453 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:12:32.831453 np0000001583 nova-compute[98241]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:32.831453 np0000001583 nova-compute[98241]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:32.831453 np0000001583 nova-compute[98241]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:32.831453 np0000001583 nova-compute[98241]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:32.831453 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:12:32.831642 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:12:32.831642 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:12:32.831642 np0000001583 nova-compute[98241]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:32.831642 np0000001583 nova-compute[98241]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:32.831642 np0000001583 nova-compute[98241]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:32.831642 np0000001583 nova-compute[98241]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:32.831642 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:12:32.831940 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.142s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:12:32.832101 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:12:32.832833 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] HCTL ('11', '-', '-', 0) found on session 215 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:12:32.832991 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:12:32.841981 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Searching for a device in session 214 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:12:32.842206 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '22b04366-97bc-4f2b-836a-d5da4169ae96', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:12:32.848576 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Searching for a device in session 215 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:12:32.848576 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '22b04366-97bc-4f2b-836a-d5da4169ae96', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:12:32.977453 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:12:33.426482 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Acquiring lock "e7554a11-146b-416b-8121-b7e6773b8dab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:12:33.426829 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "e7554a11-146b-416b-8121-b7e6773b8dab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:12:33.426860 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Acquiring lock "e7554a11-146b-416b-8121-b7e6773b8dab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:12:33.427009 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "e7554a11-146b-416b-8121-b7e6773b8dab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:12:33.427138 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "e7554a11-146b-416b-8121-b7e6773b8dab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:12:33.429224 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Terminating instance
May 28 02:12:33.483615 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Compute_service record updated for np0000001583:np0000001583 {{(pid=98241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 02:12:33.483747 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.288s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:12:33.484051 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:12:33.491209 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:33.689457 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 02:12:33.833524 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:12:33.833632 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:12:33.833749 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:12:33.833820 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] No VIF found with MAC fa:16:3e:32:90:44, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:12:33.932174 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 02:12:33.946612 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:33.948788 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:33.963996 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:33.965635 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:33.986741 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:34.074446 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-707389b2-658c-45f4-9efc-b50617afcb6c req-49cb22a3-e78b-45f0-8327-d99d94eb75c7 service nova] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Received event network-vif-unplugged-ec4997ed-eb88-422c-a1f5-0a9bcccaa71a {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:12:34.074788 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-707389b2-658c-45f4-9efc-b50617afcb6c req-49cb22a3-e78b-45f0-8327-d99d94eb75c7 service nova] Acquiring lock "e7554a11-146b-416b-8121-b7e6773b8dab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:12:34.074788 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-707389b2-658c-45f4-9efc-b50617afcb6c req-49cb22a3-e78b-45f0-8327-d99d94eb75c7 service nova] Lock "e7554a11-146b-416b-8121-b7e6773b8dab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:12:34.074854 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-707389b2-658c-45f4-9efc-b50617afcb6c req-49cb22a3-e78b-45f0-8327-d99d94eb75c7 service nova] Lock "e7554a11-146b-416b-8121-b7e6773b8dab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:12:34.074965 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-707389b2-658c-45f4-9efc-b50617afcb6c req-49cb22a3-e78b-45f0-8327-d99d94eb75c7 service nova] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] No waiting events found dispatching network-vif-unplugged-ec4997ed-eb88-422c-a1f5-0a9bcccaa71a {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:12:34.075108 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-707389b2-658c-45f4-9efc-b50617afcb6c req-49cb22a3-e78b-45f0-8327-d99d94eb75c7 service nova] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Received event network-vif-unplugged-ec4997ed-eb88-422c-a1f5-0a9bcccaa71a for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:12:34.107378 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:34.222117 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:34.229470 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:34.244480 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999087963999955 future=<Future at 0x7724ec17ac90 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:12:34.245789 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Instance destroyed successfully.
May 28 02:12:34.246218 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lazy-loading 'resources' on Instance uuid e7554a11-146b-416b-8121-b7e6773b8dab {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:12:34.479681 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:12:34.480054 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:12:34.480171 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:12:34.480403 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:12:34.480555 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 02:12:34.480780 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 49.71 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:12:34.706498 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Found WWN 3300000008b355762 for multipath device dm-1 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 02:12:34.706826 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:12:34.707014 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] <== connect_volume: return (5886ms) {'type': 'block', 'scsi_wwn': '3300000008b355762', 'path': '/dev/dm-1', 'multipath_id': '3300000008b355762'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:12:34.707307 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008b355762', 'path': '/dev/dm-1', 'multipath_id': '3300000008b355762'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 02:12:34.709878 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lazy-loading 'flavor' on Instance uuid 769d888e-505f-49eb-b3d8-9f9e8c7f0aab {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:12:34.748959 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T02:09:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1188082680',display_name='tempest-TestVolumeBootPatternV346-server-1188082680',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testvolumebootpatternv346-server-1188082680',id=72,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCX0yMP8i6nBj1+RANIo+QRZE8WT/Obll/ENVwOiSPazwBcRR0Pfr9evlfuVjkxzJhaxppC4MDYBJwjftjTp/GHQDQ9Yx1BmAoo1aj5gXO5QjoX1tFlBW7KYV0aAzSCVaA==',key_name='tempest-keypair-580717331',keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:09:27Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60b5c56c77c64b318056094f7fa5861d',ramdisk_id='',reservation_id='r-00srh294',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPatternV346-884356236',owner_user_name='tempest-TestVolumeBootPatternV346-884356236-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T02:09:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8ce004361ad4602a6f330506184114b',uuid=e7554a11-146b-416b-8121-b7e6773b8dab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec4997ed-eb88-422c-a1f5-0a9bcccaa71a", "address": "fa:16:3e:e4:70:4e", "network": {"id": "a349b3ac-cae9-4909-b273-8409a97fbe5c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-810622904-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60b5c56c77c64b318056094f7fa5861d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4997ed-eb", "ovs_interfaceid": "ec4997ed-eb88-422c-a1f5-0a9bcccaa71a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:12:34.749126 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Converting VIF {"id": "ec4997ed-eb88-422c-a1f5-0a9bcccaa71a", "address": "fa:16:3e:e4:70:4e", "network": {"id": "a349b3ac-cae9-4909-b273-8409a97fbe5c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-810622904-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60b5c56c77c64b318056094f7fa5861d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4997ed-eb", "ovs_interfaceid": "ec4997ed-eb88-422c-a1f5-0a9bcccaa71a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:12:34.749798 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:70:4e,bridge_name='br-int',has_traffic_filtering=True,id=ec4997ed-eb88-422c-a1f5-0a9bcccaa71a,network=Network(a349b3ac-cae9-4909-b273-8409a97fbe5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec4997ed-eb') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:12:34.750123 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:70:4e,bridge_name='br-int',has_traffic_filtering=True,id=ec4997ed-eb88-422c-a1f5-0a9bcccaa71a,network=Network(a349b3ac-cae9-4909-b273-8409a97fbe5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec4997ed-eb') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:12:34.751921 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:34.752155 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec4997ed-eb, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:12:34.753039 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:34.753827 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:12:34.754275 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:34.754790 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:34.754909 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ec53e224-012b-4004-b507-f7cbc9dbbe96) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:12:34.755655 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:34.755896 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:12:34.757561 np0000001583 nova-compute[98241]: INFO os_vif [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:70:4e,bridge_name='br-int',has_traffic_filtering=True,id=ec4997ed-eb88-422c-a1f5-0a9bcccaa71a,network=Network(a349b3ac-cae9-4909-b273-8409a97fbe5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec4997ed-eb')
May 28 02:12:34.759196 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:12:34.759561 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb', 'iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '50b4ab79-6825-49a1-92c3-c4ec0d47aecb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:12:34.759728 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:12:34.760210 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:12:34.760518 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb', 'iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '50b4ab79-6825-49a1-92c3-c4ec0d47aecb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:12:34.760643 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:12:34.786173 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:12:34.786173 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:12:34.786173 np0000001583 nova-compute[98241]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:34.786173 np0000001583 nova-compute[98241]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:34.786173 np0000001583 nova-compute[98241]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:34.786173 np0000001583 nova-compute[98241]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:34.786173 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:12:34.786376 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:12:34.786376 np0000001583 nova-compute[98241]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb (non-flash)
May 28 02:12:34.786376 np0000001583 nova-compute[98241]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:34.786376 np0000001583 nova-compute[98241]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:34.786376 np0000001583 nova-compute[98241]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:34.786376 np0000001583 nova-compute[98241]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:34.786376 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:12:34.786512 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb', '181'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb', '182'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1', '212'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1', '213'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96', '214'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96', '215')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:12:34.786570 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb', '181')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:12:34.787744 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb', '182')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:12:34.788478 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724ec1ad620>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb'): ({'sdg'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:12:34.788652 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Removing multipathed devices sdd, sdg {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:12:34.788845 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Flush multipath device 33000000064ca37b4 {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:12:34.854444 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:12:34.900585 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:12:34.946705 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Checking to see if SCSI volumes sdd, sdg have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:12:34.946885 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] SCSI volumes sdd, sdg have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:12:34.947653 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Checking to see if device paths {'sdd', 'sdg'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:12:34.958291 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Device paths {'sdd', 'sdg'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:12:34.958445 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:12:34.967324 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:34.997985 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 181, target: iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb, portal: 192.168.40.100,3260]
May 28 02:12:34.997985 np0000001583 nova-compute[98241]: Logout of [sid: 181, target: iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb, portal: 192.168.40.100,3260] successful.
May 28 02:12:34.997985 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:35.012231 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:35.022356 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:35.047862 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 182, target: iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb, portal: 192.168.50.100,3260]
May 28 02:12:35.047862 np0000001583 nova-compute[98241]: Logout of [sid: 182, target: iqn.2023-03.storpool.com:os--volume-50b4ab79-6825-49a1-92c3-c4ec0d47aecb, portal: 192.168.50.100,3260] successful.
May 28 02:12:35.047862 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:35.061016 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:35.061209 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:12:35.061353 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] <== disconnect_volume: return (301ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:12:35.061461 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:12:35.061709 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Deleting instance files /opt/stack/data/nova/instances/e7554a11-146b-416b-8121-b7e6773b8dab_del
May 28 02:12:35.062192 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Deletion of /opt/stack/data/nova/instances/e7554a11-146b-416b-8121-b7e6773b8dab_del complete
May 28 02:12:35.212951 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Attempting to attach volume 22b04366-97bc-4f2b-836a-d5da4169ae96 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98241) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 02:12:35.214424 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] attach device xml: <disk type="block" device="disk">
May 28 02:12:35.214424 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:12:35.214424 np0000001583 nova-compute[98241]:   <alias name="ua-22b04366-97bc-4f2b-836a-d5da4169ae96"/>
May 28 02:12:35.214424 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-1"/>
May 28 02:12:35.214424 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:12:35.214424 np0000001583 nova-compute[98241]:   <serial>22b04366-97bc-4f2b-836a-d5da4169ae96</serial>
May 28 02:12:35.214424 np0000001583 nova-compute[98241]: </disk>
May 28 02:12:35.214424 np0000001583 nova-compute[98241]:  {{(pid=98241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 02:12:35.376499 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-2bbf1de2-b9ec-4a32-a1c5-d771761e8710 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Lock "3d3cb2ab-e6f7-4700-9599-1d42b17b2c48" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.407s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:12:35.571591 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Took 1.64 seconds to destroy the instance on the hypervisor.
May 28 02:12:35.572229 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 02:12:35.573031 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 02:12:35.573266 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 02:12:35.573405 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:12:35.684932 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:12:36.134069 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-998dc9cc-1be6-421d-a7af-4cc7d9566727 req-7ec12f6f-b32f-4e2c-9025-f44322f9b3d4 service nova] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Received event network-vif-unplugged-ec4997ed-eb88-422c-a1f5-0a9bcccaa71a {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:12:36.134458 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-998dc9cc-1be6-421d-a7af-4cc7d9566727 req-7ec12f6f-b32f-4e2c-9025-f44322f9b3d4 service nova] Acquiring lock "e7554a11-146b-416b-8121-b7e6773b8dab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:12:36.134606 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-998dc9cc-1be6-421d-a7af-4cc7d9566727 req-7ec12f6f-b32f-4e2c-9025-f44322f9b3d4 service nova] Lock "e7554a11-146b-416b-8121-b7e6773b8dab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:12:36.134738 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-998dc9cc-1be6-421d-a7af-4cc7d9566727 req-7ec12f6f-b32f-4e2c-9025-f44322f9b3d4 service nova] Lock "e7554a11-146b-416b-8121-b7e6773b8dab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:12:36.134872 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-998dc9cc-1be6-421d-a7af-4cc7d9566727 req-7ec12f6f-b32f-4e2c-9025-f44322f9b3d4 service nova] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] No waiting events found dispatching network-vif-unplugged-ec4997ed-eb88-422c-a1f5-0a9bcccaa71a {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:12:36.134992 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-998dc9cc-1be6-421d-a7af-4cc7d9566727 req-7ec12f6f-b32f-4e2c-9025-f44322f9b3d4 service nova] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Received event network-vif-unplugged-ec4997ed-eb88-422c-a1f5-0a9bcccaa71a for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:12:36.135097 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-998dc9cc-1be6-421d-a7af-4cc7d9566727 req-7ec12f6f-b32f-4e2c-9025-f44322f9b3d4 service nova] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Received event network-vif-deleted-ec4997ed-eb88-422c-a1f5-0a9bcccaa71a {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:12:36.135293 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-998dc9cc-1be6-421d-a7af-4cc7d9566727 req-7ec12f6f-b32f-4e2c-9025-f44322f9b3d4 service nova] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Neutron deleted interface ec4997ed-eb88-422c-a1f5-0a9bcccaa71a; detaching it from the instance and deleting it from the info cache
May 28 02:12:36.136813 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-998dc9cc-1be6-421d-a7af-4cc7d9566727 req-7ec12f6f-b32f-4e2c-9025-f44322f9b3d4 service nova] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Detach interface failed, port_id=ec4997ed-eb88-422c-a1f5-0a9bcccaa71a, reason: Instance e7554a11-146b-416b-8121-b7e6773b8dab could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 02:12:36.474226 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Acquiring lock "3d3cb2ab-e6f7-4700-9599-1d42b17b2c48" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:12:36.475126 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Lock "3d3cb2ab-e6f7-4700-9599-1d42b17b2c48" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:12:36.537773 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:12:36.863179 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:12:36.863482 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:12:36.863482 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:12:36.863482 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] No VIF found with MAC fa:16:3e:13:4c:d8, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:12:36.977619 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Lazy-loading 'flavor' on Instance uuid 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:12:37.039412 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Took 1.47 seconds to deallocate network for instance.
May 28 02:12:37.584112 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Took 0.54 seconds to detach 1 volumes for instance.
May 28 02:12:37.982672 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Lock "3d3cb2ab-e6f7-4700-9599-1d42b17b2c48" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:12:38.089152 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:12:38.089367 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:12:38.247550 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:12:38.247741 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:12:38.407691 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8234137f-1c62-4fc1-84ba-06f45bbae176 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "769d888e-505f-49eb-b3d8-9f9e8c7f0aab" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.264s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:12:38.489540 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "769d888e-505f-49eb-b3d8-9f9e8c7f0aab" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:12:38.489781 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "769d888e-505f-49eb-b3d8-9f9e8c7f0aab" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:12:38.590012 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0004574109998429776 future=<Future at 0x7724ec064140 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:12:38.590495 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Emitting event <LifecycleEvent: 1779934343.5894268, 1c600f44-79c3-4d3f-ad07-0f09ad498836 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:12:38.590659 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:12:38.590848 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] VM Stopped (Lifecycle Event)
May 28 02:12:38.592118 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=10.651606316000198 future=<Future at 0x7724ec17ac90 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:12:38.592118 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=10.651437496000199 future=<Future at 0x7724ec17ac90 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:12:38.750143 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:12:38.993133 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lazy-loading 'flavor' on Instance uuid 769d888e-505f-49eb-b3d8-9f9e8c7f0aab {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:12:39.042020 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Acquiring lock "3d3cb2ab-e6f7-4700-9599-1d42b17b2c48" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:12:39.042161 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Lock "3d3cb2ab-e6f7-4700-9599-1d42b17b2c48" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:12:39.042386 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Attaching volume 0111ac28-6f08-44bf-919c-6340f967eb01 to /dev/vdc
May 28 02:12:39.078484 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:12:39.090223 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 02:12:39.093322 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 1c600f44-79c3-4d3f-ad07-0f09ad498836] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:12:39.117669 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:12:39.162122 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 02:12:39.162341 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 02:12:39.170993 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 02:12:39.171938 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe13:4cd8', 'fe80::d05c:d0ff:fe98:b4ef', 'fe80::fc16:3eff:fe32:9044', 'fe80::1c28:99ff:fe15:1c08'] 
May 28 02:12:39.172045 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 02:12:39.172317 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 02:12:39.172524 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] <== get_connector_properties: return (93ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:12:39.172756 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Updating existing volume attachment record: 2723f6af-8c41-4228-b0bf-231ecdef407d {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 02:12:39.259057 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.170s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:12:39.306858 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Deleted allocations for instance e7554a11-146b-416b-8121-b7e6773b8dab
May 28 02:12:39.722861 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 02:12:39.723266 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01', 'iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0111ac28-6f08-44bf-919c-6340f967eb01', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:12:39.723433 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:12:39.723925 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:12:39.724191 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01', 'iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0111ac28-6f08-44bf-919c-6340f967eb01', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 02:12:39.736369 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:12:39.736899 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:12:39.737365 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:12:39.737561 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:12:39.738147 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:12:39.738569 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:12:39.748018 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:12:39.748018 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:39.752854 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:12:39.752854 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:39.756571 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:39.760104 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01] added
May 28 02:12:39.760104 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:12:39.760104 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:12:39.760104 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:12:39.760104 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:12:39.760104 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:12:39.760104 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:39.760376 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:12:39.760418 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0228(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:12:39.760547 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:12:39.763610 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01] added
May 28 02:12:39.763610 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:12:39.763610 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:12:39.763610 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:12:39.763610 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:12:39.763610 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:12:39.763610 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:39.763610 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:12:39.763879 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0254(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:12:39.764017 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:12:39.998459 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "769d888e-505f-49eb-b3d8-9f9e8c7f0aab" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:12:40.315021 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-8f2d6dd9-9dc0-4f96-ab5d-2a55dd2b3d64 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Lock "e7554a11-146b-416b-8121-b7e6773b8dab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.888s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:12:40.761053 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:12:40.765146 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:12:40.772534 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:12:40.772534 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:12:40.778494 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:12:40.778494 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:40.785194 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:40.790657 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:40.798289 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:40.798289 np0000001583 nova-compute[98241]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:40.798289 np0000001583 nova-compute[98241]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:40.798289 np0000001583 nova-compute[98241]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:40.798289 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:12:40.798488 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsi session list stdout=tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:40.798488 np0000001583 nova-compute[98241]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:40.798488 np0000001583 nova-compute[98241]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:40.798488 np0000001583 nova-compute[98241]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:40.798488 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:12:40.803813 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:40.803813 np0000001583 nova-compute[98241]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:40.803813 np0000001583 nova-compute[98241]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:40.803813 np0000001583 nova-compute[98241]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:40.803813 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:12:40.803973 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsi session list stdout=tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:40.803973 np0000001583 nova-compute[98241]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:40.803973 np0000001583 nova-compute[98241]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:40.803973 np0000001583 nova-compute[98241]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:40.803973 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:12:40.832269 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01, portal: 192.168.40.100,3260]
May 28 02:12:40.832269 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01, portal: 192.168.40.100,3260] successful.
May 28 02:12:40.832269 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:40.844586 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:40.849091 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01, portal: 192.168.50.100,3260]
May 28 02:12:40.849091 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01, portal: 192.168.50.100,3260] successful.
May 28 02:12:40.849091 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:40.858939 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:40.858939 np0000001583 nova-compute[98241]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:40.858939 np0000001583 nova-compute[98241]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:40.858939 np0000001583 nova-compute[98241]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:40.858939 np0000001583 nova-compute[98241]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01 (non-flash)
May 28 02:12:40.858939 np0000001583 nova-compute[98241]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01 (non-flash)
May 28 02:12:40.858939 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:12:40.859289 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsi session list stdout=tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:40.859289 np0000001583 nova-compute[98241]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:40.859289 np0000001583 nova-compute[98241]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:40.859289 np0000001583 nova-compute[98241]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:40.859289 np0000001583 nova-compute[98241]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01 (non-flash)
May 28 02:12:40.859289 np0000001583 nova-compute[98241]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01 (non-flash)
May 28 02:12:40.859289 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:12:40.859480 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.122s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:12:40.859480 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:12:40.859947 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:40.861063 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] HCTL ('9', '-', '-', 0) found on session 216 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:12:40.861258 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:12:40.875604 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:40.875604 np0000001583 nova-compute[98241]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:40.875604 np0000001583 nova-compute[98241]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:40.875604 np0000001583 nova-compute[98241]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:40.875604 np0000001583 nova-compute[98241]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01 (non-flash)
May 28 02:12:40.875604 np0000001583 nova-compute[98241]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01 (non-flash)
May 28 02:12:40.875604 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:12:40.875604 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsi session list stdout=tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:40.875604 np0000001583 nova-compute[98241]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:40.875604 np0000001583 nova-compute[98241]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:40.875604 np0000001583 nova-compute[98241]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:40.875604 np0000001583 nova-compute[98241]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01 (non-flash)
May 28 02:12:40.875604 np0000001583 nova-compute[98241]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01 (non-flash)
May 28 02:12:40.875604 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:12:40.875604 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.136s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:12:40.875604 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:12:40.875978 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] HCTL ('12', '-', '-', 0) found on session 217 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:12:40.875978 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:12:40.877465 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Searching for a device in session 216 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:12:40.878038 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0111ac28-6f08-44bf-919c-6340f967eb01', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:12:40.888387 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Searching for a device in session 217 and hctl ['12', '*', '*', 0] yield: None {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:12:41.057206 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "769d888e-505f-49eb-b3d8-9f9e8c7f0aab" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:12:41.057653 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "769d888e-505f-49eb-b3d8-9f9e8c7f0aab" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:12:41.057653 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Attaching volume b3ce7f47-21bb-4a00-a346-fa17d1b1d84b to /dev/vdc
May 28 02:12:41.092433 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:12:41.103963 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 02:12:41.122459 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:12:41.164745 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 02:12:41.165115 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 02:12:41.173024 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 02:12:41.174063 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe13:4cd8', 'fe80::d05c:d0ff:fe98:b4ef', 'fe80::fc16:3eff:fe32:9044', 'fe80::1c28:99ff:fe15:1c08'] 
May 28 02:12:41.174236 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 02:12:41.174352 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 02:12:41.174596 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] <== get_connector_properties: return (81ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:12:41.174857 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Updating existing volume attachment record: 8c319d3b-c4f0-462b-926a-a02c5ae4cd01 {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 02:12:41.742868 np0000001583 nova-compute[98241]: DEBUG os_brick.encryptors [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b', 'iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b3ce7f47-21bb-4a00-a346-fa17d1b1d84b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '769d888e-505f-49eb-b3d8-9f9e8c7f0aab', 'attached_at': '', 'detached_at': '', 'volume_id': 'b3ce7f47-21bb-4a00-a346-fa17d1b1d84b', 'serial': 'b3ce7f47-21bb-4a00-a346-fa17d1b1d84b'} {{(pid=98241) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 02:12:41.748772 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 02:12:41.749306 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b', 'iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b3ce7f47-21bb-4a00-a346-fa17d1b1d84b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:12:41.749543 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:12:41.888390 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Searching for a device in session 217 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:12:41.888534 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0111ac28-6f08-44bf-919c-6340f967eb01', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:12:42.355130 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:42.616865 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:42.757806 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Found WWN 330000000893785fd for multipath device dm-2 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 02:12:42.758118 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:12:42.758575 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] <== connect_volume: return (3034ms) {'type': 'block', 'scsi_wwn': '330000000893785fd', 'path': '/dev/dm-2', 'multipath_id': '330000000893785fd'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:12:42.758575 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000893785fd', 'path': '/dev/dm-2', 'multipath_id': '330000000893785fd'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 02:12:42.759336 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.010s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:12:42.759528 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b', 'iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b3ce7f47-21bb-4a00-a346-fa17d1b1d84b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 02:12:42.765828 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Lazy-loading 'flavor' on Instance uuid 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:12:42.772234 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:12:42.772697 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:12:42.773234 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:12:42.773496 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:12:42.773681 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:12:42.773841 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:12:42.784903 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:12:42.784903 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:42.790544 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:12:42.790544 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:42.798612 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b] added
May 28 02:12:42.798612 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:12:42.798612 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:12:42.798612 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:12:42.798612 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:12:42.798612 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:12:42.798612 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:42.798612 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:12:42.799201 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0249(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:12:42.799642 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:12:42.803575 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b] added
May 28 02:12:42.803575 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:12:42.803575 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:12:42.803575 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:12:42.803575 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:12:42.803575 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:12:42.803575 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:42.803737 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:12:42.803973 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0302(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:12:42.804156 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:12:43.270427 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Attempting to attach volume 0111ac28-6f08-44bf-919c-6340f967eb01 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98241) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 02:12:43.272210 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] attach device xml: <disk type="block" device="disk">
May 28 02:12:43.272210 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:12:43.272210 np0000001583 nova-compute[98241]:   <alias name="ua-0111ac28-6f08-44bf-919c-6340f967eb01"/>
May 28 02:12:43.272210 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-2"/>
May 28 02:12:43.272210 np0000001583 nova-compute[98241]:   <target dev="vdc" bus="virtio"/>
May 28 02:12:43.272210 np0000001583 nova-compute[98241]:   <serial>0111ac28-6f08-44bf-919c-6340f967eb01</serial>
May 28 02:12:43.272210 np0000001583 nova-compute[98241]: </disk>
May 28 02:12:43.272210 np0000001583 nova-compute[98241]:  {{(pid=98241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 02:12:43.800274 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:12:43.804538 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:12:43.815091 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:12:43.815091 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:12:43.820920 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:12:43.820920 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:43.827158 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:43.833371 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:43.842622 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:43.842622 np0000001583 nova-compute[98241]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:43.842622 np0000001583 nova-compute[98241]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:43.842622 np0000001583 nova-compute[98241]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:43.842622 np0000001583 nova-compute[98241]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01 (non-flash)
May 28 02:12:43.842622 np0000001583 nova-compute[98241]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01 (non-flash)
May 28 02:12:43.842622 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:12:43.842622 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsi session list stdout=tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:43.842622 np0000001583 nova-compute[98241]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:43.842622 np0000001583 nova-compute[98241]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:43.842622 np0000001583 nova-compute[98241]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:43.842622 np0000001583 nova-compute[98241]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01 (non-flash)
May 28 02:12:43.842622 np0000001583 nova-compute[98241]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01 (non-flash)
May 28 02:12:43.842622 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:12:43.848284 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:43.848284 np0000001583 nova-compute[98241]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:43.848284 np0000001583 nova-compute[98241]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:43.848284 np0000001583 nova-compute[98241]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:43.848284 np0000001583 nova-compute[98241]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01 (non-flash)
May 28 02:12:43.848284 np0000001583 nova-compute[98241]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01 (non-flash)
May 28 02:12:43.848284 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:12:43.848574 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsi session list stdout=tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:43.848574 np0000001583 nova-compute[98241]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:43.848574 np0000001583 nova-compute[98241]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:43.848574 np0000001583 nova-compute[98241]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:43.848574 np0000001583 nova-compute[98241]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01 (non-flash)
May 28 02:12:43.848574 np0000001583 nova-compute[98241]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01 (non-flash)
May 28 02:12:43.848574 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:12:43.877097 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b, portal: 192.168.40.100,3260]
May 28 02:12:43.877097 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b, portal: 192.168.40.100,3260] successful.
May 28 02:12:43.877097 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:43.890777 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:43.895517 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b, portal: 192.168.50.100,3260]
May 28 02:12:43.895517 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b, portal: 192.168.50.100,3260] successful.
May 28 02:12:43.895517 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:43.907524 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:43.908088 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:43.908088 np0000001583 nova-compute[98241]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:43.908088 np0000001583 nova-compute[98241]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:43.908088 np0000001583 nova-compute[98241]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:43.908088 np0000001583 nova-compute[98241]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01 (non-flash)
May 28 02:12:43.908088 np0000001583 nova-compute[98241]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01 (non-flash)
May 28 02:12:43.908088 np0000001583 nova-compute[98241]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b (non-flash)
May 28 02:12:43.908088 np0000001583 nova-compute[98241]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b (non-flash)
May 28 02:12:43.908088 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:12:43.908284 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsi session list stdout=tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:43.908284 np0000001583 nova-compute[98241]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:43.908284 np0000001583 nova-compute[98241]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:43.908284 np0000001583 nova-compute[98241]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:43.908284 np0000001583 nova-compute[98241]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01 (non-flash)
May 28 02:12:43.908284 np0000001583 nova-compute[98241]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01 (non-flash)
May 28 02:12:43.908284 np0000001583 nova-compute[98241]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b (non-flash)
May 28 02:12:43.908284 np0000001583 nova-compute[98241]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b (non-flash)
May 28 02:12:43.908284 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:12:43.908615 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.135s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:12:43.908901 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:12:43.910051 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] HCTL ('13', '-', '-', 0) found on session 218 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:12:43.910209 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:12:43.925041 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:43.925041 np0000001583 nova-compute[98241]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:43.925041 np0000001583 nova-compute[98241]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:43.925041 np0000001583 nova-compute[98241]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:43.925041 np0000001583 nova-compute[98241]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01 (non-flash)
May 28 02:12:43.925041 np0000001583 nova-compute[98241]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01 (non-flash)
May 28 02:12:43.925041 np0000001583 nova-compute[98241]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b (non-flash)
May 28 02:12:43.925041 np0000001583 nova-compute[98241]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b (non-flash)
May 28 02:12:43.925041 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:12:43.931174 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsi session list stdout=tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:43.931174 np0000001583 nova-compute[98241]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:43.931174 np0000001583 nova-compute[98241]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:43.931174 np0000001583 nova-compute[98241]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:43.931174 np0000001583 nova-compute[98241]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01 (non-flash)
May 28 02:12:43.931174 np0000001583 nova-compute[98241]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01 (non-flash)
May 28 02:12:43.931174 np0000001583 nova-compute[98241]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b (non-flash)
May 28 02:12:43.931174 np0000001583 nova-compute[98241]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b (non-flash)
May 28 02:12:43.931174 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:12:43.931174 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.152s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:12:43.931174 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:12:43.931174 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] HCTL ('14', '-', '-', 0) found on session 219 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:12:43.931174 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:12:43.931511 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Searching for a device in session 218 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:12:43.931848 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b3ce7f47-21bb-4a00-a346-fa17d1b1d84b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:12:43.946588 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Searching for a device in session 219 and hctl ['14', '*', '*', 0] yield: None {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:12:44.179184 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:44.758613 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:44.922306 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:12:44.922711 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:12:44.922711 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:12:44.922711 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:12:44.922711 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] No VIF found with MAC fa:16:3e:32:90:44, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:12:44.942614 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Searching for a device in session 219 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:12:44.942763 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b3ce7f47-21bb-4a00-a346-fa17d1b1d84b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:12:45.788871 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Found WWN 330000000451bc91a for multipath device dm-3 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 02:12:45.789163 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:12:45.790061 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] <== connect_volume: return (4040ms) {'type': 'block', 'scsi_wwn': '330000000451bc91a', 'path': '/dev/disk/by-id/os-brick+dev+dm-3', 'multipath_id': '330000000451bc91a'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:12:45.790196 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000451bc91a', 'path': '/dev/disk/by-id/os-brick+dev+dm-3', 'multipath_id': '330000000451bc91a'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 02:12:45.792184 np0000001583 nova-compute[98241]: WARNING stevedore.named [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 02:12:45.792463 np0000001583 nova-compute[98241]: WARNING castellan.key_manager [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 02:12:45.792643 np0000001583 nova-compute[98241]: WARNING nova.keymgr.conf_key_mgr [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 02:12:45.811554 np0000001583 nova-compute[98241]: WARNING os_brick.encryptors.luks [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 28 02:12:45.811904 np0000001583 nova-compute[98241]: WARNING stevedore.named [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 02:12:45.812091 np0000001583 nova-compute[98241]: WARNING castellan.key_manager [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 02:12:45.812254 np0000001583 nova-compute[98241]: WARNING nova.keymgr.conf_key_mgr [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 02:12:45.812728 np0000001583 nova-compute[98241]: DEBUG os_brick.encryptors [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x7724f84efaa0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b', 'iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b3ce7f47-21bb-4a00-a346-fa17d1b1d84b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-3'}, 'status': 'reserved', 'instance': '769d888e-505f-49eb-b3d8-9f9e8c7f0aab', 'attached_at': '', 'detached_at': '', 'volume_id': 'b3ce7f47-21bb-4a00-a346-fa17d1b1d84b', 'serial': 'b3ce7f47-21bb-4a00-a346-fa17d1b1d84b'} {{(pid=98241) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 28 02:12:45.812878 np0000001583 nova-compute[98241]: DEBUG os_brick.encryptors.luks [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] formatting encrypted volume /dev/dm-3 {{(pid=98241) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 28 02:12:46.467238 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-35053222-80fc-4d6f-accb-d0e2c4f7063a tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Lock "3d3cb2ab-e6f7-4700-9599-1d42b17b2c48" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.425s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:12:46.920279 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1d1846a2-dd4b-47d6-9734-976ee5f24828 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Acquiring lock "3d3cb2ab-e6f7-4700-9599-1d42b17b2c48" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:12:46.920467 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1d1846a2-dd4b-47d6-9734-976ee5f24828 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Lock "3d3cb2ab-e6f7-4700-9599-1d42b17b2c48" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:12:47.422737 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-1d1846a2-dd4b-47d6-9734-976ee5f24828 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Detaching volume 0111ac28-6f08-44bf-919c-6340f967eb01
May 28 02:12:47.455783 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-1d1846a2-dd4b-47d6-9734-976ee5f24828 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Attempting to driver detach volume 0111ac28-6f08-44bf-919c-6340f967eb01 from mountpoint /dev/vdc
May 28 02:12:47.460582 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1d1846a2-dd4b-47d6-9734-976ee5f24828 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Found disk vdc by alias ua-0111ac28-6f08-44bf-919c-6340f967eb01 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:12:47.464732 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1d1846a2-dd4b-47d6-9734-976ee5f24828 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Found disk vdc by alias ua-0111ac28-6f08-44bf-919c-6340f967eb01 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:12:47.464844 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1d1846a2-dd4b-47d6-9734-976ee5f24828 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Attempting to detach device vdc from instance 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48 from the persistent domain config. {{(pid=98241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 02:12:47.465043 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-1d1846a2-dd4b-47d6-9734-976ee5f24828 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:12:47.465043 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:12:47.465043 np0000001583 nova-compute[98241]:   <alias name="ua-0111ac28-6f08-44bf-919c-6340f967eb01"/>
May 28 02:12:47.465043 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-2"/>
May 28 02:12:47.465043 np0000001583 nova-compute[98241]:   <target dev="vdc" bus="virtio"/>
May 28 02:12:47.465043 np0000001583 nova-compute[98241]:   <serial>0111ac28-6f08-44bf-919c-6340f967eb01</serial>
May 28 02:12:47.465043 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 28 02:12:47.465043 np0000001583 nova-compute[98241]: </disk>
May 28 02:12:47.465043 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:12:47.476701 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-1d1846a2-dd4b-47d6-9734-976ee5f24828 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Successfully detached device vdc from instance 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48 from the persistent domain config.
May 28 02:12:47.477054 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1d1846a2-dd4b-47d6-9734-976ee5f24828 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] (1/8): Attempting to detach device vdc with device alias ua-0111ac28-6f08-44bf-919c-6340f967eb01 from instance 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48 from the live domain config. {{(pid=98241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 02:12:47.477188 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-1d1846a2-dd4b-47d6-9734-976ee5f24828 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:12:47.477188 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:12:47.477188 np0000001583 nova-compute[98241]:   <alias name="ua-0111ac28-6f08-44bf-919c-6340f967eb01"/>
May 28 02:12:47.477188 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-2"/>
May 28 02:12:47.477188 np0000001583 nova-compute[98241]:   <target dev="vdc" bus="virtio"/>
May 28 02:12:47.477188 np0000001583 nova-compute[98241]:   <serial>0111ac28-6f08-44bf-919c-6340f967eb01</serial>
May 28 02:12:47.477188 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 28 02:12:47.477188 np0000001583 nova-compute[98241]: </disk>
May 28 02:12:47.477188 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:12:47.950517 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Received event <DeviceRemovedEvent: 1779934367.9501727, 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48 => ua-0111ac28-6f08-44bf-919c-6340f967eb01> from libvirt while the driver is waiting for it; dispatched. {{(pid=98241) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 02:12:47.952450 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1d1846a2-dd4b-47d6-9734-976ee5f24828 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-0111ac28-6f08-44bf-919c-6340f967eb01 for instance 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48 {{(pid=98241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 02:12:47.956994 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-1d1846a2-dd4b-47d6-9734-976ee5f24828 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Successfully detached device vdc from instance 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48 from the live domain config.
May 28 02:12:47.958483 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d1846a2-dd4b-47d6-9734-976ee5f24828 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:12:47.958739 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1846a2-dd4b-47d6-9734-976ee5f24828 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01', 'iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0111ac28-6f08-44bf-919c-6340f967eb01', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:12:47.958935 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-1d1846a2-dd4b-47d6-9734-976ee5f24828 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:12:47.959304 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-1d1846a2-dd4b-47d6-9734-976ee5f24828 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:12:47.959570 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1846a2-dd4b-47d6-9734-976ee5f24828 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01', 'iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0111ac28-6f08-44bf-919c-6340f967eb01', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:12:47.959684 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1846a2-dd4b-47d6-9734-976ee5f24828 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:12:47.990298 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1846a2-dd4b-47d6-9734-976ee5f24828 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:47.990298 np0000001583 nova-compute[98241]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:47.990298 np0000001583 nova-compute[98241]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:47.990298 np0000001583 nova-compute[98241]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:47.990298 np0000001583 nova-compute[98241]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01 (non-flash)
May 28 02:12:47.990298 np0000001583 nova-compute[98241]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01 (non-flash)
May 28 02:12:47.990298 np0000001583 nova-compute[98241]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b (non-flash)
May 28 02:12:47.990298 np0000001583 nova-compute[98241]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b (non-flash)
May 28 02:12:47.990298 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:12:47.990573 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1846a2-dd4b-47d6-9734-976ee5f24828 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsi session list stdout=tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:47.990573 np0000001583 nova-compute[98241]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:47.990573 np0000001583 nova-compute[98241]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:47.990573 np0000001583 nova-compute[98241]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:47.990573 np0000001583 nova-compute[98241]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01 (non-flash)
May 28 02:12:47.990573 np0000001583 nova-compute[98241]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01 (non-flash)
May 28 02:12:47.990573 np0000001583 nova-compute[98241]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b (non-flash)
May 28 02:12:47.990573 np0000001583 nova-compute[98241]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b (non-flash)
May 28 02:12:47.990573 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:12:47.990713 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1846a2-dd4b-47d6-9734-976ee5f24828 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1', '212'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1', '213'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96', '214'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96', '215'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01', '216'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01', '217'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b', '218'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b', '219')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:12:47.990836 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1846a2-dd4b-47d6-9734-976ee5f24828 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01', '216')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:12:47.991996 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1846a2-dd4b-47d6-9734-976ee5f24828 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01', '217')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:12:47.992983 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1846a2-dd4b-47d6-9734-976ee5f24828 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724ec1f4fe0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01'): ({'sdg'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:12:47.994534 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-1d1846a2-dd4b-47d6-9734-976ee5f24828 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Removing multipathed devices sdd, sdg {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:12:47.994807 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-1d1846a2-dd4b-47d6-9734-976ee5f24828 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Flush multipath device 330000000893785fd {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:12:48.031096 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-1d1846a2-dd4b-47d6-9734-976ee5f24828 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:12:48.070418 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-1d1846a2-dd4b-47d6-9734-976ee5f24828 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:12:48.124394 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-1d1846a2-dd4b-47d6-9734-976ee5f24828 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Checking to see if SCSI volumes sdd, sdg have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:12:48.124561 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-1d1846a2-dd4b-47d6-9734-976ee5f24828 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] SCSI volumes sdd, sdg have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:12:48.125472 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-1d1846a2-dd4b-47d6-9734-976ee5f24828 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Checking to see if device paths {'sdd', 'sdg'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:12:48.136625 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-1d1846a2-dd4b-47d6-9734-976ee5f24828 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Device paths {'sdd', 'sdg'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:12:48.136792 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1846a2-dd4b-47d6-9734-976ee5f24828 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:12:48.150022 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1846a2-dd4b-47d6-9734-976ee5f24828 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:48.188048 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1846a2-dd4b-47d6-9734-976ee5f24828 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 216, target: iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01, portal: 192.168.40.100,3260]
May 28 02:12:48.188048 np0000001583 nova-compute[98241]: Logout of [sid: 216, target: iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01, portal: 192.168.40.100,3260] successful.
May 28 02:12:48.188048 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:48.204982 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1846a2-dd4b-47d6-9734-976ee5f24828 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:48.217126 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1846a2-dd4b-47d6-9734-976ee5f24828 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:48.257524 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1846a2-dd4b-47d6-9734-976ee5f24828 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 217, target: iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01, portal: 192.168.50.100,3260]
May 28 02:12:48.257524 np0000001583 nova-compute[98241]: Logout of [sid: 217, target: iqn.2023-03.storpool.com:os--volume-0111ac28-6f08-44bf-919c-6340f967eb01, portal: 192.168.50.100,3260] successful.
May 28 02:12:48.257524 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:48.279029 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1846a2-dd4b-47d6-9734-976ee5f24828 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:48.282102 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-1d1846a2-dd4b-47d6-9734-976ee5f24828 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:12:48.282102 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1846a2-dd4b-47d6-9734-976ee5f24828 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] <== disconnect_volume: return (320ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:12:48.282102 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d1846a2-dd4b-47d6-9734-976ee5f24828 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:12:48.832517 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-1d1846a2-dd4b-47d6-9734-976ee5f24828 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Lazy-loading 'flavor' on Instance uuid 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:12:49.244510 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0008945589997892966 future=<Future at 0x7724ec17ac90 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:12:49.244510 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:12:49.244826 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Emitting event <LifecycleEvent: 1779934354.2434037, e7554a11-146b-416b-8121-b7e6773b8dab => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:12:49.245027 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] VM Stopped (Lifecycle Event)
May 28 02:12:49.747342 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: e7554a11-146b-416b-8121-b7e6773b8dab] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:12:49.750480 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Secret XML: <secret ephemeral="no" private="no">
May 28 02:12:49.750480 np0000001583 nova-compute[98241]:   <usage type="volume">
May 28 02:12:49.750480 np0000001583 nova-compute[98241]:     <volume>b3ce7f47-21bb-4a00-a346-fa17d1b1d84b</volume>
May 28 02:12:49.750480 np0000001583 nova-compute[98241]:   </usage>
May 28 02:12:49.750480 np0000001583 nova-compute[98241]: </secret>
May 28 02:12:49.750480 np0000001583 nova-compute[98241]:  {{(pid=98241) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 28 02:12:49.755732 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lazy-loading 'flavor' on Instance uuid 769d888e-505f-49eb-b3d8-9f9e8c7f0aab {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:12:49.760289 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:49.843506 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1d1846a2-dd4b-47d6-9734-976ee5f24828 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Lock "3d3cb2ab-e6f7-4700-9599-1d42b17b2c48" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.923s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:12:50.218157 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-83e51082-f6b0-4e22-886b-b5a06c9dbdfa tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Acquiring lock "3d3cb2ab-e6f7-4700-9599-1d42b17b2c48" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:12:50.218314 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-83e51082-f6b0-4e22-886b-b5a06c9dbdfa tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Lock "3d3cb2ab-e6f7-4700-9599-1d42b17b2c48" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:12:50.258343 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Attempting to attach volume b3ce7f47-21bb-4a00-a346-fa17d1b1d84b with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98241) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 02:12:50.259973 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] attach device xml: <disk type="block" device="disk">
May 28 02:12:50.259973 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:12:50.259973 np0000001583 nova-compute[98241]:   <alias name="ua-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b"/>
May 28 02:12:50.259973 np0000001583 nova-compute[98241]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-3"/>
May 28 02:12:50.259973 np0000001583 nova-compute[98241]:   <target dev="vdc" bus="virtio"/>
May 28 02:12:50.259973 np0000001583 nova-compute[98241]:   <serial>b3ce7f47-21bb-4a00-a346-fa17d1b1d84b</serial>
May 28 02:12:50.259973 np0000001583 nova-compute[98241]:   <encryption format="luks">
May 28 02:12:50.259973 np0000001583 nova-compute[98241]:     <secret type="passphrase" uuid="ee35f557-d9e2-42d4-8cb3-f0e1e0be3f9d"/>
May 28 02:12:50.259973 np0000001583 nova-compute[98241]:   </encryption>
May 28 02:12:50.259973 np0000001583 nova-compute[98241]: </disk>
May 28 02:12:50.259973 np0000001583 nova-compute[98241]:  {{(pid=98241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 02:12:50.720642 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-83e51082-f6b0-4e22-886b-b5a06c9dbdfa tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Detaching volume bdf0a8cd-977b-4d68-96f5-27255b1012d1
May 28 02:12:50.758406 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-83e51082-f6b0-4e22-886b-b5a06c9dbdfa tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Attempting to driver detach volume bdf0a8cd-977b-4d68-96f5-27255b1012d1 from mountpoint /dev/vdb
May 28 02:12:50.766305 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-83e51082-f6b0-4e22-886b-b5a06c9dbdfa tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Found disk vdb by alias ua-bdf0a8cd-977b-4d68-96f5-27255b1012d1 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:12:50.767777 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-83e51082-f6b0-4e22-886b-b5a06c9dbdfa tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Found disk vdb by alias ua-bdf0a8cd-977b-4d68-96f5-27255b1012d1 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:12:50.767958 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-83e51082-f6b0-4e22-886b-b5a06c9dbdfa tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Attempting to detach device vdb from instance 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48 from the persistent domain config. {{(pid=98241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 02:12:50.768335 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-83e51082-f6b0-4e22-886b-b5a06c9dbdfa tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:12:50.768335 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:12:50.768335 np0000001583 nova-compute[98241]:   <alias name="ua-bdf0a8cd-977b-4d68-96f5-27255b1012d1"/>
May 28 02:12:50.768335 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-0"/>
May 28 02:12:50.768335 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:12:50.768335 np0000001583 nova-compute[98241]:   <serial>bdf0a8cd-977b-4d68-96f5-27255b1012d1</serial>
May 28 02:12:50.768335 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 02:12:50.768335 np0000001583 nova-compute[98241]: </disk>
May 28 02:12:50.768335 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:12:50.775210 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-83e51082-f6b0-4e22-886b-b5a06c9dbdfa tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Successfully detached device vdb from instance 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48 from the persistent domain config.
May 28 02:12:50.775349 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-83e51082-f6b0-4e22-886b-b5a06c9dbdfa tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] (1/8): Attempting to detach device vdb with device alias ua-bdf0a8cd-977b-4d68-96f5-27255b1012d1 from instance 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48 from the live domain config. {{(pid=98241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 02:12:50.775610 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-83e51082-f6b0-4e22-886b-b5a06c9dbdfa tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:12:50.775610 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:12:50.775610 np0000001583 nova-compute[98241]:   <alias name="ua-bdf0a8cd-977b-4d68-96f5-27255b1012d1"/>
May 28 02:12:50.775610 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-0"/>
May 28 02:12:50.775610 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:12:50.775610 np0000001583 nova-compute[98241]:   <serial>bdf0a8cd-977b-4d68-96f5-27255b1012d1</serial>
May 28 02:12:50.775610 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 02:12:50.775610 np0000001583 nova-compute[98241]: </disk>
May 28 02:12:50.775610 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:12:51.233319 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Received event <DeviceRemovedEvent: 1779934371.2329736, 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48 => ua-bdf0a8cd-977b-4d68-96f5-27255b1012d1> from libvirt while the driver is waiting for it; dispatched. {{(pid=98241) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 02:12:51.234565 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-83e51082-f6b0-4e22-886b-b5a06c9dbdfa tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-bdf0a8cd-977b-4d68-96f5-27255b1012d1 for instance 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48 {{(pid=98241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 02:12:51.236755 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-83e51082-f6b0-4e22-886b-b5a06c9dbdfa tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Successfully detached device vdb from instance 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48 from the live domain config.
May 28 02:12:51.237883 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83e51082-f6b0-4e22-886b-b5a06c9dbdfa tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:12:51.238155 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-83e51082-f6b0-4e22-886b-b5a06c9dbdfa tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1', 'iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bdf0a8cd-977b-4d68-96f5-27255b1012d1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:12:51.238284 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-83e51082-f6b0-4e22-886b-b5a06c9dbdfa tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:12:51.238574 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-83e51082-f6b0-4e22-886b-b5a06c9dbdfa tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:12:51.238832 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-83e51082-f6b0-4e22-886b-b5a06c9dbdfa tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1', 'iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bdf0a8cd-977b-4d68-96f5-27255b1012d1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:12:51.238952 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-83e51082-f6b0-4e22-886b-b5a06c9dbdfa tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:12:51.267932 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-83e51082-f6b0-4e22-886b-b5a06c9dbdfa tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:51.267932 np0000001583 nova-compute[98241]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:51.267932 np0000001583 nova-compute[98241]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:51.267932 np0000001583 nova-compute[98241]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:51.267932 np0000001583 nova-compute[98241]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b (non-flash)
May 28 02:12:51.267932 np0000001583 nova-compute[98241]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b (non-flash)
May 28 02:12:51.267932 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:12:51.268240 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-83e51082-f6b0-4e22-886b-b5a06c9dbdfa tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsi session list stdout=tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:51.268240 np0000001583 nova-compute[98241]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1 (non-flash)
May 28 02:12:51.268240 np0000001583 nova-compute[98241]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:51.268240 np0000001583 nova-compute[98241]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:51.268240 np0000001583 nova-compute[98241]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b (non-flash)
May 28 02:12:51.268240 np0000001583 nova-compute[98241]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b (non-flash)
May 28 02:12:51.268240 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:12:51.268240 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-83e51082-f6b0-4e22-886b-b5a06c9dbdfa tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1', '212'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1', '213'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96', '214'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96', '215'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b', '218'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b', '219')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:12:51.268409 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-83e51082-f6b0-4e22-886b-b5a06c9dbdfa tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1', '212')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:12:51.269246 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-83e51082-f6b0-4e22-886b-b5a06c9dbdfa tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1', '213')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:12:51.269911 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-83e51082-f6b0-4e22-886b-b5a06c9dbdfa tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724ec25f1a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1'): ({'sdc'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:12:51.270093 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-83e51082-f6b0-4e22-886b-b5a06c9dbdfa tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Removing multipathed devices sdc, sdb {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:12:51.270311 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-83e51082-f6b0-4e22-886b-b5a06c9dbdfa tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Flush multipath device 330000000d23587a8 {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:12:51.301396 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-83e51082-f6b0-4e22-886b-b5a06c9dbdfa tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:12:51.346516 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-83e51082-f6b0-4e22-886b-b5a06c9dbdfa tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:12:51.398402 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-83e51082-f6b0-4e22-886b-b5a06c9dbdfa tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:12:51.398588 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-83e51082-f6b0-4e22-886b-b5a06c9dbdfa tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:12:51.399562 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-83e51082-f6b0-4e22-886b-b5a06c9dbdfa tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:12:51.411962 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-83e51082-f6b0-4e22-886b-b5a06c9dbdfa tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:12:51.411962 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-83e51082-f6b0-4e22-886b-b5a06c9dbdfa tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:12:51.423819 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-83e51082-f6b0-4e22-886b-b5a06c9dbdfa tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:51.459741 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-83e51082-f6b0-4e22-886b-b5a06c9dbdfa tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 212, target: iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1, portal: 192.168.40.100,3260]
May 28 02:12:51.459741 np0000001583 nova-compute[98241]: Logout of [sid: 212, target: iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1, portal: 192.168.40.100,3260] successful.
May 28 02:12:51.459741 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:51.480391 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-83e51082-f6b0-4e22-886b-b5a06c9dbdfa tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:51.495816 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-83e51082-f6b0-4e22-886b-b5a06c9dbdfa tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:51.525421 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-83e51082-f6b0-4e22-886b-b5a06c9dbdfa tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 213, target: iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1, portal: 192.168.50.100,3260]
May 28 02:12:51.525421 np0000001583 nova-compute[98241]: Logout of [sid: 213, target: iqn.2023-03.storpool.com:os--volume-bdf0a8cd-977b-4d68-96f5-27255b1012d1, portal: 192.168.50.100,3260] successful.
May 28 02:12:51.525421 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:51.544128 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-83e51082-f6b0-4e22-886b-b5a06c9dbdfa tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:51.544128 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-83e51082-f6b0-4e22-886b-b5a06c9dbdfa tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:12:51.544128 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-83e51082-f6b0-4e22-886b-b5a06c9dbdfa tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] <== disconnect_volume: return (305ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:12:51.544128 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83e51082-f6b0-4e22-886b-b5a06c9dbdfa tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:12:52.085644 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-83e51082-f6b0-4e22-886b-b5a06c9dbdfa tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Lazy-loading 'flavor' on Instance uuid 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:12:52.893129 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:12:52.893550 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:12:52.893550 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:12:52.893550 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:12:52.893698 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] No VIF found with MAC fa:16:3e:13:4c:d8, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:12:53.090915 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-83e51082-f6b0-4e22-886b-b5a06c9dbdfa tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Lock "3d3cb2ab-e6f7-4700-9599-1d42b17b2c48" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.872s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:12:53.467219 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-cda69310-0bf8-405e-9ce8-1d10e0beb057 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Acquiring lock "3d3cb2ab-e6f7-4700-9599-1d42b17b2c48" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:12:53.467443 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-cda69310-0bf8-405e-9ce8-1d10e0beb057 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Lock "3d3cb2ab-e6f7-4700-9599-1d42b17b2c48" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:12:53.467652 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-cda69310-0bf8-405e-9ce8-1d10e0beb057 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Acquiring lock "3d3cb2ab-e6f7-4700-9599-1d42b17b2c48-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:12:53.467819 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-cda69310-0bf8-405e-9ce8-1d10e0beb057 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Lock "3d3cb2ab-e6f7-4700-9599-1d42b17b2c48-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:12:53.467966 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-cda69310-0bf8-405e-9ce8-1d10e0beb057 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Lock "3d3cb2ab-e6f7-4700-9599-1d42b17b2c48-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:12:53.470316 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cda69310-0bf8-405e-9ce8-1d10e0beb057 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Terminating instance
May 28 02:12:53.972834 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cda69310-0bf8-405e-9ce8-1d10e0beb057 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 02:12:53.988115 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:53.990029 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:54.016367 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:54.036245 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:54.283704 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-dc9454c8-7416-4bbe-897f-c69fa98fba18 req-c15496fd-a608-42c6-ba9c-2c82dcc5889b service nova] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Received event network-vif-unplugged-de3e5796-e5a7-4bac-9a3f-cc12d3d45282 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:12:54.284971 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-dc9454c8-7416-4bbe-897f-c69fa98fba18 req-c15496fd-a608-42c6-ba9c-2c82dcc5889b service nova] Acquiring lock "3d3cb2ab-e6f7-4700-9599-1d42b17b2c48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:12:54.284971 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-dc9454c8-7416-4bbe-897f-c69fa98fba18 req-c15496fd-a608-42c6-ba9c-2c82dcc5889b service nova] Lock "3d3cb2ab-e6f7-4700-9599-1d42b17b2c48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:12:54.284971 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-dc9454c8-7416-4bbe-897f-c69fa98fba18 req-c15496fd-a608-42c6-ba9c-2c82dcc5889b service nova] Lock "3d3cb2ab-e6f7-4700-9599-1d42b17b2c48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:12:54.284971 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-dc9454c8-7416-4bbe-897f-c69fa98fba18 req-c15496fd-a608-42c6-ba9c-2c82dcc5889b service nova] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] No waiting events found dispatching network-vif-unplugged-de3e5796-e5a7-4bac-9a3f-cc12d3d45282 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:12:54.284971 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-dc9454c8-7416-4bbe-897f-c69fa98fba18 req-c15496fd-a608-42c6-ba9c-2c82dcc5889b service nova] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Received event network-vif-unplugged-de3e5796-e5a7-4bac-9a3f-cc12d3d45282 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:12:54.285981 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:54.293001 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:54.313720 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999729847999788 future=<Future at 0x7724f81760c0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:12:54.314284 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999176280000029 future=<Future at 0x7724f81760c0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:12:54.314380 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999040511999738 future=<Future at 0x7724f81760c0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:12:54.316309 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Instance destroyed successfully.
May 28 02:12:54.316813 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-cda69310-0bf8-405e-9ce8-1d10e0beb057 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Lazy-loading 'resources' on Instance uuid 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48 {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:12:54.440322 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c1f58b24-16eb-43d0-ad37-12856bd1774d tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "769d888e-505f-49eb-b3d8-9f9e8c7f0aab" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.383s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:12:54.761627 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:54.819820 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-cda69310-0bf8-405e-9ce8-1d10e0beb057 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T02:11:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2038882305',display_name='tempest-TestServerVolumeAttachmentScenario-server-2038882305',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-testservervolumeattachmentscenario-server-2038882305',id=79,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZJ/h5hJi0FfW5EOIhbaBmM1xTGUjJQOAHhcWja+bB3cVb5l0NSXmcrNiuqd3GX8Nt0leLxyEKN+qXMfXDOm8HpYAFiE7CQlz+G50B5ZeCM5U26f6dw5GQFKnLrqXDULg==',key_name='tempest-keypair-762686630',keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:11:57Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a074e5b5a0c04c93a93cf6a066856ad3',ramdisk_id='',reservation_id='r-wpwb3c96',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1455437119',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1455437119-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T02:11:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c90a2da7d9f4fbc9993789800a47d06',uuid=3d3cb2ab-e6f7-4700-9599-1d42b17b2c48,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de3e5796-e5a7-4bac-9a3f-cc12d3d45282", "address": "fa:16:3e:32:90:44", "network": {"id": "6ef77fc7-70af-4b8b-a202-b78eed6d619f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1127154808-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a074e5b5a0c04c93a93cf6a066856ad3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3e5796-e5", "ovs_interfaceid": "de3e5796-e5a7-4bac-9a3f-cc12d3d45282", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:12:54.820146 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-cda69310-0bf8-405e-9ce8-1d10e0beb057 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Converting VIF {"id": "de3e5796-e5a7-4bac-9a3f-cc12d3d45282", "address": "fa:16:3e:32:90:44", "network": {"id": "6ef77fc7-70af-4b8b-a202-b78eed6d619f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1127154808-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a074e5b5a0c04c93a93cf6a066856ad3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3e5796-e5", "ovs_interfaceid": "de3e5796-e5a7-4bac-9a3f-cc12d3d45282", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:12:54.820722 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-cda69310-0bf8-405e-9ce8-1d10e0beb057 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:90:44,bridge_name='br-int',has_traffic_filtering=True,id=de3e5796-e5a7-4bac-9a3f-cc12d3d45282,network=Network(6ef77fc7-70af-4b8b-a202-b78eed6d619f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde3e5796-e5') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:12:54.821050 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-cda69310-0bf8-405e-9ce8-1d10e0beb057 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:90:44,bridge_name='br-int',has_traffic_filtering=True,id=de3e5796-e5a7-4bac-9a3f-cc12d3d45282,network=Network(6ef77fc7-70af-4b8b-a202-b78eed6d619f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde3e5796-e5') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:12:54.822558 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:54.822932 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde3e5796-e5, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:12:54.824066 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:54.825479 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:12:54.826192 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:54.826435 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=30f573d3-2d94-4ffc-b13b-6ba0b75ea462) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:12:54.826963 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:54.827941 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:12:54.829495 np0000001583 nova-compute[98241]: INFO os_vif [None req-cda69310-0bf8-405e-9ce8-1d10e0beb057 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:90:44,bridge_name='br-int',has_traffic_filtering=True,id=de3e5796-e5a7-4bac-9a3f-cc12d3d45282,network=Network(6ef77fc7-70af-4b8b-a202-b78eed6d619f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde3e5796-e5')
May 28 02:12:54.829849 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-cda69310-0bf8-405e-9ce8-1d10e0beb057 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Deleting instance files /opt/stack/data/nova/instances/3d3cb2ab-e6f7-4700-9599-1d42b17b2c48_del
May 28 02:12:54.830527 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-cda69310-0bf8-405e-9ce8-1d10e0beb057 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Deletion of /opt/stack/data/nova/instances/3d3cb2ab-e6f7-4700-9599-1d42b17b2c48_del complete
May 28 02:12:55.031629 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "769d888e-505f-49eb-b3d8-9f9e8c7f0aab" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:12:55.031949 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "769d888e-505f-49eb-b3d8-9f9e8c7f0aab" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:12:55.336400 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cda69310-0bf8-405e-9ce8-1d10e0beb057 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Took 1.36 seconds to destroy the instance on the hypervisor.
May 28 02:12:55.337045 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-cda69310-0bf8-405e-9ce8-1d10e0beb057 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 02:12:55.337278 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 02:12:55.337396 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 02:12:55.337923 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:12:55.393551 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:12:55.536741 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lazy-loading 'flavor' on Instance uuid 769d888e-505f-49eb-b3d8-9f9e8c7f0aab {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:12:56.271234 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:12:56.344153 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-148c4166-3c29-4ed1-84a8-8de29c234f68 req-489e5a58-dcfb-48ce-b1df-3d57ca8c00f9 service nova] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Received event network-vif-unplugged-de3e5796-e5a7-4bac-9a3f-cc12d3d45282 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:12:56.344571 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-148c4166-3c29-4ed1-84a8-8de29c234f68 req-489e5a58-dcfb-48ce-b1df-3d57ca8c00f9 service nova] Acquiring lock "3d3cb2ab-e6f7-4700-9599-1d42b17b2c48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:12:56.344815 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-148c4166-3c29-4ed1-84a8-8de29c234f68 req-489e5a58-dcfb-48ce-b1df-3d57ca8c00f9 service nova] Lock "3d3cb2ab-e6f7-4700-9599-1d42b17b2c48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:12:56.345705 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-148c4166-3c29-4ed1-84a8-8de29c234f68 req-489e5a58-dcfb-48ce-b1df-3d57ca8c00f9 service nova] Lock "3d3cb2ab-e6f7-4700-9599-1d42b17b2c48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:12:56.345705 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-148c4166-3c29-4ed1-84a8-8de29c234f68 req-489e5a58-dcfb-48ce-b1df-3d57ca8c00f9 service nova] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] No waiting events found dispatching network-vif-unplugged-de3e5796-e5a7-4bac-9a3f-cc12d3d45282 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:12:56.345705 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-148c4166-3c29-4ed1-84a8-8de29c234f68 req-489e5a58-dcfb-48ce-b1df-3d57ca8c00f9 service nova] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Received event network-vif-unplugged-de3e5796-e5a7-4bac-9a3f-cc12d3d45282 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:12:56.345705 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-148c4166-3c29-4ed1-84a8-8de29c234f68 req-489e5a58-dcfb-48ce-b1df-3d57ca8c00f9 service nova] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Received event network-vif-deleted-de3e5796-e5a7-4bac-9a3f-cc12d3d45282 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:12:56.542926 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "769d888e-505f-49eb-b3d8-9f9e8c7f0aab" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:12:56.773154 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Took 1.44 seconds to deallocate network for instance.
May 28 02:12:56.865230 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:57.278586 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-cda69310-0bf8-405e-9ce8-1d10e0beb057 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:12:57.278997 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-cda69310-0bf8-405e-9ce8-1d10e0beb057 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:12:57.400743 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cda69310-0bf8-405e-9ce8-1d10e0beb057 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:12:57.400977 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-cda69310-0bf8-405e-9ce8-1d10e0beb057 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:12:57.601634 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "769d888e-505f-49eb-b3d8-9f9e8c7f0aab" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:12:57.601810 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "769d888e-505f-49eb-b3d8-9f9e8c7f0aab" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:12:57.601968 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Attaching volume 3a99d18a-ba56-4405-a9cf-1b4578a54376 to /dev/vdd
May 28 02:12:57.633534 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:12:57.644415 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 02:12:57.664969 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:12:57.715770 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 02:12:57.716639 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 02:12:57.725785 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 02:12:57.728005 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe13:4cd8', 'fe80::d05c:d0ff:fe98:b4ef'] 
May 28 02:12:57.728517 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 02:12:57.728517 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 02:12:57.728602 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] <== get_connector_properties: return (94ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:12:57.728801 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Updating existing volume attachment record: 44b6a30a-125f-4e8b-b0ea-7c024510a6a0 {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 02:12:57.904047 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-cda69310-0bf8-405e-9ce8-1d10e0beb057 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:12:58.275839 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 02:12:58.276046 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376', 'iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3a99d18a-ba56-4405-a9cf-1b4578a54376', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:12:58.276183 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:12:58.276545 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:12:58.276728 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376', 'iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3a99d18a-ba56-4405-a9cf-1b4578a54376', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 02:12:58.287778 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:12:58.288152 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:12:58.288651 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:12:58.289291 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:12:58.290483 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:12:58.290670 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:12:58.298834 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:12:58.298834 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:58.302796 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:12:58.302796 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:58.308571 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376] added
May 28 02:12:58.308571 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:12:58.308571 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:12:58.308571 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:12:58.308571 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:12:58.308571 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:12:58.308571 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:58.308867 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:12:58.308907 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0202(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:12:58.309056 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:12:58.312590 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376] added
May 28 02:12:58.312590 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:12:58.312590 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:12:58.312590 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:12:58.312590 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:12:58.312590 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:12:58.312590 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:58.312773 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:12:58.312948 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0222(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:12:58.313056 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:12:58.410854 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-cda69310-0bf8-405e-9ce8-1d10e0beb057 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.132s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:12:58.456921 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-cda69310-0bf8-405e-9ce8-1d10e0beb057 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Deleted allocations for instance 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48
May 28 02:12:58.680509 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:59.190299 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:12:59.309450 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:12:59.313479 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:12:59.323638 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:12:59.323638 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:12:59.328282 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:12:59.328282 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:59.337534 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:59.341934 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:59.353951 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:59.353951 np0000001583 nova-compute[98241]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:59.353951 np0000001583 nova-compute[98241]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b (non-flash)
May 28 02:12:59.353951 np0000001583 nova-compute[98241]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b (non-flash)
May 28 02:12:59.353951 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:12:59.354071 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsi session list stdout=tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:59.354071 np0000001583 nova-compute[98241]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:59.354071 np0000001583 nova-compute[98241]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b (non-flash)
May 28 02:12:59.354071 np0000001583 nova-compute[98241]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b (non-flash)
May 28 02:12:59.354071 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:12:59.355509 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:59.355509 np0000001583 nova-compute[98241]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:59.355509 np0000001583 nova-compute[98241]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b (non-flash)
May 28 02:12:59.355509 np0000001583 nova-compute[98241]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b (non-flash)
May 28 02:12:59.355509 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:12:59.355638 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsi session list stdout=tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:59.355638 np0000001583 nova-compute[98241]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:59.355638 np0000001583 nova-compute[98241]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b (non-flash)
May 28 02:12:59.355638 np0000001583 nova-compute[98241]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b (non-flash)
May 28 02:12:59.355638 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:12:59.393192 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376, portal: 192.168.40.100,3260]
May 28 02:12:59.393192 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376, portal: 192.168.40.100,3260] successful.
May 28 02:12:59.393192 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:59.399624 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376, portal: 192.168.50.100,3260]
May 28 02:12:59.399624 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376, portal: 192.168.50.100,3260] successful.
May 28 02:12:59.399624 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:59.404328 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:59.410678 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:12:59.419170 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:59.419170 np0000001583 nova-compute[98241]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:59.419170 np0000001583 nova-compute[98241]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b (non-flash)
May 28 02:12:59.419170 np0000001583 nova-compute[98241]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b (non-flash)
May 28 02:12:59.419170 np0000001583 nova-compute[98241]: tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376 (non-flash)
May 28 02:12:59.419170 np0000001583 nova-compute[98241]: tcp: [221] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376 (non-flash)
May 28 02:12:59.419170 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:12:59.419446 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsi session list stdout=tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:59.419446 np0000001583 nova-compute[98241]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:59.419446 np0000001583 nova-compute[98241]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b (non-flash)
May 28 02:12:59.419446 np0000001583 nova-compute[98241]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b (non-flash)
May 28 02:12:59.419446 np0000001583 nova-compute[98241]: tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376 (non-flash)
May 28 02:12:59.419446 np0000001583 nova-compute[98241]: tcp: [221] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376 (non-flash)
May 28 02:12:59.419446 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:12:59.419672 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.131s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:12:59.419803 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:12:59.420606 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] HCTL ('7', '-', '-', 0) found on session 220 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:12:59.420764 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:12:59.425412 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:59.425412 np0000001583 nova-compute[98241]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:59.425412 np0000001583 nova-compute[98241]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b (non-flash)
May 28 02:12:59.425412 np0000001583 nova-compute[98241]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b (non-flash)
May 28 02:12:59.425412 np0000001583 nova-compute[98241]: tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376 (non-flash)
May 28 02:12:59.425412 np0000001583 nova-compute[98241]: tcp: [221] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376 (non-flash)
May 28 02:12:59.425412 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:12:59.425620 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsi session list stdout=tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:59.425620 np0000001583 nova-compute[98241]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:12:59.425620 np0000001583 nova-compute[98241]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b (non-flash)
May 28 02:12:59.425620 np0000001583 nova-compute[98241]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b (non-flash)
May 28 02:12:59.425620 np0000001583 nova-compute[98241]: tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376 (non-flash)
May 28 02:12:59.425620 np0000001583 nova-compute[98241]: tcp: [221] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376 (non-flash)
May 28 02:12:59.425620 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:12:59.425752 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.135s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:12:59.425855 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:12:59.426493 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] HCTL ('8', '-', '-', 0) found on session 221 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:12:59.426583 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:12:59.435060 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Searching for a device in session 220 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:12:59.435060 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3a99d18a-ba56-4405-a9cf-1b4578a54376', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:12:59.440377 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Searching for a device in session 221 and hctl ['8', '*', '*', 0] yield: None {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:12:59.465794 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-cda69310-0bf8-405e-9ce8-1d10e0beb057 tempest-TestServerVolumeAttachmentScenario-1455437119 tempest-TestServerVolumeAttachmentScenario-1455437119-project-member] Lock "3d3cb2ab-e6f7-4700-9599-1d42b17b2c48" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.998s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:12:59.828297 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:13:00.440181 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Searching for a device in session 221 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:13:00.440581 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3a99d18a-ba56-4405-a9cf-1b4578a54376', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:13:01.308883 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Found WWN 33000000001c82a55 for multipath device dm-0 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 02:13:01.309173 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:13:01.309324 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] <== connect_volume: return (3032ms) {'type': 'block', 'scsi_wwn': '33000000001c82a55', 'path': '/dev/dm-0', 'multipath_id': '33000000001c82a55'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:13:01.309443 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000001c82a55', 'path': '/dev/dm-0', 'multipath_id': '33000000001c82a55'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 02:13:01.312446 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lazy-loading 'flavor' on Instance uuid 769d888e-505f-49eb-b3d8-9f9e8c7f0aab {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:13:01.815325 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Attempting to attach volume 3a99d18a-ba56-4405-a9cf-1b4578a54376 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98241) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 02:13:01.817258 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] attach device xml: <disk type="block" device="disk">
May 28 02:13:01.817258 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:13:01.817258 np0000001583 nova-compute[98241]:   <alias name="ua-3a99d18a-ba56-4405-a9cf-1b4578a54376"/>
May 28 02:13:01.817258 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-0"/>
May 28 02:13:01.817258 np0000001583 nova-compute[98241]:   <target dev="vdd" bus="virtio"/>
May 28 02:13:01.817258 np0000001583 nova-compute[98241]:   <serial>3a99d18a-ba56-4405-a9cf-1b4578a54376</serial>
May 28 02:13:01.817258 np0000001583 nova-compute[98241]:   <shareable/>
May 28 02:13:01.817258 np0000001583 nova-compute[98241]: </disk>
May 28 02:13:01.817258 np0000001583 nova-compute[98241]:  {{(pid=98241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 02:13:03.454981 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:13:03.455375 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:13:03.455375 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:13:03.455482 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] No BDM found with device name vdd, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:13:03.455603 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:13:03.455734 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] No VIF found with MAC fa:16:3e:13:4c:d8, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:13:03.694885 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:13:03.697642 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:13:04.830112 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:13:05.008866 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-c19f4709-5b42-48db-aaf5-53d913f011b9 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "769d888e-505f-49eb-b3d8-9f9e8c7f0aab" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.407s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:13:05.264552 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:13:07.484703 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "517d9811-556f-437c-92f9-1eee887e072b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:13:07.485163 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "517d9811-556f-437c-92f9-1eee887e072b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:13:07.988540 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 02:13:08.529800 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:13:08.530215 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:13:08.533376 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 02:13:08.533565 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Claim successful on node np0000001583
May 28 02:13:08.696428 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:13:09.313935 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0004109970000172325 future=<Future at 0x7724f81760c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:13:09.314525 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Emitting event <LifecycleEvent: 1779934374.313368, 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48 => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:13:09.314525 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:13:09.314674 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] VM Stopped (Lifecycle Event)
May 28 02:13:09.657270 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:13:09.657508 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:13:09.818159 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-2532d241-4b05-4c2e-9ec1-1139b241f7bd tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 3d3cb2ab-e6f7-4700-9599-1d42b17b2c48] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:13:09.831911 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:13:10.160236 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:13:10.667812 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.138s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:13:10.668332 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 02:13:11.172928 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 02:13:11.173660 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 517d9811-556f-437c-92f9-1eee887e072b] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 02:13:11.174606 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:13:11.174606 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:13:11.239269 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a89bef00d8034a63ac07ef521be03355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b993c740f0114a22b4ec01fd0172dc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 02:13:11.676648 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 02:13:11.744311 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Successfully created port: ecc3a968-ac6b-49b9-b844-dd6984ececf3 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 02:13:12.181055 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Successfully updated port: ecc3a968-ac6b-49b9-b844-dd6984ececf3 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 02:13:12.182507 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 02:13:12.234267 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-8ee80199-e4d2-4ef2-aec6-bc7a49ef4a54 req-57327b3f-e159-4644-b1f7-fd163b18d893 service nova] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Received event network-changed-ecc3a968-ac6b-49b9-b844-dd6984ececf3 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:13:12.234657 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-8ee80199-e4d2-4ef2-aec6-bc7a49ef4a54 req-57327b3f-e159-4644-b1f7-fd163b18d893 service nova] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Refreshing instance network info cache due to event network-changed-ecc3a968-ac6b-49b9-b844-dd6984ececf3. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:13:12.234657 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-8ee80199-e4d2-4ef2-aec6-bc7a49ef4a54 req-57327b3f-e159-4644-b1f7-fd163b18d893 service nova] Acquiring lock "refresh_cache-517d9811-556f-437c-92f9-1eee887e072b" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:13:12.235329 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-8ee80199-e4d2-4ef2-aec6-bc7a49ef4a54 req-57327b3f-e159-4644-b1f7-fd163b18d893 service nova] Acquired lock "refresh_cache-517d9811-556f-437c-92f9-1eee887e072b" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:13:12.235603 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-8ee80199-e4d2-4ef2-aec6-bc7a49ef4a54 req-57327b3f-e159-4644-b1f7-fd163b18d893 service nova] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Refreshing network info cache for port ecc3a968-ac6b-49b9-b844-dd6984ececf3 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:13:12.686003 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "refresh_cache-517d9811-556f-437c-92f9-1eee887e072b" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:13:12.737366 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-8ee80199-e4d2-4ef2-aec6-bc7a49ef4a54 req-57327b3f-e159-4644-b1f7-fd163b18d893 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:13:12.792300 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-8ee80199-e4d2-4ef2-aec6-bc7a49ef4a54 req-57327b3f-e159-4644-b1f7-fd163b18d893 service nova] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:13:12.933338 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-8ee80199-e4d2-4ef2-aec6-bc7a49ef4a54 req-57327b3f-e159-4644-b1f7-fd163b18d893 service nova] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:13:13.190275 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 02:13:13.191051 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 02:13:13.191292 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Creating image(s)
May 28 02:13:13.191802 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "/opt/stack/data/nova/instances/517d9811-556f-437c-92f9-1eee887e072b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:13:13.191955 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "/opt/stack/data/nova/instances/517d9811-556f-437c-92f9-1eee887e072b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:13:13.192495 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "/opt/stack/data/nova/instances/517d9811-556f-437c-92f9-1eee887e072b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:13:13.192995 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:13:13.195491 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:13:13.196378 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:13:13.284810 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.088s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:13:13.285318 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:13:13.285852 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:13:13.286312 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:13:13.288960 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:13:13.289413 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:13:13.378214 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.088s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:13:13.379108 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/517d9811-556f-437c-92f9-1eee887e072b/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:13:13.433698 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/517d9811-556f-437c-92f9-1eee887e072b/disk 1073741824" returned: 0 in 0.055s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:13:13.434260 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.148s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:13:13.434604 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:13:13.447190 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-8ee80199-e4d2-4ef2-aec6-bc7a49ef4a54 req-57327b3f-e159-4644-b1f7-fd163b18d893 service nova] Releasing lock "refresh_cache-517d9811-556f-437c-92f9-1eee887e072b" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:13:13.448434 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquired lock "refresh_cache-517d9811-556f-437c-92f9-1eee887e072b" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:13:13.448619 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:13:13.527603 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.093s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:13:13.528291 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Checking if we can resize image /opt/stack/data/nova/instances/517d9811-556f-437c-92f9-1eee887e072b/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 02:13:13.528404 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/517d9811-556f-437c-92f9-1eee887e072b/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:13:13.615858 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/517d9811-556f-437c-92f9-1eee887e072b/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:13:13.616433 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Cannot resize image /opt/stack/data/nova/instances/517d9811-556f-437c-92f9-1eee887e072b/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 02:13:13.617191 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 02:13:13.617486 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Ensure instance console log exists: /opt/stack/data/nova/instances/517d9811-556f-437c-92f9-1eee887e072b/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 02:13:13.617825 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:13:13.618137 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:13:13.618351 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:13:13.698294 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:13:14.024465 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:13:14.153096 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:13:14.265095 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Updating instance_info_cache with network_info: [{"id": "ecc3a968-ac6b-49b9-b844-dd6984ececf3", "address": "fa:16:3e:53:84:69", "network": {"id": "3b938343-a65c-4ea6-9c96-be377e9fe646", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-19450663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b993c740f0114a22b4ec01fd0172dc89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc3a968-ac", "ovs_interfaceid": "ecc3a968-ac6b-49b9-b844-dd6984ececf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:13:14.766929 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Releasing lock "refresh_cache-517d9811-556f-437c-92f9-1eee887e072b" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:13:14.767421 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Instance network_info: |[{"id": "ecc3a968-ac6b-49b9-b844-dd6984ececf3", "address": "fa:16:3e:53:84:69", "network": {"id": "3b938343-a65c-4ea6-9c96-be377e9fe646", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-19450663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b993c740f0114a22b4ec01fd0172dc89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc3a968-ac", "ovs_interfaceid": "ecc3a968-ac6b-49b9-b844-dd6984ececf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 02:13:14.768703 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Start _get_guest_xml network_info=[{"id": "ecc3a968-ac6b-49b9-b844-dd6984ececf3", "address": "fa:16:3e:53:84:69", "network": {"id": "3b938343-a65c-4ea6-9c96-be377e9fe646", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-19450663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b993c740f0114a22b4ec01fd0172dc89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc3a968-ac", "ovs_interfaceid": "ecc3a968-ac6b-49b9-b844-dd6984ececf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 02:13:14.774448 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:13:14.775591 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-VolumeMultiattachTests-server-1582208117', uuid='517d9811-556f-437c-92f9-1eee887e072b'), owner=OwnerMeta(userid='a89bef00d8034a63ac07ef521be03355', username='tempest-VolumeMultiattachTests-562724558-project-member', projectid='b993c740f0114a22b4ec01fd0172dc89', projectname='tempest-VolumeMultiattachTests-562724558'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ecc3a968-ac6b-49b9-b844-dd6984ececf3", "address": "fa:16:3e:53:84:69", "network": {"id": "3b938343-a65c-4ea6-9c96-be377e9fe646", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-19450663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b993c740f0114a22b4ec01fd0172dc89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc3a968-ac", "ovs_interfaceid": "ecc3a968-ac6b-49b9-b844-dd6984ececf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779934394.7752883) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 02:13:14.776704 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 02:13:14.777000 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 02:13:14.778101 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 02:13:14.778355 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 02:13:14.779353 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 02:13:14.779682 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 02:13:14.779918 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 02:13:14.780049 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 02:13:14.780243 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 02:13:14.780371 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 02:13:14.780502 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 02:13:14.780717 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 02:13:14.780854 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 02:13:14.781004 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 02:13:14.781161 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 02:13:14.781331 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 02:13:14.792040 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:13:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1582208117',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-volumemultiattachtests-server-1582208117',id=80,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCw6mfS2UYDP9PgoI2ARsl9ucPnOUIdVENs+bIGUR2pJqKYe9J5WuC1571kjjgpZpiCNiKuxg+RnaT2NiKlIqk+HjAvm/MD3/Wxke+V2cXkupwN0eLhzgarMMyq4yLY9EA==',key_name='tempest-keypair-805647940',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b993c740f0114a22b4ec01fd0172dc89',ramdisk_id='',reservation_id='r-zot0zte8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-562724558',owner_user_name='tempest-VolumeMultiattachTests-562724558-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:13:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a89bef00d8034a63ac07ef521be03355',uuid=517d9811-556f-437c-92f9-1eee887e072b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ecc3a968-ac6b-49b9-b844-dd6984ececf3", "address": "fa:16:3e:53:84:69", "network": {"id": "3b938343-a65c-4ea6-9c96-be377e9fe646", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-19450663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b993c740f0114a22b4ec01fd0172dc89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc3a968-ac", "ovs_interfaceid": "ecc3a968-ac6b-49b9-b844-dd6984ececf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 02:13:14.792263 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Converting VIF {"id": "ecc3a968-ac6b-49b9-b844-dd6984ececf3", "address": "fa:16:3e:53:84:69", "network": {"id": "3b938343-a65c-4ea6-9c96-be377e9fe646", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-19450663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b993c740f0114a22b4ec01fd0172dc89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc3a968-ac", "ovs_interfaceid": "ecc3a968-ac6b-49b9-b844-dd6984ececf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:13:14.792807 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:84:69,bridge_name='br-int',has_traffic_filtering=True,id=ecc3a968-ac6b-49b9-b844-dd6984ececf3,network=Network(3b938343-a65c-4ea6-9c96-be377e9fe646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc3a968-ac') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:13:14.793572 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lazy-loading 'pci_devices' on Instance uuid 517d9811-556f-437c-92f9-1eee887e072b {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:13:14.833695 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:13:15.295876 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 517d9811-556f-437c-92f9-1eee887e072b] End _get_guest_xml xml=<domain type="qemu">
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:   <uuid>517d9811-556f-437c-92f9-1eee887e072b</uuid>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:   <name>instance-00000050</name>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:   <metadata>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:       <nova:name>tempest-VolumeMultiattachTests-server-1582208117</nova:name>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 02:13:14</nova:creationTime>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:       </nova:image>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:         <nova:user uuid="a89bef00d8034a63ac07ef521be03355">tempest-VolumeMultiattachTests-562724558-project-member</nova:user>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:         <nova:project uuid="b993c740f0114a22b4ec01fd0172dc89">tempest-VolumeMultiattachTests-562724558</nova:project>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:         <nova:port uuid="ecc3a968-ac6b-49b9-b844-dd6984ececf3">
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:         </nova:port>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:   </metadata>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:     <system>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:       <entry name="serial">517d9811-556f-437c-92f9-1eee887e072b</entry>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:       <entry name="uuid">517d9811-556f-437c-92f9-1eee887e072b</entry>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:     </system>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:   <os>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:   </os>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:   <features>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:     <acpi/>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:     <tcg>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:     </tcg>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:   </features>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:   </cpu>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:   <devices>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/517d9811-556f-437c-92f9-1eee887e072b/disk"/>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:     </disk>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/517d9811-556f-437c-92f9-1eee887e072b/disk.config"/>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:     </disk>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:53:84:69"/>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:       <target dev="tapecc3a968-ac"/>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:     </interface>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/517d9811-556f-437c-92f9-1eee887e072b/console.log" append="off"/>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:     </serial>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:     <video>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:     </video>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:     </rng>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:     </memballoon>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:   </devices>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]: </domain>
May 28 02:13:15.295876 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 02:13:15.297966 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Preparing to wait for external event network-vif-plugged-ecc3a968-ac6b-49b9-b844-dd6984ececf3 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 02:13:15.297966 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "517d9811-556f-437c-92f9-1eee887e072b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:13:15.297966 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "517d9811-556f-437c-92f9-1eee887e072b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:13:15.297966 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "517d9811-556f-437c-92f9-1eee887e072b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:13:15.297966 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:13:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1582208117',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-volumemultiattachtests-server-1582208117',id=80,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCw6mfS2UYDP9PgoI2ARsl9ucPnOUIdVENs+bIGUR2pJqKYe9J5WuC1571kjjgpZpiCNiKuxg+RnaT2NiKlIqk+HjAvm/MD3/Wxke+V2cXkupwN0eLhzgarMMyq4yLY9EA==',key_name='tempest-keypair-805647940',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b993c740f0114a22b4ec01fd0172dc89',ramdisk_id='',reservation_id='r-zot0zte8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-562724558',owner_user_name='tempest-VolumeMultiattachTests-562724558-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:13:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a89bef00d8034a63ac07ef521be03355',uuid=517d9811-556f-437c-92f9-1eee887e072b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ecc3a968-ac6b-49b9-b844-dd6984ececf3", "address": "fa:16:3e:53:84:69", "network": {"id": "3b938343-a65c-4ea6-9c96-be377e9fe646", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-19450663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b993c740f0114a22b4ec01fd0172dc89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc3a968-ac", "ovs_interfaceid": "ecc3a968-ac6b-49b9-b844-dd6984ececf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 02:13:15.297966 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Converting VIF {"id": "ecc3a968-ac6b-49b9-b844-dd6984ececf3", "address": "fa:16:3e:53:84:69", "network": {"id": "3b938343-a65c-4ea6-9c96-be377e9fe646", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-19450663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b993c740f0114a22b4ec01fd0172dc89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc3a968-ac", "ovs_interfaceid": "ecc3a968-ac6b-49b9-b844-dd6984ececf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:13:15.297966 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:84:69,bridge_name='br-int',has_traffic_filtering=True,id=ecc3a968-ac6b-49b9-b844-dd6984ececf3,network=Network(3b938343-a65c-4ea6-9c96-be377e9fe646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc3a968-ac') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:13:15.297966 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:84:69,bridge_name='br-int',has_traffic_filtering=True,id=ecc3a968-ac6b-49b9-b844-dd6984ececf3,network=Network(3b938343-a65c-4ea6-9c96-be377e9fe646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc3a968-ac') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 02:13:15.298265 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:13:15.298559 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:13:15.298823 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 02:13:15.299590 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:13:15.299783 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ce2a5a4d-0f00-5e23-8d8d-db36a7ec9d52', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:13:15.300948 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:13:15.301605 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:13:15.303466 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:13:15.303648 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapecc3a968-ac, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:13:15.303977 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapecc3a968-ac, col_values=(('qos', UUID('1c4cafe2-d024-4e6b-89ed-31a3019b60a9')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:13:15.304177 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapecc3a968-ac, col_values=(('external_ids', {'iface-id': 'ecc3a968-ac6b-49b9-b844-dd6984ececf3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:84:69', 'vm-uuid': '517d9811-556f-437c-92f9-1eee887e072b'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:13:15.305110 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:13:15.306303 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:13:15.309529 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:13:15.310398 np0000001583 nova-compute[98241]: INFO os_vif [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:84:69,bridge_name='br-int',has_traffic_filtering=True,id=ecc3a968-ac6b-49b9-b844-dd6984ececf3,network=Network(3b938343-a65c-4ea6-9c96-be377e9fe646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc3a968-ac')
May 28 02:13:16.824773 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:13:16.824773 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:13:16.824773 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] No VIF found with MAC fa:16:3e:53:84:69, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:13:16.825298 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Using config drive
May 28 02:13:17.331622 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:13:17.438729 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Creating config drive at /opt/stack/data/nova/instances/517d9811-556f-437c-92f9-1eee887e072b/disk.config
May 28 02:13:17.443108 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/517d9811-556f-437c-92f9-1eee887e072b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnowrj3wo {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:13:17.495142 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/517d9811-556f-437c-92f9-1eee887e072b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnowrj3wo" returned: 0 in 0.052s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:13:17.887882 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:13:17.906747 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:13:17.907756 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:13:18.013931 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:13:18.038590 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5c3855c6-b8bd-4937-9811-745fab618932 req-c1ff6bb8-c7fb-4500-b31a-2b25f94dd714 service nova] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Received event network-vif-plugged-ecc3a968-ac6b-49b9-b844-dd6984ececf3 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:13:18.038820 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5c3855c6-b8bd-4937-9811-745fab618932 req-c1ff6bb8-c7fb-4500-b31a-2b25f94dd714 service nova] Acquiring lock "517d9811-556f-437c-92f9-1eee887e072b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:13:18.039014 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5c3855c6-b8bd-4937-9811-745fab618932 req-c1ff6bb8-c7fb-4500-b31a-2b25f94dd714 service nova] Lock "517d9811-556f-437c-92f9-1eee887e072b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:13:18.039165 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5c3855c6-b8bd-4937-9811-745fab618932 req-c1ff6bb8-c7fb-4500-b31a-2b25f94dd714 service nova] Lock "517d9811-556f-437c-92f9-1eee887e072b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:13:18.039279 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5c3855c6-b8bd-4937-9811-745fab618932 req-c1ff6bb8-c7fb-4500-b31a-2b25f94dd714 service nova] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Processing event network-vif-plugged-ecc3a968-ac6b-49b9-b844-dd6984ececf3 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 02:13:18.050872 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:13:18.051627 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:13:18.560863 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934398.560432, 517d9811-556f-437c-92f9-1eee887e072b => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:13:18.560966 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 517d9811-556f-437c-92f9-1eee887e072b] VM Started (Lifecycle Event)
May 28 02:13:18.562733 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 02:13:18.564803 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 02:13:18.566726 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Instance spawned successfully.
May 28 02:13:18.566987 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 02:13:18.698921 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:13:19.063809 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:13:19.066098 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:13:19.073621 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:13:19.073735 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:13:19.074111 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:13:19.074324 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:13:19.074579 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:13:19.074808 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:13:19.568288 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 517d9811-556f-437c-92f9-1eee887e072b] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 02:13:19.568643 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934399.5684578, 517d9811-556f-437c-92f9-1eee887e072b => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:13:19.568769 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 517d9811-556f-437c-92f9-1eee887e072b] VM Paused (Lifecycle Event)
May 28 02:13:19.579677 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Took 6.39 seconds to spawn the instance on the hypervisor.
May 28 02:13:19.580658 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:13:20.071785 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:13:20.075001 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934400.0738857, 517d9811-556f-437c-92f9-1eee887e072b => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:13:20.075001 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 517d9811-556f-437c-92f9-1eee887e072b] VM Resumed (Lifecycle Event)
May 28 02:13:20.092291 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Took 11.60 seconds to build instance.
May 28 02:13:20.094029 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7f4aec86-05b8-47b2-8c63-0b3998a617bf req-94c8792a-8ec0-49e7-a8b9-9b0d007e158c service nova] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Received event network-vif-plugged-ecc3a968-ac6b-49b9-b844-dd6984ececf3 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:13:20.094227 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7f4aec86-05b8-47b2-8c63-0b3998a617bf req-94c8792a-8ec0-49e7-a8b9-9b0d007e158c service nova] Acquiring lock "517d9811-556f-437c-92f9-1eee887e072b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:13:20.094448 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7f4aec86-05b8-47b2-8c63-0b3998a617bf req-94c8792a-8ec0-49e7-a8b9-9b0d007e158c service nova] Lock "517d9811-556f-437c-92f9-1eee887e072b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:13:20.094501 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-7f4aec86-05b8-47b2-8c63-0b3998a617bf req-94c8792a-8ec0-49e7-a8b9-9b0d007e158c service nova] Lock "517d9811-556f-437c-92f9-1eee887e072b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:13:20.095637 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-7f4aec86-05b8-47b2-8c63-0b3998a617bf req-94c8792a-8ec0-49e7-a8b9-9b0d007e158c service nova] [instance: 517d9811-556f-437c-92f9-1eee887e072b] No waiting events found dispatching network-vif-plugged-ecc3a968-ac6b-49b9-b844-dd6984ececf3 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:13:20.096057 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-7f4aec86-05b8-47b2-8c63-0b3998a617bf req-94c8792a-8ec0-49e7-a8b9-9b0d007e158c service nova] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Received unexpected event network-vif-plugged-ecc3a968-ac6b-49b9-b844-dd6984ececf3 for instance with vm_state active and task_state None.
May 28 02:13:20.307302 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:13:20.577833 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:13:20.581393 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:13:20.597187 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "517d9811-556f-437c-92f9-1eee887e072b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.112s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:13:22.156576 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a48436ed-97c1-43fb-a326-1b74469ed362 req-7894951c-fba3-4236-8eec-5a0ae10d1571 service nova] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Received event network-changed-43226b3b-c629-47bd-b874-28fc2f7defc5 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:13:22.156971 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a48436ed-97c1-43fb-a326-1b74469ed362 req-7894951c-fba3-4236-8eec-5a0ae10d1571 service nova] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Refreshing instance network info cache due to event network-changed-43226b3b-c629-47bd-b874-28fc2f7defc5. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:13:22.156971 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a48436ed-97c1-43fb-a326-1b74469ed362 req-7894951c-fba3-4236-8eec-5a0ae10d1571 service nova] Acquiring lock "refresh_cache-769d888e-505f-49eb-b3d8-9f9e8c7f0aab" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:13:22.156971 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a48436ed-97c1-43fb-a326-1b74469ed362 req-7894951c-fba3-4236-8eec-5a0ae10d1571 service nova] Acquired lock "refresh_cache-769d888e-505f-49eb-b3d8-9f9e8c7f0aab" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:13:22.157251 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-a48436ed-97c1-43fb-a326-1b74469ed362 req-7894951c-fba3-4236-8eec-5a0ae10d1571 service nova] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Refreshing network info cache for port 43226b3b-c629-47bd-b874-28fc2f7defc5 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:13:22.659385 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-a48436ed-97c1-43fb-a326-1b74469ed362 req-7894951c-fba3-4236-8eec-5a0ae10d1571 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:13:22.980811 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-a48436ed-97c1-43fb-a326-1b74469ed362 req-7894951c-fba3-4236-8eec-5a0ae10d1571 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:13:23.117550 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-a48436ed-97c1-43fb-a326-1b74469ed362 req-7894951c-fba3-4236-8eec-5a0ae10d1571 service nova] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Updated VIF entry in instance network info cache for port 43226b3b-c629-47bd-b874-28fc2f7defc5. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:13:23.117807 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-a48436ed-97c1-43fb-a326-1b74469ed362 req-7894951c-fba3-4236-8eec-5a0ae10d1571 service nova] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Updating instance_info_cache with network_info: [{"id": "43226b3b-c629-47bd-b874-28fc2f7defc5", "address": "fa:16:3e:13:4c:d8", "network": {"id": "3b938343-a65c-4ea6-9c96-be377e9fe646", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-19450663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b993c740f0114a22b4ec01fd0172dc89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43226b3b-c6", "ovs_interfaceid": "43226b3b-c629-47bd-b874-28fc2f7defc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:13:23.619955 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a48436ed-97c1-43fb-a326-1b74469ed362 req-7894951c-fba3-4236-8eec-5a0ae10d1571 service nova] Releasing lock "refresh_cache-769d888e-505f-49eb-b3d8-9f9e8c7f0aab" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:13:23.620243 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a48436ed-97c1-43fb-a326-1b74469ed362 req-7894951c-fba3-4236-8eec-5a0ae10d1571 service nova] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Received event network-changed-ecc3a968-ac6b-49b9-b844-dd6984ececf3 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:13:23.620243 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-a48436ed-97c1-43fb-a326-1b74469ed362 req-7894951c-fba3-4236-8eec-5a0ae10d1571 service nova] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Refreshing instance network info cache due to event network-changed-ecc3a968-ac6b-49b9-b844-dd6984ececf3. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:13:23.620356 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a48436ed-97c1-43fb-a326-1b74469ed362 req-7894951c-fba3-4236-8eec-5a0ae10d1571 service nova] Acquiring lock "refresh_cache-517d9811-556f-437c-92f9-1eee887e072b" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:13:23.620448 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a48436ed-97c1-43fb-a326-1b74469ed362 req-7894951c-fba3-4236-8eec-5a0ae10d1571 service nova] Acquired lock "refresh_cache-517d9811-556f-437c-92f9-1eee887e072b" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:13:23.620565 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-a48436ed-97c1-43fb-a326-1b74469ed362 req-7894951c-fba3-4236-8eec-5a0ae10d1571 service nova] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Refreshing network info cache for port ecc3a968-ac6b-49b9-b844-dd6984ececf3 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:13:23.702340 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:13:24.122612 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-a48436ed-97c1-43fb-a326-1b74469ed362 req-7894951c-fba3-4236-8eec-5a0ae10d1571 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:13:24.194380 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:13:24.194867 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:13:24.433878 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-a48436ed-97c1-43fb-a326-1b74469ed362 req-7894951c-fba3-4236-8eec-5a0ae10d1571 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:13:24.560895 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-a48436ed-97c1-43fb-a326-1b74469ed362 req-7894951c-fba3-4236-8eec-5a0ae10d1571 service nova] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Updated VIF entry in instance network info cache for port ecc3a968-ac6b-49b9-b844-dd6984ececf3. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:13:24.561252 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-a48436ed-97c1-43fb-a326-1b74469ed362 req-7894951c-fba3-4236-8eec-5a0ae10d1571 service nova] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Updating instance_info_cache with network_info: [{"id": "ecc3a968-ac6b-49b9-b844-dd6984ececf3", "address": "fa:16:3e:53:84:69", "network": {"id": "3b938343-a65c-4ea6-9c96-be377e9fe646", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-19450663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b993c740f0114a22b4ec01fd0172dc89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc3a968-ac", "ovs_interfaceid": "ecc3a968-ac6b-49b9-b844-dd6984ececf3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:13:25.063432 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-a48436ed-97c1-43fb-a326-1b74469ed362 req-7894951c-fba3-4236-8eec-5a0ae10d1571 service nova] Releasing lock "refresh_cache-517d9811-556f-437c-92f9-1eee887e072b" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:13:25.328143 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:13:26.193844 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:13:26.194346 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:13:27.193258 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:13:27.193491 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:13:28.704333 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:13:30.193348 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:13:30.329211 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:13:30.698554 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:13:30.698554 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:13:30.698554 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:13:30.698554 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Auditing locally available compute resources for np0000001583 (node: np0000001583) {{(pid=98241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 02:13:31.719945 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/517d9811-556f-437c-92f9-1eee887e072b/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:13:31.813524 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/517d9811-556f-437c-92f9-1eee887e072b/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:13:31.813978 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/517d9811-556f-437c-92f9-1eee887e072b/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:13:31.899660 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/517d9811-556f-437c-92f9-1eee887e072b/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:13:31.904637 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769d888e-505f-49eb-b3d8-9f9e8c7f0aab/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:13:31.989813 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769d888e-505f-49eb-b3d8-9f9e8c7f0aab/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:13:31.990279 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769d888e-505f-49eb-b3d8-9f9e8c7f0aab/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:13:32.077273 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769d888e-505f-49eb-b3d8-9f9e8c7f0aab/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:13:32.077899 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 02:13:32.078156 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-3 (vdc) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 02:13:32.078368 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] skipping disk /dev/dm-0 (vdd) as it is a volume {{(pid=98241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 02:13:32.084378 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:13:32.086046 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:13:32.141850 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.055s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:13:32.142552 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Hypervisor/Node resource view: name=np0000001583 free_ram=12790MB free_disk=72.59490966796875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 02:13:32.142847 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:13:32.143244 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:13:33.197873 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 769d888e-505f-49eb-b3d8-9f9e8c7f0aab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:13:33.198277 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 517d9811-556f-437c-92f9-1eee887e072b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:13:33.198402 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 02:13:33.198544 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Final resource view: name=np0000001583 phys_ram=24030MB used_ram=896MB phys_disk=95GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:13:32 up 49 min,  2 users,  load average: 2.80, 4.29, 4.56\n', 'num_instances': '2', 'num_vm_active': '2', 'num_task_None': '2', 'num_os_type_None': '2', 'num_proj_b993c740f0114a22b4ec01fd0172dc89': '2', 'io_workload': '0'} {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 02:13:33.328290 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:13:33.328512 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:13:33.706149 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:13:33.831188 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:13:34.338478 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Compute_service record updated for np0000001583:np0000001583 {{(pid=98241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 02:13:34.339132 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:13:34.339277 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.196s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:13:34.339612 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:13:35.335332 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:13:35.335672 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:13:35.335882 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:13:35.336126 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:13:35.336300 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 02:13:35.336438 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.85 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:13:35.344482 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:13:38.705327 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:13:40.189746 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:13:40.190175 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 46.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:13:40.347298 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:13:43.706509 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:13:45.349164 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:13:48.059587 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "517d9811-556f-437c-92f9-1eee887e072b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:13:48.059949 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "517d9811-556f-437c-92f9-1eee887e072b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:13:48.563491 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lazy-loading 'flavor' on Instance uuid 517d9811-556f-437c-92f9-1eee887e072b {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:13:48.708142 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:13:49.568161 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "517d9811-556f-437c-92f9-1eee887e072b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:13:50.351516 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:13:50.624545 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "517d9811-556f-437c-92f9-1eee887e072b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:13:50.624980 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "517d9811-556f-437c-92f9-1eee887e072b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:13:50.624980 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Attaching volume 3a99d18a-ba56-4405-a9cf-1b4578a54376 to /dev/vdb
May 28 02:13:50.660754 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:13:50.670688 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 02:13:50.688160 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:13:50.732667 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 02:13:50.732954 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 02:13:50.741338 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 02:13:50.742344 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fe13:4cd8', 'fe80::d05c:d0ff:fe98:b4ef', 'fe80::fc16:3eff:fe53:8469'] 
May 28 02:13:50.742501 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 02:13:50.742603 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 02:13:50.742845 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] <== get_connector_properties: return (82ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:13:50.743126 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Updating existing volume attachment record: ad3e2217-9954-4f8c-9961-a6a541cc62f4 {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 02:13:51.289320 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 02:13:51.289674 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376', 'iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3a99d18a-ba56-4405-a9cf-1b4578a54376', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:13:51.289810 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:13:52.743551 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.454s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:13:52.743971 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376', 'iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3a99d18a-ba56-4405-a9cf-1b4578a54376', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 02:13:52.755405 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:13:52.756070 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:13:52.756592 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:13:52.756784 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:13:52.757211 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:13:52.757399 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: node.startup = automatic
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: node.session.scan = manual
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:13:52.768483 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:13:52.768483 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: node.startup = automatic
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: node.session.scan = manual
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:13:52.773684 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:13:52.773684 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:13:52.779598 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:13:52.785788 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:13:52.794505 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:13:52.794505 np0000001583 nova-compute[98241]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:13:52.794505 np0000001583 nova-compute[98241]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b (non-flash)
May 28 02:13:52.794505 np0000001583 nova-compute[98241]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b (non-flash)
May 28 02:13:52.794505 np0000001583 nova-compute[98241]: tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376 (non-flash)
May 28 02:13:52.794505 np0000001583 nova-compute[98241]: tcp: [221] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376 (non-flash)
May 28 02:13:52.794505 np0000001583 nova-compute[98241]: tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d48540c-cc56-4482-8cf8-af1db9096ce2 (non-flash)
May 28 02:13:52.794505 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:13:52.794749 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsi session list stdout=tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:13:52.794749 np0000001583 nova-compute[98241]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:13:52.794749 np0000001583 nova-compute[98241]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b (non-flash)
May 28 02:13:52.794749 np0000001583 nova-compute[98241]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b (non-flash)
May 28 02:13:52.794749 np0000001583 nova-compute[98241]: tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376 (non-flash)
May 28 02:13:52.794749 np0000001583 nova-compute[98241]: tcp: [221] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376 (non-flash)
May 28 02:13:52.794749 np0000001583 nova-compute[98241]: tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d48540c-cc56-4482-8cf8-af1db9096ce2 (non-flash)
May 28 02:13:52.794749 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:13:52.794985 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.038s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:13:52.795109 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:13:52.795694 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] HCTL ('8', '0', '0', 0) found on session 221 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:13:52.795901 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Scanning host 8 c: 0, t: 0, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:13:52.802100 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:13:52.802100 np0000001583 nova-compute[98241]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:13:52.802100 np0000001583 nova-compute[98241]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b (non-flash)
May 28 02:13:52.802100 np0000001583 nova-compute[98241]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b (non-flash)
May 28 02:13:52.802100 np0000001583 nova-compute[98241]: tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376 (non-flash)
May 28 02:13:52.802100 np0000001583 nova-compute[98241]: tcp: [221] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376 (non-flash)
May 28 02:13:52.802100 np0000001583 nova-compute[98241]: tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d48540c-cc56-4482-8cf8-af1db9096ce2 (non-flash)
May 28 02:13:52.802100 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:13:52.802100 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsi session list stdout=tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:13:52.802100 np0000001583 nova-compute[98241]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:13:52.802100 np0000001583 nova-compute[98241]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b (non-flash)
May 28 02:13:52.802100 np0000001583 nova-compute[98241]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b (non-flash)
May 28 02:13:52.802100 np0000001583 nova-compute[98241]: tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376 (non-flash)
May 28 02:13:52.802100 np0000001583 nova-compute[98241]: tcp: [221] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376 (non-flash)
May 28 02:13:52.802100 np0000001583 nova-compute[98241]: tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d48540c-cc56-4482-8cf8-af1db9096ce2 (non-flash)
May 28 02:13:52.802100 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:13:52.802100 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.046s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:13:52.802581 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:13:52.802765 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] HCTL ('7', '0', '0', 0) found on session 220 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:13:52.802863 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Scanning host 7 c: 0, t: 0, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:13:52.807766 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Searching for a device in session 221 and hctl ('8', '0', '0', 0) yield: sdc {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:13:52.807905 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3a99d18a-ba56-4405-a9cf-1b4578a54376', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:13:52.811711 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Searching for a device in session 220 and hctl ('7', '0', '0', 0) yield: sdb {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:13:52.811855 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3a99d18a-ba56-4405-a9cf-1b4578a54376', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:13:53.757156 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 02:13:54.791435 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Found WWN 33000000001c82a55 for multipath device dm-0 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 02:13:54.791858 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.048s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:13:54.791858 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] <== connect_volume: return (3502ms) {'type': 'block', 'scsi_wwn': '33000000001c82a55', 'path': '/dev/dm-0', 'multipath_id': '33000000001c82a55'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:13:54.791939 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000001c82a55', 'path': '/dev/dm-0', 'multipath_id': '33000000001c82a55'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 02:13:54.794708 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lazy-loading 'flavor' on Instance uuid 517d9811-556f-437c-92f9-1eee887e072b {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:13:55.298512 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Attempting to attach volume 3a99d18a-ba56-4405-a9cf-1b4578a54376 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98241) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 02:13:55.300108 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] attach device xml: <disk type="block" device="disk">
May 28 02:13:55.300108 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:13:55.300108 np0000001583 nova-compute[98241]:   <alias name="ua-3a99d18a-ba56-4405-a9cf-1b4578a54376"/>
May 28 02:13:55.300108 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-0"/>
May 28 02:13:55.300108 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:13:55.300108 np0000001583 nova-compute[98241]:   <serial>3a99d18a-ba56-4405-a9cf-1b4578a54376</serial>
May 28 02:13:55.300108 np0000001583 nova-compute[98241]:   <shareable/>
May 28 02:13:55.300108 np0000001583 nova-compute[98241]: </disk>
May 28 02:13:55.300108 np0000001583 nova-compute[98241]:  {{(pid=98241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 02:13:55.356466 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:13:55.365678 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:13:55.365678 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:13:55.365678 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:13:55.366062 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:13:55.366303 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:13:56.952514 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:13:56.952884 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:13:56.952884 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:13:56.952884 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] No VIF found with MAC fa:16:3e:53:84:69, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:13:58.497308 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0c8ca706-226e-4ecd-b399-bd485fb85293 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "517d9811-556f-437c-92f9-1eee887e072b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.872s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:14:00.377838 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:14:00.377838 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:14:00.377838 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:14:00.377838 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:14:00.378315 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:00.378341 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:14:00.743922 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ca1ffa48-2cab-4799-a72d-90e0f7811577 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "517d9811-556f-437c-92f9-1eee887e072b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:14:00.744049 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ca1ffa48-2cab-4799-a72d-90e0f7811577 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "517d9811-556f-437c-92f9-1eee887e072b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:14:01.247684 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-ca1ffa48-2cab-4799-a72d-90e0f7811577 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Detaching volume 3a99d18a-ba56-4405-a9cf-1b4578a54376
May 28 02:14:01.287765 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-ca1ffa48-2cab-4799-a72d-90e0f7811577 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Attempting to driver detach volume 3a99d18a-ba56-4405-a9cf-1b4578a54376 from mountpoint /dev/vdb
May 28 02:14:01.291956 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ca1ffa48-2cab-4799-a72d-90e0f7811577 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Found disk vdb by alias ua-3a99d18a-ba56-4405-a9cf-1b4578a54376 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:14:01.293062 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ca1ffa48-2cab-4799-a72d-90e0f7811577 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Found disk vdb by alias ua-3a99d18a-ba56-4405-a9cf-1b4578a54376 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:14:01.293214 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ca1ffa48-2cab-4799-a72d-90e0f7811577 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Attempting to detach device vdb from instance 517d9811-556f-437c-92f9-1eee887e072b from the persistent domain config. {{(pid=98241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 02:14:01.293438 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-ca1ffa48-2cab-4799-a72d-90e0f7811577 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:14:01.293438 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:14:01.293438 np0000001583 nova-compute[98241]:   <alias name="ua-3a99d18a-ba56-4405-a9cf-1b4578a54376"/>
May 28 02:14:01.293438 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-0"/>
May 28 02:14:01.293438 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:14:01.293438 np0000001583 nova-compute[98241]:   <serial>3a99d18a-ba56-4405-a9cf-1b4578a54376</serial>
May 28 02:14:01.293438 np0000001583 nova-compute[98241]:   <shareable/>
May 28 02:14:01.293438 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 02:14:01.293438 np0000001583 nova-compute[98241]: </disk>
May 28 02:14:01.293438 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:14:01.299158 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-ca1ffa48-2cab-4799-a72d-90e0f7811577 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Successfully detached device vdb from instance 517d9811-556f-437c-92f9-1eee887e072b from the persistent domain config.
May 28 02:14:01.299279 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ca1ffa48-2cab-4799-a72d-90e0f7811577 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] (1/8): Attempting to detach device vdb with device alias ua-3a99d18a-ba56-4405-a9cf-1b4578a54376 from instance 517d9811-556f-437c-92f9-1eee887e072b from the live domain config. {{(pid=98241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 02:14:01.299501 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-ca1ffa48-2cab-4799-a72d-90e0f7811577 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:14:01.299501 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:14:01.299501 np0000001583 nova-compute[98241]:   <alias name="ua-3a99d18a-ba56-4405-a9cf-1b4578a54376"/>
May 28 02:14:01.299501 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-0"/>
May 28 02:14:01.299501 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:14:01.299501 np0000001583 nova-compute[98241]:   <serial>3a99d18a-ba56-4405-a9cf-1b4578a54376</serial>
May 28 02:14:01.299501 np0000001583 nova-compute[98241]:   <shareable/>
May 28 02:14:01.299501 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 02:14:01.299501 np0000001583 nova-compute[98241]: </disk>
May 28 02:14:01.299501 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:14:01.748961 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Received event <DeviceRemovedEvent: 1779934441.748255, 517d9811-556f-437c-92f9-1eee887e072b => ua-3a99d18a-ba56-4405-a9cf-1b4578a54376> from libvirt while the driver is waiting for it; dispatched. {{(pid=98241) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 02:14:01.749536 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ca1ffa48-2cab-4799-a72d-90e0f7811577 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-3a99d18a-ba56-4405-a9cf-1b4578a54376 for instance 517d9811-556f-437c-92f9-1eee887e072b {{(pid=98241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 02:14:01.751434 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-ca1ffa48-2cab-4799-a72d-90e0f7811577 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Successfully detached device vdb from instance 517d9811-556f-437c-92f9-1eee887e072b from the live domain config.
May 28 02:14:02.280334 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-ca1ffa48-2cab-4799-a72d-90e0f7811577 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Detected multiple connections on this host for volume: 3a99d18a-ba56-4405-a9cf-1b4578a54376, skipping target disconnect.
May 28 02:14:02.825341 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-ca1ffa48-2cab-4799-a72d-90e0f7811577 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lazy-loading 'flavor' on Instance uuid 517d9811-556f-437c-92f9-1eee887e072b {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:14:03.711153 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:03.830530 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ca1ffa48-2cab-4799-a72d-90e0f7811577 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "517d9811-556f-437c-92f9-1eee887e072b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.086s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:14:03.931338 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0cea19a5-9a7e-4f7d-85e4-b436e119afc7 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "517d9811-556f-437c-92f9-1eee887e072b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:14:03.931645 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0cea19a5-9a7e-4f7d-85e4-b436e119afc7 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "517d9811-556f-437c-92f9-1eee887e072b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:14:03.931973 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0cea19a5-9a7e-4f7d-85e4-b436e119afc7 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "517d9811-556f-437c-92f9-1eee887e072b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:14:03.932288 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0cea19a5-9a7e-4f7d-85e4-b436e119afc7 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "517d9811-556f-437c-92f9-1eee887e072b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:14:03.932467 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0cea19a5-9a7e-4f7d-85e4-b436e119afc7 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "517d9811-556f-437c-92f9-1eee887e072b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:14:03.937001 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-0cea19a5-9a7e-4f7d-85e4-b436e119afc7 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Terminating instance
May 28 02:14:04.448961 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-0cea19a5-9a7e-4f7d-85e4-b436e119afc7 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 02:14:04.466613 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:04.490641 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:04.614826 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e3740aab-50a2-440c-b0ed-d8e4fce8190e req-7fa96400-745e-4b53-828f-18040dc1e9c3 service nova] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Received event network-vif-unplugged-ecc3a968-ac6b-49b9-b844-dd6984ececf3 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:14:04.614826 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e3740aab-50a2-440c-b0ed-d8e4fce8190e req-7fa96400-745e-4b53-828f-18040dc1e9c3 service nova] Acquiring lock "517d9811-556f-437c-92f9-1eee887e072b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:14:04.614980 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e3740aab-50a2-440c-b0ed-d8e4fce8190e req-7fa96400-745e-4b53-828f-18040dc1e9c3 service nova] Lock "517d9811-556f-437c-92f9-1eee887e072b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:14:04.615175 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e3740aab-50a2-440c-b0ed-d8e4fce8190e req-7fa96400-745e-4b53-828f-18040dc1e9c3 service nova] Lock "517d9811-556f-437c-92f9-1eee887e072b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:14:04.615506 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e3740aab-50a2-440c-b0ed-d8e4fce8190e req-7fa96400-745e-4b53-828f-18040dc1e9c3 service nova] [instance: 517d9811-556f-437c-92f9-1eee887e072b] No waiting events found dispatching network-vif-unplugged-ecc3a968-ac6b-49b9-b844-dd6984ececf3 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:14:04.615506 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e3740aab-50a2-440c-b0ed-d8e4fce8190e req-7fa96400-745e-4b53-828f-18040dc1e9c3 service nova] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Received event network-vif-unplugged-ecc3a968-ac6b-49b9-b844-dd6984ececf3 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:14:04.650565 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:04.657659 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:04.683414 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:04.741272 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:04.746905 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:04.771052 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999714437999955 future=<Future at 0x7724f8281100 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:14:04.771414 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999304592000044 future=<Future at 0x7724f8281100 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:14:04.771580 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.99913145399978 future=<Future at 0x7724f8281100 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:14:04.772801 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Instance destroyed successfully.
May 28 02:14:04.773192 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-0cea19a5-9a7e-4f7d-85e4-b436e119afc7 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lazy-loading 'resources' on Instance uuid 517d9811-556f-437c-92f9-1eee887e072b {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:14:05.275379 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-0cea19a5-9a7e-4f7d-85e4-b436e119afc7 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T02:13:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1582208117',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-volumemultiattachtests-server-1582208117',id=80,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCw6mfS2UYDP9PgoI2ARsl9ucPnOUIdVENs+bIGUR2pJqKYe9J5WuC1571kjjgpZpiCNiKuxg+RnaT2NiKlIqk+HjAvm/MD3/Wxke+V2cXkupwN0eLhzgarMMyq4yLY9EA==',key_name='tempest-keypair-805647940',keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:13:19Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b993c740f0114a22b4ec01fd0172dc89',ramdisk_id='',reservation_id='r-zot0zte8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumeMultiattachTests-562724558',owner_user_name='tempest-VolumeMultiattachTests-562724558-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T02:13:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a89bef00d8034a63ac07ef521be03355',uuid=517d9811-556f-437c-92f9-1eee887e072b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ecc3a968-ac6b-49b9-b844-dd6984ececf3", "address": "fa:16:3e:53:84:69", "network": {"id": "3b938343-a65c-4ea6-9c96-be377e9fe646", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-19450663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b993c740f0114a22b4ec01fd0172dc89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc3a968-ac", "ovs_interfaceid": "ecc3a968-ac6b-49b9-b844-dd6984ececf3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:14:05.275851 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-0cea19a5-9a7e-4f7d-85e4-b436e119afc7 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Converting VIF {"id": "ecc3a968-ac6b-49b9-b844-dd6984ececf3", "address": "fa:16:3e:53:84:69", "network": {"id": "3b938343-a65c-4ea6-9c96-be377e9fe646", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-19450663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b993c740f0114a22b4ec01fd0172dc89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc3a968-ac", "ovs_interfaceid": "ecc3a968-ac6b-49b9-b844-dd6984ececf3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:14:05.276137 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-0cea19a5-9a7e-4f7d-85e4-b436e119afc7 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:84:69,bridge_name='br-int',has_traffic_filtering=True,id=ecc3a968-ac6b-49b9-b844-dd6984ececf3,network=Network(3b938343-a65c-4ea6-9c96-be377e9fe646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc3a968-ac') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:14:05.276350 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-0cea19a5-9a7e-4f7d-85e4-b436e119afc7 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:84:69,bridge_name='br-int',has_traffic_filtering=True,id=ecc3a968-ac6b-49b9-b844-dd6984ececf3,network=Network(3b938343-a65c-4ea6-9c96-be377e9fe646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc3a968-ac') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:14:05.277433 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:05.277634 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapecc3a968-ac, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:14:05.295057 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:05.296559 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:14:05.297028 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:05.297186 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1c4cafe2-d024-4e6b-89ed-31a3019b60a9) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:14:05.298541 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:14:05.299878 np0000001583 nova-compute[98241]: INFO os_vif [None req-0cea19a5-9a7e-4f7d-85e4-b436e119afc7 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:84:69,bridge_name='br-int',has_traffic_filtering=True,id=ecc3a968-ac6b-49b9-b844-dd6984ececf3,network=Network(3b938343-a65c-4ea6-9c96-be377e9fe646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc3a968-ac')
May 28 02:14:05.300150 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-0cea19a5-9a7e-4f7d-85e4-b436e119afc7 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Deleting instance files /opt/stack/data/nova/instances/517d9811-556f-437c-92f9-1eee887e072b_del
May 28 02:14:05.300946 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-0cea19a5-9a7e-4f7d-85e4-b436e119afc7 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Deletion of /opt/stack/data/nova/instances/517d9811-556f-437c-92f9-1eee887e072b_del complete
May 28 02:14:05.809754 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-0cea19a5-9a7e-4f7d-85e4-b436e119afc7 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Took 1.36 seconds to destroy the instance on the hypervisor.
May 28 02:14:05.810363 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-0cea19a5-9a7e-4f7d-85e4-b436e119afc7 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 02:14:05.810534 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 02:14:05.810633 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 517d9811-556f-437c-92f9-1eee887e072b] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 02:14:05.810871 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:14:05.915584 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:14:06.298463 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-98def633-25dc-44f8-955a-9321b5e543fb req-996345ef-de7b-42ef-ba26-5533e4878d78 service nova] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Received event network-vif-deleted-ecc3a968-ac6b-49b9-b844-dd6984ececf3 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:14:06.298806 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-98def633-25dc-44f8-955a-9321b5e543fb req-996345ef-de7b-42ef-ba26-5533e4878d78 service nova] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Neutron deleted interface ecc3a968-ac6b-49b9-b844-dd6984ececf3; detaching it from the instance and deleting it from the info cache
May 28 02:14:06.300261 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-98def633-25dc-44f8-955a-9321b5e543fb req-996345ef-de7b-42ef-ba26-5533e4878d78 service nova] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Detach interface failed, port_id=ecc3a968-ac6b-49b9-b844-dd6984ececf3, reason: Instance 517d9811-556f-437c-92f9-1eee887e072b could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 02:14:06.671224 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-aacb83b1-db35-40af-b701-3542798b518e req-8bf8c2a4-36cf-4464-b371-3022e0184986 service nova] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Received event network-vif-unplugged-ecc3a968-ac6b-49b9-b844-dd6984ececf3 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:14:06.671776 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-aacb83b1-db35-40af-b701-3542798b518e req-8bf8c2a4-36cf-4464-b371-3022e0184986 service nova] Acquiring lock "517d9811-556f-437c-92f9-1eee887e072b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:14:06.671966 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-aacb83b1-db35-40af-b701-3542798b518e req-8bf8c2a4-36cf-4464-b371-3022e0184986 service nova] Lock "517d9811-556f-437c-92f9-1eee887e072b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:14:06.672088 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-aacb83b1-db35-40af-b701-3542798b518e req-8bf8c2a4-36cf-4464-b371-3022e0184986 service nova] Lock "517d9811-556f-437c-92f9-1eee887e072b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:14:06.672226 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-aacb83b1-db35-40af-b701-3542798b518e req-8bf8c2a4-36cf-4464-b371-3022e0184986 service nova] [instance: 517d9811-556f-437c-92f9-1eee887e072b] No waiting events found dispatching network-vif-unplugged-ecc3a968-ac6b-49b9-b844-dd6984ececf3 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:14:06.672325 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-aacb83b1-db35-40af-b701-3542798b518e req-8bf8c2a4-36cf-4464-b371-3022e0184986 service nova] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Received event network-vif-unplugged-ecc3a968-ac6b-49b9-b844-dd6984ececf3 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:14:06.761119 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:14:07.263106 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Took 1.45 seconds to deallocate network for instance.
May 28 02:14:07.774289 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0cea19a5-9a7e-4f7d-85e4-b436e119afc7 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:14:07.774739 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0cea19a5-9a7e-4f7d-85e4-b436e119afc7 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:14:07.892056 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-0cea19a5-9a7e-4f7d-85e4-b436e119afc7 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:14:07.892318 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-0cea19a5-9a7e-4f7d-85e4-b436e119afc7 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:14:08.394734 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-0cea19a5-9a7e-4f7d-85e4-b436e119afc7 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:14:08.901564 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0cea19a5-9a7e-4f7d-85e4-b436e119afc7 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.127s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:14:08.942968 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-0cea19a5-9a7e-4f7d-85e4-b436e119afc7 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Deleted allocations for instance 517d9811-556f-437c-92f9-1eee887e072b
May 28 02:14:09.952189 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-0cea19a5-9a7e-4f7d-85e4-b436e119afc7 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "517d9811-556f-437c-92f9-1eee887e072b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.021s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:14:10.298909 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:11.010780 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-51593096-88bb-4f86-a137-3fb833017cdf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "769d888e-505f-49eb-b3d8-9f9e8c7f0aab" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:14:11.011250 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-51593096-88bb-4f86-a137-3fb833017cdf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "769d888e-505f-49eb-b3d8-9f9e8c7f0aab" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:14:11.513856 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-51593096-88bb-4f86-a137-3fb833017cdf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Detaching volume 3a99d18a-ba56-4405-a9cf-1b4578a54376
May 28 02:14:11.547257 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-51593096-88bb-4f86-a137-3fb833017cdf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Attempting to driver detach volume 3a99d18a-ba56-4405-a9cf-1b4578a54376 from mountpoint /dev/vdd
May 28 02:14:11.551747 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-51593096-88bb-4f86-a137-3fb833017cdf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Found disk vdd by alias ua-3a99d18a-ba56-4405-a9cf-1b4578a54376 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:14:11.552992 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-51593096-88bb-4f86-a137-3fb833017cdf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Found disk vdd by alias ua-3a99d18a-ba56-4405-a9cf-1b4578a54376 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:14:11.553166 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-51593096-88bb-4f86-a137-3fb833017cdf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Attempting to detach device vdd from instance 769d888e-505f-49eb-b3d8-9f9e8c7f0aab from the persistent domain config. {{(pid=98241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 02:14:11.553415 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-51593096-88bb-4f86-a137-3fb833017cdf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:14:11.553415 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:14:11.553415 np0000001583 nova-compute[98241]:   <alias name="ua-3a99d18a-ba56-4405-a9cf-1b4578a54376"/>
May 28 02:14:11.553415 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-0"/>
May 28 02:14:11.553415 np0000001583 nova-compute[98241]:   <target dev="vdd" bus="virtio"/>
May 28 02:14:11.553415 np0000001583 nova-compute[98241]:   <serial>3a99d18a-ba56-4405-a9cf-1b4578a54376</serial>
May 28 02:14:11.553415 np0000001583 nova-compute[98241]:   <shareable/>
May 28 02:14:11.553415 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x09" function="0x0"/>
May 28 02:14:11.553415 np0000001583 nova-compute[98241]: </disk>
May 28 02:14:11.553415 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:14:11.561175 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-51593096-88bb-4f86-a137-3fb833017cdf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Successfully detached device vdd from instance 769d888e-505f-49eb-b3d8-9f9e8c7f0aab from the persistent domain config.
May 28 02:14:11.561324 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-51593096-88bb-4f86-a137-3fb833017cdf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] (1/8): Attempting to detach device vdd with device alias ua-3a99d18a-ba56-4405-a9cf-1b4578a54376 from instance 769d888e-505f-49eb-b3d8-9f9e8c7f0aab from the live domain config. {{(pid=98241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 02:14:11.561575 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-51593096-88bb-4f86-a137-3fb833017cdf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:14:11.561575 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:14:11.561575 np0000001583 nova-compute[98241]:   <alias name="ua-3a99d18a-ba56-4405-a9cf-1b4578a54376"/>
May 28 02:14:11.561575 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-0"/>
May 28 02:14:11.561575 np0000001583 nova-compute[98241]:   <target dev="vdd" bus="virtio"/>
May 28 02:14:11.561575 np0000001583 nova-compute[98241]:   <serial>3a99d18a-ba56-4405-a9cf-1b4578a54376</serial>
May 28 02:14:11.561575 np0000001583 nova-compute[98241]:   <shareable/>
May 28 02:14:11.561575 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x09" function="0x0"/>
May 28 02:14:11.561575 np0000001583 nova-compute[98241]: </disk>
May 28 02:14:11.561575 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:14:12.003580 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Received event <DeviceRemovedEvent: 1779934452.0032086, 769d888e-505f-49eb-b3d8-9f9e8c7f0aab => ua-3a99d18a-ba56-4405-a9cf-1b4578a54376> from libvirt while the driver is waiting for it; dispatched. {{(pid=98241) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 02:14:12.004651 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-51593096-88bb-4f86-a137-3fb833017cdf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Start waiting for the detach event from libvirt for device vdd with device alias ua-3a99d18a-ba56-4405-a9cf-1b4578a54376 for instance 769d888e-505f-49eb-b3d8-9f9e8c7f0aab {{(pid=98241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 02:14:12.007182 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-51593096-88bb-4f86-a137-3fb833017cdf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Successfully detached device vdd from instance 769d888e-505f-49eb-b3d8-9f9e8c7f0aab from the live domain config.
May 28 02:14:12.033262 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51593096-88bb-4f86-a137-3fb833017cdf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:14:12.033623 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-51593096-88bb-4f86-a137-3fb833017cdf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376', 'iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3a99d18a-ba56-4405-a9cf-1b4578a54376', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:14:12.033759 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-51593096-88bb-4f86-a137-3fb833017cdf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:14:12.034059 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-51593096-88bb-4f86-a137-3fb833017cdf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:14:12.034369 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-51593096-88bb-4f86-a137-3fb833017cdf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376', 'iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3a99d18a-ba56-4405-a9cf-1b4578a54376', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:14:12.034486 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-51593096-88bb-4f86-a137-3fb833017cdf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:14:12.059499 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-51593096-88bb-4f86-a137-3fb833017cdf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:14:12.059499 np0000001583 nova-compute[98241]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:14:12.059499 np0000001583 nova-compute[98241]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b (non-flash)
May 28 02:14:12.059499 np0000001583 nova-compute[98241]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b (non-flash)
May 28 02:14:12.059499 np0000001583 nova-compute[98241]: tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376 (non-flash)
May 28 02:14:12.059499 np0000001583 nova-compute[98241]: tcp: [221] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376 (non-flash)
May 28 02:14:12.059499 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:14:12.059692 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-51593096-88bb-4f86-a137-3fb833017cdf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsi session list stdout=tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:14:12.059692 np0000001583 nova-compute[98241]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:14:12.059692 np0000001583 nova-compute[98241]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b (non-flash)
May 28 02:14:12.059692 np0000001583 nova-compute[98241]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b (non-flash)
May 28 02:14:12.059692 np0000001583 nova-compute[98241]: tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376 (non-flash)
May 28 02:14:12.059692 np0000001583 nova-compute[98241]: tcp: [221] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376 (non-flash)
May 28 02:14:12.059692 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:14:12.059879 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-51593096-88bb-4f86-a137-3fb833017cdf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96', '214'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96', '215'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b', '218'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b', '219'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376', '220'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376', '221')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:14:12.059930 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-51593096-88bb-4f86-a137-3fb833017cdf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376', '220')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:14:12.060707 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-51593096-88bb-4f86-a137-3fb833017cdf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376', '221')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:14:12.061441 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-51593096-88bb-4f86-a137-3fb833017cdf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724ec1af7e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376'): ({'sdc'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:14:12.061646 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-51593096-88bb-4f86-a137-3fb833017cdf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Removing multipathed devices sdc, sdb {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:14:12.061867 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-51593096-88bb-4f86-a137-3fb833017cdf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Flush multipath device 33000000001c82a55 {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:14:12.096277 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-51593096-88bb-4f86-a137-3fb833017cdf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:14:12.134355 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-51593096-88bb-4f86-a137-3fb833017cdf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:14:12.179299 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-51593096-88bb-4f86-a137-3fb833017cdf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:14:12.179463 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-51593096-88bb-4f86-a137-3fb833017cdf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:14:12.180306 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-51593096-88bb-4f86-a137-3fb833017cdf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:14:12.191375 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-51593096-88bb-4f86-a137-3fb833017cdf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:14:12.191547 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-51593096-88bb-4f86-a137-3fb833017cdf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:14:12.202047 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-51593096-88bb-4f86-a137-3fb833017cdf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:14:12.230791 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-51593096-88bb-4f86-a137-3fb833017cdf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 220, target: iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376, portal: 192.168.40.100,3260]
May 28 02:14:12.230791 np0000001583 nova-compute[98241]: Logout of [sid: 220, target: iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376, portal: 192.168.40.100,3260] successful.
May 28 02:14:12.230791 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:14:12.245194 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-51593096-88bb-4f86-a137-3fb833017cdf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:14:12.255715 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-51593096-88bb-4f86-a137-3fb833017cdf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:14:12.284734 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-51593096-88bb-4f86-a137-3fb833017cdf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 221, target: iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376, portal: 192.168.50.100,3260]
May 28 02:14:12.284734 np0000001583 nova-compute[98241]: Logout of [sid: 221, target: iqn.2023-03.storpool.com:os--volume-3a99d18a-ba56-4405-a9cf-1b4578a54376, portal: 192.168.50.100,3260] successful.
May 28 02:14:12.284734 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:14:12.296993 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-51593096-88bb-4f86-a137-3fb833017cdf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:14:12.297213 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-51593096-88bb-4f86-a137-3fb833017cdf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.263s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:14:12.297323 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-51593096-88bb-4f86-a137-3fb833017cdf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] <== disconnect_volume: return (263ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:14:12.297430 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51593096-88bb-4f86-a137-3fb833017cdf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:14:12.838652 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-51593096-88bb-4f86-a137-3fb833017cdf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lazy-loading 'flavor' on Instance uuid 769d888e-505f-49eb-b3d8-9f9e8c7f0aab {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:14:13.843354 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-51593096-88bb-4f86-a137-3fb833017cdf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "769d888e-505f-49eb-b3d8-9f9e8c7f0aab" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.832s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:14:14.272486 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e9a8a602-150e-4005-a39e-0a7ea83ec5bf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "769d888e-505f-49eb-b3d8-9f9e8c7f0aab" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:14:14.272728 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e9a8a602-150e-4005-a39e-0a7ea83ec5bf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "769d888e-505f-49eb-b3d8-9f9e8c7f0aab" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:14:14.774919 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-e9a8a602-150e-4005-a39e-0a7ea83ec5bf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Detaching volume b3ce7f47-21bb-4a00-a346-fa17d1b1d84b
May 28 02:14:14.810313 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-e9a8a602-150e-4005-a39e-0a7ea83ec5bf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Attempting to driver detach volume b3ce7f47-21bb-4a00-a346-fa17d1b1d84b from mountpoint /dev/vdc
May 28 02:14:14.835513 np0000001583 nova-compute[98241]: DEBUG os_brick.encryptors [None req-e9a8a602-150e-4005-a39e-0a7ea83ec5bf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b', 'iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b3ce7f47-21bb-4a00-a346-fa17d1b1d84b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-3'}, 'status': 'reserved', 'instance': '769d888e-505f-49eb-b3d8-9f9e8c7f0aab', 'attached_at': '', 'detached_at': '', 'volume_id': 'b3ce7f47-21bb-4a00-a346-fa17d1b1d84b', 'serial': 'b3ce7f47-21bb-4a00-a346-fa17d1b1d84b'} {{(pid=98241) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 02:14:14.838777 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e9a8a602-150e-4005-a39e-0a7ea83ec5bf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Found disk vdc by alias ua-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:14:14.839903 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e9a8a602-150e-4005-a39e-0a7ea83ec5bf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Found disk vdc by alias ua-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:14:14.840042 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e9a8a602-150e-4005-a39e-0a7ea83ec5bf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Attempting to detach device vdc from instance 769d888e-505f-49eb-b3d8-9f9e8c7f0aab from the persistent domain config. {{(pid=98241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 02:14:14.840303 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-e9a8a602-150e-4005-a39e-0a7ea83ec5bf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:14:14.840303 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:14:14.840303 np0000001583 nova-compute[98241]:   <alias name="ua-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b"/>
May 28 02:14:14.840303 np0000001583 nova-compute[98241]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-3"/>
May 28 02:14:14.840303 np0000001583 nova-compute[98241]:   <target dev="vdc" bus="virtio"/>
May 28 02:14:14.840303 np0000001583 nova-compute[98241]:   <serial>b3ce7f47-21bb-4a00-a346-fa17d1b1d84b</serial>
May 28 02:14:14.840303 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 28 02:14:14.840303 np0000001583 nova-compute[98241]:   <encryption format="luks">
May 28 02:14:14.840303 np0000001583 nova-compute[98241]:     <secret type="passphrase" uuid="ee35f557-d9e2-42d4-8cb3-f0e1e0be3f9d"/>
May 28 02:14:14.840303 np0000001583 nova-compute[98241]:   </encryption>
May 28 02:14:14.840303 np0000001583 nova-compute[98241]: </disk>
May 28 02:14:14.840303 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:14:14.845399 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-e9a8a602-150e-4005-a39e-0a7ea83ec5bf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Successfully detached device vdc from instance 769d888e-505f-49eb-b3d8-9f9e8c7f0aab from the persistent domain config.
May 28 02:14:14.845698 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e9a8a602-150e-4005-a39e-0a7ea83ec5bf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] (1/8): Attempting to detach device vdc with device alias ua-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b from instance 769d888e-505f-49eb-b3d8-9f9e8c7f0aab from the live domain config. {{(pid=98241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 02:14:14.845698 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-e9a8a602-150e-4005-a39e-0a7ea83ec5bf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:14:14.845698 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:14:14.845698 np0000001583 nova-compute[98241]:   <alias name="ua-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b"/>
May 28 02:14:14.845698 np0000001583 nova-compute[98241]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-3"/>
May 28 02:14:14.845698 np0000001583 nova-compute[98241]:   <target dev="vdc" bus="virtio"/>
May 28 02:14:14.845698 np0000001583 nova-compute[98241]:   <serial>b3ce7f47-21bb-4a00-a346-fa17d1b1d84b</serial>
May 28 02:14:14.845698 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 28 02:14:14.845698 np0000001583 nova-compute[98241]:   <encryption format="luks">
May 28 02:14:14.845698 np0000001583 nova-compute[98241]:     <secret type="passphrase" uuid="ee35f557-d9e2-42d4-8cb3-f0e1e0be3f9d"/>
May 28 02:14:14.845698 np0000001583 nova-compute[98241]:   </encryption>
May 28 02:14:14.845698 np0000001583 nova-compute[98241]: </disk>
May 28 02:14:14.845698 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:14:15.293516 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Received event <DeviceRemovedEvent: 1779934455.293196, 769d888e-505f-49eb-b3d8-9f9e8c7f0aab => ua-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b> from libvirt while the driver is waiting for it; dispatched. {{(pid=98241) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 02:14:15.294545 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e9a8a602-150e-4005-a39e-0a7ea83ec5bf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b for instance 769d888e-505f-49eb-b3d8-9f9e8c7f0aab {{(pid=98241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 02:14:15.296723 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-e9a8a602-150e-4005-a39e-0a7ea83ec5bf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Successfully detached device vdc from instance 769d888e-505f-49eb-b3d8-9f9e8c7f0aab from the live domain config.
May 28 02:14:15.298958 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9a8a602-150e-4005-a39e-0a7ea83ec5bf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:14:15.299298 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a8a602-150e-4005-a39e-0a7ea83ec5bf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b', 'iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b3ce7f47-21bb-4a00-a346-fa17d1b1d84b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:14:15.299440 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-e9a8a602-150e-4005-a39e-0a7ea83ec5bf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:14:15.299819 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-e9a8a602-150e-4005-a39e-0a7ea83ec5bf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:14:15.300067 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a8a602-150e-4005-a39e-0a7ea83ec5bf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b', 'iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b3ce7f47-21bb-4a00-a346-fa17d1b1d84b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:14:15.300208 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a8a602-150e-4005-a39e-0a7ea83ec5bf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:14:15.300515 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:15.320535 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a8a602-150e-4005-a39e-0a7ea83ec5bf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:14:15.320535 np0000001583 nova-compute[98241]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:14:15.320535 np0000001583 nova-compute[98241]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b (non-flash)
May 28 02:14:15.320535 np0000001583 nova-compute[98241]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b (non-flash)
May 28 02:14:15.320535 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:14:15.320699 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a8a602-150e-4005-a39e-0a7ea83ec5bf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsi session list stdout=tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:14:15.320699 np0000001583 nova-compute[98241]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:14:15.320699 np0000001583 nova-compute[98241]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b (non-flash)
May 28 02:14:15.320699 np0000001583 nova-compute[98241]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b (non-flash)
May 28 02:14:15.320699 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:14:15.320799 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a8a602-150e-4005-a39e-0a7ea83ec5bf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96', '214'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96', '215'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b', '218'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b', '219')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:14:15.320843 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a8a602-150e-4005-a39e-0a7ea83ec5bf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b', '218')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:14:15.322807 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a8a602-150e-4005-a39e-0a7ea83ec5bf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b', '219')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:14:15.323632 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a8a602-150e-4005-a39e-0a7ea83ec5bf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f85a3a60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b'): ({'sdi'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:14:15.323632 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-e9a8a602-150e-4005-a39e-0a7ea83ec5bf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Removing multipathed devices sdh, sdi {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:14:15.323837 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-e9a8a602-150e-4005-a39e-0a7ea83ec5bf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Flush multipath device 330000000451bc91a {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:14:15.357440 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-e9a8a602-150e-4005-a39e-0a7ea83ec5bf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:14:15.408534 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-e9a8a602-150e-4005-a39e-0a7ea83ec5bf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:14:15.451564 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-e9a8a602-150e-4005-a39e-0a7ea83ec5bf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:14:15.451814 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-e9a8a602-150e-4005-a39e-0a7ea83ec5bf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:14:15.452923 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-e9a8a602-150e-4005-a39e-0a7ea83ec5bf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:14:15.463506 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-e9a8a602-150e-4005-a39e-0a7ea83ec5bf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:14:15.463670 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a8a602-150e-4005-a39e-0a7ea83ec5bf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:14:15.474508 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a8a602-150e-4005-a39e-0a7ea83ec5bf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:14:15.508176 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a8a602-150e-4005-a39e-0a7ea83ec5bf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 218, target: iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b, portal: 192.168.40.100,3260]
May 28 02:14:15.508176 np0000001583 nova-compute[98241]: Logout of [sid: 218, target: iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b, portal: 192.168.40.100,3260] successful.
May 28 02:14:15.508176 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:14:15.521246 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a8a602-150e-4005-a39e-0a7ea83ec5bf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:14:15.533235 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a8a602-150e-4005-a39e-0a7ea83ec5bf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:14:15.562036 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a8a602-150e-4005-a39e-0a7ea83ec5bf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 219, target: iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b, portal: 192.168.50.100,3260]
May 28 02:14:15.562036 np0000001583 nova-compute[98241]: Logout of [sid: 219, target: iqn.2023-03.storpool.com:os--volume-b3ce7f47-21bb-4a00-a346-fa17d1b1d84b, portal: 192.168.50.100,3260] successful.
May 28 02:14:15.562036 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:14:15.576516 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a8a602-150e-4005-a39e-0a7ea83ec5bf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:14:15.578123 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-e9a8a602-150e-4005-a39e-0a7ea83ec5bf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:14:15.578123 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a8a602-150e-4005-a39e-0a7ea83ec5bf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] <== disconnect_volume: return (278ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:14:15.578123 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9a8a602-150e-4005-a39e-0a7ea83ec5bf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:14:16.123311 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-e9a8a602-150e-4005-a39e-0a7ea83ec5bf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lazy-loading 'flavor' on Instance uuid 769d888e-505f-49eb-b3d8-9f9e8c7f0aab {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:14:17.128496 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e9a8a602-150e-4005-a39e-0a7ea83ec5bf tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "769d888e-505f-49eb-b3d8-9f9e8c7f0aab" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.856s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:14:17.511001 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-48b196dc-386a-4f49-8083-33e13e3cccd5 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "769d888e-505f-49eb-b3d8-9f9e8c7f0aab" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:14:17.511001 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-48b196dc-386a-4f49-8083-33e13e3cccd5 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "769d888e-505f-49eb-b3d8-9f9e8c7f0aab" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:14:18.013276 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-48b196dc-386a-4f49-8083-33e13e3cccd5 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Detaching volume 22b04366-97bc-4f2b-836a-d5da4169ae96
May 28 02:14:18.047099 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-48b196dc-386a-4f49-8083-33e13e3cccd5 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Attempting to driver detach volume 22b04366-97bc-4f2b-836a-d5da4169ae96 from mountpoint /dev/vdb
May 28 02:14:18.051405 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-48b196dc-386a-4f49-8083-33e13e3cccd5 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Found disk vdb by alias ua-22b04366-97bc-4f2b-836a-d5da4169ae96 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:14:18.052368 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-48b196dc-386a-4f49-8083-33e13e3cccd5 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Found disk vdb by alias ua-22b04366-97bc-4f2b-836a-d5da4169ae96 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:14:18.052471 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-48b196dc-386a-4f49-8083-33e13e3cccd5 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Attempting to detach device vdb from instance 769d888e-505f-49eb-b3d8-9f9e8c7f0aab from the persistent domain config. {{(pid=98241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 02:14:18.052687 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-48b196dc-386a-4f49-8083-33e13e3cccd5 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:14:18.052687 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:14:18.052687 np0000001583 nova-compute[98241]:   <alias name="ua-22b04366-97bc-4f2b-836a-d5da4169ae96"/>
May 28 02:14:18.052687 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-1"/>
May 28 02:14:18.052687 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:14:18.052687 np0000001583 nova-compute[98241]:   <serial>22b04366-97bc-4f2b-836a-d5da4169ae96</serial>
May 28 02:14:18.052687 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 02:14:18.052687 np0000001583 nova-compute[98241]: </disk>
May 28 02:14:18.052687 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:14:18.057616 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-48b196dc-386a-4f49-8083-33e13e3cccd5 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Successfully detached device vdb from instance 769d888e-505f-49eb-b3d8-9f9e8c7f0aab from the persistent domain config.
May 28 02:14:18.057762 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-48b196dc-386a-4f49-8083-33e13e3cccd5 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] (1/8): Attempting to detach device vdb with device alias ua-22b04366-97bc-4f2b-836a-d5da4169ae96 from instance 769d888e-505f-49eb-b3d8-9f9e8c7f0aab from the live domain config. {{(pid=98241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 02:14:18.057959 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-48b196dc-386a-4f49-8083-33e13e3cccd5 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:14:18.057959 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:14:18.057959 np0000001583 nova-compute[98241]:   <alias name="ua-22b04366-97bc-4f2b-836a-d5da4169ae96"/>
May 28 02:14:18.057959 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-1"/>
May 28 02:14:18.057959 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:14:18.057959 np0000001583 nova-compute[98241]:   <serial>22b04366-97bc-4f2b-836a-d5da4169ae96</serial>
May 28 02:14:18.057959 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 02:14:18.057959 np0000001583 nova-compute[98241]: </disk>
May 28 02:14:18.057959 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:14:18.485209 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Received event <DeviceRemovedEvent: 1779934458.4848397, 769d888e-505f-49eb-b3d8-9f9e8c7f0aab => ua-22b04366-97bc-4f2b-836a-d5da4169ae96> from libvirt while the driver is waiting for it; dispatched. {{(pid=98241) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 02:14:18.487883 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-48b196dc-386a-4f49-8083-33e13e3cccd5 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-22b04366-97bc-4f2b-836a-d5da4169ae96 for instance 769d888e-505f-49eb-b3d8-9f9e8c7f0aab {{(pid=98241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 02:14:18.490279 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-48b196dc-386a-4f49-8083-33e13e3cccd5 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Successfully detached device vdb from instance 769d888e-505f-49eb-b3d8-9f9e8c7f0aab from the live domain config.
May 28 02:14:18.491326 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48b196dc-386a-4f49-8083-33e13e3cccd5 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:14:18.492069 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b196dc-386a-4f49-8083-33e13e3cccd5 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96', 'iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '22b04366-97bc-4f2b-836a-d5da4169ae96', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:14:18.492069 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-48b196dc-386a-4f49-8083-33e13e3cccd5 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:14:18.943686 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-48b196dc-386a-4f49-8083-33e13e3cccd5 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.451s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:14:18.943902 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b196dc-386a-4f49-8083-33e13e3cccd5 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96', 'iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '22b04366-97bc-4f2b-836a-d5da4169ae96', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:14:18.944009 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b196dc-386a-4f49-8083-33e13e3cccd5 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:14:18.971483 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b196dc-386a-4f49-8083-33e13e3cccd5 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:14:18.971483 np0000001583 nova-compute[98241]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:14:18.971483 np0000001583 nova-compute[98241]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860 (non-flash)
May 28 02:14:18.971483 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:14:18.971653 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b196dc-386a-4f49-8083-33e13e3cccd5 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsi session list stdout=tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:14:18.971653 np0000001583 nova-compute[98241]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96 (non-flash)
May 28 02:14:18.971653 np0000001583 nova-compute[98241]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860 (non-flash)
May 28 02:14:18.971653 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:14:18.971754 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b196dc-386a-4f49-8083-33e13e3cccd5 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96', '214'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96', '215'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860', '227')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:14:18.971808 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b196dc-386a-4f49-8083-33e13e3cccd5 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96', '214')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:14:18.972530 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b196dc-386a-4f49-8083-33e13e3cccd5 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96', '215')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:14:18.973148 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b196dc-386a-4f49-8083-33e13e3cccd5 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f8460ae0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96'): ({'sdf'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:14:18.973319 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-48b196dc-386a-4f49-8083-33e13e3cccd5 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Removing multipathed devices sdf, sde {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:14:18.973541 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-48b196dc-386a-4f49-8083-33e13e3cccd5 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Flush multipath device 3300000008b355762 {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:14:19.008519 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-48b196dc-386a-4f49-8083-33e13e3cccd5 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:14:19.047232 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-48b196dc-386a-4f49-8083-33e13e3cccd5 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:14:19.095922 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-48b196dc-386a-4f49-8083-33e13e3cccd5 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Checking to see if SCSI volumes sdf, sde have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:14:19.096038 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-48b196dc-386a-4f49-8083-33e13e3cccd5 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] SCSI volumes sdf, sde have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:14:19.096863 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-48b196dc-386a-4f49-8083-33e13e3cccd5 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Checking to see if device paths {'sdf', 'sde'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:14:19.110432 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-48b196dc-386a-4f49-8083-33e13e3cccd5 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Device paths {'sdf', 'sde'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:14:19.110613 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b196dc-386a-4f49-8083-33e13e3cccd5 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:14:19.122231 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b196dc-386a-4f49-8083-33e13e3cccd5 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:14:19.149180 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b196dc-386a-4f49-8083-33e13e3cccd5 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 214, target: iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96, portal: 192.168.40.100,3260]
May 28 02:14:19.149180 np0000001583 nova-compute[98241]: Logout of [sid: 214, target: iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96, portal: 192.168.40.100,3260] successful.
May 28 02:14:19.149180 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:14:19.162429 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b196dc-386a-4f49-8083-33e13e3cccd5 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:14:19.173292 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b196dc-386a-4f49-8083-33e13e3cccd5 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:14:19.202027 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b196dc-386a-4f49-8083-33e13e3cccd5 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 215, target: iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96, portal: 192.168.50.100,3260]
May 28 02:14:19.202027 np0000001583 nova-compute[98241]: Logout of [sid: 215, target: iqn.2023-03.storpool.com:os--volume-22b04366-97bc-4f2b-836a-d5da4169ae96, portal: 192.168.50.100,3260] successful.
May 28 02:14:19.202027 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:14:19.214857 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b196dc-386a-4f49-8083-33e13e3cccd5 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:14:19.215058 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-48b196dc-386a-4f49-8083-33e13e3cccd5 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:14:19.215197 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b196dc-386a-4f49-8083-33e13e3cccd5 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] <== disconnect_volume: return (723ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:14:19.215301 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48b196dc-386a-4f49-8083-33e13e3cccd5 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:14:19.758638 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-48b196dc-386a-4f49-8083-33e13e3cccd5 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lazy-loading 'flavor' on Instance uuid 769d888e-505f-49eb-b3d8-9f9e8c7f0aab {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:14:19.771013 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.00026547100014795433 future=<Future at 0x7724f8281100 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:14:19.771609 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Emitting event <LifecycleEvent: 1779934444.7706645, 517d9811-556f-437c-92f9-1eee887e072b => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:14:19.771777 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:14:19.771952 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 517d9811-556f-437c-92f9-1eee887e072b] VM Stopped (Lifecycle Event)
May 28 02:14:20.274379 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3a9b923e-824d-401d-87ff-5517adadcb8c tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 517d9811-556f-437c-92f9-1eee887e072b] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:14:20.301861 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:20.764346 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-48b196dc-386a-4f49-8083-33e13e3cccd5 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "769d888e-505f-49eb-b3d8-9f9e8c7f0aab" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.253s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:14:24.085973 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b0edacc7-961a-461c-9e37-e4d1e800d8af tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "769d888e-505f-49eb-b3d8-9f9e8c7f0aab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:14:24.085973 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b0edacc7-961a-461c-9e37-e4d1e800d8af tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "769d888e-505f-49eb-b3d8-9f9e8c7f0aab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:14:24.086601 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b0edacc7-961a-461c-9e37-e4d1e800d8af tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "769d888e-505f-49eb-b3d8-9f9e8c7f0aab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:14:24.086601 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b0edacc7-961a-461c-9e37-e4d1e800d8af tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "769d888e-505f-49eb-b3d8-9f9e8c7f0aab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:14:24.086601 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b0edacc7-961a-461c-9e37-e4d1e800d8af tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "769d888e-505f-49eb-b3d8-9f9e8c7f0aab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:14:24.091945 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-b0edacc7-961a-461c-9e37-e4d1e800d8af tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Terminating instance
May 28 02:14:24.601347 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-b0edacc7-961a-461c-9e37-e4d1e800d8af tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 02:14:24.622365 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:24.624629 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:24.638696 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:24.658216 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:24.768819 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-dd52b435-7eb4-4c3b-9d84-3d6ee6e74d94 req-cc8232a9-8752-4851-8b24-6320f6ec59a3 service nova] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Received event network-vif-unplugged-43226b3b-c629-47bd-b874-28fc2f7defc5 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:14:24.769285 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-dd52b435-7eb4-4c3b-9d84-3d6ee6e74d94 req-cc8232a9-8752-4851-8b24-6320f6ec59a3 service nova] Acquiring lock "769d888e-505f-49eb-b3d8-9f9e8c7f0aab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:14:24.769452 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-dd52b435-7eb4-4c3b-9d84-3d6ee6e74d94 req-cc8232a9-8752-4851-8b24-6320f6ec59a3 service nova] Lock "769d888e-505f-49eb-b3d8-9f9e8c7f0aab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:14:24.769591 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-dd52b435-7eb4-4c3b-9d84-3d6ee6e74d94 req-cc8232a9-8752-4851-8b24-6320f6ec59a3 service nova] Lock "769d888e-505f-49eb-b3d8-9f9e8c7f0aab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:14:24.769738 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-dd52b435-7eb4-4c3b-9d84-3d6ee6e74d94 req-cc8232a9-8752-4851-8b24-6320f6ec59a3 service nova] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] No waiting events found dispatching network-vif-unplugged-43226b3b-c629-47bd-b874-28fc2f7defc5 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:14:24.769857 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-dd52b435-7eb4-4c3b-9d84-3d6ee6e74d94 req-cc8232a9-8752-4851-8b24-6320f6ec59a3 service nova] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Received event network-vif-unplugged-43226b3b-c629-47bd-b874-28fc2f7defc5 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:14:24.912484 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999616952999986 future=<Future at 0x7724f8186150 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:14:24.915464 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.996641292999811 future=<Future at 0x7724f8186150 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:14:24.915645 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.996405504999984 future=<Future at 0x7724f8186150 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:14:24.916815 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Instance destroyed successfully.
May 28 02:14:24.919436 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-b0edacc7-961a-461c-9e37-e4d1e800d8af tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lazy-loading 'resources' on Instance uuid 769d888e-505f-49eb-b3d8-9f9e8c7f0aab {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:14:25.303439 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:25.422613 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-b0edacc7-961a-461c-9e37-e4d1e800d8af tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T02:11:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1121346609',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-volumemultiattachtests-server-1121346609',id=78,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCw6mfS2UYDP9PgoI2ARsl9ucPnOUIdVENs+bIGUR2pJqKYe9J5WuC1571kjjgpZpiCNiKuxg+RnaT2NiKlIqk+HjAvm/MD3/Wxke+V2cXkupwN0eLhzgarMMyq4yLY9EA==',key_name='tempest-keypair-805647940',keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:11:43Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b993c740f0114a22b4ec01fd0172dc89',ramdisk_id='',reservation_id='r-4ampdxqi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumeMultiattachTests-562724558',owner_user_name='tempest-VolumeMultiattachTests-562724558-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T02:11:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a89bef00d8034a63ac07ef521be03355',uuid=769d888e-505f-49eb-b3d8-9f9e8c7f0aab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43226b3b-c629-47bd-b874-28fc2f7defc5", "address": "fa:16:3e:13:4c:d8", "network": {"id": "3b938343-a65c-4ea6-9c96-be377e9fe646", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-19450663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b993c740f0114a22b4ec01fd0172dc89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43226b3b-c6", "ovs_interfaceid": "43226b3b-c629-47bd-b874-28fc2f7defc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:14:25.422824 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-b0edacc7-961a-461c-9e37-e4d1e800d8af tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Converting VIF {"id": "43226b3b-c629-47bd-b874-28fc2f7defc5", "address": "fa:16:3e:13:4c:d8", "network": {"id": "3b938343-a65c-4ea6-9c96-be377e9fe646", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-19450663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b993c740f0114a22b4ec01fd0172dc89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43226b3b-c6", "ovs_interfaceid": "43226b3b-c629-47bd-b874-28fc2f7defc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:14:25.423426 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-b0edacc7-961a-461c-9e37-e4d1e800d8af tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:4c:d8,bridge_name='br-int',has_traffic_filtering=True,id=43226b3b-c629-47bd-b874-28fc2f7defc5,network=Network(3b938343-a65c-4ea6-9c96-be377e9fe646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43226b3b-c6') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:14:25.423683 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-b0edacc7-961a-461c-9e37-e4d1e800d8af tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:4c:d8,bridge_name='br-int',has_traffic_filtering=True,id=43226b3b-c629-47bd-b874-28fc2f7defc5,network=Network(3b938343-a65c-4ea6-9c96-be377e9fe646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43226b3b-c6') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:14:25.424717 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:25.424981 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap43226b3b-c6, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:14:25.426036 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:25.427232 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:14:25.427778 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:25.427937 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2875ee9c-85c6-4c6e-b836-b03cc2ff400c) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:14:25.428358 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:25.428919 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:14:25.430788 np0000001583 nova-compute[98241]: INFO os_vif [None req-b0edacc7-961a-461c-9e37-e4d1e800d8af tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:4c:d8,bridge_name='br-int',has_traffic_filtering=True,id=43226b3b-c629-47bd-b874-28fc2f7defc5,network=Network(3b938343-a65c-4ea6-9c96-be377e9fe646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43226b3b-c6')
May 28 02:14:25.431099 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-b0edacc7-961a-461c-9e37-e4d1e800d8af tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Deleting instance files /opt/stack/data/nova/instances/769d888e-505f-49eb-b3d8-9f9e8c7f0aab_del
May 28 02:14:25.431947 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-b0edacc7-961a-461c-9e37-e4d1e800d8af tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Deletion of /opt/stack/data/nova/instances/769d888e-505f-49eb-b3d8-9f9e8c7f0aab_del complete
May 28 02:14:25.938567 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-b0edacc7-961a-461c-9e37-e4d1e800d8af tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Took 1.34 seconds to destroy the instance on the hypervisor.
May 28 02:14:25.939685 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-b0edacc7-961a-461c-9e37-e4d1e800d8af tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 02:14:25.939970 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 02:14:25.940041 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 02:14:25.940274 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:14:26.028526 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:14:26.193297 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:14:26.193669 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:14:26.268744 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-51f06086-ecd6-4b5f-831d-3753bfc4bf78 req-2d3101ab-9c9c-4796-bfaa-3a07ace0e9a9 service nova] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Received event network-vif-deleted-43226b3b-c629-47bd-b874-28fc2f7defc5 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:14:26.269252 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-51f06086-ecd6-4b5f-831d-3753bfc4bf78 req-2d3101ab-9c9c-4796-bfaa-3a07ace0e9a9 service nova] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Neutron deleted interface 43226b3b-c629-47bd-b874-28fc2f7defc5; detaching it from the instance and deleting it from the info cache
May 28 02:14:26.270994 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-51f06086-ecd6-4b5f-831d-3753bfc4bf78 req-2d3101ab-9c9c-4796-bfaa-3a07ace0e9a9 service nova] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Detach interface failed, port_id=43226b3b-c629-47bd-b874-28fc2f7defc5, reason: Instance 769d888e-505f-49eb-b3d8-9f9e8c7f0aab could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 02:14:26.727936 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:14:26.818464 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e7ba9161-4044-44fe-b337-1c52d8676014 req-5c552f55-577c-4b7a-abb0-468281e30bc2 service nova] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Received event network-vif-unplugged-43226b3b-c629-47bd-b874-28fc2f7defc5 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:14:26.818667 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e7ba9161-4044-44fe-b337-1c52d8676014 req-5c552f55-577c-4b7a-abb0-468281e30bc2 service nova] Acquiring lock "769d888e-505f-49eb-b3d8-9f9e8c7f0aab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:14:26.818820 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e7ba9161-4044-44fe-b337-1c52d8676014 req-5c552f55-577c-4b7a-abb0-468281e30bc2 service nova] Lock "769d888e-505f-49eb-b3d8-9f9e8c7f0aab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:14:26.818949 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-e7ba9161-4044-44fe-b337-1c52d8676014 req-5c552f55-577c-4b7a-abb0-468281e30bc2 service nova] Lock "769d888e-505f-49eb-b3d8-9f9e8c7f0aab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:14:26.819057 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e7ba9161-4044-44fe-b337-1c52d8676014 req-5c552f55-577c-4b7a-abb0-468281e30bc2 service nova] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] No waiting events found dispatching network-vif-unplugged-43226b3b-c629-47bd-b874-28fc2f7defc5 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:14:26.819190 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-e7ba9161-4044-44fe-b337-1c52d8676014 req-5c552f55-577c-4b7a-abb0-468281e30bc2 service nova] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Received event network-vif-unplugged-43226b3b-c629-47bd-b874-28fc2f7defc5 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:14:27.193659 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:14:27.193931 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:14:27.229691 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Took 1.29 seconds to deallocate network for instance.
May 28 02:14:27.734569 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b0edacc7-961a-461c-9e37-e4d1e800d8af tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:14:27.734985 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b0edacc7-961a-461c-9e37-e4d1e800d8af tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:14:27.820548 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-b0edacc7-961a-461c-9e37-e4d1e800d8af tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:14:27.820751 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-b0edacc7-961a-461c-9e37-e4d1e800d8af tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:14:28.193238 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:14:28.193790 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:14:28.323172 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-b0edacc7-961a-461c-9e37-e4d1e800d8af tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:14:28.829870 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b0edacc7-961a-461c-9e37-e4d1e800d8af tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.095s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:14:28.871970 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-b0edacc7-961a-461c-9e37-e4d1e800d8af tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Deleted allocations for instance 769d888e-505f-49eb-b3d8-9f9e8c7f0aab
May 28 02:14:29.880143 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-b0edacc7-961a-461c-9e37-e4d1e800d8af tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "769d888e-505f-49eb-b3d8-9f9e8c7f0aab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.794s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:14:30.429825 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:31.193261 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:14:31.193711 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 02:14:31.193711 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:14:31.698753 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:14:31.698939 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:14:31.699118 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:14:31.699285 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Auditing locally available compute resources for np0000001583 (node: np0000001583) {{(pid=98241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 02:14:31.710629 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:14:31.712011 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:14:31.768342 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.056s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:14:31.768723 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Hypervisor/Node resource view: name=np0000001583 free_ram=13788MB free_disk=72.63921356201172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 02:14:31.768872 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:14:31.769152 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:14:32.817650 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 02:14:32.818032 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Final resource view: name=np0000001583 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:14:31 up 50 min,  2 users,  load average: 1.80, 3.76, 4.37\n'} {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 02:14:32.862698 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:14:32.862920 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:14:33.365820 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:14:33.873836 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Compute_service record updated for np0000001583:np0000001583 {{(pid=98241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 02:14:33.874236 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.105s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:14:33.874322 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:14:34.046215 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "7b6daa1b-e2ee-41a5-8476-d478101a4a2c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:14:34.046379 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "7b6daa1b-e2ee-41a5-8476-d478101a4a2c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:14:34.549942 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 02:14:34.556003 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Acquiring lock "d77db397-a74c-4916-a215-ae19b63f90ec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:14:34.556206 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Lock "d77db397-a74c-4916-a215-ae19b63f90ec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:14:34.870033 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:14:34.870298 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:14:34.870546 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.32 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:14:35.058312 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Starting instance... {{(pid=98241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 02:14:35.102744 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:14:35.102964 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:14:35.106451 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 02:14:35.106629 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Claim successful on node np0000001583
May 28 02:14:35.432838 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:35.612856 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:14:36.193055 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:14:36.193804 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:14:36.244403 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:14:36.244606 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:14:36.746933 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:14:37.193858 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:14:37.193858 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Cleaning up deleted instances {{(pid=98241) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}}
May 28 02:14:37.253201 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.150s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:14:37.253806 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.641s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:14:37.253953 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 02:14:37.258048 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 02:14:37.258143 np0000001583 nova-compute[98241]: INFO nova.compute.claims [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Claim successful on node np0000001583
May 28 02:14:37.695716 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] There are 0 instances to clean {{(pid=98241) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}}
May 28 02:14:37.696037 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.50 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:14:37.764837 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 02:14:37.766623 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 02:14:37.767498 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:14:37.768093 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:14:37.831623 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a89bef00d8034a63ac07ef521be03355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b993c740f0114a22b4ec01fd0172dc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 02:14:38.193569 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:14:38.193877 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98241) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}}
May 28 02:14:38.269411 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 02:14:38.280406 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Successfully created port: c06038a3-0d97-4e8b-9b86-57f1bd5c5f51 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 02:14:38.397883 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:14:38.398128 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:14:38.685014 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Successfully updated port: c06038a3-0d97-4e8b-9b86-57f1bd5c5f51 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 02:14:38.696494 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 17.50 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:14:38.728287 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-dc749add-6fb8-4b3a-ae28-5911eb353028 req-3af993f6-9cab-4ca3-8ccc-a8054d252a15 service nova] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Received event network-changed-c06038a3-0d97-4e8b-9b86-57f1bd5c5f51 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:14:38.728423 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-dc749add-6fb8-4b3a-ae28-5911eb353028 req-3af993f6-9cab-4ca3-8ccc-a8054d252a15 service nova] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Refreshing instance network info cache due to event network-changed-c06038a3-0d97-4e8b-9b86-57f1bd5c5f51. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:14:38.728566 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-dc749add-6fb8-4b3a-ae28-5911eb353028 req-3af993f6-9cab-4ca3-8ccc-a8054d252a15 service nova] Acquiring lock "refresh_cache-7b6daa1b-e2ee-41a5-8476-d478101a4a2c" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:14:38.728681 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-dc749add-6fb8-4b3a-ae28-5911eb353028 req-3af993f6-9cab-4ca3-8ccc-a8054d252a15 service nova] Acquired lock "refresh_cache-7b6daa1b-e2ee-41a5-8476-d478101a4a2c" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:14:38.729314 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-dc749add-6fb8-4b3a-ae28-5911eb353028 req-3af993f6-9cab-4ca3-8ccc-a8054d252a15 service nova] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Refreshing network info cache for port c06038a3-0d97-4e8b-9b86-57f1bd5c5f51 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:14:38.772936 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 02:14:38.900858 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:14:39.187103 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "refresh_cache-7b6daa1b-e2ee-41a5-8476-d478101a4a2c" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:14:39.231005 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-dc749add-6fb8-4b3a-ae28-5911eb353028 req-3af993f6-9cab-4ca3-8ccc-a8054d252a15 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:14:39.284976 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-dc749add-6fb8-4b3a-ae28-5911eb353028 req-3af993f6-9cab-4ca3-8ccc-a8054d252a15 service nova] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:14:39.400539 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-dc749add-6fb8-4b3a-ae28-5911eb353028 req-3af993f6-9cab-4ca3-8ccc-a8054d252a15 service nova] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:14:39.409703 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.156s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:14:39.410294 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Start building networks asynchronously for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 02:14:39.779876 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 02:14:39.780541 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 02:14:39.780833 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Creating image(s)
May 28 02:14:39.781365 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "/opt/stack/data/nova/instances/7b6daa1b-e2ee-41a5-8476-d478101a4a2c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:14:39.781540 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "/opt/stack/data/nova/instances/7b6daa1b-e2ee-41a5-8476-d478101a4a2c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:14:39.781971 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "/opt/stack/data/nova/instances/7b6daa1b-e2ee-41a5-8476-d478101a4a2c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:14:39.782528 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:14:39.785214 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:14:39.786169 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:14:39.870023 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.083s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:14:39.870591 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:14:39.871195 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:14:39.871698 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:14:39.875221 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:14:39.875605 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:14:39.903833 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-dc749add-6fb8-4b3a-ae28-5911eb353028 req-3af993f6-9cab-4ca3-8ccc-a8054d252a15 service nova] Releasing lock "refresh_cache-7b6daa1b-e2ee-41a5-8476-d478101a4a2c" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:14:39.904845 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquired lock "refresh_cache-7b6daa1b-e2ee-41a5-8476-d478101a4a2c" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:14:39.905230 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:14:39.912717 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.0006086170001253777 future=<Future at 0x7724f8186150 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:14:39.916723 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:14:39.917586 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] Emitting event <LifecycleEvent: 1779934464.91199, 769d888e-505f-49eb-b3d8-9f9e8c7f0aab => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:14:39.917729 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] VM Stopped (Lifecycle Event)
May 28 02:14:39.919794 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Allocating IP information in the background. {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 02:14:39.921323 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] allocate_for_instance() {{(pid=98241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 02:14:39.921578 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:14:39.921881 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:14:39.965090 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.089s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:14:39.965545 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/7b6daa1b-e2ee-41a5-8476-d478101a4a2c/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:14:39.987912 np0000001583 nova-compute[98241]: DEBUG nova.policy [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c42b95d08c7244f69c4ae5171c4f38b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e27ed5be47848cf82a89a18801a8cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98241) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 02:14:40.017204 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/7b6daa1b-e2ee-41a5-8476-d478101a4a2c/disk 1073741824" returned: 0 in 0.052s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:14:40.017595 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.146s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:14:40.017891 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:14:40.117045 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.099s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:14:40.118661 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7b6daa1b-e2ee-41a5-8476-d478101a4a2c/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 02:14:40.118944 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6daa1b-e2ee-41a5-8476-d478101a4a2c/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:14:40.209121 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6daa1b-e2ee-41a5-8476-d478101a4a2c/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:14:40.209705 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Cannot resize image /opt/stack/data/nova/instances/7b6daa1b-e2ee-41a5-8476-d478101a4a2c/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 02:14:40.210090 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 02:14:40.211057 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Ensure instance console log exists: /opt/stack/data/nova/instances/7b6daa1b-e2ee-41a5-8476-d478101a4a2c/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 02:14:40.211057 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:14:40.211057 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:14:40.211057 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:14:40.400879 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Successfully created port: cffb4a3e-54d4-491a-96c3-2a447f3397f4 {{(pid=98241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 02:14:40.420528 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 02:14:40.424295 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1ab2a23f-5480-48fa-9dc8-33002c936a17 tempest-VolumesSnapshotTestJSON-1803039293 tempest-VolumesSnapshotTestJSON-1803039293-project-member] [instance: 769d888e-505f-49eb-b3d8-9f9e8c7f0aab] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:14:40.433555 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:40.478970 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:14:40.621702 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:14:40.744753 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Updating instance_info_cache with network_info: [{"id": "c06038a3-0d97-4e8b-9b86-57f1bd5c5f51", "address": "fa:16:3e:f6:24:64", "network": {"id": "3b938343-a65c-4ea6-9c96-be377e9fe646", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-19450663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b993c740f0114a22b4ec01fd0172dc89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc06038a3-0d", "ovs_interfaceid": "c06038a3-0d97-4e8b-9b86-57f1bd5c5f51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:14:40.863395 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Successfully updated port: cffb4a3e-54d4-491a-96c3-2a447f3397f4 {{(pid=98241) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 02:14:40.904538 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-222ada11-319c-4442-8a51-6ea4040944be req-26ed8530-835d-42e2-a4b5-41e1b6c24202 service nova] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Received event network-changed-cffb4a3e-54d4-491a-96c3-2a447f3397f4 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:14:40.905199 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-222ada11-319c-4442-8a51-6ea4040944be req-26ed8530-835d-42e2-a4b5-41e1b6c24202 service nova] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Refreshing instance network info cache due to event network-changed-cffb4a3e-54d4-491a-96c3-2a447f3397f4. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:14:40.905412 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-222ada11-319c-4442-8a51-6ea4040944be req-26ed8530-835d-42e2-a4b5-41e1b6c24202 service nova] Acquiring lock "refresh_cache-d77db397-a74c-4916-a215-ae19b63f90ec" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:14:40.905442 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-222ada11-319c-4442-8a51-6ea4040944be req-26ed8530-835d-42e2-a4b5-41e1b6c24202 service nova] Acquired lock "refresh_cache-d77db397-a74c-4916-a215-ae19b63f90ec" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:14:40.905532 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-222ada11-319c-4442-8a51-6ea4040944be req-26ed8530-835d-42e2-a4b5-41e1b6c24202 service nova] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Refreshing network info cache for port cffb4a3e-54d4-491a-96c3-2a447f3397f4 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:14:41.246742 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Releasing lock "refresh_cache-7b6daa1b-e2ee-41a5-8476-d478101a4a2c" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:14:41.247047 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Instance network_info: |[{"id": "c06038a3-0d97-4e8b-9b86-57f1bd5c5f51", "address": "fa:16:3e:f6:24:64", "network": {"id": "3b938343-a65c-4ea6-9c96-be377e9fe646", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-19450663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b993c740f0114a22b4ec01fd0172dc89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc06038a3-0d", "ovs_interfaceid": "c06038a3-0d97-4e8b-9b86-57f1bd5c5f51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 02:14:41.248812 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Start _get_guest_xml network_info=[{"id": "c06038a3-0d97-4e8b-9b86-57f1bd5c5f51", "address": "fa:16:3e:f6:24:64", "network": {"id": "3b938343-a65c-4ea6-9c96-be377e9fe646", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-19450663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b993c740f0114a22b4ec01fd0172dc89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc06038a3-0d", "ovs_interfaceid": "c06038a3-0d97-4e8b-9b86-57f1bd5c5f51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 02:14:41.251570 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:14:41.252753 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-VolumeMultiattachTests-server-1814078736', uuid='7b6daa1b-e2ee-41a5-8476-d478101a4a2c'), owner=OwnerMeta(userid='a89bef00d8034a63ac07ef521be03355', username='tempest-VolumeMultiattachTests-562724558-project-member', projectid='b993c740f0114a22b4ec01fd0172dc89', projectname='tempest-VolumeMultiattachTests-562724558'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c06038a3-0d97-4e8b-9b86-57f1bd5c5f51", "address": "fa:16:3e:f6:24:64", "network": {"id": "3b938343-a65c-4ea6-9c96-be377e9fe646", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-19450663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b993c740f0114a22b4ec01fd0172dc89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc06038a3-0d", "ovs_interfaceid": "c06038a3-0d97-4e8b-9b86-57f1bd5c5f51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779934481.2523985) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 02:14:41.253835 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 02:14:41.254202 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 02:14:41.255069 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 02:14:41.255233 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 02:14:41.256015 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 02:14:41.256325 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 02:14:41.256454 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 02:14:41.256541 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 02:14:41.256650 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 02:14:41.256726 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 02:14:41.256807 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 02:14:41.256956 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 02:14:41.257087 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 02:14:41.257240 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 02:14:41.257348 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 02:14:41.257470 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 02:14:41.267539 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:14:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1814078736',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-volumemultiattachtests-server-1814078736',id=81,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsbyy7JdQzN4BiPWu1qHPp0Y0ooSVtuSNyfHNuCWHUvOc17UDfUFc7MeISc9lZmdBu5c3VvBWlIM0RfohHj9ig0+yvFEihRqr3KQPG6+4qb+RjOoC7dyNNrntcr16kUYA==',key_name='tempest-keypair-52718899',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b993c740f0114a22b4ec01fd0172dc89',ramdisk_id='',reservation_id='r-6xek0rdi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-562724558',owner_user_name='tempest-VolumeMultiattachTests-562724558-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:14:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a89bef00d8034a63ac07ef521be03355',uuid=7b6daa1b-e2ee-41a5-8476-d478101a4a2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c06038a3-0d97-4e8b-9b86-57f1bd5c5f51", "address": "fa:16:3e:f6:24:64", "network": {"id": "3b938343-a65c-4ea6-9c96-be377e9fe646", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-19450663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b993c740f0114a22b4ec01fd0172dc89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc06038a3-0d", "ovs_interfaceid": "c06038a3-0d97-4e8b-9b86-57f1bd5c5f51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 02:14:41.267722 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Converting VIF {"id": "c06038a3-0d97-4e8b-9b86-57f1bd5c5f51", "address": "fa:16:3e:f6:24:64", "network": {"id": "3b938343-a65c-4ea6-9c96-be377e9fe646", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-19450663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b993c740f0114a22b4ec01fd0172dc89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc06038a3-0d", "ovs_interfaceid": "c06038a3-0d97-4e8b-9b86-57f1bd5c5f51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:14:41.268269 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:24:64,bridge_name='br-int',has_traffic_filtering=True,id=c06038a3-0d97-4e8b-9b86-57f1bd5c5f51,network=Network(3b938343-a65c-4ea6-9c96-be377e9fe646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc06038a3-0d') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:14:41.268731 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lazy-loading 'pci_devices' on Instance uuid 7b6daa1b-e2ee-41a5-8476-d478101a4a2c {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:14:41.365327 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Acquiring lock "refresh_cache-d77db397-a74c-4916-a215-ae19b63f90ec" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:14:41.407438 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-222ada11-319c-4442-8a51-6ea4040944be req-26ed8530-835d-42e2-a4b5-41e1b6c24202 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:14:41.426856 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Start building block device mappings for instance. {{(pid=98241) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 02:14:41.475583 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-222ada11-319c-4442-8a51-6ea4040944be req-26ed8530-835d-42e2-a4b5-41e1b6c24202 service nova] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:14:41.610206 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-222ada11-319c-4442-8a51-6ea4040944be req-26ed8530-835d-42e2-a4b5-41e1b6c24202 service nova] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:14:41.771870 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] End _get_guest_xml xml=<domain type="qemu">
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:   <uuid>7b6daa1b-e2ee-41a5-8476-d478101a4a2c</uuid>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:   <name>instance-00000051</name>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:   <metadata>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:       <nova:name>tempest-VolumeMultiattachTests-server-1814078736</nova:name>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 02:14:41</nova:creationTime>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:       </nova:image>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:         <nova:user uuid="a89bef00d8034a63ac07ef521be03355">tempest-VolumeMultiattachTests-562724558-project-member</nova:user>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:         <nova:project uuid="b993c740f0114a22b4ec01fd0172dc89">tempest-VolumeMultiattachTests-562724558</nova:project>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:         <nova:port uuid="c06038a3-0d97-4e8b-9b86-57f1bd5c5f51">
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:         </nova:port>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:   </metadata>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:     <system>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:       <entry name="serial">7b6daa1b-e2ee-41a5-8476-d478101a4a2c</entry>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:       <entry name="uuid">7b6daa1b-e2ee-41a5-8476-d478101a4a2c</entry>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:     </system>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:   <os>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:   </os>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:   <features>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:     <acpi/>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:     <tcg>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:     </tcg>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:   </features>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:   </cpu>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:   <devices>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/7b6daa1b-e2ee-41a5-8476-d478101a4a2c/disk"/>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:     </disk>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/7b6daa1b-e2ee-41a5-8476-d478101a4a2c/disk.config"/>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:     </disk>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:f6:24:64"/>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:       <target dev="tapc06038a3-0d"/>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:     </interface>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/7b6daa1b-e2ee-41a5-8476-d478101a4a2c/console.log" append="off"/>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:     </serial>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:     <video>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:     </video>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:     </rng>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:     </memballoon>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:   </devices>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]: </domain>
May 28 02:14:41.771870 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 02:14:41.773780 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Preparing to wait for external event network-vif-plugged-c06038a3-0d97-4e8b-9b86-57f1bd5c5f51 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 02:14:41.773780 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "7b6daa1b-e2ee-41a5-8476-d478101a4a2c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:14:41.773780 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "7b6daa1b-e2ee-41a5-8476-d478101a4a2c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:14:41.773780 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "7b6daa1b-e2ee-41a5-8476-d478101a4a2c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:14:41.773780 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:14:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1814078736',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-volumemultiattachtests-server-1814078736',id=81,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsbyy7JdQzN4BiPWu1qHPp0Y0ooSVtuSNyfHNuCWHUvOc17UDfUFc7MeISc9lZmdBu5c3VvBWlIM0RfohHj9ig0+yvFEihRqr3KQPG6+4qb+RjOoC7dyNNrntcr16kUYA==',key_name='tempest-keypair-52718899',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b993c740f0114a22b4ec01fd0172dc89',ramdisk_id='',reservation_id='r-6xek0rdi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-562724558',owner_user_name='tempest-VolumeMultiattachTests-562724558-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:14:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a89bef00d8034a63ac07ef521be03355',uuid=7b6daa1b-e2ee-41a5-8476-d478101a4a2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c06038a3-0d97-4e8b-9b86-57f1bd5c5f51", "address": "fa:16:3e:f6:24:64", "network": {"id": "3b938343-a65c-4ea6-9c96-be377e9fe646", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-19450663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b993c740f0114a22b4ec01fd0172dc89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc06038a3-0d", "ovs_interfaceid": "c06038a3-0d97-4e8b-9b86-57f1bd5c5f51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 02:14:41.773780 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Converting VIF {"id": "c06038a3-0d97-4e8b-9b86-57f1bd5c5f51", "address": "fa:16:3e:f6:24:64", "network": {"id": "3b938343-a65c-4ea6-9c96-be377e9fe646", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-19450663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b993c740f0114a22b4ec01fd0172dc89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc06038a3-0d", "ovs_interfaceid": "c06038a3-0d97-4e8b-9b86-57f1bd5c5f51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:14:41.774189 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:24:64,bridge_name='br-int',has_traffic_filtering=True,id=c06038a3-0d97-4e8b-9b86-57f1bd5c5f51,network=Network(3b938343-a65c-4ea6-9c96-be377e9fe646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc06038a3-0d') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:14:41.774522 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:24:64,bridge_name='br-int',has_traffic_filtering=True,id=c06038a3-0d97-4e8b-9b86-57f1bd5c5f51,network=Network(3b938343-a65c-4ea6-9c96-be377e9fe646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc06038a3-0d') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 02:14:41.774829 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:41.775057 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:14:41.775378 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 02:14:41.776041 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:41.776203 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ff968d17-db06-5ddd-98ed-3f3c99b5bc4d', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:14:41.777187 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:41.777840 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:14:41.777979 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:41.779494 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:41.779646 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc06038a3-0d, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:14:41.779926 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc06038a3-0d, col_values=(('qos', UUID('f09223bb-8086-471a-bf11-1280e494d762')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:14:41.780144 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc06038a3-0d, col_values=(('external_ids', {'iface-id': 'c06038a3-0d97-4e8b-9b86-57f1bd5c5f51', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:24:64', 'vm-uuid': '7b6daa1b-e2ee-41a5-8476-d478101a4a2c'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:14:41.780804 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:41.781913 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:14:41.787004 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:41.787669 np0000001583 nova-compute[98241]: INFO os_vif [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:24:64,bridge_name='br-int',has_traffic_filtering=True,id=c06038a3-0d97-4e8b-9b86-57f1bd5c5f51,network=Network(3b938343-a65c-4ea6-9c96-be377e9fe646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc06038a3-0d')
May 28 02:14:41.933911 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Booting with volume 7650b5b9-d11a-49dc-8e6d-20070e724860 at /dev/vdb
May 28 02:14:41.967002 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:14:41.978232 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 02:14:41.997275 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:14:42.039489 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 02:14:42.039743 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 02:14:42.047572 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 02:14:42.048333 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046'] 
May 28 02:14:42.048449 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 02:14:42.048547 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 02:14:42.048762 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] <== get_connector_properties: return (82ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:14:42.048963 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Updating existing volume attachment record: 981faded-e7b0-4b2b-85b6-30fee040239d {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 02:14:42.112273 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-222ada11-319c-4442-8a51-6ea4040944be req-26ed8530-835d-42e2-a4b5-41e1b6c24202 service nova] Releasing lock "refresh_cache-d77db397-a74c-4916-a215-ae19b63f90ec" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:14:42.112876 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Acquired lock "refresh_cache-d77db397-a74c-4916-a215-ae19b63f90ec" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:14:42.113090 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Building network info cache for instance {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 02:14:42.672217 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Instance cache missing network info. {{(pid=98241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 02:14:42.802969 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:14:42.919443 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Updating instance_info_cache with network_info: [{"id": "cffb4a3e-54d4-491a-96c3-2a447f3397f4", "address": "fa:16:3e:3d:9e:0b", "network": {"id": "2520d56d-1ded-4ed5-87da-e2d4bab6272c", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1831941816-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e27ed5be47848cf82a89a18801a8cc2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcffb4a3e-54", "ovs_interfaceid": "cffb4a3e-54d4-491a-96c3-2a447f3397f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:14:43.303707 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:14:43.303855 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:14:43.303915 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] No VIF found with MAC fa:16:3e:f6:24:64, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:14:43.304451 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Using config drive
May 28 02:14:43.421444 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Releasing lock "refresh_cache-d77db397-a74c-4916-a215-ae19b63f90ec" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:14:43.421740 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Instance network_info: |[{"id": "cffb4a3e-54d4-491a-96c3-2a447f3397f4", "address": "fa:16:3e:3d:9e:0b", "network": {"id": "2520d56d-1ded-4ed5-87da-e2d4bab6272c", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1831941816-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e27ed5be47848cf82a89a18801a8cc2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcffb4a3e-54", "ovs_interfaceid": "cffb4a3e-54d4-491a-96c3-2a447f3397f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 02:14:43.809945 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:14:43.923947 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Creating config drive at /opt/stack/data/nova/instances/7b6daa1b-e2ee-41a5-8476-d478101a4a2c/disk.config
May 28 02:14:43.927661 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7b6daa1b-e2ee-41a5-8476-d478101a4a2c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptfzsjb55 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:14:43.980818 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7b6daa1b-e2ee-41a5-8476-d478101a4a2c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptfzsjb55" returned: 0 in 0.053s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:14:44.136734 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Start spawning the instance on the hypervisor. {{(pid=98241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 02:14:44.138303 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Creating instance directory {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 02:14:44.138631 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Creating image(s)
May 28 02:14:44.139342 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Acquiring lock "/opt/stack/data/nova/instances/d77db397-a74c-4916-a215-ae19b63f90ec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:14:44.139626 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Lock "/opt/stack/data/nova/instances/d77db397-a74c-4916-a215-ae19b63f90ec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:14:44.140300 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Lock "/opt/stack/data/nova/instances/d77db397-a74c-4916-a215-ae19b63f90ec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:14:44.140956 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:14:44.145276 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:14:44.146735 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:14:44.240780 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.094s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:14:44.241308 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Acquiring lock "9d60daaad2450df78b710eabbb81da4840745899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:14:44.241908 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:14:44.242500 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:14:44.247088 np0000001583 nova-compute[98241]: DEBUG oslo_utils.imageutils.format_inspector [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98241) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 02:14:44.247583 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:14:44.336315 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.088s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:14:44.336864 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/d77db397-a74c-4916-a215-ae19b63f90ec/disk 1073741824 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:14:44.385819 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:44.402236 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:44.411890 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899,backing_fmt=raw /opt/stack/data/nova/instances/d77db397-a74c-4916-a215-ae19b63f90ec/disk 1073741824" returned: 0 in 0.075s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:14:44.412157 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Lock "9d60daaad2450df78b710eabbb81da4840745899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.170s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:14:44.412535 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:14:44.486224 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:44.501028 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 --force-share --output=json" returned: 0 in 0.088s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:14:44.501472 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d77db397-a74c-4916-a215-ae19b63f90ec/disk. size=1073741824 {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 02:14:44.501754 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77db397-a74c-4916-a215-ae19b63f90ec/disk --force-share --output=json {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:14:44.563386 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ff6e3155-33e9-4765-bbe3-6aad2c579849 req-79d0e8d4-0448-449b-a8c5-2dccb754dbb7 service nova] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Received event network-vif-plugged-c06038a3-0d97-4e8b-9b86-57f1bd5c5f51 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:14:44.563754 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ff6e3155-33e9-4765-bbe3-6aad2c579849 req-79d0e8d4-0448-449b-a8c5-2dccb754dbb7 service nova] Acquiring lock "7b6daa1b-e2ee-41a5-8476-d478101a4a2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:14:44.563920 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ff6e3155-33e9-4765-bbe3-6aad2c579849 req-79d0e8d4-0448-449b-a8c5-2dccb754dbb7 service nova] Lock "7b6daa1b-e2ee-41a5-8476-d478101a4a2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:14:44.564069 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-ff6e3155-33e9-4765-bbe3-6aad2c579849 req-79d0e8d4-0448-449b-a8c5-2dccb754dbb7 service nova] Lock "7b6daa1b-e2ee-41a5-8476-d478101a4a2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:14:44.564325 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-ff6e3155-33e9-4765-bbe3-6aad2c579849 req-79d0e8d4-0448-449b-a8c5-2dccb754dbb7 service nova] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Processing event network-vif-plugged-c06038a3-0d97-4e8b-9b86-57f1bd5c5f51 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 02:14:44.594148 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77db397-a74c-4916-a215-ae19b63f90ec/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:14:44.594506 np0000001583 nova-compute[98241]: DEBUG nova.virt.disk.api [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Cannot resize image /opt/stack/data/nova/instances/d77db397-a74c-4916-a215-ae19b63f90ec/disk to a smaller size. {{(pid=98241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 02:14:44.594868 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Created local disks {{(pid=98241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 02:14:44.595058 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Ensure instance console log exists: /opt/stack/data/nova/instances/d77db397-a74c-4916-a215-ae19b63f90ec/console.log {{(pid=98241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 02:14:44.595362 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:14:44.595543 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:14:44.595637 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:14:44.597737 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Start _get_guest_xml network_info=[{"id": "cffb4a3e-54d4-491a-96c3-2a447f3397f4", "address": "fa:16:3e:3d:9e:0b", "network": {"id": "2520d56d-1ded-4ed5-87da-e2d4bab6272c", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1831941816-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e27ed5be47848cf82a89a18801a8cc2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcffb4a3e-54", "ovs_interfaceid": "cffb4a3e-54d4-491a-96c3-2a447f3397f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3aa57a53-c080-4a55-ba67-d70bf1ef7690'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860', 'iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7650b5b9-d11a-49dc-8e6d-20070e724860', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'd77db397-a74c-4916-a215-ae19b63f90ec', 'attached_at': '', 'detached_at': '', 'volume_id': '7650b5b9-d11a-49dc-8e6d-20070e724860', 'serial': '7650b5b9-d11a-49dc-8e6d-20070e724860'}, 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'boot_index': -1, 'attachment_id': '981faded-e7b0-4b2b-85b6-30fee040239d', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 02:14:44.603448 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:14:44.604975 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', instance_meta=NovaInstanceMeta(name='tempest-instance-748513095', uuid='d77db397-a74c-4916-a215-ae19b63f90ec'), owner=OwnerMeta(userid='c42b95d08c7244f69c4ae5171c4f38b8', username='tempest-VolumesBackupsTest-1928548083-project-member', projectid='7e27ed5be47848cf82a89a18801a8cc2', projectname='tempest-VolumesBackupsTest-1928548083'), image=ImageMeta(id='3aa57a53-c080-4a55-ba67-d70bf1ef7690', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "cffb4a3e-54d4-491a-96c3-2a447f3397f4", "address": "fa:16:3e:3d:9e:0b", "network": {"id": "2520d56d-1ded-4ed5-87da-e2d4bab6272c", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1831941816-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e27ed5be47848cf82a89a18801a8cc2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcffb4a3e-54", "ovs_interfaceid": "cffb4a3e-54d4-491a-96c3-2a447f3397f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779934484.6045463) {{(pid=98241) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 02:14:44.607052 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V1... {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 02:14:44.607428 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] CPU controller missing on host. {{(pid=98241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 02:14:44.608882 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Searching host: 'np0000001583' for CPU controller through CGroups V2... {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 02:14:44.609130 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.host [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] CPU controller found on host. {{(pid=98241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 02:14:44.610355 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 02:14:44.610812 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:49:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=3aa57a53-c080-4a55-ba67-d70bf1ef7690,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='b6b98ce7597d45a6b839c720f99fa1e9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 02:14:44.611019 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Flavor limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 02:14:44.611158 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Image limits 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 02:14:44.611340 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Flavor pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 02:14:44.611470 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Image pref 0:0:0 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 02:14:44.611599 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 02:14:44.612423 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 02:14:44.612423 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 02:14:44.612817 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Got 1 possible topologies {{(pid=98241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 02:14:44.612968 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 02:14:44.613161 np0000001583 nova-compute[98241]: DEBUG nova.virt.hardware [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 02:14:44.626167 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 02:14:44.626528 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860', 'iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7650b5b9-d11a-49dc-8e6d-20070e724860', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:14:44.626671 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:14:44.626992 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:14:44.627202 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860', 'iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7650b5b9-d11a-49dc-8e6d-20070e724860', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 02:14:44.639428 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:14:44.639985 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:14:44.640428 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:14:44.640689 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:14:44.641015 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:14:44.641182 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:14:44.656736 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:14:44.656736 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:14:44.657212 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:14:44.657212 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:14:44.669489 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860] added
May 28 02:14:44.669489 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:14:44.669489 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:14:44.669489 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:14:44.669489 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:14:44.669489 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:14:44.669489 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:14:44.669727 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:14:44.669759 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0285(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:14:44.669945 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:14:44.673483 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860] added
May 28 02:14:44.673483 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:14:44.673483 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:14:44.673483 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:14:44.673483 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:14:44.673483 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:14:44.673483 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:14:44.673677 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:14:44.673733 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0331(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:14:44.673846 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:14:44.722601 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:44.723995 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:44.726417 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:44.740726 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:45.091346 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934485.090871, 7b6daa1b-e2ee-41a5-8476-d478101a4a2c => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:14:45.091727 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] VM Started (Lifecycle Event)
May 28 02:14:45.092647 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 02:14:45.096248 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 02:14:45.099125 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Instance spawned successfully.
May 28 02:14:45.099716 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 02:14:45.594860 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:14:45.597070 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:14:45.605337 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:14:45.605429 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:14:45.605737 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:14:45.605978 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:14:45.606223 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:14:45.606465 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:14:45.670331 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:14:45.674462 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:14:45.682470 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:14:45.682470 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:14:45.689047 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:14:45.689047 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:14:45.693677 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:14:45.700481 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:14:45.705440 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 02:14:45.705440 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:14:45.705584 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 02:14:45.705584 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:14:45.705694 np0000001583 nova-compute[98241]: WARNING os_brick.initiator.connectors.iscsi [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 02:14:45.705694 np0000001583 nova-compute[98241]: 
May 28 02:14:45.711306 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 02:14:45.711306 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:14:45.711485 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 02:14:45.711485 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:14:45.711640 np0000001583 nova-compute[98241]: WARNING os_brick.initiator.connectors.iscsi [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 02:14:45.711640 np0000001583 nova-compute[98241]: 
May 28 02:14:46.099528 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 02:14:46.099946 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934486.099688, 7b6daa1b-e2ee-41a5-8476-d478101a4a2c => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:14:46.099946 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] VM Paused (Lifecycle Event)
May 28 02:14:46.110717 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Took 6.33 seconds to spawn the instance on the hypervisor.
May 28 02:14:46.111213 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:14:46.604040 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:14:46.606057 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934486.605849, 7b6daa1b-e2ee-41a5-8476-d478101a4a2c => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:14:46.606185 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] VM Resumed (Lifecycle Event)
May 28 02:14:46.623277 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Took 11.57 seconds to build instance.
May 28 02:14:46.627321 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5eaef27e-922e-404e-8c03-be620a48e949 req-4d18603d-5066-46f2-8ecd-0c6ceb526705 service nova] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Received event network-vif-plugged-c06038a3-0d97-4e8b-9b86-57f1bd5c5f51 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:14:46.627321 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5eaef27e-922e-404e-8c03-be620a48e949 req-4d18603d-5066-46f2-8ecd-0c6ceb526705 service nova] Acquiring lock "7b6daa1b-e2ee-41a5-8476-d478101a4a2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:14:46.627321 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5eaef27e-922e-404e-8c03-be620a48e949 req-4d18603d-5066-46f2-8ecd-0c6ceb526705 service nova] Lock "7b6daa1b-e2ee-41a5-8476-d478101a4a2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:14:46.627321 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5eaef27e-922e-404e-8c03-be620a48e949 req-4d18603d-5066-46f2-8ecd-0c6ceb526705 service nova] Lock "7b6daa1b-e2ee-41a5-8476-d478101a4a2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:14:46.627321 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5eaef27e-922e-404e-8c03-be620a48e949 req-4d18603d-5066-46f2-8ecd-0c6ceb526705 service nova] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] No waiting events found dispatching network-vif-plugged-c06038a3-0d97-4e8b-9b86-57f1bd5c5f51 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:14:46.627321 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-5eaef27e-922e-404e-8c03-be620a48e949 req-4d18603d-5066-46f2-8ecd-0c6ceb526705 service nova] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Received unexpected event network-vif-plugged-c06038a3-0d97-4e8b-9b86-57f1bd5c5f51 for instance with vm_state active and task_state None.
May 28 02:14:46.735508 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860, portal: 192.168.50.100,3260]
May 28 02:14:46.735508 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860, portal: 192.168.50.100,3260] successful.
May 28 02:14:46.735508 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:14:46.744736 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860, portal: 192.168.40.100,3260]
May 28 02:14:46.744736 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860, portal: 192.168.40.100,3260] successful.
May 28 02:14:46.744736 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:14:46.749485 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:14:46.755744 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:14:46.763589 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860 (non-flash)
May 28 02:14:46.763589 np0000001583 nova-compute[98241]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860 (non-flash)
May 28 02:14:46.763589 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:14:46.763849 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] iscsi session list stdout=tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860 (non-flash)
May 28 02:14:46.763849 np0000001583 nova-compute[98241]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860 (non-flash)
May 28 02:14:46.763849 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:14:46.764232 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.123s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:14:46.764424 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:14:46.765001 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] HCTL ('7', '-', '-', 0) found on session 228 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:14:46.765192 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:14:46.769379 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860 (non-flash)
May 28 02:14:46.769379 np0000001583 nova-compute[98241]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860 (non-flash)
May 28 02:14:46.769379 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:14:46.769488 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] iscsi session list stdout=tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860 (non-flash)
May 28 02:14:46.769488 np0000001583 nova-compute[98241]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860 (non-flash)
May 28 02:14:46.769488 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:14:46.769675 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.129s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:14:46.769768 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:14:46.770164 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] HCTL ('8', '-', '-', 0) found on session 229 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:14:46.770259 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:14:46.782009 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Searching for a device in session 228 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:14:46.782233 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7650b5b9-d11a-49dc-8e6d-20070e724860', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:14:46.785670 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Searching for a device in session 229 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:14:46.785670 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7650b5b9-d11a-49dc-8e6d-20070e724860', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:14:46.787665 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:47.109064 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:14:47.111008 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:14:47.128593 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-1b8c149e-ed99-497d-96e2-2c73b09cc829 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "7b6daa1b-e2ee-41a5-8476-d478101a4a2c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.082s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:14:47.641435 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 02:14:47.977860 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-020598e3-810a-493d-9e3e-f6cf692cd148 req-e294030f-8cd9-4506-9b01-727d2a2fbc6f service nova] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Received event network-changed-c06038a3-0d97-4e8b-9b86-57f1bd5c5f51 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:14:47.978310 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-020598e3-810a-493d-9e3e-f6cf692cd148 req-e294030f-8cd9-4506-9b01-727d2a2fbc6f service nova] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Refreshing instance network info cache due to event network-changed-c06038a3-0d97-4e8b-9b86-57f1bd5c5f51. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:14:47.978562 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-020598e3-810a-493d-9e3e-f6cf692cd148 req-e294030f-8cd9-4506-9b01-727d2a2fbc6f service nova] Acquiring lock "refresh_cache-7b6daa1b-e2ee-41a5-8476-d478101a4a2c" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:14:47.978640 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-020598e3-810a-493d-9e3e-f6cf692cd148 req-e294030f-8cd9-4506-9b01-727d2a2fbc6f service nova] Acquired lock "refresh_cache-7b6daa1b-e2ee-41a5-8476-d478101a4a2c" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:14:47.978805 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-020598e3-810a-493d-9e3e-f6cf692cd148 req-e294030f-8cd9-4506-9b01-727d2a2fbc6f service nova] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Refreshing network info cache for port c06038a3-0d97-4e8b-9b86-57f1bd5c5f51 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:14:48.481717 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-020598e3-810a-493d-9e3e-f6cf692cd148 req-e294030f-8cd9-4506-9b01-727d2a2fbc6f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:14:48.657565 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Found WWN 330000000f38928c2 for multipath device dm-0 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 02:14:48.657932 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.031s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:14:48.658211 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] <== connect_volume: return (4031ms) {'type': 'block', 'scsi_wwn': '330000000f38928c2', 'path': '/dev/dm-0', 'multipath_id': '330000000f38928c2'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:14:48.658422 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f38928c2', 'path': '/dev/dm-0', 'multipath_id': '330000000f38928c2'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 02:14:48.717171 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:48.769340 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-020598e3-810a-493d-9e3e-f6cf692cd148 req-e294030f-8cd9-4506-9b01-727d2a2fbc6f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:14:48.894551 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-020598e3-810a-493d-9e3e-f6cf692cd148 req-e294030f-8cd9-4506-9b01-727d2a2fbc6f service nova] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Updated VIF entry in instance network info cache for port c06038a3-0d97-4e8b-9b86-57f1bd5c5f51. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:14:48.894772 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-020598e3-810a-493d-9e3e-f6cf692cd148 req-e294030f-8cd9-4506-9b01-727d2a2fbc6f service nova] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Updating instance_info_cache with network_info: [{"id": "c06038a3-0d97-4e8b-9b86-57f1bd5c5f51", "address": "fa:16:3e:f6:24:64", "network": {"id": "3b938343-a65c-4ea6-9c96-be377e9fe646", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-19450663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b993c740f0114a22b4ec01fd0172dc89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc06038a3-0d", "ovs_interfaceid": "c06038a3-0d97-4e8b-9b86-57f1bd5c5f51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:14:49.164063 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:14:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-instance-748513095',display_name='tempest-instance-748513095',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-instance-748513095',id=82,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCEmLagGDAXkfIckrPFpMGIrnm3Mnfhnk/2guDvfzqGrfPPaRGvoapmrmnW0XsJNOQzawXRKT+2Iqx+ffkwYJU80FDBzQgMrxCINEs5fsFkIkU3XiKSGT4v6piUxTCC/GQ==',key_name='tempest-keypair-663479384',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e27ed5be47848cf82a89a18801a8cc2',ramdisk_id='',reservation_id='r-h5c0hnl9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-1928548083',owner_user_name='tempest-VolumesBackupsTest-1928548083-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:14:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c42b95d08c7244f69c4ae5171c4f38b8',uuid=d77db397-a74c-4916-a215-ae19b63f90ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cffb4a3e-54d4-491a-96c3-2a447f3397f4", "address": "fa:16:3e:3d:9e:0b", "network": {"id": "2520d56d-1ded-4ed5-87da-e2d4bab6272c", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1831941816-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e27ed5be47848cf82a89a18801a8cc2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcffb4a3e-54", "ovs_interfaceid": "cffb4a3e-54d4-491a-96c3-2a447f3397f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 02:14:49.164346 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Converting VIF {"id": "cffb4a3e-54d4-491a-96c3-2a447f3397f4", "address": "fa:16:3e:3d:9e:0b", "network": {"id": "2520d56d-1ded-4ed5-87da-e2d4bab6272c", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1831941816-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e27ed5be47848cf82a89a18801a8cc2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcffb4a3e-54", "ovs_interfaceid": "cffb4a3e-54d4-491a-96c3-2a447f3397f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:14:49.164838 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:9e:0b,bridge_name='br-int',has_traffic_filtering=True,id=cffb4a3e-54d4-491a-96c3-2a447f3397f4,network=Network(2520d56d-1ded-4ed5-87da-e2d4bab6272c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcffb4a3e-54') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:14:49.165523 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Lazy-loading 'pci_devices' on Instance uuid d77db397-a74c-4916-a215-ae19b63f90ec {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:14:49.396567 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-020598e3-810a-493d-9e3e-f6cf692cd148 req-e294030f-8cd9-4506-9b01-727d2a2fbc6f service nova] Releasing lock "refresh_cache-7b6daa1b-e2ee-41a5-8476-d478101a4a2c" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:14:49.668535 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] End _get_guest_xml xml=<domain type="qemu">
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:   <uuid>d77db397-a74c-4916-a215-ae19b63f90ec</uuid>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:   <name>instance-00000052</name>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:   <memory>196608</memory>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:   <vcpu>1</vcpu>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:   <metadata>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:       <nova:package version="33.1.0"/>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:       <nova:name>tempest-instance-748513095</nova:name>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:       <nova:creationTime>2026-05-28 02:14:44</nova:creationTime>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:       <nova:flavor name="m1.nano" id="42">
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:         <nova:memory>192</nova:memory>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:         <nova:disk>1</nova:disk>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:         <nova:swap>0</nova:swap>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:         <nova:ephemeral>0</nova:ephemeral>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:         <nova:vcpus>1</nova:vcpus>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:         <nova:extraSpecs>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:         </nova:extraSpecs>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:       </nova:flavor>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:       <nova:image uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690">
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:         <nova:minDisk>1</nova:minDisk>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:         <nova:minRam>0</nova:minRam>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:         <nova:properties>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:         </nova:properties>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:       </nova:image>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:       <nova:owner>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:         <nova:user uuid="c42b95d08c7244f69c4ae5171c4f38b8">tempest-VolumesBackupsTest-1928548083-project-member</nova:user>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:         <nova:project uuid="7e27ed5be47848cf82a89a18801a8cc2">tempest-VolumesBackupsTest-1928548083</nova:project>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:       </nova:owner>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:       <nova:root type="image" uuid="3aa57a53-c080-4a55-ba67-d70bf1ef7690"/>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:       <nova:ports>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:         <nova:port uuid="cffb4a3e-54d4-491a-96c3-2a447f3397f4">
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:         </nova:port>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:       </nova:ports>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:     </nova:instance>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:   </metadata>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:   <sysinfo type="smbios">
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:     <system>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:       <entry name="product">OpenStack Nova</entry>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:       <entry name="version">33.1.0</entry>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:       <entry name="serial">d77db397-a74c-4916-a215-ae19b63f90ec</entry>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:       <entry name="uuid">d77db397-a74c-4916-a215-ae19b63f90ec</entry>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:       <entry name="family">Virtual Machine</entry>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:     </system>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:   </sysinfo>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:   <os>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:     <boot dev="hd"/>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:     <smbios mode="sysinfo"/>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:   </os>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:   <features>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:     <acpi/>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:     <tcg>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:       <tb-cache unit="MiB">128</tb-cache>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:     </tcg>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:     <vmcoreinfo/>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:   </features>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:   <iothreads>1</iothreads>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:   <clock offset="utc"/>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:   <cpu mode="custom" match="exact">
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:     <model>Nehalem</model>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:     <topology sockets="1" cores="1" threads="1"/>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:   </cpu>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:   <devices>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:     <disk type="file" device="disk">
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/d77db397-a74c-4916-a215-ae19b63f90ec/disk"/>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:       <target dev="vda" bus="virtio"/>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:     </disk>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:     <disk type="file" device="cdrom">
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none"/>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:       <source file="/opt/stack/data/nova/instances/d77db397-a74c-4916-a215-ae19b63f90ec/disk.config"/>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:       <target dev="hda" bus="ide"/>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:     </disk>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:     <disk type="block" device="disk">
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:       <alias name="ua-7650b5b9-d11a-49dc-8e6d-20070e724860"/>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:       <source dev="/dev/dm-0"/>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:       <target dev="vdb" bus="virtio"/>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:       <serial>7650b5b9-d11a-49dc-8e6d-20070e724860</serial>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:     </disk>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:     <interface type="ethernet">
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:       <mac address="fa:16:3e:3d:9e:0b"/>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:       <driver name="qemu"/>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:       <mtu size="1372"/>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:       <target dev="tapcffb4a3e-54"/>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:     </interface>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:     <serial type="pty">
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:       <log file="/opt/stack/data/nova/instances/d77db397-a74c-4916-a215-ae19b63f90ec/console.log" append="off"/>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:     </serial>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:     <video>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:       <model type="virtio"/>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:     </video>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:     <rng model="virtio">
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:       <backend model="random">/dev/urandom</backend>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:     </rng>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:     <controller type="usb" index="0" model="none"/>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:       <stats period="10"/>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:     </memballoon>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:   </devices>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]: </domain>
May 28 02:14:49.668535 np0000001583 nova-compute[98241]:  {{(pid=98241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 02:14:49.670966 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Preparing to wait for external event network-vif-plugged-cffb4a3e-54d4-491a-96c3-2a447f3397f4 {{(pid=98241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 02:14:49.670966 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Acquiring lock "d77db397-a74c-4916-a215-ae19b63f90ec-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:14:49.670966 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Lock "d77db397-a74c-4916-a215-ae19b63f90ec-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:14:49.670966 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Lock "d77db397-a74c-4916-a215-ae19b63f90ec-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:14:49.670966 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:14:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-instance-748513095',display_name='tempest-instance-748513095',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-instance-748513095',id=82,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCEmLagGDAXkfIckrPFpMGIrnm3Mnfhnk/2guDvfzqGrfPPaRGvoapmrmnW0XsJNOQzawXRKT+2Iqx+ffkwYJU80FDBzQgMrxCINEs5fsFkIkU3XiKSGT4v6piUxTCC/GQ==',key_name='tempest-keypair-663479384',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e27ed5be47848cf82a89a18801a8cc2',ramdisk_id='',reservation_id='r-h5c0hnl9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-1928548083',owner_user_name='tempest-VolumesBackupsTest-1928548083-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T02:14:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c42b95d08c7244f69c4ae5171c4f38b8',uuid=d77db397-a74c-4916-a215-ae19b63f90ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cffb4a3e-54d4-491a-96c3-2a447f3397f4", "address": "fa:16:3e:3d:9e:0b", "network": {"id": "2520d56d-1ded-4ed5-87da-e2d4bab6272c", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1831941816-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e27ed5be47848cf82a89a18801a8cc2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcffb4a3e-54", "ovs_interfaceid": "cffb4a3e-54d4-491a-96c3-2a447f3397f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 02:14:49.670966 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Converting VIF {"id": "cffb4a3e-54d4-491a-96c3-2a447f3397f4", "address": "fa:16:3e:3d:9e:0b", "network": {"id": "2520d56d-1ded-4ed5-87da-e2d4bab6272c", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1831941816-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e27ed5be47848cf82a89a18801a8cc2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcffb4a3e-54", "ovs_interfaceid": "cffb4a3e-54d4-491a-96c3-2a447f3397f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:14:49.670966 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:9e:0b,bridge_name='br-int',has_traffic_filtering=True,id=cffb4a3e-54d4-491a-96c3-2a447f3397f4,network=Network(2520d56d-1ded-4ed5-87da-e2d4bab6272c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcffb4a3e-54') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:14:49.670966 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:9e:0b,bridge_name='br-int',has_traffic_filtering=True,id=cffb4a3e-54d4-491a-96c3-2a447f3397f4,network=Network(2520d56d-1ded-4ed5-87da-e2d4bab6272c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcffb4a3e-54') {{(pid=98241) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 02:14:49.670966 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:49.671299 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:14:49.671439 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 02:14:49.671948 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:49.672141 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3d9b5d58-3af7-5480-b14c-9bd5368f0b1e', '_type': 'linux-noop'}}, row=False) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:14:49.672937 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:49.673606 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:14:49.673849 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:49.675599 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:49.675757 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcffb4a3e-54, may_exist=True, interface_attrs={}) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:14:49.676043 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcffb4a3e-54, col_values=(('qos', UUID('4832e7c4-abd8-4d01-a227-fbe7a0f7856c')),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:14:49.676228 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcffb4a3e-54, col_values=(('external_ids', {'iface-id': 'cffb4a3e-54d4-491a-96c3-2a447f3397f4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:9e:0b', 'vm-uuid': 'd77db397-a74c-4916-a215-ae19b63f90ec'}),), if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:14:49.676949 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:49.677946 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:14:49.681737 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:49.682494 np0000001583 nova-compute[98241]: INFO os_vif [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:9e:0b,bridge_name='br-int',has_traffic_filtering=True,id=cffb4a3e-54d4-491a-96c3-2a447f3397f4,network=Network(2520d56d-1ded-4ed5-87da-e2d4bab6272c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcffb4a3e-54')
May 28 02:14:51.199969 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:14:51.200407 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:14:51.200407 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:14:51.200407 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] No VIF found with MAC fa:16:3e:3d:9e:0b, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:14:51.200733 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Using config drive
May 28 02:14:51.708239 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:14:51.813424 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Creating config drive at /opt/stack/data/nova/instances/d77db397-a74c-4916-a215-ae19b63f90ec/disk.config
May 28 02:14:51.817138 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d77db397-a74c-4916-a215-ae19b63f90ec/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpcf1losk0 {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:14:51.869658 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d77db397-a74c-4916-a215-ae19b63f90ec/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpcf1losk0" returned: 0 in 0.052s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:14:52.258144 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:52.283424 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:52.371097 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:52.441743 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-856fd4fd-2a8a-4250-893a-133cef32c6c5 req-4337480e-05af-47bf-b4ec-03bdac3e791b service nova] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Received event network-vif-plugged-cffb4a3e-54d4-491a-96c3-2a447f3397f4 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:14:52.442047 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-856fd4fd-2a8a-4250-893a-133cef32c6c5 req-4337480e-05af-47bf-b4ec-03bdac3e791b service nova] Acquiring lock "d77db397-a74c-4916-a215-ae19b63f90ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:14:52.442282 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-856fd4fd-2a8a-4250-893a-133cef32c6c5 req-4337480e-05af-47bf-b4ec-03bdac3e791b service nova] Lock "d77db397-a74c-4916-a215-ae19b63f90ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:14:52.442434 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-856fd4fd-2a8a-4250-893a-133cef32c6c5 req-4337480e-05af-47bf-b4ec-03bdac3e791b service nova] Lock "d77db397-a74c-4916-a215-ae19b63f90ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:14:52.442573 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-856fd4fd-2a8a-4250-893a-133cef32c6c5 req-4337480e-05af-47bf-b4ec-03bdac3e791b service nova] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Processing event network-vif-plugged-cffb4a3e-54d4-491a-96c3-2a447f3397f4 {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 02:14:52.743876 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:52.744598 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:52.746033 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:52.763699 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:53.036919 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934493.036477, d77db397-a74c-4916-a215-ae19b63f90ec => Started> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:14:53.037243 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 02:14:53.037403 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] VM Started (Lifecycle Event)
May 28 02:14:53.041139 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Guest created on hypervisor {{(pid=98241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 02:14:53.042600 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Instance spawned successfully.
May 28 02:14:53.042927 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 02:14:53.540471 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:14:53.542619 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:14:53.548751 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Found default for hw_cdrom_bus of ide {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:14:53.548929 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Found default for hw_disk_bus of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:14:53.549259 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Found default for hw_input_bus of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:14:53.549546 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Found default for hw_pointer_model of None {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:14:53.549848 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Found default for hw_video_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:14:53.550189 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Found default for hw_vif_model of virtio {{(pid=98241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 02:14:53.719999 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:54.044881 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 02:14:54.045197 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934494.0449784, d77db397-a74c-4916-a215-ae19b63f90ec => Paused> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:14:54.045352 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] VM Paused (Lifecycle Event)
May 28 02:14:54.054259 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Took 9.92 seconds to spawn the instance on the hypervisor.
May 28 02:14:54.054405 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:14:54.494657 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d53d51eb-3650-4aaf-bd42-247eda7235a5 req-395a5cb5-6b85-4c28-9208-0b1856d78226 service nova] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Received event network-vif-plugged-cffb4a3e-54d4-491a-96c3-2a447f3397f4 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:14:54.494657 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d53d51eb-3650-4aaf-bd42-247eda7235a5 req-395a5cb5-6b85-4c28-9208-0b1856d78226 service nova] Acquiring lock "d77db397-a74c-4916-a215-ae19b63f90ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:14:54.494657 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d53d51eb-3650-4aaf-bd42-247eda7235a5 req-395a5cb5-6b85-4c28-9208-0b1856d78226 service nova] Lock "d77db397-a74c-4916-a215-ae19b63f90ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:14:54.494657 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-d53d51eb-3650-4aaf-bd42-247eda7235a5 req-395a5cb5-6b85-4c28-9208-0b1856d78226 service nova] Lock "d77db397-a74c-4916-a215-ae19b63f90ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:14:54.494657 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-d53d51eb-3650-4aaf-bd42-247eda7235a5 req-395a5cb5-6b85-4c28-9208-0b1856d78226 service nova] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] No waiting events found dispatching network-vif-plugged-cffb4a3e-54d4-491a-96c3-2a447f3397f4 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:14:54.494657 np0000001583 nova-compute[98241]: WARNING nova.compute.manager [req-d53d51eb-3650-4aaf-bd42-247eda7235a5 req-395a5cb5-6b85-4c28-9208-0b1856d78226 service nova] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Received unexpected event network-vif-plugged-cffb4a3e-54d4-491a-96c3-2a447f3397f4 for instance with vm_state active and task_state None.
May 28 02:14:54.547628 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:14:54.549827 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Emitting event <LifecycleEvent: 1779934494.5496137, d77db397-a74c-4916-a215-ae19b63f90ec => Resumed> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:14:54.549959 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] VM Resumed (Lifecycle Event)
May 28 02:14:54.563144 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Took 19.00 seconds to build instance.
May 28 02:14:54.685519 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:55.052192 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:14:55.054340 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98241) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 02:14:55.064501 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Lock "d77db397-a74c-4916-a215-ae19b63f90ec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.508s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:14:56.193992 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:14:56.549234 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2f59903c-2280-4f43-bb12-cda53cb0ac54 req-314c4b97-6e51-4c32-8a57-7594030cbbbb service nova] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Received event network-changed-cffb4a3e-54d4-491a-96c3-2a447f3397f4 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:14:56.549403 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-2f59903c-2280-4f43-bb12-cda53cb0ac54 req-314c4b97-6e51-4c32-8a57-7594030cbbbb service nova] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Refreshing instance network info cache due to event network-changed-cffb4a3e-54d4-491a-96c3-2a447f3397f4. {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 02:14:56.549641 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2f59903c-2280-4f43-bb12-cda53cb0ac54 req-314c4b97-6e51-4c32-8a57-7594030cbbbb service nova] Acquiring lock "refresh_cache-d77db397-a74c-4916-a215-ae19b63f90ec" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:14:56.549725 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2f59903c-2280-4f43-bb12-cda53cb0ac54 req-314c4b97-6e51-4c32-8a57-7594030cbbbb service nova] Acquired lock "refresh_cache-d77db397-a74c-4916-a215-ae19b63f90ec" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:14:56.549853 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-2f59903c-2280-4f43-bb12-cda53cb0ac54 req-314c4b97-6e51-4c32-8a57-7594030cbbbb service nova] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Refreshing network info cache for port cffb4a3e-54d4-491a-96c3-2a447f3397f4 {{(pid=98241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 02:14:56.695809 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 30.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:14:57.051795 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-2f59903c-2280-4f43-bb12-cda53cb0ac54 req-314c4b97-6e51-4c32-8a57-7594030cbbbb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:14:57.307680 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [req-2f59903c-2280-4f43-bb12-cda53cb0ac54 req-314c4b97-6e51-4c32-8a57-7594030cbbbb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:14:57.436071 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-2f59903c-2280-4f43-bb12-cda53cb0ac54 req-314c4b97-6e51-4c32-8a57-7594030cbbbb service nova] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Updated VIF entry in instance network info cache for port cffb4a3e-54d4-491a-96c3-2a447f3397f4. {{(pid=98241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 02:14:57.436450 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [req-2f59903c-2280-4f43-bb12-cda53cb0ac54 req-314c4b97-6e51-4c32-8a57-7594030cbbbb service nova] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Updating instance_info_cache with network_info: [{"id": "cffb4a3e-54d4-491a-96c3-2a447f3397f4", "address": "fa:16:3e:3d:9e:0b", "network": {"id": "2520d56d-1ded-4ed5-87da-e2d4bab6272c", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1831941816-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e27ed5be47848cf82a89a18801a8cc2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcffb4a3e-54", "ovs_interfaceid": "cffb4a3e-54d4-491a-96c3-2a447f3397f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:14:57.938343 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-2f59903c-2280-4f43-bb12-cda53cb0ac54 req-314c4b97-6e51-4c32-8a57-7594030cbbbb service nova] Releasing lock "refresh_cache-d77db397-a74c-4916-a215-ae19b63f90ec" {{(pid=98241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:14:58.720470 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:14:59.704509 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:15:03.721921 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:15:04.706215 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:15:08.723211 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:15:09.719597 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:15:13.725067 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:15:14.728958 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:15:15.291733 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "7b6daa1b-e2ee-41a5-8476-d478101a4a2c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:15:15.291733 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "7b6daa1b-e2ee-41a5-8476-d478101a4a2c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:15:15.796386 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lazy-loading 'flavor' on Instance uuid 7b6daa1b-e2ee-41a5-8476-d478101a4a2c {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:15:16.800468 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "7b6daa1b-e2ee-41a5-8476-d478101a4a2c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:15:17.857837 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "7b6daa1b-e2ee-41a5-8476-d478101a4a2c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:15:17.858235 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "7b6daa1b-e2ee-41a5-8476-d478101a4a2c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:15:17.858346 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Attaching volume e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5 to /dev/vdb
May 28 02:15:17.905490 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.170', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001583', 'execute': None}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:15:17.917489 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.scaleio [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98241) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 02:15:17.941241 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Running cmd (subprocess): nvme version {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:15:17.990751 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] 'nvme version' failed. Not Retrying. {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 02:15:17.991001 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] nvme not present on system {{(pid=98241) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 02:15:17.999808 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98241) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 02:15:18.000720 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.lightos [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Current host hostNQN  and IP(s) are ['10.4.3.170', 'fe80::f816:3eff:fe8f:393c', '192.168.40.6', 'fe80::f816:3eff:febe:af8f', '192.168.50.6', 'fe80::f816:3eff:fec9:d59c', '192.168.10.6', 'fe80::f816:3eff:fef0:153b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::809f:fdff:fe74:5046', 'fe80::fc16:3eff:fef6:2464', 'fe80::d05c:d0ff:fe98:b4ef', 'fe80::fc16:3eff:fe3d:9e0b', 'fe80::3428:65ff:fe18:3864'] 
May 28 02:15:18.000876 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 02:15:18.000959 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.lightos [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] LIGHTOS: no hostnqn found. {{(pid=98241) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 02:15:18.001183 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] <== get_connector_properties: return (95ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.170', 'host': 'np0000001583', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d83c7d1661d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0fbeada7-265e-4536-bdd8-74ffd44032fb', 'nvme_native_multipath': False} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:15:18.001415 np0000001583 nova-compute[98241]: DEBUG nova.virt.block_device [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Updating existing volume attachment record: fb3f7e8e-b507-403c-8ab1-2b0cc1781bfe {{(pid=98241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 02:15:18.490931 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Acquiring lock "d77db397-a74c-4916-a215-ae19b63f90ec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:15:18.491213 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Lock "d77db397-a74c-4916-a215-ae19b63f90ec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:15:18.491466 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Acquiring lock "d77db397-a74c-4916-a215-ae19b63f90ec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:15:18.491653 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Lock "d77db397-a74c-4916-a215-ae19b63f90ec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:15:18.491863 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Lock "d77db397-a74c-4916-a215-ae19b63f90ec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:15:18.494549 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Terminating instance
May 28 02:15:18.547105 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Calling os-brick to attach iSCSI Volume {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 02:15:18.547482 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5', 'iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:15:18.547656 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:15:18.548101 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:15:18.548341 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5', 'iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 02:15:18.561006 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:15:18.561751 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:15:18.562396 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:15:18.562674 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:15:18.563278 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:15:18.563489 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:15:18.573169 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:15:18.573169 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:15:18.579431 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 02:15:18.579431 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:15:18.587506 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5] added
May 28 02:15:18.587506 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:15:18.587506 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:15:18.587506 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:15:18.587506 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:15:18.587506 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:15:18.587506 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:15:18.587828 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:15:18.587828 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0256(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:15:18.588026 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:15:18.591399 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5] added
May 28 02:15:18.591399 np0000001583 nova-compute[98241]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 02:15:18.591399 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:15:18.591399 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:15:18.591399 np0000001583 nova-compute[98241]: iscsiadm: Config file line 363 does not have value
May 28 02:15:18.591399 np0000001583 nova-compute[98241]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 02:15:18.591399 np0000001583 nova-compute[98241]:  {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:15:18.591587 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98241) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 02:15:18.591814 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0283(s), this was the 1st time calling it. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 02:15:18.592006 np0000001583 nova-compute[98241]: DEBUG os_brick.utils [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98241) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 02:15:18.725174 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:15:18.998485 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 02:15:19.013376 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:15:19.018439 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:15:19.029439 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:15:19.034732 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:15:19.053354 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:15:19.160010 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5bfaba4c-7139-4912-a5af-0b4a9431cb5e req-6e7c344f-bb13-4600-9222-fba3e955310e service nova] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Received event network-vif-unplugged-cffb4a3e-54d4-491a-96c3-2a447f3397f4 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:15:19.160193 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5bfaba4c-7139-4912-a5af-0b4a9431cb5e req-6e7c344f-bb13-4600-9222-fba3e955310e service nova] Acquiring lock "d77db397-a74c-4916-a215-ae19b63f90ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:15:19.160349 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5bfaba4c-7139-4912-a5af-0b4a9431cb5e req-6e7c344f-bb13-4600-9222-fba3e955310e service nova] Lock "d77db397-a74c-4916-a215-ae19b63f90ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:15:19.160467 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-5bfaba4c-7139-4912-a5af-0b4a9431cb5e req-6e7c344f-bb13-4600-9222-fba3e955310e service nova] Lock "d77db397-a74c-4916-a215-ae19b63f90ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:15:19.160577 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5bfaba4c-7139-4912-a5af-0b4a9431cb5e req-6e7c344f-bb13-4600-9222-fba3e955310e service nova] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] No waiting events found dispatching network-vif-unplugged-cffb4a3e-54d4-491a-96c3-2a447f3397f4 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:15:19.160686 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-5bfaba4c-7139-4912-a5af-0b4a9431cb5e req-6e7c344f-bb13-4600-9222-fba3e955310e service nova] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Received event network-vif-unplugged-cffb4a3e-54d4-491a-96c3-2a447f3397f4 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:15:19.361221 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.99961099300026 future=<Future at 0x7724f814e1e0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:15:19.361579 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999196187000052 future=<Future at 0x7724f814e1e0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:15:19.361753 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999006736999945 future=<Future at 0x7724f814e1e0 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:15:19.363733 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Instance destroyed successfully.
May 28 02:15:19.364327 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Lazy-loading 'resources' on Instance uuid d77db397-a74c-4916-a215-ae19b63f90ec {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:15:19.588392 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 02:15:19.592492 np0000001583 nova-compute[98241]: INFO os_brick.initiator.connectors.iscsi [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.40.100
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:15:19.599816 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:15:19.599816 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: node.name = iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: node.tpgt = -1
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: node.startup = manual
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: node.leading_login = No
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.iscsi_ifacename = default
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.net_ifacename = <empty>
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.ipaddress = <empty>
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.prefix_len = 0
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.hwaddress = <empty>
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.transport_name = tcp
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.initiatorname = <empty>
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.state = <empty>
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.vlan_id = 0
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.vlan_priority = 0
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.vlan_state = <empty>
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.iface_num = 0
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.mtu = 0
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.port = 0
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.bootproto = <empty>
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.subnet_mask = <empty>
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.gateway = <empty>
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id_state = <empty>
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.dhcp_alt_client_id = <empty>
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.dhcp_dns = <empty>
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.dhcp_learn_iqn = <empty>
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.dhcp_req_vendor_id_state = <empty>
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id_state = <empty>
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.dhcp_vendor_id = <empty>
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.dhcp_slp_da = <empty>
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.fragmentation = <empty>
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.gratuitous_arp = <empty>
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.incoming_forwarding = <empty>
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.tos_state = <empty>
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.tos = 0
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.ttl = 0
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.delayed_ack = <empty>
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.tcp_nagle = <empty>
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.tcp_wsf_state = <empty>
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.tcp_wsf = 0
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.tcp_timer_scale = 0
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.tcp_timestamp = <empty>
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.redirect = <empty>
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.def_task_mgmt_timeout = 0
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.header_digest = <empty>
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.data_digest = <empty>
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.immediate_data = <empty>
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.initial_r2t = <empty>
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.data_seq_inorder = <empty>
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.data_pdu_inorder = <empty>
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.erl = 0
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.max_receive_data_len = 0
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.first_burst_len = 0
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.max_outstanding_r2t = 0
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.max_burst_len = 0
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.chap_auth = <empty>
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.bidi_chap = <empty>
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.strict_login_compliance = <empty>
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.discovery_auth = <empty>
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: iface.discovery_logout = <empty>
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: node.discovery_address = <empty>
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: node.discovery_port = 0
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: node.discovery_type = fw
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: node.session.initial_cmdsn = 0
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: node.session.initial_login_retry_max = 8
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: node.session.xmit_thread_priority = 0
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: node.session.cmds_max = 128
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: node.session.queue_depth = 32
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: node.session.nr_sessions = 1
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: node.session.auth.authmethod = None
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: node.session.auth.username = <empty>
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: node.session.auth.password = ***
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: node.session.auth.username_in = <empty>
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: node.session.auth.password_in = <empty>
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: node.session.auth.chap_algs = SHA256
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: node.session.timeo.replacement_timeout = 120
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: node.session.err_timeo.abort_timeout = 15
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: node.session.err_timeo.lu_reset_timeout = 30
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: node.session.err_timeo.host_reset_timeout = 60
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: node.session.iscsi.FastAbort = Yes
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: node.session.iscsi.InitialR2T = No
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: node.session.iscsi.ImmediateData = Yes
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: node.session.iscsi.FirstBurstLength = 262144
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: node.session.iscsi.MaxBurstLength = 16776192
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Retain = 0
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: node.session.iscsi.DefaultTime2Wait = 2
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: node.session.iscsi.MaxConnections = 1
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: node.session.iscsi.ERL = 0
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: node.session.scan = auto
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: node.session.reopen_max = 0
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: node.conn[0].address = 192.168.50.100
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: node.conn[0].port = 3260
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: node.conn[0].startup = manual
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: node.conn[0].tcp.window_size = 524288
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: node.conn[0].tcp.type_of_service = 0
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: node.conn[0].timeo.logout_timeout = 15
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: node.conn[0].timeo.login_timeout = 15
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: node.conn[0].timeo.auth_timeout = 45
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_interval = 5
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: node.conn[0].timeo.noop_out_timeout = 5
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: node.conn[0].iscsi.HeaderDigest = None
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: node.conn[0].iscsi.DataDigest = None
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: node.conn[0].iscsi.IFMarker = No
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: node.conn[0].iscsi.OFMarker = No
May 28 02:15:19.604869 np0000001583 nova-compute[98241]: # END RECORD
May 28 02:15:19.604869 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:15:19.611097 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:15:19.615904 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:15:19.623782 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860 (non-flash)
May 28 02:15:19.623782 np0000001583 nova-compute[98241]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860 (non-flash)
May 28 02:15:19.623782 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:15:19.623924 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsi session list stdout=tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860 (non-flash)
May 28 02:15:19.623924 np0000001583 nova-compute[98241]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860 (non-flash)
May 28 02:15:19.623924 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:15:19.629188 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860 (non-flash)
May 28 02:15:19.629188 np0000001583 nova-compute[98241]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860 (non-flash)
May 28 02:15:19.629188 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:15:19.629322 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsi session list stdout=tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860 (non-flash)
May 28 02:15:19.629322 np0000001583 nova-compute[98241]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860 (non-flash)
May 28 02:15:19.629322 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:15:19.655537 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5, portal: 192.168.40.100,3260]
May 28 02:15:19.655537 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5, portal: 192.168.40.100,3260] successful.
May 28 02:15:19.655537 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:15:19.656018 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5, portal: 192.168.50.100,3260]
May 28 02:15:19.656018 np0000001583 nova-compute[98241]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5, portal: 192.168.50.100,3260] successful.
May 28 02:15:19.656018 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:15:19.667350 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:15:19.671298 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:15:19.678865 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860 (non-flash)
May 28 02:15:19.678865 np0000001583 nova-compute[98241]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860 (non-flash)
May 28 02:15:19.678865 np0000001583 nova-compute[98241]: tcp: [230] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5 (non-flash)
May 28 02:15:19.678865 np0000001583 nova-compute[98241]: tcp: [231] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5 (non-flash)
May 28 02:15:19.678865 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:15:19.679066 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsi session list stdout=tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860 (non-flash)
May 28 02:15:19.679066 np0000001583 nova-compute[98241]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860 (non-flash)
May 28 02:15:19.679066 np0000001583 nova-compute[98241]: tcp: [230] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5 (non-flash)
May 28 02:15:19.679066 np0000001583 nova-compute[98241]: tcp: [231] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5 (non-flash)
May 28 02:15:19.679066 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:15:19.679328 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.118s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:15:19.679473 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Connected to 192.168.40.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:15:19.680248 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] HCTL ('9', '-', '-', 0) found on session 230 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:15:19.680381 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:15:19.684653 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860 (non-flash)
May 28 02:15:19.684653 np0000001583 nova-compute[98241]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860 (non-flash)
May 28 02:15:19.684653 np0000001583 nova-compute[98241]: tcp: [230] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5 (non-flash)
May 28 02:15:19.684653 np0000001583 nova-compute[98241]: tcp: [231] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5 (non-flash)
May 28 02:15:19.684653 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:15:19.684853 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsi session list stdout=tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860 (non-flash)
May 28 02:15:19.684853 np0000001583 nova-compute[98241]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860 (non-flash)
May 28 02:15:19.684853 np0000001583 nova-compute[98241]: tcp: [230] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5 (non-flash)
May 28 02:15:19.684853 np0000001583 nova-compute[98241]: tcp: [231] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5 (non-flash)
May 28 02:15:19.684853 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:15:19.685065 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.122s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:15:19.685225 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Connected to 192.168.50.100:3260 {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 02:15:19.685861 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] HCTL ('10', '-', '-', 0) found on session 231 with lun 0 {{(pid=98241) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 02:15:19.685987 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98241) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 02:15:19.694606 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Searching for a device in session 230 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:15:19.694606 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:15:19.700114 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Searching for a device in session 231 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98241) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 02:15:19.700114 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98241) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 02:15:19.730443 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:15:19.869145 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T02:14:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-instance-748513095',display_name='tempest-instance-748513095',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-instance-748513095',id=82,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCEmLagGDAXkfIckrPFpMGIrnm3Mnfhnk/2guDvfzqGrfPPaRGvoapmrmnW0XsJNOQzawXRKT+2Iqx+ffkwYJU80FDBzQgMrxCINEs5fsFkIkU3XiKSGT4v6piUxTCC/GQ==',key_name='tempest-keypair-663479384',keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:14:54Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7e27ed5be47848cf82a89a18801a8cc2',ramdisk_id='',reservation_id='r-h5c0hnl9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesBackupsTest-1928548083',owner_user_name='tempest-VolumesBackupsTest-1928548083-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T02:14:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c42b95d08c7244f69c4ae5171c4f38b8',uuid=d77db397-a74c-4916-a215-ae19b63f90ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cffb4a3e-54d4-491a-96c3-2a447f3397f4", "address": "fa:16:3e:3d:9e:0b", "network": {"id": "2520d56d-1ded-4ed5-87da-e2d4bab6272c", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1831941816-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e27ed5be47848cf82a89a18801a8cc2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcffb4a3e-54", "ovs_interfaceid": "cffb4a3e-54d4-491a-96c3-2a447f3397f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:15:19.869502 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Converting VIF {"id": "cffb4a3e-54d4-491a-96c3-2a447f3397f4", "address": "fa:16:3e:3d:9e:0b", "network": {"id": "2520d56d-1ded-4ed5-87da-e2d4bab6272c", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1831941816-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e27ed5be47848cf82a89a18801a8cc2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcffb4a3e-54", "ovs_interfaceid": "cffb4a3e-54d4-491a-96c3-2a447f3397f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:15:19.870141 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:9e:0b,bridge_name='br-int',has_traffic_filtering=True,id=cffb4a3e-54d4-491a-96c3-2a447f3397f4,network=Network(2520d56d-1ded-4ed5-87da-e2d4bab6272c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcffb4a3e-54') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:15:19.870420 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:9e:0b,bridge_name='br-int',has_traffic_filtering=True,id=cffb4a3e-54d4-491a-96c3-2a447f3397f4,network=Network(2520d56d-1ded-4ed5-87da-e2d4bab6272c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcffb4a3e-54') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:15:19.871693 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:15:19.871874 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcffb4a3e-54, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:15:19.872864 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:15:19.874055 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:15:19.874550 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:15:19.874699 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4832e7c4-abd8-4d01-a227-fbe7a0f7856c) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:15:19.875369 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:15:19.875751 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:15:19.875953 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:15:19.877710 np0000001583 nova-compute[98241]: INFO os_vif [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:9e:0b,bridge_name='br-int',has_traffic_filtering=True,id=cffb4a3e-54d4-491a-96c3-2a447f3397f4,network=Network(2520d56d-1ded-4ed5-87da-e2d4bab6272c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcffb4a3e-54')
May 28 02:15:19.879211 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:15:19.879514 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860', 'iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7650b5b9-d11a-49dc-8e6d-20070e724860', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:15:19.879647 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:15:20.563134 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 02:15:21.217718 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-332e5e3e-1163-4616-819a-5a59d8d534f2 req-aa502050-5301-4e84-b037-d33676d07bf3 service nova] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Received event network-vif-unplugged-cffb4a3e-54d4-491a-96c3-2a447f3397f4 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:15:21.218181 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-332e5e3e-1163-4616-819a-5a59d8d534f2 req-aa502050-5301-4e84-b037-d33676d07bf3 service nova] Acquiring lock "d77db397-a74c-4916-a215-ae19b63f90ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:15:21.218384 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-332e5e3e-1163-4616-819a-5a59d8d534f2 req-aa502050-5301-4e84-b037-d33676d07bf3 service nova] Lock "d77db397-a74c-4916-a215-ae19b63f90ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:15:21.218541 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-332e5e3e-1163-4616-819a-5a59d8d534f2 req-aa502050-5301-4e84-b037-d33676d07bf3 service nova] Lock "d77db397-a74c-4916-a215-ae19b63f90ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:15:21.218669 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-332e5e3e-1163-4616-819a-5a59d8d534f2 req-aa502050-5301-4e84-b037-d33676d07bf3 service nova] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] No waiting events found dispatching network-vif-unplugged-cffb4a3e-54d4-491a-96c3-2a447f3397f4 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:15:21.218780 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-332e5e3e-1163-4616-819a-5a59d8d534f2 req-aa502050-5301-4e84-b037-d33676d07bf3 service nova] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Received event network-vif-unplugged-cffb4a3e-54d4-491a-96c3-2a447f3397f4 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:15:21.581856 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Found WWN 330000000821582f9 for multipath device dm-3 {{(pid=98241) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 02:15:21.582285 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:15:21.582285 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] <== connect_volume: return (3034ms) {'type': 'block', 'scsi_wwn': '330000000821582f9', 'path': '/dev/dm-3', 'multipath_id': '330000000821582f9'} {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:15:21.582396 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000821582f9', 'path': '/dev/dm-3', 'multipath_id': '330000000821582f9'} {{(pid=98241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 02:15:21.582754 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.703s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:15:21.583190 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860', 'iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7650b5b9-d11a-49dc-8e6d-20070e724860', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:15:21.583335 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:15:21.585030 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lazy-loading 'flavor' on Instance uuid 7b6daa1b-e2ee-41a5-8476-d478101a4a2c {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:15:21.606806 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860 (non-flash)
May 28 02:15:21.606806 np0000001583 nova-compute[98241]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860 (non-flash)
May 28 02:15:21.606806 np0000001583 nova-compute[98241]: tcp: [230] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5 (non-flash)
May 28 02:15:21.606806 np0000001583 nova-compute[98241]: tcp: [231] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5 (non-flash)
May 28 02:15:21.606806 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:15:21.607003 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] iscsi session list stdout=tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860 (non-flash)
May 28 02:15:21.607003 np0000001583 nova-compute[98241]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860 (non-flash)
May 28 02:15:21.607003 np0000001583 nova-compute[98241]: tcp: [230] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5 (non-flash)
May 28 02:15:21.607003 np0000001583 nova-compute[98241]: tcp: [231] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5 (non-flash)
May 28 02:15:21.607003 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:15:21.607165 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860', '228'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860', '229'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5', '230'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5', '231')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:15:21.607254 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860', '229')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:15:21.608007 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860', '228')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:15:21.608636 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724f829c0e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860'): ({'sdb'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:15:21.608812 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Removing multipathed devices sdc, sdb {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:15:21.609006 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Flush multipath device 330000000f38928c2 {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:15:21.674232 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:15:21.719515 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:15:21.769365 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:15:21.769531 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:15:21.770161 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:15:21.781093 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:15:21.781306 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:15:21.791469 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:15:21.818595 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 229, target: iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860, portal: 192.168.40.100,3260]
May 28 02:15:21.818595 np0000001583 nova-compute[98241]: Logout of [sid: 229, target: iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860, portal: 192.168.40.100,3260] successful.
May 28 02:15:21.818595 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:15:21.831353 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:15:21.843641 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:15:21.871878 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 228, target: iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860, portal: 192.168.50.100,3260]
May 28 02:15:21.871878 np0000001583 nova-compute[98241]: Logout of [sid: 228, target: iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860, portal: 192.168.50.100,3260] successful.
May 28 02:15:21.871878 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:15:21.883634 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:15:21.883819 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:15:21.883919 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] <== disconnect_volume: return (2004ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:15:21.884025 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:15:21.884320 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Deleting instance files /opt/stack/data/nova/instances/d77db397-a74c-4916-a215-ae19b63f90ec_del
May 28 02:15:21.884928 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Deletion of /opt/stack/data/nova/instances/d77db397-a74c-4916-a215-ae19b63f90ec_del complete
May 28 02:15:22.087662 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Attempting to attach volume e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98241) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 02:15:22.090581 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] attach device xml: <disk type="block" device="disk">
May 28 02:15:22.090581 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:15:22.090581 np0000001583 nova-compute[98241]:   <alias name="ua-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5"/>
May 28 02:15:22.090581 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-3"/>
May 28 02:15:22.090581 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:15:22.090581 np0000001583 nova-compute[98241]:   <serial>e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5</serial>
May 28 02:15:22.090581 np0000001583 nova-compute[98241]:   <shareable/>
May 28 02:15:22.090581 np0000001583 nova-compute[98241]: </disk>
May 28 02:15:22.090581 np0000001583 nova-compute[98241]:  {{(pid=98241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 02:15:22.393984 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Took 3.40 seconds to destroy the instance on the hypervisor.
May 28 02:15:22.394568 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 02:15:22.394854 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 02:15:22.394997 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 02:15:22.395260 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:15:22.488477 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:15:22.807869 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:15:22.872216 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-749c56e8-473d-4589-8a81-b6283af20e32 req-ea671603-3c10-4b80-8772-f4784672b1c9 service nova] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Received event network-vif-deleted-cffb4a3e-54d4-491a-96c3-2a447f3397f4 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:15:22.874341 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-749c56e8-473d-4589-8a81-b6283af20e32 req-ea671603-3c10-4b80-8772-f4784672b1c9 service nova] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Neutron deleted interface cffb4a3e-54d4-491a-96c3-2a447f3397f4; detaching it from the instance and deleting it from the info cache
May 28 02:15:22.875058 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-749c56e8-473d-4589-8a81-b6283af20e32 req-ea671603-3c10-4b80-8772-f4784672b1c9 service nova] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Detach interface failed, port_id=cffb4a3e-54d4-491a-96c3-2a447f3397f4, reason: Instance d77db397-a74c-4916-a215-ae19b63f90ec could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 02:15:23.333146 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:15:23.730369 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] No BDM found with device name vda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:15:23.730520 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:15:23.730562 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] No BDM found with device name hda, not building metadata. {{(pid=98241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 02:15:23.730684 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] No VIF found with MAC fa:16:3e:f6:24:64, not building metadata {{(pid=98241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 02:15:23.834674 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Took 1.44 seconds to deallocate network for instance.
May 28 02:15:24.378172 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Took 0.54 seconds to detach 1 volumes for instance.
May 28 02:15:24.883295 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:15:24.883781 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:15:24.886981 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:15:24.961377 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Refreshing inventories for resource provider cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 28 02:15:24.997299 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Updating ProviderTree inventory for provider cfa1af79-477d-460a-869d-84a19fa91765 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 28 02:15:24.997446 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Updating inventory in ProviderTree for provider cfa1af79-477d-460a-869d-84a19fa91765 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 28 02:15:25.033092 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Refreshing aggregate associations for resource provider cfa1af79-477d-460a-869d-84a19fa91765, aggregates: None {{(pid=98241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 28 02:15:25.074369 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Refreshing trait associations for resource provider cfa1af79-477d-460a-869d-84a19fa91765, traits: COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_NET_VIF_MODEL_IGB,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_ARCH_AARCH64,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_ARCH_S390X,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ARCH_MIPSEL,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,COMPUTE_SOUND_MODEL_USB,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ARCH_X86_64,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ARCH_RISCV64,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ARCH_PPC64LE,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_SOUND_MODEL_SB16,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_SOUND_MODEL_AC97,COMPUTE_RESCUE_BFV,HW_ARCH_X86_64,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=98241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 28 02:15:25.193522 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:15:25.193721 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:15:25.270586 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-e3173ed2-721d-488b-9d3d-df2ec93190dc tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "7b6daa1b-e2ee-41a5-8476-d478101a4a2c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.412s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:15:25.696100 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:15:25.920438 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6f5b1a32-26ba-4f0e-a474-9a256d992bd0 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "7b6daa1b-e2ee-41a5-8476-d478101a4a2c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:15:25.920783 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6f5b1a32-26ba-4f0e-a474-9a256d992bd0 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "7b6daa1b-e2ee-41a5-8476-d478101a4a2c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:15:26.201997 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.318s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:15:26.244351 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Deleted allocations for instance d77db397-a74c-4916-a215-ae19b63f90ec
May 28 02:15:26.422950 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-6f5b1a32-26ba-4f0e-a474-9a256d992bd0 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Detaching volume e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5
May 28 02:15:26.457521 np0000001583 nova-compute[98241]: INFO nova.virt.block_device [None req-6f5b1a32-26ba-4f0e-a474-9a256d992bd0 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Attempting to driver detach volume e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5 from mountpoint /dev/vdb
May 28 02:15:26.462623 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6f5b1a32-26ba-4f0e-a474-9a256d992bd0 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Found disk vdb by alias ua-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:15:26.464090 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6f5b1a32-26ba-4f0e-a474-9a256d992bd0 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Found disk vdb by alias ua-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5 {{(pid=98241) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 02:15:26.464281 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6f5b1a32-26ba-4f0e-a474-9a256d992bd0 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Attempting to detach device vdb from instance 7b6daa1b-e2ee-41a5-8476-d478101a4a2c from the persistent domain config. {{(pid=98241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 02:15:26.464585 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-6f5b1a32-26ba-4f0e-a474-9a256d992bd0 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:15:26.464585 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:15:26.464585 np0000001583 nova-compute[98241]:   <alias name="ua-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5"/>
May 28 02:15:26.464585 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-3"/>
May 28 02:15:26.464585 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:15:26.464585 np0000001583 nova-compute[98241]:   <serial>e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5</serial>
May 28 02:15:26.464585 np0000001583 nova-compute[98241]:   <shareable/>
May 28 02:15:26.464585 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 02:15:26.464585 np0000001583 nova-compute[98241]: </disk>
May 28 02:15:26.464585 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:15:26.469809 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-6f5b1a32-26ba-4f0e-a474-9a256d992bd0 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Successfully detached device vdb from instance 7b6daa1b-e2ee-41a5-8476-d478101a4a2c from the persistent domain config.
May 28 02:15:26.469981 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6f5b1a32-26ba-4f0e-a474-9a256d992bd0 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] (1/8): Attempting to detach device vdb with device alias ua-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5 from instance 7b6daa1b-e2ee-41a5-8476-d478101a4a2c from the live domain config. {{(pid=98241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 02:15:26.470294 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.guest [None req-6f5b1a32-26ba-4f0e-a474-9a256d992bd0 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] detach device xml: <disk type="block" device="disk">
May 28 02:15:26.470294 np0000001583 nova-compute[98241]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 02:15:26.470294 np0000001583 nova-compute[98241]:   <alias name="ua-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5"/>
May 28 02:15:26.470294 np0000001583 nova-compute[98241]:   <source dev="/dev/dm-3"/>
May 28 02:15:26.470294 np0000001583 nova-compute[98241]:   <target dev="vdb" bus="virtio"/>
May 28 02:15:26.470294 np0000001583 nova-compute[98241]:   <serial>e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5</serial>
May 28 02:15:26.470294 np0000001583 nova-compute[98241]:   <shareable/>
May 28 02:15:26.470294 np0000001583 nova-compute[98241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 02:15:26.470294 np0000001583 nova-compute[98241]: </disk>
May 28 02:15:26.470294 np0000001583 nova-compute[98241]:  {{(pid=98241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 02:15:26.695121 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:15:26.695390 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.50 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:15:26.916977 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Received event <DeviceRemovedEvent: 1779934526.9165788, 7b6daa1b-e2ee-41a5-8476-d478101a4a2c => ua-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5> from libvirt while the driver is waiting for it; dispatched. {{(pid=98241) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 02:15:26.917961 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-6f5b1a32-26ba-4f0e-a474-9a256d992bd0 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5 for instance 7b6daa1b-e2ee-41a5-8476-d478101a4a2c {{(pid=98241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 02:15:26.920135 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-6f5b1a32-26ba-4f0e-a474-9a256d992bd0 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Successfully detached device vdb from instance 7b6daa1b-e2ee-41a5-8476-d478101a4a2c from the live domain config.
May 28 02:15:26.947354 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f5b1a32-26ba-4f0e-a474-9a256d992bd0 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] calling os-brick to detach iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 02:15:26.947633 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5b1a32-26ba-4f0e-a474-9a256d992bd0 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7724f8281df0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5', 'iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 02:15:26.947810 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6f5b1a32-26ba-4f0e-a474-9a256d992bd0 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 02:15:27.251669 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-ef169bd3-fa0c-4f59-8720-c072409203ae tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Lock "d77db397-a74c-4916-a215-ae19b63f90ec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.760s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:15:28.100406 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6f5b1a32-26ba-4f0e-a474-9a256d992bd0 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.152s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 02:15:28.100813 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5b1a32-26ba-4f0e-a474-9a256d992bd0 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5', 'iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 02:15:28.100903 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5b1a32-26ba-4f0e-a474-9a256d992bd0 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5', 0)] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 02:15:28.124746 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5b1a32-26ba-4f0e-a474-9a256d992bd0 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [230] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5 (non-flash)
May 28 02:15:28.124746 np0000001583 nova-compute[98241]: tcp: [231] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5 (non-flash)
May 28 02:15:28.124746 np0000001583 nova-compute[98241]: tcp: [232] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860 (non-flash)
May 28 02:15:28.124746 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 02:15:28.124942 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5b1a32-26ba-4f0e-a474-9a256d992bd0 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsi session list stdout=tcp: [230] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5 (non-flash)
May 28 02:15:28.124942 np0000001583 nova-compute[98241]: tcp: [231] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5 (non-flash)
May 28 02:15:28.124942 np0000001583 nova-compute[98241]: tcp: [232] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860 (non-flash)
May 28 02:15:28.124942 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 02:15:28.125026 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5b1a32-26ba-4f0e-a474-9a256d992bd0 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5', '230'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5', '231'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7650b5b9-d11a-49dc-8e6d-20070e724860', '232')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 02:15:28.125155 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5b1a32-26ba-4f0e-a474-9a256d992bd0 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5', '230')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:15:28.125937 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5b1a32-26ba-4f0e-a474-9a256d992bd0 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5', '231')] {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 02:15:28.126561 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5b1a32-26ba-4f0e-a474-9a256d992bd0 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7724ec1e8c20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5'): ({'sde'}, set())}) {{(pid=98241) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 02:15:28.126737 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6f5b1a32-26ba-4f0e-a474-9a256d992bd0 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Removing multipathed devices sdd, sde {{(pid=98241) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 02:15:28.126961 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6f5b1a32-26ba-4f0e-a474-9a256d992bd0 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Flush multipath device 330000000821582f9 {{(pid=98241) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 02:15:28.161216 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6f5b1a32-26ba-4f0e-a474-9a256d992bd0 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:15:28.212527 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6f5b1a32-26ba-4f0e-a474-9a256d992bd0 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98241) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 02:15:28.261360 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6f5b1a32-26ba-4f0e-a474-9a256d992bd0 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 02:15:28.261545 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6f5b1a32-26ba-4f0e-a474-9a256d992bd0 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 02:15:28.262464 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6f5b1a32-26ba-4f0e-a474-9a256d992bd0 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 02:15:28.273529 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.linuxscsi [None req-6f5b1a32-26ba-4f0e-a474-9a256d992bd0 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98241) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 02:15:28.273793 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5b1a32-26ba-4f0e-a474-9a256d992bd0 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5')] {{(pid=98241) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 02:15:28.284871 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5b1a32-26ba-4f0e-a474-9a256d992bd0 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:15:28.316237 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5b1a32-26ba-4f0e-a474-9a256d992bd0 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 230, target: iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5, portal: 192.168.40.100,3260]
May 28 02:15:28.316237 np0000001583 nova-compute[98241]: Logout of [sid: 230, target: iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5, portal: 192.168.40.100,3260] successful.
May 28 02:15:28.316237 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:15:28.328593 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5b1a32-26ba-4f0e-a474-9a256d992bd0 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:15:28.339234 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5b1a32-26ba-4f0e-a474-9a256d992bd0 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:15:28.375191 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5b1a32-26ba-4f0e-a474-9a256d992bd0 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 231, target: iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5, portal: 192.168.50.100,3260]
May 28 02:15:28.375191 np0000001583 nova-compute[98241]: Logout of [sid: 231, target: iqn.2023-03.storpool.com:os--volume-e7f7bdb6-a4c8-427c-a321-4d5e1c8854e5, portal: 192.168.50.100,3260] successful.
May 28 02:15:28.375191 np0000001583 nova-compute[98241]:  stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:15:28.387765 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5b1a32-26ba-4f0e-a474-9a256d992bd0 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98241) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 02:15:28.388046 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.base [None req-6f5b1a32-26ba-4f0e-a474-9a256d992bd0 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 02:15:28.388180 np0000001583 nova-compute[98241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5b1a32-26ba-4f0e-a474-9a256d992bd0 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] <== disconnect_volume: return (1440ms) None {{(pid=98241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 02:15:28.388304 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f5b1a32-26ba-4f0e-a474-9a256d992bd0 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Disconnected iSCSI Volume {{(pid=98241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 02:15:28.930753 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-6f5b1a32-26ba-4f0e-a474-9a256d992bd0 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lazy-loading 'flavor' on Instance uuid 7b6daa1b-e2ee-41a5-8476-d478101a4a2c {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:15:29.193211 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:15:29.194260 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:15:29.194260 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:15:29.898296 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:15:29.935558 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-6f5b1a32-26ba-4f0e-a474-9a256d992bd0 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "7b6daa1b-e2ee-41a5-8476-d478101a4a2c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.015s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:15:31.276289 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3b1b7674-bdbf-445a-bb63-afb2638d5b83 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "7b6daa1b-e2ee-41a5-8476-d478101a4a2c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:15:31.276289 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3b1b7674-bdbf-445a-bb63-afb2638d5b83 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "7b6daa1b-e2ee-41a5-8476-d478101a4a2c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:15:31.276289 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3b1b7674-bdbf-445a-bb63-afb2638d5b83 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "7b6daa1b-e2ee-41a5-8476-d478101a4a2c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:15:31.276289 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3b1b7674-bdbf-445a-bb63-afb2638d5b83 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "7b6daa1b-e2ee-41a5-8476-d478101a4a2c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:15:31.276289 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3b1b7674-bdbf-445a-bb63-afb2638d5b83 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "7b6daa1b-e2ee-41a5-8476-d478101a4a2c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:15:31.278539 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-3b1b7674-bdbf-445a-bb63-afb2638d5b83 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Terminating instance
May 28 02:15:31.781403 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-3b1b7674-bdbf-445a-bb63-afb2638d5b83 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Start destroying the instance on the hypervisor. {{(pid=98241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 02:15:31.803718 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:15:31.805298 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:15:31.818775 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:15:31.821470 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:15:31.833561 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:15:31.837994 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:15:31.937568 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f6ac45e9-1ddc-4b41-bd08-2f065fc22104 req-97b62b06-0608-4849-a22f-76e47135ec38 service nova] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Received event network-vif-unplugged-c06038a3-0d97-4e8b-9b86-57f1bd5c5f51 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:15:31.937756 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f6ac45e9-1ddc-4b41-bd08-2f065fc22104 req-97b62b06-0608-4849-a22f-76e47135ec38 service nova] Acquiring lock "7b6daa1b-e2ee-41a5-8476-d478101a4a2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:15:31.937995 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f6ac45e9-1ddc-4b41-bd08-2f065fc22104 req-97b62b06-0608-4849-a22f-76e47135ec38 service nova] Lock "7b6daa1b-e2ee-41a5-8476-d478101a4a2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:15:31.938179 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-f6ac45e9-1ddc-4b41-bd08-2f065fc22104 req-97b62b06-0608-4849-a22f-76e47135ec38 service nova] Lock "7b6daa1b-e2ee-41a5-8476-d478101a4a2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:15:31.938597 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f6ac45e9-1ddc-4b41-bd08-2f065fc22104 req-97b62b06-0608-4849-a22f-76e47135ec38 service nova] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] No waiting events found dispatching network-vif-unplugged-c06038a3-0d97-4e8b-9b86-57f1bd5c5f51 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:15:31.938786 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-f6ac45e9-1ddc-4b41-bd08-2f065fc22104 req-97b62b06-0608-4849-a22f-76e47135ec38 service nova] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Received event network-vif-unplugged-c06038a3-0d97-4e8b-9b86-57f1bd5c5f51 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:15:32.089465 np0000001583 nova-compute[98241]: DEBUG nova.utils [None req-cca5b0b6-a7b2-4c7f-8d3a-67cb9732d90b None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=14.999740529000064 future=<Future at 0x7724ec4e1f70 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:15:32.090478 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [-] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Instance destroyed successfully.
May 28 02:15:32.090853 np0000001583 nova-compute[98241]: DEBUG nova.objects.instance [None req-3b1b7674-bdbf-445a-bb63-afb2638d5b83 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lazy-loading 'resources' on Instance uuid 7b6daa1b-e2ee-41a5-8476-d478101a4a2c {{(pid=98241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 02:15:32.193272 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:15:32.193433 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 02:15:32.193634 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:15:32.593053 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.vif [None req-3b1b7674-bdbf-445a-bb63-afb2638d5b83 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T02:14:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1814078736',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001583',hostname='tempest-volumemultiattachtests-server-1814078736',id=81,image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsbyy7JdQzN4BiPWu1qHPp0Y0ooSVtuSNyfHNuCWHUvOc17UDfUFc7MeISc9lZmdBu5c3VvBWlIM0RfohHj9ig0+yvFEihRqr3KQPG6+4qb+RjOoC7dyNNrntcr16kUYA==',key_name='tempest-keypair-52718899',keypairs=<?>,launch_index=0,launched_at=2026-05-28T02:14:46Z,launched_on='np0000001583',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001583',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b993c740f0114a22b4ec01fd0172dc89',ramdisk_id='',reservation_id='r-6xek0rdi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3aa57a53-c080-4a55-ba67-d70bf1ef7690',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumeMultiattachTests-562724558',owner_user_name='tempest-VolumeMultiattachTests-562724558-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T02:14:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a89bef00d8034a63ac07ef521be03355',uuid=7b6daa1b-e2ee-41a5-8476-d478101a4a2c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c06038a3-0d97-4e8b-9b86-57f1bd5c5f51", "address": "fa:16:3e:f6:24:64", "network": {"id": "3b938343-a65c-4ea6-9c96-be377e9fe646", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-19450663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b993c740f0114a22b4ec01fd0172dc89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc06038a3-0d", "ovs_interfaceid": "c06038a3-0d97-4e8b-9b86-57f1bd5c5f51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 02:15:32.593589 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-3b1b7674-bdbf-445a-bb63-afb2638d5b83 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Converting VIF {"id": "c06038a3-0d97-4e8b-9b86-57f1bd5c5f51", "address": "fa:16:3e:f6:24:64", "network": {"id": "3b938343-a65c-4ea6-9c96-be377e9fe646", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-19450663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b993c740f0114a22b4ec01fd0172dc89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc06038a3-0d", "ovs_interfaceid": "c06038a3-0d97-4e8b-9b86-57f1bd5c5f51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 02:15:32.593839 np0000001583 nova-compute[98241]: DEBUG nova.network.os_vif_util [None req-3b1b7674-bdbf-445a-bb63-afb2638d5b83 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:24:64,bridge_name='br-int',has_traffic_filtering=True,id=c06038a3-0d97-4e8b-9b86-57f1bd5c5f51,network=Network(3b938343-a65c-4ea6-9c96-be377e9fe646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc06038a3-0d') {{(pid=98241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 02:15:32.594110 np0000001583 nova-compute[98241]: DEBUG os_vif [None req-3b1b7674-bdbf-445a-bb63-afb2638d5b83 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:24:64,bridge_name='br-int',has_traffic_filtering=True,id=c06038a3-0d97-4e8b-9b86-57f1bd5c5f51,network=Network(3b938343-a65c-4ea6-9c96-be377e9fe646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc06038a3-0d') {{(pid=98241) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 02:15:32.594915 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:15:32.595123 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc06038a3-0d, bridge=br-int, if_exists=True) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:15:32.596150 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:15:32.597297 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:15:32.597675 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 11 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:15:32.597817 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f09223bb-8086-471a-bf11-1280e494d762) {{(pid=98241) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 02:15:32.598229 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:15:32.598695 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:15:32.599218 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:15:32.600706 np0000001583 nova-compute[98241]: INFO os_vif [None req-3b1b7674-bdbf-445a-bb63-afb2638d5b83 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:24:64,bridge_name='br-int',has_traffic_filtering=True,id=c06038a3-0d97-4e8b-9b86-57f1bd5c5f51,network=Network(3b938343-a65c-4ea6-9c96-be377e9fe646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc06038a3-0d')
May 28 02:15:32.600956 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-3b1b7674-bdbf-445a-bb63-afb2638d5b83 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Deleting instance files /opt/stack/data/nova/instances/7b6daa1b-e2ee-41a5-8476-d478101a4a2c_del
May 28 02:15:32.601658 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.driver [None req-3b1b7674-bdbf-445a-bb63-afb2638d5b83 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Deletion of /opt/stack/data/nova/instances/7b6daa1b-e2ee-41a5-8476-d478101a4a2c_del complete
May 28 02:15:32.698827 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:15:32.698990 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:15:32.699164 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:15:32.699332 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Auditing locally available compute resources for np0000001583 (node: np0000001583) {{(pid=98241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 02:15:33.108558 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-3b1b7674-bdbf-445a-bb63-afb2638d5b83 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Took 1.33 seconds to destroy the instance on the hypervisor.
May 28 02:15:33.109089 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._common.loopingcall [None req-3b1b7674-bdbf-445a-bb63-afb2638d5b83 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98241) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 02:15:33.109400 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [-] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Deallocating network for instance {{(pid=98241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 02:15:33.109513 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] deallocate_for_instance() {{(pid=98241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 02:15:33.109767 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:15:33.204303 np0000001583 nova-compute[98241]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 02:15:33.585193 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-90cf49f8-7a90-4a85-9058-004f4a313d83 req-05447419-fd49-4d9e-8862-e58b28200a98 service nova] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Received event network-vif-deleted-c06038a3-0d97-4e8b-9b86-57f1bd5c5f51 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:15:33.585573 np0000001583 nova-compute[98241]: INFO nova.compute.manager [req-90cf49f8-7a90-4a85-9058-004f4a313d83 req-05447419-fd49-4d9e-8862-e58b28200a98 service nova] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Neutron deleted interface c06038a3-0d97-4e8b-9b86-57f1bd5c5f51; detaching it from the instance and deleting it from the info cache
May 28 02:15:33.587242 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-90cf49f8-7a90-4a85-9058-004f4a313d83 req-05447419-fd49-4d9e-8862-e58b28200a98 service nova] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Detach interface failed, port_id=c06038a3-0d97-4e8b-9b86-57f1bd5c5f51, reason: Instance 7b6daa1b-e2ee-41a5-8476-d478101a4a2c could not be found. {{(pid=98241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 02:15:33.718223 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Error from libvirt while getting description of instance-00000051: [Error Code 42] Domain not found: no domain with matching uuid '7b6daa1b-e2ee-41a5-8476-d478101a4a2c' (instance-00000051): libvirt.libvirtError: Domain not found: no domain with matching uuid '7b6daa1b-e2ee-41a5-8476-d478101a4a2c' (instance-00000051)
May 28 02:15:33.720514 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:15:33.721330 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:15:33.783019 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.061s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:15:33.783365 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Hypervisor/Node resource view: name=np0000001583 free_ram=13865MB free_disk=72.63255310058594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 02:15:33.783527 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:15:33.784169 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:15:33.997626 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-783c5d35-aebf-4e34-80db-891a99f316f6 req-3879d6c7-b122-4b12-a0e8-812bebf6695b service nova] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Received event network-vif-unplugged-c06038a3-0d97-4e8b-9b86-57f1bd5c5f51 {{(pid=98241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 02:15:33.997883 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-783c5d35-aebf-4e34-80db-891a99f316f6 req-3879d6c7-b122-4b12-a0e8-812bebf6695b service nova] Acquiring lock "7b6daa1b-e2ee-41a5-8476-d478101a4a2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:15:33.998177 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-783c5d35-aebf-4e34-80db-891a99f316f6 req-3879d6c7-b122-4b12-a0e8-812bebf6695b service nova] Lock "7b6daa1b-e2ee-41a5-8476-d478101a4a2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:15:33.998895 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [req-783c5d35-aebf-4e34-80db-891a99f316f6 req-3879d6c7-b122-4b12-a0e8-812bebf6695b service nova] Lock "7b6daa1b-e2ee-41a5-8476-d478101a4a2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:15:33.999072 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-783c5d35-aebf-4e34-80db-891a99f316f6 req-3879d6c7-b122-4b12-a0e8-812bebf6695b service nova] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] No waiting events found dispatching network-vif-unplugged-c06038a3-0d97-4e8b-9b86-57f1bd5c5f51 {{(pid=98241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 02:15:33.999250 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [req-783c5d35-aebf-4e34-80db-891a99f316f6 req-3879d6c7-b122-4b12-a0e8-812bebf6695b service nova] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Received event network-vif-unplugged-c06038a3-0d97-4e8b-9b86-57f1bd5c5f51 for instance with task_state deleting. {{(pid=98241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 02:15:34.037174 np0000001583 nova-compute[98241]: DEBUG nova.network.neutron [-] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Updating instance_info_cache with network_info: [] {{(pid=98241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 02:15:34.343008 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:15:34.361228 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.00044687999979942106 future=<Future at 0x7724f814e1e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:15:34.361667 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] Emitting event <LifecycleEvent: 1779934519.3606718, d77db397-a74c-4916-a215-ae19b63f90ec => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:15:34.361840 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] VM Stopped (Lifecycle Event)
May 28 02:15:34.362691 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:15:34.362808 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=12.726359423999838 future=<Future at 0x7724ec4e1f70 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:15:34.362890 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=12.72626957400007 future=<Future at 0x7724ec4e1f70 state=pending>) {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:15:34.539631 np0000001583 nova-compute[98241]: INFO nova.compute.manager [-] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Took 1.43 seconds to deallocate network for instance.
May 28 02:15:34.837814 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Instance 7b6daa1b-e2ee-41a5-8476-d478101a4a2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 02:15:34.838161 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 02:15:34.838161 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Final resource view: name=np0000001583 phys_ram=24030MB used_ram=704MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:15:33 up 51 min,  2 users,  load average: 2.39, 3.51, 4.24\n', 'num_instances': '1', 'num_vm_active': '1', 'num_task_deleting': '1', 'num_os_type_None': '1', 'num_proj_b993c740f0114a22b4ec01fd0172dc89': '1', 'io_workload': '0'} {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 02:15:34.866306 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-7643bae6-f772-4f10-9f06-676cfd609b3c tempest-VolumesBackupsTest-1928548083 tempest-VolumesBackupsTest-1928548083-project-member] [instance: d77db397-a74c-4916-a215-ae19b63f90ec] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:15:34.918656 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:15:34.918656 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:15:35.047666 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3b1b7674-bdbf-445a-bb63-afb2638d5b83 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:15:35.423197 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:15:35.931781 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Compute_service record updated for np0000001583:np0000001583 {{(pid=98241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 02:15:35.931781 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.148s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:15:35.932662 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3b1b7674-bdbf-445a-bb63-afb2638d5b83 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.885s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:15:35.932889 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:15:36.018632 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-3b1b7674-bdbf-445a-bb63-afb2638d5b83 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:15:36.018817 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-3b1b7674-bdbf-445a-bb63-afb2638d5b83 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:15:36.521524 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-3b1b7674-bdbf-445a-bb63-afb2638d5b83 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:15:37.027220 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3b1b7674-bdbf-445a-bb63-afb2638d5b83 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.095s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:15:37.071068 np0000001583 nova-compute[98241]: INFO nova.scheduler.client.report [None req-3b1b7674-bdbf-445a-bb63-afb2638d5b83 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Deleted allocations for instance 7b6daa1b-e2ee-41a5-8476-d478101a4a2c
May 28 02:15:37.599134 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:15:37.928518 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:15:37.928747 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:15:37.929016 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:15:37.929281 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.26 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:15:38.080771 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-3b1b7674-bdbf-445a-bb63-afb2638d5b83 tempest-VolumeMultiattachTests-562724558 tempest-VolumeMultiattachTests-562724558-project-member] Lock "7b6daa1b-e2ee-41a5-8476-d478101a4a2c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.805s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:15:39.517066 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:15:41.009504 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:15:41.189334 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:15:41.189644 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 47.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:15:42.600998 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:15:47.089580 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x77250229eea0>>, remaining_delay=-0.00035901799992643646 future=<Future at 0x7724ec4e1f70 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x772502576b40> {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:15:47.090037 np0000001583 nova-compute[98241]: DEBUG nova.virt.driver [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] Emitting event <LifecycleEvent: 1779934532.0891125, 7b6daa1b-e2ee-41a5-8476-d478101a4a2c => Stopped> {{(pid=98241) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 02:15:47.090193 np0000001583 nova-compute[98241]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98241) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:15:47.090324 np0000001583 nova-compute[98241]: INFO nova.compute.manager [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] VM Stopped (Lifecycle Event)
May 28 02:15:47.592781 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-f7c2bfb5-6a9f-449e-b711-07968ede0d65 tempest-TestVolumeBootPatternV346-884356236 tempest-TestVolumeBootPatternV346-884356236-project-member] [instance: 7b6daa1b-e2ee-41a5-8476-d478101a4a2c] Checking state {{(pid=98241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 02:15:47.604750 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:15:47.604750 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:15:47.604750 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:15:47.604750 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:15:47.613014 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:15:47.613014 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:15:52.614461 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:15:57.615625 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:16:02.616592 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:16:07.618190 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:16:12.619123 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:16:17.619714 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:16:17.620162 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:16:17.620162 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5000 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:16:17.620162 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:16:17.620411 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:16:17.620613 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:16:22.622102 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:16:27.623302 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:16:28.193118 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:16:28.193378 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:16:29.193181 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:16:29.193577 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:16:29.193700 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:16:32.193240 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:16:32.624840 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:16:32.697403 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:16:32.697551 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:16:32.697689 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:16:32.697824 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Auditing locally available compute resources for np0000001583 (node: np0000001583) {{(pid=98241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 02:16:32.715307 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:16:32.716971 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:16:32.769335 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.052s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:16:32.769667 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Hypervisor/Node resource view: name=np0000001583 free_ram=14044MB free_disk=72.62882995605469GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 02:16:32.769815 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:16:32.770130 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:16:33.817635 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 02:16:33.817985 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Final resource view: name=np0000001583 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:16:32 up 52 min,  2 users,  load average: 0.98, 2.91, 3.98\n'} {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 02:16:33.859622 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:16:33.859814 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:16:34.362197 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:16:34.868653 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Compute_service record updated for np0000001583:np0000001583 {{(pid=98241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 02:16:34.869155 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.099s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:16:34.869347 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:16:36.865182 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:16:36.865584 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:16:36.865584 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:16:36.865757 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:16:36.865882 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 02:16:36.866122 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 52.33 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:16:37.627461 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:16:42.628904 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:16:47.631252 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:16:52.632542 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:16:57.633056 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:17:02.634493 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:17:07.635643 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:17:12.636817 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:17:17.637379 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:17:22.638789 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:17:27.639726 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:17:29.193540 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:17:29.194138 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:17:31.193104 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:17:31.193532 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:17:31.193532 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:17:32.193308 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:17:32.641765 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:17:32.697980 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:17:32.698195 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:17:32.698370 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:17:32.698525 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Auditing locally available compute resources for np0000001583 (node: np0000001583) {{(pid=98241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 02:17:32.711753 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:17:32.712565 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:17:32.756852 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.044s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:17:32.757342 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Hypervisor/Node resource view: name=np0000001583 free_ram=14041MB free_disk=72.6200065612793GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 02:17:32.757580 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:17:32.757861 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:17:33.809511 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 02:17:33.809820 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Final resource view: name=np0000001583 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:17:32 up 53 min,  2 users,  load average: 0.69, 2.50, 3.77\n'} {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 02:17:33.856535 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:17:33.856762 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:17:34.345511 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:17:34.359470 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:17:34.866959 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Compute_service record updated for np0000001583:np0000001583 {{(pid=98241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 02:17:34.867410 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.109s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:17:34.867457 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:17:36.863226 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:17:36.863813 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:17:36.863813 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:17:36.863961 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 02:17:36.864317 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.33 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:17:37.193631 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:17:37.193864 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.99 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:17:37.643983 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:17:42.189220 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:17:42.189734 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 49.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:17:42.645949 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:17:47.647580 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:17:52.648156 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:17:57.649560 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:18:02.650519 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:18:07.652136 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:18:12.653945 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:18:17.655715 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:18:22.656671 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:18:27.657868 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:18:31.193043 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:18:31.193484 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:18:32.193191 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:18:32.193588 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:18:32.658287 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:18:33.193202 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:18:33.193670 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:18:33.698066 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:18:33.698066 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:18:33.698066 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:18:33.698066 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Auditing locally available compute resources for np0000001583 (node: np0000001583) {{(pid=98241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 02:18:33.708158 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:18:33.709115 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:18:33.753515 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.044s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:18:33.753931 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Hypervisor/Node resource view: name=np0000001583 free_ram=14037MB free_disk=72.61899185180664GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 02:18:33.754109 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:18:33.754392 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:18:34.801139 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 02:18:34.801139 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Final resource view: name=np0000001583 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:18:33 up 54 min,  2 users,  load average: 0.38, 2.07, 3.54\n'} {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 02:18:34.841200 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:18:34.841473 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:18:35.343855 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:18:35.850037 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Compute_service record updated for np0000001583:np0000001583 {{(pid=98241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 02:18:35.850370 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.096s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:18:35.850528 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:18:37.659170 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:18:37.846287 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:18:37.846549 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:18:37.846722 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:18:37.846906 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:18:37.847026 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 02:18:37.847229 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 54.35 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:18:42.660622 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:18:47.661538 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:18:52.662173 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:18:57.663664 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:19:02.664562 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:19:07.665952 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:19:12.668015 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:19:17.669148 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:19:22.670302 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:19:27.671493 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:19:32.193581 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:19:32.194133 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:19:32.672681 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:19:33.193177 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:19:33.193387 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:19:33.193617 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:19:34.193240 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:19:34.348301 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:19:34.697822 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:19:34.698021 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:19:34.698145 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:19:34.698263 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Auditing locally available compute resources for np0000001583 (node: np0000001583) {{(pid=98241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 02:19:34.709323 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:19:34.710003 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:19:34.753708 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.043s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:19:34.754050 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Hypervisor/Node resource view: name=np0000001583 free_ram=14048MB free_disk=72.61795806884766GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 02:19:34.754264 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:19:34.754554 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:19:35.802591 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 02:19:35.802951 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Final resource view: name=np0000001583 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:19:34 up 55 min,  2 users,  load average: 0.24, 1.72, 3.33\n'} {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 02:19:35.843524 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:19:35.843786 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:19:36.346632 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:19:36.852434 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Compute_service record updated for np0000001583:np0000001583 {{(pid=98241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 02:19:36.852434 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.098s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:19:36.852896 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.34 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:19:37.673161 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:19:38.193552 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:19:38.194132 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:19:38.194132 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:19:38.194132 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:19:38.194349 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 02:19:38.194520 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:19:38.194651 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Cleaning up deleted instances {{(pid=98241) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}}
May 28 02:19:38.697019 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] There are 0 instances to clean {{(pid=98241) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}}
May 28 02:19:38.697273 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 7.50 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:19:42.674130 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:19:46.193504 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:19:46.194905 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:19:46.194905 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98241) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}}
May 28 02:19:46.696458 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 12.50 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:19:47.675178 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:19:52.676347 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:19:57.677671 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:19:59.193984 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:19:59.695912 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 8.11 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:20:02.678311 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:20:07.678899 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:20:07.804095 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:20:07.806038 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.99 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:20:09.801236 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:20:10.304622 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 24.39 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:20:12.680063 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:20:17.681209 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:20:22.682463 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:20:27.683233 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:20:32.684819 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:20:34.696605 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:20:34.697066 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.50 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:20:35.193209 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:20:35.193429 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:20:35.193632 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:20:36.189523 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:20:36.190033 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:20:36.193049 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:20:36.697624 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:20:36.697842 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:20:36.698015 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:20:36.698200 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Auditing locally available compute resources for np0000001583 (node: np0000001583) {{(pid=98241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 02:20:36.709874 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:20:36.710783 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:20:36.758013 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.047s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:20:36.758413 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Hypervisor/Node resource view: name=np0000001583 free_ram=14045MB free_disk=72.61690139770508GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 02:20:36.758576 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:20:36.758808 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:20:37.686292 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:20:37.925875 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 02:20:37.926034 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Final resource view: name=np0000001583 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:20:36 up 56 min,  2 users,  load average: 0.31, 1.48, 3.14\n'} {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 02:20:37.965658 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Refreshing inventories for resource provider cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 28 02:20:38.005176 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Updating ProviderTree inventory for provider cfa1af79-477d-460a-869d-84a19fa91765 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 28 02:20:38.005324 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Updating inventory in ProviderTree for provider cfa1af79-477d-460a-869d-84a19fa91765 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 28 02:20:38.042647 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Refreshing aggregate associations for resource provider cfa1af79-477d-460a-869d-84a19fa91765, aggregates: None {{(pid=98241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 28 02:20:38.085835 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Refreshing trait associations for resource provider cfa1af79-477d-460a-869d-84a19fa91765, traits: COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_NET_VIF_MODEL_IGB,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_ARCH_AARCH64,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_ARCH_S390X,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ARCH_MIPSEL,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,COMPUTE_SOUND_MODEL_USB,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ARCH_X86_64,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ARCH_RISCV64,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ARCH_PPC64LE,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_SOUND_MODEL_SB16,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_SOUND_MODEL_AC97,COMPUTE_RESCUE_BFV,HW_ARCH_X86_64,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=98241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 28 02:20:38.126687 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:20:38.126880 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:20:38.629546 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:20:39.138889 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Compute_service record updated for np0000001583:np0000001583 {{(pid=98241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 02:20:39.139395 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.380s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:20:39.139574 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:20:41.139634 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:20:41.140049 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:20:41.140049 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:20:41.140156 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 02:20:41.140337 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 55.05 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:20:42.687147 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:20:47.688359 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:20:52.689597 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:20:57.690365 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:21:02.690908 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:21:07.691133 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:21:12.692282 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:21:17.693356 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:21:22.694681 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:21:27.694782 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:21:32.696454 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:21:34.350798 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:21:36.189687 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:21:36.190166 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:21:36.192834 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:21:36.193009 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:21:36.193219 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:21:36.193428 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:21:37.193483 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:21:37.698822 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:21:37.699211 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:21:37.699608 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:21:37.699831 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:21:37.700067 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Auditing locally available compute resources for np0000001583 (node: np0000001583) {{(pid=98241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 02:21:37.712483 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:21:37.713387 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:21:37.760783 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.047s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:21:37.761190 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Hypervisor/Node resource view: name=np0000001583 free_ram=14042MB free_disk=72.61585998535156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 02:21:37.761377 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:21:37.761650 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:21:38.809880 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 02:21:38.810345 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Final resource view: name=np0000001583 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:21:37 up 57 min,  2 users,  load average: 0.25, 1.22, 2.94\n'} {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 02:21:38.854042 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:21:38.854351 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:21:39.356874 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:21:39.863049 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Compute_service record updated for np0000001583:np0000001583 {{(pid=98241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 02:21:39.863538 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.102s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:21:39.863538 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:21:40.863680 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:21:40.864715 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:21:40.865143 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:21:40.865428 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 02:21:40.865769 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 7.32 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:21:42.700463 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:21:47.705344 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:21:47.705868 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:21:47.705868 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:21:47.705868 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:21:47.710907 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:21:47.711061 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:21:48.191299 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:21:48.191649 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 48.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:21:52.716313 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:21:52.716799 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:21:52.716799 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:21:52.716799 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:21:52.718431 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:21:52.718699 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:21:57.740580 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:22:02.744200 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:22:02.744742 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:22:02.744742 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:22:02.744742 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:22:02.755551 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:22:02.755732 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:22:07.757759 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:22:07.757759 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:22:07.757759 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:22:07.757759 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:22:07.775123 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:22:07.775312 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:22:12.793906 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:22:17.799811 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:22:17.800330 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:22:17.800330 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:22:17.800330 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:22:17.804200 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:22:17.804382 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:22:22.809610 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:22:22.810135 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:22:22.810135 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:22:22.810135 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:22:22.815413 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:22:22.815563 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:22:27.816867 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:22:27.817352 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:22:27.817352 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:22:27.817352 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:22:27.822777 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:22:27.822950 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:22:32.825765 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:22:32.825765 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:22:32.825765 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:22:32.825765 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:22:32.830107 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:22:32.830174 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:22:36.193206 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:22:36.193681 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:22:36.193681 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:22:37.189501 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:22:37.189835 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:22:37.831022 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:22:38.193295 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:22:38.193538 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:22:38.697660 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:22:38.697978 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:22:38.698046 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:22:38.698260 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Auditing locally available compute resources for np0000001583 (node: np0000001583) {{(pid=98241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 02:22:38.711275 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:22:38.712007 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:22:38.762443 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.050s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:22:38.762783 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Hypervisor/Node resource view: name=np0000001583 free_ram=14027MB free_disk=72.61352157592773GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 02:22:38.763012 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:22:38.763196 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:22:39.811375 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 02:22:39.811709 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Final resource view: name=np0000001583 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:22:38 up 58 min,  2 users,  load average: 0.09, 0.99, 2.75\n'} {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 02:22:39.855260 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:22:39.855467 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:22:40.358057 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:22:40.864028 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Compute_service record updated for np0000001583:np0000001583 {{(pid=98241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 02:22:40.864459 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.101s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:22:40.864512 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:22:41.864277 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:22:41.864939 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:22:41.865323 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:22:41.865323 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 02:22:41.865647 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 56.32 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:22:42.838038 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:22:42.838038 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:22:42.838038 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:22:42.838038 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:22:42.838770 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:22:42.839004 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:22:47.847467 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:22:52.852145 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:22:52.852639 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:22:52.852639 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:22:52.852639 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:22:52.856723 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:22:52.856809 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:22:57.869873 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:23:02.870922 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:23:02.871309 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:23:02.871309 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5000 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:23:02.871309 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:23:02.883139 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:23:02.883276 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:23:07.885815 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:23:07.886332 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:23:07.886332 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:23:07.886332 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:23:07.894335 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:23:07.894456 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:23:12.896223 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:23:12.896223 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:23:12.896223 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:23:12.896223 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:23:12.909858 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:23:12.909939 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:23:17.932008 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:23:22.943774 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:23:22.944275 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:23:22.944275 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5011 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:23:22.944275 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:23:22.944511 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:23:22.944692 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:23:27.959747 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:23:27.959747 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:23:27.959747 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:23:27.959747 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:23:27.960393 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:23:27.960455 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:23:32.975440 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:23:34.353061 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:23:37.979048 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:23:37.979048 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:23:37.979048 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:23:37.979048 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:23:37.992550 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:23:37.992743 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:23:38.190296 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:23:38.190605 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:23:38.192890 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:23:38.193123 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:23:38.193324 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:23:38.193523 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:23:38.698853 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:23:38.699013 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:23:38.699135 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:23:38.699257 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Auditing locally available compute resources for np0000001583 (node: np0000001583) {{(pid=98241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 02:23:38.711404 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:23:38.712069 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:23:38.757889 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.045s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:23:38.758276 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Hypervisor/Node resource view: name=np0000001583 free_ram=14044MB free_disk=72.6125373840332GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 02:23:38.758441 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:23:38.758644 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:23:39.805210 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 02:23:39.805514 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Final resource view: name=np0000001583 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:23:38 up 59 min,  2 users,  load average: 0.09, 0.83, 2.58\n'} {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 02:23:39.847257 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:23:39.847514 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:23:40.349809 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:23:40.855494 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Compute_service record updated for np0000001583:np0000001583 {{(pid=98241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 02:23:40.855802 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.097s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:23:40.855932 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:23:42.855762 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:23:42.856471 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:23:42.856471 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:23:42.856471 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 02:23:42.856677 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 10.33 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:23:43.008965 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:23:48.014554 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:23:48.014554 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:23:48.014554 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:23:48.014554 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:23:48.027953 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:23:48.028220 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:23:53.048070 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:23:53.048599 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:23:53.048599 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5020 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:23:53.048599 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:23:53.048599 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:23:53.048599 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:23:53.189979 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:23:53.190331 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 45.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:23:58.055854 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:23:58.055854 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:23:58.055854 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:23:58.055854 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:23:58.056431 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:23:58.056618 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:24:03.061789 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:24:03.062328 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:24:03.062328 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:24:03.062328 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:24:03.077553 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:24:03.077782 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:24:08.078222 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:24:08.078759 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:24:08.078759 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5000 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:24:08.078759 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:24:08.090739 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:24:08.090970 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:24:13.105836 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:24:18.111380 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:24:18.111899 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:24:18.111899 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:24:18.111899 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:24:18.117860 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:24:18.117996 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:24:23.123241 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:24:23.123736 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:24:23.123736 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:24:23.123736 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:24:23.129125 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:24:23.129323 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:24:28.134761 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:24:28.134761 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:24:28.134761 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:24:28.134761 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:24:28.153892 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:24:28.153892 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:24:33.162637 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:24:33.162637 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:24:33.163121 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5008 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:24:33.163121 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:24:33.163121 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:24:33.163442 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:24:38.172510 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:24:38.172510 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:24:38.172510 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:24:38.172510 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:24:38.173041 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:24:38.173041 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:24:38.193092 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:24:38.193291 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:24:38.193492 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:24:38.697496 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:24:38.697702 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:24:38.697781 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:24:38.697900 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Auditing locally available compute resources for np0000001583 (node: np0000001583) {{(pid=98241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 02:24:38.708936 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:24:38.709613 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:24:38.753208 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.043s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:24:38.753672 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Hypervisor/Node resource view: name=np0000001583 free_ram=14033MB free_disk=72.60372924804688GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 02:24:38.753833 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:24:38.754058 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:24:39.802419 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 02:24:39.802885 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Final resource view: name=np0000001583 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:24:38 up  1:00,  2 users,  load average: 0.11, 0.70, 2.43\n'} {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 02:24:39.843192 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:24:39.843400 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:24:40.345794 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:24:40.851963 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Compute_service record updated for np0000001583:np0000001583 {{(pid=98241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 02:24:40.852418 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.098s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:24:40.852624 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:24:41.848487 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:24:41.848737 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:24:41.848949 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:24:41.849143 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:24:41.849359 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.34 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:24:42.193520 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:24:42.193896 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Cleaning up deleted instances {{(pid=98241) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}}
May 28 02:24:42.695680 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] There are 0 instances to clean {{(pid=98241) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}}
May 28 02:24:42.695916 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:24:43.183379 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:24:43.695668 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:24:43.696161 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 02:24:43.696161 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.50 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:24:47.194124 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:24:47.194124 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98241) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}}
May 28 02:24:47.695362 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 17.50 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:24:48.185363 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:24:48.185589 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:24:48.185722 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:24:48.185765 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:24:48.195320 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:24:48.195666 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:24:53.198937 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:24:53.198937 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:24:53.198937 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:24:53.198937 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:24:53.205970 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:24:53.205970 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:24:58.222540 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:24:58.222991 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:24:58.222991 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5016 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:24:58.222991 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:24:58.223157 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:24:58.223197 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:25:03.235564 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:25:03.235564 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:25:03.235564 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:25:03.235564 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:25:03.236151 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:25:03.236151 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:25:05.193780 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:25:05.695529 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 33.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:25:08.241446 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:25:08.241446 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:25:08.241446 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:25:08.241946 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:25:08.245387 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:25:08.245387 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:25:13.246007 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:25:13.246007 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:25:13.246007 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5000 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:25:13.246007 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:25:13.258509 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:25:13.258509 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:25:18.260810 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:25:18.260810 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:25:18.260810 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:25:18.260810 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:25:18.279578 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:25:18.279578 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:25:23.291624 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:25:28.303735 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:25:28.304278 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:25:28.304278 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5012 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:25:28.304278 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:25:28.304278 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:25:28.304475 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:25:33.310997 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:25:34.355060 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:25:38.316373 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:25:38.316816 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:25:38.316816 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:25:38.316816 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:25:38.322151 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:25:38.322286 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:25:38.694942 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:25:38.695252 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.49 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:25:39.191158 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:25:39.191158 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:25:39.192932 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:25:39.193146 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:25:39.193370 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:25:40.193220 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:25:40.193726 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:25:40.696935 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:25:40.697127 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:25:40.697242 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:25:40.697363 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Auditing locally available compute resources for np0000001583 (node: np0000001583) {{(pid=98241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 02:25:40.708017 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:25:40.708668 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:25:40.754348 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.045s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:25:40.754726 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Hypervisor/Node resource view: name=np0000001583 free_ram=14040MB free_disk=72.60269165039062GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 02:25:40.754900 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:25:40.755194 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:25:41.880519 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 02:25:41.880836 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Final resource view: name=np0000001583 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:25:40 up  1:01,  2 users,  load average: 0.25, 0.63, 2.29\n'} {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 02:25:41.920189 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Refreshing inventories for resource provider cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 28 02:25:41.957205 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Updating ProviderTree inventory for provider cfa1af79-477d-460a-869d-84a19fa91765 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 28 02:25:41.957355 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Updating inventory in ProviderTree for provider cfa1af79-477d-460a-869d-84a19fa91765 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 28 02:25:41.992285 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Refreshing aggregate associations for resource provider cfa1af79-477d-460a-869d-84a19fa91765, aggregates: None {{(pid=98241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 28 02:25:42.035370 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Refreshing trait associations for resource provider cfa1af79-477d-460a-869d-84a19fa91765, traits: COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_NET_VIF_MODEL_IGB,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_ARCH_AARCH64,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_ARCH_S390X,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ARCH_MIPSEL,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,COMPUTE_SOUND_MODEL_USB,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ARCH_X86_64,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ARCH_RISCV64,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ARCH_PPC64LE,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_SOUND_MODEL_SB16,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_SOUND_MODEL_AC97,COMPUTE_RESCUE_BFV,HW_ARCH_X86_64,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=98241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 28 02:25:42.075220 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:25:42.075435 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:25:42.577770 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:25:43.083769 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Compute_service record updated for np0000001583:np0000001583 {{(pid=98241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 02:25:43.084123 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.329s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:25:43.084219 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:25:43.327184 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:25:43.327423 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:25:43.327505 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:25:43.327555 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:25:43.343371 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:25:43.343524 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:25:44.084268 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:25:44.084568 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:25:44.084674 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 02:25:44.084798 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 11.10 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:25:48.348680 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:25:48.349333 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:25:48.349684 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:25:48.349684 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:25:48.356567 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:25:48.356683 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:25:53.361874 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:25:53.362339 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:25:53.362339 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:25:53.362339 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:25:53.368871 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:25:53.368871 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:25:55.189663 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:25:55.190180 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 44.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:25:58.369975 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:26:03.375358 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:26:03.377143 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:26:03.377143 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:26:03.377143 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:26:03.377143 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:26:03.377143 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:26:08.381802 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:26:08.381802 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:26:08.381802 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:26:08.381802 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:26:08.383546 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:26:08.383741 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:26:13.386599 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:26:13.386599 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:26:13.386599 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:26:13.386599 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:26:13.397871 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:26:13.397871 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:26:18.403519 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:26:18.403519 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:26:18.403519 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:26:18.403519 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:26:18.407809 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:26:18.407963 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:26:23.423153 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:26:23.423153 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:26:23.423153 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5015 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:26:23.423714 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:26:23.423714 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:26:23.423838 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:26:28.429187 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:26:28.429628 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:26:28.429628 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:26:28.429628 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:26:28.442104 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:26:28.442363 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:26:33.443237 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:26:33.443823 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:26:33.443823 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:26:33.443823 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:26:33.451309 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:26:33.451471 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:26:38.456700 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:26:38.457265 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:26:38.457265 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:26:38.457265 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:26:38.477511 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:26:38.477691 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:26:39.193206 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:26:39.193489 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:26:39.193771 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:26:40.193281 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:26:40.193839 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:26:40.697294 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:26:40.697450 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:26:40.697567 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:26:40.697688 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Auditing locally available compute resources for np0000001583 (node: np0000001583) {{(pid=98241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 02:26:40.708363 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:26:40.709067 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:26:40.752493 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.043s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:26:40.752840 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Hypervisor/Node resource view: name=np0000001583 free_ram=14043MB free_disk=72.60166931152344GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 02:26:40.753064 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:26:40.753265 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:26:41.798787 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 02:26:41.799097 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Final resource view: name=np0000001583 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:26:40 up  1:02,  2 users,  load average: 0.18, 0.55, 2.16\n'} {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 02:26:41.841894 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:26:41.842129 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:26:42.344645 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:26:42.851066 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Compute_service record updated for np0000001583:np0000001583 {{(pid=98241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 02:26:42.851516 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.098s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:26:42.851638 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:26:43.479064 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:26:43.847624 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:26:43.847935 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:26:43.848223 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:26:43.848563 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.34 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:26:44.193359 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:26:44.193760 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 02:26:44.193760 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 55.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:26:48.480885 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:26:48.481409 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:26:48.481409 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:26:48.481409 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:26:48.491975 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:26:48.492370 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:26:53.505226 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:26:58.506795 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:27:03.511381 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:27:03.511895 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:27:03.511895 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:27:03.511895 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:27:03.522551 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:27:03.522733 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:27:08.527355 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:27:08.528283 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:27:08.528283 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:27:08.528283 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:27:08.538730 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:27:08.538894 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:27:13.540305 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:27:18.542913 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:27:18.543397 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:27:18.543397 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:27:18.543397 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:27:18.553073 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:27:18.553330 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:27:23.553642 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:27:23.554196 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:27:23.554196 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5000 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:27:23.554196 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:27:23.561208 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:27:23.561396 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:27:28.566186 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:27:28.566653 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:27:28.566653 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:27:28.566653 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:27:28.581561 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:27:28.581786 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:27:33.583466 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:27:33.583950 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:27:33.583950 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:27:33.583950 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:27:33.592950 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:27:33.592950 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:27:34.357362 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:27:38.594148 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:27:39.193703 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:27:39.193936 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:27:41.193192 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:27:41.193642 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:27:41.193642 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:27:41.698215 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:27:41.698453 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:27:41.698667 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:27:41.698852 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Auditing locally available compute resources for np0000001583 (node: np0000001583) {{(pid=98241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 02:27:41.712906 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:27:41.713734 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:27:41.758704 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.044s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:27:41.759169 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Hypervisor/Node resource view: name=np0000001583 free_ram=14042MB free_disk=72.60064697265625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 02:27:41.759367 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:27:41.759678 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:27:42.807017 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 02:27:42.807338 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Final resource view: name=np0000001583 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:27:41 up  1:03,  2 users,  load average: 0.23, 0.49, 2.04\n'} {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 02:27:42.849036 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:27:42.849315 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:27:43.351942 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:27:43.598066 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:27:43.598298 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:27:43.598365 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:27:43.598432 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:27:43.605011 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:27:43.605208 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:27:43.857783 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Compute_service record updated for np0000001583:np0000001583 {{(pid=98241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 02:27:43.858175 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.098s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:27:43.858175 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:27:44.853959 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:27:44.854209 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:27:44.854416 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:27:44.854658 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.34 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:27:46.193371 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:27:46.193774 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 02:27:46.193774 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 10.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:27:48.610819 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:27:48.610819 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:27:48.610819 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:27:48.610819 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:27:48.622406 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:27:48.622630 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:27:53.628102 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:27:53.628102 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:27:53.628102 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:27:53.628102 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:27:53.630723 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:27:53.630723 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:27:56.189511 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:27:56.190473 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 43.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:27:58.644613 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:28:03.646992 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:28:03.646992 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:28:03.646992 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:28:03.646992 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:28:03.658958 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:28:03.659036 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:28:08.664147 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:28:08.664732 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:28:08.664732 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:28:08.664732 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:28:08.669121 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:28:08.669318 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:28:13.684101 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:28:13.684746 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:28:13.684746 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5015 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:28:13.684746 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:28:13.684746 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:28:13.684949 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:28:18.690322 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:28:18.690322 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:28:18.690760 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:28:18.690760 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:28:18.699333 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:28:18.699438 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:28:23.707247 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:28:23.707247 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:28:23.707247 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:28:23.707247 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:28:23.707885 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:28:23.707885 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:28:28.712907 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:28:28.713421 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:28:28.713421 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:28:28.713421 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:28:28.723799 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:28:28.723963 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:28:33.732661 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:28:33.732661 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:28:33.732661 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:28:33.732661 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:28:33.733292 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:28:33.733292 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:28:38.733974 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:28:39.193413 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:28:39.193671 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:28:41.193459 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:28:41.193949 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:28:41.193992 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:28:42.193207 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:28:42.193428 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:28:43.193252 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:28:43.194693 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:28:43.699145 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:28:43.699403 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:28:43.699403 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:28:43.699481 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Auditing locally available compute resources for np0000001583 (node: np0000001583) {{(pid=98241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 02:28:43.710375 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:28:43.711122 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:28:43.739866 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:28:43.740585 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:28:43.740776 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5006 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:28:43.740938 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:28:43.746380 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:28:43.746535 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:28:43.756236 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.045s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:28:43.756593 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Hypervisor/Node resource view: name=np0000001583 free_ram=14039MB free_disk=72.599609375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 02:28:43.756746 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:28:43.756987 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:28:44.804629 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 02:28:44.804947 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Final resource view: name=np0000001583 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:28:43 up  1:04,  2 users,  load average: 0.22, 0.44, 1.91\n'} {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 02:28:44.847858 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:28:44.848120 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:28:45.350549 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:28:45.857136 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Compute_service record updated for np0000001583:np0000001583 {{(pid=98241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 02:28:45.857458 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.100s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:28:45.857550 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:28:46.853441 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:28:46.853825 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.34 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:28:47.193162 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:28:47.193493 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 02:28:47.194343 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 21.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:28:48.751701 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:28:48.751701 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:28:48.751701 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:28:48.751701 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:28:48.757551 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:28:48.757706 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:28:51.882138 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:28:52.896950 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:28:53.759254 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:28:58.761564 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:29:03.763431 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:29:03.763982 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:29:03.763982 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:29:03.763982 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:29:03.778148 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:29:03.778332 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:29:08.193594 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:29:08.194112 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:29:08.194234 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:29:08.194517 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:29:08.194644 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:29:08.194842 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:29:08.195053 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:29:08.784098 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:29:08.784098 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:29:08.784098 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:29:08.784098 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:29:08.787586 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:29:08.787786 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:29:09.198991 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.imagecache [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Verify base images {{(pid=98241) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
May 28 02:29:09.199518 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.imagecache [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/86d7e6d4e86a0e87924f99c68e18f84e62b7eeb2
May 28 02:29:09.199518 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.imagecache [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/68eb2642ce949fc71df161507beab4c8318cb427
May 28 02:29:09.199518 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.imagecache [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/5ff04dfbf78a91fdd2fa92ad36c8b3d1c67b2990
May 28 02:29:09.199649 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.imagecache [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/217de507a86b423465a151d274036e35e7d64e07
May 28 02:29:09.199764 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.imagecache [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899
May 28 02:29:09.199900 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.imagecache [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/a33b178235b2834843c883f14aa71de50d42329d
May 28 02:29:09.200051 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.imagecache [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/e818dcc4c16250e7a92d5e7941fabccdfcdc862c
May 28 02:29:09.200221 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.imagecache [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/53568087b7f6756103af21d4fcdbe387ad32abe4
May 28 02:29:09.200355 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.imagecache [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/e27f461ed4738d95f9590de1f4c12a3363ed8cbd
May 28 02:29:09.200585 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.imagecache [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/0d77f92dafdba4f1aba5f55dc4fe581b87a56861
May 28 02:29:09.200647 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.imagecache [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/5fae241bec13d6964e7b7236331e2a2426e51f84
May 28 02:29:09.200810 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.imagecache [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Removable base files: /opt/stack/data/nova/instances/_base/86d7e6d4e86a0e87924f99c68e18f84e62b7eeb2 /opt/stack/data/nova/instances/_base/68eb2642ce949fc71df161507beab4c8318cb427 /opt/stack/data/nova/instances/_base/5ff04dfbf78a91fdd2fa92ad36c8b3d1c67b2990 /opt/stack/data/nova/instances/_base/217de507a86b423465a151d274036e35e7d64e07 /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899 /opt/stack/data/nova/instances/_base/a33b178235b2834843c883f14aa71de50d42329d /opt/stack/data/nova/instances/_base/e818dcc4c16250e7a92d5e7941fabccdfcdc862c /opt/stack/data/nova/instances/_base/53568087b7f6756103af21d4fcdbe387ad32abe4 /opt/stack/data/nova/instances/_base/e27f461ed4738d95f9590de1f4c12a3363ed8cbd /opt/stack/data/nova/instances/_base/0d77f92dafdba4f1aba5f55dc4fe581b87a56861 /opt/stack/data/nova/instances/_base/5fae241bec13d6964e7b7236331e2a2426e51f84
May 28 02:29:09.201469 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.imagecache [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/86d7e6d4e86a0e87924f99c68e18f84e62b7eeb2
May 28 02:29:09.201648 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.imagecache [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/68eb2642ce949fc71df161507beab4c8318cb427
May 28 02:29:09.201819 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.imagecache [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5ff04dfbf78a91fdd2fa92ad36c8b3d1c67b2990
May 28 02:29:09.202007 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.imagecache [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/217de507a86b423465a151d274036e35e7d64e07
May 28 02:29:09.202199 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.imagecache [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9d60daaad2450df78b710eabbb81da4840745899
May 28 02:29:09.202363 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.imagecache [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a33b178235b2834843c883f14aa71de50d42329d
May 28 02:29:09.202528 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.imagecache [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e818dcc4c16250e7a92d5e7941fabccdfcdc862c
May 28 02:29:09.202691 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.imagecache [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/53568087b7f6756103af21d4fcdbe387ad32abe4
May 28 02:29:09.202854 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.imagecache [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e27f461ed4738d95f9590de1f4c12a3363ed8cbd
May 28 02:29:09.203028 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.imagecache [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0d77f92dafdba4f1aba5f55dc4fe581b87a56861
May 28 02:29:09.203207 np0000001583 nova-compute[98241]: INFO nova.virt.libvirt.imagecache [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5fae241bec13d6964e7b7236331e2a2426e51f84
May 28 02:29:09.203339 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.imagecache [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Verification complete {{(pid=98241) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
May 28 02:29:09.203475 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.imagecache [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Verify swap images {{(pid=98241) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
May 28 02:29:09.203606 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.imagecache [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Verify ephemeral images {{(pid=98241) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
May 28 02:29:09.203856 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 31.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:29:13.789179 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:29:18.789890 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:29:23.795232 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:29:23.795743 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:29:23.795743 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:29:23.795743 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:29:23.800210 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:29:23.800376 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:29:28.801278 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:29:33.810668 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:29:34.359666 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:29:38.811526 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:29:40.203577 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:29:40.203989 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:29:41.193489 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:29:41.193800 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:29:42.193114 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:29:42.193538 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:29:43.193496 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:29:43.193923 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:29:43.194061 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:29:43.816935 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:29:43.817210 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:29:43.817210 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:29:43.817210 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:29:43.819618 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:29:43.819766 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:29:45.193277 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:29:45.697938 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:29:45.698282 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:29:45.698358 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:29:45.698545 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Auditing locally available compute resources for np0000001583 (node: np0000001583) {{(pid=98241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 02:29:45.710003 np0000001583 nova-compute[98241]: WARNING nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:29:45.710688 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:29:45.754931 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.processutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.044s {{(pid=98241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:29:45.755376 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Hypervisor/Node resource view: name=np0000001583 free_ram=14232MB free_disk=72.59538650512695GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 02:29:45.755582 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:29:45.755899 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:29:46.806511 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 02:29:46.806921 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Final resource view: name=np0000001583 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:29:45 up  1:05,  1 user,  load average: 0.24, 0.41, 1.81\n'} {{(pid=98241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 02:29:46.849735 np0000001583 nova-compute[98241]: DEBUG nova.virt.libvirt.driver [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98241) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:29:46.850047 np0000001583 nova-compute[98241]: DEBUG nova.compute.provider_tree [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed in ProviderTree for provider: cfa1af79-477d-460a-869d-84a19fa91765 {{(pid=98241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:29:47.352930 np0000001583 nova-compute[98241]: DEBUG nova.scheduler.client.report [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Inventory has not changed for provider cfa1af79-477d-460a-869d-84a19fa91765 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:29:47.859533 np0000001583 nova-compute[98241]: DEBUG nova.compute.resource_tracker [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Compute_service record updated for np0000001583:np0000001583 {{(pid=98241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 02:29:47.859909 np0000001583 nova-compute[98241]: DEBUG oslo_concurrency.lockutils [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.104s {{(pid=98241) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:29:47.860026 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:29:48.825233 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:29:48.825527 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:29:48.825602 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:29:48.825684 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:29:48.830906 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:29:48.831112 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:29:48.855807 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:29:48.856060 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:29:48.856218 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 02:29:48.856433 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.34 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:29:51.193495 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:29:51.193989 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Cleaning up deleted instances {{(pid=98241) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}}
May 28 02:29:51.695768 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] There are 0 instances to clean {{(pid=98241) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}}
May 28 02:29:51.696190 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.50 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:29:53.831347 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:29:53.831780 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:29:53.831780 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5000 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:29:53.831780 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:29:53.848341 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:29:53.848562 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:29:54.193822 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:29:54.193961 np0000001583 nova-compute[98241]: DEBUG nova.compute.manager [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98241) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}}
May 28 02:29:54.696307 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 5.99 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:29:58.849654 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:30:00.691681 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:30:00.692477 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 15.50 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:30:03.854711 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:30:03.855315 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:30:03.855315 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:30:03.855315 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:30:03.857420 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:30:03.857573 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:30:08.863247 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:30:08.863247 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:30:08.863247 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:30:08.863247 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:30:08.867821 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:30:08.867821 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:30:13.871914 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:30:13.872411 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 02:30:13.872411 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=98241) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 02:30:13.872411 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:30:13.877008 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98241) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 02:30:13.877008 np0000001583 nova-compute[98241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98241) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 02:30:16.193566 np0000001583 nova-compute[98241]: DEBUG oslo_service.periodic_task [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98241) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:30:16.695287 np0000001583 nova-compute[98241]: DEBUG oslo.service.backend._threading.loopingcall [None req-9ddf0a04-5bdb-4033-b047-07c737df20b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 18.61 seconds {{(pid=98241) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}